[D 16:19:37.030212] [INFO]: Mapping pointer 0x4000024d000 for I/O.
[D 16:19:37.037302] [INFO]: Mapping pointer 0x4000164f000 for I/O.
[E 16:19:37.040205] Warning: openib_new_connection: asked for 70 send WRs on QP, got 0.
[E 16:20:36.979462] Warning: openib_new_connection: asked for 70 send WRs on QP, got 0.
[D 18:26:17.240774] [INFO]: Mapping pointer 0x4000024d000 for I/O.
[D 18:26:17.248738] [INFO]: Mapping pointer 0x4000164f000 for I/O.
[E 18:26:17.262588] Warning: openib_new_connection: asked for 70 send WRs on QP, got 0.
[D 15:19:37.566106] [INFO]: Mapping pointer 0x4000024d000 for I/O.
[D 15:19:37.573195] [INFO]: Mapping pointer 0x4000164f000 for I/O.
[E 15:19:37.635369] Warning: openib_new_connection: asked for 70 send WRs on QP, got 0.
[D 15:24:00.655309] [INFO]: Mapping pointer 0x4000024d000 for I/O.
[D 15:24:00.661949] [INFO]: Mapping pointer 0x4000164f000 for I/O.
[E 15:24:00.666193] Warning: openib_new_connection: asked for 70 send WRs on QP, got 0.
[E 15:24:22.502892] Warning: openib_new_connection: asked for 70 send WRs on QP, got 0.
[D 15:29:58.438046] client_op_state_get_machine 301
[D 15:29:58.438075] PINT_client_state_machine_post smcb 0x100c9430, op: UNKNOWN
[D 15:29:58.438105] Posted UNKNOWN (-1) (waiting for test)(-1073741839)
[D 15:29:58.438133] client_op_state_get_machine 301
[D 15:29:58.438157] PINT_client_state_machine_post smcb 0x100c9f00, op: UNKNOWN
[D 15:29:58.438182] Posted UNKNOWN (-1) (waiting for test)(-1073741839)
[D 15:29:58.438496] [INFO]: Mapping pointer 0x4000024d000 for I/O.
[D 15:29:58.444954] [INFO]: Mapping pointer 0x4000164f000 for I/O.
[D 15:29:58.445051] PINT_sys_dev_unexp
[D 15:29:58.445082] client_op_state_get_machine 400
[D 15:29:58.445106] PINT_client_state_machine_post smcb 0x100cc380, op: PVFS_DEV_UNEXPECTED
[D 15:29:58.445137] Posted PVFS_DEV_UNEXPECTED (8) (waiting for test)(-1073741839)
[D 15:29:58.445166] PINT_sys_dev_unexp
[D 15:29:58.445190] client_op_state_get_machine 400
[D 15:29:58.445213] PINT_client_state_machine_post smcb 0x100ce270, op: PVFS_DEV_UNEXPECTED
[D 15:29:58.445238] Posted PVFS_DEV_UNEXPECTED (10) (waiting for test)(-1073741839)
[D 15:29:58.445267] PINT_sys_dev_unexp
[D 15:29:58.445291] client_op_state_get_machine 400
[D 15:29:58.445314] PINT_client_state_machine_post smcb 0x100d0160, op: PVFS_DEV_UNEXPECTED
[D 15:29:58.445339] Posted PVFS_DEV_UNEXPECTED (12) (waiting for test)(-1073741839)
[D 15:29:58.445370] PINT_sys_dev_unexp
[D 15:29:58.445394] client_op_state_get_machine 400
[D 15:29:58.445417] PINT_client_state_machine_post smcb 0x100d2050, op: PVFS_DEV_UNEXPECTED
[D 15:29:58.445442] Posted PVFS_DEV_UNEXPECTED (14) (waiting for test)(-1073741839)
[D 15:29:58.445468] PINT_sys_dev_unexp
[D 15:29:58.445495] client_op_state_get_machine 400
[D 15:29:58.445518] PINT_client_state_machine_post smcb 0x100d3f40, op: PVFS_DEV_UNEXPECTED
[D 15:29:58.445543] Posted PVFS_DEV_UNEXPECTED (16) (waiting for test)(-1073741839)
[D 15:29:58.445570] PINT_sys_dev_unexp
[D 15:29:58.445597] client_op_state_get_machine 400
[D 15:29:58.445620] PINT_client_state_machine_post smcb 0x100d5e30, op: PVFS_DEV_UNEXPECTED
[D 15:29:58.445645] Posted PVFS_DEV_UNEXPECTED (18) (waiting for test)(-1073741839)
[D 15:29:58.445672] PINT_sys_dev_unexp
[D 15:29:58.445703] client_op_state_get_machine 400
[D 15:29:58.445727] PINT_client_state_machine_post smcb 0x100d7d20, op: PVFS_DEV_UNEXPECTED
[D 15:29:58.445752] Posted PVFS_DEV_UNEXPECTED (20) (waiting for test)(-1073741839)
[D 15:29:58.445778] PINT_sys_dev_unexp
[D 15:29:58.445805] client_op_state_get_machine 400
[D 15:29:58.445829] PINT_client_state_machine_post smcb 0x100d9c10, op: PVFS_DEV_UNEXPECTED
[D 15:29:58.445854] Posted PVFS_DEV_UNEXPECTED (22) (waiting for test)(-1073741839)
[D 15:29:58.445880] PINT_sys_dev_unexp
[D 15:29:58.445907] client_op_state_get_machine 400
[D 15:29:58.445931] PINT_client_state_machine_post smcb 0x100dbb00, op: PVFS_DEV_UNEXPECTED
[D 15:29:58.445956] Posted PVFS_DEV_UNEXPECTED (24) (waiting for test)(-1073741839)
[D 15:29:58.445983] PINT_sys_dev_unexp
[D 15:29:58.446009] client_op_state_get_machine 400
[D 15:29:58.446039] PINT_client_state_machine_post smcb 0x100dd9f0, op: PVFS_DEV_UNEXPECTED
[D 15:29:58.446064] Posted PVFS_DEV_UNEXPECTED (26) (waiting for test)(-1073741839)
[D 15:29:58.446091] PINT_sys_dev_unexp
[D 15:29:58.446118] client_op_state_get_machine 400
[D 15:29:58.446141] PINT_client_state_machine_post smcb 0x100df8e0, op: PVFS_DEV_UNEXPECTED
[D 15:29:58.446166] Posted PVFS_DEV_UNEXPECTED (28) (waiting for test)(-1073741839)
[D 15:29:58.446193] PINT_sys_dev_unexp
[D 15:29:58.446220] client_op_state_get_machine 400
[D 15:29:58.446243] PINT_client_state_machine_post smcb 0x100e17d0, op: PVFS_DEV_UNEXPECTED
[D 15:29:58.446268] Posted PVFS_DEV_UNEXPECTED (30) (waiting for test)(-1073741839)
[D 15:29:58.446294] PINT_sys_dev_unexp
[D 15:29:58.446318] client_op_state_get_machine 400
[D 15:29:58.446341] PINT_client_state_machine_post smcb 0x100e36c0, op: PVFS_DEV_UNEXPECTED
[D 15:29:58.446369] Posted PVFS_DEV_UNEXPECTED (32) (waiting for test)(-1073741839)
[D 15:29:58.446396] PINT_sys_dev_unexp
[D 15:29:58.446420] client_op_state_get_machine 400
[D 15:29:58.446442] PINT_client_state_machine_post smcb 0x100e55b0, op: PVFS_DEV_UNEXPECTED
[D 15:29:58.446473] Posted PVFS_DEV_UNEXPECTED (34) (waiting for test)(-1073741839)
[D 15:29:58.446503] PINT_sys_dev_unexp
[D 15:29:58.446527] client_op_state_get_machine 400
[D 15:29:58.446549] PINT_client_state_machine_post smcb 0x100e74a0, op: PVFS_DEV_UNEXPECTED
[D 15:29:58.446575] Posted PVFS_DEV_UNEXPECTED (36) (waiting for test)(-1073741839)
[D 15:29:58.446603] PINT_sys_dev_unexp
[D 15:29:58.446627] client_op_state_get_machine 400
[D 15:29:58.446650] PINT_client_state_machine_post smcb 0x100e9390, op: PVFS_DEV_UNEXPECTED
[D 15:29:58.446675] Posted PVFS_DEV_UNEXPECTED (38) (waiting for test)(-1073741839)
[D 15:29:58.446704] PINT_sys_dev_unexp
[D 15:29:58.446728] client_op_state_get_machine 400
[D 15:29:58.446751] PINT_client_state_machine_post smcb 0x100eb280, op: PVFS_DEV_UNEXPECTED
[D 15:29:58.446776] Posted PVFS_DEV_UNEXPECTED (40) (waiting for test)(-1073741839)
[D 15:29:58.446805] PINT_sys_dev_unexp
[D 15:29:58.446829] client_op_state_get_machine 400
[D 15:29:58.446852] PINT_client_state_machine_post smcb 0x100ed170, op: PVFS_DEV_UNEXPECTED
[D 15:29:58.446876] Posted PVFS_DEV_UNEXPECTED (42) (waiting for test)(-1073741839)
[D 15:29:58.446906] PINT_sys_dev_unexp
[D 15:29:58.446929] client_op_state_get_machine 400
[D 15:29:58.446952] PINT_client_state_machine_post smcb 0x100ef060, op: PVFS_DEV_UNEXPECTED
[D 15:29:58.446977] Posted PVFS_DEV_UNEXPECTED (44) (waiting for test)(-1073741839)
[D 15:29:58.447007] PINT_sys_dev_unexp
[D 15:29:58.447033] client_op_state_get_machine 400
[D 15:29:58.447057] PINT_client_state_machine_post smcb 0x100f0f50, op: PVFS_DEV_UNEXPECTED
[D 15:29:58.447082] Posted PVFS_DEV_UNEXPECTED (46) (waiting for test)(-1073741839)
[D 15:29:58.447109] PINT_sys_dev_unexp
[D 15:29:58.447135] client_op_state_get_machine 400
[D 15:29:58.447158] PINT_client_state_machine_post smcb 0x100f2e40, op: PVFS_DEV_UNEXPECTED
[D 15:29:58.447184] Posted PVFS_DEV_UNEXPECTED (48) (waiting for test)(-1073741839)
[D 15:29:58.447213] PINT_sys_dev_unexp
[D 15:29:58.447239] client_op_state_get_machine 400
[D 15:29:58.447263] PINT_client_state_machine_post smcb 0x100f4d30, op: PVFS_DEV_UNEXPECTED
[D 15:29:58.447287] Posted PVFS_DEV_UNEXPECTED (50) (waiting for test)(-1073741839)
[D 15:29:58.447315] PINT_sys_dev_unexp
[D 15:29:58.447340] client_op_state_get_machine 400
[D 15:29:58.447364] PINT_client_state_machine_post smcb 0x100f6c20, op: PVFS_DEV_UNEXPECTED
[D 15:29:58.447389] Posted PVFS_DEV_UNEXPECTED (52) (waiting for test)(-1073741839)
[D 15:29:58.447416] PINT_sys_dev_unexp
[D 15:29:58.447443] client_op_state_get_machine 400
[D 15:29:58.447467] PINT_client_state_machine_post smcb 0x100f8b10, op: PVFS_DEV_UNEXPECTED
[D 15:29:58.447492] Posted PVFS_DEV_UNEXPECTED (54) (waiting for test)(-1073741839)
[D 15:29:58.447520] PINT_sys_dev_unexp
[D 15:29:58.447546] client_op_state_get_machine 400
[D 15:29:58.447569] PINT_client_state_machine_post smcb 0x100faa00, op: PVFS_DEV_UNEXPECTED
[D 15:29:58.447597] Posted PVFS_DEV_UNEXPECTED (56) (waiting for test)(-1073741839)
[D 15:29:58.447624] PINT_sys_dev_unexp
[D 15:29:58.447650] client_op_state_get_machine 400
[D 15:29:58.447673] PINT_client_state_machine_post smcb 0x100fc8f0, op: PVFS_DEV_UNEXPECTED
[D 15:29:58.447698] Posted PVFS_DEV_UNEXPECTED (58) (waiting for test)(-1073741839)
[D 15:29:58.447726] PINT_sys_dev_unexp
[D 15:29:58.447752] client_op_state_get_machine 400
[D 15:29:58.447775] PINT_client_state_machine_post smcb 0x100fe7e0, op: PVFS_DEV_UNEXPECTED
[D 15:29:58.447800] Posted PVFS_DEV_UNEXPECTED (60) (waiting for test)(-1073741839)
[D 15:29:58.447828] PINT_sys_dev_unexp
[D 15:29:58.447852] client_op_state_get_machine 400
[D 15:29:58.447875] PINT_client_state_machine_post smcb 0x101006d0, op: PVFS_DEV_UNEXPECTED
[D 15:29:58.447902] Posted PVFS_DEV_UNEXPECTED (62) (waiting for test)(-1073741839)
[D 15:29:58.447932] PINT_sys_dev_unexp
[D 15:29:58.447956] client_op_state_get_machine 400
[D 15:29:58.447978] PINT_client_state_machine_post smcb 0x101025c0, op: PVFS_DEV_UNEXPECTED
[D 15:29:58.448006] Posted PVFS_DEV_UNEXPECTED (64) (waiting for test)(-1073741839)
[D 15:29:58.448035] PINT_sys_dev_unexp
[D 15:29:58.448059] client_op_state_get_machine 400
[D 15:29:58.448081] PINT_client_state_machine_post smcb 0x101044b0, op: PVFS_DEV_UNEXPECTED
[D 15:29:58.448106] Posted PVFS_DEV_UNEXPECTED (66) (waiting for test)(-1073741839)
[D 15:29:58.448136] PINT_sys_dev_unexp
[D 15:29:58.448160] client_op_state_get_machine 400
[D 15:29:58.448183] PINT_client_state_machine_post smcb 0x101063a0, op: PVFS_DEV_UNEXPECTED
[D 15:29:58.448207] Posted PVFS_DEV_UNEXPECTED (68) (waiting for test)(-1073741839)
[D 15:29:58.448237] PINT_sys_dev_unexp
[D 15:29:58.448261] client_op_state_get_machine 400
[D 15:29:58.448284] PINT_client_state_machine_post smcb 0x10108290, op: PVFS_DEV_UNEXPECTED
[D 15:29:58.448310] Posted PVFS_DEV_UNEXPECTED (70) (waiting for test)(-1073741839)
[D 15:29:58.448340] PINT_sys_dev_unexp
[D 15:29:58.448364] client_op_state_get_machine 400
[D 15:29:58.448387] PINT_client_state_machine_post smcb 0x1010a180, op: PVFS_DEV_UNEXPECTED
[D 15:29:58.448411] Posted PVFS_DEV_UNEXPECTED (72) (waiting for test)(-1073741839)
[D 15:29:58.448441] PINT_sys_dev_unexp
[D 15:29:58.448465] client_op_state_get_machine 400
[D 15:29:58.448487] PINT_client_state_machine_post smcb 0x1010c070, op: PVFS_DEV_UNEXPECTED
[D 15:29:58.448516] Posted PVFS_DEV_UNEXPECTED (74) (waiting for test)(-1073741839)
[D 15:29:58.448547] PINT_sys_dev_unexp
[D 15:29:58.448579] client_op_state_get_machine 400
[D 15:29:58.448606] PINT_client_state_machine_post smcb 0x1010df60, op: PVFS_DEV_UNEXPECTED
[D 15:29:58.448632] Posted PVFS_DEV_UNEXPECTED (76) (waiting for test)(-1073741839)
[D 15:29:58.448658] PINT_sys_dev_unexp
[D 15:29:58.448688] client_op_state_get_machine 400
[D 15:29:58.448711] PINT_client_state_machine_post smcb 0x1010fe50, op: PVFS_DEV_UNEXPECTED
[D 15:29:58.448737] Posted PVFS_DEV_UNEXPECTED (78) (waiting for test)(-1073741839)
[D 15:29:58.448763] PINT_sys_dev_unexp
[D 15:29:58.448790] client_op_state_get_machine 400
[D 15:29:58.448813] PINT_client_state_machine_post smcb 0x10111d40, op: PVFS_DEV_UNEXPECTED
[D 15:29:58.448839] Posted PVFS_DEV_UNEXPECTED (80) (waiting for test)(-1073741839)
[D 15:29:58.448865] PINT_sys_dev_unexp
[D 15:29:58.448892] client_op_state_get_machine 400
[D 15:29:58.448915] PINT_client_state_machine_post smcb 0x10113c30, op: PVFS_DEV_UNEXPECTED
[D 15:29:58.448940] Posted PVFS_DEV_UNEXPECTED (82) (waiting for test)(-1073741839)
[D 15:29:58.448967] PINT_sys_dev_unexp
[D 15:29:58.448993] client_op_state_get_machine 400
[D 15:29:58.449017] PINT_client_state_machine_post smcb 0x10115b20, op: PVFS_DEV_UNEXPECTED
[D 15:29:58.449042] Posted PVFS_DEV_UNEXPECTED (84) (waiting for test)(-1073741839)
[D 15:29:58.449069] PINT_sys_dev_unexp
[D 15:29:58.449095] client_op_state_get_machine 400
[D 15:29:58.449119] PINT_client_state_machine_post smcb 0x10117a10, op: PVFS_DEV_UNEXPECTED
[D 15:29:58.449144] Posted PVFS_DEV_UNEXPECTED (86) (waiting for test)(-1073741839)
[D 15:29:58.449171] PINT_sys_dev_unexp
[D 15:29:58.449200] client_op_state_get_machine 400
[D 15:29:58.449224] PINT_client_state_machine_post smcb 0x10119900, op: PVFS_DEV_UNEXPECTED
[D 15:29:58.449249] Posted PVFS_DEV_UNEXPECTED (88) (waiting for test)(-1073741839)
[D 15:29:58.449275] PINT_sys_dev_unexp
[D 15:29:58.449302] client_op_state_get_machine 400
[D 15:29:58.449325] PINT_client_state_machine_post smcb 0x1011b7f0, op: PVFS_DEV_UNEXPECTED
[D 15:29:58.449351] Posted PVFS_DEV_UNEXPECTED (90) (waiting for test)(-1073741839)
[D 15:29:58.449378] PINT_sys_dev_unexp
[D 15:29:58.449401] client_op_state_get_machine 400
[D 15:29:58.449424] PINT_client_state_machine_post smcb 0x1011d6e0, op: PVFS_DEV_UNEXPECTED
[D 15:29:58.449454] Posted PVFS_DEV_UNEXPECTED (92) (waiting for test)(-1073741839)
[D 15:29:58.449481] PINT_sys_dev_unexp
[D 15:29:58.449505] client_op_state_get_machine 400
[D 15:29:58.449528] PINT_client_state_machine_post smcb 0x1011f5d0, op: PVFS_DEV_UNEXPECTED
[D 15:29:58.449556] Posted PVFS_DEV_UNEXPECTED (94) (waiting for test)(-1073741839)
[D 15:29:58.449584] PINT_sys_dev_unexp
[D 15:29:58.449607] client_op_state_get_machine 400
[D 15:29:58.449630] PINT_client_state_machine_post smcb 0x101214c0, op: PVFS_DEV_UNEXPECTED
[D 15:29:58.449655] Posted PVFS_DEV_UNEXPECTED (96) (waiting for test)(-1073741839)
[D 15:29:58.449685] PINT_sys_dev_unexp
[D 15:29:58.449708] client_op_state_get_machine 400
[D 15:29:58.449731] PINT_client_state_machine_post smcb 0x101233b0, op: PVFS_DEV_UNEXPECTED
[D 15:29:58.449756] Posted PVFS_DEV_UNEXPECTED (98) (waiting for test)(-1073741839)
[D 15:29:58.449785] PINT_sys_dev_unexp
[D 15:29:58.449809] client_op_state_get_machine 400
[D 15:29:58.449831] PINT_client_state_machine_post smcb 0x101252a0, op: PVFS_DEV_UNEXPECTED
[D 15:29:58.449857] Posted PVFS_DEV_UNEXPECTED (100) (waiting for test)(-1073741839)
[D 15:29:58.449887] PINT_sys_dev_unexp
[D 15:29:58.449911] client_op_state_get_machine 400
[D 15:29:58.449934] PINT_client_state_machine_post smcb 0x10127190, op: PVFS_DEV_UNEXPECTED
[D 15:29:58.449958] Posted PVFS_DEV_UNEXPECTED (102) (waiting for test)(-1073741839)
[D 15:29:58.449988] PINT_sys_dev_unexp
[D 15:29:58.450012] client_op_state_get_machine 400
[D 15:29:58.450035] PINT_client_state_machine_post smcb 0x10129080, op: PVFS_DEV_UNEXPECTED
[D 15:29:58.450059] Posted PVFS_DEV_UNEXPECTED (104) (waiting for test)(-1073741839)
[D 15:29:58.450086] PINT_sys_dev_unexp
[D 15:29:58.450113] client_op_state_get_machine 400
[D 15:29:58.450137] PINT_client_state_machine_post smcb 0x1012af70, op: PVFS_DEV_UNEXPECTED
[D 15:29:58.450161] Posted PVFS_DEV_UNEXPECTED (106) (waiting for test)(-1073741839)
[D 15:29:58.450194] PINT_sys_dev_unexp
[D 15:29:58.450221] client_op_state_get_machine 400
[D 15:29:58.450243] PINT_client_state_machine_post smcb 0x1012ce60, op: PVFS_DEV_UNEXPECTED
[D 15:29:58.450268] Posted PVFS_DEV_UNEXPECTED (108) (waiting for test)(-1073741839)
[D 15:29:58.450296] PINT_sys_dev_unexp
[D 15:29:58.450323] client_op_state_get_machine 400
[D 15:29:58.450346] PINT_client_state_machine_post smcb 0x1012ed50, op: PVFS_DEV_UNEXPECTED
[D 15:29:58.450371] Posted PVFS_DEV_UNEXPECTED (110) (waiting for test)(-1073741839)
[D 15:29:58.450399] PINT_sys_dev_unexp
[D 15:29:58.450426] client_op_state_get_machine 400
[D 15:29:58.450448] PINT_client_state_machine_post smcb 0x10130c40, op: PVFS_DEV_UNEXPECTED
[D 15:29:58.450473] Posted PVFS_DEV_UNEXPECTED (112) (waiting for test)(-1073741839)
[D 15:29:58.450504] PINT_sys_dev_unexp
[D 15:29:58.450531] client_op_state_get_machine 400
[D 15:29:58.450553] PINT_client_state_machine_post smcb 0x10132b30, op: PVFS_DEV_UNEXPECTED
[D 15:29:58.450579] Posted PVFS_DEV_UNEXPECTED (114) (waiting for test)(-1073741839)
[D 15:29:58.450606] PINT_sys_dev_unexp
[D 15:29:58.450633] client_op_state_get_machine 400
[D 15:29:58.450655] PINT_client_state_machine_post smcb 0x10134a20, op: PVFS_DEV_UNEXPECTED
[D 15:29:58.450681] Posted PVFS_DEV_UNEXPECTED (116) (waiting for test)(-1073741839)
[D 15:29:58.450708] PINT_sys_dev_unexp
[D 15:29:58.450736] client_op_state_get_machine 400
[D 15:29:58.450761] PINT_client_state_machine_post smcb 0x10136910, op: PVFS_DEV_UNEXPECTED
[D 15:29:58.450786] Posted PVFS_DEV_UNEXPECTED (118) (waiting for test)(-1073741839)
[D 15:29:58.450814] PINT_sys_dev_unexp
[D 15:29:58.450840] client_op_state_get_machine 400
[D 15:29:58.450863] PINT_client_state_machine_post smcb 0x10138800, op: PVFS_DEV_UNEXPECTED
[D 15:29:58.450888] Posted PVFS_DEV_UNEXPECTED (120) (waiting for test)(-1073741839)
[D 15:29:58.450918] PINT_sys_dev_unexp
[D 15:29:58.450942] client_op_state_get_machine 400
[D 15:29:58.450964] PINT_client_state_machine_post smcb 0x1013a6f0, op: PVFS_DEV_UNEXPECTED
[D 15:29:58.450994] Posted PVFS_DEV_UNEXPECTED (122) (waiting for test)(-1073741839)
[D 15:29:58.451022] PINT_sys_dev_unexp
[D 15:29:58.451046] client_op_state_get_machine 400
[D 15:29:58.451068] PINT_client_state_machine_post smcb 0x1013c5e0, op: PVFS_DEV_UNEXPECTED
[D 15:29:58.451097] Posted PVFS_DEV_UNEXPECTED (124) (waiting for test)(-1073741839)
[D 15:29:58.451124] PINT_sys_dev_unexp
[D 15:29:58.451148] client_op_state_get_machine 400
[D 15:29:58.451170] PINT_client_state_machine_post smcb 0x1013e4d0, op: PVFS_DEV_UNEXPECTED
[D 15:29:58.451195] Posted PVFS_DEV_UNEXPECTED (126) (waiting for test)(-1073741839)
[D 15:29:58.451226] PINT_sys_dev_unexp
[D 15:29:58.451250] client_op_state_get_machine 400
[D 15:29:58.451272] PINT_client_state_machine_post smcb 0x101403c0, op: PVFS_DEV_UNEXPECTED
[D 15:29:58.451296] Posted PVFS_DEV_UNEXPECTED (128) (waiting for test)(-1073741839)
[D 15:29:58.451326] PINT_sys_dev_unexp
[D 15:29:58.451350] client_op_state_get_machine 400
[D 15:29:58.451373] PINT_client_state_machine_post smcb 0x101422b0, op: PVFS_DEV_UNEXPECTED
[D 15:29:58.451397] Posted PVFS_DEV_UNEXPECTED (130) (waiting for test)(-1073741839)
[D 15:29:58.451427] PINT_sys_dev_unexp
[D 15:29:58.451451] client_op_state_get_machine 400
[D 15:29:58.451475] PINT_client_state_machine_post smcb 0x101441a0, op: PVFS_DEV_UNEXPECTED
[D 15:29:58.451499] Posted PVFS_DEV_UNEXPECTED (132) (waiting for test)(-1073741839)
[D 15:29:58.451529] PINT_sys_dev_unexp
[D 15:29:58.451553] client_op_state_get_machine 400
[D 15:29:58.451576] PINT_client_state_machine_post smcb 0x10146090, op: PVFS_DEV_UNEXPECTED
[D 15:29:58.451601] Posted PVFS_DEV_UNEXPECTED (134) (waiting for test)(-1073741839)
[D 15:29:58.451679] client_state_machine_terminate smcb 0x100cc380
[D 15:29:58.451703] add smcb 0x100cc380 to completion list
[D 15:29:58.451726] PINT_sys_release: id 8
[D 15:29:58.451798] BMI_ib_initialize: init.
[D 15:29:58.451828] openib_ib_initialize: init.
[D 15:29:58.452770] openib_ib_initialize: max 16380 completion queue entries.
[D 15:29:58.452962] BMI_ib_initialize: done.
[D 15:29:58.453008] client_op_state_get_machine 19
[D 15:29:58.453038] PINT_client_state_machine_post smcb 0x100cc630, op: PVFS_SYS_FS_ADD
[D 15:29:58.453063] get_config state: server_get_config_setup_msgpair
[D 15:29:58.453142] BMI_post_recv: addr: 269273072, offset: 0x101482a0, size: 16416, tag: 1
[E 15:29:58.454279] Warning: openib_new_connection: asked for 70 send WRs on QP, got 0.
[D 15:29:58.454975] post_recv: new rq 0x1014e0c0.
[D 15:29:58.455009] memcache_register: hit [0] 0x101482a0 len 16416 (via 0x101482a0 len 16416) refcnt now 2.
[D 15:29:58.455063] BMI_post_sendunexpected_list: addr: 269273072, count: 1, total_size: 24, tag: 1
[D 15:29:58.455096]    element 0: offset: 0x10148280, size: 24
[D 15:29:58.455123] post_send: sq 0x1014e380 len 24 peer da13:3345.
[D 15:29:58.455152] encourage_send_waiting_buffer: sq 0x1014e380 sent EAGER len 24.
[D 15:29:58.455181] Posted PVFS_SYS_FS_ADD (137) (waiting for test)(-1073741839)
[D 15:29:58.455240] ib_check_cq: send to da13:3345 completed locally: -> SQ_WAITING_USER_TEST.
[D 15:29:58.455266] test_sq: sq 0x1014e380 completed 24 to da13:3345.
[D 15:29:58.459088] ib_check_cq: recv from da13:3345 len 1432 type MSG_EAGER_SEND credit 1.
[D 15:29:58.459117] encourage_recv_incoming: recv eager len 1432.
[D 15:29:58.459143] encourage_recv_incoming: matched rq 0x1014e0c0 now RQ_EAGER_WAITING_USER_TEST.
[D 15:29:58.459166] encourage_recv_incoming: early registration not needed, dereg after eager.
[D 15:29:58.459194] memcache_deregister: dec refcount [0] 0x101482a0 len 16416 (via 0x101482a0 len 16416) refcnt now 1.
[D 15:29:58.459219] test_rq: rq 0x1014e0c0 completed 1416 from da13:3345.
[D 15:29:58.459829] [BMI CONTROL]: BMI_set_info: set_info: 0 option: 11
[D 15:29:58.459856] [BMI CONTROL]: BMI_set_info: set_info: 0 option: 12
[D 15:29:58.459898] * Adding new dynamic mount point <DYNAMIC-1> [7,0]
[D 15:29:58.459928] PINT_server_config_mgr_add_config: adding config 0x10148190
[D 15:29:58.459953] 	mapped fs_id 1334155764 => config 0x10148190
[D 15:29:58.459985] Set min handle recycle time to 360 seconds
[D 15:29:58.460008] Reloading handle mappings for fs_id 1334155764
[D 15:29:58.460040] client_state_machine_terminate smcb 0x100cc630
[D 15:29:58.460062] add smcb 0x100cc630 to completion list
[D 15:29:58.460086] PINT_sys_release: id 137
[D 15:29:58.460123] [BMI CONTROL]: BMI_set_info: set_info: 269273072 option: 8
[D 15:29:58.460146] [BMI CONTROL]: BMI_set_info: searching for ref 269273072
[D 15:29:58.460192] PINT_sys_release: id 137
[D 15:29:58.460273] PINT_sys_dev_unexp
[D 15:29:58.460302] client_op_state_get_machine 400
[D 15:29:58.460330] PINT_client_state_machine_post smcb 0x100cc630, op: PVFS_DEV_UNEXPECTED
[D 15:29:58.460359] Posted PVFS_DEV_UNEXPECTED (139) (waiting for test)(-1073741839)
[D 15:29:58.460395] client_state_machine_terminate smcb 0x100ce270
[D 15:29:58.460419] add smcb 0x100ce270 to completion list
[D 15:29:58.460442] PINT_sys_release: id 10
[D 15:29:58.460474] PVFS_isys_getattr entered
[D 15:29:58.460517] client_op_state_get_machine 5
[D 15:29:58.460544] PINT_client_state_machine_post smcb 0x100ccc80, op: PVFS_SYS_GETATTR
[D 15:29:58.460576] (0x100ce270) getattr_object_getattr_setup_msgpair
[D 15:29:58.460649] BMI_post_recv: addr: 269773808, offset: 0x10151030, size: 9280, tag: 2
[D 15:29:58.460676] post_recv: new rq 0x100cebc0.
[D 15:29:58.460700] memcache_register: hit [0] 0x10151030 len 9280 (via 0x10151030 len 9280) refcnt now 2.
[D 15:29:58.460732] BMI_post_sendunexpected_list: addr: 269773808, count: 1, total_size: 40, tag: 2
[D 15:29:58.460756]    element 0: offset: 0x10146c30, size: 40
[D 15:29:58.460780] post_send: sq 0x1014e8b0 len 40 peer da13:3345.
[D 15:29:58.460807] encourage_send_waiting_buffer: sq 0x1014e8b0 sent EAGER len 40.
[D 15:29:58.460832] Posted PVFS_SYS_GETATTR (142) (waiting for test)(-1073741839)
[D 15:29:58.460860] ib_check_cq: send to da13:3345 completed locally: -> SQ_WAITING_USER_TEST.
[D 15:29:58.460885] test_sq: sq 0x1014e8b0 completed 40 to da13:3345.
[D 15:29:58.464330] ib_check_cq: recv from da13:3345 len 124 type MSG_EAGER_SEND credit 1.
[D 15:29:58.464355] encourage_recv_incoming: recv eager len 124.
[D 15:29:58.464379] encourage_recv_incoming: matched rq 0x100cebc0 now RQ_EAGER_WAITING_USER_TEST.
[D 15:29:58.464403] encourage_recv_incoming: early registration not needed, dereg after eager.
[D 15:29:58.464426] memcache_deregister: dec refcount [0] 0x10151030 len 9280 (via 0x10151030 len 9280) refcnt now 1.
[D 15:29:58.464450] test_rq: rq 0x100cebc0 completed 108 from da13:3345.
[D 15:29:58.464488] getattr comp_fn [0x100ce2a8] dfile_count = 0 dist_name_len = 0 dist_params_len = 0
[D 15:29:58.464521] trying to add object reference to acache
[D 15:29:58.464545] (0x100ce270) getattr state: getattr_cleanup
[D 15:29:58.464569] dfile_count: 0
[D 15:29:58.464591] dist_name_len = 0, dist_params_len = 0
[D 15:29:58.464615] client_state_machine_terminate smcb 0x100ccc80
[D 15:29:58.464637] add smcb 0x100ccc80 to completion list
[D 15:29:58.464661] PINT_sys_release: id 142
[D 15:29:58.464696] PINT_sys_release: id 142
[D 15:29:58.464792] PINT_sys_dev_unexp
[D 15:29:58.464856] client_op_state_get_machine 400
[D 15:29:58.464891] PINT_client_state_machine_post smcb 0x100ccc80, op: PVFS_DEV_UNEXPECTED
[D 15:29:58.464926] Posted PVFS_DEV_UNEXPECTED (144) (waiting for test)(-1073741839)
[D 15:30:29.228778] client_state_machine_terminate smcb 0x100d0160
[D 15:30:29.228822] add smcb 0x100d0160 to completion list
[D 15:30:29.228851] PINT_sys_release: id 12
[D 15:30:29.228880] PVFS_isys_getattr entered
[D 15:30:29.228905] client_op_state_get_machine 5
[D 15:30:29.228932] PINT_client_state_machine_post smcb 0x10146ce0, op: PVFS_SYS_GETATTR
[D 15:30:29.228959] (0x100d0160) getattr_object_getattr_setup_msgpair
[D 15:30:29.228993] BMI_post_recv: addr: 269773808, offset: 0x10151030, size: 9280, tag: 3
[D 15:30:29.229023] post_recv: new rq 0x100d0ae0.
[D 15:30:29.229047] memcache_register: hit [0] 0x10151030 len 9280 (via 0x10151030 len 9280) refcnt now 2.
[D 15:30:29.229081] BMI_post_sendunexpected_list: addr: 269773808, count: 1, total_size: 40, tag: 3
[D 15:30:29.229108]    element 0: offset: 0x100d0980, size: 40
[D 15:30:29.229132] post_send: sq 0x1014e990 len 40 peer da13:3345.
[D 15:30:29.229160] encourage_send_waiting_buffer: sq 0x1014e990 sent EAGER len 40.
[D 15:30:29.229185] Posted PVFS_SYS_GETATTR (177) (waiting for test)(-1073741839)
[D 15:30:29.229213] ib_check_cq: send to da13:3345 completed locally: -> SQ_WAITING_USER_TEST.
[D 15:30:29.229237] test_sq: sq 0x1014e990 completed 40 to da13:3345.
[D 15:30:29.233448] ib_check_cq: recv from da13:3345 len 124 type MSG_EAGER_SEND credit 1.
[D 15:30:29.233472] encourage_recv_incoming: recv eager len 124.
[D 15:30:29.233496] encourage_recv_incoming: matched rq 0x100d0ae0 now RQ_EAGER_WAITING_USER_TEST.
[D 15:30:29.233520] encourage_recv_incoming: early registration not needed, dereg after eager.
[D 15:30:29.233543] memcache_deregister: dec refcount [0] 0x10151030 len 9280 (via 0x10151030 len 9280) refcnt now 1.
[D 15:30:29.233568] test_rq: rq 0x100d0ae0 completed 108 from da13:3345.
[D 15:30:29.233598] getattr comp_fn [0x100d0198] dfile_count = 0 dist_name_len = 0 dist_params_len = 0
[D 15:30:29.233628] trying to add object reference to acache
[D 15:30:29.233652] (0x100d0160) getattr state: getattr_cleanup
[D 15:30:29.233675] dfile_count: 0
[D 15:30:29.233696] dist_name_len = 0, dist_params_len = 0
[D 15:30:29.233719] client_state_machine_terminate smcb 0x10146ce0
[D 15:30:29.233742] add smcb 0x10146ce0 to completion list
[D 15:30:29.233765] PINT_sys_release: id 177
[D 15:30:29.233801] PINT_sys_release: id 177
[D 15:30:29.233826] PINT_sys_dev_unexp
[D 15:30:29.233850] client_op_state_get_machine 400
[D 15:30:29.233883] PINT_client_state_machine_post smcb 0x10146ce0, op: PVFS_DEV_UNEXPECTED
[D 15:30:29.233919] Posted PVFS_DEV_UNEXPECTED (179) (waiting for test)(-1073741839)
[D 15:30:29.234683] client_state_machine_terminate smcb 0x100d2050
[D 15:30:29.234712] add smcb 0x100d2050 to completion list
[D 15:30:29.234739] PINT_sys_release: id 14
[D 15:30:29.234768] PVFS_isys_getattr entered
[D 15:30:29.234795] client_op_state_get_machine 5
[D 15:30:29.234820] PINT_client_state_machine_post smcb 0x1014e9c0, op: PVFS_SYS_GETATTR
[D 15:30:29.234845] (0x100d2050) getattr state: getattr_cleanup
[D 15:30:29.234868] dfile_count: 0
[D 15:30:29.234890] dist_name_len = 0, dist_params_len = 0
[D 15:30:29.234913] Posted PVFS_SYS_GETATTR (18446744073709551615) (ran to termination)(0)
[D 15:30:29.234946] PINT_sys_release: id -1
[D 15:30:29.234971] PINT_sys_dev_unexp
[D 15:30:29.234994] client_op_state_get_machine 400
[D 15:30:29.235021] PINT_client_state_machine_post smcb 0x1014e9c0, op: PVFS_DEV_UNEXPECTED
[D 15:30:29.235050] Posted PVFS_DEV_UNEXPECTED (181) (waiting for test)(-1073741839)
[D 15:30:29.235087] client_state_machine_terminate smcb 0x100d3f40
[D 15:30:29.235114] add smcb 0x100d3f40 to completion list
[D 15:30:29.235136] PINT_sys_release: id 16
[D 15:30:29.235169] PVFS_isys_readdir entered
[D 15:30:29.235195] client_op_state_get_machine 9
[D 15:30:29.235222] PINT_client_state_machine_post smcb 0x1014e780, op: PVFS_SYS_READDIR
[D 15:30:29.235246] readdir state: init
[D 15:30:29.235271] (0x100d3f40) getattr_object_getattr_setup_msgpair
[D 15:30:29.235300] BMI_post_recv: addr: 269773808, offset: 0x10151030, size: 9280, tag: 4
[D 15:30:29.235324] post_recv: new rq 0x100d4890.
[D 15:30:29.235348] memcache_register: hit [0] 0x10151030 len 9280 (via 0x10151030 len 9280) refcnt now 2.
[D 15:30:29.235381] BMI_post_sendunexpected_list: addr: 269773808, count: 1, total_size: 40, tag: 4
[D 15:30:29.235405]    element 0: offset: 0x100cec20, size: 40
[D 15:30:29.235429] post_send: sq 0x100d0a80 len 40 peer da13:3345.
[D 15:30:29.235455] encourage_send_waiting_buffer: sq 0x100d0a80 sent EAGER len 40.
[D 15:30:29.235481] Posted PVFS_SYS_READDIR (184) (waiting for test)(-1073741839)
[D 15:30:29.235507] ib_check_cq: send to da13:3345 completed locally: -> SQ_WAITING_USER_TEST.
[D 15:30:29.235532] test_sq: sq 0x100d0a80 completed 40 to da13:3345.
[D 15:30:29.238487] ib_check_cq: recv from da13:3345 len 124 type MSG_EAGER_SEND credit 1.
[D 15:30:29.238512] encourage_recv_incoming: recv eager len 124.
[D 15:30:29.238535] encourage_recv_incoming: matched rq 0x100d4890 now RQ_EAGER_WAITING_USER_TEST.
[D 15:30:29.238559] encourage_recv_incoming: early registration not needed, dereg after eager.
[D 15:30:29.238582] memcache_deregister: dec refcount [0] 0x10151030 len 9280 (via 0x10151030 len 9280) refcnt now 1.
[D 15:30:29.238607] test_rq: rq 0x100d4890 completed 108 from da13:3345.
[D 15:30:29.238636] getattr comp_fn [0x100d3f78] dfile_count = 0 dist_name_len = 0 dist_params_len = 0
[D 15:30:29.238664] trying to add object reference to acache
[D 15:30:29.238687] (0x100d3f40) getattr state: getattr_cleanup
[D 15:30:29.238714] readdir state: readdir_msg_setup_msgpair
[D 15:30:29.238832] BMI_post_recv: addr: 269773808, offset: 0x40001fbf010, size: 135720, tag: 5
[D 15:30:29.238859] post_recv: new rq 0x100d0980.
[D 15:30:29.238882] memcache_register: hit [0] 0x40001fbf010 len 135720 (via 0x40001fbf010 len 135720) refcnt now 2.
[D 15:30:29.238912] BMI_post_sendunexpected_list: addr: 269773808, count: 1, total_size: 48, tag: 5
[D 15:30:29.238936]    element 0: offset: 0x100d4950, size: 48
[D 15:30:29.238960] post_send: sq 0x10150510 len 48 peer da13:3345.
[D 15:30:29.238986] encourage_send_waiting_buffer: sq 0x10150510 sent EAGER len 48.
[D 15:30:29.239019] ib_check_cq: send to da13:3345 completed locally: -> SQ_WAITING_USER_TEST.
[D 15:30:29.239046] test_sq: sq 0x10150510 completed 48 to da13:3345.
[D 15:30:29.240816] ib_check_cq: recv from da13:3345 len 304 type MSG_EAGER_SEND credit 1.
[D 15:30:29.240840] encourage_recv_incoming: recv eager len 304.
[D 15:30:29.240864] encourage_recv_incoming: matched rq 0x100d0980 now RQ_EAGER_WAITING_USER_TEST.
[D 15:30:29.240887] encourage_recv_incoming: early registration not needed, dereg after eager.
[D 15:30:29.240911] memcache_deregister: dec refcount [0] 0x40001fbf010 len 135720 (via 0x40001fbf010 len 135720) refcnt now 1.
[D 15:30:29.240936] test_rq: rq 0x100d0980 completed 288 from da13:3345.
[D 15:30:29.240965] readdir_msg_comp_fn
[D 15:30:29.240992] readdir state: cleanup
[D 15:30:29.241037] readdir state: do_cleanup
[D 15:30:29.241060] client_state_machine_terminate smcb 0x1014e780
[D 15:30:29.241083] add smcb 0x1014e780 to completion list
[D 15:30:29.241106] PINT_sys_release: id 184
[D 15:30:29.241169] PINT_sys_release: id 184
[D 15:30:29.241195] PINT_sys_dev_unexp
[D 15:30:29.241219] client_op_state_get_machine 400
[D 15:30:29.241243] PINT_client_state_machine_post smcb 0x1014e4c0, op: PVFS_DEV_UNEXPECTED
[D 15:30:29.241270] Posted PVFS_DEV_UNEXPECTED (188) (waiting for test)(-1073741839)
[D 15:30:29.241304] client_state_machine_terminate smcb 0x100d5e30
[D 15:30:29.241328] add smcb 0x100d5e30 to completion list
[D 15:30:29.241352] PINT_sys_release: id 18
[D 15:30:29.241384] PVFS_isys_setattr entered
[D 15:30:29.241410] client_op_state_get_machine 10
[D 15:30:29.241435] Doing setattr on handle 1048576 on fs 1334155764
[D 15:30:29.241458] PINT_client_state_machine_post smcb 0x100d6730, op: PVFS_SYS_SETATTR
[D 15:30:29.241482]  setattr: posting setattr req
[D 15:30:29.241506] setattr attr mask sent to server: 0x48
[D 15:30:29.241563] BMI_post_recv: addr: 269773808, offset: 0x100d4960, size: 16, tag: 6
[D 15:30:29.241590] post_recv: new rq 0x100d67e0.
[D 15:30:29.241620] BMI_post_sendunexpected_list: addr: 269773808, count: 1, total_size: 88, tag: 6
[D 15:30:29.241643]    element 0: offset: 0x10153480, size: 88
[D 15:30:29.241670] post_send: sq 0x1014fe20 len 88 peer da13:3345.
[D 15:30:29.241697] encourage_send_waiting_buffer: sq 0x1014fe20 sent EAGER len 88.
[D 15:30:29.241722] Posted PVFS_SYS_SETATTR (191) (waiting for test)(-1073741839)
[D 15:30:29.241749] ib_check_cq: send to da13:3345 completed locally: -> SQ_WAITING_USER_TEST.
[D 15:30:29.241773] test_sq: sq 0x1014fe20 completed 88 to da13:3345.
[D 15:30:29.242682] ib_check_cq: recv from da13:3345 len 32 type MSG_EAGER_SEND credit 1.
[D 15:30:29.242706] encourage_recv_incoming: recv eager len 32.
[D 15:30:29.242730] encourage_recv_incoming: matched rq 0x100d67e0 now RQ_EAGER_WAITING_USER_TEST.
[D 15:30:29.242753] test_rq: rq 0x100d67e0 completed 16 from da13:3345.
[D 15:30:29.242782] setattr_msg_comp_fn
[D 15:30:29.242810] client_state_machine_terminate smcb 0x100d6730
[D 15:30:29.242834] add smcb 0x100d6730 to completion list
[D 15:30:29.242856] PINT_sys_release: id 191
[D 15:30:29.242890] PINT_sys_release: id 191
[D 15:30:29.242914] PINT_sys_dev_unexp
[D 15:30:29.242939] client_op_state_get_machine 400
[D 15:30:29.242963] PINT_client_state_machine_post smcb 0x1014e6a0, op: PVFS_DEV_UNEXPECTED
[D 15:30:29.242989] Posted PVFS_DEV_UNEXPECTED (193) (waiting for test)(-1073741839)
[D 15:30:32.692472] client_state_machine_terminate smcb 0x100d7d20
[D 15:30:32.692515] add smcb 0x100d7d20 to completion list
[D 15:30:32.692543] PINT_sys_release: id 20
[D 15:30:32.692571] PVFS_isys_getattr entered
[D 15:30:32.692598] client_op_state_get_machine 5
[D 15:30:32.692625] PINT_client_state_machine_post smcb 0x1014e750, op: PVFS_SYS_GETATTR
[D 15:30:32.692651] (0x100d5e30) getattr_object_getattr_setup_msgpair
[D 15:30:32.692686] BMI_post_recv: addr: 269773808, offset: 0x10151030, size: 9280, tag: 7
[D 15:30:32.692713] post_recv: new rq 0x100d4890.
[D 15:30:32.692741] memcache_register: hit [0] 0x10151030 len 9280 (via 0x10151030 len 9280) refcnt now 2.
[D 15:30:32.692775] BMI_post_sendunexpected_list: addr: 269773808, count: 1, total_size: 40, tag: 7
[D 15:30:32.692801]    element 0: offset: 0x100d4960, size: 40
[D 15:30:32.692825] post_send: sq 0x100d7d20 len 40 peer da13:3345.
[D 15:30:32.692852] encourage_send_waiting_buffer: sq 0x100d7d20 sent EAGER len 40.
[D 15:30:32.692878] Posted PVFS_SYS_GETATTR (199) (waiting for test)(-1073741839)
[D 15:30:32.692906] ib_check_cq: send to da13:3345 completed locally: -> SQ_WAITING_USER_TEST.
[D 15:30:32.692930] test_sq: sq 0x100d7d20 completed 40 to da13:3345.
[D 15:30:32.693778] ib_check_cq: recv from da13:3345 len 124 type MSG_EAGER_SEND credit 1.
[D 15:30:32.693803] encourage_recv_incoming: recv eager len 124.
[D 15:30:32.693827] encourage_recv_incoming: matched rq 0x100d4890 now RQ_EAGER_WAITING_USER_TEST.
[D 15:30:32.693850] encourage_recv_incoming: early registration not needed, dereg after eager.
[D 15:30:32.693873] memcache_deregister: dec refcount [0] 0x10151030 len 9280 (via 0x10151030 len 9280) refcnt now 1.
[D 15:30:32.693898] test_rq: rq 0x100d4890 completed 108 from da13:3345.
[D 15:30:32.693928] getattr comp_fn [0x100d5e68] dfile_count = 0 dist_name_len = 0 dist_params_len = 0
[D 15:30:32.693958] trying to add object reference to acache
[D 15:30:32.693981] (0x100d5e30) getattr state: getattr_cleanup
[D 15:30:32.694004] dfile_count: 0
[D 15:30:32.694025] dist_name_len = 0, dist_params_len = 0
[D 15:30:32.694048] client_state_machine_terminate smcb 0x1014e750
[D 15:30:32.694071] add smcb 0x1014e750 to completion list
[D 15:30:32.694094] PINT_sys_release: id 199
[D 15:30:32.694129] PINT_sys_release: id 199
[D 15:30:32.694153] PINT_sys_dev_unexp
[D 15:30:32.694178] client_op_state_get_machine 400
[D 15:30:32.694201] PINT_client_state_machine_post smcb 0x1014e750, op: PVFS_DEV_UNEXPECTED
[D 15:30:32.694234] Posted PVFS_DEV_UNEXPECTED (201) (waiting for test)(-1073741839)
[D 15:30:32.694998] client_state_machine_terminate smcb 0x100d9c10
[D 15:30:32.695028] add smcb 0x100d9c10 to completion list
[D 15:30:32.695055] PINT_sys_release: id 22
[D 15:30:32.695085] PVFS_isys_getattr entered
[D 15:30:32.695112] client_op_state_get_machine 5
[D 15:30:32.695139] PINT_client_state_machine_post smcb 0x1014fda0, op: PVFS_SYS_GETATTR
[D 15:30:32.695165] (0x100d9c10) getattr state: getattr_cleanup
[D 15:30:32.695188] dfile_count: 0
[D 15:30:32.695210] dist_name_len = 0, dist_params_len = 0
[D 15:30:32.695234] Posted PVFS_SYS_GETATTR (18446744073709551615) (ran to termination)(0)
[D 15:30:32.695265] PINT_sys_release: id -1
[D 15:30:32.695289] PINT_sys_dev_unexp
[D 15:30:32.695313] client_op_state_get_machine 400
[D 15:30:32.695337] PINT_client_state_machine_post smcb 0x100d6650, op: PVFS_DEV_UNEXPECTED
[D 15:30:32.695362] Posted PVFS_DEV_UNEXPECTED (203) (waiting for test)(-1073741839)
[D 15:30:32.695395] client_state_machine_terminate smcb 0x100dbb00
[D 15:30:32.695418] add smcb 0x100dbb00 to completion list
[D 15:30:32.695442] PINT_sys_release: id 24
[D 15:30:32.695467] PVFS_isys_readdir entered
[D 15:30:32.695492] client_op_state_get_machine 9
[D 15:30:32.695516] PINT_client_state_machine_post smcb 0x1014fda0, op: PVFS_SYS_READDIR
[D 15:30:32.695539] readdir state: init
[D 15:30:32.695563] (0x100dbb00) getattr_object_getattr_setup_msgpair
[D 15:30:32.695592] BMI_post_recv: addr: 269773808, offset: 0x10151030, size: 9280, tag: 8
[D 15:30:32.695617] post_recv: new rq 0x100dc480.
[D 15:30:32.695641] memcache_register: hit [0] 0x10151030 len 9280 (via 0x10151030 len 9280) refcnt now 2.
[D 15:30:32.695672] BMI_post_sendunexpected_list: addr: 269773808, count: 1, total_size: 40, tag: 8
[D 15:30:32.695695]    element 0: offset: 0x100dc320, size: 40
[D 15:30:32.695719] post_send: sq 0x100d7d20 len 40 peer da13:3345.
[D 15:30:32.695745] encourage_send_waiting_buffer: sq 0x100d7d20 sent EAGER len 40.
[D 15:30:32.695770] Posted PVFS_SYS_READDIR (206) (waiting for test)(-1073741839)
[D 15:30:32.695797] ib_check_cq: send to da13:3345 completed locally: -> SQ_WAITING_USER_TEST.
[D 15:30:32.695822] test_sq: sq 0x100d7d20 completed 40 to da13:3345.
[D 15:30:32.698627] ib_check_cq: recv from da13:3345 len 124 type MSG_EAGER_SEND credit 1.
[D 15:30:32.698652] encourage_recv_incoming: recv eager len 124.
[D 15:30:32.698675] encourage_recv_incoming: matched rq 0x100dc480 now RQ_EAGER_WAITING_USER_TEST.
[D 15:30:32.698698] encourage_recv_incoming: early registration not needed, dereg after eager.
[D 15:30:32.698721] memcache_deregister: dec refcount [0] 0x10151030 len 9280 (via 0x10151030 len 9280) refcnt now 1.
[D 15:30:32.698746] test_rq: rq 0x100dc480 completed 108 from da13:3345.
[D 15:30:32.698775] getattr comp_fn [0x100dbb38] dfile_count = 0 dist_name_len = 0 dist_params_len = 0
[D 15:30:32.698803] trying to add object reference to acache
[D 15:30:32.698826] (0x100dbb00) getattr state: getattr_cleanup
[D 15:30:32.698849] readdir state: readdir_msg_setup_msgpair
[D 15:30:32.698877] BMI_post_recv: addr: 269773808, offset: 0x40001fbf010, size: 135720, tag: 9
[D 15:30:32.698902] post_recv: new rq 0x100d4890.
[D 15:30:32.698925] memcache_register: hit [0] 0x40001fbf010 len 135720 (via 0x40001fbf010 len 135720) refcnt now 2.
[D 15:30:32.698956] BMI_post_sendunexpected_list: addr: 269773808, count: 1, total_size: 48, tag: 9
[D 15:30:32.698980]    element 0: offset: 0x100dc510, size: 48
[D 15:30:32.699006] post_send: sq 0x100da530 len 48 peer da13:3345.
[D 15:30:32.699035] encourage_send_waiting_buffer: sq 0x100da530 sent EAGER len 48.
[D 15:30:32.699068] ib_check_cq: send to da13:3345 completed locally: -> SQ_WAITING_USER_TEST.
[D 15:30:32.699094] test_sq: sq 0x100da530 completed 48 to da13:3345.
[D 15:30:32.700166] ib_check_cq: recv from da13:3345 len 304 type MSG_EAGER_SEND credit 1.
[D 15:30:32.700191] encourage_recv_incoming: recv eager len 304.
[D 15:30:32.700215] encourage_recv_incoming: matched rq 0x100d4890 now RQ_EAGER_WAITING_USER_TEST.
[D 15:30:32.700238] encourage_recv_incoming: early registration not needed, dereg after eager.
[D 15:30:32.700261] memcache_deregister: dec refcount [0] 0x40001fbf010 len 135720 (via 0x40001fbf010 len 135720) refcnt now 1.
[D 15:30:32.700285] test_rq: rq 0x100d4890 completed 288 from da13:3345.
[D 15:30:32.700315] readdir_msg_comp_fn
[D 15:30:32.700344] readdir state: cleanup
[D 15:30:32.700386] readdir state: do_cleanup
[D 15:30:32.700408] client_state_machine_terminate smcb 0x1014fda0
[D 15:30:32.700431] add smcb 0x1014fda0 to completion list
[D 15:30:32.700455] PINT_sys_release: id 206
[D 15:30:32.700511] PINT_sys_release: id 206
[D 15:30:32.700536] PINT_sys_dev_unexp
[D 15:30:32.700571] client_op_state_get_machine 400
[D 15:30:32.700594] PINT_client_state_machine_post smcb 0x100d7d20, op: PVFS_DEV_UNEXPECTED
[D 15:30:32.700619] Posted PVFS_DEV_UNEXPECTED (210) (waiting for test)(-1073741839)
[D 15:30:32.700653] client_state_machine_terminate smcb 0x100dd9f0
[D 15:30:32.700676] add smcb 0x100dd9f0 to completion list
[D 15:30:32.700699] PINT_sys_release: id 26
[D 15:30:32.700731] PVFS_isys_ref_lookup entered
[D 15:30:32.700772] client_op_state_get_machine 11
[D 15:30:32.700811] lookup got: 4g (parent 1048576)
[D 15:30:32.700834] PINT_client_state_machine_post smcb 0x1014fda0, op: PVFS_SYS_LOOKUP
[D 15:30:32.700859] lookup state: lookup_init
[D 15:30:32.700883] lookup state: lookup_cleanup
[D 15:30:32.700908] Posted PVFS_SYS_LOOKUP (18446744073709551615) (ran to termination)(0)
[D 15:30:32.700940] PINT_sys_release: id -1
[D 15:30:32.700963] PINT_sys_dev_unexp
[D 15:30:32.700987] client_op_state_get_machine 400
[D 15:30:32.701015] PINT_client_state_machine_post smcb 0x100da430, op: PVFS_DEV_UNEXPECTED
[D 15:30:32.701041] Posted PVFS_DEV_UNEXPECTED (212) (waiting for test)(-1073741839)
[D 15:30:32.701074] client_state_machine_terminate smcb 0x100df8e0
[D 15:30:32.701097] add smcb 0x100df8e0 to completion list
[D 15:30:32.701121] PINT_sys_release: id 28
[D 15:30:32.701147] PVFS_isys_getattr entered
[D 15:30:32.701171] client_op_state_get_machine 5
[D 15:30:32.701195] PINT_client_state_machine_post smcb 0x1014fda0, op: PVFS_SYS_GETATTR
[D 15:30:32.701220] (0x100df8e0) getattr_object_getattr_setup_msgpair
[D 15:30:32.701249] BMI_post_recv: addr: 269773808, offset: 0x10151030, size: 9280, tag: 10
[D 15:30:32.701273] post_recv: new rq 0x100e0100.
[D 15:30:32.701297] memcache_register: hit [0] 0x10151030 len 9280 (via 0x10151030 len 9280) refcnt now 2.
[D 15:30:32.701328] BMI_post_sendunexpected_list: addr: 269773808, count: 1, total_size: 40, tag: 10
[D 15:30:32.701352]    element 0: offset: 0x1014f900, size: 40
[D 15:30:32.701375] post_send: sq 0x100ddb20 len 40 peer da13:3345.
[D 15:30:32.701402] encourage_send_waiting_buffer: sq 0x100ddb20 sent EAGER len 40.
[D 15:30:32.701427] Posted PVFS_SYS_GETATTR (215) (waiting for test)(-1073741839)
[D 15:30:32.701455] ib_check_cq: send to da13:3345 completed locally: -> SQ_WAITING_USER_TEST.
[D 15:30:32.701478] test_sq: sq 0x100ddb20 completed 40 to da13:3345.
[D 15:30:32.702640] ib_check_cq: recv from da13:3345 len 144 type MSG_EAGER_SEND credit 1.
[D 15:30:32.702664] encourage_recv_incoming: recv eager len 144.
[D 15:30:32.702688] encourage_recv_incoming: matched rq 0x100e0100 now RQ_EAGER_WAITING_USER_TEST.
[D 15:30:32.702712] encourage_recv_incoming: early registration not needed, dereg after eager.
[D 15:30:32.702734] memcache_deregister: dec refcount [0] 0x10151030 len 9280 (via 0x10151030 len 9280) refcnt now 1.
[D 15:30:32.702759] test_rq: rq 0x100e0100 completed 128 from da13:3345.
[D 15:30:32.702805] BMI_post_recv: addr: 269773808, offset: 0x10151030, size: 9280, tag: 11
[D 15:30:32.702831] post_recv: new rq 0x100e0230.
[D 15:30:32.702854] memcache_register: hit [0] 0x10151030 len 9280 (via 0x10151030 len 9280) refcnt now 2.
[D 15:30:32.702884] BMI_post_sendunexpected_list: addr: 269773808, count: 1, total_size: 40, tag: 11
[D 15:30:32.702908]    element 0: offset: 0x100d86a0, size: 40
[D 15:30:32.702932] post_send: sq 0x100ddbd0 len 40 peer da13:3345.
[D 15:30:32.702958] encourage_send_waiting_buffer: sq 0x100ddbd0 sent EAGER len 40.
[D 15:30:32.703022] BMI_post_recv: addr: 269321776, offset: 0x10156400, size: 9280, tag: 12
[E 15:30:32.705926] Warning: openib_new_connection: asked for 70 send WRs on QP, got 0.
[D 15:30:32.706863] ib_check_cq: send to da13:3345 completed locally: -> SQ_WAITING_USER_TEST.
[D 15:30:32.706905] ib_check_cq: recv from da13:3345 len 88 type MSG_EAGER_SEND credit 1.
[D 15:30:32.706931] encourage_recv_incoming: recv eager len 88.
[D 15:30:32.706956] encourage_recv_incoming: matched rq 0x100e0230 now RQ_EAGER_WAITING_USER_TEST.
[D 15:30:32.706980] encourage_recv_incoming: early registration not needed, dereg after eager.
[D 15:30:32.707004] memcache_deregister: dec refcount [0] 0x10151030 len 9280 (via 0x10151030 len 9280) refcnt now 1.
[D 15:30:32.707031] post_recv: new rq 0x10150a30.
[D 15:30:32.707055] memcache_register: hit [0] 0x10156400 len 9280 (via 0x10156400 len 9280) refcnt now 2.
[D 15:30:32.707088] test_sq: sq 0x100ddbd0 completed 40 to da13:3345.
[D 15:30:32.707113] test_rq: rq 0x100e0230 completed 72 from da13:3345.
[D 15:30:32.707145] BMI_post_sendunexpected_list: addr: 269321776, count: 1, total_size: 40, tag: 12
[D 15:30:32.707170]    element 0: offset: 0x100ddd40, size: 40
[D 15:30:32.707195] post_send: sq 0x100ddbd0 len 40 peer da12:3345.
[D 15:30:32.707220] encourage_send_waiting_buffer: sq 0x100ddbd0 sent EAGER len 40.
[D 15:30:32.707257] ib_check_cq: send to da12:3345 completed locally: -> SQ_WAITING_USER_TEST.
[D 15:30:32.707282] test_sq: sq 0x100ddbd0 completed 40 to da12:3345.
[D 15:30:32.718398] ib_check_cq: recv from da12:3345 len 88 type MSG_EAGER_SEND credit 1.
[D 15:30:32.718422] encourage_recv_incoming: recv eager len 88.
[D 15:30:32.718446] encourage_recv_incoming: matched rq 0x10150a30 now RQ_EAGER_WAITING_USER_TEST.
[D 15:30:32.718469] encourage_recv_incoming: early registration not needed, dereg after eager.
[D 15:30:32.718492] memcache_deregister: dec refcount [0] 0x10156400 len 9280 (via 0x10156400 len 9280) refcnt now 1.
[D 15:30:32.718518] test_rq: rq 0x10150a30 completed 72 from da12:3345.
[D 15:30:32.718561] trying to add object reference to acache
[D 15:30:32.718584] (0x100df8e0) getattr state: getattr_cleanup
[D 15:30:32.718609] client_state_machine_terminate smcb 0x1014fda0
[D 15:30:32.718632] add smcb 0x1014fda0 to completion list
[D 15:30:32.718655] PINT_sys_release: id 215
[D 15:30:32.718696] PINT_sys_release: id 215
[D 15:30:32.718726] PINT_sys_dev_unexp
[D 15:30:32.718760] client_op_state_get_machine 400
[D 15:30:32.718788] PINT_client_state_machine_post smcb 0x100ddd70, op: PVFS_DEV_UNEXPECTED
[D 15:30:32.718816] Posted PVFS_DEV_UNEXPECTED (222) (waiting for test)(-1073741839)
[D 15:30:32.718855] client_state_machine_terminate smcb 0x100e17d0
[D 15:30:32.718879] add smcb 0x100e17d0 to completion list
[D 15:30:32.718902] PINT_sys_release: id 30
[D 15:30:32.718930] PVFS_isys_getattr entered
[D 15:30:32.718955] client_op_state_get_machine 5
[D 15:30:32.718981] PINT_client_state_machine_post smcb 0x1014fda0, op: PVFS_SYS_GETATTR
[D 15:30:32.719008] (0x100e17d0) getattr state: getattr_cleanup
[D 15:30:32.719033] Posted PVFS_SYS_GETATTR (18446744073709551615) (ran to termination)(0)
[D 15:30:32.719063] PINT_sys_release: id -1
[D 15:30:32.719102] PINT_sys_dev_unexp
[D 15:30:32.719126] client_op_state_get_machine 400
[D 15:30:32.719149] PINT_client_state_machine_post smcb 0x100dd9f0, op: PVFS_DEV_UNEXPECTED
[D 15:30:32.719175] Posted PVFS_DEV_UNEXPECTED (224) (waiting for test)(-1073741839)
[D 15:30:32.719207] client_state_machine_terminate smcb 0x100e36c0
[D 15:30:32.719231] add smcb 0x100e36c0 to completion list
[D 15:30:32.719254] PINT_sys_release: id 32
[D 15:30:32.719281] PVFS_isys_ref_lookup entered
[D 15:30:32.719305] client_op_state_get_machine 11
[D 15:30:32.719337] lookup got: 4g (parent 1048576)
[D 15:30:32.719361] PINT_client_state_machine_post smcb 0x1014fda0, op: PVFS_SYS_LOOKUP
[D 15:30:32.719385] lookup state: lookup_init
[D 15:30:32.719410] lookup state: lookup_segment_lookup_setup_msgpair
[D 15:30:32.719442] lookup_ncache state: lookup
[D 15:30:32.719466] lookup_ncache state: lookup_ncache_lookup on segment [4g]
[D 15:30:32.719529] BMI_post_recv: addr: 269773808, offset: 0x10159f00, size: 8224, tag: 13
[D 15:30:32.719555] post_recv: new rq 0x100e0230.
[D 15:30:32.719579] memcache_register: hit [0] 0x10159f00 len 8224 (via 0x10159f00 len 8224) refcnt now 2.
[D 15:30:32.719614] BMI_post_sendunexpected_list: addr: 269773808, count: 1, total_size: 52, tag: 13
[D 15:30:32.719639]    element 0: offset: 0x100e3ee0, size: 52
[D 15:30:32.719663] post_send: sq 0x100ddc00 len 52 peer da13:3345.
[D 15:30:32.719689] encourage_send_waiting_buffer: sq 0x100ddc00 sent EAGER len 52.
[D 15:30:32.719715] Posted PVFS_SYS_LOOKUP (227) (waiting for test)(-1073741839)
[D 15:30:32.719742] ib_check_cq: send to da13:3345 completed locally: -> SQ_WAITING_USER_TEST.
[D 15:30:32.719766] test_sq: sq 0x100ddc00 completed 52 to da13:3345.
[D 15:30:32.721166] ib_check_cq: recv from da13:3345 len 104 type MSG_EAGER_SEND credit 1.
[D 15:30:32.721192] encourage_recv_incoming: recv eager len 104.
[D 15:30:32.721215] encourage_recv_incoming: matched rq 0x100e0230 now RQ_EAGER_WAITING_USER_TEST.
[D 15:30:32.721239] encourage_recv_incoming: early registration not needed, dereg after eager.
[D 15:30:32.721261] memcache_deregister: dec refcount [0] 0x10159f00 len 8224 (via 0x10159f00 len 8224) refcnt now 1.
[D 15:30:32.721286] test_rq: rq 0x100e0230 completed 88 from da13:3345.
[D 15:30:32.721318] lookup_segment_lookup_comp_fn
[D 15:30:32.721350] lookup state: lookup_segment_verify_attr_present
[D 15:30:32.721374] lookup state: lookup_segment_check_attr_type
[D 15:30:32.721398] lookup state: lookup_context_check_completion
[D 15:30:32.721421] lookup state: lookup_cleanup
[D 15:30:32.721445] client_state_machine_terminate smcb 0x1014fda0
[D 15:30:32.721467] add smcb 0x1014fda0 to completion list
[D 15:30:32.721490] PINT_sys_release: id 227
[D 15:30:32.721523] PINT_sys_release: id 227
[D 15:30:32.721548] PINT_sys_dev_unexp
[D 15:30:32.721571] client_op_state_get_machine 400
[D 15:30:32.721594] PINT_client_state_machine_post smcb 0x100e1ff0, op: PVFS_DEV_UNEXPECTED
[D 15:30:32.721620] Posted PVFS_DEV_UNEXPECTED (229) (waiting for test)(-1073741839)
[D 15:30:32.721652] client_state_machine_terminate smcb 0x100e55b0
[D 15:30:32.721676] add smcb 0x100e55b0 to completion list
[D 15:30:32.721699] PINT_sys_release: id 34
[D 15:30:32.721726] PVFS_isys_getattr entered
[D 15:30:32.721750] client_op_state_get_machine 5
[D 15:30:32.721774] PINT_client_state_machine_post smcb 0x1014fda0, op: PVFS_SYS_GETATTR
[D 15:30:32.721799] (0x100e55b0) getattr state: getattr_cleanup
[D 15:30:32.721824] Posted PVFS_SYS_GETATTR (18446744073709551615) (ran to termination)(0)
[D 15:30:32.721855] PINT_sys_release: id -1
[D 15:30:32.721879] PINT_sys_dev_unexp
[D 15:30:32.721903] client_op_state_get_machine 400
[D 15:30:32.721927] PINT_client_state_machine_post smcb 0x100e3ee0, op: PVFS_DEV_UNEXPECTED
[D 15:30:32.721952] Posted PVFS_DEV_UNEXPECTED (231) (waiting for test)(-1073741839)
[D 15:30:32.721984] client_state_machine_terminate smcb 0x100e74a0
[D 15:30:32.722011] add smcb 0x100e74a0 to completion list
[D 15:30:32.722035] PINT_sys_release: id 36
[D 15:30:32.722061] PVFS_isys_ref_lookup entered
[D 15:30:32.722084] client_op_state_get_machine 11
[D 15:30:32.722110] lookup got: np1 (parent 1048576)
[D 15:30:32.722133] PINT_client_state_machine_post smcb 0x1014fda0, op: PVFS_SYS_LOOKUP
[D 15:30:32.722157] lookup state: lookup_init
[D 15:30:32.722183] lookup state: lookup_segment_lookup_setup_msgpair
[D 15:30:32.722208] lookup_ncache state: lookup
[D 15:30:32.722231] lookup_ncache state: lookup_ncache_lookup on segment [np1]
[D 15:30:32.722258] BMI_post_recv: addr: 269773808, offset: 0x10159f00, size: 8224, tag: 14
[D 15:30:32.722284] post_recv: new rq 0x100e0230.
[D 15:30:32.722307] memcache_register: hit [0] 0x10159f00 len 8224 (via 0x10159f00 len 8224) refcnt now 2.
[D 15:30:32.722337] BMI_post_sendunexpected_list: addr: 269773808, count: 1, total_size: 52, tag: 14
[D 15:30:32.722362]    element 0: offset: 0x100e7cc0, size: 52
[D 15:30:32.722385] post_send: sq 0x10150b60 len 52 peer da13:3345.
[D 15:30:32.722412] encourage_send_waiting_buffer: sq 0x10150b60 sent EAGER len 52.
[D 15:30:32.722436] Posted PVFS_SYS_LOOKUP (234) (waiting for test)(-1073741839)
[D 15:30:32.722464] ib_check_cq: send to da13:3345 completed locally: -> SQ_WAITING_USER_TEST.
[D 15:30:32.722491] test_sq: sq 0x10150b60 completed 52 to da13:3345.
[D 15:30:32.723517] ib_check_cq: recv from da13:3345 len 104 type MSG_EAGER_SEND credit 1.
[D 15:30:32.723542] encourage_recv_incoming: recv eager len 104.
[D 15:30:32.723566] encourage_recv_incoming: matched rq 0x100e0230 now RQ_EAGER_WAITING_USER_TEST.
[D 15:30:32.723588] encourage_recv_incoming: early registration not needed, dereg after eager.
[D 15:30:32.723611] memcache_deregister: dec refcount [0] 0x10159f00 len 8224 (via 0x10159f00 len 8224) refcnt now 1.
[D 15:30:32.723636] test_rq: rq 0x100e0230 completed 88 from da13:3345.
[D 15:30:32.723665] lookup_segment_lookup_comp_fn
[D 15:30:32.723693] lookup state: lookup_segment_verify_attr_present
[D 15:30:32.723716] lookup state: lookup_segment_check_attr_type
[D 15:30:32.723739] lookup state: lookup_context_check_completion
[D 15:30:32.723762] lookup state: lookup_cleanup
[D 15:30:32.723786] client_state_machine_terminate smcb 0x1014fda0
[D 15:30:32.723809] add smcb 0x1014fda0 to completion list
[D 15:30:32.723832] PINT_sys_release: id 234
[D 15:30:32.723863] PINT_sys_release: id 234
[D 15:30:32.723887] PINT_sys_dev_unexp
[D 15:30:32.723912] client_op_state_get_machine 400
[D 15:30:32.723935] PINT_client_state_machine_post smcb 0x100e5dd0, op: PVFS_DEV_UNEXPECTED
[D 15:30:32.723960] Posted PVFS_DEV_UNEXPECTED (236) (waiting for test)(-1073741839)
[D 15:30:32.723993] client_state_machine_terminate smcb 0x100e9390
[D 15:30:32.724021] add smcb 0x100e9390 to completion list
[D 15:30:32.724047] PINT_sys_release: id 38
[D 15:30:32.724077] PVFS_isys_getattr entered
[D 15:30:32.724103] client_op_state_get_machine 5
[D 15:30:32.724129] PINT_client_state_machine_post smcb 0x1014fda0, op: PVFS_SYS_GETATTR
[D 15:30:32.724154] (0x100e9390) getattr_object_getattr_setup_msgpair
[D 15:30:32.724184] BMI_post_recv: addr: 269773808, offset: 0x10156400, size: 9280, tag: 15
[D 15:30:32.724208] post_recv: new rq 0x100e9ce0.
[D 15:30:32.724232] memcache_register: hit [0] 0x10156400 len 9280 (via 0x10156400 len 9280) refcnt now 2.
[D 15:30:32.724263] BMI_post_sendunexpected_list: addr: 269773808, count: 1, total_size: 40, tag: 15
[D 15:30:32.724287]    element 0: offset: 0x100d2a50, size: 40
[D 15:30:32.724311] post_send: sq 0x10150a30 len 40 peer da13:3345.
[D 15:30:32.724337] encourage_send_waiting_buffer: sq 0x10150a30 sent EAGER len 40.
[D 15:30:32.724363] Posted PVFS_SYS_GETATTR (239) (waiting for test)(-1073741839)
[D 15:30:32.724390] ib_check_cq: send to da13:3345 completed locally: -> SQ_WAITING_USER_TEST.
[D 15:30:32.724414] test_sq: sq 0x10150a30 completed 40 to da13:3345.
[D 15:30:32.725132] ib_check_cq: recv from da13:3345 len 144 type MSG_EAGER_SEND credit 1.
[D 15:30:32.725156] encourage_recv_incoming: recv eager len 144.
[D 15:30:32.725180] encourage_recv_incoming: matched rq 0x100e9ce0 now RQ_EAGER_WAITING_USER_TEST.
[D 15:30:32.725204] encourage_recv_incoming: early registration not needed, dereg after eager.
[D 15:30:32.725227] memcache_deregister: dec refcount [0] 0x10156400 len 9280 (via 0x10156400 len 9280) refcnt now 1.
[D 15:30:32.725253] test_rq: rq 0x100e9ce0 completed 128 from da13:3345.
[D 15:30:32.725293] BMI_post_recv: addr: 269773808, offset: 0x10156400, size: 9280, tag: 16
[D 15:30:32.725318] post_recv: new rq 0x100e9bb0.
[D 15:30:32.725342] memcache_register: hit [0] 0x10156400 len 9280 (via 0x10156400 len 9280) refcnt now 2.
[D 15:30:32.725373] BMI_post_sendunexpected_list: addr: 269773808, count: 1, total_size: 40, tag: 16
[D 15:30:32.725397]    element 0: offset: 0x100d2a50, size: 40
[D 15:30:32.725420] post_send: sq 0x100e7cc0 len 40 peer da13:3345.
[D 15:30:32.725446] encourage_send_waiting_buffer: sq 0x100e7cc0 sent EAGER len 40.
[D 15:30:32.725474] BMI_post_recv: addr: 269321776, offset: 0x10151030, size: 9280, tag: 17
[D 15:30:32.725500] ib_check_cq: send to da13:3345 completed locally: -> SQ_WAITING_USER_TEST.
[D 15:30:32.725523] post_recv: new rq 0x10150cd0.
[D 15:30:32.725546] memcache_register: hit [0] 0x10151030 len 9280 (via 0x10151030 len 9280) refcnt now 2.
[D 15:30:32.725577] test_sq: sq 0x100e7cc0 completed 40 to da13:3345.
[D 15:30:32.725605] BMI_post_sendunexpected_list: addr: 269321776, count: 1, total_size: 40, tag: 17
[D 15:30:32.725629]    element 0: offset: 0x100e7e00, size: 40
[D 15:30:32.725653] post_send: sq 0x100e7e30 len 40 peer da12:3345.
[D 15:30:32.725679] encourage_send_waiting_buffer: sq 0x100e7e30 sent EAGER len 40.
[D 15:30:32.725711] ib_check_cq: send to da12:3345 completed locally: -> SQ_WAITING_USER_TEST.
[D 15:30:32.725736] test_sq: sq 0x100e7e30 completed 40 to da12:3345.
[D 15:30:32.726406] ib_check_cq: recv from da13:3345 len 88 type MSG_EAGER_SEND credit 1.
[D 15:30:32.726430] encourage_recv_incoming: recv eager len 88.
[D 15:30:32.726453] encourage_recv_incoming: matched rq 0x100e9bb0 now RQ_EAGER_WAITING_USER_TEST.
[D 15:30:32.726476] encourage_recv_incoming: early registration not needed, dereg after eager.
[D 15:30:32.726499] memcache_deregister: dec refcount [0] 0x10156400 len 9280 (via 0x10156400 len 9280) refcnt now 1.
[D 15:30:32.726525] test_rq: rq 0x100e9bb0 completed 72 from da13:3345.
[D 15:30:32.729469] ib_check_cq: recv from da12:3345 len 88 type MSG_EAGER_SEND credit 1.
[D 15:30:32.729494] encourage_recv_incoming: recv eager len 88.
[D 15:30:32.729516] encourage_recv_incoming: matched rq 0x10150cd0 now RQ_EAGER_WAITING_USER_TEST.
[D 15:30:32.729540] encourage_recv_incoming: early registration not needed, dereg after eager.
[D 15:30:32.729563] memcache_deregister: dec refcount [0] 0x10151030 len 9280 (via 0x10151030 len 9280) refcnt now 1.
[D 15:30:32.729588] test_rq: rq 0x10150cd0 completed 72 from da12:3345.
[D 15:30:32.729622] trying to add object reference to acache
[D 15:30:32.729646] (0x100e9390) getattr state: getattr_cleanup
[D 15:30:32.729670] client_state_machine_terminate smcb 0x1014fda0
[D 15:30:32.729693] add smcb 0x1014fda0 to completion list
[D 15:30:32.729716] PINT_sys_release: id 239
[D 15:30:32.729747] PINT_sys_release: id 239
[D 15:30:32.729778] PINT_sys_dev_unexp
[D 15:30:32.729810] client_op_state_get_machine 400
[D 15:30:32.729836] PINT_client_state_machine_post smcb 0x10150ba0, op: PVFS_DEV_UNEXPECTED
[D 15:30:32.729865] Posted PVFS_DEV_UNEXPECTED (245) (waiting for test)(-1073741839)
[D 15:30:32.729902] client_state_machine_terminate smcb 0x100eb280
[D 15:30:32.729925] add smcb 0x100eb280 to completion list
[D 15:30:32.729948] PINT_sys_release: id 40
[D 15:30:32.729974] PVFS_isys_getattr entered
[D 15:30:32.730003] client_op_state_get_machine 5
[D 15:30:32.730028] PINT_client_state_machine_post smcb 0x1014fda0, op: PVFS_SYS_GETATTR
[D 15:30:32.730053] (0x100eb280) getattr state: getattr_cleanup
[D 15:30:32.730078] Posted PVFS_SYS_GETATTR (18446744073709551615) (ran to termination)(0)
[D 15:30:32.730109] PINT_sys_release: id -1
[D 15:30:32.730141] PINT_sys_dev_unexp
[D 15:30:32.730165] client_op_state_get_machine 400
[D 15:30:32.730188] PINT_client_state_machine_post smcb 0x100e7cc0, op: PVFS_DEV_UNEXPECTED
[D 15:30:32.730213] Posted PVFS_DEV_UNEXPECTED (247) (waiting for test)(-1073741839)
[D 15:30:32.730246] client_state_machine_terminate smcb 0x100ed170
[D 15:30:32.730270] add smcb 0x100ed170 to completion list
[D 15:30:32.730293] PINT_sys_release: id 42
[D 15:30:32.730319] PVFS_isys_ref_lookup entered
[D 15:30:32.730343] client_op_state_get_machine 11
[D 15:30:32.730369] lookup got: np1 (parent 1048576)
[D 15:30:32.730392] PINT_client_state_machine_post smcb 0x1014fda0, op: PVFS_SYS_LOOKUP
[D 15:30:32.730416] lookup state: lookup_init
[D 15:30:32.730440] lookup state: lookup_segment_lookup_setup_msgpair
[D 15:30:32.730464] lookup_ncache state: lookup
[D 15:30:32.730487] lookup_ncache state: lookup_ncache_lookup on segment [np1]
[D 15:30:32.730515] BMI_post_recv: addr: 269773808, offset: 0x10159f00, size: 8224, tag: 18
[D 15:30:32.730541] post_recv: new rq 0x100e9ce0.
[D 15:30:32.730564] memcache_register: hit [0] 0x10159f00 len 8224 (via 0x10159f00 len 8224) refcnt now 2.
[D 15:30:32.730595] BMI_post_sendunexpected_list: addr: 269773808, count: 1, total_size: 52, tag: 18
[D 15:30:32.730622]    element 0: offset: 0x100ed990, size: 52
[D 15:30:32.730646] post_send: sq 0x10150d80 len 52 peer da13:3345.
[D 15:30:32.730672] encourage_send_waiting_buffer: sq 0x10150d80 sent EAGER len 52.
[D 15:30:32.730697] Posted PVFS_SYS_LOOKUP (250) (waiting for test)(-1073741839)
[D 15:30:32.730725] ib_check_cq: send to da13:3345 completed locally: -> SQ_WAITING_USER_TEST.
[D 15:30:32.730749] test_sq: sq 0x10150d80 completed 52 to da13:3345.
[D 15:30:32.731707] ib_check_cq: recv from da13:3345 len 104 type MSG_EAGER_SEND credit 1.
[D 15:30:32.731731] encourage_recv_incoming: recv eager len 104.
[D 15:30:32.731755] encourage_recv_incoming: matched rq 0x100e9ce0 now RQ_EAGER_WAITING_USER_TEST.
[D 15:30:32.731779] encourage_recv_incoming: early registration not needed, dereg after eager.
[D 15:30:32.731801] memcache_deregister: dec refcount [0] 0x10159f00 len 8224 (via 0x10159f00 len 8224) refcnt now 1.
[D 15:30:32.731826] test_rq: rq 0x100e9ce0 completed 88 from da13:3345.
[D 15:30:32.731855] lookup_segment_lookup_comp_fn
[D 15:30:32.731884] lookup state: lookup_segment_verify_attr_present
[D 15:30:32.731906] lookup state: lookup_segment_check_attr_type
[D 15:30:32.731929] lookup state: lookup_context_check_completion
[D 15:30:32.731952] lookup state: lookup_cleanup
[D 15:30:32.731976] client_state_machine_terminate smcb 0x1014fda0
[D 15:30:32.731998] add smcb 0x1014fda0 to completion list
[D 15:30:32.732027] PINT_sys_release: id 250
[D 15:30:32.732062] PINT_sys_release: id 250
[D 15:30:32.732089] PINT_sys_dev_unexp
[D 15:30:32.732116] client_op_state_get_machine 400
[D 15:30:32.732139] PINT_client_state_machine_post smcb 0x100ebc00, op: PVFS_DEV_UNEXPECTED
[D 15:30:32.732165] Posted PVFS_DEV_UNEXPECTED (252) (waiting for test)(-1073741839)
[D 15:30:32.732199] client_state_machine_terminate smcb 0x100ef060
[D 15:30:32.732223] add smcb 0x100ef060 to completion list
[D 15:30:32.732246] PINT_sys_release: id 44
[D 15:30:32.732273] PVFS_isys_getattr entered
[D 15:30:32.732296] client_op_state_get_machine 5
[D 15:30:32.732320] PINT_client_state_machine_post smcb 0x1014fda0, op: PVFS_SYS_GETATTR
[D 15:30:32.732346] (0x100ef060) getattr state: getattr_cleanup
[D 15:30:32.732371] Posted PVFS_SYS_GETATTR (18446744073709551615) (ran to termination)(0)
[D 15:30:32.732400] PINT_sys_release: id -1
[D 15:30:32.732434] PINT_sys_dev_unexp
[D 15:30:32.732458] client_op_state_get_machine 400
[D 15:30:32.732481] PINT_client_state_machine_post smcb 0x100edaf0, op: PVFS_DEV_UNEXPECTED
[D 15:30:32.732505] Posted PVFS_DEV_UNEXPECTED (254) (waiting for test)(-1073741839)
[D 15:30:32.732538] client_state_machine_terminate smcb 0x100f0f50
[D 15:30:32.732561] add smcb 0x100f0f50 to completion list
[D 15:30:32.732584] PINT_sys_release: id 46
[D 15:30:32.732610] PVFS_isys_ref_lookup entered
[D 15:30:32.732635] client_op_state_get_machine 11
[D 15:30:32.732661] lookup got: lost+found (parent 1048576)
[D 15:30:32.732684] PINT_client_state_machine_post smcb 0x1014fda0, op: PVFS_SYS_LOOKUP
[D 15:30:32.732707] lookup state: lookup_init
[D 15:30:32.732731] lookup state: lookup_segment_lookup_setup_msgpair
[D 15:30:32.732756] lookup_ncache state: lookup
[D 15:30:32.732779] lookup_ncache state: lookup_ncache_lookup on segment [lost+found]
[D 15:30:32.732807] BMI_post_recv: addr: 269773808, offset: 0x10159f00, size: 8224, tag: 19
[D 15:30:32.732832] post_recv: new rq 0x100e0230.
[D 15:30:32.732855] memcache_register: hit [0] 0x10159f00 len 8224 (via 0x10159f00 len 8224) refcnt now 2.
[D 15:30:32.732887] BMI_post_sendunexpected_list: addr: 269773808, count: 1, total_size: 60, tag: 19
[D 15:30:32.732912]    element 0: offset: 0x100f1770, size: 60
[D 15:30:32.732934] post_send: sq 0x10150d80 len 60 peer da13:3345.
[D 15:30:32.732961] encourage_send_waiting_buffer: sq 0x10150d80 sent EAGER len 60.
[D 15:30:32.732986] Posted PVFS_SYS_LOOKUP (257) (waiting for test)(-1073741839)
[D 15:30:32.733014] ib_check_cq: send to da13:3345 completed locally: -> SQ_WAITING_USER_TEST.
[D 15:30:32.733037] test_sq: sq 0x10150d80 completed 60 to da13:3345.
[D 15:30:32.734104] ib_check_cq: recv from da13:3345 len 104 type MSG_EAGER_SEND credit 1.
[D 15:30:32.734128] encourage_recv_incoming: recv eager len 104.
[D 15:30:32.734152] encourage_recv_incoming: matched rq 0x100e0230 now RQ_EAGER_WAITING_USER_TEST.
[D 15:30:32.734175] encourage_recv_incoming: early registration not needed, dereg after eager.
[D 15:30:32.734199] memcache_deregister: dec refcount [0] 0x10159f00 len 8224 (via 0x10159f00 len 8224) refcnt now 1.
[D 15:30:32.734224] test_rq: rq 0x100e0230 completed 88 from da13:3345.
[D 15:30:32.734252] lookup_segment_lookup_comp_fn
[D 15:30:32.734281] lookup state: lookup_segment_verify_attr_present
[D 15:30:32.734304] lookup state: lookup_segment_check_attr_type
[D 15:30:32.734327] lookup state: lookup_context_check_completion
[D 15:30:32.734350] lookup state: lookup_cleanup
[D 15:30:32.734373] client_state_machine_terminate smcb 0x1014fda0
[D 15:30:32.734395] add smcb 0x1014fda0 to completion list
[D 15:30:32.734419] PINT_sys_release: id 257
[D 15:30:32.734451] PINT_sys_release: id 257
[D 15:30:32.734475] PINT_sys_dev_unexp
[D 15:30:32.734499] client_op_state_get_machine 400
[D 15:30:32.734522] PINT_client_state_machine_post smcb 0x100ef9e0, op: PVFS_DEV_UNEXPECTED
[D 15:30:32.734547] Posted PVFS_DEV_UNEXPECTED (259) (waiting for test)(-1073741839)
[D 15:30:32.734580] client_state_machine_terminate smcb 0x100f2e40
[D 15:30:32.734603] add smcb 0x100f2e40 to completion list
[D 15:30:32.734626] PINT_sys_release: id 48
[D 15:30:32.734653] PVFS_isys_getattr entered
[D 15:30:32.734677] client_op_state_get_machine 5
[D 15:30:32.734701] PINT_client_state_machine_post smcb 0x1014fda0, op: PVFS_SYS_GETATTR
[D 15:30:32.734725] (0x100f2e40) getattr_object_getattr_setup_msgpair
[D 15:30:32.734753] BMI_post_recv: addr: 269773808, offset: 0x10151030, size: 9280, tag: 20
[D 15:30:32.734779] post_recv: new rq 0x100f3660.
[D 15:30:32.734803] memcache_register: hit [0] 0x10151030 len 9280 (via 0x10151030 len 9280) refcnt now 2.
[D 15:30:32.734833] BMI_post_sendunexpected_list: addr: 269773808, count: 1, total_size: 40, tag: 20
[D 15:30:32.734857]    element 0: offset: 0x100d4890, size: 40
[D 15:30:32.734881] post_send: sq 0x100e9ce0 len 40 peer da13:3345.
[D 15:30:32.734907] encourage_send_waiting_buffer: sq 0x100e9ce0 sent EAGER len 40.
[D 15:30:32.734932] Posted PVFS_SYS_GETATTR (262) (waiting for test)(-1073741839)
[D 15:30:32.734959] ib_check_cq: send to da13:3345 completed locally: -> SQ_WAITING_USER_TEST.
[D 15:30:32.734984] test_sq: sq 0x100e9ce0 completed 40 to da13:3345.
[D 15:30:32.738451] ib_check_cq: recv from da13:3345 len 124 type MSG_EAGER_SEND credit 1.
[D 15:30:32.738474] encourage_recv_incoming: recv eager len 124.
[D 15:30:32.738499] encourage_recv_incoming: matched rq 0x100f3660 now RQ_EAGER_WAITING_USER_TEST.
[D 15:30:32.738522] encourage_recv_incoming: early registration not needed, dereg after eager.
[D 15:30:32.738545] memcache_deregister: dec refcount [0] 0x10151030 len 9280 (via 0x10151030 len 9280) refcnt now 1.
[D 15:30:32.738570] test_rq: rq 0x100f3660 completed 108 from da13:3345.
[D 15:30:32.738598] getattr comp_fn [0x100f2e78] dfile_count = 0 dist_name_len = 0 dist_params_len = 0
[D 15:30:32.738627] trying to add object reference to acache
[D 15:30:32.738650] (0x100f2e40) getattr state: getattr_cleanup
[D 15:30:32.738673] dfile_count: 0
[D 15:30:32.738695] dist_name_len = 0, dist_params_len = 0
[D 15:30:32.738718] client_state_machine_terminate smcb 0x1014fda0
[D 15:30:32.738740] add smcb 0x1014fda0 to completion list
[D 15:30:32.738764] PINT_sys_release: id 262
[D 15:30:32.738796] PINT_sys_release: id 262
[D 15:30:32.738824] PINT_sys_dev_unexp
[D 15:30:32.738857] client_op_state_get_machine 400
[D 15:30:32.738883] PINT_client_state_machine_post smcb 0x100e9bb0, op: PVFS_DEV_UNEXPECTED
[D 15:30:32.738910] Posted PVFS_DEV_UNEXPECTED (264) (waiting for test)(-1073741839)
[D 15:30:32.738947] client_state_machine_terminate smcb 0x100f4d30
[D 15:30:32.738971] add smcb 0x100f4d30 to completion list
[D 15:30:32.738994] PINT_sys_release: id 50
[D 15:30:32.739021] PVFS_isys_getattr entered
[D 15:30:32.739048] client_op_state_get_machine 5
[D 15:30:32.739071] PINT_client_state_machine_post smcb 0x1014fda0, op: PVFS_SYS_GETATTR
[D 15:30:32.739097] (0x100f4d30) getattr state: getattr_cleanup
[D 15:30:32.739120] dfile_count: 0
[D 15:30:32.739142] dist_name_len = 0, dist_params_len = 0
[D 15:30:32.739165] Posted PVFS_SYS_GETATTR (18446744073709551615) (ran to termination)(0)
[D 15:30:32.739195] PINT_sys_release: id -1
[D 15:30:32.739228] PINT_sys_dev_unexp
[D 15:30:32.739252] client_op_state_get_machine 400
[D 15:30:32.739274] PINT_client_state_machine_post smcb 0x100f3660, op: PVFS_DEV_UNEXPECTED
[D 15:30:32.739299] Posted PVFS_DEV_UNEXPECTED (266) (waiting for test)(-1073741839)
[D 15:30:32.739332] client_state_machine_terminate smcb 0x100f6c20
[D 15:30:32.739356] add smcb 0x100f6c20 to completion list
[D 15:30:32.739378] PINT_sys_release: id 52
[D 15:30:32.739405] PVFS_isys_ref_lookup entered
[D 15:30:32.739429] client_op_state_get_machine 11
[D 15:30:32.739455] lookup got: lost+found (parent 1048576)
[D 15:30:32.739478] PINT_client_state_machine_post smcb 0x1014fda0, op: PVFS_SYS_LOOKUP
[D 15:30:32.739501] lookup state: lookup_init
[D 15:30:32.739525] lookup state: lookup_segment_lookup_setup_msgpair
[D 15:30:32.739550] lookup_ncache state: lookup
[D 15:30:32.739573] lookup_ncache state: lookup_ncache_lookup on segment [lost+found]
[D 15:30:32.739601] BMI_post_recv: addr: 269773808, offset: 0x10159f00, size: 8224, tag: 21
[D 15:30:32.739625] post_recv: new rq 0x100f5680.
[D 15:30:32.739649] memcache_register: hit [0] 0x10159f00 len 8224 (via 0x10159f00 len 8224) refcnt now 2.
[D 15:30:32.739680] BMI_post_sendunexpected_list: addr: 269773808, count: 1, total_size: 60, tag: 21
[D 15:30:32.739705]    element 0: offset: 0x100f7440, size: 60
[D 15:30:32.739728] post_send: sq 0x10150d80 len 60 peer da13:3345.
[D 15:30:32.739754] encourage_send_waiting_buffer: sq 0x10150d80 sent EAGER len 60.
[D 15:30:32.739779] Posted PVFS_SYS_LOOKUP (269) (waiting for test)(-1073741839)
[D 15:30:32.739807] ib_check_cq: send to da13:3345 completed locally: -> SQ_WAITING_USER_TEST.
[D 15:30:32.739830] test_sq: sq 0x10150d80 completed 60 to da13:3345.
[D 15:30:32.740779] ib_check_cq: recv from da13:3345 len 104 type MSG_EAGER_SEND credit 1.
[D 15:30:32.740804] encourage_recv_incoming: recv eager len 104.
[D 15:30:32.740828] encourage_recv_incoming: matched rq 0x100f5680 now RQ_EAGER_WAITING_USER_TEST.
[D 15:30:32.740851] encourage_recv_incoming: early registration not needed, dereg after eager.
[D 15:30:32.740874] memcache_deregister: dec refcount [0] 0x10159f00 len 8224 (via 0x10159f00 len 8224) refcnt now 1.
[D 15:30:32.740900] test_rq: rq 0x100f5680 completed 88 from da13:3345.
[D 15:30:32.740928] lookup_segment_lookup_comp_fn
[D 15:30:32.740956] lookup state: lookup_segment_verify_attr_present
[D 15:30:32.740980] lookup state: lookup_segment_check_attr_type
[D 15:30:32.741003] lookup state: lookup_context_check_completion
[D 15:30:32.741024] lookup state: lookup_cleanup
[D 15:30:32.741048] client_state_machine_terminate smcb 0x1014fda0
[D 15:30:32.741071] add smcb 0x1014fda0 to completion list
[D 15:30:32.741094] PINT_sys_release: id 269
[D 15:30:32.741127] PINT_sys_release: id 269
[D 15:30:32.741150] PINT_sys_dev_unexp
[D 15:30:32.741174] client_op_state_get_machine 400
[D 15:30:32.741197] PINT_client_state_machine_post smcb 0x100f5550, op: PVFS_DEV_UNEXPECTED
[D 15:30:32.741222] Posted PVFS_DEV_UNEXPECTED (271) (waiting for test)(-1073741839)
[D 15:30:32.741254] client_state_machine_terminate smcb 0x100f8b10
[D 15:30:32.741278] add smcb 0x100f8b10 to completion list
[D 15:30:32.741301] PINT_sys_release: id 54
[D 15:30:32.741328] PVFS_isys_getattr entered
[D 15:30:32.741352] client_op_state_get_machine 5
[D 15:30:32.741375] PINT_client_state_machine_post smcb 0x1014fda0, op: PVFS_SYS_GETATTR
[D 15:30:32.741400] (0x100f8b10) getattr state: getattr_cleanup
[D 15:30:32.741423] dfile_count: 0
[D 15:30:32.741445] dist_name_len = 0, dist_params_len = 0
[D 15:30:32.741469] Posted PVFS_SYS_GETATTR (18446744073709551615) (ran to termination)(0)
[D 15:30:32.741501] PINT_sys_release: id -1
[D 15:30:32.741537] PINT_sys_dev_unexp
[D 15:30:32.741560] client_op_state_get_machine 400
[D 15:30:32.741583] PINT_client_state_machine_post smcb 0x100f7440, op: PVFS_DEV_UNEXPECTED
[D 15:30:32.741609] Posted PVFS_DEV_UNEXPECTED (273) (waiting for test)(-1073741839)
[D 15:30:32.741641] client_state_machine_terminate smcb 0x100faa00
[D 15:30:32.741664] add smcb 0x100faa00 to completion list
[D 15:30:32.741687] PINT_sys_release: id 56
[D 15:30:32.741714] PVFS_isys_ref_lookup entered
[D 15:30:32.741738] client_op_state_get_machine 11
[D 15:30:32.741764] lookup got: sm1.testfile (parent 1048576)
[D 15:30:32.741786] PINT_client_state_machine_post smcb 0x1014fda0, op: PVFS_SYS_LOOKUP
[D 15:30:32.741810] lookup state: lookup_init
[D 15:30:32.741834] lookup state: lookup_segment_lookup_setup_msgpair
[D 15:30:32.741859] lookup_ncache state: lookup
[D 15:30:32.741882] lookup_ncache state: lookup_ncache_lookup on segment [sm1.testfile]
[D 15:30:32.741909] BMI_post_recv: addr: 269773808, offset: 0x10159f00, size: 8224, tag: 22
[D 15:30:32.741934] post_recv: new rq 0x100f9460.
[D 15:30:32.741958] memcache_register: hit [0] 0x10159f00 len 8224 (via 0x10159f00 len 8224) refcnt now 2.
[D 15:30:32.741989] BMI_post_sendunexpected_list: addr: 269773808, count: 1, total_size: 68, tag: 22
[D 15:30:32.742015]    element 0: offset: 0x100fb220, size: 68
[D 15:30:32.742039] post_send: sq 0x10150d80 len 68 peer da13:3345.
[D 15:30:32.742065] encourage_send_waiting_buffer: sq 0x10150d80 sent EAGER len 68.
[D 15:30:32.742091] Posted PVFS_SYS_LOOKUP (276) (waiting for test)(-1073741839)
[D 15:30:32.742118] ib_check_cq: send to da13:3345 completed locally: -> SQ_WAITING_USER_TEST.
[D 15:30:32.742142] test_sq: sq 0x10150d80 completed 68 to da13:3345.
[D 15:30:32.743201] ib_check_cq: recv from da13:3345 len 104 type MSG_EAGER_SEND credit 1.
[D 15:30:32.743225] encourage_recv_incoming: recv eager len 104.
[D 15:30:32.743248] encourage_recv_incoming: matched rq 0x100f9460 now RQ_EAGER_WAITING_USER_TEST.
[D 15:30:32.743272] encourage_recv_incoming: early registration not needed, dereg after eager.
[D 15:30:32.743294] memcache_deregister: dec refcount [0] 0x10159f00 len 8224 (via 0x10159f00 len 8224) refcnt now 1.
[D 15:30:32.743319] test_rq: rq 0x100f9460 completed 88 from da13:3345.
[D 15:30:32.743348] lookup_segment_lookup_comp_fn
[D 15:30:32.743376] lookup state: lookup_segment_verify_attr_present
[D 15:30:32.743399] lookup state: lookup_segment_check_attr_type
[D 15:30:32.743422] lookup state: lookup_context_check_completion
[D 15:30:32.743445] lookup state: lookup_cleanup
[D 15:30:32.743468] client_state_machine_terminate smcb 0x1014fda0
[D 15:30:32.743491] add smcb 0x1014fda0 to completion list
[D 15:30:32.743515] PINT_sys_release: id 276
[D 15:30:32.743546] PINT_sys_release: id 276
[D 15:30:32.743570] PINT_sys_dev_unexp
[D 15:30:32.743594] client_op_state_get_machine 400
[D 15:30:32.743617] PINT_client_state_machine_post smcb 0x100f9330, op: PVFS_DEV_UNEXPECTED
[D 15:30:32.743642] Posted PVFS_DEV_UNEXPECTED (278) (waiting for test)(-1073741839)
[D 15:30:32.743675] client_state_machine_terminate smcb 0x100fc8f0
[D 15:30:32.743698] add smcb 0x100fc8f0 to completion list
[D 15:30:32.743721] PINT_sys_release: id 58
[D 15:30:32.743747] PVFS_isys_getattr entered
[D 15:30:32.743771] client_op_state_get_machine 5
[D 15:30:32.743795] PINT_client_state_machine_post smcb 0x1014fda0, op: PVFS_SYS_GETATTR
[D 15:30:32.743819] (0x100fc8f0) getattr_object_getattr_setup_msgpair
[D 15:30:32.743847] BMI_post_recv: addr: 269773808, offset: 0x10151030, size: 9280, tag: 23
[D 15:30:32.743873] post_recv: new rq 0x100fd240.
[D 15:30:32.743896] memcache_register: hit [0] 0x10151030 len 9280 (via 0x10151030 len 9280) refcnt now 2.
[D 15:30:32.743927] BMI_post_sendunexpected_list: addr: 269773808, count: 1, total_size: 40, tag: 23
[D 15:30:32.743950]    element 0: offset: 0x100d4820, size: 40
[D 15:30:32.743974] post_send: sq 0x10150c50 len 40 peer da13:3345.
[D 15:30:32.743999] encourage_send_waiting_buffer: sq 0x10150c50 sent EAGER len 40.
[D 15:30:32.744031] Posted PVFS_SYS_GETATTR (281) (waiting for test)(-1073741839)
[D 15:30:32.744063] ib_check_cq: send to da13:3345 completed locally: -> SQ_WAITING_USER_TEST.
[D 15:30:32.744090] test_sq: sq 0x10150c50 completed 40 to da13:3345.
[D 15:30:32.744794] ib_check_cq: recv from da13:3345 len 144 type MSG_EAGER_SEND credit 1.
[D 15:30:32.744819] encourage_recv_incoming: recv eager len 144.
[D 15:30:32.744843] encourage_recv_incoming: matched rq 0x100fd240 now RQ_EAGER_WAITING_USER_TEST.
[D 15:30:32.744866] encourage_recv_incoming: early registration not needed, dereg after eager.
[D 15:30:32.744889] memcache_deregister: dec refcount [0] 0x10151030 len 9280 (via 0x10151030 len 9280) refcnt now 1.
[D 15:30:32.744914] test_rq: rq 0x100fd240 completed 128 from da13:3345.
[D 15:30:32.744953] BMI_post_recv: addr: 269773808, offset: 0x10151030, size: 9280, tag: 24
[D 15:30:32.744979] post_recv: new rq 0x100fd110.
[D 15:30:32.745002] memcache_register: hit [0] 0x10151030 len 9280 (via 0x10151030 len 9280) refcnt now 2.
[D 15:30:32.745034] BMI_post_sendunexpected_list: addr: 269773808, count: 1, total_size: 40, tag: 24
[D 15:30:32.745058]    element 0: offset: 0x100e7dd0, size: 40
[D 15:30:32.745081] post_send: sq 0x100fb220 len 40 peer da13:3345.
[D 15:30:32.745106] encourage_send_waiting_buffer: sq 0x100fb220 sent EAGER len 40.
[D 15:30:32.745133] BMI_post_recv: addr: 269321776, offset: 0x10156400, size: 9280, tag: 25
[D 15:30:32.745159] ib_check_cq: send to da13:3345 completed locally: -> SQ_WAITING_USER_TEST.
[D 15:30:32.745182] post_recv: new rq 0x10150ef0.
[D 15:30:32.745205] memcache_register: hit [0] 0x10156400 len 9280 (via 0x10156400 len 9280) refcnt now 2.
[D 15:30:32.745232] test_sq: sq 0x100fb220 completed 40 to da13:3345.
[D 15:30:32.745261] BMI_post_sendunexpected_list: addr: 269321776, count: 1, total_size: 40, tag: 25
[D 15:30:32.745285]    element 0: offset: 0x100fb360, size: 40
[D 15:30:32.745308] post_send: sq 0x10150f80 len 40 peer da12:3345.
[D 15:30:32.745334] encourage_send_waiting_buffer: sq 0x10150f80 sent EAGER len 40.
[D 15:30:32.745367] ib_check_cq: send to da12:3345 completed locally: -> SQ_WAITING_USER_TEST.
[D 15:30:32.745390] test_sq: sq 0x10150f80 completed 40 to da12:3345.
[D 15:30:32.748921] ib_check_cq: recv from da12:3345 len 88 type MSG_EAGER_SEND credit 1.
[D 15:30:32.748946] encourage_recv_incoming: recv eager len 88.
[D 15:30:32.748970] encourage_recv_incoming: matched rq 0x10150ef0 now RQ_EAGER_WAITING_USER_TEST.
[D 15:30:32.748992] encourage_recv_incoming: early registration not needed, dereg after eager.
[D 15:30:32.749015] memcache_deregister: dec refcount [0] 0x10156400 len 9280 (via 0x10156400 len 9280) refcnt now 1.
[D 15:30:32.749041] test_rq: rq 0x10150ef0 completed 72 from da12:3345.