/var/tmp/bins/crutest verify -t 127.0.0.1:8810 -t 127.0.0.1:8820 -t 127.0.0.1:8830 --verify-out /tmp/test_repair_verify.data --verify-in /tmp/test_repair_verify.data --range -q -g 199 {"msg":"Upstairs starts","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.711412641Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931} {"msg":"Crucible Version: BuildInfo {\n version: \"0.0.1\",\n git_sha: \"9f74bb5fe2be09de9f7a47f2db64d7dce836b79c\",\n git_commit_timestamp: \"2024-02-12T01:11:14.000000000Z\",\n git_branch: \"main\",\n rustc_semver: \"1.75.0\",\n rustc_channel: \"stable\",\n rustc_host_triple: \"x86_64-unknown-illumos\",\n rustc_commit_sha: \"82e1608dfa6e0b5569232559e3d385fea5a93112\",\n cargo_triple: \"x86_64-unknown-illumos\",\n debug: true,\n opt_level: 0,\n}","v":0,"name":"crucible","level":30Crucible runtime is spawned ,"time":"2024-02-12T01:43:52.711726886Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931} {"msg":"Upstairs <-> Downstairs Message Version: 5","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.711757965Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931} {"msg":"Crucible a08b4bb8-f78c-4caf-9d70-16bad65b7d3f has session id: 394cc571-84d7-49be-8edf-0659fed72cab","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.711778654Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"Upstairs opts: Upstairs UUID: a08b4bb8-f78c-4caf-9d70-16bad65b7d3f, Targets: [127.0.0.1:8810, 127.0.0.1:8820, 127.0.0.1:8830], lossy: false, flush_timeout: None, key populated: false, cert_pem populated: false, key_pem populated: false, root_cert_pem populated: false, Control: None, read_only: false","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.711809712Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"Crucible stats registered with UUID: a08b4bb8-f78c-4caf-9d70-16bad65b7d3f","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.711833801Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"The guest has requested activation with gen:199","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.71184798Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931} {"msg":"a08b4bb8-f78c-4caf-9d70-16bad65b7d3f active request set","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.712014012Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"sending connect oneshot to client","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.712046341Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"client":"0","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"client set_active_request while in New; waiting...","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.71207269Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"client":"0","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"sending connect oneshot to client","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.712095899Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"client":"1","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"client set_active_request while in New; waiting...","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.712119847Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"client":"1","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"sending connect oneshot to client","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.712134937Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"client":"2","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"client set_active_request while in New; waiting...","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.712152736Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"client":"2","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"connecting to 127.0.0.1:8830","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.712166775Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"":"io task","client":"2","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"connecting to 127.0.0.1:8810","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.712193914Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"":"io task","client":"0","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"connecting to 127.0.0.1:8820","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.712219633Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"":"io task","client":"1","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"ds_connection connected","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.712304429Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"":"io task","client":"2","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"ds_connection connected","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.712545227Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"":"io task","client":"1","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"ds_connection connected","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.712581025Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"":"io task","client":"0","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"ds_transition from New to WaitActive","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.712964997Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"client":"2","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"[2] Transition from New to WaitActive","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.712990156Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"client":"2","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"ds_transition from New to WaitActive","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.71310477Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"client":"1","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"[1] Transition from New to WaitActive","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.713143149Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"client":"1","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"ds_transition from New to WaitActive","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.713172127Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"client":"0","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"[0] Transition from New to WaitActive","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.713187187Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"client":"0","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"downstairs client at Some(127.0.0.1:8830) has region UUID 12345678-0000-0000-0000-000000008830","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.71354441Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"client":"2","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"downstairs client at Some(127.0.0.1:8820) has region UUID 12345678-0000-0000-0000-000000008820","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.713755269Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"client":"1","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"downstairs client at Some(127.0.0.1:8810) has region UUID 12345678-0000-0000-0000-000000008810","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.713830246Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"client":"0","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"ds_transition from WaitActive to WaitQuorum","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.713970059Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"client":"2","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"[2] Transition from WaitActive to WaitQuorum","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.714005637Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"client":"2","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"Waiting for true more clients to be ready","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.714030946Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"ds_transition from WaitActive to WaitQuorum","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.714222327Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"client":"1","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"[1] Transition from WaitActive to WaitQuorum","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.714258515Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"client":"1","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"Waiting for true more clients to be ready","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.714283654Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"ds_transition from WaitActive to WaitQuorum","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.714305963Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"client":"0","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"[0] Transition from WaitActive to WaitQuorum","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.714321402Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"client":"0","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"[0]R flush_numbers[0..12]: [348, 345, 346, 345, 348, 346, 329, 345, 349, 347, 347, 346]","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.714336182Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"":"downstairs","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"[0]R generation[0..12]: [197, 194, 195, 194, 197, 195, 184, 194, 198, 196, 196, 195]","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.714350311Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"":"downstairs","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"[0]R dirty[0..12]: [false, false, false, false, false, false, false, false, false, false, false, false]","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.71436794Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"":"downstairs","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"[1]R flush_numbers[0..12]: [350, 345, 350, 350, 350, 350, 329, 345, 349, 347, 350, 350]","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.714382279Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"":"downstairs","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"[1]R generation[0..12]: [198, 194, 198, 198, 198, 198, 184, 194, 198, 196, 198, 198]","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.714396289Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"":"downstairs","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"[1]R dirty[0..12]: [false, true, false, false, false, false, false, false, false, false, false, false]","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.714413398Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"":"downstairs","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"[2]R flush_numbers[0..12]: [350, 345, 350, 350, 350, 350, 329, 345, 349, 347, 350, 350]","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.714427607Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"":"downstairs","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"[2]R generation[0..12]: [198, 194, 198, 198, 198, 198, 184, 194, 198, 196, 198, 198]","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.714441287Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"":"downstairs","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"[2]R dirty[0..12]: [false, true, false, false, false, false, false, false, false, false, false, false]","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.714455596Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"":"downstairs","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"Max found gen is 199","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.714468755Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"":"downstairs","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"Generation requested: 199 >= found:199","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.714482175Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"":"downstairs","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"Next flush: 351","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.714495174Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"":"downstairs","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"Extents 1 dirty","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.714508073Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"":"mend","":"downstairs","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"First source client ID for extent 1","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.714521963Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"mrl":"dirty","":"mend","":"downstairs","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"extent:1 gens: 194 194 194","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.714536262Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"mrl":"dirty","":"mend","":"downstairs","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"extent:1 flush: 345 345 345 scs: [ClientId(0), ClientId(1), ClientId(2)]","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.714551031Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"mrl":"dirty","":"mend","":"downstairs","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"max_flush now has: [ClientId(0), ClientId(1), ClientId(2)]","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.714565821Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"mrl":"dirty","":"mend","":"downstairs","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"extent:1 dirty: false true true","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.71458014Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"mrl":"dirty","":"mend","":"downstairs","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"find dest for source 1 for extent at index 1","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.714594659Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"mrl":"dirty","":"mend","":"downstairs","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"source 1, add dest 0 source flush","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.714610568Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"mrl":"dirty","":"mend","":"downstairs","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"source 1, add dest 2 source flush","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.714625208Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"mrl":"dirty","":"mend","":"downstairs","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"Extents 16 dirty","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.714639997Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"":"mend","":"downstairs","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"First source client ID for extent 16","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.714653857Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"mrl":"dirty","":"mend","":"downstairs","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"extent:16 gens: 196 196 196","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.714668056Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"mrl":"dirty","":"mend","":"downstairs","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"extent:16 flush: 347 347 347 scs: [ClientId(0), ClientId(1), ClientId(2)]","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.714682785Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"mrl":"dirty","":"mend","":"downstairs","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"max_flush now has: [ClientId(0), ClientId(1), ClientId(2)]","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.714697384Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"mrl":"dirty","":"mend","":"downstairs","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"extent:16 dirty: false true true","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.714711714Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"mrl":"dirty","":"mend","":"downstairs","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"find dest for source 1 for extent at index 16","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.714726893Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"mrl":"dirty","":"mend","":"downstairs","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"source 1, add dest 0 source flush","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.714741702Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"mrl":"dirty","":"mend","":"downstairs","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"source 1, add dest 2 source flush","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.714755952Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"mrl":"dirty","":"mend","":"downstairs","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"Extents 17 dirty","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.714770151Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"":"mend","":"downstairs","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"First source client ID for extent 17","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.71478389Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"mrl":"dirty","":"mend","":"downstairs","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"extent:17 gens: 195 195 195","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.71479827Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"mrl":"dirty","":"mend","":"downstairs","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"extent:17 flush: 346 346 346 scs: [ClientId(0), ClientId(1), ClientId(2)]","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.714814599Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"mrl":"dirty","":"mend","":"downstairs","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"max_flush now has: [ClientId(0), ClientId(1), ClientId(2)]","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.714829528Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"mrl":"dirty","":"mend","":"downstairs","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"extent:17 dirty: false true true","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.714843737Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"mrl":"dirty","":"mend","":"downstairs","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"find dest for source 1 for extent at index 17","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.714867826Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"mrl":"dirty","":"mend","":"downstairs","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"source 1, add dest 0 source flush","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.714882526Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"mrl":"dirty","":"mend","":"downstairs","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"source 1, add dest 2 source flush","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.714896635Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"mrl":"dirty","":"mend","":"downstairs","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"Extents 21 dirty","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.714910894Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"":"mend","":"downstairs","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"First source client ID for extent 21","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.714924784Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"mrl":"dirty","":"mend","":"downstairs","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"extent:21 gens: 194 194 194","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.714939093Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"mrl":"dirty","":"mend","":"downstairs","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"extent:21 flush: 345 345 345 scs: [ClientId(0), ClientId(1), ClientId(2)]","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.714954212Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"mrl":"dirty","":"mend","":"downstairs","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"max_flush now has: [ClientId(0), ClientId(1), ClientId(2)]","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.714969002Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"mrl":"dirty","":"mend","":"downstairs","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"extent:21 dirty: false true true","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.714983501Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"mrl":"dirty","":"mend","":"downstairs","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"find dest for source 1 for extent at index 21","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.71500165Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"mrl":"dirty","":"mend","":"downstairs","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"source 1, add dest 0 source flush","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.715027589Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"mrl":"dirty","":"mend","":"downstairs","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"source 1, add dest 2 source flush","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.715043658Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"mrl":"dirty","":"mend","":"downstairs","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"Extents 27 dirty","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.715058577Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"":"mend","":"downstairs","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"First source client ID for extent 27","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.715072746Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"mrl":"dirty","":"mend","":"downstairs","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"extent:27 gens: 196 198 198","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.715087276Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"mrl":"dirty","":"mend","":"downstairs","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"extent:27 flush: 347 350 350 scs: [ClientId(1), ClientId(2)]","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.715101905Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"mrl":"dirty","":"mend","":"downstairs","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"max_flush now has: [ClientId(1), ClientId(2)]","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.715116364Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"mrl":"dirty","":"mend","":"downstairs","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"extent:27 dirty: false true true","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.715130654Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"mrl":"dirty","":"mend","":"downstairs","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"find dest for source 1 for extent at index 27","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.715145053Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"mrl":"dirty","":"mend","":"downstairs","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"source 1, add dest 0 gen","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.715159042Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"mrl":"dirty","":"mend","":"downstairs","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"source 1, add dest 2 source flush","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.715173212Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"mrl":"dirty","":"mend","":"downstairs","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"Extents 29 dirty","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.715187391Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"":"mend","":"downstairs","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"First source client ID for extent 29","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.71520104Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"mrl":"dirty","":"mend","":"downstairs","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"extent:29 gens: 196 196 196","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.71521527Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"mrl":"dirty","":"mend","":"downstairs","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"extent:29 flush: 347 347 347 scs: [ClientId(0), ClientId(1), ClientId(2)]","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.715231799Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"mrl":"dirty","":"mend","":"downstairs","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"max_flush now has: [ClientId(0), ClientId(1), ClientId(2)]","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.715246688Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"mrl":"dirty","":"mend","":"downstairs","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"extent:29 dirty: false true true","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.715260928Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"mrl":"dirty","":"mend","":"downstairs","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"find dest for source 1 for extent at index 29","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.715275457Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"mrl":"dirty","":"mend","":"downstairs","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"source 1, add dest 0 source flush","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.715289796Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"mrl":"dirty","":"mend","":"downstairs","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"source 1, add dest 2 source flush","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.715304315Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"mrl":"dirty","":"mend","":"downstairs","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"Extent 0 has flush number mismatch","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.715318865Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"":"mend","":"downstairs","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"First source client ID for extent 0","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.715332804Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"mrl":"flush_mismatch","":"mend","":"downstairs","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"extent:0 gens: 197 198 198","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.715347173Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"mrl":"flush_mismatch","":"mend","":"downstairs","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"extent:0 flush: 348 350 350 scs: [ClientId(1), ClientId(2)]","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.715362053Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"mrl":"flush_mismatch","":"mend","":"downstairs","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"max_flush now has: [ClientId(1), ClientId(2)]","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.715376702Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"mrl":"flush_mismatch","":"mend","":"downstairs","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"extent:0 dirty: false false false","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.715391091Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"mrl":"flush_mismatch","":"mend","":"downstairs","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"No maxes found, left with: [ClientId(1), ClientId(2)]","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.715405701Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"mrl":"flush_mismatch","":"mend","":"downstairs","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"find dest for source 1 for extent at index 0","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.71542044Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"mrl":"flush_mismatch","":"mend","":"downstairs","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"source 1, add dest 0 gen","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.715436169Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"mrl":"flush_mismatch","":"mend","":"downstairs","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"Extent 2 has flush number mismatch","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.715450839Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"":"mend","":"downstairs","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"First source client ID for extent 2","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.715464648Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"mrl":"flush_mismatch","":"mend","":"downstairs","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"extent:2 gens: 195 198 198","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.715479057Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"mrl":"flush_mismatch","":"mend","":"downstairs","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"extent:2 flush: 346 350 350 scs: [ClientId(1), ClientId(2)]","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.715494126Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"mrl":"flush_mismatch","":"mend","":"downstairs","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"max_flush now has: [ClientId(1), ClientId(2)]","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.715508596Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"mrl":"flush_mismatch","":"mend","":"downstairs","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"extent:2 dirty: false false false","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.715523025Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"mrl":"flush_mismatch","":"mend","":"downstairs","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"No maxes found, left with: [ClientId(1), ClientId(2)]","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.715537764Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"mrl":"flush_mismatch","":"mend","":"downstairs","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"find dest for source 1 for extent at index 2","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.715552284Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"mrl":"flush_mismatch","":"mend","":"downstairs","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"source 1, add dest 0 gen","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.715566473Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"mrl":"flush_mismatch","":"mend","":"downstairs","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"Extent 3 has flush number mismatch","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.715580952Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"":"mend","":"downstairs","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"First source client ID for extent 3","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.715594492Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"mrl":"flush_mismatch","":"mend","":"downstairs","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"extent:3 gens: 194 198 198","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.715608671Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"mrl":"flush_mismatch","":"mend","":"downstairs","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"extent:3 flush: 345 350 350 scs: [ClientId(1), ClientId(2)]","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.71562475Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"mrl":"flush_mismatch","":"mend","":"downstairs","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"max_flush now has: [ClientId(1), ClientId(2)]","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.71563949Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"mrl":"flush_mismatch","":"mend","":"downstairs","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"extent:3 dirty: false false false","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.715654199Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"mrl":"flush_mismatch","":"mend","":"downstairs","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"No maxes found, left with: [ClientId(1), ClientId(2)]","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.715668868Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"mrl":"flush_mismatch","":"mend","":"downstairs","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"find dest for source 1 for extent at index 3","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.715683437Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"mrl":"flush_mismatch","":"mend","":"downstairs","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"source 1, add dest 0 gen","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.715697847Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"mrl":"flush_mismatch","":"mend","":"downstairs","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"Extent 4 has flush number mismatch","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.715712286Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"":"mend","":"downstairs","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"First source client ID for extent 4","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.715726045Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"mrl":"flush_mismatch","":"mend","":"downstairs","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"extent:4 gens: 197 198 198","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.715740365Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"mrl":"flush_mismatch","":"mend","":"downstairs","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"extent:4 flush: 348 350 350 scs: [ClientId(1), ClientId(2)]","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.715755244Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"mrl":"flush_mismatch","":"mend","":"downstairs","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"max_flush now has: [ClientId(1), ClientId(2)]","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.715769853Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"mrl":"flush_mismatch","":"mend","":"downstairs","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"extent:4 dirty: false false false","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.715784272Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"mrl":"flush_mismatch","":"mend","":"downstairs","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"No maxes found, left with: [ClientId(1), ClientId(2)]","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.715798822Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"mrl":"flush_mismatch","":"mend","":"downstairs","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"find dest for source 1 for extent at index 4","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.715813401Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"mrl":"flush_mismatch","":"mend","":"downstairs","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"source 1, add dest 0 gen","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.715829101Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"mrl":"flush_mismatch","":"mend","":"downstairs","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"Extent 5 has flush number mismatch","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.71584368Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"":"mend","":"downstairs","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"First source client ID for extent 5","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.715857509Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"mrl":"flush_mismatch","":"mend","":"downstairs","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"extent:5 gens: 195 198 198","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.715872018Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"mrl":"flush_mismatch","":"mend","":"downstairs","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"extent:5 flush: 346 350 350 scs: [ClientId(1), ClientId(2)]","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.715886838Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"mrl":"flush_mismatch","":"mend","":"downstairs","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"max_flush now has: [ClientId(1), ClientId(2)]","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.715901447Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"mrl":"flush_mismatch","":"mend","":"downstairs","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"extent:5 dirty: false false false","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.715915776Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"mrl":"flush_mismatch","":"mend","":"downstairs","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"No maxes found, left with: [ClientId(1), ClientId(2)]","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.715930405Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"mrl":"flush_mismatch","":"mend","":"downstairs","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"find dest for source 1 for extent at index 5","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.715944665Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"mrl":"flush_mismatch","":"mend","":"downstairs","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"source 1, add dest 0 gen","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.715958874Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"mrl":"flush_mismatch","":"mend","":"downstairs","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"Extent 10 has flush number mismatch","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.715973463Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"":"mend","":"downstairs","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"First source client ID for extent 10","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.715987203Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"mrl":"flush_mismatch","":"mend","":"downstairs","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"extent:10 gens: 196 198 198","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.716007272Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"mrl":"flush_mismatch","":"mend","":"downstairs","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"extent:10 flush: 347 350 350 scs: [ClientId(1), ClientId(2)]","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.716030181Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"mrl":"flush_mismatch","":"mend","":"downstairs","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"max_flush now has: [ClientId(1), ClientId(2)]","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.71604565Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"mrl":"flush_mismatch","":"mend","":"downstairs","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"extent:10 dirty: false false false","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.716060039Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"mrl":"flush_mismatch","":"mend","":"downstairs","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"No maxes found, left with: [ClientId(1), ClientId(2)]","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.716074709Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"mrl":"flush_mismatch","":"mend","":"downstairs","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"find dest for source 1 for extent at index 10","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.716089188Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"mrl":"flush_mismatch","":"mend","":"downstairs","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"source 1, add dest 0 gen","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.716103387Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"mrl":"flush_mismatch","":"mend","":"downstairs","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"Extent 11 has flush number mismatch","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.716117957Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"":"mend","":"downstairs","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"First source client ID for extent 11","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.716131536Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"mrl":"flush_mismatch","":"mend","":"downstairs","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"extent:11 gens: 195 198 198","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.716145995Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"mrl":"flush_mismatch","":"mend","":"downstairs","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"extent:11 flush: 346 350 350 scs: [ClientId(1), ClientId(2)]","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.716160735Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"mrl":"flush_mismatch","":"mend","":"downstairs","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"max_flush now has: [ClientId(1), ClientId(2)]","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.716175544Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"mrl":"flush_mismatch","":"mend","":"downstairs","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"extent:11 dirty: false false false","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.716189943Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"mrl":"flush_mismatch","":"mend","":"downstairs","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"No maxes found, left with: [ClientId(1), ClientId(2)]","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.716204612Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"mrl":"flush_mismatch","":"mend","":"downstairs","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"find dest for source 1 for extent at index 11","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.716220592Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"mrl":"flush_mismatch","":"mend","":"downstairs","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"source 1, add dest 0 gen","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.716244301Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"mrl":"flush_mismatch","":"mend","":"downstairs","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"Extent 23 has flush number mismatch","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.716274209Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"":"mend","":"downstairs","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"First source client ID for extent 23","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.716304228Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"mrl":"flush_mismatch","":"mend","":"downstairs","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"extent:23 gens: 186 198 198","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.716335226Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"mrl":"flush_mismatch","":"mend","":"downstairs","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"extent:23 flush: 333 350 350 scs: [ClientId(1), ClientId(2)]","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.716367265Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"mrl":"flush_mismatch","":"mend","":"downstairs","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"max_flush now has: [ClientId(1), ClientId(2)]","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.716390164Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"mrl":"flush_mismatch","":"mend","":"downstairs","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"extent:23 dirty: false false false","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.716405143Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"mrl":"flush_mismatch","":"mend","":"downstairs","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"No maxes found, left with: [ClientId(1), ClientId(2)]","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.716419862Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"mrl":"flush_mismatch","":"mend","":"downstairs","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"find dest for source 1 for extent at index 23","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.716434461Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"mrl":"flush_mismatch","":"mend","":"downstairs","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"source 1, add dest 0 gen","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.716448921Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"mrl":"flush_mismatch","":"mend","":"downstairs","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"Transition from WaitQuorum to Reconcile","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.71646395Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"client":"0","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"Transition from WaitQuorum to Reconcile","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.716477359Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"client":"1","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"Transition from WaitQuorum to Reconcile","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.716490669Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"client":"2","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"Found 14 extents that need repair","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.716506478Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"":"downstairs","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"Full repair list: {1: ExtentFix { source: ClientId(1), dest: [ClientId(0), ClientId(2)] }, 17: ExtentFix { source: ClientId(1), dest: [ClientId(0), ClientId(2)] }, 27: ExtentFix { source: ClientId(1), dest: [ClientId(0), ClientId(2)] }, 0: ExtentFix { source: ClientId(1), dest: [ClientId(0)] }, 29: ExtentFix { source: ClientId(1), dest: [ClientId(0), ClientId(2)] }, 2: ExtentFix { source: ClientId(1), dest: [ClientId(0)] }, 3: ExtentFix { source: ClientId(1), dest: [ClientId(0)] }, 4: ExtentFix { source: ClientId(1), dest: [ClientId(0)] }, 16: ExtentFix { source: ClientId(1), dest: [ClientId(0), ClientId(2)] }, 5: ExtentFix { source: ClientId(1), dest: [ClientId(0)] }, 10: ExtentFix { source: ClientId(1), dest: [ClientId(0)] }, 11: ExtentFix { source: ClientId(1), dest: [ClientId(0)] }, 21: ExtentFix { source: ClientId(1), dest: [ClientId(0), ClientId(2)] }, 23: ExtentFix { source: ClientId(1), dest: [ClientId(0)] }}","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.716533887Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"":"downstairs","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"Task list: [ReconcileIO { id: ReconciliationId(0), op: ExtentFlush { repair_id: ReconciliationId(0), extent_id: 1, client_id: ClientId(1), flush_number: 351, gen_number: 199 }, state: ClientData([New, New, New]) }, ReconcileIO { id: ReconciliationId(1), op: ExtentClose { repair_id: ReconciliationId(1), extent_id: 1 }, state: ClientData([New, New, New]) }, ReconcileIO { id: ReconciliationId(2), op: ExtentRepair { repair_id: ReconciliationId(2), extent_id: 1, source_client_id: ClientId(1), source_repair_address: 0.0.0.0:12820, dest_clients: [ClientId(0), ClientId(2)] }, state: ClientData([New, New, New]) }, ReconcileIO { id: ReconciliationId(3), op: ExtentReopen { repair_id: ReconciliationId(3), extent_id: 1 }, state: ClientData([New, New, New]) }, ReconcileIO { id: ReconciliationId(4), op: ExtentFlush { repair_id: ReconciliationId(4), extent_id: 17, client_id: ClientId(1), flush_number: 351, gen_number: 199 }, state: ClientData([New, New, New]) }, ReconcileIO { id: ReconciliationId(5), op: ExtentClose { repair_id: ReconciliationId(5), extent_id: 17 }, state: ClientData([New, New, New]) }, ReconcileIO { id: ReconciliationId(6), op: ExtentRepair { repair_id: ReconciliationId(6), extent_id: 17, source_client_id: ClientId(1), source_repair_address: 0.0.0.0:12820, dest_clients: [ClientId(0), ClientId(2)] }, state: ClientData([New, New, New]) }, ReconcileIO { id: ReconciliationId(7), op: ExtentReopen { repair_id: ReconciliationId(7), extent_id: 17 }, state: ClientData([New, New, New]) }, ReconcileIO { id: ReconciliationId(8), op: ExtentFlush { repair_id: ReconciliationId(8), extent_id: 27, client_id: ClientId(1), flush_number: 351, gen_number: 199 }, state: ClientData([New, New, New]) }, ReconcileIO { id: ReconciliationId(9), op: ExtentClose { repair_id: ReconciliationId(9), extent_id: 27 }, state: ClientData([New, New, New]) }, ReconcileIO { id: ReconciliationId(10), op: ExtentRepair { repair_id: ReconciliationId(10), extent_id: 27, source_client_id: ClientId(1), source_repair_address: 0.0.0.0:12820, dest_clients: [ClientId(0), ClientId(2)] }, state: ClientData([New, New, New]) }, ReconcileIO { id: ReconciliationId(11), op: ExtentReopen { repair_id: ReconciliationId(11), extent_id: 27 }, state: ClientData([New, New, New]) }, ReconcileIO { id: ReconciliationId(12), op: ExtentFlush { repair_id: ReconciliationId(12), extent_id: 0, client_id: ClientId(1), flush_number: 351, gen_number: 199 }, state: ClientData([New, New, New]) }, ReconcileIO { id: ReconciliationId(13), op: ExtentClose { repair_id: ReconciliationId(13), extent_id: 0 }, state: ClientData([New, New, New]) }, ReconcileIO { id: ReconciliationId(14), op: ExtentRepair { repair_id: ReconciliationId(14), extent_id: 0, source_client_id: ClientId(1), source_repair_address: 0.0.0.0:12820, dest_clients: [ClientId(0)] }, state: ClientData([New, New, New]) }, ReconcileIO { id: ReconciliationId(15), op: ExtentReopen { repair_id: ReconciliationId(15), extent_id: 0 }, state: ClientData([New, New, New]) }, ReconcileIO { id: ReconciliationId(16), op: ExtentFlush { repair_id: ReconciliationId(16), extent_id: 29, client_id: ClientId(1), flush_number: 351, gen_number: 199 }, state: ClientData([New, New, New]) }, ReconcileIO { id: ReconciliationId(17), op: ExtentClose { repair_id: ReconciliationId(17), extent_id: 29 }, state: ClientData([New, New, New]) }, ReconcileIO { id: ReconciliationId(18), op: ExtentRepair { repair_id: ReconciliationId(18), extent_id: 29, source_client_id: ClientId(1), source_repair_address: 0.0.0.0:12820, dest_clients: [ClientId(0), ClientId(2)] }, state: ClientData([New, New, New]) }, ReconcileIO { id: ReconciliationId(19), op: ExtentReopen { repair_id: ReconciliationId(19), extent_id: 29 }, state: ClientData([New, New, New]) }, ReconcileIO { id: ReconciliationId(20), op: ExtentFlush { repair_id: ReconciliationId(20), extent_id: 2, client_id: ClientId(1), flush_number: 351, gen_number: 199 }, state: ClientData([New, New, New]) }, ReconcileIO { id: ReconciliationId(21), op: ExtentClose { repair_id: ReconciliationId(21), extent_id: 2 }, state: ClientData([New, New, New]) }, ReconcileIO { id: ReconciliationId(22), op: ExtentRepair { repair_id: ReconciliationId(22), extent_id: 2, source_client_id: ClientId(1), source_repair_address: 0.0.0.0:12820, dest_clients: [ClientId(0)] }, state: ClientData([New, New, New]) }, ReconcileIO { id: ReconciliationId(23), op: ExtentReopen { repair_id: ReconciliationId(23), extent_id: 2 }, state: ClientData([New, New, New]) }, ReconcileIO { id: ReconciliationId(24), op: ExtentFlush { repair_id: ReconciliationId(24), extent_id: 3, client_id: ClientId(1), flush_number: 351, gen_number: 199 }, state: ClientData([New, New, New]) }, ReconcileIO { id: ReconciliationId(25), op: ExtentClose { repair_id: ReconciliationId(25), extent_id: 3 }, state: ClientData([New, New, New]) }, ReconcileIO { id: ReconciliationId(26), op: ExtentRepair { repair_id: ReconciliationId(26), extent_id: 3, source_client_id: ClientId(1), source_repair_address: 0.0.0.0:12820, dest_clients: [ClientId(0)] }, state: ClientData([New, New, New]) }, ReconcileIO { id: ReconciliationId(27), op: ExtentReopen { repair_id: ReconciliationId(27), extent_id: 3 }, state: ClientData([New, New, New]) }, ReconcileIO { id: ReconciliationId(28), op: ExtentFlush { repair_id: ReconciliationId(28), extent_id: 4, client_id: ClientId(1), flush_number: 351, gen_number: 199 }, state: ClientData([New, New, New]) }, ReconcileIO { id: ReconciliationId(29), op: ExtentClose { repair_id: ReconciliationId(29), extent_id: 4 }, state: ClientData([New, New, New]) }, ReconcileIO { id: ReconciliationId(30), op: ExtentRepair { repair_id: ReconciliationId(30), extent_id: 4, source_client_id: ClientId(1), source_repair_address: 0.0.0.0:12820, dest_clients: [ClientId(0)] }, state: ClientData([New, New, New]) }, ReconcileIO { id: ReconciliationId(31), op: ExtentReopen { repair_id: ReconciliationId(31), extent_id: 4 }, state: ClientData([New, New, New]) }, ReconcileIO { id: ReconciliationId(32), op: ExtentFlush { repair_id: ReconciliationId(32), extent_id: 16, client_id: ClientId(1), flush_number: 351, gen_number: 199 }, state: ClientData([New, New, New]) }, ReconcileIO { id: ReconciliationId(33), op: ExtentClose { repair_id: ReconciliationId(33), extent_id: 16 }, state: ClientData([New, New, New]) }, ReconcileIO { id: ReconciliationId(34), op: ExtentRepair { repair_id: ReconciliationId(34), extent_id: 16, source_client_id: ClientId(1), source_repair_address: 0.0.0.0:12820, dest_clients: [ClientId(0), ClientId(2)] }, state: ClientData([New, New, New]) }, ReconcileIO { id: ReconciliationId(35), op: ExtentReopen { repair_id: ReconciliationId(35), extent_id: 16 }, state: ClientData([New, New, New]) }, ReconcileIO { id: ReconciliationId(36), op: ExtentFlush { repair_id: ReconciliationId(36), extent_id: 5, client_id: ClientId(1), flush_number: 351, gen_number: 199 }, state: ClientData([New, New, New]) }, ReconcileIO { id: ReconciliationId(37), op: ExtentClose { repair_id: ReconciliationId(37), extent_id: 5 }, state: ClientData([New, New, New]) }, ReconcileIO { id: ReconciliationId(38), op: ExtentRepair { repair_id: ReconciliationId(38), extent_id: 5, source_client_id: ClientId(1), source_repair_address: 0.0.0.0:12820, dest_clients: [ClientId(0)] }, state: ClientData([New, New, New]) }, ReconcileIO { id: ReconciliationId(39), op: ExtentReopen { repair_id: ReconciliationId(39), extent_id: 5 }, state: ClientData([New, New, New]) }, ReconcileIO { id: ReconciliationId(40), op: ExtentFlush { repair_id: ReconciliationId(40), extent_id: 10, client_id: ClientId(1), flush_number: 351, gen_number: 199 }, state: ClientData([New, New, New]) }, ReconcileIO { id: ReconciliationId(41), op: ExtentClose { repair_id: ReconciliationId(41), extent_id: 10 }, state: ClientData([New, New, New]) }, ReconcileIO { id: ReconciliationId(42), op: ExtentRepair { repair_id: ReconciliationId(42), extent_id: 10, source_client_id: ClientId(1), source_repair_address: 0.0.0.0:12820, dest_clients: [ClientId(0)] }, state: ClientData([New, New, New]) }, ReconcileIO { id: ReconciliationId(43), op: ExtentReopen { repair_id: ReconciliationId(43), extent_id: 10 }, state: ClientData([New, New, New]) }, ReconcileIO { id: ReconciliationId(44), op: ExtentFlush { repair_id: ReconciliationId(44), extent_id: 11, client_id: ClientId(1), flush_number: 351, gen_number: 199 }, state: ClientData([New, New, New]) }, ReconcileIO { id: ReconciliationId(45), op: ExtentClose { repair_id: ReconciliationId(45), extent_id: 11 }, state: ClientData([New, New, New]) }, ReconcileIO { id: ReconciliationId(46), op: ExtentRepair { repair_id: ReconciliationId(46), extent_id: 11, source_client_id: ClientId(1), source_repair_address: 0.0.0.0:12820, dest_clients: [ClientId(0)] }, state: ClientData([New, New, New]) }, ReconcileIO { id: ReconciliationId(47), op: ExtentReopen { repair_id: ReconciliationId(47), extent_id: 11 }, state: ClientData([New, New, New]) }, ReconcileIO { id: ReconciliationId(48), op: ExtentFlush { repair_id: ReconciliationId(48), extent_id: 21, client_id: ClientId(1), flush_number: 351, gen_number: 199 }, state: ClientData([New, New, New]) }, ReconcileIO { id: ReconciliationId(49), op: ExtentClose { repair_id: ReconciliationId(49), extent_id: 21 }, state: ClientData([New, New, New]) }, ReconcileIO { id: ReconciliationId(50), op: ExtentRepair { repair_id: ReconciliationId(50), extent_id: 21, source_client_id: ClientId(1), source_repair_address: 0.0.0.0:12820, dest_clients: [ClientId(0), ClientId(2)] }, state: ClientData([New, New, New]) }, ReconcileIO { id: ReconciliationId(51), op: ExtentReopen { repair_id: ReconciliationId(51), extent_id: 21 }, state: ClientData([New, New, New]) }, ReconcileIO { id: ReconciliationId(52), op: ExtentFlush { repair_id: ReconciliationId(52), extent_id: 23, client_id: ClientId(1), flush_number: 351, gen_number: 199 }, state: ClientData([New, New, New]) }, ReconcileIO { id: ReconciliationId(53), op: ExtentClose { repair_id: ReconciliationId(53), extent_id: 23 }, state: ClientData([New, New, New]) }, ReconcileIO { id: ReconciliationId(54), op: ExtentRepair { repair_id: ReconciliationId(54), extent_id: 23, source_client_id: ClientId(1), source_repair_address: 0.0.0.0:12820, dest_clients: [ClientId(0)] }, state: ClientData([New, New, New]) }, ReconcileIO { id: ReconciliationId(55), op: ExtentReopen { repair_id: ReconciliationId(55), extent_id: 23 }, state: ClientData([New, New, New]) }]","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.716779955Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"":"downstairs","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"skipping flush request ReconciliationId(0)","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.716816303Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"client":"0","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"sending flush request ReconciliationId(0)","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.716843112Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"client":"1","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"skipping flush request ReconciliationId(0)","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.716864761Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"client":"2","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"sending reconcile request ReconciliationId(2)","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.71688607Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"client":"0","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"no action needed request ReconciliationId(2)","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.716907559Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"client":"1","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"sending reconcile request ReconciliationId(2)","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.716928748Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"client":"2","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"skipping flush request ReconciliationId(4)","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.767885107Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"client":"0","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"sending flush request ReconciliationId(4)","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.767923595Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"client":"1","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"skipping flush request ReconciliationId(4)","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.767950094Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"client":"2","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"sending reconcile request ReconciliationId(6)","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.769815685Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"client":"0","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"no action needed request ReconciliationId(6)","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.769850713Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"client":"1","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"sending reconcile request ReconciliationId(6)","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.769870682Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"client":"2","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"skipping flush request ReconciliationId(8)","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.810806899Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"client":"0","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"sending flush request ReconciliationId(8)","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.810903885Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"client":"1","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"skipping flush request ReconciliationId(8)","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.810935763Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"client":"2","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"sending reconcile request ReconciliationId(10)","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.812740007Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"client":"0","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"no action needed request ReconciliationId(10)","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.812771865Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"client":"1","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"sending reconcile request ReconciliationId(10)","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.812788305Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"client":"2","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"skipping flush request ReconciliationId(12)","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.857651454Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"client":"0","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"sending flush request ReconciliationId(12)","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.857689742Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"client":"1","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"skipping flush request ReconciliationId(12)","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.857710221Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"client":"2","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"sending reconcile request ReconciliationId(14)","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.858266965Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"client":"0","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"no action needed request ReconciliationId(14)","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.858294074Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"client":"1","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"no action needed request ReconciliationId(14)","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.858308773Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"client":"2","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"skipping flush request ReconciliationId(16)","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.897850357Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"client":"0","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"sending flush request ReconciliationId(16)","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.897887545Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"client":"1","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"skipping flush request ReconciliationId(16)","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.897910274Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"client":"2","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"sending reconcile request ReconciliationId(18)","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.899819523Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"client":"0","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"no action needed request ReconciliationId(18)","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.899853821Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"client":"1","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"sending reconcile request ReconciliationId(18)","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.89987359Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"client":"2","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"skipping flush request ReconciliationId(20)","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.943557176Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"client":"0","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"sending flush request ReconciliationId(20)","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.943597064Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"client":"1","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"skipping flush request ReconciliationId(20)","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.943631532Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"client":"2","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"sending reconcile request ReconciliationId(22)","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.944159067Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"client":"0","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"no action needed request ReconciliationId(22)","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.944186906Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"client":"1","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"no action needed request ReconciliationId(22)","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.944202535Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"client":"2","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"skipping flush request ReconciliationId(24)","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.983276301Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"client":"0","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"sending flush request ReconciliationId(24)","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.983310949Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"client":"1","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"skipping flush request ReconciliationId(24)","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.983330368Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"client":"2","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"sending reconcile request ReconciliationId(26)","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.983862373Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"client":"0","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"no action needed request ReconciliationId(26)","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.983910851Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"client":"1","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"no action needed request ReconciliationId(26)","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:52.983947709Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"client":"2","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"skipping flush request ReconciliationId(28)","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:53.022425813Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"client":"0","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"sending flush request ReconciliationId(28)","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:53.022453192Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"client":"1","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"skipping flush request ReconciliationId(28)","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:53.022468071Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"client":"2","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"sending reconcile request ReconciliationId(30)","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:53.023031114Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"client":"0","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"no action needed request ReconciliationId(30)","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:53.023060713Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"client":"1","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"no action needed request ReconciliationId(30)","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:53.023076372Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"client":"2","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"skipping flush request ReconciliationId(32)","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:53.063484314Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"client":"0","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"sending flush request ReconciliationId(32)","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:53.063524362Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"client":"1","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"skipping flush request ReconciliationId(32)","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:53.063554621Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"client":"2","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"sending reconcile request ReconciliationId(34)","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:53.065318597Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"client":"0","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"no action needed request ReconciliationId(34)","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:53.065364165Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"client":"1","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"sending reconcile request ReconciliationId(34)","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:53.065435821Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"client":"2","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"skipping flush request ReconciliationId(36)","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:53.105235602Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"client":"0","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"sending flush request ReconciliationId(36)","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:53.105266291Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"client":"1","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"skipping flush request ReconciliationId(36)","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:53.10529138Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"client":"2","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"sending reconcile request ReconciliationId(38)","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:53.105837074Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"client":"0","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"no action needed request ReconciliationId(38)","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:53.105878572Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"client":"1","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"no action needed request ReconciliationId(38)","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:53.10591482Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"client":"2","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"skipping flush request ReconciliationId(40)","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:53.145253973Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"client":"0","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"sending flush request ReconciliationId(40)","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:53.145282412Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"client":"1","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"skipping flush request ReconciliationId(40)","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:53.145297161Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"client":"2","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"sending reconcile request ReconciliationId(42)","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:53.145817136Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"client":"0","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"no action needed request ReconciliationId(42)","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:53.145844035Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"client":"1","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"no action needed request ReconciliationId(42)","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:53.145868004Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"client":"2","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"skipping flush request ReconciliationId(44)","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:53.184584847Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"client":"0","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"sending flush request ReconciliationId(44)","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:53.184618735Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"client":"1","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"skipping flush request ReconciliationId(44)","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:53.184637854Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"client":"2","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"sending reconcile request ReconciliationId(46)","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:53.185239695Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"client":"0","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"no action needed request ReconciliationId(46)","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:53.185267224Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"client":"1","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"no action needed request ReconciliationId(46)","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:53.185281904Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"client":"2","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"skipping flush request ReconciliationId(48)","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:53.224732421Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"client":"0","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"sending flush request ReconciliationId(48)","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:53.22475974Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"client":"1","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"skipping flush request ReconciliationId(48)","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:53.224775049Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"client":"2","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"sending reconcile request ReconciliationId(50)","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:53.226510326Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"client":"0","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"no action needed request ReconciliationId(50)","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:53.226537705Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"client":"1","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"sending reconcile request ReconciliationId(50)","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:53.226563074Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"client":"2","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"skipping flush request ReconciliationId(52)","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:53.266568705Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"client":"0","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"sending flush request ReconciliationId(52)","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:53.266606393Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"client":"1","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"skipping flush request ReconciliationId(52)","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:53.26666995Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"client":"2","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"sending reconcile request ReconciliationId(54)","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:53.267151187Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"client":"0","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"no action needed request ReconciliationId(54)","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:53.267185646Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"client":"1","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"no action needed request ReconciliationId(54)","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:53.267209245Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"client":"2","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"done with reconciliation","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:53.30545743Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"":"downstairs","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"Transition from Reconcile to Active","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:53.305491888Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"client":"0","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"Transition from Reconcile to Active","v":0,"name":"crucible","level":30Wait for a query_work_queue command to finish before sending IO ,"time":"2024-02-12T01:43:53.305511168Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"client":"1","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"Transition from Reconcile to Active","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:53.305530267Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"client":"2","":"downstairs","session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"All required reconciliation work is completed","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:53.305547996Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"Set Downstairs and Upstairs active after reconciliation","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:53.305567385Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"a08b4bb8-f78c-4caf-9d70-16bad65b7d3f is now active with session: 394cc571-84d7-49be-8edf-0659fed72cab","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:53.305594653Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931,"session_id":"394cc571-84d7-49be-8edf-0659fed72cab"} {"msg":"The guest has finished waiting for activation with:199","v":0,"name":"crucible","level":30,"time":"2024-02-12T01:43:53.305621352Z","hostname":"ip-10-150-1-24.us-west-2.compute.internal","pid":1931} Region: es:20 ec:30 bs:4096 ts:2457600 tb:600 max_io:256 or 1048576 Loading write count information from file "/tmp/test_repair_verify.data" Read and Verify all blocks (0..600 range:true) Wrote out file "/tmp/test_repair_verify.data" Verify test completed Wrote out file "/tmp/test_repair_verify.data" CLIENT: Tests done. All submitted work has been ACK'd ---------------------------------------------------------------- Crucible gen:199 GIO:true work queues: Upstairs:0 downstairs:6 States: Active Active Active GW_ID ACK DSID TYPE BLOCKS DS:0 DS:1 DS:2 REPLAY 1 Acked 1000 Read 100 Done Done Done false 2 Acked 1001 Read 100 Done Done Done false 3 Acked 1002 Read 100 Done Done Done false 4 Acked 1003 Read 100 Done Done Done false 5 Acked 1004 Read 100 Done Done Done false 6 Acked 1005 Read 100 Done Done Done false STATES DS:0 DS:1 DS:2 TOTAL New 0 0 0 0 Sent 0 0 0 0 Done 6 6 6 18 Skipped 0 0 0 0 Error 0 0 0 0 Last Flush: 0 0 0 Downstairs last five completed: Upstairs last five completed: 6 5 4 3 2 CLIENT: Up:0 ds:6 act:3 ---------------------------------------------------------------- Crucible gen:199 GIO:true work queues: Upstairs:0 downstairs:0 Downstairs last five completed: 1006 1005 1004 1003 1002 Upstairs last five completed: 7 6 5 4 3 CLIENT: Up:0 ds:0 act:3 CLIENT: All crucible jobs finished, exiting program