/var/tmp/bins/crutest verify -t 127.0.0.1:8810 -t 127.0.0.1:8820 -t 127.0.0.1:8830 --verify-out /tmp/test_repair_verify.data --verify-in /tmp/test_repair_verify.data --range -q -g 199 {"msg":"Upstairs starts","v":0,"name":"crucible","level":30,"time":"2024-08-08T16:19:40.319710114Z","hostname":"w-01J4SA7S709AJF5QPY1NHP65KM","pid":5112} {"msg":"Crucible Version: BuildInfo {\n version: \"0.0.1\",\n git_sha: \"361584843ef1ddcec7585daa2b2efecd4dcd6a18\",\n git_commit_timestamp: \"2024-08-08T15:17:39.000000000Z\",\n git_branch: \"main\",\n rustc_semver: \"1.76.0\",\n rustc_channel: \"stable\",\n rustc_host_triple: \"x86_64-unknown-illumos\",\n rustc_commit_sha: \"07dca489ac2d933c78d3c5158e3f43beefeb02ce\",\n cargo_triple: \"x86_64-unknown-illumos\",\n debug: true,\n opt_level: 0,\n}","v":0,"name":"crucible","level":30,"time":"2024-08-08T16:19:40.320093932Z","hostname":"w-01J4SA7S709AJF5QPY1NHP65KM","pid":5112} {"msg":"Upstairs <-> Downstairs Message Version: 11","v":0,"name":"crucible","level":30,"time":"2024-08-08T16:19:40.32012375Z","hostname":"w-01J4SA7S709AJF5QPY1NHP65KM","pid":5112} {"msg":"Crucible daa158e2-0e0f-4411-9079-002b6bccc598 has session id: 5ab4b7e7-a9e0-4310-bac4-d2618a5bbef4","v":0,"name":"crucible","level":30,"time":"2024-08-08T16:19:40.320488169Z","hostname":"w-01J4SA7S709AJF5QPY1NHP65KM","pid":5112,"session_id":"5ab4b7e7-a9e0-4310-bac4-d2618a5bbef4"} {"msg":"Upstairs opts: Upstairs UUID: daa158e2-0e0f-4411-9079-002b6bccc598, Targets: [127.0.0.1:8810, 127.0.0.1:8820, 127.0.0.1:8830], lossy: false, flush_timeout: None, key populated: false, cert_pem populated: false, key_pem populated: false, root_cert_pem populated: false, Control: None, read_only: false","v":0,"name":"crucible","level":30,"time":"2024-08-08T16:19:40.320532917Z","hostname":"w-01J4SA7S709AJF5QPY1NHP65KM","pid":5112,"session_id":"5ab4b7e7-a9e0-4310-bac4-d2618a5bbef4"} {"msg":"Crucible stats registered with UUID: daa158e2-0e0f-4411-9079-002b6bccc598","v":0,"name":"crucible","level":30,"time":"2024-08-08T16:19:40.320555065Z","hostname":"w-01J4SA7S709AJF5QPY1NHP65KM","pid":5112,"session_id":"5ab4b7e7-a9e0-4310-bac4-d2618a5bbef4"} Crucible runtime is spawned {"msg":"The guest has requested activation with gen:199","v":0,"name":"crucible","level":30,"time":"2024-08-08T16:19:40.320868118Z","hostname":"w-01J4SA7S709AJF5QPY1NHP65KM","pid":5112} {"msg":"daa158e2-0e0f-4411-9079-002b6bccc598 active request set","v":0,"name":"crucible","level":30,"time":"2024-08-08T16:19:40.320963122Z","hostname":"w-01J4SA7S709AJF5QPY1NHP65KM","pid":5112,"session_id":"5ab4b7e7-a9e0-4310-bac4-d2618a5bbef4"} {"msg":"sending connect oneshot to client","v":0,"name":"crucible","level":30,"time":"2024-08-08T16:19:40.320982001Z","hostname":"w-01J4SA7S709AJF5QPY1NHP65KM","pid":5112,"client":"0","":"downstairs","session_id":"5ab4b7e7-a9e0-4310-bac4-d2618a5bbef4"} {"msg":"client set_active_request while in New; waiting...","v":0,"name":"crucible","level":30,"time":"2024-08-08T16:19:40.32100142Z","hostname":"w-01J4SA7S709AJF5QPY1NHP65KM","pid":5112,"client":"0","":"downstairs","session_id":"5ab4b7e7-a9e0-4310-bac4-d2618a5bbef4"} {"msg":"sending connect oneshot to client","v":0,"name":"crucible","level":30,"time":"2024-08-08T16:19:40.321015799Z","hostname":"w-01J4SA7S709AJF5QPY1NHP65KM","pid":5112,"client":"1","":"downstairs","session_id":"5ab4b7e7-a9e0-4310-bac4-d2618a5bbef4"} {"msg":"client set_active_request while in New; waiting...","v":0,"name":"crucible","level":30,"time":"2024-08-08T16:19:40.321030568Z","hostname":"w-01J4SA7S709AJF5QPY1NHP65KM","pid":5112,"client":"1","":"downstairs","session_id":"5ab4b7e7-a9e0-4310-bac4-d2618a5bbef4"} {"msg":"sending connect oneshot to client","v":0,"name":"crucible","level":30,"time":"2024-08-08T16:19:40.321043848Z","hostname":"w-01J4SA7S709AJF5QPY1NHP65KM","pid":5112,"client":"2","":"downstairs","session_id":"5ab4b7e7-a9e0-4310-bac4-d2618a5bbef4"} {"msg":"client set_active_request while in New; waiting...","v":0,"name":"crucible","level":30,"time":"2024-08-08T16:19:40.321057597Z","hostname":"w-01J4SA7S709AJF5QPY1NHP65KM","pid":5112,"client":"2","":"downstairs","session_id":"5ab4b7e7-a9e0-4310-bac4-d2618a5bbef4"} {"msg":"connecting to 127.0.0.1:8810","v":0,"name":"crucible","level":30,"time":"2024-08-08T16:19:40.321081715Z","hostname":"w-01J4SA7S709AJF5QPY1NHP65KM","pid":5112,"":"io task","client":"0","":"downstairs","session_id":"5ab4b7e7-a9e0-4310-bac4-d2618a5bbef4"} {"msg":"connecting to 127.0.0.1:8820","v":0,"name":"crucible","level":30,"time":"2024-08-08T16:19:40.321096185Z","hostname":"w-01J4SA7S709AJF5QPY1NHP65KM","pid":5112,"":"io task","client":"1","":"downstairs","session_id":"5ab4b7e7-a9e0-4310-bac4-d2618a5bbef4"} {"msg":"connecting to 127.0.0.1:8830","v":0,"name":"crucible","level":30,"time":"2024-08-08T16:19:40.321110904Z","hostname":"w-01J4SA7S709AJF5QPY1NHP65KM","pid":5112,"":"io task","client":"2","":"downstairs","session_id":"5ab4b7e7-a9e0-4310-bac4-d2618a5bbef4"} {"msg":"ds_connection connect to 127.0.0.1:8810 failure: Os { code: 146, kind: ConnectionRefused, message: \"Connection refused\" }","v":0,"name":"crucible","level":40,"time":"2024-08-08T16:19:40.321381708Z","hostname":"w-01J4SA7S709AJF5QPY1NHP65KM","pid":5112,"":"io task","client":"0","":"downstairs","session_id":"5ab4b7e7-a9e0-4310-bac4-d2618a5bbef4"} {"msg":"client task is sending Done(ConnectionFailed(Os { code: 146, kind: ConnectionRefused, message: \"Connection refused\" }))","v":0,"name":"crucible","level":40,"time":"2024-08-08T16:19:40.321424056Z","hostname":"w-01J4SA7S709AJF5QPY1NHP65KM","pid":5112,"":"io task","client":"0","":"downstairs","session_id":"5ab4b7e7-a9e0-4310-bac4-d2618a5bbef4"} {"msg":"downstairs task for 0 stopped due to ConnectionFailed(Os { code: 146, kind: ConnectionRefused, message: \"Connection refused\" })","v":0,"name":"crucible","level":40,"time":"2024-08-08T16:19:40.321456664Z","hostname":"w-01J4SA7S709AJF5QPY1NHP65KM","pid":5112,"session_id":"5ab4b7e7-a9e0-4310-bac4-d2618a5bbef4"} {"msg":"Gone missing, transition from New to Disconnected","v":0,"name":"crucible","level":30,"time":"2024-08-08T16:19:40.321485032Z","hostname":"w-01J4SA7S709AJF5QPY1NHP65KM","pid":5112,"client":"0","":"downstairs","session_id":"5ab4b7e7-a9e0-4310-bac4-d2618a5bbef4"} {"msg":"Disconnected -> New","v":0,"name":"crucible","level":30,"time":"2024-08-08T16:19:40.321510661Z","hostname":"w-01J4SA7S709AJF5QPY1NHP65KM","pid":5112,"client":"0","":"downstairs","session_id":"5ab4b7e7-a9e0-4310-bac4-d2618a5bbef4"} {"msg":"ds_connection connected from Ok(127.0.0.1:55160)","v":0,"name":"crucible","level":30,"time":"2024-08-08T16:19:40.321537479Z","hostname":"w-01J4SA7S709AJF5QPY1NHP65KM","pid":5112,"":"io task","client":"2","":"downstairs","session_id":"5ab4b7e7-a9e0-4310-bac4-d2618a5bbef4"} {"msg":"ds_connection connected from Ok(127.0.0.1:55571)","v":0,"name":"crucible","level":30,"time":"2024-08-08T16:19:40.321740328Z","hostname":"w-01J4SA7S709AJF5QPY1NHP65KM","pid":5112,"":"io task","client":"1","":"downstairs","session_id":"5ab4b7e7-a9e0-4310-bac4-d2618a5bbef4"} {"msg":"client task is exiting","v":0,"name":"crucible","level":30,"time":"2024-08-08T16:19:40.321787575Z","hostname":"w-01J4SA7S709AJF5QPY1NHP65KM","pid":5112,"":"io task","client":"0","":"downstairs","session_id":"5ab4b7e7-a9e0-4310-bac4-d2618a5bbef4"} {"msg":"ds_transition from New to WaitActive","v":0,"name":"crucible","level":30,"time":"2024-08-08T16:19:40.322553921Z","hostname":"w-01J4SA7S709AJF5QPY1NHP65KM","pid":5112,"client":"1","":"downstairs","session_id":"5ab4b7e7-a9e0-4310-bac4-d2618a5bbef4"} {"msg":"[1] Transition from New to WaitActive","v":0,"name":"crucible","level":30,"time":"2024-08-08T16:19:40.322588109Z","hostname":"w-01J4SA7S709AJF5QPY1NHP65KM","pid":5112,"client":"1","":"downstairs","session_id":"5ab4b7e7-a9e0-4310-bac4-d2618a5bbef4"} {"msg":"ds_transition from New to WaitActive","v":0,"name":"crucible","level":30,"time":"2024-08-08T16:19:40.322611928Z","hostname":"w-01J4SA7S709AJF5QPY1NHP65KM","pid":5112,"client":"2","":"downstairs","session_id":"5ab4b7e7-a9e0-4310-bac4-d2618a5bbef4"} {"msg":"[2] Transition from New to WaitActive","v":0,"name":"crucible","level":30,"time":"2024-08-08T16:19:40.322632927Z","hostname":"w-01J4SA7S709AJF5QPY1NHP65KM","pid":5112,"client":"2","":"downstairs","session_id":"5ab4b7e7-a9e0-4310-bac4-d2618a5bbef4"} {"msg":"downstairs client at Some(127.0.0.1:8820) has region UUID 12345678-0000-0000-0000-000000008820","v":0,"name":"crucible","level":30,"time":"2024-08-08T16:19:40.338961923Z","hostname":"w-01J4SA7S709AJF5QPY1NHP65KM","pid":5112,"client":"1","":"downstairs","session_id":"5ab4b7e7-a9e0-4310-bac4-d2618a5bbef4"} {"msg":"downstairs client at Some(127.0.0.1:8830) has region UUID 12345678-0000-0000-0000-000000008830","v":0,"name":"crucible","level":30,"time":"2024-08-08T16:19:40.339074597Z","hostname":"w-01J4SA7S709AJF5QPY1NHP65KM","pid":5112,"client":"2","":"downstairs","session_id":"5ab4b7e7-a9e0-4310-bac4-d2618a5bbef4"} {"msg":"ds_transition from WaitActive to WaitQuorum","v":0,"name":"crucible","level":30,"time":"2024-08-08T16:19:40.339504292Z","hostname":"w-01J4SA7S709AJF5QPY1NHP65KM","pid":5112,"client":"1","":"downstairs","session_id":"5ab4b7e7-a9e0-4310-bac4-d2618a5bbef4"} {"msg":"[1] Transition from WaitActive to WaitQuorum","v":0,"name":"crucible","level":30,"time":"2024-08-08T16:19:40.33954141Z","hostname":"w-01J4SA7S709AJF5QPY1NHP65KM","pid":5112,"client":"1","":"downstairs","session_id":"5ab4b7e7-a9e0-4310-bac4-d2618a5bbef4"} {"msg":"Waiting for more clients to be ready","v":0,"name":"crucible","level":30,"time":"2024-08-08T16:19:40.339566289Z","hostname":"w-01J4SA7S709AJF5QPY1NHP65KM","pid":5112,"session_id":"5ab4b7e7-a9e0-4310-bac4-d2618a5bbef4"} {"msg":"ds_transition from WaitActive to WaitQuorum","v":0,"name":"crucible","level":30,"time":"2024-08-08T16:19:40.339689171Z","hostname":"w-01J4SA7S709AJF5QPY1NHP65KM","pid":5112,"client":"2","":"downstairs","session_id":"5ab4b7e7-a9e0-4310-bac4-d2618a5bbef4"} {"msg":"[2] Transition from WaitActive to WaitQuorum","v":0,"name":"crucible","level":30,"time":"2024-08-08T16:19:40.33971763Z","hostname":"w-01J4SA7S709AJF5QPY1NHP65KM","pid":5112,"client":"2","":"downstairs","session_id":"5ab4b7e7-a9e0-4310-bac4-d2618a5bbef4"} {"msg":"Waiting for more clients to be ready","v":0,"name":"crucible","level":30,"time":"2024-08-08T16:19:40.339733249Z","hostname":"w-01J4SA7S709AJF5QPY1NHP65KM","pid":5112,"session_id":"5ab4b7e7-a9e0-4310-bac4-d2618a5bbef4"} {"msg":"connecting to 127.0.0.1:8810","v":0,"name":"crucible","level":30,"time":"2024-08-08T16:19:50.322677837Z","hostname":"w-01J4SA7S709AJF5QPY1NHP65KM","pid":5112,"":"io task","client":"0","":"downstairs","session_id":"5ab4b7e7-a9e0-4310-bac4-d2618a5bbef4"} {"msg":"ds_connection connected from Ok(127.0.0.1:39650)","v":0,"name":"crucible","level":30,"time":"2024-08-08T16:19:50.322821309Z","hostname":"w-01J4SA7S709AJF5QPY1NHP65KM","pid":5112,"":"io task","client":"0","":"downstairs","session_id":"5ab4b7e7-a9e0-4310-bac4-d2618a5bbef4"} {"msg":"ds_transition from New to WaitActive","v":0,"name":"crucible","level":30,"time":"2024-08-08T16:19:50.323925746Z","hostname":"w-01J4SA7S709AJF5QPY1NHP65KM","pid":5112,"client":"0","":"downstairs","session_id":"5ab4b7e7-a9e0-4310-bac4-d2618a5bbef4"} {"msg":"[0] Transition from New to WaitActive","v":0,"name":"crucible","level":30,"time":"2024-08-08T16:19:50.323959433Z","hostname":"w-01J4SA7S709AJF5QPY1NHP65KM","pid":5112,"client":"0","":"downstairs","session_id":"5ab4b7e7-a9e0-4310-bac4-d2618a5bbef4"} {"msg":"downstairs client at Some(127.0.0.1:8810) has region UUID 12345678-0000-0000-0000-000000008810","v":0,"name":"crucible","level":30,"time":"2024-08-08T16:19:50.33731994Z","hostname":"w-01J4SA7S709AJF5QPY1NHP65KM","pid":5112,"client":"0","":"downstairs","session_id":"5ab4b7e7-a9e0-4310-bac4-d2618a5bbef4"} {"msg":"ds_transition from WaitActive to WaitQuorum","v":0,"name":"crucible","level":30,"time":"2024-08-08T16:19:50.337952674Z","hostname":"w-01J4SA7S709AJF5QPY1NHP65KM","pid":5112,"client":"0","":"downstairs","session_id":"5ab4b7e7-a9e0-4310-bac4-d2618a5bbef4"} {"msg":"[0] Transition from WaitActive to WaitQuorum","v":0,"name":"crucible","level":30,"time":"2024-08-08T16:19:50.337973672Z","hostname":"w-01J4SA7S709AJF5QPY1NHP65KM","pid":5112,"client":"0","":"downstairs","session_id":"5ab4b7e7-a9e0-4310-bac4-d2618a5bbef4"} {"msg":"[0]R flush_numbers[0..12]: [430, 427, 431, 410, 430, 433, 428, 431, 427, 427, 412, 408]","v":0,"name":"crucible","level":30,"time":"2024-08-08T16:19:50.337994421Z","hostname":"w-01J4SA7S709AJF5QPY1NHP65KM","pid":5112,"":"downstairs","":"downstairs","session_id":"5ab4b7e7-a9e0-4310-bac4-d2618a5bbef4"} {"msg":"[0]R generation[0..12]: [196, 195, 196, 187, 196, 198, 196, 196, 195, 195, 188, 186]","v":0,"name":"crucible","level":30,"time":"2024-08-08T16:19:50.33800967Z","hostname":"w-01J4SA7S709AJF5QPY1NHP65KM","pid":5112,"":"downstairs","":"downstairs","session_id":"5ab4b7e7-a9e0-4310-bac4-d2618a5bbef4"} {"msg":"[0]R dirty[0..12]: [false, false, false, false, false, false, false, false, false, false, true, false]","v":0,"name":"crucible","level":30,"time":"2024-08-08T16:19:50.338024249Z","hostname":"w-01J4SA7S709AJF5QPY1NHP65KM","pid":5112,"":"downstairs","":"downstairs","session_id":"5ab4b7e7-a9e0-4310-bac4-d2618a5bbef4"} {"msg":"[1]R flush_numbers[0..12]: [430, 427, 431, 410, 430, 433, 428, 431, 427, 427, 412, 408]","v":0,"name":"crucible","level":30,"time":"2024-08-08T16:19:50.338038399Z","hostname":"w-01J4SA7S709AJF5QPY1NHP65KM","pid":5112,"":"downstairs","":"downstairs","session_id":"5ab4b7e7-a9e0-4310-bac4-d2618a5bbef4"} {"msg":"[1]R generation[0..12]: [196, 195, 196, 187, 196, 198, 196, 196, 195, 195, 188, 186]","v":0,"name":"crucible","level":30,"time":"2024-08-08T16:19:50.338052428Z","hostname":"w-01J4SA7S709AJF5QPY1NHP65KM","pid":5112,"":"downstairs","":"downstairs","session_id":"5ab4b7e7-a9e0-4310-bac4-d2618a5bbef4"} {"msg":"[1]R dirty[0..12]: [false, false, false, false, false, false, false, false, false, false, true, false]","v":0,"name":"crucible","level":30,"time":"2024-08-08T16:19:50.338066557Z","hostname":"w-01J4SA7S709AJF5QPY1NHP65KM","pid":5112,"":"downstairs","":"downstairs","session_id":"5ab4b7e7-a9e0-4310-bac4-d2618a5bbef4"} {"msg":"[2]R flush_numbers[0..12]: [430, 427, 431, 410, 430, 433, 428, 431, 427, 427, 412, 408]","v":0,"name":"crucible","level":30,"time":"2024-08-08T16:19:50.338080326Z","hostname":"w-01J4SA7S709AJF5QPY1NHP65KM","pid":5112,"":"downstairs","":"downstairs","session_id":"5ab4b7e7-a9e0-4310-bac4-d2618a5bbef4"} {"msg":"[2]R generation[0..12]: [196, 195, 196, 187, 196, 198, 196, 196, 195, 195, 188, 186]","v":0,"name":"crucible","level":30,"time":"2024-08-08T16:19:50.338094156Z","hostname":"w-01J4SA7S709AJF5QPY1NHP65KM","pid":5112,"":"downstairs","":"downstairs","session_id":"5ab4b7e7-a9e0-4310-bac4-d2618a5bbef4"} {"msg":"[2]R dirty[0..12]: [false, false, false, false, false, false, false, false, false, false, true, false]","v":0,"name":"crucible","level":30,"time":"2024-08-08T16:19:50.338108425Z","hostname":"w-01J4SA7S709AJF5QPY1NHP65KM","pid":5112,"":"downstairs","":"downstairs","session_id":"5ab4b7e7-a9e0-4310-bac4-d2618a5bbef4"} {"msg":"Max found gen is 199","v":0,"name":"crucible","level":30,"time":"2024-08-08T16:19:50.338121324Z","hostname":"w-01J4SA7S709AJF5QPY1NHP65KM","pid":5112,"":"downstairs","":"downstairs","session_id":"5ab4b7e7-a9e0-4310-bac4-d2618a5bbef4"} {"msg":"Generation requested: 199 >= found:199","v":0,"name":"crucible","level":30,"time":"2024-08-08T16:19:50.338134453Z","hostname":"w-01J4SA7S709AJF5QPY1NHP65KM","pid":5112,"":"downstairs","":"downstairs","session_id":"5ab4b7e7-a9e0-4310-bac4-d2618a5bbef4"} {"msg":"Next flush: 436","v":0,"name":"crucible","level":30,"time":"2024-08-08T16:19:50.338147402Z","hostname":"w-01J4SA7S709AJF5QPY1NHP65KM","pid":5112,"":"downstairs","":"downstairs","session_id":"5ab4b7e7-a9e0-4310-bac4-d2618a5bbef4"} {"msg":"Extents 10 dirty","v":0,"name":"crucible","level":30,"time":"2024-08-08T16:19:50.338160362Z","hostname":"w-01J4SA7S709AJF5QPY1NHP65KM","pid":5112,"":"mend","":"downstairs","":"downstairs","session_id":"5ab4b7e7-a9e0-4310-bac4-d2618a5bbef4"} {"msg":"First source client ID for extent 10","v":0,"name":"crucible","level":30,"time":"2024-08-08T16:19:50.338174301Z","hostname":"w-01J4SA7S709AJF5QPY1NHP65KM","pid":5112,"mrl":"dirty","":"mend","":"downstairs","":"downstairs","session_id":"5ab4b7e7-a9e0-4310-bac4-d2618a5bbef4"} {"msg":"extent:10 gens: 188 188 188","v":0,"name":"crucible","level":30,"time":"2024-08-08T16:19:50.33819068Z","hostname":"w-01J4SA7S709AJF5QPY1NHP65KM","pid":5112,"mrl":"dirty","":"mend","":"downstairs","":"downstairs","session_id":"5ab4b7e7-a9e0-4310-bac4-d2618a5bbef4"} {"msg":"extent:10 flush: 412 412 412 scs: [ClientId(0), ClientId(1), ClientId(2)]","v":0,"name":"crucible","level":30,"time":"2024-08-08T16:19:50.338205829Z","hostname":"w-01J4SA7S709AJF5QPY1NHP65KM","pid":5112,"mrl":"dirty","":"mend","":"downstairs","":"downstairs","session_id":"5ab4b7e7-a9e0-4310-bac4-d2618a5bbef4"} {"msg":"max_flush now has: [ClientId(0), ClientId(1), ClientId(2)]","v":0,"name":"crucible","level":30,"time":"2024-08-08T16:19:50.338220648Z","hostname":"w-01J4SA7S709AJF5QPY1NHP65KM","pid":5112,"mrl":"dirty","":"mend","":"downstairs","":"downstairs","session_id":"5ab4b7e7-a9e0-4310-bac4-d2618a5bbef4"} {"msg":"extent:10 dirty: true true true","v":0,"name":"crucible","level":30,"time":"2024-08-08T16:19:50.338234977Z","hostname":"w-01J4SA7S709AJF5QPY1NHP65KM","pid":5112,"mrl":"dirty","":"mend","":"downstairs","":"downstairs","session_id":"5ab4b7e7-a9e0-4310-bac4-d2618a5bbef4"} {"msg":"find dest for source 0 for extent at index 10","v":0,"name":"crucible","level":30,"time":"2024-08-08T16:19:50.338249467Z","hostname":"w-01J4SA7S709AJF5QPY1NHP65KM","pid":5112,"mrl":"dirty","":"mend","":"downstairs","":"downstairs","session_id":"5ab4b7e7-a9e0-4310-bac4-d2618a5bbef4"} {"msg":"source 0, add dest 1 source flush","v":0,"name":"crucible","level":30,"time":"2024-08-08T16:19:50.338263826Z","hostname":"w-01J4SA7S709AJF5QPY1NHP65KM","pid":5112,"mrl":"dirty","":"mend","":"downstairs","":"downstairs","session_id":"5ab4b7e7-a9e0-4310-bac4-d2618a5bbef4"} {"msg":"source 0, add dest 2 source flush","v":0,"name":"crucible","level":30,"time":"2024-08-08T16:19:50.338278145Z","hostname":"w-01J4SA7S709AJF5QPY1NHP65KM","pid":5112,"mrl":"dirty","":"mend","":"downstairs","":"downstairs","session_id":"5ab4b7e7-a9e0-4310-bac4-d2618a5bbef4"} {"msg":"Extents 15 dirty","v":0,"name":"crucible","level":30,"time":"2024-08-08T16:19:50.338292734Z","hostname":"w-01J4SA7S709AJF5QPY1NHP65KM","pid":5112,"":"mend","":"downstairs","":"downstairs","session_id":"5ab4b7e7-a9e0-4310-bac4-d2618a5bbef4"} {"msg":"First source client ID for extent 15","v":0,"name":"crucible","level":30,"time":"2024-08-08T16:19:50.338306663Z","hostname":"w-01J4SA7S709AJF5QPY1NHP65KM","pid":5112,"mrl":"dirty","":"mend","":"downstairs","":"downstairs","session_id":"5ab4b7e7-a9e0-4310-bac4-d2618a5bbef4"} {"msg":"extent:15 gens: 192 192 192","v":0,"name":"crucible","level":30,"time":"2024-08-08T16:19:50.338321023Z","hostname":"w-01J4SA7S709AJF5QPY1NHP65KM","pid":5112,"mrl":"dirty","":"mend","":"downstairs","":"downstairs","session_id":"5ab4b7e7-a9e0-4310-bac4-d2618a5bbef4"} {"msg":"extent:15 flush: 420 420 420 scs: [ClientId(0), ClientId(1), ClientId(2)]","v":0,"name":"crucible","level":30,"time":"2024-08-08T16:19:50.338335842Z","hostname":"w-01J4SA7S709AJF5QPY1NHP65KM","pid":5112,"mrl":"dirty","":"mend","":"downstairs","":"downstairs","session_id":"5ab4b7e7-a9e0-4310-bac4-d2618a5bbef4"} {"msg":"max_flush now has: [ClientId(0), ClientId(1), ClientId(2)]","v":0,"name":"crucible","level":30,"time":"2024-08-08T16:19:50.338350551Z","hostname":"w-01J4SA7S709AJF5QPY1NHP65KM","pid":5112,"mrl":"dirty","":"mend","":"downstairs","":"downstairs","session_id":"5ab4b7e7-a9e0-4310-bac4-d2618a5bbef4"} {"msg":"extent:15 dirty: true true true","v":0,"name":"crucible","level":30,"time":"2024-08-08T16:19:50.33836495Z","hostname":"w-01J4SA7S709AJF5QPY1NHP65KM","pid":5112,"mrl":"dirty","":"mend","":"downstairs","":"downstairs","session_id":"5ab4b7e7-a9e0-4310-bac4-d2618a5bbef4"} {"msg":"find dest for source 0 for extent at index 15","v":0,"name":"crucible","level":30,"time":"2024-08-08T16:19:50.338379169Z","hostname":"w-01J4SA7S709AJF5QPY1NHP65KM","pid":5112,"mrl":"dirty","":"mend","":"downstairs","":"downstairs","session_id":"5ab4b7e7-a9e0-4310-bac4-d2618a5bbef4"} {"msg":"source 0, add dest 1 source flush","v":0,"name":"crucible","level":30,"time":"2024-08-08T16:19:50.338396468Z","hostname":"w-01J4SA7S709AJF5QPY1NHP65KM","pid":5112,"mrl":"dirty","":"mend","":"downstairs","":"downstairs","session_id":"5ab4b7e7-a9e0-4310-bac4-d2618a5bbef4"} {"msg":"source 0, add dest 2 source flush","v":0,"name":"crucible","level":30,"time":"2024-08-08T16:19:50.338411258Z","hostname":"w-01J4SA7S709AJF5QPY1NHP65KM","pid":5112,"mrl":"dirty","":"mend","":"downstairs","":"downstairs","session_id":"5ab4b7e7-a9e0-4310-bac4-d2618a5bbef4"} {"msg":"Extents 20 dirty","v":0,"name":"crucible","level":30,"time":"2024-08-08T16:19:50.338425367Z","hostname":"w-01J4SA7S709AJF5QPY1NHP65KM","pid":5112,"":"mend","":"downstairs","":"downstairs","session_id":"5ab4b7e7-a9e0-4310-bac4-d2618a5bbef4"} {"msg":"First source client ID for extent 20","v":0,"name":"crucible","level":30,"time":"2024-08-08T16:19:50.338439106Z","hostname":"w-01J4SA7S709AJF5QPY1NHP65KM","pid":5112,"mrl":"dirty","":"mend","":"downstairs","":"downstairs","session_id":"5ab4b7e7-a9e0-4310-bac4-d2618a5bbef4"} {"msg":"extent:20 gens: 193 193 193","v":0,"name":"crucible","level":30,"time":"2024-08-08T16:19:50.338453385Z","hostname":"w-01J4SA7S709AJF5QPY1NHP65KM","pid":5112,"mrl":"dirty","":"mend","":"downstairs","":"downstairs","session_id":"5ab4b7e7-a9e0-4310-bac4-d2618a5bbef4"} {"msg":"extent:20 flush: 421 421 421 scs: [ClientId(0), ClientId(1), ClientId(2)]","v":0,"name":"crucible","level":30,"time":"2024-08-08T16:19:50.338468694Z","hostname":"w-01J4SA7S709AJF5QPY1NHP65KM","pid":5112,"mrl":"dirty","":"mend","":"downstairs","":"downstairs","session_id":"5ab4b7e7-a9e0-4310-bac4-d2618a5bbef4"} {"msg":"max_flush now has: [ClientId(0), ClientId(1), ClientId(2)]","v":0,"name":"crucible","level":30,"time":"2024-08-08T16:19:50.338483883Z","hostname":"w-01J4SA7S709AJF5QPY1NHP65KM","pid":5112,"mrl":"dirty","":"mend","":"downstairs","":"downstairs","session_id":"5ab4b7e7-a9e0-4310-bac4-d2618a5bbef4"} {"msg":"extent:20 dirty: true true true","v":0,"name":"crucible","level":30,"time":"2024-08-08T16:19:50.338498062Z","hostname":"w-01J4SA7S709AJF5QPY1NHP65KM","pid":5112,"mrl":"dirty","":"mend","":"downstairs","":"downstairs","session_id":"5ab4b7e7-a9e0-4310-bac4-d2618a5bbef4"} {"msg":"find dest for source 0 for extent at index 20","v":0,"name":"crucible","level":30,"time":"2024-08-08T16:19:50.338512542Z","hostname":"w-01J4SA7S709AJF5QPY1NHP65KM","pid":5112,"mrl":"dirty","":"mend","":"downstairs","":"downstairs","session_id":"5ab4b7e7-a9e0-4310-bac4-d2618a5bbef4"} {"msg":"source 0, add dest 1 source flush","v":0,"name":"crucible","level":30,"time":"2024-08-08T16:19:50.338526931Z","hostname":"w-01J4SA7S709AJF5QPY1NHP65KM","pid":5112,"mrl":"dirty","":"mend","":"downstairs","":"downstairs","session_id":"5ab4b7e7-a9e0-4310-bac4-d2618a5bbef4"} {"msg":"source 0, add dest 2 source flush","v":0,"name":"crucible","level":30,"time":"2024-08-08T16:19:50.33854125Z","hostname":"w-01J4SA7S709AJF5QPY1NHP65KM","pid":5112,"mrl":"dirty","":"mend","":"downstairs","":"downstairs","session_id":"5ab4b7e7-a9e0-4310-bac4-d2618a5bbef4"} {"msg":"Extents 21 dirty","v":0,"name":"crucible","level":30,"time":"2024-08-08T16:19:50.338555459Z","hostname":"w-01J4SA7S709AJF5QPY1NHP65KM","pid":5112,"":"mend","":"downstairs","":"downstairs","session_id":"5ab4b7e7-a9e0-4310-bac4-d2618a5bbef4"} {"msg":"First source client ID for extent 21","v":0,"name":"crucible","level":30,"time":"2024-08-08T16:19:50.338569288Z","hostname":"w-01J4SA7S709AJF5QPY1NHP65KM","pid":5112,"mrl":"dirty","":"mend","":"downstairs","":"downstairs","session_id":"5ab4b7e7-a9e0-4310-bac4-d2618a5bbef4"} {"msg":"extent:21 gens: 194 194 194","v":0,"name":"crucible","level":30,"time":"2024-08-08T16:19:50.338583497Z","hostname":"w-01J4SA7S709AJF5QPY1NHP65KM","pid":5112,"mrl":"dirty","":"mend","":"downstairs","":"downstairs","session_id":"5ab4b7e7-a9e0-4310-bac4-d2618a5bbef4"} {"msg":"extent:21 flush: 426 426 426 scs: [ClientId(0), ClientId(1), ClientId(2)]","v":0,"name":"crucible","level":30,"time":"2024-08-08T16:19:50.338598197Z","hostname":"w-01J4SA7S709AJF5QPY1NHP65KM","pid":5112,"mrl":"dirty","":"mend","":"downstairs","":"downstairs","session_id":"5ab4b7e7-a9e0-4310-bac4-d2618a5bbef4"} {"msg":"max_flush now has: [ClientId(0), ClientId(1), ClientId(2)]","v":0,"name":"crucible","level":30,"time":"2024-08-08T16:19:50.338614676Z","hostname":"w-01J4SA7S709AJF5QPY1NHP65KM","pid":5112,"mrl":"dirty","":"mend","":"downstairs","":"downstairs","session_id":"5ab4b7e7-a9e0-4310-bac4-d2618a5bbef4"} {"msg":"extent:21 dirty: true true true","v":0,"name":"crucible","level":30,"time":"2024-08-08T16:19:50.338629295Z","hostname":"w-01J4SA7S709AJF5QPY1NHP65KM","pid":5112,"mrl":"dirty","":"mend","":"downstairs","":"downstairs","session_id":"5ab4b7e7-a9e0-4310-bac4-d2618a5bbef4"} {"msg":"find dest for source 0 for extent at index 21","v":0,"name":"crucible","level":30,"time":"2024-08-08T16:19:50.338643864Z","hostname":"w-01J4SA7S709AJF5QPY1NHP65KM","pid":5112,"mrl":"dirty","":"mend","":"downstairs","":"downstairs","session_id":"5ab4b7e7-a9e0-4310-bac4-d2618a5bbef4"} {"msg":"source 0, add dest 1 source flush","v":0,"name":"crucible","level":30,"time":"2024-08-08T16:19:50.338658043Z","hostname":"w-01J4SA7S709AJF5QPY1NHP65KM","pid":5112,"mrl":"dirty","":"mend","":"downstairs","":"downstairs","session_id":"5ab4b7e7-a9e0-4310-bac4-d2618a5bbef4"} {"msg":"source 0, add dest 2 source flush","v":0,"name":"crucible","level":30,"time":"2024-08-08T16:19:50.338672183Z","hostname":"w-01J4SA7S709AJF5QPY1NHP65KM","pid":5112,"mrl":"dirty","":"mend","":"downstairs","":"downstairs","session_id":"5ab4b7e7-a9e0-4310-bac4-d2618a5bbef4"} {"msg":"Extents 25 dirty","v":0,"name":"crucible","level":30,"time":"2024-08-08T16:19:50.338686462Z","hostname":"w-01J4SA7S709AJF5QPY1NHP65KM","pid":5112,"":"mend","":"downstairs","":"downstairs","session_id":"5ab4b7e7-a9e0-4310-bac4-d2618a5bbef4"} {"msg":"First source client ID for extent 25","v":0,"name":"crucible","level":30,"time":"2024-08-08T16:19:50.338700161Z","hostname":"w-01J4SA7S709AJF5QPY1NHP65KM","pid":5112,"mrl":"dirty","":"mend","":"downstairs","":"downstairs","session_id":"5ab4b7e7-a9e0-4310-bac4-d2618a5bbef4"} {"msg":"extent:25 gens: 195 195 195","v":0,"name":"crucible","level":30,"time":"2024-08-08T16:19:50.33871427Z","hostname":"w-01J4SA7S709AJF5QPY1NHP65KM","pid":5112,"mrl":"dirty","":"mend","":"downstairs","":"downstairs","session_id":"5ab4b7e7-a9e0-4310-bac4-d2618a5bbef4"} {"msg":"extent:25 flush: 427 427 427 scs: [ClientId(0), ClientId(1), ClientId(2)]","v":0,"name":"crucible","level":30,"time":"2024-08-08T16:19:50.338728989Z","hostname":"w-01J4SA7S709AJF5QPY1NHP65KM","pid":5112,"mrl":"dirty","":"mend","":"downstairs","":"downstairs","session_id":"5ab4b7e7-a9e0-4310-bac4-d2618a5bbef4"} {"msg":"max_flush now has: [ClientId(0), ClientId(1), ClientId(2)]","v":0,"name":"crucible","level":30,"time":"2024-08-08T16:19:50.338743559Z","hostname":"w-01J4SA7S709AJF5QPY1NHP65KM","pid":5112,"mrl":"dirty","":"mend","":"downstairs","":"downstairs","session_id":"5ab4b7e7-a9e0-4310-bac4-d2618a5bbef4"} {"msg":"extent:25 dirty: true true true","v":0,"name":"crucible","level":30,"time":"2024-08-08T16:19:50.338757828Z","hostname":"w-01J4SA7S709AJF5QPY1NHP65KM","pid":5112,"mrl":"dirty","":"mend","":"downstairs","":"downstairs","session_id":"5ab4b7e7-a9e0-4310-bac4-d2618a5bbef4"} {"msg":"find dest for source 0 for extent at index 25","v":0,"name":"crucible","level":30,"time":"2024-08-08T16:19:50.338772207Z","hostname":"w-01J4SA7S709AJF5QPY1NHP65KM","pid":5112,"mrl":"dirty","":"mend","":"downstairs","":"downstairs","session_id":"5ab4b7e7-a9e0-4310-bac4-d2618a5bbef4"} {"msg":"source 0, add dest 1 source flush","v":0,"name":"crucible","level":30,"time":"2024-08-08T16:19:50.338786446Z","hostname":"w-01J4SA7S709AJF5QPY1NHP65KM","pid":5112,"mrl":"dirty","":"mend","":"downstairs","":"downstairs","session_id":"5ab4b7e7-a9e0-4310-bac4-d2618a5bbef4"} {"msg":"source 0, add dest 2 source flush","v":0,"name":"crucible","level":30,"time":"2024-08-08T16:19:50.338800585Z","hostname":"w-01J4SA7S709AJF5QPY1NHP65KM","pid":5112,"mrl":"dirty","":"mend","":"downstairs","":"downstairs","session_id":"5ab4b7e7-a9e0-4310-bac4-d2618a5bbef4"} {"msg":"Extents 29 dirty","v":0,"name":"crucible","level":30,"time":"2024-08-08T16:19:50.338816664Z","hostname":"w-01J4SA7S709AJF5QPY1NHP65KM","pid":5112,"":"mend","":"downstairs","":"downstairs","session_id":"5ab4b7e7-a9e0-4310-bac4-d2618a5bbef4"} {"msg":"First source client ID for extent 29","v":0,"name":"crucible","level":30,"time":"2024-08-08T16:19:50.338830494Z","hostname":"w-01J4SA7S709AJF5QPY1NHP65KM","pid":5112,"mrl":"dirty","":"mend","":"downstairs","":"downstairs","session_id":"5ab4b7e7-a9e0-4310-bac4-d2618a5bbef4"} {"msg":"extent:29 gens: 197 197 197","v":0,"name":"crucible","level":30,"time":"2024-08-08T16:19:50.338844573Z","hostname":"w-01J4SA7S709AJF5QPY1NHP65KM","pid":5112,"mrl":"dirty","":"mend","":"downstairs","":"downstairs","session_id":"5ab4b7e7-a9e0-4310-bac4-d2618a5bbef4"} {"msg":"extent:29 flush: 432 432 432 scs: [ClientId(0), ClientId(1), ClientId(2)]","v":0,"name":"crucible","level":30,"time":"2024-08-08T16:19:50.338859352Z","hostname":"w-01J4SA7S709AJF5QPY1NHP65KM","pid":5112,"mrl":"dirty","":"mend","":"downstairs","":"downstairs","session_id":"5ab4b7e7-a9e0-4310-bac4-d2618a5bbef4"} {"msg":"max_flush now has: [ClientId(0), ClientId(1), ClientId(2)]","v":0,"name":"crucible","level":30,"time":"2024-08-08T16:19:50.338874091Z","hostname":"w-01J4SA7S709AJF5QPY1NHP65KM","pid":5112,"mrl":"dirty","":"mend","":"downstairs","":"downstairs","session_id":"5ab4b7e7-a9e0-4310-bac4-d2618a5bbef4"} {"msg":"extent:29 dirty: true true true","v":0,"name":"crucible","level":30,"time":"2024-08-08T16:19:50.33888821Z","hostname":"w-01J4SA7S709AJF5QPY1NHP65KM","pid":5112,"mrl":"dirty","":"mend","":"downstairs","":"downstairs","session_id":"5ab4b7e7-a9e0-4310-bac4-d2618a5bbef4"} {"msg":"find dest for source 0 for extent at index 29","v":0,"name":"crucible","level":30,"time":"2024-08-08T16:19:50.338902559Z","hostname":"w-01J4SA7S709AJF5QPY1NHP65KM","pid":5112,"mrl":"dirty","":"mend","":"downstairs","":"downstairs","session_id":"5ab4b7e7-a9e0-4310-bac4-d2618a5bbef4"} {"msg":"source 0, add dest 1 source flush","v":0,"name":"crucible","level":30,"time":"2024-08-08T16:19:50.338916869Z","hostname":"w-01J4SA7S709AJF5QPY1NHP65KM","pid":5112,"mrl":"dirty","":"mend","":"downstairs","":"downstairs","session_id":"5ab4b7e7-a9e0-4310-bac4-d2618a5bbef4"} {"msg":"source 0, add dest 2 source flush","v":0,"name":"crucible","level":30,"time":"2024-08-08T16:19:50.338931168Z","hostname":"w-01J4SA7S709AJF5QPY1NHP65KM","pid":5112,"mrl":"dirty","":"mend","":"downstairs","":"downstairs","session_id":"5ab4b7e7-a9e0-4310-bac4-d2618a5bbef4"} {"msg":"Transition from WaitQuorum to Reconcile","v":0,"name":"crucible","level":30,"time":"2024-08-08T16:19:50.338945877Z","hostname":"w-01J4SA7S709AJF5QPY1NHP65KM","pid":5112,"client":"0","":"downstairs","session_id":"5ab4b7e7-a9e0-4310-bac4-d2618a5bbef4"} {"msg":"Transition from WaitQuorum to Reconcile","v":0,"name":"crucible","level":30,"time":"2024-08-08T16:19:50.338959146Z","hostname":"w-01J4SA7S709AJF5QPY1NHP65KM","pid":5112,"client":"1","":"downstairs","session_id":"5ab4b7e7-a9e0-4310-bac4-d2618a5bbef4"} {"msg":"Transition from WaitQuorum to Reconcile","v":0,"name":"crucible","level":30,"time":"2024-08-08T16:19:50.338972395Z","hostname":"w-01J4SA7S709AJF5QPY1NHP65KM","pid":5112,"client":"2","":"downstairs","session_id":"5ab4b7e7-a9e0-4310-bac4-d2618a5bbef4"} {"msg":"starting reconciliation 8720f233-b2fa-48b2-8671-3c10129f2633: found 6 extents that need repair","v":0,"name":"crucible","level":30,"time":"2024-08-08T16:19:50.338986574Z","hostname":"w-01J4SA7S709AJF5QPY1NHP65KM","pid":5112,"":"downstairs","":"downstairs","session_id":"5ab4b7e7-a9e0-4310-bac4-d2618a5bbef4"} {"msg":"Full repair list: {ExtentId(29): ExtentFix { source: ClientId(0), dest: [ClientId(1), ClientId(2)] }, ExtentId(10): ExtentFix { source: ClientId(0), dest: [ClientId(1), ClientId(2)] }, ExtentId(25): ExtentFix { source: ClientId(0), dest: [ClientId(1), ClientId(2)] }, ExtentId(15): ExtentFix { source: ClientId(0), dest: [ClientId(1), ClientId(2)] }, ExtentId(20): ExtentFix { source: ClientId(0), dest: [ClientId(1), ClientId(2)] }, ExtentId(21): ExtentFix { source: ClientId(0), dest: [ClientId(1), ClientId(2)] }}","v":0,"name":"crucible","level":30,"time":"2024-08-08T16:19:50.339009353Z","hostname":"w-01J4SA7S709AJF5QPY1NHP65KM","pid":5112,"":"downstairs","":"downstairs","session_id":"5ab4b7e7-a9e0-4310-bac4-d2618a5bbef4"} {"msg":"Task list: [ReconcileIO { id: ReconciliationId(0), op: ExtentFlush { repair_id: ReconciliationId(0), extent_id: ExtentId(29), client_id: ClientId(0), flush_number: 436, gen_number: 199 }, state: ClientData([New, New, New]) }, ReconcileIO { id: ReconciliationId(1), op: ExtentClose { repair_id: ReconciliationId(1), extent_id: ExtentId(29) }, state: ClientData([New, New, New]) }, ReconcileIO { id: ReconciliationId(2), op: ExtentRepair { repair_id: ReconciliationId(2), extent_id: ExtentId(29), source_client_id: ClientId(0), source_repair_address: 0.0.0.0:12810, dest_clients: [ClientId(1), ClientId(2)] }, state: ClientData([New, New, New]) }, ReconcileIO { id: ReconciliationId(3), op: ExtentReopen { repair_id: ReconciliationId(3), extent_id: ExtentId(29) }, state: ClientData([New, New, New]) }, ReconcileIO { id: ReconciliationId(4), op: ExtentFlush { repair_id: ReconciliationId(4), extent_id: ExtentId(10), client_id: ClientId(0), flush_number: 436, gen_number: 199 }, state: ClientData([New, New, New]) }, ReconcileIO { id: ReconciliationId(5), op: ExtentClose { repair_id: ReconciliationId(5), extent_id: ExtentId(10) }, state: ClientData([New, New, New]) }, ReconcileIO { id: ReconciliationId(6), op: ExtentRepair { repair_id: ReconciliationId(6), extent_id: ExtentId(10), source_client_id: ClientId(0), source_repair_address: 0.0.0.0:12810, dest_clients: [ClientId(1), ClientId(2)] }, state: ClientData([New, New, New]) }, ReconcileIO { id: ReconciliationId(7), op: ExtentReopen { repair_id: ReconciliationId(7), extent_id: ExtentId(10) }, state: ClientData([New, New, New]) }, ReconcileIO { id: ReconciliationId(8), op: ExtentFlush { repair_id: ReconciliationId(8), extent_id: ExtentId(25), client_id: ClientId(0), flush_number: 436, gen_number: 199 }, state: ClientData([New, New, New]) }, ReconcileIO { id: ReconciliationId(9), op: ExtentClose { repair_id: ReconciliationId(9), extent_id: ExtentId(25) }, state: ClientData([New, New, New]) }, ReconcileIO { id: ReconciliationId(10), op: ExtentRepair { repair_id: ReconciliationId(10), extent_id: ExtentId(25), source_client_id: ClientId(0), source_repair_address: 0.0.0.0:12810, dest_clients: [ClientId(1), ClientId(2)] }, state: ClientData([New, New, New]) }, ReconcileIO { id: ReconciliationId(11), op: ExtentReopen { repair_id: ReconciliationId(11), extent_id: ExtentId(25) }, state: ClientData([New, New, New]) }, ReconcileIO { id: ReconciliationId(12), op: ExtentFlush { repair_id: ReconciliationId(12), extent_id: ExtentId(15), client_id: ClientId(0), flush_number: 436, gen_number: 199 }, state: ClientData([New, New, New]) }, ReconcileIO { id: ReconciliationId(13), op: ExtentClose { repair_id: ReconciliationId(13), extent_id: ExtentId(15) }, state: ClientData([New, New, New]) }, ReconcileIO { id: ReconciliationId(14), op: ExtentRepair { repair_id: ReconciliationId(14), extent_id: ExtentId(15), source_client_id: ClientId(0), source_repair_address: 0.0.0.0:12810, dest_clients: [ClientId(1), ClientId(2)] }, state: ClientData([New, New, New]) }, ReconcileIO { id: ReconciliationId(15), op: ExtentReopen { repair_id: ReconciliationId(15), extent_id: ExtentId(15) }, state: ClientData([New, New, New]) }, ReconcileIO { id: ReconciliationId(16), op: ExtentFlush { repair_id: ReconciliationId(16), extent_id: ExtentId(20), client_id: ClientId(0), flush_number: 436, gen_number: 199 }, state: ClientData([New, New, New]) }, ReconcileIO { id: ReconciliationId(17), op: ExtentClose { repair_id: ReconciliationId(17), extent_id: ExtentId(20) }, state: ClientData([New, New, New]) }, ReconcileIO { id: ReconciliationId(18), op: ExtentRepair { repair_id: ReconciliationId(18), extent_id: ExtentId(20), source_client_id: ClientId(0), source_repair_address: 0.0.0.0:12810, dest_clients: [ClientId(1), ClientId(2)] }, state: ClientData([New, New, New]) }, ReconcileIO { id: ReconciliationId(19), op: ExtentReopen { repair_id: ReconciliationId(19), extent_id: ExtentId(20) }, state: ClientData([New, New, New]) }, ReconcileIO { id: ReconciliationId(20), op: ExtentFlush { repair_id: ReconciliationId(20), extent_id: ExtentId(21), client_id: ClientId(0), flush_number: 436, gen_number: 199 }, state: ClientData([New, New, New]) }, ReconcileIO { id: ReconciliationId(21), op: ExtentClose { repair_id: ReconciliationId(21), extent_id: ExtentId(21) }, state: ClientData([New, New, New]) }, ReconcileIO { id: ReconciliationId(22), op: ExtentRepair { repair_id: ReconciliationId(22), extent_id: ExtentId(21), source_client_id: ClientId(0), source_repair_address: 0.0.0.0:12810, dest_clients: [ClientId(1), ClientId(2)] }, state: ClientData([New, New, New]) }, ReconcileIO { id: ReconciliationId(23), op: ExtentReopen { repair_id: ReconciliationId(23), extent_id: ExtentId(21) }, state: ClientData([New, New, New]) }]","v":0,"name":"crucible","level":30,"time":"2024-08-08T16:19:50.339106028Z","hostname":"w-01J4SA7S709AJF5QPY1NHP65KM","pid":5112,"":"downstairs","":"downstairs","session_id":"5ab4b7e7-a9e0-4310-bac4-d2618a5bbef4"} {"msg":"sending reconcile request ReconciliationId(2)","v":0,"name":"crucible","level":30,"time":"2024-08-08T16:19:50.340273231Z","hostname":"w-01J4SA7S709AJF5QPY1NHP65KM","pid":5112,"client":"1","":"downstairs","session_id":"5ab4b7e7-a9e0-4310-bac4-d2618a5bbef4"} {"msg":"sending reconcile request ReconciliationId(2)","v":0,"name":"crucible","level":30,"time":"2024-08-08T16:19:50.340307949Z","hostname":"w-01J4SA7S709AJF5QPY1NHP65KM","pid":5112,"client":"2","":"downstairs","session_id":"5ab4b7e7-a9e0-4310-bac4-d2618a5bbef4"} {"msg":"sending reconcile request ReconciliationId(6)","v":0,"name":"crucible","level":30,"time":"2024-08-08T16:19:50.374604368Z","hostname":"w-01J4SA7S709AJF5QPY1NHP65KM","pid":5112,"client":"1","":"downstairs","session_id":"5ab4b7e7-a9e0-4310-bac4-d2618a5bbef4"} {"msg":"sending reconcile request ReconciliationId(6)","v":0,"name":"crucible","level":30,"time":"2024-08-08T16:19:50.374682644Z","hostname":"w-01J4SA7S709AJF5QPY1NHP65KM","pid":5112,"client":"2","":"downstairs","session_id":"5ab4b7e7-a9e0-4310-bac4-d2618a5bbef4"} {"msg":"sending reconcile request ReconciliationId(10)","v":0,"name":"crucible","level":30,"time":"2024-08-08T16:19:50.407999519Z","hostname":"w-01J4SA7S709AJF5QPY1NHP65KM","pid":5112,"client":"1","":"downstairs","session_id":"5ab4b7e7-a9e0-4310-bac4-d2618a5bbef4"} {"msg":"sending reconcile request ReconciliationId(10)","v":0,"name":"crucible","level":30,"time":"2024-08-08T16:19:50.408054616Z","hostname":"w-01J4SA7S709AJF5QPY1NHP65KM","pid":5112,"client":"2","":"downstairs","session_id":"5ab4b7e7-a9e0-4310-bac4-d2618a5bbef4"} {"msg":"sending reconcile request ReconciliationId(14)","v":0,"name":"crucible","level":30,"time":"2024-08-08T16:19:50.441933039Z","hostname":"w-01J4SA7S709AJF5QPY1NHP65KM","pid":5112,"client":"1","":"downstairs","session_id":"5ab4b7e7-a9e0-4310-bac4-d2618a5bbef4"} {"msg":"sending reconcile request ReconciliationId(14)","v":0,"name":"crucible","level":30,"time":"2024-08-08T16:19:50.442024184Z","hostname":"w-01J4SA7S709AJF5QPY1NHP65KM","pid":5112,"client":"2","":"downstairs","session_id":"5ab4b7e7-a9e0-4310-bac4-d2618a5bbef4"} {"msg":"sending reconcile request ReconciliationId(18)","v":0,"name":"crucible","level":30,"time":"2024-08-08T16:19:50.47499243Z","hostname":"w-01J4SA7S709AJF5QPY1NHP65KM","pid":5112,"client":"1","":"downstairs","session_id":"5ab4b7e7-a9e0-4310-bac4-d2618a5bbef4"} {"msg":"sending reconcile request ReconciliationId(18)","v":0,"name":"crucible","level":30,"time":"2024-08-08T16:19:50.475057216Z","hostname":"w-01J4SA7S709AJF5QPY1NHP65KM","pid":5112,"client":"2","":"downstairs","session_id":"5ab4b7e7-a9e0-4310-bac4-d2618a5bbef4"} {"msg":"sending reconcile request ReconciliationId(22)","v":0,"name":"crucible","level":30,"time":"2024-08-08T16:19:50.507104724Z","hostname":"w-01J4SA7S709AJF5QPY1NHP65KM","pid":5112,"client":"1","":"downstairs","session_id":"5ab4b7e7-a9e0-4310-bac4-d2618a5bbef4"} {"msg":"sending reconcile request ReconciliationId(22)","v":0,"name":"crucible","level":30,"time":"2024-08-08T16:19:50.50717515Z","hostname":"w-01J4SA7S709AJF5QPY1NHP65KM","pid":5112,"client":"2","":"downstairs","session_id":"5ab4b7e7-a9e0-4310-bac4-d2618a5bbef4"} {"msg":"done with reconciliation","v":0,"name":"crucible","level":30,"time":"2024-08-08T16:19:50.537759851Z","hostname":"w-01J4SA7S709AJF5QPY1NHP65KM","pid":5112,"":"downstairs","":"downstairs","session_id":"5ab4b7e7-a9e0-4310-bac4-d2618a5bbef4"} {"msg":"Transition from Reconcile to Active","v":0,"name":"crucible","level":30Wait for a query_work_queue command to finish before sending IO ,"time":"2024-08-08T16:19:50.537812858Z","hostname":"w-01J4SA7S709AJF5QPY1NHP65KM","pid":5112,"client":"0","":"downstairs","session_id":"5ab4b7e7-a9e0-4310-bac4-d2618a5bbef4"} {"msg":"Transition from Reconcile to Active","v":0,"name":"crucible","level":30,"time":"2024-08-08T16:19:50.537829327Z","hostname":"w-01J4SA7S709AJF5QPY1NHP65KM","pid":5112,"client":"1","":"downstairs","session_id":"5ab4b7e7-a9e0-4310-bac4-d2618a5bbef4"} {"msg":"Transition from Reconcile to Active","v":0,"name":"crucible","level":30,"time":"2024-08-08T16:19:50.537843297Z","hostname":"w-01J4SA7S709AJF5QPY1NHP65KM","pid":5112,"client":"2","":"downstairs","session_id":"5ab4b7e7-a9e0-4310-bac4-d2618a5bbef4"} {"msg":"All required reconciliation work is completed","v":0,"name":"crucible","level":30,"time":"2024-08-08T16:19:50.537856976Z","hostname":"w-01J4SA7S709AJF5QPY1NHP65KM","pid":5112,"session_id":"5ab4b7e7-a9e0-4310-bac4-d2618a5bbef4"} {"msg":"Set Downstairs and Upstairs active after reconciliation","v":0,"name":"crucible","level":30,"time":"2024-08-08T16:19:50.537869405Z","hostname":"w-01J4SA7S709AJF5QPY1NHP65KM","pid":5112,"session_id":"5ab4b7e7-a9e0-4310-bac4-d2618a5bbef4"} {"msg":"daa158e2-0e0f-4411-9079-002b6bccc598 is now active with session: 5ab4b7e7-a9e0-4310-bac4-d2618a5bbef4","v":0,"name":"crucible","level":30,"time":"2024-08-08T16:19:50.537889764Z","hostname":"w-01J4SA7S709AJF5QPY1NHP65KM","pid":5112,"session_id":"5ab4b7e7-a9e0-4310-bac4-d2618a5bbef4"} {"msg":"The guest has finished waiting for activation with:199","v":0,"name":"crucible","level":30,"time":"2024-08-08T16:19:50.537905793Z","hostname":"w-01J4SA7S709AJF5QPY1NHP65KM","pid":5112} Region: es:20 ec:30 bs:4096 ts:2457600 tb:600 max_io:256 or 1048576 Loading write count information from file "/tmp/test_repair_verify.data" Read and Verify all blocks (0..600 range:true) Wrote out file "/tmp/test_repair_verify.data" Verify test completed Wrote out file "/tmp/test_repair_verify.data" CLIENT: Tests done. All submitted work has been ACK'd ---------------------------------------------------------------- Crucible gen:199 GIO:true work queues: Upstairs:0 downstairs:3 States: Active Active Active GW_ID ACK DSID TYPE BKS/EXT DS:0 DS:1 DS:2 REPLAY 1 Acked 1000 Read 88 Done Done Done false 2 Acked 1001 Read 256 Done Done Done false 3 Acked 1002 Read 256 Done Done Done false STATES DS:0 DS:1 DS:2 TOTAL New 0 0 0 0 Sent 0 0 0 0 Done 3 3 3 9 Skipped 0 0 0 0 Error 0 0 0 0 Last Flush: 0 0 0 Downstairs last five completed: Upstairs last five completed: 3 2 1 CLIENT: Up:0 ds:3 act:3 ---------------------------------------------------------------- Crucible gen:199 GIO:true work queues: Upstairs:0 downstairs:0 Downstairs last five completed: 1003 1002 1001 1000 Upstairs last five completed: 4 3 2 1 CLIENT: Up:0 ds:0 act:3 CLIENT: All crucible jobs finished, exiting program {"msg":"Guest handle has been dropped","v":0,"name":"crucible","level":40,"time":"2024-08-08T16:19:54.590296817Z","hostname":"w-01J4SA7S709AJF5QPY1NHP65KM","pid":5112}