Using existing output directory "/tmp/dsc" start ds: 8810 start ds: 8820 start ds: 8830 start access at:127.0.0.1:9998 Starting downstairs at port 8810 Make output file at "/tmp/dsc/downstairs-8810.txt" Starting downstairs at port 8830 Make output file at "/tmp/dsc/downstairs-8830.txt" [8810][0] reports Starting [8830][2] reports Starting Starting downstairs at port 8820 [8820][1] reports Starting Make output file at "/tmp/dsc/downstairs-8820.txt" Downstairs /var/tmp/dsc/8810 port 8810 PID:Some(1445) [8810][0] reports Running Downstairs /var/tmp/dsc/8830 port 8830 PID:Some(1446) [8830][2] reports Running Jan 24 23:41:02.537 INFO Downstairs /var/tmp/dsc/8820 port 8820 PID:Some(1447) listening, local_addr: 127.0.0.1:9998 [8820][1] reports Running Control access at:127.0.0.1:9998 Jan 24 23:41:07.604 INFO accepted connection, remote_addr: 127.0.0.1:64098, local_addr: 127.0.0.1:9998 Main task has work to do, go find it got dsc DisableRestartAll disable restart on all: 3 Jan 24 23:41:07.605 INFO request completed, latency_us: 178, response_code: 204, uri: /disablerestart/all[8810] Disable keep_running , method: POST, req_id: 27691077-f45c-47ed-b8a3-63394da8e298, remote_addr: 127.[8820] Disable keep_running 0.0.1:64098, local_addr: 127.0.0.1:9998[8830] Disable keep_running Jan 24 23:48:07.056 INFO accepted connection, remote_addr: 127.0.0.1:36777, local_addr: 127.0.0.1:9998 Main task has work to do, go find it got dsc Shutdown Shutdown Shut it down Jan 24 23:48:07.057 INFO request completed, latency_us: 85, response_code: 204, uri:[8820] Disable keep_running [8810] Disable keep_running /shutdown[8830] Disable keep_running , [8830] Got stop action so:false kr:false method: POST, req_id: c570d589-dfeb-426a-af51-32f67beaf95b, remote_addr: 127.0.0.1:36777, local_addr: 127.[8820] Got stop action so:false kr:false 0.0.1:9998 [8810] Got stop action so:false kr:false [8810] Exited with: ExitStatus(unix_wait_status(9)) [8820] Exited with: ExitStatus(unix_wait_status(9)) [8830] Exited with: ExitStatus(unix_wait_status(9)) [8810][0] reports Exit [8820][1] reports Exit [8830][2] reports Exit 73392Z","hostname":"ip-10-150-1-194.us-west-2.compute.internal","pid":1450} {"msg":"Upstairs <-> Downstairs Message Version: 5","v":0,"name":"crucible","level":30,"time":"2024-01-24T23:41:07.625382497Z","hostname":"ip-10-150-1-194.us-west-2.compute.internal","pid":1450} {"msg":"Crucible b7d3b986-1cbd-4738-8b27-ac6e34729b86 has session id: 0cb4a627-e4f6-4d59-b807-a48a01d7fcef","v":0,"name":"crucible","level":30,"time":"2024-01-24T23:41:07.625389314Z","hostname":"ip-10-150-1-194.us-west-2.compute.internal","pid":1450,"session_id":"0cb4a627-e4f6-4d59-b807-a48a01d7fcef"} {"msg":"Upstairs opts: Upstairs UUID: b7d3b986-1cbd-4738-8b27-ac6e34729b86, Targets: [127.0.0.1:8810, 127.0.0.1:8820, 127.0.0.1:8830], lossy: false, flush_timeout: None, key populated: false, cert_pem populated: false, key_pem populated: false, root_cert_pem populated: false, Control: None, read_only: false","v":0,"name":"crucible","level":30,"time":"2024-01-24T23:41:07.625401601Z","hostname":"ip-10-150-1-194.us-west-2.compute.internal","pid":1450,"session_id":"0cb4a627-e4f6-4d59-b807-a48a01d7fcef"} {"msg":"Crucible stats registered with UUID: b7d3b986-1cbd-4738-8b27-ac6e34729b86","v":0,"name":"crucible","level":30,"time":"2024-01-24T23:41:07.625409009Z","hostname":"ip-10-150-1-194.us-west-2.compute.internal","pid":1450,"session_id":"0cb4a627-e4f6-4d59-b807-a48a01d7fcef"} Crucible runtime is spawned {"msg":"The guest has requested activation with gen:1","v":0,"name":"crucible","level":30,"time":"2024-01-24T23:41:07.625555902Z","hostname":"ip-10-150-1-194.us-west-2.compute.internal","pid":1450} {"msg":"b7d3b986-1cbd-4738-8b27-ac6e34729b86 active request set","v":0,"name":"crucible","level":30,"time":"2024-01-24T23:41:07.625574875Z","hostname":"ip-10-150-1-194.us-west-2.compute.internal","pid":1450,"session_id":"0cb4a627-e4f6-4d59-b807-a48a01d7fcef"} {"msg":"sending connect oneshot to client","v":0,"name":"crucible","level":30,"time":"2024-01-24T23:41:07.62558382Z","hostname":"ip-10-150-1-194.us-west-2.compute.internal","pid":1450,"client":"0","":"downstairs","session_id":"0cb4a627-e4f6-4d59-b807-a48a01d7fcef"} {"msg":"client set_active_request while in New; waiting...","v":0,"name":"crucible","level":30,"time":"2024-01-24T23:41:07.625602693Z","hostname":"ip-10-150-1-194.us-west-2.compute.internal","pid":1450,"client":"0","":"downstairs","session_id":"0cb4a627-e4f6-4d59-b807-a48a01d7fcef"} {"msg":"sending connect oneshot to client","v":0,"name":"crucible","level":30,"time":"2024-01-24T23:41:07.625610246Z","hostname":"ip-10-150-1-194.us-west-2.compute.internal","pid":1450,"client":"1","":"downstairs","session_id":"0cb4a627-e4f6-4d59-b807-a48a01d7fcef"} {"msg":"client set_active_request while in New; waiting...","v":0,"name":"crucible","level":30,"time":"2024-01-24T23:41:07.625617371Z","hostname":"ip-10-150-1-194.us-west-2.compute.internal","pid":1450,"client":"1","":"downstairs","session_id":"0cb4a627-e4f6-4d59-b807-a48a01d7fcef"} {"msg":"sending connect oneshot to client","v":0,"name":"crucible","level":30,"time":"2024-01-24T23:41:07.62562445Z","hostname":"ip-10-150-1-194.us-west-2.compute.internal","pid":1450,"client":"2","":"downstairs","session_id":"0cb4a627-e4f6-4d59-b807-a48a01d7fcef"} {"msg":"client set_active_request while in New; waiting...","v":0,"name":"crucible","level":30,"time":"2024-01-24T23:41:07.62563156Z","hostname":"ip-10-150-1-194.us-west-2.compute.internal","pid":1450,"client":"2","":"downstairs","session_id":"0cb4a627-e4f6-4d59-b807-a48a01d7fcef"} {"msg":"connecting to 127.0.0.1:8830","v":0,"name":"crucible","level":30,"time":"2024-01-24T23:41:07.625711601Z","hostname":"ip-10-150-1-194.us-west-2.compute.internal","pid":1450,"":"io task","client":"2","":"downstairs","session_id":"0cb4a627-e4f6-4d59-b807-a48a01d7fcef"} {"msg":"connecting to 127.0.0.1:8810","v":0,"name":"crucible","level":30,"time":"2024-01-24T23:41:07.625726381Z","hostname":"ip-10-150-1-194.us-west-2.compute.internal","pid":1450,"":"io task","client":"0","":"downstairs","session_id":"0cb4a627-e4f6-4d59-b807-a48a01d7fcef"} {"msg":"connecting to 127.0.0.1:8820","v":0,"name":"crucible","level":30,"time":"2024-01-24T23:41:07.625734294Z","hostname":"ip-10-150-1-194.us-west-2.compute.internal","pid":1450,"":"io task","client":"1","":"downstairs","session_id":"0cb4a627-e4f6-4d59-b807-a48a01d7fcef"} {"msg":"ds_connection connected","v":0,"name":"crucible","level":30,"time":"2024-01-24T23:41:07.625966778Z","hostname":"ip-10-150-1-194.us-west-2.compute.internal","pid":1450,"":"io task","client":"1","":"downstairs","session_id":"0cb4a627-e4f6-4d59-b807-a48a01d7fcef"} {"msg":"ds_connection connected","v":0,"name":"crucible","level":30,"time":"2024-01-24T23:41:07.626167557Z","hostname":"ip-10-150-1-194.us-west-2.compute.internal","pid":1450,"":"io task","client":"0","":"downstairs","session_id":"0cb4a627-e4f6-4d59-b807-a48a01d7fcef"} {"msg":"ds_connection connected","v":0,"name":"crucible","level":30,"time":"2024-01-24T23:41:07.626186671Z","hostname":"ip-10-150-1-194.us-west-2.compute.internal","pid":1450,"":"io task","client":"2","":"downstairs","session_id":"0cb4a627-e4f6-4d59-b807-a48a01d7fcef"} {"msg":"ds_transition from New to WaitActive","v":0,"name":"crucible","level":30,"time":"2024-01-24T23:41:07.626506361Z","hostname":"ip-10-150-1-194.us-west-2.compute.internal","pid":1450,"client":"0","":"downstairs","session_id":"0cb4a627-e4f6-4d59-b807-a48a01d7fcef"} {"msg":"[0] Transition from New to WaitActive","v":0,"name":"crucible","level":30,"time":"2024-01-24T23:41:07.626527387Z","hostname":"ip-10-150-1-194.us-west-2.compute.internal","pid":1450,"client":"0","":"downstairs","session_id":"0cb4a627-e4f6-4d59-b807-a48a01d7fcef"} {"msg":"ds_transition from New to WaitActive","v":0,"name":"crucible","level":30,"time":"2024-01-24T23:41:07.62659191Z","hostname":"ip-10-150-1-194.us-west-2.compute.internal","pid":1450,"client":"1","":"downstairs","session_id":"0cb4a627-e4f6-4d59-b807-a48a01d7fcef"} {"msg":"[1] Transition from New to WaitActive","v":0,"name":"crucible","level":30,"time":"2024-01-24T23:41:07.626667457Z","hostname":"ip-10-150-1-194.us-west-2.compute.internal","pid":1450,"client":"1","":"downstairs","session_id":"0cb4a627-e4f6-4d59-b807-a48a01d7fcef"} {"msg":"ds_transition from New to WaitActive","v":0,"name":"crucible","level":30,"time":"2024-01-24T23:41:07.626688107Z","hostname":"ip-10-150-1-194.us-west-2.compute.internal","pid":1450,"client":"2","":"downstairs","session_id":"0cb4a627-e4f6-4d59-b807-a48a01d7fcef"} {"msg":"[2] Transition from New to WaitActive","v":0,"name":"crucible","level":30,"time":"2024-01-24T23:41:07.626701748Z","hostname":"ip-10-150-1-194.us-west-2.compute.internal","pid":1450,"client":"2","":"downstairs","session_id":"0cb4a627-e4f6-4d59-b807-a48a01d7fcef"} {"msg":"downstairs client at Some(127.0.0.1:8810) has region UUID 12345678-0000-0000-0000-000000008810","v":0,"name":"crucible","level":30,"time":"2024-01-24T23:41:07.627344712Z","hostname":"ip-10-150-1-194.us-west-2.compute.internal","pid":1450,"client":"0","":"downstairs","session_id":"0cb4a627-e4f6-4d59-b807-a48a01d7fcef"} {"msg":"downstairs client at Some(127.0.0.1:8820) has region UUID 12345678-0000-0000-0000-000000008820","v":0,"name":"crucible","level":30,"time":"2024-01-24T23:41:07.627562149Z","hostname":"ip-10-150-1-194.us-west-2.compute.internal","pid":1450,"client":"1","":"downstairs","session_id":"0cb4a627-e4f6-4d59-b807-a48a01d7fcef"} {"msg":"downstairs client at Some(127.0.0.1:8830) has region UUID 12345678-0000-0000-0000-000000008830","v":0,"name":"crucible","level":30,"time":"2024-01-24T23:41:07.627639129Z","hostname":"ip-10-150-1-194.us-west-2.compute.internal","pid":1450,"client":"2","":"downstairs","session_id":"0cb4a627-e4f6-4d59-b807-a48a01d7fcef"} {"msg":"ds_transition from WaitActive to WaitQuorum","v":0,"name":"crucible","level":30,"time":"2024-01-24T23:41:07.640422506Z","hostname":"ip-10-150-1-194.us-west-2.compute.internal","pid":1450,"client":"0","":"downstairs","session_id":"0cb4a627-e4f6-4d59-b807-a48a01d7fcef"} {"msg":"[0] Transition from WaitActive to WaitQuorum","v":0,"name":"crucible","level":30,"time":"2024-01-24T23:41:07.640438483Z","hostname":"ip-10-150-1-194.us-west-2.compute.internal","pid":1450,"client":"0","":"downstairs","session_id":"0cb4a627-e4f6-4d59-b807-a48a01d7fcef"} {"msg":"Waiting for true more clients to be ready","v":0,"name":"crucible","level":30,"time":"2024-01-24T23:41:07.64044629Z","hostname":"ip-10-150-1-194.us-west-2.compute.internal","pid":1450,"session_id":"0cb4a627-e4f6-4d59-b807-a48a01d7fcef"} {"msg":"ds_transition from WaitActive to WaitQuorum","v":0,"name":"crucible","level":30,"time":"2024-01-24T23:41:07.640678339Z","hostname":"ip-10-150-1-194.us-west-2.compute.internal","pid":1450,"client":"1","":"downstairs","session_id":"0cb4a627-e4f6-4d59-b807-a48a01d7fcef"} {"msg":"[1] Transition from WaitActive to WaitQuorum","v":0,"name":"crucible","level":30,"time":"2024-01-24T23:41:07.640687788Z","hostname":"ip-10-150-1-194.us-west-2.compute.internal","pid":1450,"client":"1","":"downstairs","session_id":"0cb4a627-e4f6-4d59-b807-a48a01d7fcef"} {"msg":"Waiting for true more clients to be ready","v":0,"name":"crucible","level":30,"time":"2024-01-24T23:41:07.640694935Z","hostname":"ip-10-150-1-194.us-west-2.compute.internal","pid":1450,"session_id":"0cb4a627-e4f6-4d59-b807-a48a01d7fcef"} {"msg":"ds_transition from WaitActive to WaitQuorum","v":0,"name":"crucible","level":30,"time":"2024-01-24T23:41:07.64070131Z","hostname":"ip-10-150-1-194.us-west-2.compute.internal","pid":1450,"client":"2","":"downstairs","session_id":"0cb4a627-e4f6-4d59-b807-a48a01d7fcef"} {"msg":"[2] Transition from WaitActive to WaitQuorum","v":0,"name":"crucible","level":30,"time":"2024-01-24T23:41:07.640708546Z","hostname":"ip-10-150-1-194.us-west-2.compute.internal","pid":1450,"client":"2","":"downstairs","session_id":"0cb4a627-e4f6-4d59-b807-a48a01d7fcef"} {"msg":"[0]R flush_numbers[0..12]: [0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]","v":0,"name":"crucible","level":30,"time":"2024-01-24T23:41:07.640725287Z","hostname":"ip-10-150-1-194.us-west-2.compute.internal","pid":1450,"":"downstairs","":"downstairs","session_id":"0cb4a627-e4f6-4d59-b807-a48a01d7fcef"} {"msg":"[0]R generation[0..12]: [0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]","v":0,"name":"crucible","level":30,"time":"2024-01-24T23:41:07.640737326Z","hostname":"ip-10-150-1-194.us-west-2.compute.internal","pid":1450,"":"downstairs","":"downstairs","session_id":"0cb4a627-e4f6-4d59-b807-a48a01d7fcef"} {"msg":"[0]R dirty[0..12]: [false, false, false, false, false, false, false, false, false, false, false, false]","v":0,"name":"crucible","level":30,"time":"2024-01-24T23:41:07.640745076Z","hostname":"ip-10-150-1-194.us-west-2.compute.internal","pid":1450,"":"downstairs","":"downstairs","session_id":"0cb4a627-e4f6-4d59-b807-a48a01d7fcef"} {"msg":"[1]R flush_numbers[0..12]: [0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]","v":0,"name":"crucible","level":30,"time":"2024-01-24T23:41:07.640752227Z","hostname":"ip-10-150-1-194.us-west-2.compute.internal","pid":1450,"":"downstairs","":"downstairs","session_id":"0cb4a627-e4f6-4d59-b807-a48a01d7fcef"} {"msg":"[1]R generation[0..12]: [0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]","v":0,"name":"crucible","level":30,"time":"2024-01-24T23:41:07.640759342Z","hostname":"ip-10-150-1-194.us-west-2.compute.internal","pid":1450,"":"downstairs","":"downstairs","session_id":"0cb4a627-e4f6-4d59-b807-a48a01d7fcef"} {"msg":"[1]R dirty[0..12]: [false, false, false, false, false, false, false, false, false, false, false, false]","v":0,"name":"crucible","level":30,"time":"2024-01-24T23:41:07.640766472Z","hostname":"ip-10-150-1-194.us-west-2.compute.internal","pid":1450,"":"downstairs","":"downstairs","session_id":"0cb4a627-e4f6-4d59-b807-a48a01d7fcef"} {"msg":"[2]R flush_numbers[0..12]: [0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]","v":0,"name":"crucible","level":30,"time":"2024-01-24T23:41:07.640773482Z","hostname":"ip-10-150-1-194.us-west-2.compute.internal","pid":1450,"":"downstairs","":"downstairs","session_id":"0cb4a627-e4f6-4d59-b807-a48a01d7fcef"} {"msg":"[2]R generation[0..12]: [0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]","v":0,"name":"crucible","level":30,"time":"2024-01-24T23:41:07.640780427Z","hostname":"ip-10-150-1-194.us-west-2.compute.internal","pid":1450,"":"downstairs","":"downstairs","session_id":"0cb4a627-e4f6-4d59-b807-a48a01d7fcef"} {"msg":"[2]R dirty[0..12]: [false, false, false, false, false, false, false, false, false, false, false, false]","v":0,"name":"crucible","level":30,"time":"2024-01-24T23:41:07.640787499Z","hostname":"ip-10-150-1-194.us-west-2.compute.internal","pid":1450,"":"downstairs","":"downstairs","session_id":"0cb4a627-e4f6-4d59-b807-a48a01d7fcef"} {"msg":"Max found gen is 1","v":0,"name":"crucible","level":30,"time":"2024-01-24T23:41:07.640794571Z","hostname":"ip-10-150-1-194.us-west-2.compute.internal","pid":1450,"":"downstairs","":"downstairs","session_id":"0cb4a627-e4f6-4d59-b807-a48a01d7fcef"} {"msg":"Generation requested: 1 >= found:1","v":0,"name":"crucible","level":30,"time":"2024-01-24T23:41:07.640801588Z","hostname":"ip-10-150-1-194.us-west-2.compute.internal","pid":1450,"":"downstairs","":"downstairs","session_id":"0cb4a627-e4f6-4d59-b807-a48a01d7fcef"} {"msg":"Next flush: 1","v":0,"name":"crucible","level":30,"time":"2024-01-24T23:41:07.640808569Z","hostname":"ip-10-150-1-194.us-west-2.compute.internal","pid":1450,"":"downstairs","":"downstairs","session_id":"0cb4a627-e4f6-4d59-b807-a48a01d7fcef"} {"msg":"All extents match","v":0,"name":"crucible","level":30,"time":"2024-01-24T23:41:07.640815546Z","hostname":"ip-10-150-1-194.us-west-2.compute.internal","pid":1450,"":"downstairs","":"downstairs","session_id":"0cb4a627-e4f6-4d59-b807-a48a01d7fcef"} {"msg":"No downstairs reconciliation required","v":0,"name":"crucible","level":30,"time":"2024-01-24T23:41:07.640822511Z","hostname":"ip-10-150-1-194.us-west-2.compute.internal","pid":1450,"session_id":"0cb4a627-e4f6-4d59-b807-a48a01d7fcef"} {"msg":"Transition from WaitQuorum to Active","v":0,"name":"crucible","level":30,"time":"2024-01-24T23:41:07.640828559Z","hostname":"ip-10-150-1-194.us-west-2.compute.internal","pid":1450,"client":"0","":"downstairs","session_id":"0cb4a627-e4f6-4d59-b807-a48a01d7fcef"} {"msg":"Transition from WaitQuorum to Active","v":0,"name":"crucible","level":30,"time":"2024-01-24T23:41:07.640835579Z","hostname":"ip-10-150-1-194.us-west-2.compute.internal","pid":1450,"client":"1","":"downstairs","session_id":"0cb4a627-e4f6-4d59-b807-a48a01d7fcef"} {"msg":"Transition from WaitQuorum to Active","v":0,"name":"crucible","level":30,"time":"2024-01-24T23:41:07.640845542Z","hostname":"ip-10-150-1-194.us-west-2.compute.internal","pid":1450,"client":"2","":"downstairs","session_id":"0cb4a627-e4f6-4d59-b807-a48a01d7fcef"} {"msg":"All required reconciliation work is completed","v":0,"name":"crucible","level":30,"time":"2024-01-24T23:41:07.640852681Z","hostname":"ip-10-150-1-194.us-west-2.compute.internal","pid":1450,"session_id":"0cb4a627-e4f6-4d59-b807-a48a01d7fcef"} Wait for a query_work_queue command to finish before sending IO {"msg":"Set Downstairs and Upstairs active after reconciliation","v":0,"name":"crucible","level":30,"time":"2024-01-24T23:41:07.640862712Z","hostname":"ip-10-150-1-194.us-west-2.compute.internal","pid":1450,"session_id":"0cb4a627-e4f6-4d59-b807-a48a01d7fcef"} {"msg":"b7d3b986-1cbd-4738-8b27-ac6e34729b86 is now active with session: 0cb4a627-e4f6-4d59-b807-a48a01d7fcef","v":0,"name":"crucible","level":30,"time":"2024-01-24T23:41:07.640869597Z","hostname":"ip-10-150-1-194.us-west-2.compute.internal","pid":1450,"session_id":"0cb4a627-e4f6-4d59-b807-a48a01d7fcef"} {"msg":"Set Active after no reconciliation","v":0,"name":"crucible","level":30,"time":"2024-01-24T23:41:07.640875585Z","hostname":"ip-10-150-1-194.us-west-2.compute.internal","pid":1450,"session_id":"0cb4a627-e4f6-4d59-b807-a48a01d7fcef"} {"msg":"The guest has finished waiting for activation with:1","v":0,"name":"crucible","level":30,"time":"2024-01-24T23:41:07.640881647Z","hostname":"ip-10-150-1-194.us-west-2.compute.internal","pid":1450} Region: es:16384 ec:1600 bs:4096 ts:107374182400 tb:26214400 max_io:256 or 1048576 Fill test CLIENT: Tests done. All submitted work has been ACK'd ---------------------------------------------------------------- Crucible gen:1 GIO:true work queues: Upstairs:0 downstairs:68 States: Active Active Active GW_ID ACK DSID TYPE BLOCKS DS:0 DS:1 DS:2 REPLAY 262904 Acked 263903 Write 100 Done Done Done false 262905 Acked 263904 Write 100 Done Done Done false 262906 Acked 263905 Write 100 Done Done Done false 262907 Acked 263906 Write 100 Done Done Done false 262908 Acked 263907 Write 100 Done Done Done false 262909 Acked 263908 Write 100 Done Done Done false 262910 Acked 263909 Write 100 Done Done Done false 262911 Acked 263910 Write 100 Done Done Done false 262912 Acked 263911 Write 100 Done Done Done false 262913 Acked 263912 Write 100 Done Done Done false 262914 Acked 263913 Write 100 Done Done Done false 262915 Acked 263914 Write 100 Done Done Done false 262916 Acked 263915 Write 100 Done Done Done false 262917 Acked 263916 Write 100 Done Done Done false 262918 Acked 263917 Write 100 Done Done Done false 262919 Acked 263918 Write 100 Done Done Done false 262920 Acked 263919 Write 100 Done Done Done false 262921 Acked 263920 Write 100 Done Done Done false 262922 Acked 263921 Write 100 Done Done Done false 262923 Acked 263922 Write 100 Done Done Done false 262924 Acked 263923 Write 100 Done Done Done false 262925 Acked 263924 Write 100 Done Done Done false 262926 Acked 263925 Write 100 Done Done Done false 262927 Acked 263926 Write 100 Done Done Done false 262928 Acked 263927 Write 100 Done Done Done false 262929 Acked 263928 Write 100 Done Done Done false 262930 Acked 263929 Write 100 Done Done Done false 262931 Acked 263930 Write 100 Done Done Done false 262932 Acked 263931 Write 100 Done Done Done false 262933 Acked 263932 Write 100 Done Done Done false 262934 Acked 263933 Write 100 Done Done Done false 262935 Acked 263934 Write 100 Done Done Done false 262936 Acked 263935 Write 100 Done Done Done false 262937 Acked 263936 Write 100 Done Done Done false 262938 Acked 263937 Write 100 Done Done Done false 262939 Acked 263938 Write 100 Done Done Done false 262940 Acked 263939 Write 100 Done Done Done false 262941 Acked 263940 Write 100 Done Done Done false 262942 Acked 263941 Write 100 Done Done Done false 262943 Acked 263942 Write 100 Done Done Done false 262944 Acked 263943 Write 100 Done Done Done false 262945 Acked 263944 Write 100 Done Done Done false 262946 Acked 263945 Write 100 Done Done Done false 262947 Acked 263946 Write 100 Done Done Done false 262948 Acked 263947 Write 100 Done Done Done false 262949 Acked 263948 Write 100 Done Done Done false 262950 Acked 263949 Write 100 Done Done Done false 262951 Acked 263950 Write 100 Done Done Done false 262952 Acked 263951 Write 100 Done Done Done false 262953 Acked 263952 Write 100 Done Done Done false 262954 Acked 263953 Write 100 Done Done Done false 262955 Acked 263954 Write 100 Done Done Done false 262956 Acked 263955 Write 100 Done Done Done false 262957 Acked 263956 Write 100 Done Done Done false 262958 Acked 263957 Write 100 Done Done Done false 262959 Acked 263958 Write 100 Done Done Done false 262960 Acked 263959 Write 100 Done Done Done false 262961 Acked 263960 Write 100 Done Done Done false 262962 Acked 263961 Write 100 Done Done Done false 262963 Acked 263962 Write 100 Done Done Done false 262964 Acked 263963 Write 100 Done Done Done false 262965 Acked 263964 Write 100 Done Done Done false 262966 Acked 263965 Write 100 Done Done Done false 262967 Acked 263966 Write 100 Done Done Done false 262968 Acked 263967 Write 100 Done Done Done false 262969 Acked 263968 Write 100 Done Done Done false 262970 Acked 263969 Write 100 Done Done Done false 262971 Acked 263970 Flush 0 Done Done Sent false STATES DS:0 DS:1 DS:2 TOTAL New 0 0 0 0 Sent 0 0 1 1 Done 68 68 67 203 Skipped 0 0 0 0 Error 0 0 0 0 Last Flush: 263970 263970 263902 Downstairs last five completed: 263902 263901 263900 263899 263898 Upstairs last five completed: 262971 262970 262969 262968 262967 CLIENT: Up:0 ds:68 act:3 ---------------------------------------------------------------- Crucible gen:1 GIO:true work queues: Upstairs:0 downstairs:0 Downstairs last five completed: 263970 263969 263968 263967 263966 Upstairs last five completed: 262971 262970 262969 262968 262967 CLIENT: Up:0 ds:0 act:3 CLIENT: All crucible jobs finished, exiting program