Using existing output directory "/tmp/dsc" start ds: 8810 start ds: 8820 start ds: 8830 start access at:127.0.0.1:9998 Starting downstairs at port 8810 Starting downstairs at port 8820 Make output file at "/tmp/dsc/downstairs-8810.txt" Make output file at "/tmp/dsc/downstairs-8820.txt" [8810][0] reports Starting [8820][1] reports Starting Starting downstairs at port 8830 Make output file at "/tmp/dsc/downstairs-8830.txt" [8830][2] reports Starting Downstairs /var/tmp/dsc/8810 port 8810 PID:Some(1457) [8810][0] reports Running Downstairs /var/tmp/dsc/8830 port 8830 PID:Some(1458) [8830][2] reports Running Downstairs /var/tmp/dsc/8820 port 8820 PID:Some(1459) [8820][1] reports Running Jul 09 21:53:54.798 INFO listening, local_addr: 127.0.0.1:9998 Control access at:127.0.0.1:9998 Jul 09 21:53:59.842 INFO accepted connection, remote_addr: 127.0.0.1:43997, local_addr: 127.0.0.1:9998 Main task has work to do, go find it got dsc DisableRestartAll disable restart on all: 3 Jul 09 21:53:59.843 INFO[8810] Disable keep_running [8830] Disable keep_running request completed, latency_us: 146[8820] Disable keep_running , response_code: 204, uri: /disablerestart/all, method: POST, req_id: 0776c324-4b2e-4013-9f9a-0bcc3ebf982f, remote_addr: 127.0.0.1:43997, local_addr: 127.0.0.1:9998 Jul 09 21:55:33.708 INFO accepted connection, remote_addr: 127.0.0.1:61271, local_addr: 127.0.0.1:9998 Jul 09 21:55:33.708 INFO request completed, latency_us: 78, response_code: 204, uri: /shutdown, method: POST, req_id: 6b5827e2-c813-4968-9ea5-342b8c269617, remote_addr: 127.0.0.1:61271, local_addr: 127.0.0.1:9998 Main task has work to do, go find it got dsc Shutdown Shutdown Shut it down [8810] Disable keep_running [8810] Got stop action so:false kr:false [8820] Disable keep_running [8830] Disable keep_running [8830] Got stop action so:false kr:false [8820] Got stop action so:false kr:false [8820] Exited with: ExitStatus(unix_wait_status(9)) [8820][1] reports Exit [8830] Exited with: ExitStatus(unix_wait_status(9)) [8830][2] reports Exit [8810] Exited with: ExitStatus(unix_wait_status(9)) [8810][0] reports Exit ":"bmat-EVT22200007-00002cd1","pid":1462} {"msg":"Upstairs <-> Downstairs Message Version: 8","v":0,"name":"crucible","level":30,"time":"2024-07-09T21:53:59.860151348Z","hostname":"bmat-EVT22200007-00002cd1","pid":1462} {"msg":"Crucible 64bd5254-91af-460e-9373-51c03787a2ff has session id: bc2456df-3af5-4674-b20a-f98bea0ccd02","v":0,"name":"crucible","level":30,"time":"2024-07-09T21:53:59.860472204Z","hostname":"bmat-EVT22200007-00002cd1","pid":1462,"session_id":"bc2456df-3af5-4674-b20a-f98bea0ccd02"} {"msg":"Upstairs opts: Upstairs UUID: 64bd5254-91af-460e-9373-51c03787a2ff, Targets: [127.0.0.1:8810, 127.0.0.1:8820, 127.0.0.1:8830], lossy: false, flush_timeout: None, key populated: false, cert_pem populated: false, key_pem populated: false, root_cert_pem populated: false, Control: None, read_only: false","v":0,"name":"crucible","level":30,"time":"2024-07-09T21:53:59.860501171Z","hostname":"bmat-EVT22200007-00002cd1","pid":1462,"session_id":"bc2456df-3af5-4674-b20a-f98bea0ccd02"} {"msg":"Crucible stats registered with UUID: 64bd5254-91af-460e-9373-51c03787a2ff","v":0,"name":"crucible","level":30,"time":"2024-07-09T21:53:59.860508265Z","hostname":"bmat-EVT22200007-00002cd1","pid":1462,"session_id":"bc2456df-3af5-4674-b20a-f98bea0ccd02"} Crucible runtime is spawned {"msg":"The guest has requested activation with gen:1","v":0,"name":"crucible","level":30,"time":"2024-07-09T21:53:59.904531784Z","hostname":"bmat-EVT22200007-00002cd1","pid":1462} {"msg":"64bd5254-91af-460e-9373-51c03787a2ff active request set","v":0,"name":"crucible","level":30,"time":"2024-07-09T21:53:59.904698945Z","hostname":"bmat-EVT22200007-00002cd1","pid":1462,"session_id":"bc2456df-3af5-4674-b20a-f98bea0ccd02"} {"msg":"sending connect oneshot to client","v":0,"name":"crucible","level":30,"time":"2024-07-09T21:53:59.904707722Z","hostname":"bmat-EVT22200007-00002cd1","pid":1462,"client":"0","":"downstairs","session_id":"bc2456df-3af5-4674-b20a-f98bea0ccd02"} {"msg":"client set_active_request while in New; waiting...","v":0,"name":"crucible","level":30,"time":"2024-07-09T21:53:59.904720127Z","hostname":"bmat-EVT22200007-00002cd1","pid":1462,"client":"0","":"downstairs","session_id":"bc2456df-3af5-4674-b20a-f98bea0ccd02"} {"msg":"sending connect oneshot to client","v":0,"name":"crucible","level":30,"time":"2024-07-09T21:53:59.90473206Z","hostname":"bmat-EVT22200007-00002cd1","pid":1462,"client":"1","":"downstairs","session_id":"bc2456df-3af5-4674-b20a-f98bea0ccd02"} {"msg":"client set_active_request while in New; waiting...","v":0,"name":"crucible","level":30,"time":"2024-07-09T21:53:59.904743212Z","hostname":"bmat-EVT22200007-00002cd1","pid":1462,"client":"1","":"downstairs","session_id":"bc2456df-3af5-4674-b20a-f98bea0ccd02"} {"msg":"sending connect oneshot to client","v":0,"name":"crucible","level":30,"time":"2024-07-09T21:53:59.904749164Z","hostname":"bmat-EVT22200007-00002cd1","pid":1462,"client":"2","":"downstairs","session_id":"bc2456df-3af5-4674-b20a-f98bea0ccd02"} {"msg":"client set_active_request while in New; waiting...","v":0,"name":"crucible","level":30,"time":"2024-07-09T21:53:59.904754385Z","hostname":"bmat-EVT22200007-00002cd1","pid":1462,"client":"2","":"downstairs","session_id":"bc2456df-3af5-4674-b20a-f98bea0ccd02"} {"msg":"connecting to 127.0.0.1:8830","v":0,"name":"crucible","level":30,"time":"2024-07-09T21:53:59.904919912Z","hostname":"bmat-EVT22200007-00002cd1","pid":1462,"":"io task","client":"2","":"downstairs","session_id":"bc2456df-3af5-4674-b20a-f98bea0ccd02"} {"msg":"connecting to 127.0.0.1:8810","v":0,"name":"crucible","level":30,"time":"2024-07-09T21:53:59.90492909Z","hostname":"bmat-EVT22200007-00002cd1","pid":1462,"":"io task","client":"0","":"downstairs","session_id":"bc2456df-3af5-4674-b20a-f98bea0ccd02"} {"msg":"connecting to 127.0.0.1:8820","v":0,"name":"crucible","level":30,"time":"2024-07-09T21:53:59.904997005Z","hostname":"bmat-EVT22200007-00002cd1","pid":1462,"":"io task","client":"1","":"downstairs","session_id":"bc2456df-3af5-4674-b20a-f98bea0ccd02"} {"msg":"ds_connection connected from Ok(127.0.0.1:55990)","v":0,"name":"crucible","level":30,"time":"2024-07-09T21:53:59.905349828Z","hostname":"bmat-EVT22200007-00002cd1","pid":1462,"":"io task","client":"0","":"downstairs","session_id":"bc2456df-3af5-4674-b20a-f98bea0ccd02"} {"msg":"ds_connection connected from Ok(127.0.0.1:46989)","v":0,"name":"crucible","level":30,"time":"2024-07-09T21:53:59.905385158Z","hostname":"bmat-EVT22200007-00002cd1","pid":1462,"":"io task","client":"1","":"downstairs","session_id":"bc2456df-3af5-4674-b20a-f98bea0ccd02"} {"msg":"ds_connection connected from Ok(127.0.0.1:37250)","v":0,"name":"crucible","level":30,"time":"2024-07-09T21:53:59.905393905Z","hostname":"bmat-EVT22200007-00002cd1","pid":1462,"":"io task","client":"2","":"downstairs","session_id":"bc2456df-3af5-4674-b20a-f98bea0ccd02"} {"msg":"ds_transition from New to WaitActive","v":0,"name":"crucible","level":30,"time":"2024-07-09T21:53:59.905788366Z","hostname":"bmat-EVT22200007-00002cd1","pid":1462,"client":"0","":"downstairs","session_id":"bc2456df-3af5-4674-b20a-f98bea0ccd02"} {"msg":"[0] Transition from New to WaitActive","v":0,"name":"crucible","level":30,"time":"2024-07-09T21:53:59.905803346Z","hostname":"bmat-EVT22200007-00002cd1","pid":1462,"client":"0","":"downstairs","session_id":"bc2456df-3af5-4674-b20a-f98bea0ccd02"} {"msg":"ds_transition from New to WaitActive","v":0,"name":"crucible","level":30,"time":"2024-07-09T21:53:59.906038043Z","hostname":"bmat-EVT22200007-00002cd1","pid":1462,"client":"1","":"downstairs","session_id":"bc2456df-3af5-4674-b20a-f98bea0ccd02"} {"msg":"[1] Transition from New to WaitActive","v":0,"name":"crucible","level":30,"time":"2024-07-09T21:53:59.906181126Z","hostname":"bmat-EVT22200007-00002cd1","pid":1462,"client":"1","":"downstairs","session_id":"bc2456df-3af5-4674-b20a-f98bea0ccd02"} {"msg":"ds_transition from New to WaitActive","v":0,"name":"crucible","level":30,"time":"2024-07-09T21:53:59.906188791Z","hostname":"bmat-EVT22200007-00002cd1","pid":1462,"client":"2","":"downstairs","session_id":"bc2456df-3af5-4674-b20a-f98bea0ccd02"} {"msg":"[2] Transition from New to WaitActive","v":0,"name":"crucible","level":30,"time":"2024-07-09T21:53:59.906202599Z","hostname":"bmat-EVT22200007-00002cd1","pid":1462,"client":"2","":"downstairs","session_id":"bc2456df-3af5-4674-b20a-f98bea0ccd02"} {"msg":"downstairs client at Some(127.0.0.1:8810) has region UUID 12345678-0000-0000-0000-000000008810","v":0,"name":"crucible","level":30,"time":"2024-07-09T21:53:59.906416602Z","hostname":"bmat-EVT22200007-00002cd1","pid":1462,"client":"0","":"downstairs","session_id":"bc2456df-3af5-4674-b20a-f98bea0ccd02"} {"msg":"downstairs client at Some(127.0.0.1:8830) has region UUID 12345678-0000-0000-0000-000000008830","v":0,"name":"crucible","level":30,"time":"2024-07-09T21:53:59.906430189Z","hostname":"bmat-EVT22200007-00002cd1","pid":1462,"client":"2","":"downstairs","session_id":"bc2456df-3af5-4674-b20a-f98bea0ccd02"} {"msg":"downstairs client at Some(127.0.0.1:8820) has region UUID 12345678-0000-0000-0000-000000008820","v":0,"name":"crucible","level":30,"time":"2024-07-09T21:53:59.90644583Z","hostname":"bmat-EVT22200007-00002cd1","pid":1462,"client":"1","":"downstairs","session_id":"bc2456df-3af5-4674-b20a-f98bea0ccd02"} {"msg":"ds_transition from WaitActive to WaitQuorum","v":0,"name":"crucible","level":30,"time":"2024-07-09T21:53:59.917273943Z","hostname":"bmat-EVT22200007-00002cd1","pid":1462,"client":"0","":"downstairs","session_id":"bc2456df-3af5-4674-b20a-f98bea0ccd02"} {"msg":"[0] Transition from WaitActive to WaitQuorum","v":0,"name":"crucible","level":30,"time":"2024-07-09T21:53:59.917285476Z","hostname":"bmat-EVT22200007-00002cd1","pid":1462,"client":"0","":"downstairs","session_id":"bc2456df-3af5-4674-b20a-f98bea0ccd02"} {"msg":"Waiting for more clients to be ready","v":0,"name":"crucible","level":30,"time":"2024-07-09T21:53:59.917291508Z","hostname":"bmat-EVT22200007-00002cd1","pid":1462,"session_id":"bc2456df-3af5-4674-b20a-f98bea0ccd02"} {"msg":"ds_transition from WaitActive to WaitQuorum","v":0,"name":"crucible","level":30,"time":"2024-07-09T21:53:59.917375334Z","hostname":"bmat-EVT22200007-00002cd1","pid":1462,"client":"2","":"downstairs","session_id":"bc2456df-3af5-4674-b20a-f98bea0ccd02"} {"msg":"[2] Transition from WaitActive to WaitQuorum","v":0,"name":"crucible","level":30,"time":"2024-07-09T21:53:59.917382959Z","hostname":"bmat-EVT22200007-00002cd1","pid":1462,"client":"2","":"downstairs","session_id":"bc2456df-3af5-4674-b20a-f98bea0ccd02"} {"msg":"Waiting for more clients to be ready","v":0,"name":"crucible","level":30,"time":"2024-07-09T21:53:59.917389011Z","hostname":"bmat-EVT22200007-00002cd1","pid":1462,"session_id":"bc2456df-3af5-4674-b20a-f98bea0ccd02"} {"msg":"ds_transition from WaitActive to WaitQuorum","v":0,"name":"crucible","level":30,"time":"2024-07-09T21:53:59.917503437Z","hostname":"bmat-EVT22200007-00002cd1","pid":1462,"client":"1","":"downstairs","session_id":"bc2456df-3af5-4674-b20a-f98bea0ccd02"} {"msg":"[1] Transition from WaitActive to WaitQuorum","v":0,"name":"crucible","level":30,"time":"2024-07-09T21:53:59.917511072Z","hostname":"bmat-EVT22200007-00002cd1","pid":1462,"client":"1","":"downstairs","session_id":"bc2456df-3af5-4674-b20a-f98bea0ccd02"} {"msg":"[0]R flush_numbers[0..12]: [0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]","v":0,"name":"crucible","level":30,"time":"2024-07-09T21:53:59.917517575Z","hostname":"bmat-EVT22200007-00002cd1","pid":1462,"":"downstairs","":"downstairs","session_id":"bc2456df-3af5-4674-b20a-f98bea0ccd02"} {"msg":"[0]R generation[0..12]: [0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]","v":0,"name":"crucible","level":30,"time":"2024-07-09T21:53:59.917524028Z","hostname":"bmat-EVT22200007-00002cd1","pid":1462,"":"downstairs","":"downstairs","session_id":"bc2456df-3af5-4674-b20a-f98bea0ccd02"} {"msg":"[0]R dirty[0..12]: [false, false, false, false, false, false, false, false, false, false, false, false]","v":0,"name":"crucible","level":30,"time":"2024-07-09T21:53:59.917530591Z","hostname":"bmat-EVT22200007-00002cd1","pid":1462,"":"downstairs","":"downstairs","session_id":"bc2456df-3af5-4674-b20a-f98bea0ccd02"} {"msg":"[1]R flush_numbers[0..12]: [0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]","v":0,"name":"crucible","level":30,"time":"2024-07-09T21:53:59.917542444Z","hostname":"bmat-EVT22200007-00002cd1","pid":1462,"":"downstairs","":"downstairs","session_id":"bc2456df-3af5-4674-b20a-f98bea0ccd02"} {"msg":"[1]R generation[0..12]: [0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]","v":0,"name":"crucible","level":30,"time":"2024-07-09T21:53:59.917548807Z","hostname":"bmat-EVT22200007-00002cd1","pid":1462,"":"downstairs","":"downstairs","session_id":"bc2456df-3af5-4674-b20a-f98bea0ccd02"} {"msg":"[1]R dirty[0..12]: [false, false, false, false, false, false, false, false, false, false, false, false]","v":0,"name":"crucible","level":30,"time":"2024-07-09T21:53:59.917554729Z","hostname":"bmat-EVT22200007-00002cd1","pid":1462,"":"downstairs","":"downstairs","session_id":"bc2456df-3af5-4674-b20a-f98bea0ccd02"} {"msg":"[2]R flush_numbers[0..12]: [0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]","v":0,"name":"crucible","level":30,"time":"2024-07-09T21:53:59.917560741Z","hostname":"bmat-EVT22200007-00002cd1","pid":1462,"":"downstairs","":"downstairs","session_id":"bc2456df-3af5-4674-b20a-f98bea0ccd02"} {"msg":"[2]R generation[0..12]: [0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]","v":0,"name":"crucible","level":30,"time":"2024-07-09T21:53:59.917566602Z","hostname":"bmat-EVT22200007-00002cd1","pid":1462,"":"downstairs","":"downstairs","session_id":"bc2456df-3af5-4674-b20a-f98bea0ccd02"} {"msg":"[2]R dirty[0..12]: [false, false, false, false, false, false, false, false, false, false, false, false]","v":0,"name":"crucible","level":30,"time":"2024-07-09T21:53:59.917572604Z","hostname":"bmat-EVT22200007-00002cd1","pid":1462,"":"downstairs","":"downstairs","session_id":"bc2456df-3af5-4674-b20a-f98bea0ccd02"} {"msg":"Max found gen is 1","v":0,"name":"crucible","level":30,"time":"2024-07-09T21:53:59.917578656Z","hostname":"bmat-EVT22200007-00002cd1","pid":1462,"":"downstairs","":"downstairs","session_id":"bc2456df-3af5-4674-b20a-f98bea0ccd02"} {"msg":"Generation requested: 1 >= found:1","v":0,"name":"crucible","level":30,"time":"2024-07-09T21:53:59.917584558Z","hostname":"bmat-EVT22200007-00002cd1","pid":1462,"":"downstairs","":"downstairs","session_id":"bc2456df-3af5-4674-b20a-f98bea0ccd02"} {"msg":"Next flush: 1","v":0,"name":"crucible","level":30,"time":"2024-07-09T21:53:59.91759059Z","hostname":"bmat-EVT22200007-00002cd1","pid":1462,"":"downstairs","":"downstairs","session_id":"bc2456df-3af5-4674-b20a-f98bea0ccd02"} {"msg":"All extents match","v":0,"name":"crucible","level":30,"time":"2024-07-09T21:53:59.917602052Z","hostname":"bmat-EVT22200007-00002cd1","pid":1462,"":"downstairs","":"downstairs","session_id":"bc2456df-3af5-4674-b20a-f98bea0ccd02"} {"msg":"No downstairs reconciliation required","v":0,"name":"crucible","level":30,"time":"2024-07-09T21:53:59.917608716Z","hostname":"bmat-EVT22200007-00002cd1","pid":1462,"session_id":"bc2456df-3af5-4674-b20a-f98bea0ccd02"} {"msg":"Transition from WaitQuorum to Active","v":0,"name":"crucible","level":30,"time":"2024-07-09T21:53:59.917614016Z","hostname":"bmat-EVT22200007-00002cd1","pid":1462,"client":"0","":"downstairs","session_id":"bc2456df-3af5-4674-b20a-f98bea0ccd02"} {"msg":"Transition from WaitQuorum to Active","v":0,"name":"crucible","level":30,"time":"2024-07-09T21:53:59.917619797Z","hostname":"bmat-EVT22200007-00002cd1","pid":1462,"client":"1","":"downstairs","session_id":"bc2456df-3af5-4674-b20a-f98bea0ccd02"} {"msg":"Transition from WaitQuorum to Active","v":0,"name":"crucible","level":30,"time":"2024-07-09T21:53:59.917625589Z","hostname":"bmat-EVT22200007-00002cd1","pid":1462,"client":"2","":"downstairs","session_id":"bc2456df-3af5-4674-b20a-f98bea0ccd02"} {"msg":"All required reconciliation work is completed","v":0,"name":"crucible","level":30,"time":"2024-07-09T21:53:59.917631571Z","hostname":"bmat-EVT22200007-00002cd1","pid":1462,"session_id":"bc2456df-3af5-4674-b20a-f98bea0ccd02"} {"msg":"Set Downstairs and Upstairs active after reconciliation","v":0,"name":"crucible","level":30,"time":"2024-07-09T21:53:59.917636851Z","hostname":"bmat-EVT22200007-00002cd1","pid":1462,"session_id":"bc2456df-3af5-4674-b20a-f98bea0ccd02"} {"msg":"64bd5254-91af-460e-9373-51c03787a2ff is now active with session: bc2456df-3af5-4674-b20a-f98bea0ccd02","v":0,"name":"crucible","level":30,"time":"2024-07-09T21:53:59.917645108Z","hostname":"bmat-EVT22200007-00002cd1","pid":1462,"session_id":"bc2456df-3af5-4674-b20a-f98bea0ccd02"} {"msg":"Set Active after no reconciliation","v":0,"name":"crucible","level":30,"time":"2024-07-09T21:53:59.917650508Z","hostname":"bmat-EVT22200007-00002cd1","pid":1462,"session_id":"bc2456df-3af5-4674-b20a-f98bea0ccd02"} {"msg":"The guest has finished waiting for activation with:1","v":0,"name":"crucible","level":30,"time":"2024-07-09T21:53:59.91766653Z","hostname":"bmat-EVT22200007-00002cd1","pid":1462} Wait for a query_work_queue command to finish before sending IO Region: es:16384 ec:1600 bs:4096 ts:107374182400 tb:26214400 max_io:256 or 1048576 Fill test CLIENT: Tests done. All submitted work has been ACK'd ---------------------------------------------------------------- Crucible gen:1 GIO:true work queues: Upstairs:0 downstairs:77 States: Active Active Active GW_ID ACK DSID TYPE BKS/EXT DS:0 DS:1 DS:2 REPLAY 102498 Acked 103497 Write 256 Done Done Done false 102499 Acked 103498 Write 256 Done Done Done false 102500 Acked 103499 Write 256 Done Done Done false 102501 Acked 103500 Write 256 Done Done Done false 102502 Acked 103501 Write 256 Done Done Done false 102503 Acked 103502 Write 256 Done Done Done false 102504 Acked 103503 Write 256 Done Done Done false 102505 Acked 103504 Write 256 Done Done Done false 102506 Acked 103505 Write 256 Done Done Done false 102507 Acked 103506 Write 256 Done Done Done false 102508 Acked 103507 Write 256 Done Done Done false 102509 Acked 103508 Write 256 Done Done Done false 102510 Acked 103509 Write 256 Done Done Done false 102511 Acked 103510 Write 256 Done Done Done false 102512 Acked 103511 Write 256 Done Done Done false 102513 Acked 103512 Write 256 Done Done Done false 102514 Acked 103513 Write 256 Done Done Done false 102515 Acked 103514 Write 256 Done Done Done false 102516 Acked 103515 Write 256 Done Done Done false 102517 Acked 103516 Write 256 Done Done Done false 102518 Acked 103517 Write 256 Done Done Done false 102519 Acked 103518 Write 256 Done Done Done false 102520 Acked 103519 Write 256 Done Done Done false 102521 Acked 103520 Write 256 Done Done Done false 102522 Acked 103521 Write 256 Done Done Done false 102523 Acked 103522 Write 256 Done Done Done false 102524 Acked 103523 Write 256 Done Done Done false 102525 Acked 103524 Write 256 Done Done Done false 102526 Acked 103525 Write 256 Done Done Done false 102527 Acked 103526 Write 256 Done Done Done false 102528 Acked 103527 Write 256 Done Done Done false 102529 Acked 103528 Write 256 Done Done Done false 102530 Acked 103529 Write 256 Done Done Done false 102531 Acked 103530 Write 256 Done Done Done false 102532 Acked 103531 Write 256 Done Done Done false 102533 Acked 103532 Write 256 Done Done Done false 102534 Acked 103533 Write 256 Done Done Done false 102535 Acked 103534 Write 256 Done Done Done false 102536 Acked 103535 Write 256 Done Done Done false 102537 Acked 103536 Write 256 Done Done Done false 102538 Acked 103537 Write 256 Done Done Done false 102539 Acked 103538 Write 256 Done Done Done false 102540 Acked 103539 Write 256 Done Done Done false 102541 Acked 103540 Write 256 Done Done Done false 102542 Acked 103541 Write 256 Done Done Done false 102543 Acked 103542 Write 256 Done Done Done false 102544 Acked 103543 Write 256 Done Done Done false 102545 Acked 103544 Write 256 Done Done Done false 102546 Acked 103545 Write 256 Done Done Done false 102547 Acked 103546 Write 256 Done Done Done false 102548 Acked 103547 Write 256 Done Done Done false 102549 Acked 103548 Write 256 Done Done Done false 102550 Acked 103549 Write 256 Done Done Done false 102551 Acked 103550 Write 256 Done Done Done false 102552 Acked 103551 Write 256 Done Done Done false 102553 Acked 103552 Write 256 Done Done Done false 102554 Acked 103553 Write 256 Done Done Done false 102555 Acked 103554 Write 256 Done Done Done false 102556 Acked 103555 Write 256 Done Done Done false 102557 Acked 103556 Write 256 Done Done Done false 102558 Acked 103557 Write 256 Done Done Done false 102559 Acked 103558 Write 256 Done Done Done false 102560 Acked 103559 Write 256 Done Done Done false 102561 Acked 103560 Write 256 Done Done Done false 102562 Acked 103561 Write 256 Done Done Done false 102563 Acked 103562 Write 256 Done Done Done false 102564 Acked 103563 Write 256 Done Done Done false 102565 Acked 103564 Write 256 Done Done Done false 102566 Acked 103565 Write 256 Done Sent Done false 102567 Acked 103566 Write 256 Done Sent Done false 102568 Acked 103567 Write 256 Done Sent Done false 102569 Acked 103568 Write 256 Done Sent Done false 102570 Acked 103569 Write 256 Done Sent Done false 102571 Acked 103570 Write 256 Done Sent Done false 102572 Acked 103571 Write 256 Done Sent Done false 102573 Acked 103572 Write 256 Done Sent Done false 102574 Acked 103573 Flush 0 Done Sent Done false STATES DS:0 DS:1 DS:2 TOTAL New 0 0 0 0 Sent 0 9 0 9 Done 77 68 77 222 Skipped 0 0 0 0 Error 0 0 0 0 Last Flush: 103573 103496 103573 Downstairs last five completed: 103496 103495 103494 103493 103492 Upstairs last five completed: 102574 102573 102572 102571 102570 CLIENT: Up:0 ds:77 act:3 ---------------------------------------------------------------- Crucible gen:1 GIO:true work queues: Upstairs:0 downstairs:0 Downstairs last five completed: 103573 103572 103571 103570 103569 Upstairs last five completed: 102574 102573 102572 102571 102570 CLIENT: Up:0 ds:0 act:3 CLIENT: All crucible jobs finished, exiting program