Max level shown:
1 starting April 20, 2024 at 01:04:57 AM UTC
2 Creating downstairs regions
3 Creating region directory at: /var/tmp/dsc/region
4 Creating dsc directory at: /tmp/dsc
5 Downstairs region 0 created at /var/tmp/dsc/region/8810 in 0.35739556
6 Downstairs region 1 created at /var/tmp/dsc/region/8820 in 0.054783896
7 Downstairs region 2 created at /var/tmp/dsc/region/8830 in 0.057418097
8 Region set with 3 regions was created
9 Starting downstairs
10 Using existing output directory "/tmp/dsc"
11 start ds: 8810
12 start ds: 8820
13 start ds: 8830
14 Starting downstairs at port 8810
15 start access at:127.0.0.1:9998
16 Starting downstairs at port 8820
17 Make output file at "/tmp/dsc/downstairs-8810.txt"
18 Starting downstairs at port 8830
19 Make output file at "/tmp/dsc/downstairs-8830.txt"
20 Make output file at "/tmp/dsc/downstairs-8820.txt"
21 [8810][0] reports Starting
22 [8820][1] reports Starting
23 [8830][2] reports Starting
24 Downstairs /var/tmp/dsc/region/8820 port 8820 PID:Some(1186)
25 [8820][1] reports Running
26 Downstairs /var/tmp/dsc/region/8830 port 8830 PID:Some(1187)
27 [8830][2] reports Running
28 Downstairs /var/tmp/dsc/region/8810 port 8810 PID:Some(1188)
29 [8810][0] reports Running
30 Apr 20 01:04:58.476 INFO listening, local_addr: 127.0.0.1:9998
31 Control access at:127.0.0.1:9998
32 Running initial fill
332024-04-20T01:05:03.491ZINFOcrucible: Upstairs starts
342024-04-20T01:05:03.492ZINFOcrucible: Crucible Version: BuildInfo { version: "0.0.1", git_sha: "b97e434eec561fa80f965a2f40ec87c83a3a439e", git_commit_timestamp: "2024-04-20T00:34:22.000000000Z", git_branch: "artemis/remove-reqwest-block-io", rustc_semver: "1.76.0", rustc_channel: "stable", rustc_host_triple: "x86_64-unknown-illumos", rustc_commit_sha: "07dca489ac2d933c78d3c5158e3f43beefeb02ce", cargo_triple: "x86_64-unknown-illumos", debug: true, opt_level: 0, }
352024-04-20T01:05:03.492ZINFOcrucible: Upstairs <-> Downstairs Message Version: 6
362024-04-20T01:05:03.492ZINFOcrucible: Crucible 71dc4886-6507-4c11-9b33-f6d3054a6afb has session id: 944066dc-e56b-4208-ae1c-db1ef612af0d session_id = 944066dc-e56b-4208-ae1c-db1ef612af0d
372024-04-20T01:05:03.492ZINFOcrucible: Upstairs opts: Upstairs UUID: 71dc4886-6507-4c11-9b33-f6d3054a6afb, Targets: [127.0.0.1:8810, 127.0.0.1:8820, 127.0.0.1:8830], lossy: false, flush_timeout: None, key populated: false, cert_pem populated: false, key_pem populated: false, root_cert_pem populated: false, Control: None, read_only: false session_id = 944066dc-e56b-4208-ae1c-db1ef612af0d
382024-04-20T01:05:03.492ZINFOcrucible: Crucible stats registered with UUID: 71dc4886-6507-4c11-9b33-f6d3054a6afb session_id = 944066dc-e56b-4208-ae1c-db1ef612af0d
39 Crucible runtime is spawned
402024-04-20T01:05:03.493ZINFOcrucible: The guest has requested activation with gen:1
412024-04-20T01:05:03.493ZINFOcrucible: 71dc4886-6507-4c11-9b33-f6d3054a6afb active request set session_id = 944066dc-e56b-4208-ae1c-db1ef612af0d
422024-04-20T01:05:03.493ZINFOcrucible: sending connect oneshot to client = downstairs client = 0 session_id = 944066dc-e56b-4208-ae1c-db1ef612af0d
432024-04-20T01:05:03.493ZINFOcrucible: client set_active_request while in New; waiting... = downstairs client = 0 session_id = 944066dc-e56b-4208-ae1c-db1ef612af0d
442024-04-20T01:05:03.493ZINFOcrucible: sending connect oneshot to client = downstairs client = 1 session_id = 944066dc-e56b-4208-ae1c-db1ef612af0d
452024-04-20T01:05:03.493ZINFOcrucible: client set_active_request while in New; waiting... = downstairs client = 1 session_id = 944066dc-e56b-4208-ae1c-db1ef612af0d
462024-04-20T01:05:03.493ZINFOcrucible: sending connect oneshot to client = downstairs client = 2 session_id = 944066dc-e56b-4208-ae1c-db1ef612af0d
472024-04-20T01:05:03.493ZINFOcrucible: client set_active_request while in New; waiting... = downstairs client = 2 session_id = 944066dc-e56b-4208-ae1c-db1ef612af0d
482024-04-20T01:05:03.493ZINFOcrucible: connecting to 127.0.0.1:8810 = io task client = 0 session_id = 944066dc-e56b-4208-ae1c-db1ef612af0d
492024-04-20T01:05:03.493ZINFOcrucible: connecting to 127.0.0.1:8820 = io task client = 1 session_id = 944066dc-e56b-4208-ae1c-db1ef612af0d
502024-04-20T01:05:03.493ZINFOcrucible: connecting to 127.0.0.1:8830 = io task client = 2 session_id = 944066dc-e56b-4208-ae1c-db1ef612af0d
512024-04-20T01:05:03.493ZINFOcrucible: ds_connection connected from Ok(127.0.0.1:53032) = io task client = 1 session_id = 944066dc-e56b-4208-ae1c-db1ef612af0d
522024-04-20T01:05:03.493ZINFOcrucible: ds_connection connected from Ok(127.0.0.1:56106) = io task client = 2 session_id = 944066dc-e56b-4208-ae1c-db1ef612af0d
532024-04-20T01:05:03.493ZINFOcrucible: ds_connection connected from Ok(127.0.0.1:64851) = io task client = 0 session_id = 944066dc-e56b-4208-ae1c-db1ef612af0d
542024-04-20T01:05:03.496ZINFOcrucible: ds_transition from New to WaitActive = downstairs client = 1 session_id = 944066dc-e56b-4208-ae1c-db1ef612af0d
552024-04-20T01:05:03.496ZINFOcrucible: [1] Transition from New to WaitActive = downstairs client = 1 session_id = 944066dc-e56b-4208-ae1c-db1ef612af0d
562024-04-20T01:05:03.496ZINFOcrucible: ds_transition from New to WaitActive = downstairs client = 2 session_id = 944066dc-e56b-4208-ae1c-db1ef612af0d
572024-04-20T01:05:03.496ZINFOcrucible: [2] Transition from New to WaitActive = downstairs client = 2 session_id = 944066dc-e56b-4208-ae1c-db1ef612af0d
582024-04-20T01:05:03.496ZINFOcrucible: ds_transition from New to WaitActive = downstairs client = 0 session_id = 944066dc-e56b-4208-ae1c-db1ef612af0d
592024-04-20T01:05:03.496ZINFOcrucible: [0] Transition from New to WaitActive = downstairs client = 0 session_id = 944066dc-e56b-4208-ae1c-db1ef612af0d
602024-04-20T01:05:03.497ZINFOcrucible: downstairs client at Some(127.0.0.1:8830) has region UUID 12345678-0000-0000-0000-000000008830 = downstairs client = 2 session_id = 944066dc-e56b-4208-ae1c-db1ef612af0d
612024-04-20T01:05:03.497ZINFOcrucible: downstairs client at Some(127.0.0.1:8820) has region UUID 12345678-0000-0000-0000-000000008820 = downstairs client = 1 session_id = 944066dc-e56b-4208-ae1c-db1ef612af0d
622024-04-20T01:05:03.497ZINFOcrucible: downstairs client at Some(127.0.0.1:8810) has region UUID 12345678-0000-0000-0000-000000008810 = downstairs client = 0 session_id = 944066dc-e56b-4208-ae1c-db1ef612af0d
632024-04-20T01:05:03.498ZINFOcrucible: ds_transition from WaitActive to WaitQuorum = downstairs client = 1 session_id = 944066dc-e56b-4208-ae1c-db1ef612af0d
642024-04-20T01:05:03.498ZINFOcrucible: [1] Transition from WaitActive to WaitQuorum = downstairs client = 1 session_id = 944066dc-e56b-4208-ae1c-db1ef612af0d
652024-04-20T01:05:03.498ZINFOcrucible: Waiting for more clients to be ready session_id = 944066dc-e56b-4208-ae1c-db1ef612af0d
662024-04-20T01:05:03.498ZINFOcrucible: ds_transition from WaitActive to WaitQuorum = downstairs client = 2 session_id = 944066dc-e56b-4208-ae1c-db1ef612af0d
672024-04-20T01:05:03.498ZINFOcrucible: [2] Transition from WaitActive to WaitQuorum = downstairs client = 2 session_id = 944066dc-e56b-4208-ae1c-db1ef612af0d
682024-04-20T01:05:03.498ZINFOcrucible: Waiting for more clients to be ready session_id = 944066dc-e56b-4208-ae1c-db1ef612af0d
692024-04-20T01:05:03.498ZINFOcrucible: ds_transition from WaitActive to WaitQuorum = downstairs client = 0 session_id = 944066dc-e56b-4208-ae1c-db1ef612af0d
702024-04-20T01:05:03.498ZINFOcrucible: [0] Transition from WaitActive to WaitQuorum = downstairs client = 0 session_id = 944066dc-e56b-4208-ae1c-db1ef612af0d
712024-04-20T01:05:03.498ZINFOcrucible: [0]R flush_numbers[0..12]: [0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0] = downstairs session_id = 944066dc-e56b-4208-ae1c-db1ef612af0d
722024-04-20T01:05:03.498ZINFOcrucible: [0]R generation[0..12]: [0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0] = downstairs session_id = 944066dc-e56b-4208-ae1c-db1ef612af0d
732024-04-20T01:05:03.498ZINFOcrucible: [0]R dirty[0..12]: [false, false, false, false, false, false, false, false, false, false, false, false] = downstairs session_id = 944066dc-e56b-4208-ae1c-db1ef612af0d
742024-04-20T01:05:03.498ZINFOcrucible: [1]R flush_numbers[0..12]: [0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0] = downstairs session_id = 944066dc-e56b-4208-ae1c-db1ef612af0d
752024-04-20T01:05:03.498ZINFOcrucible: [1]R generation[0..12]: [0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0] = downstairs session_id = 944066dc-e56b-4208-ae1c-db1ef612af0d
762024-04-20T01:05:03.498ZINFOcrucible: [1]R dirty[0..12]: [false, false, false, false, false, false, false, false, false, false, false, false] = downstairs session_id = 944066dc-e56b-4208-ae1c-db1ef612af0d
772024-04-20T01:05:03.499ZINFOcrucible: [2]R flush_numbers[0..12]: [0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0] = downstairs session_id = 944066dc-e56b-4208-ae1c-db1ef612af0d
782024-04-20T01:05:03.499ZINFOcrucible: [2]R generation[0..12]: [0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0] = downstairs session_id = 944066dc-e56b-4208-ae1c-db1ef612af0d
792024-04-20T01:05:03.499ZINFOcrucible: [2]R dirty[0..12]: [false, false, false, false, false, false, false, false, false, false, false, false] = downstairs session_id = 944066dc-e56b-4208-ae1c-db1ef612af0d
802024-04-20T01:05:03.499ZINFOcrucible: Max found gen is 1 = downstairs session_id = 944066dc-e56b-4208-ae1c-db1ef612af0d
812024-04-20T01:05:03.499ZINFOcrucible: Generation requested: 1 >= found:1 = downstairs session_id = 944066dc-e56b-4208-ae1c-db1ef612af0d
822024-04-20T01:05:03.499ZINFOcrucible: Next flush: 1 = downstairs session_id = 944066dc-e56b-4208-ae1c-db1ef612af0d
832024-04-20T01:05:03.499ZINFOcrucible: All extents match = downstairs session_id = 944066dc-e56b-4208-ae1c-db1ef612af0d
84 {"msg":"No downstairs reconciliation required","v":0,"name":"crucible","level":30,"time":"2024-04-20T01:05:03.499115562Z","hostname":"w-01HVWGBJP7HK0H9TQ26T6N3X8M","Activate successful
85 pid"Wait for a query_work_queue command to finish before sending IO
86 :1192,"session_id":"944066dc-e56b-4208-ae1c-db1ef612af0d"}
872024-04-20T01:05:03.499ZINFOcrucible: Transition from WaitQuorum to Active = downstairs client = 0 session_id = 944066dc-e56b-4208-ae1c-db1ef612af0d
882024-04-20T01:05:03.499ZINFOcrucible: Transition from WaitQuorum to Active = downstairs client = 1 session_id = 944066dc-e56b-4208-ae1c-db1ef612af0d
892024-04-20T01:05:03.499ZINFOcrucible: Transition from WaitQuorum to Active = downstairs client = 2 session_id = 944066dc-e56b-4208-ae1c-db1ef612af0d
902024-04-20T01:05:03.499ZINFOcrucible: All required reconciliation work is completed session_id = 944066dc-e56b-4208-ae1c-db1ef612af0d
912024-04-20T01:05:03.499ZINFOcrucible: Set Downstairs and Upstairs active after reconciliation session_id = 944066dc-e56b-4208-ae1c-db1ef612af0d
922024-04-20T01:05:03.499ZINFOcrucible: 71dc4886-6507-4c11-9b33-f6d3054a6afb is now active with session: 944066dc-e56b-4208-ae1c-db1ef612af0d session_id = 944066dc-e56b-4208-ae1c-db1ef612af0d
932024-04-20T01:05:03.499ZINFOcrucible: The guest has finished waiting for activation with:1
942024-04-20T01:05:03.499ZINFOcrucible: Set Active after no reconciliation session_id = 944066dc-e56b-4208-ae1c-db1ef612af0d
95 Region: es:100 ec:50 bs:4096 ts:20480000 tb:5000 max_io:256 or 1048576
96 Fill test
97 Read and Verify all blocks (0..5000 range:false)
98 Wrote out file "alan"
99 CLIENT: Tests done. All submitted work has been ACK'd
100 ----------------------------------------------------------------
101 Crucible gen:1 GIO:true work queues: Upstairs:0 downstairs:20
102 States: Active Active Active
103 GW_ID ACK DSID TYPE BLOCKS DS:0 DS:1 DS:2 REPLAY
104 22 Acked 1021 Read 256 Done Done Done false
105 23 Acked 1022 Read 256 Done Done Done false
106 24 Acked 1023 Read 256 Done Done Done false
107 25 Acked 1024 Read 256 Done Done Done false
108 26 Acked 1025 Read 256 Done Done Done false
109 27 Acked 1026 Read 256 Done Done Done false
110 28 Acked 1027 Read 256 Done Done Done false
111 29 Acked 1028 Read 256 Done Done Done false
112 30 Acked 1029 Read 256 Done Done Done false
113 31 Acked 1030 Read 256 Done Done Done false
114 32 Acked 1031 Read 256 Done Done Done false
115 33 Acked 1032 Read 256 Done Done Done false
116 34 Acked 1033 Read 256 Done Done Done false
117 35 Acked 1034 Read 256 Done Done Done false
118 36 Acked 1035 Read 136 Done Done Done false
119 37 Acked 1036 Read 256 Done Done Done false
120 38 Acked 1037 Read 256 Done Done Done false
121 39 Acked 1038 Read 256 Done Done Done false
122 40 Acked 1039 Read 256 Done Done Done false
123 41 Acked 1040 Read 256 Done Done Done false
124 STATES DS:0 DS:1 DS:2 TOTAL
125 New 0 0 0 0
126 Sent 0 0 0 0
127 Done 20 20 20 60
128 Skipped 0 0 0 0
129 Error 0 0 0 0
130 Last Flush: 1020 1020 1020
131 Downstairs last five completed: 1020 1019 1018 1017 1016
132 Upstairs last five completed: 41 40 39 38 37
133 CLIENT: Up:0 ds:20 act:3
134 ----------------------------------------------------------------
135 Crucible gen:1 GIO:true work queues: Upstairs:0 downstairs:0
136 Downstairs last five completed: 1041 1040 1039 1038 1037
137 Upstairs last five completed: 42 41 40 39 38
138 CLIENT: Up:0 ds:0 act:3
139 CLIENT: All crucible jobs finished, exiting program
1402024-04-20T01:05:07.932ZWARNcrucible: Guest handle has been dropped
141 Replay loop starts now April 20, 2024 at 01:05:07 AM UTC
1422024-04-20T01:05:07.959ZINFOcrucible: Upstairs starts
1432024-04-20T01:05:07.959ZINFOcrucible: Crucible Version: BuildInfo { version: "0.0.1", git_sha: "b97e434eec561fa80f965a2f40ec87c83a3a439e", git_commit_timestamp: "2024-04-20T00:34:22.000000000Z", git_branch: "artemis/remove-reqwest-block-io", rustc_semver: "1.76.0", rustc_channel: "stable", rustc_host_triple: "x86_64-unknown-illumos", rustc_commit_sha: "07dca489ac2d933c78d3c5158e3f43beefeb02ce", cargo_triple: "x86_64-unknown-illumos", debug: true, opt_level: 0, }
1442024-04-20T01:05:07.959ZINFOcrucible: Upstairs <-> Downstairs Message Version: 6
1452024-04-20T01:05:07.959ZINFOcrucible: Crucible 5563f411-a208-4a46-b296-c24dfab98a05 has session id: 132b460a-26a0-4532-b1ab-4f8c07d4c6c7 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
1462024-04-20T01:05:07.959ZINFOcrucible: Upstairs opts: Upstairs UUID: 5563f411-a208-4a46-b296-c24dfab98a05, Targets: [127.0.0.1:8810, 127.0.0.1:8820, 127.0.0.1:8830], lossy: false, flush_timeout: None, key populated: false, cert_pem populated: false, key_pem populated: false, root_cert_pem populated: false, Control: None, read_only: false session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
1472024-04-20T01:05:07.959ZINFOcrucible: Crucible stats registered with UUID: 5563f411-a208-4a46-b296-c24dfab98a05 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
148 Crucible runtime is spawned
1492024-04-20T01:05:07.959ZINFOcrucible: The guest has requested activation with gen:2
1502024-04-20T01:05:07.959ZINFOcrucible: 5563f411-a208-4a46-b296-c24dfab98a05 active request set session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
1512024-04-20T01:05:07.959ZINFOcrucible: sending connect oneshot to client = downstairs client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
1522024-04-20T01:05:07.959ZINFOcrucible: client set_active_request while in New; waiting... = downstairs client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
1532024-04-20T01:05:07.959ZINFOcrucible: sending connect oneshot to client = downstairs client = 1 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
1542024-04-20T01:05:07.959ZINFOcrucible: client set_active_request while in New; waiting... = downstairs client = 1 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
1552024-04-20T01:05:07.959ZINFOcrucible: sending connect oneshot to client = downstairs client = 2 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
1562024-04-20T01:05:07.959ZINFOcrucible: client set_active_request while in New; waiting... = downstairs client = 2 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
1572024-04-20T01:05:07.959ZINFOcrucible: connecting to 127.0.0.1:8810 = io task client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
1582024-04-20T01:05:07.959ZINFOcrucible: connecting to 127.0.0.1:8820 = io task client = 1 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
1592024-04-20T01:05:07.959ZINFOcrucible: connecting to 127.0.0.1:8830 = io task client = 2 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
1602024-04-20T01:05:07.959ZINFOcrucible: ds_connection connected from Ok(127.0.0.1:63088) = io task client = 1 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
1612024-04-20T01:05:07.959ZINFOcrucible: ds_connection connected from Ok(127.0.0.1:42481) = io task client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
1622024-04-20T01:05:07.959ZINFOcrucible: ds_connection connected from Ok(127.0.0.1:62074) = io task client = 2 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
1632024-04-20T01:05:07.960ZINFOcrucible: ds_transition from New to WaitActive = downstairs client = 2 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
1642024-04-20T01:05:07.960ZINFOcrucible: [2] Transition from New to WaitActive = downstairs client = 2 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
1652024-04-20T01:05:07.960ZINFOcrucible: ds_transition from New to WaitActive = downstairs client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
1662024-04-20T01:05:07.960ZINFOcrucible: [0] Transition from New to WaitActive = downstairs client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
1672024-04-20T01:05:07.960ZINFOcrucible: ds_transition from New to WaitActive = downstairs client = 1 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
1682024-04-20T01:05:07.960ZINFOcrucible: [1] Transition from New to WaitActive = downstairs client = 1 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
1692024-04-20T01:05:07.961ZINFOcrucible: downstairs client at Some(127.0.0.1:8830) has region UUID 12345678-0000-0000-0000-000000008830 = downstairs client = 2 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
1702024-04-20T01:05:07.961ZINFOcrucible: downstairs client at Some(127.0.0.1:8820) has region UUID 12345678-0000-0000-0000-000000008820 = downstairs client = 1 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
1712024-04-20T01:05:07.961ZINFOcrucible: downstairs client at Some(127.0.0.1:8810) has region UUID 12345678-0000-0000-0000-000000008810 = downstairs client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
1722024-04-20T01:05:07.961ZINFOcrucible: ds_transition from WaitActive to WaitQuorum = downstairs client = 2 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
1732024-04-20T01:05:07.961ZINFOcrucible: [2] Transition from WaitActive to WaitQuorum = downstairs client = 2 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
1742024-04-20T01:05:07.961ZINFOcrucible: Waiting for more clients to be ready session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
1752024-04-20T01:05:07.961ZINFOcrucible: ds_transition from WaitActive to WaitQuorum = downstairs client = 1 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
1762024-04-20T01:05:07.961ZINFOcrucible: [1] Transition from WaitActive to WaitQuorum = downstairs client = 1 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
1772024-04-20T01:05:07.961ZINFOcrucible: Waiting for more clients to be ready session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
1782024-04-20T01:05:07.961ZINFOcrucible: ds_transition from WaitActive to WaitQuorum = downstairs client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
1792024-04-20T01:05:07.961ZINFOcrucible: [0] Transition from WaitActive to WaitQuorum = downstairs client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
1802024-04-20T01:05:07.962ZINFOcrucible: [0]R flush_numbers[0..12]: [1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1] = downstairs session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
1812024-04-20T01:05:07.962ZINFOcrucible: [0]R generation[0..12]: [1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1] = downstairs session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
1822024-04-20T01:05:07.962ZINFOcrucible: [0]R dirty[0..12]: [false, false, false, false, false, false, false, false, false, false, false, false] = downstairs session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
1832024-04-20T01:05:07.962ZINFOcrucible: [1]R flush_numbers[0..12]: [1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1] = downstairs session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
1842024-04-20T01:05:07.962ZINFOcrucible: [1]R generation[0..12]: [1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1] = downstairs session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
1852024-04-20T01:05:07.962ZINFOcrucible: [1]R dirty[0..12]: [false, false, false, false, false, false, false, false, false, false, false, false] = downstairs session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
1862024-04-20T01:05:07.962ZINFOcrucible: [2]R flush_numbers[0..12]: [1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1] = downstairs session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
1872024-04-20T01:05:07.962ZINFOcrucible: [2]R generation[0..12]: [1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1] = downstairs session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
1882024-04-20T01:05:07.962ZINFOcrucible: [2]R dirty[0..12]: [false, false, false, false, false, false, false, false, false, false, false, false] = downstairs session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
1892024-04-20T01:05:07.962ZINFOcrucible: Max found gen is 2 = downstairs session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
190 Activate successful
191 {Wait for a query_work_queue command to finish before sending IO
192 "msg":"Generation requested: 2 >= found:2","v":0,"name":"crucible","level":30,"time":"2024-04-20T01:05:07.962155397Z","hostname":"w-01HVWGBJP7HK0H9TQ26T6N3X8M","pid":1196,"":"downstairs","":"downstairs","session_id":"132b460a-26a0-4532-b1ab-4f8c07d4c6c7"}
1932024-04-20T01:05:07.962ZINFOcrucible: Next flush: 2 = downstairs session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
1942024-04-20T01:05:07.962ZINFOcrucible: All extents match = downstairs session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
1952024-04-20T01:05:07.962ZINFOcrucible: No downstairs reconciliation required session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
1962024-04-20T01:05:07.962ZINFOcrucible: Transition from WaitQuorum to Active = downstairs client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
1972024-04-20T01:05:07.962ZINFOcrucible: Transition from WaitQuorum to Active = downstairs client = 1 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
1982024-04-20T01:05:07.962ZINFOcrucible: Transition from WaitQuorum to Active = downstairs client = 2 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
1992024-04-20T01:05:07.962ZINFOcrucible: All required reconciliation work is completed session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
2002024-04-20T01:05:07.962ZINFOcrucible: Set Downstairs and Upstairs active after reconciliation session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
2012024-04-20T01:05:07.962ZINFOcrucible: 5563f411-a208-4a46-b296-c24dfab98a05 is now active with session: 132b460a-26a0-4532-b1ab-4f8c07d4c6c7 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
2022024-04-20T01:05:07.962ZINFOcrucible: Set Active after no reconciliation session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
2032024-04-20T01:05:07.962ZINFOcrucible: The guest has finished waiting for activation with:2
204 Region: es:100 ec:50 bs:4096 ts:20480000 tb:5000 max_io:256 or 1048576
205 Loading write count information from file "alan"
206 Apr 20 01:05:08.010 INFO accepted connection, remote_addr: 127.0.0.1:60352, local_addr: 127.0.0.1:9998
207 Main task has work to do, go find it
208 got dsc Stop(1)
209 stop 1
210 Apr 20 01:05:08.012 INFO request completed, latency_us: 459, response_code: 204, uri: /stop/cid/1, method: POST, req_id: b86e8f5d-9553-4f33-be0a-32a384a024b5, remote_addr: 127.0.0.1:60352, local_addr: 127.0.0.1:9998
211 [8820] Got stop action so:false kr:false
2122024-04-20T01:05:08.013ZWARNcrucible: downstairs disconnected = io task client = 1 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
2132024-04-20T01:05:08.013ZWARNcrucible: client task is sending Done(Finished) = io task client = 1 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
2142024-04-20T01:05:08.013ZWARNcrucible: downstairs task for 1 stopped due to Finished session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
2152024-04-20T01:05:08.013ZINFOcrucible: Gone missing, transition from Active to Offline = downstairs client = 1 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
2162024-04-20T01:05:08.013ZINFOcrucible: [1] client re-new 0 jobs since flush 0 = downstairs session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
2172024-04-20T01:05:08.013ZINFOcrucible: [1] Marked 0 jobs for replay since flush: 0 = downstairs session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
2182024-04-20T01:05:08.013ZINFOcrucible: client task is exiting = io task client = 1 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
219 Apr 20 01:05:08.014 INFO request completed, latency_us: 702, response_code: 200, uri: /state/cid/1, method: GET, req_id: d3aa78d7-9f93-4c44-b088-895445a18a3f, remote_addr: 127.0.0.1:60352, local_addr: 127.0.0.1:9998
220 [8820] Exited with: ExitStatus(unix_wait_status(9))
221 [8820][1] reports Exit
222 Apr 20 01:05:12.017 INFO request completed, latency_us: 197, response_code: 200, uri: /state/cid/1, method: GET, req_id: 3b31a3ba-992b-4f70-a962-17a347107fbf, remote_addr: 127.0.0.1:60352, local_addr: 127.0.0.1:9998
223 001/300 Flush
224 002/300 Read block 1409 len 8192
225 003/300 Flush
226 004/300 Write block 4080 len 12288 data: 2 2 2
227 005/300 Write block 2753 len 16384 data: 2 2 2 2
228 006/300 Read block 1160 len 12288
229 007/300 Write block 3693 len 24576 data: 2 2 2 2 2 2
230 008/300 Write block 3037 len 4096 data: 2
231 009/300 Write block 3643 len 16384 data: 2 2 2 2
232 010/300 Read block 694 len 28672
233 011/300 Write block 2007 len 16384 data: 2 2 2 2
234 012/300 Write block 4168 len 20480 data: 2 2 2 2 2
235 013/300 Read block 3009 len 4096
236 014/300 Read block 613 len 20480
237 015/300 Read block 3324 len 8192
238 016/300 Read block 579 len 24576
239 017/300 Write block 3015 len 28672 data: 2 2 2 2 2 2 2
240 018/300 Read block 4886 len 8192
241 019/300 Read block 3699 len 12288
242 020/300 Flush
243 021/300 Read block 2720 len 28672
244 022/300 Read block 2260 len 40960
245 023/300 Read block 3186 len 32768
246 024/300 Write block 4675 len 40960 data: 2 2 2 2 2 2 2 2 2 2
247 025/300 Read block 2595 len 28672
248 026/300 Write block 229 len 8192 data: 2 2
249 027/300 Write block 2985 len 40960 data: 2 2 2 2 2 2 2 2 2 2
250 028/300 Write block 4594 len 32768 data: 2 2 2 2 2 2 2 2
251 029/300 Write block 4886 len 24576 data: 2 2 2 2 2 2
252 030/300 Read block 944 len 12288
253 031/300 Write block 4245 len 8192 data: 2 2
254 032/300 Write block 1130 len 28672 data: 2 2 2 2 2 2 2
255 033/300 Read block 774 len 36864
256 034/300 Read block 4466 len 40960
257 035/300 Read block 2898 len 16384
258 036/300 Write block 4378 len 16384 data: 2 2 2 2
259 037/300 Write block 1766 len 8192 data: 2 2
260 038/300 Read block 2715 len 20480
261 039/300 Read block 4900 len 36864
262 040/300 Write block 391 len 32768 data: 2 2 2 2 2 2 2 2
263 041/300 Read block 1857 len 8192
264 042/300 Write block 2918 len 20480 data: 2 2 2 2 2
265 043/300 Read block 2794 len 32768
266 044/300 Write block 4673 len 28672 data: 2 2 3 3 3 3 3
267 045/300 Read block 302 len 8192
268 046/300 Flush
269 047/300 Read block 4266 len 40960
270 048/300 Write block 4818 len 40960 data: 2 2 2 2 2 2 2 2 2 2
271 049/300 Write block 1654 len 4096 data: 2
272 050/300 Write block 3870 len 40960 data: 2 2 2 2 2 2 2 2 2 2
273 051/300 Read block 388 len 32768
274 052/300 Read block 1226 len 4096
275 053/300 Flush
276 054/300 Read block 4283 len 24576
277 055/300 Read block 3685 len 20480
278 056/300 Read block 3845 len 24576
279 057/300 Write block 4727 len 12288 data: 2 2 2
280 058/300 Write block 4483 len 8192 data: 2 2
281 059/300 Read block 889 len 28672
282 060/300 Write block 3570 len 32768 data: 2 2 2 2 2 2 2 2
283 061/300 Write block 3631 len 4096 data: 2
284 062/300 Write block 4224 len 28672 data: 2 2 2 2 2 2 2
285 063/300 Flush
286 064/300 Write block 3164 len 32768 data: 2 2 2 2 2 2 2 2
287 065/300 Read block 4593 len 8192
288 066/300 Read block 2463 len 16384
289 067/300 Read block 611 len 28672
290 068/300 Read block 3153 len 32768
291 069/300 Read block 1090 len 20480
292 070/300 Write block 4397 len 12288 data: 2 2 2
293 071/300 Write block 1903 len 16384 data: 2 2 2 2
294 072/300 Write block 2261 len 24576 data: 2 2 2 2 2 2
295 073/300 Read block 2077 len 4096
296 074/300 Write block 570 len 40960 data: 2 2 2 2 2 2 2 2 2 2
297 075/300 Write block 499 len 12288 data: 2 2 2
298 076/300 Flush
299 077/300 Read block 2437 len 12288
300 078/300 Write block 1264 len 28672 data: 2 2 2 2 2 2 2
301 079/300 Write block 978 len 24576 data: 2 2 2 2 2 2
302 080/300 Read block 4480 len 32768
303 081/300 Read block 3456 len 8192
304 082/300 Flush
305 083/300 Read block 2362 len 28672
306 084/300 Write block 4340 len 20480 data: 2 2 2 2 2
307 085/300 Read block 2523 len 20480
308 086/300 Read block 4737 len 8192
309 087/300 Read block 4254 len 40960
310 088/300 Read block 4327 len 12288
311 089/300 Write block 52 len 12288 data: 2 2 2
312 090/300 Read block 3571 len 28672
313 091/300 Write block 466 len 32768 data: 2 2 2 2 2 2 2 2
314 092/300 Write block 717 len 28672 data: 2 2 2 2 2 2 2
315 093/300 Read block 799 len 40960
316 094/300 Read block 4981 len 16384
317 095/300 Flush
318 096/300 Write block 745 len 32768 data: 2 2 2 2 2 2 2 2
319 097/300 Write block 2517 len 40960 data: 2 2 2 2 2 2 2 2 2 2
320 098/300 Write block 200 len 28672 data: 2 2 2 2 2 2 2
321 099/300 Read block 3156 len 12288
322 100/300 Write block 3411 len 16384 data: 2 2 2 2
323 101/300 Read block 4375 len 16384
324 102/300 Write block 4199 len 24576 data: 2 2 2 2 2 2
325 103/300 Read block 214 len 40960
326 104/300 Write block 990 len 20480 data: 2 2 2 2 2
327 105/300 Read block 2817 len 20480
328 106/300 Write block 3431 len 24576 data: 2 2 2 2 2 2
329 107/300 Flush
330 108/300 Read block 1758 len 12288
331 109/300 Read block 2803 len 12288
332 110/300 Read block 3129 len 36864
333 111/300 Write block 836 len 36864 data: 2 2 2 2 2 2 2 2 2
334 112/300 Read block 1010 len 28672
335 113/300 Read block 3162 len 8192
336 114/300 Read block 3681 len 32768
337 115/300 Write block 2559 len 28672 data: 2 2 2 2 2 2 2
338 116/300 Read block 2637 len 20480
339 117/300 Read block 1549 len 20480
340 118/300 Flush
341 119/300 Write block 277 len 12288 data: 2 2 2
342 120/300 Read block 166 len 20480
343 121/300 Read block 402 len 40960
344 122/300 Read block 684 len 40960
345 123/300 Write block 4170 len 20480 data: 3 3 3 2 2
346 124/300 Read block 4195 len 4096
347 125/300 Write block 4632 len 24576 data: 2 2 2 2 2 2
348 126/300 Read block 4309 len 28672
349 127/300 Read block 456 len 28672
350 128/300 Read block 1515 len 20480
351 129/300 Read block 1540 len 8192
352 130/300 Read block 2984 len 32768
353 131/300 Write block 4544 len 12288 data: 2 2 2
354 132/300 Read block 2334 len 28672
355 133/300 Write block 1027 len 32768 data: 2 2 2 2 2 2 2 2
356 134/300 Read block 3206 len 20480
357 135/300 Flush
358 136/300 Read block 3555 len 4096
359 137/300 Write block 3072 len 40960 data: 2 2 2 2 2 2 2 2 2 2
360 138/300 Write block 3933 len 4096 data: 2
361 139/300 Read block 1484 len 28672
362 140/300 Flush
363 141/300 Write block 1305 len 16384 data: 2 2 2 2
364 142/300 Read block 3151 len 20480
365 143/300 Read block 4178 len 32768
366 144/300 Write block 2799 len 4096 data: 2
367 145/300 Read block 1149 len 8192
368 146/300 Read block 1438 len 8192
369 147/300 Write block 1224 len 28672 data: 2 2 2 2 2 2 2
370 148/300 Write block 4940 len 4096 data: 2
371 149/300 Write block 4738 len 12288 data: 2 2 2
372 150/300 Flush
373 151/300 Read block 4525 len 40960
374 152/300 Read block 2516 len 20480
375 153/300 Write block 947 len 20480 data: 2 2 2 2 2
376 154/300 Read block 2200 len 4096
377 155/300 Write block 1056 len 40960 data: 2 2 2 2 2 2 2 2 2 2
378 156/300 Read block 408 len 32768
379 157/300 Write block 1546 len 8192 data: 2 2
380 158/300 Flush
381 159/300 Read block 2016 len 8192
382 160/300 Write block 1465 len 8192 data: 2 2
383 161/300 Read block 3906 len 28672
384 162/300 Read block 714 len 28672
385 163/300 Write block 503 len 32768 data: 2 2 2 2 2 2 2 2
386 164/300 Write block 2446 len 16384 data: 2 2 2 2
387 165/300 Write block 4407 len 28672 data: 2 2 2 2 2 2 2
388 166/300 Read block 953 len 32768
389 167/300 Read block 4264 len 24576
390 168/300 Read block 4912 len 20480
391 169/300 Read block 4662 len 24576
392 170/300 Flush
393 171/300 Read block 4814 len 12288
394 172/300 Read block 312 len 32768
395 173/300 Read block 4280 len 16384
396 174/300 Write block 2559 len 32768 data: 3 3 3 3 3 3 3 2
397 175/300 Read block 3704 len 40960
398 176/300 Read block 2803 len 28672
399 177/300 Read block 4476 len 20480
400 178/300 Write block 3134 len 20480 data: 2 2 2 2 2
401 179/300 Read block 1452 len 24576
402 180/300 Read block 1765 len 40960
403 181/300 Read block 3741 len 40960
404 182/300 Write block 580 len 12288 data: 2 2 2
405 183/300 Write block 61 len 24576 data: 2 2 2 2 2 2
406 184/300 Write block 4137 len 32768 data: 2 2 2 2 2 2 2 2
407 185/300 Write block 2980 len 28672 data: 2 2 2 2 2 3 3
408 186/300 Write block 393 len 40960 data: 3 3 3 3 3 3 2 2 2 2
409 187/300 Read block 1545 len 16384
410 188/300 Read block 4976 len 32768
411 189/300 Read block 4825 len 16384
412 190/300 Read block 1657 len 12288
413 191/300 Write block 4223 len 32768 data: 2 3 3 3 3 3 3 3
414 192/300 Read block 3878 len 36864
415 193/300 Read block 2673 len 36864
416 194/300 Read block 319 len 4096
417 195/300 Write block 4942 len 28672 data: 2 2 2 2 2 2 2
418 196/300 Read block 1294 len 20480
419 197/300 Flush
420 198/300 Read block 2250 len 20480
421 199/300 Write block 1737 len 12288 data: 2 2 2
422 200/300 Write block 3960 len 16384 data: 2 2 2 2
423 201/300 Write block 3997 len 40960 data: 2 2 2 2 2 2 2 2 2 2
424 202/300 Write block 1770 len 36864 data: 2 2 2 2 2 2 2 2 2
425 203/300 Write block 3084 len 28672 data: 2 2 2 2 2 2 2
426 204/300 Write block 4626 len 12288 data: 2 2 2
427 205/300 Read block 1491 len 8192
428 206/300 Write block 722 len 36864 data: 3 3 2 2 2 2 2 2 2
429 207/300 Write block 4177 len 28672 data: 2 2 2 2 2 2 2
430 208/300 Write block 3477 len 32768 data: 2 2 2 2 2 2 2 2
431 209/300 Write block 4443 len 32768 data: 2 2 2 2 2 2 2 2
432 210/300 Read block 4586 len 4096
433 211/300 Read block 3504 len 12288
434 212/300 Read block 1487 len 8192
435 213/300 Read block 2834 len 20480
436 214/300 Read block 3906 len 28672
437 215/300 Write block 4711 len 4096 data: 2
438 216/300 Write block 3816 len 12288 data: 2 2 2
439 217/300 Read block 2179 len 28672
440 218/300 Flush
441 219/300 Read block 2021 len 24576
442 220/300 Write block 1242 len 12288 data: 2 2 2
443 221/300 Read block 2764 len 4096
444 222/300 Write block 2386 len 32768 data: 2 2 2 2 2 2 2 2
445 223/300 Write block 743 len 28672 data: 2 2 3 3 3 3 3
446 224/300 Read block 4346 len 4096
447 225/300 Read block 2741 len 8192
448 226/300 Write block 3280 len 32768 data: 2 2 2 2 2 2 2 2
449 227/300 Write block 3206 len 32768 data: 2 2 2 2 2 2 2 2
450 228/300 Read block 2333 len 32768
451 229/300 Flush
452 230/300 Write block 4846 len 4096 data: 2
453 231/300 Flush
454 232/300 Read block 4380 len 4096
455 233/300 Flush
456 234/300 Read block 4788 len 16384
457 235/300 Write block 2045 len 8192 data: 2 2
458 236/300 Write block 4738 len 32768 data: 3 3 3 2 2 2 2 2
459 237/300 Write block 3305 len 4096 data: 2
460 238/300 Write block 1152 len 28672 data: 2 2 2 2 2 2 2
461 239/300 Write block 4656 len 32768 data: 2 2 2 2 2 2 2 2
462 240/300 Write block 82 len 24576 data: 2 2 2 2 2 2
463 241/300 Read block 1377 len 28672
464 242/300 Flush
465 243/300 Read block 3210 len 16384
466 244/300 Write block 2348 len 8192 data: 2 2
467 245/300 Write block 1902 len 16384 data: 2 3 3 3
468 246/300 Write block 384 len 40960 data: 2 2 2 2 2 2 2 3 3 4
469 247/300 Write block 3725 len 36864 data: 2 2 2 2 2 2 2 2 2
470 248/300 Write block 3177 len 40960 data: 2 2 2 2 2 2 2 2 2 2
471 249/300 Read block 3796 len 4096
472 250/300 Read block 2076 len 20480
473 251/300 Read block 4838 len 16384
474 252/300 Write block 3484 len 28672 data: 3 2 2 2 2 2 2
475 253/300 Write block 250 len 20480 data: 2 2 2 2 2
476 254/300 Write block 466 len 8192 data: 3 3
477 255/300 Read block 2660 len 8192
478 256/300 Write block 315 len 24576 data: 2 2 2 2 2 2
479 257/300 Write block 2469 len 24576 data: 2 2 2 2 2 2
480 258/300 Write block 254 len 16384 data: 3 2 2 2
481 259/300 Read block 2810 len 24576
482 260/300 Read block 467 len 28672
483 261/300 Read block 425 len 36864
484 262/300 Write block 1661 len 32768 data: 2 2 2 2 2 2 2 2
485 263/300 Write block 4529 len 16384 data: 2 2 2 2
486 264/300 Write block 3452 len 4096 data: 2
487 265/300 Write block 3603 len 32768 data: 2 2 2 2 2 2 2 2
488 266/300 Read block 1350 len 24576
489 267/300 Read block 4769 len 32768
490 268/300 Write block 446 len 8192 data: 2 2
491 269/300 Read block 2351 len 12288
492 270/300 Flush
493 271/300 Write block 2468 len 28672 data: 2 3 3 3 3 3 3
494 272/300 Read block 898 len 40960
495 273/300 Write block 1998 len 16384 data: 2 2 2 2
496 274/300 Read block 3673 len 40960
497 275/300 Read block 3109 len 24576
498 276/300 Read block 3290 len 36864
499 277/300 Read block 1393 len 20480
500 278/300 Write block 3024 len 8192 data: 2 2
501 279/300 Read block 3224 len 20480
502 280/300 Write block 1433 len 20480 data: 2 2 2 2 2
503 281/300 Write block 589 len 12288 data: 2 2 2
504 282/300 Read block 3212 len 32768
505 283/300 Write block 3815 len 16384 data: 2 3 3 3
506 284/300 Read block 1609 len 40960
507 285/300 Read block 4936 len 8192
508 286/300 Write block 2944 len 12288 data: 2 2 2
509 287/300 Write block 222 len 8192 data: 2 2
510 288/300 Read block 2079 len 12288
511 289/300 Flush
512 290/300 Write block 1414 len 28672 data: 2 2 2 2 2 2 2
513 291/300 Read block 2322 len 36864
514 292/300 Write block 3098 len 40960 data: 2 2 2 2 2 2 2 2 2 2
515 293/300 Read block 516 len 28672
516 294/300 Read block 757 len 12288
517 295/300 Write block 3129 len 36864 data: 2 2 2 2 2 3 3 3 3
518 296/300 Read block 4530 len 32768
519 297/300 Write block 4889 len 24576 data: 3 3 3 2 2 2
520 298/300 Read block 4581 len 24576
521 299/300 Write block 4225 len 4096 data: 4
522 300/300 Write block 1997 len 36864 data: 2 3 3 3 3 2 2 2 2
523 Main task has work to do, go find it
524 got dsc Start(1)
525 start 1
526 Apr 20 01:05:12.345 INFO request completed, latency_us: 316, response_code: 204, uri: /start/cid/1, method: POST, req_id: 6fb6b234-37c5-472a-85c9-c141bfff8047, remote_addr: 127.0.0.1:60352, local_addr: 127.0.0.1:9998
527 Replay: started 1, returned:Ok(())
528 ----------------------------------------------------------------
529 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:300
530 States: Active Offline Active
531 GW_ID ACK DSID TYPE BLOCKS DS:0 DS:1 DS:2 REPLAY
532 1 Acked 1000 Flush 0 Done New Done false
533 2 Acked 1001 Read 2 Done New Done false
534 3 Acked 1002 Flush 0 Done New Done false
535 4 Acked 1003 Write 3 Done New Done false
536 5 Acked 1004 Write 4 Done New Done false
537 6 Acked 1005 Read 3 Done New Done false
538 7 Acked 1006 Write 6 Done New Done false
539 8 Acked 1007 Write 1 Done New Done false
540 9 Acked 1008 Write 4 Done New Done false
541 10 Acked 1009 Read 7 Done New Done false
542 11 Acked 1010 Write 4 Done New Done false
543 12 Acked 1011 Write 5 Done New Done false
544 13 Acked 1012 Read 1 Done New Done false
545 14 Acked 1013 Read 5 Done New Done false
546 15 Acked 1014 Read 2 Done New Done false
547 16 Acked 1015 Read 6 Done New Done false
548 17 Acked 1016 Write 7 Done New Done false
549 18 Acked 1017 Read 2 Done New Done false
550 19 Acked 1018 Read 3 Done New Done false
551 20 Acked 1019 Flush 0 Done New Done false
552 21 Acked 1020 Read 7 Done New Done false
553 22 Acked 1021 Read 10 Done New Done false
554 23 Acked 1022 Read 8 Done New Done false
555 24 Acked 1023 Write 10 Done New Done false
556 25 Acked 1024 Read 7 Done New Done false
557 26 Acked 1025 Write 2 Done New Done false
558 27 Acked 1026 Write 10 Done New Done false
559 28 Acked 1027 Write 8 Done New Done false
560 29 Acked 1028 Write 6 Done New Done false
561 30 Acked 1029 Read 3 Done New Done false
562 31 Acked 1030 Write 2 Done New Done false
563 32 Acked 1031 Write 7 Done New Done false
564 33 Acked 1032 Read 9 Done New Done false
565 34 Acked 1033 Read 10 Done New Done false
566 35 Acked 1034 Read 4 Done New Done false
567 36 Acked 1035 Write 4 Done New Done false
568 37 Acked 1036 Write 2 Done New Done false
569 38 Acked 1037 Read 5 Done New Done false
570 39 Acked 1038 Read 9 Done New Done false
571 40 Acked 1039 Write 8 Done New Done false
572 41 Acked 1040 Read 2 Done New Done false
573 42 Acked 1041 Write 5 Done New Done false
574 43 Acked 1042 Read 8 Done New Done false
575 44 Acked 1043 Write 7 Done New Done false
576 45 Acked 1044 Read 2 Done New Done false
577 46 Acked 1045 Flush 0 Done New Done false
578 47 Acked 1046 Read 10 Done New Done false
579 48 Acked 1047 Write 10 Done New Done false
580 49 Acked 1048 Write 1 Done New Done false
581 50 Acked 1049 Write 10 Done New Done false
582 51 Acked 1050 Read 8 Done New Done false
583 52 Acked 1051 Read 1 Done New Done false
584 53 Acked 1052 Flush 0 Done New Done false
585 54 Acked 1053 Read 6 Done New Done false
586 55 Acked 1054 Read 5 Done New Done false
587 56 Acked 1055 Read 6 Done New Done false
588 57 Acked 1056 Write 3 Done New Done false
589 58 Acked 1057 Write 2 Done New Done false
590 59 Acked 1058 Read 7 Done New Done false
591 60 Acked 1059 Write 8 Done New Done false
592 61 Acked 1060 Write 1 Done New Done false
593 62 Acked 1061 Write 7 Done New Done false
594 63 Acked 1062 Flush 0 Done New Done false
595 64 Acked 1063 Write 8 Done New Done false
596 65 Acked 1064 Read 2 Done New Done false
597 66 Acked 1065 Read 4 Done New Done false
598 67 Acked 1066 Read 7 Done New Done false
599 68 Acked 1067 Read 8 Done New Done false
600 69 Acked 1068 Read 5 Done New Done false
601 70 Acked 1069 Write 3 Done New Done false
602 71 Acked 1070 Write 4 Done New Done false
603 72 Acked 1071 Write 6 Done New Done false
604 73 Acked 1072 Read 1 Done New Done false
605 74 Acked 1073 Write 10 Done New Done false
606 75 Acked 1074 Write 3 Done New Done false
607 76 Acked 1075 Flush 0 Done New Done false
608 77 Acked 1076 Read 3 Done New Done false
609 78 Acked 1077 Write 7 Done New Done false
610 79 Acked 1078 Write 6 Done New Done false
611 80 Acked 1079 Read 8 Done New Done false
612 81 Acked 1080 Read 2 Done New Done false
613 82 Acked 1081 Flush 0 Done New Done false
614 83 Acked 1082 Read 7 Done New Done false
615 84 Acked 1083 Write 5 Done New Done false
616 85 Acked 1084 Read 5 Done New Done false
617 86 Acked 1085 Read 2 Done New Done false
618 87 Acked 1086 Read 10 Done New Done false
619 88 Acked 1087 Read 3 Done New Done false
620 89 Acked 1088 Write 3 Done New Done false
621 90 Acked 1089 Read 7 Done New Done false
622 91 Acked 1090 Write 8 Done New Done false
623 92 Acked 1091 Write 7 Done New Done false
624 93 Acked 1092 Read 10 Done New Done false
625 94 Acked 1093 Read 4 Done New Done false
626 95 Acked 1094 Flush 0 Done New Done false
627 96 Acked 1095 Write 8 Done New Done false
628 97 Acked 1096 Write 10 Done New Done false
629 98 Acked 1097 Write 7 Done New Done false
630 99 Acked 1098 Read 3 Done New Done false
631 100 Acked 1099 Write 4 Done New Done false
632 101 Acked 1100 Read 4 Done New Done false
633 102 Acked 1101 Write 6 Done New Done false
634 103 Acked 1102 Read 10 Done New Done false
635 104 Acked 1103 Write 5 Done New Done false
636 105 Acked 1104 Read 5 Done New Done false
637 106 Acked 1105 Write 6 Done New Done false
638 107 Acked 1106 Flush 0 Done New Done false
639 108 Acked 1107 Read 3 Done New Done false
640 109 Acked 1108 Read 3 Done New Done false
641 110 Acked 1109 Read 9 Done New Done false
642 111 Acked 1110 Write 9 Done New Done false
643 112 Acked 1111 Read 7 Done New Done false
644 113 Acked 1112 Read 2 Done New Done false
645 114 Acked 1113 Read 8 Done New Done false
646 115 Acked 1114 Write 7 Done New Done false
647 116 Acked 1115 Read 5 Done New Done false
648 117 Acked 1116 Read 5 Done New Done false
649 118 Acked 1117 Flush 0 Done New Done false
650 119 Acked 1118 Write 3 Done New Done false
651 120 Acked 1119 Read 5 Done New Done false
652 121 Acked 1120 Read 10 Done New Done false
653 122 Acked 1121 Read 10 Done New Done false
654 123 Acked 1122 Write 5 Done New Done false
655 124 Acked 1123 Read 1 Done New Done false
656 125 Acked 1124 Write 6 Done New Done false
657 126 Acked 1125 Read 7 Done New Done false
658 127 Acked 1126 Read 7 Done New Done false
659 128 Acked 1127 Read 5 Done New Done false
660 129 Acked 1128 Read 2 Done New Done false
661 130 Acked 1129 Read 8 Done New Done false
662 131 Acked 1130 Write 3 Done New Done false
663 132 Acked 1131 Read 7 Done New Done false
664 133 Acked 1132 Write 8 Done New Done false
665 134 Acked 1133 Read 5 Done New Done false
666 135 Acked 1134 Flush 0 Done New Done false
667 136 Acked 1135 Read 1 Done New Done false
668 137 Acked 1136 Write 10 Done New Done false
669 138 Acked 1137 Write 1 Done New Done false
670 139 Acked 1138 Read 7 Done New Done false
671 140 Acked 1139 Flush 0 Done New Done false
672 141 Acked 1140 Write 4 Done New Done false
673 142 Acked 1141 Read 5 Done New Done false
674 143 Acked 1142 Read 8 Done New Done false
675 144 Acked 1143 Write 1 Done New Done false
676 145 Acked 1144 Read 2 Done New Done false
677 146 Acked 1145 Read 2 Done New Done false
678 147 Acked 1146 Write 7 Done New Done false
679 148 Acked 1147 Write 1 Done New Done false
680 149 Acked 1148 Write 3 Done New Done false
681 150 Acked 1149 Flush 0 Done New Done false
682 151 Acked 1150 Read 10 Done New Done false
683 152 Acked 1151 Read 5 Done New Done false
684 153 Acked 1152 Write 5 Done New Done false
685 154 Acked 1153 Read 1 Done New Done false
686 155 Acked 1154 Write 10 Done New Done false
687 156 Acked 1155 Read 8 Done New Done false
688 157 Acked 1156 Write 2 Done New Done false
689 158 Acked 1157 Flush 0 Done New Done false
690 159 Acked 1158 Read 2 Done New Done false
691 160 Acked 1159 Write 2 Done New Done false
692 161 Acked 1160 Read 7 Done New Done false
693 162 Acked 1161 Read 7 Done New Done false
694 163 Acked 1162 Write 8 Done New Done false
695 164 Acked 1163 Write 4 Done New Done false
696 165 Acked 1164 Write 7 Done New Done false
697 166 Acked 1165 Read 8 Done New Done false
698 167 Acked 1166 Read 6 Done New Done false
699 168 Acked 1167 Read 5 Done New Done false
700 169 Acked 1168 Read 6 Done New Done false
701 170 Acked 1169 Flush 0 Done New Done false
702 171 Acked 1170 Read 3 Done New Done false
703 172 Acked 1171 Read 8 Done New Done false
704 173 Acked 1172 Read 4 Done New Done false
705 174 Acked 1173 Write 8 Done New Done false
706 175 Acked 1174 Read 10 Done New Done false
707 176 Acked 1175 Read 7 Done New Done false
708 177 Acked 1176 Read 5 Done New Done false
709 178 Acked 1177 Write 5 Done New Done false
710 179 Acked 1178 Read 6 Done New Done false
711 180 Acked 1179 Read 10 Done New Done false
712 181 Acked 1180 Read 10 Done New Done false
713 182 Acked 1181 Write 3 Done New Done false
714 183 Acked 1182 Write 6 Done New Done false
715 184 Acked 1183 Write 8 Done New Done false
716 185 Acked 1184 Write 7 Done New Done false
717 186 Acked 1185 Write 10 Done New Done false
718 187 Acked 1186 Read 4 Done New Done false
719 188 Acked 1187 Read 8 Done New Done false
720 189 Acked 1188 Read 4 Done New Done false
721 190 Acked 1189 Read 3 Done New Done false
722 191 Acked 1190 Write 8 Done New Done false
723 192 Acked 1191 Read 9 Done New Done false
724 193 Acked 1192 Read 9 Done New Done false
725 194 Acked 1193 Read 1 Done New Done false
726 195 Acked 1194 Write 7 Done New Done false
727 196 Acked 1195 Read 5 Done New Done false
728 197 Acked 1196 Flush 0 Done New Done false
729 198 Acked 1197 Read 5 Done New Done false
730 199 Acked 1198 Write 3 Done New Done false
731 200 Acked 1199 Write 4 Done New Done false
732 201 Acked 1200 Write 10 Done New Done false
733 202 Acked 1201 Write 9 Done New Done false
734 203 Acked 1202 Write 7 Done New Done false
735 204 Acked 1203 Write 3 Done New Done false
736 205 Acked 1204 Read 2 Done New Done false
737 206 Acked 1205 Write 9 Done New Done false
738 207 Acked 1206 Write 7 Done New Done false
739 208 Acked 1207 Write 8 Done New Done false
740 209 Acked 1208 Write 8 Done New Done false
741 210 Acked 1209 Read 1 Done New Done false
742 211 Acked 1210 Read 3 Done New Done false
743 212 Acked 1211 Read 2 Done New Done false
744 213 Acked 1212 Read 5 Done New Done false
745 214 Acked 1213 Read 7 Done New Done false
746 215 Acked 1214 Write 1 Done New Done false
747 216 Acked 1215 Write 3 Done New Done false
748 217 Acked 1216 Read 7 Done New Done false
749 218 Acked 1217 Flush 0 Done New Done false
750 219 Acked 1218 Read 6 Done New Done false
751 220 Acked 1219 Write 3 Done New Done false
752 221 Acked 1220 Read 1 Done New Done false
753 222 Acked 1221 Write 8 Done New Done false
754 223 Acked 1222 Write 7 Done New Done false
755 224 Acked 1223 Read 1 Done New Done false
756 225 Acked 1224 Read 2 Done New Done false
757 226 Acked 1225 Write 8 Done New Done false
758 227 Acked 1226 Write 8 Done New Done false
759 228 Acked 1227 Read 8 Done New Done false
760 229 Acked 1228 Flush 0 Done New Done false
761 230 Acked 1229 Write 1 Done New Done false
762 231 Acked 1230 Flush 0 Done New Done false
763 232 Acked 1231 Read 1 Done New Done false
764 233 Acked 1232 Flush 0 Done New Done false
765 234 Acked 1233 Read 4 Done New Done false
766 235 Acked 1234 Write 2 Done New Done false
767 236 Acked 1235 Write 8 Done New Done false
768 237 Acked 1236 Write 1 Done New Done false
769 238 Acked 1237 Write 7 Done New Done false
770 239 Acked 1238 Write 8 Done New Done false
771 240 Acked 1239 Write 6 Done New Done false
772 241 Acked 1240 Read 7 Done New Done false
773 242 Acked 1241 Flush 0 Done New Done false
774 243 Acked 1242 Read 4 Done New Done false
775 244 Acked 1243 Write 2 Done New Done false
776 245 Acked 1244 Write 4 Done New Done false
777 246 Acked 1245 Write 10 Done New Done false
778 247 Acked 1246 Write 9 Done New Done false
779 248 Acked 1247 Write 10 Done New Done false
780 249 Acked 1248 Read 1 Done New Done false
781 250 Acked 1249 Read 5 Done New Done false
782 251 Acked 1250 Read 4 Done New Done false
783 252 Acked 1251 Write 7 Done New Done false
784 253 Acked 1252 Write 5 Done New Done false
785 254 Acked 1253 Write 2 Done New Done false
786 255 Acked 1254 Read 2 Done New Done false
787 256 Acked 1255 Write 6 Done New Done false
788 257 Acked 1256 Write 6 Done New Done false
789 258 Acked 1257 Write 4 Done New Done false
790 259 Acked 1258 Read 6 Done New Done false
791 260 Acked 1259 Read 7 Done New Done false
792 261 Acked 1260 Read 9 Done New Done false
793 262 Acked 1261 Write 8 Done New Done false
794 263 Acked 1262 Write 4 Done New Done false
795 264 Acked 1263 Write 1 Done New Done false
796 265 Acked 1264 Write 8 Done New Done false
797 266 Acked 1265 Read 6 Done New Done false
798 267 Acked 1266 Read 8 Done New Done false
799 268 Acked 1267 Write 2 Done New Done false
800 269 Acked 1268 Read 3 Done New Done false
801 270 Acked 1269 Flush 0 Done New Done false
802 271 Acked 1270 Write 7 Done New Done false
803 272 Acked 1271 Read 10 Done New Done false
804 273 Acked 1272 Write 4 Done New Done false
805 274 Acked 1273 Read 10 Done New Done false
806 275 Acked 1274 Read 6 Done New Done false
807 276 Acked 1275 Read 9 Done New Done false
808 277 Acked 1276 Read 5 Done New Done false
809 278 Acked 1277 Write 2 Done New Done false
810 279 Acked 1278 Read 5 Done New Done false
811 280 Acked 1279 Write 5 Done New Done false
812 281 Acked 1280 Write 3 Done New Done false
813 282 Acked 1281 Read 8 Done New Done false
814 283 Acked 1282 Write 4 Done New Done false
815 284 Acked 1283 Read 10 Done New Done false
816 285 Acked 1284 Read 2 Done New Done false
817 286 Acked 1285 Write 3 Done New Done false
818 287 Acked 1286 Write 2 Done New Done false
819 288 Acked 1287 Read 3 Done New Done false
820 289 Acked 1288 Flush 0 Done New Done false
821 290 Acked 1289 Write 7 Done New Done false
822 291 Acked 1290 Read 9 Done New Done false
823 292 Acked 1291 Write 10 Done New Done false
824 293 Acked 1292 Read 7 Done New Done false
825 294 Acked 1293 Read 3 Done New Done false
826 295 Acked 1294 Write 9 Done New Done false
827 296 Acked 1295 Read 8 Done New Done false
828 297 Acked 1296 Write 6 Done New Done false
829 298 Acked 1297 Read 6 Done New Done false
830 299 Acked 1298 Write 1 Done New Done false
831 300 Acked 1299 Write 9 Done New Done false
832 STATES DS:0 DS:1 DS:2 TOTAL
833 New 0 300 0 300
834 Sent 0 0 0 0
835 Done 300 0 300 600
836 Skipped 0 0 0 0
837 Error 0 0 0 0
838 Last Flush: 1288 0 1288
839 Downstairs last five completed:
840 Upstairs last five completed: 300 299 298 297 296
841 CLIENT: Up:0 ds:300 act:2
842 ----------------------------------------------------------------
843 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:301
844 States: Active Offline Active
845 GW_ID ACK DSID TYPE BLOCKS DS:0 DS:1 DS:2 REPLAY
846 1 Acked 1000 Flush 0 Done New Done false
847 2 Acked 1001 Read 2 Done New Done false
848 3 Acked 1002 Flush 0 Done New Done false
849 4 Acked 1003 Write 3 Done New Done false
850 5 Acked 1004 Write 4 Done New Done false
851 6 Acked 1005 Read 3 Done New Done false
852 7 Acked 1006 Write 6 Done New Done false
853 8 Acked 1007 Write 1 Done New Done false
854 9 Acked 1008 Write 4 Done New Done false
855 10 Acked 1009 Read 7 Done New Done false
856 11 Acked 1010 Write 4 Done New Done false
857 12 Acked 1011 Write 5 Done New Done false
858 13 Acked 1012 Read 1 Done New Done false
859 14 Acked 1013 Read 5 Done New Done false
860 15 Acked 1014 Read 2 Done New Done false
861 16 Acked 1015 Read 6 Done New Done false
862 17 Acked 1016 Write 7 Done New Done false
863 18 Acked 1017 Read 2 Done New Done false
864 19 Acked 1018 Read 3 Done New Done false
865 20 Acked 1019 Flush 0 Done New Done false
866 21 Acked 1020 Read 7 Done New Done false
867 22 Acked 1021 Read 10 Done New Done false
868 23 Acked 1022 Read 8 Done New Done false
869 24 Acked 1023 Write 10 Done New Done false
870 25 Acked 1024 Read 7 Done New Done false
871 26 Acked 1025 Write 2 Done New Done false
872 27 Acked 1026 Write 10 Done New Done false
873 28 Acked 1027 Write 8 Done New Done false
874 29 Acked 1028 Write 6 Done New Done false
875 30 Acked 1029 Read 3 Done New Done false
876 31 Acked 1030 Write 2 Done New Done false
877 32 Acked 1031 Write 7 Done New Done false
878 33 Acked 1032 Read 9 Done New Done false
879 34 Acked 1033 Read 10 Done New Done false
880 35 Acked 1034 Read 4 Done New Done false
881 36 Acked 1035 Write 4 Done New Done false
882 37 Acked 1036 Write 2 Done New Done false
883 38 Acked 1037 Read 5 Done New Done false
884 39 Acked 1038 Read 9 Done New Done false
885 40 Acked 1039 Write 8 Done New Done false
886 41 Acked 1040 Read 2 Done New Done false
887 42 Acked 1041 Write 5 Done New Done false
888 43 Acked 1042 Read 8 Done New Done false
889 44 Acked 1043 Write 7 Done New Done false
890 45 Acked 1044 Read 2 Done New Done false
891 46 Acked 1045 Flush 0 Done New Done false
892 47 Acked 1046 Read 10 Done New Done false
893 48 Acked 1047 Write 10 Done New Done false
894 49 Acked 1048 Write 1 Done New Done false
895 50 Acked 1049 Write 10 Done New Done false
896 51 Acked 1050 Read 8 Done New Done false
897 52 Acked 1051 Read 1 Done New Done false
898 53 Acked 1052 Flush 0 Done New Done false
899 54 Acked 1053 Read 6 Done New Done false
900 55 Acked 1054 Read 5 Done New Done false
901 56 Acked 1055 Read 6 Done New Done false
902 57 Acked 1056 Write 3 Done New Done false
903 58 Acked 1057 Write 2 Done New Done false
904 59 Acked 1058 Read 7 Done New Done false
905 60 Acked 1059 Write 8 Done New Done false
906 61 Acked 1060 Write 1 Done New Done false
907 62 Acked 1061 Write 7 Done New Done false
908 63 Acked 1062 Flush 0 Done New Done false
909 64 Acked 1063 Write 8 Done New Done false
910 65 Acked 1064 Read 2 Done New Done false
911 66 Acked 1065 Read 4 Done New Done false
912 67 Acked 1066 Read 7 Done New Done false
913 68 Acked 1067 Read 8 Done New Done false
914 69 Acked 1068 Read 5 Done New Done false
915 70 Acked 1069 Write 3 Done New Done false
916 71 Acked 1070 Write 4 Done New Done false
917 72 Acked 1071 Write 6 Done New Done false
918 73 Acked 1072 Read 1 Done New Done false
919 74 Acked 1073 Write 10 Done New Done false
920 75 Acked 1074 Write 3 Done New Done false
921 76 Acked 1075 Flush 0 Done New Done false
922 77 Acked 1076 Read 3 Done New Done false
923 78 Acked 1077 Write 7 Done New Done false
924 79 Acked 1078 Write 6 Done New Done false
925 80 Acked 1079 Read 8 Done New Done false
926 81 Acked 1080 Read 2 Done New Done false
927 82 Acked 1081 Flush 0 Done New Done false
928 83 Acked 1082 Read 7 Done New Done false
929 84 Acked 1083 Write 5 Done New Done false
930 85 Acked 1084 Read 5 Done New Done false
931 86 Acked 1085 Read 2 Done New Done false
932 87 Acked 1086 Read 10 Done New Done false
933 88 Acked 1087 Read 3 Done New Done false
934 89 Acked 1088 Write 3 Done New Done false
935 90 Acked 1089 Read 7 Done New Done false
936 91 Acked 1090 Write 8 Done New Done false
937 92 Acked 1091 Write 7 Done New Done false
938 93 Acked 1092 Read 10 Done New Done false
939 94 Acked 1093 Read 4 Done New Done false
940 95 Acked 1094 Flush 0 Done New Done false
941 96 Acked 1095 Write 8 Done New Done false
942 97 Acked 1096 Write 10 Done New Done false
943 98 Acked 1097 Write 7 Done New Done false
944 99 Acked 1098 Read 3 Done New Done false
945 100 Acked 1099 Write 4 Done New Done false
946 101 Acked 1100 Read 4 Done New Done false
947 102 Acked 1101 Write 6 Done New Done false
948 103 Acked 1102 Read 10 Done New Done false
949 104 Acked 1103 Write 5 Done New Done false
950 105 Acked 1104 Read 5 Done New Done false
951 106 Acked 1105 Write 6 Done New Done false
952 107 Acked 1106 Flush 0 Done New Done false
953 108 Acked 1107 Read 3 Done New Done false
954 109 Acked 1108 Read 3 Done New Done false
955 110 Acked 1109 Read 9 Done New Done false
956 111 Acked 1110 Write 9 Done New Done false
957 112 Acked 1111 Read 7 Done New Done false
958 113 Acked 1112 Read 2 Done New Done false
959 114 Acked 1113 Read 8 Done New Done false
960 115 Acked 1114 Write 7 Done New Done false
961 116 Acked 1115 Read 5 Done New Done false
962 117 Acked 1116 Read 5 Done New Done false
963 118 Acked 1117 Flush 0 Done New Done false
964 119 Acked 1118 Write 3 Done New Done false
965 120 Acked 1119 Read 5 Done New Done false
966 121 Acked 1120 Read 10 Done New Done false
967 122 Acked 1121 Read 10 Done New Done false
968 123 Acked 1122 Write 5 Done New Done false
969 124 Acked 1123 Read 1 Done New Done false
970 125 Acked 1124 Write 6 Done New Done false
971 126 Acked 1125 Read 7 Done New Done false
972 127 Acked 1126 Read 7 Done New Done false
973 128 Acked 1127 Read 5 Done New Done false
974 129 Acked 1128 Read 2 Done New Done false
975 130 Acked 1129 Read 8 Done New Done false
976 131 Acked 1130 Write 3 Done New Done false
977 132 Acked 1131 Read 7 Done New Done false
978 133 Acked 1132 Write 8 Done New Done false
979 134 Acked 1133 Read 5 Done New Done false
980 135 Acked 1134 Flush 0 Done New Done false
981 136 Acked 1135 Read 1 Done New Done false
982 137 Acked 1136 Write 10 Done New Done false
983 138 Acked 1137 Write 1 Done New Done false
984 139 Acked 1138 Read 7 Done New Done false
985 140 Acked 1139 Flush 0 Done New Done false
986 141 Acked 1140 Write 4 Done New Done false
987 142 Acked 1141 Read 5 Done New Done false
988 143 Acked 1142 Read 8 Done New Done false
989 144 Acked 1143 Write 1 Done New Done false
990 145 Acked 1144 Read 2 Done New Done false
991 146 Acked 1145 Read 2 Done New Done false
992 147 Acked 1146 Write 7 Done New Done false
993 148 Acked 1147 Write 1 Done New Done false
994 149 Acked 1148 Write 3 Done New Done false
995 150 Acked 1149 Flush 0 Done New Done false
996 151 Acked 1150 Read 10 Done New Done false
997 152 Acked 1151 Read 5 Done New Done false
998 153 Acked 1152 Write 5 Done New Done false
999 154 Acked 1153 Read 1 Done New Done false
1000 155 Acked 1154 Write 10 Done New Done false
1001 156 Acked 1155 Read 8 Done New Done false
1002 157 Acked 1156 Write 2 Done New Done false
1003 158 Acked 1157 Flush 0 Done New Done false
1004 159 Acked 1158 Read 2 Done New Done false
1005 160 Acked 1159 Write 2 Done New Done false
1006 161 Acked 1160 Read 7 Done New Done false
1007 162 Acked 1161 Read 7 Done New Done false
1008 163 Acked 1162 Write 8 Done New Done false
1009 164 Acked 1163 Write 4 Done New Done false
1010 165 Acked 1164 Write 7 Done New Done false
1011 166 Acked 1165 Read 8 Done New Done false
1012 167 Acked 1166 Read 6 Done New Done false
1013 168 Acked 1167 Read 5 Done New Done false
1014 169 Acked 1168 Read 6 Done New Done false
1015 170 Acked 1169 Flush 0 Done New Done false
1016 171 Acked 1170 Read 3 Done New Done false
1017 172 Acked 1171 Read 8 Done New Done false
1018 173 Acked 1172 Read 4 Done New Done false
1019 174 Acked 1173 Write 8 Done New Done false
1020 175 Acked 1174 Read 10 Done New Done false
1021 176 Acked 1175 Read 7 Done New Done false
1022 177 Acked 1176 Read 5 Done New Done false
1023 178 Acked 1177 Write 5 Done New Done false
1024 179 Acked 1178 Read 6 Done New Done false
1025 180 Acked 1179 Read 10 Done New Done false
1026 181 Acked 1180 Read 10 Done New Done false
1027 182 Acked 1181 Write 3 Done New Done false
1028 183 Acked 1182 Write 6 Done New Done false
1029 184 Acked 1183 Write 8 Done New Done false
1030 185 Acked 1184 Write 7 Done New Done false
1031 186 Acked 1185 Write 10 Done New Done false
1032 187 Acked 1186 Read 4 Done New Done false
1033 188 Acked 1187 Read 8 Done New Done false
1034 189 Acked 1188 Read 4 Done New Done false
1035 190 Acked 1189 Read 3 Done New Done false
1036 191 Acked 1190 Write 8 Done New Done false
1037 192 Acked 1191 Read 9 Done New Done false
1038 193 Acked 1192 Read 9 Done New Done false
1039 194 Acked 1193 Read 1 Done New Done false
1040 195 Acked 1194 Write 7 Done New Done false
1041 196 Acked 1195 Read 5 Done New Done false
1042 197 Acked 1196 Flush 0 Done New Done false
1043 198 Acked 1197 Read 5 Done New Done false
1044 199 Acked 1198 Write 3 Done New Done false
1045 200 Acked 1199 Write 4 Done New Done false
1046 201 Acked 1200 Write 10 Done New Done false
1047 202 Acked 1201 Write 9 Done New Done false
1048 203 Acked 1202 Write 7 Done New Done false
1049 204 Acked 1203 Write 3 Done New Done false
1050 205 Acked 1204 Read 2 Done New Done false
1051 206 Acked 1205 Write 9 Done New Done false
1052 207 Acked 1206 Write 7 Done New Done false
1053 208 Acked 1207 Write 8 Done New Done false
1054 209 Acked 1208 Write 8 Done New Done false
1055 210 Acked 1209 Read 1 Done New Done false
1056 211 Acked 1210 Read 3 Done New Done false
1057 212 Acked 1211 Read 2 Done New Done false
1058 213 Acked 1212 Read 5 Done New Done false
1059 214 Acked 1213 Read 7 Done New Done false
1060 215 Acked 1214 Write 1 Done New Done false
1061 216 Acked 1215 Write 3 Done New Done false
1062 217 Acked 1216 Read 7 Done New Done false
1063 218 Acked 1217 Flush 0 Done New Done false
1064 219 Acked 1218 Read 6 Done New Done false
1065 220 Acked 1219 Write 3 Done New Done false
1066 221 Acked 1220 Read 1 Done New Done false
1067 222 Acked 1221 Write 8 Done New Done false
1068 223 Acked 1222 Write 7 Done New Done false
1069 224 Acked 1223 Read 1 Done New Done false
1070 225 Acked 1224 Read 2 Done New Done false
1071 226 Acked 1225 Write 8 Done New Done false
1072 227 Acked 1226 Write 8 Done New Done false
1073 228 Acked 1227 Read 8 Done New Done false
1074 229 Acked 1228 Flush 0 Done New Done false
1075 230 Acked 1229 Write 1 Done New Done false
1076 231 Acked 1230 Flush 0 Done New Done false
1077 232 Acked 1231 Read 1 Done New Done false
1078 233 Acked 1232 Flush 0 Done New Done false
1079 234 Acked 1233 Read 4 Done New Done false
1080 235 Acked 1234 Write 2 Done New Done false
1081 236 Acked 1235 Write 8 Done New Done false
1082 237 Acked 1236 Write 1 Done New Done false
1083 238 Acked 1237 Write 7 Done New Done false
1084 239 Acked 1238 Write 8 Done New Done false
1085 240 Acked 1239 Write 6 Done New Done false
1086 241 Acked 1240 Read 7 Done New Done false
1087 242 Acked 1241 Flush 0 Done New Done false
1088 243 Acked 1242 Read 4 Done New Done false
1089 244 Acked 1243 Write 2 Done New Done false
1090 245 Acked 1244 Write 4 Done New Done false
1091 246 Acked 1245 Write 10 Done New Done false
1092 247 Acked 1246 Write 9 Done New Done false
1093 248 Acked 1247 Write 10 Done New Done false
1094 249 Acked 1248 Read 1 Done New Done false
1095 250 Acked 1249 Read 5 Done New Done false
1096 251 Acked 1250 Read 4 Done New Done false
1097 252 Acked 1251 Write 7 Done New Done false
1098 253 Acked 1252 Write 5 Done New Done false
1099 254 Acked 1253 Write 2 Done New Done false
1100 255 Acked 1254 Read 2 Done New Done false
1101 256 Acked 1255 Write 6 Done New Done false
1102 257 Acked 1256 Write 6 Done New Done false
1103 258 Acked 1257 Write 4 Done New Done false
1104 259 Acked 1258 Read 6 Done New Done false
1105 260 Acked 1259 Read 7 Done New Done false
1106 261 Acked 1260 Read 9 Done New Done false
1107 262 Acked 1261 Write 8 Done New Done false
1108 263 Acked 1262 Write 4 Done New Done false
1109 264 Acked 1263 Write 1 Done New Done false
1110 265 Acked 1264 Write 8 Done New Done false
1111 266 Acked 1265 Read 6 Done New Done false
1112 267 Acked 1266 Read 8 Done New Done false
1113 268 Acked 1267 Write 2 Done New Done false
1114 269 Acked 1268 Read 3 Done New Done false
1115 270 Acked 1269 Flush 0 Done New Done false
1116 271 Acked 1270 Write 7 Done New Done false
1117 272 Acked 1271 Read 10 Done New Done false
1118 273 Acked 1272 Write 4 Done New Done false
1119 274 Acked 1273 Read 10 Done New Done false
1120 275 Acked 1274 Read 6 Done New Done false
1121 276 Acked 1275 Read 9 Done New Done false
1122 277 Acked 1276 Read 5 Done New Done false
1123 278 Acked 1277 Write 2 Done New Done false
1124 279 Acked 1278 Read 5 Done New Done false
1125 280 Acked 1279 Write 5 Done New Done false
1126 281 Acked 1280 Write 3 Done New Done false
1127 282 Acked 1281 Read 8 Done New Done false
1128 283 Acked 1282 Write 4 Done New Done false
1129 284 Acked 1283 Read 10 Done New Done false
1130 285 Acked 1284 Read 2 Done New Done false
1131 286 Acked 1285 Write 3 Done New Done false
1132 287 Acked 1286 Write 2 Done New Done false
1133 288 Acked 1287 Read 3 Done New Done false
1134 289 Acked 1288 Flush 0 Done New Done false
1135 290 Acked 1289 Write 7 Done New Done false
1136 291 Acked 1290 Read 9 Done New Done false
1137 292 Acked 1291 Write 10 Done New Done false
1138 293 Acked 1292 Read 7 Done New Done false
1139 294 Acked 1293 Read 3 Done New Done false
1140 295 Acked 1294 Write 9 Done New Done false
1141 296 Acked 1295 Read 8 Done New Done false
1142 297 Acked 1296 Write 6 Done New Done false
1143 298 Acked 1297 Read 6 Done New Done false
1144 299 Acked 1298 Write 1 Done New Done false
1145 300 Acked 1299 Write 9 Done New Done false
1146 301 Acked 1300 Flush 0 Done New Done false
1147 STATES DS:0 DS:1 DS:2 TOTAL
1148 New 0 301 0 301
1149 Sent 0 0 0 0
1150 Done 301 0 301 602
1151 Skipped 0 0 0 0
1152 Error 0 0 0 0
1153 Last Flush: 1300 0 1300
1154 Downstairs last five completed:
1155 Upstairs last five completed: 301 300 299 298 297
1156 CLIENT: Up:0 ds:301 act:2
11572024-04-20T01:05:18.014ZINFOcrucible: connecting to 127.0.0.1:8820 = io task client = 1 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
11582024-04-20T01:05:18.015ZWARNcrucible: ds_connection connect to 127.0.0.1:8820 failure: Os { code: 146, kind: ConnectionRefused, message: "Connection refused" } = io task client = 1 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
11592024-04-20T01:05:18.015ZWARNcrucible: client task is sending Done(ConnectionFailed(Os { code: 146, kind: ConnectionRefused, message: "Connection refused" })) = io task client = 1 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
11602024-04-20T01:05:18.015ZWARNcrucible: downstairs task for 1 stopped due to ConnectionFailed(Os { code: 146, kind: ConnectionRefused, message: "Connection refused" }) session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
11612024-04-20T01:05:18.015ZINFOcrucible: [1] client re-new 301 jobs since flush 0 = downstairs session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
11622024-04-20T01:05:18.015ZINFOcrucible: [1] Marked 0 jobs for replay since flush: 0 = downstairs session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
11632024-04-20T01:05:18.015ZINFOcrucible: client task is exiting = io task client = 1 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
1164 [8820] got start action
1165 [8820] I am going to restart
1166 Starting downstairs at port 8820
1167 Make output file at "/tmp/dsc/downstairs-8820.txt"
1168 [8820][1] reports Starting
1169 Downstairs /var/tmp/dsc/region/8820 port 8820 PID:Some(1197)
1170 [8820][1] reports Running
1171 ----------------------------------------------------------------
1172 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:301
1173 States: Active Offline Active
1174 GW_ID ACK DSID TYPE BLOCKS DS:0 DS:1 DS:2 REPLAY
1175 1 Acked 1000 Flush 0 Done New Done true
1176 2 Acked 1001 Read 2 Done New Done true
1177 3 Acked 1002 Flush 0 Done New Done true
1178 4 Acked 1003 Write 3 Done New Done true
1179 5 Acked 1004 Write 4 Done New Done true
1180 6 Acked 1005 Read 3 Done New Done true
1181 7 Acked 1006 Write 6 Done New Done true
1182 8 Acked 1007 Write 1 Done New Done true
1183 9 Acked 1008 Write 4 Done New Done true
1184 10 Acked 1009 Read 7 Done New Done true
1185 11 Acked 1010 Write 4 Done New Done true
1186 12 Acked 1011 Write 5 Done New Done true
1187 13 Acked 1012 Read 1 Done New Done true
1188 14 Acked 1013 Read 5 Done New Done true
1189 15 Acked 1014 Read 2 Done New Done true
1190 16 Acked 1015 Read 6 Done New Done true
1191 17 Acked 1016 Write 7 Done New Done true
1192 18 Acked 1017 Read 2 Done New Done true
1193 19 Acked 1018 Read 3 Done New Done true
1194 20 Acked 1019 Flush 0 Done New Done true
1195 21 Acked 1020 Read 7 Done New Done true
1196 22 Acked 1021 Read 10 Done New Done true
1197 23 Acked 1022 Read 8 Done New Done true
1198 24 Acked 1023 Write 10 Done New Done true
1199 25 Acked 1024 Read 7 Done New Done true
1200 26 Acked 1025 Write 2 Done New Done true
1201 27 Acked 1026 Write 10 Done New Done true
1202 28 Acked 1027 Write 8 Done New Done true
1203 29 Acked 1028 Write 6 Done New Done true
1204 30 Acked 1029 Read 3 Done New Done true
1205 31 Acked 1030 Write 2 Done New Done true
1206 32 Acked 1031 Write 7 Done New Done true
1207 33 Acked 1032 Read 9 Done New Done true
1208 34 Acked 1033 Read 10 Done New Done true
1209 35 Acked 1034 Read 4 Done New Done true
1210 36 Acked 1035 Write 4 Done New Done true
1211 37 Acked 1036 Write 2 Done New Done true
1212 38 Acked 1037 Read 5 Done New Done true
1213 39 Acked 1038 Read 9 Done New Done true
1214 40 Acked 1039 Write 8 Done New Done true
1215 41 Acked 1040 Read 2 Done New Done true
1216 42 Acked 1041 Write 5 Done New Done true
1217 43 Acked 1042 Read 8 Done New Done true
1218 44 Acked 1043 Write 7 Done New Done true
1219 45 Acked 1044 Read 2 Done New Done true
1220 46 Acked 1045 Flush 0 Done New Done true
1221 47 Acked 1046 Read 10 Done New Done true
1222 48 Acked 1047 Write 10 Done New Done true
1223 49 Acked 1048 Write 1 Done New Done true
1224 50 Acked 1049 Write 10 Done New Done true
1225 51 Acked 1050 Read 8 Done New Done true
1226 52 Acked 1051 Read 1 Done New Done true
1227 53 Acked 1052 Flush 0 Done New Done true
1228 54 Acked 1053 Read 6 Done New Done true
1229 55 Acked 1054 Read 5 Done New Done true
1230 56 Acked 1055 Read 6 Done New Done true
1231 57 Acked 1056 Write 3 Done New Done true
1232 58 Acked 1057 Write 2 Done New Done true
1233 59 Acked 1058 Read 7 Done New Done true
1234 60 Acked 1059 Write 8 Done New Done true
1235 61 Acked 1060 Write 1 Done New Done true
1236 62 Acked 1061 Write 7 Done New Done true
1237 63 Acked 1062 Flush 0 Done New Done true
1238 64 Acked 1063 Write 8 Done New Done true
1239 65 Acked 1064 Read 2 Done New Done true
1240 66 Acked 1065 Read 4 Done New Done true
1241 67 Acked 1066 Read 7 Done New Done true
1242 68 Acked 1067 Read 8 Done New Done true
1243 69 Acked 1068 Read 5 Done New Done true
1244 70 Acked 1069 Write 3 Done New Done true
1245 71 Acked 1070 Write 4 Done New Done true
1246 72 Acked 1071 Write 6 Done New Done true
1247 73 Acked 1072 Read 1 Done New Done true
1248 74 Acked 1073 Write 10 Done New Done true
1249 75 Acked 1074 Write 3 Done New Done true
1250 76 Acked 1075 Flush 0 Done New Done true
1251 77 Acked 1076 Read 3 Done New Done true
1252 78 Acked 1077 Write 7 Done New Done true
1253 79 Acked 1078 Write 6 Done New Done true
1254 80 Acked 1079 Read 8 Done New Done true
1255 81 Acked 1080 Read 2 Done New Done true
1256 82 Acked 1081 Flush 0 Done New Done true
1257 83 Acked 1082 Read 7 Done New Done true
1258 84 Acked 1083 Write 5 Done New Done true
1259 85 Acked 1084 Read 5 Done New Done true
1260 86 Acked 1085 Read 2 Done New Done true
1261 87 Acked 1086 Read 10 Done New Done true
1262 88 Acked 1087 Read 3 Done New Done true
1263 89 Acked 1088 Write 3 Done New Done true
1264 90 Acked 1089 Read 7 Done New Done true
1265 91 Acked 1090 Write 8 Done New Done true
1266 92 Acked 1091 Write 7 Done New Done true
1267 93 Acked 1092 Read 10 Done New Done true
1268 94 Acked 1093 Read 4 Done New Done true
1269 95 Acked 1094 Flush 0 Done New Done true
1270 96 Acked 1095 Write 8 Done New Done true
1271 97 Acked 1096 Write 10 Done New Done true
1272 98 Acked 1097 Write 7 Done New Done true
1273 99 Acked 1098 Read 3 Done New Done true
1274 100 Acked 1099 Write 4 Done New Done true
1275 101 Acked 1100 Read 4 Done New Done true
1276 102 Acked 1101 Write 6 Done New Done true
1277 103 Acked 1102 Read 10 Done New Done true
1278 104 Acked 1103 Write 5 Done New Done true
1279 105 Acked 1104 Read 5 Done New Done true
1280 106 Acked 1105 Write 6 Done New Done true
1281 107 Acked 1106 Flush 0 Done New Done true
1282 108 Acked 1107 Read 3 Done New Done true
1283 109 Acked 1108 Read 3 Done New Done true
1284 110 Acked 1109 Read 9 Done New Done true
1285 111 Acked 1110 Write 9 Done New Done true
1286 112 Acked 1111 Read 7 Done New Done true
1287 113 Acked 1112 Read 2 Done New Done true
1288 114 Acked 1113 Read 8 Done New Done true
1289 115 Acked 1114 Write 7 Done New Done true
1290 116 Acked 1115 Read 5 Done New Done true
1291 117 Acked 1116 Read 5 Done New Done true
1292 118 Acked 1117 Flush 0 Done New Done true
1293 119 Acked 1118 Write 3 Done New Done true
1294 120 Acked 1119 Read 5 Done New Done true
1295 121 Acked 1120 Read 10 Done New Done true
1296 122 Acked 1121 Read 10 Done New Done true
1297 123 Acked 1122 Write 5 Done New Done true
1298 124 Acked 1123 Read 1 Done New Done true
1299 125 Acked 1124 Write 6 Done New Done true
1300 126 Acked 1125 Read 7 Done New Done true
1301 127 Acked 1126 Read 7 Done New Done true
1302 128 Acked 1127 Read 5 Done New Done true
1303 129 Acked 1128 Read 2 Done New Done true
1304 130 Acked 1129 Read 8 Done New Done true
1305 131 Acked 1130 Write 3 Done New Done true
1306 132 Acked 1131 Read 7 Done New Done true
1307 133 Acked 1132 Write 8 Done New Done true
1308 134 Acked 1133 Read 5 Done New Done true
1309 135 Acked 1134 Flush 0 Done New Done true
1310 136 Acked 1135 Read 1 Done New Done true
1311 137 Acked 1136 Write 10 Done New Done true
1312 138 Acked 1137 Write 1 Done New Done true
1313 139 Acked 1138 Read 7 Done New Done true
1314 140 Acked 1139 Flush 0 Done New Done true
1315 141 Acked 1140 Write 4 Done New Done true
1316 142 Acked 1141 Read 5 Done New Done true
1317 143 Acked 1142 Read 8 Done New Done true
1318 144 Acked 1143 Write 1 Done New Done true
1319 145 Acked 1144 Read 2 Done New Done true
1320 146 Acked 1145 Read 2 Done New Done true
1321 147 Acked 1146 Write 7 Done New Done true
1322 148 Acked 1147 Write 1 Done New Done true
1323 149 Acked 1148 Write 3 Done New Done true
1324 150 Acked 1149 Flush 0 Done New Done true
1325 151 Acked 1150 Read 10 Done New Done true
1326 152 Acked 1151 Read 5 Done New Done true
1327 153 Acked 1152 Write 5 Done New Done true
1328 154 Acked 1153 Read 1 Done New Done true
1329 155 Acked 1154 Write 10 Done New Done true
1330 156 Acked 1155 Read 8 Done New Done true
1331 157 Acked 1156 Write 2 Done New Done true
1332 158 Acked 1157 Flush 0 Done New Done true
1333 159 Acked 1158 Read 2 Done New Done true
1334 160 Acked 1159 Write 2 Done New Done true
1335 161 Acked 1160 Read 7 Done New Done true
1336 162 Acked 1161 Read 7 Done New Done true
1337 163 Acked 1162 Write 8 Done New Done true
1338 164 Acked 1163 Write 4 Done New Done true
1339 165 Acked 1164 Write 7 Done New Done true
1340 166 Acked 1165 Read 8 Done New Done true
1341 167 Acked 1166 Read 6 Done New Done true
1342 168 Acked 1167 Read 5 Done New Done true
1343 169 Acked 1168 Read 6 Done New Done true
1344 170 Acked 1169 Flush 0 Done New Done true
1345 171 Acked 1170 Read 3 Done New Done true
1346 172 Acked 1171 Read 8 Done New Done true
1347 173 Acked 1172 Read 4 Done New Done true
1348 174 Acked 1173 Write 8 Done New Done true
1349 175 Acked 1174 Read 10 Done New Done true
1350 176 Acked 1175 Read 7 Done New Done true
1351 177 Acked 1176 Read 5 Done New Done true
1352 178 Acked 1177 Write 5 Done New Done true
1353 179 Acked 1178 Read 6 Done New Done true
1354 180 Acked 1179 Read 10 Done New Done true
1355 181 Acked 1180 Read 10 Done New Done true
1356 182 Acked 1181 Write 3 Done New Done true
1357 183 Acked 1182 Write 6 Done New Done true
1358 184 Acked 1183 Write 8 Done New Done true
1359 185 Acked 1184 Write 7 Done New Done true
1360 186 Acked 1185 Write 10 Done New Done true
1361 187 Acked 1186 Read 4 Done New Done true
1362 188 Acked 1187 Read 8 Done New Done true
1363 189 Acked 1188 Read 4 Done New Done true
1364 190 Acked 1189 Read 3 Done New Done true
1365 191 Acked 1190 Write 8 Done New Done true
1366 192 Acked 1191 Read 9 Done New Done true
1367 193 Acked 1192 Read 9 Done New Done true
1368 194 Acked 1193 Read 1 Done New Done true
1369 195 Acked 1194 Write 7 Done New Done true
1370 196 Acked 1195 Read 5 Done New Done true
1371 197 Acked 1196 Flush 0 Done New Done true
1372 198 Acked 1197 Read 5 Done New Done true
1373 199 Acked 1198 Write 3 Done New Done true
1374 200 Acked 1199 Write 4 Done New Done true
1375 201 Acked 1200 Write 10 Done New Done true
1376 202 Acked 1201 Write 9 Done New Done true
1377 203 Acked 1202 Write 7 Done New Done true
1378 204 Acked 1203 Write 3 Done New Done true
1379 205 Acked 1204 Read 2 Done New Done true
1380 206 Acked 1205 Write 9 Done New Done true
1381 207 Acked 1206 Write 7 Done New Done true
1382 208 Acked 1207 Write 8 Done New Done true
1383 209 Acked 1208 Write 8 Done New Done true
1384 210 Acked 1209 Read 1 Done New Done true
1385 211 Acked 1210 Read 3 Done New Done true
1386 212 Acked 1211 Read 2 Done New Done true
1387 213 Acked 1212 Read 5 Done New Done true
1388 214 Acked 1213 Read 7 Done New Done true
1389 215 Acked 1214 Write 1 Done New Done true
1390 216 Acked 1215 Write 3 Done New Done true
1391 217 Acked 1216 Read 7 Done New Done true
1392 218 Acked 1217 Flush 0 Done New Done true
1393 219 Acked 1218 Read 6 Done New Done true
1394 220 Acked 1219 Write 3 Done New Done true
1395 221 Acked 1220 Read 1 Done New Done true
1396 222 Acked 1221 Write 8 Done New Done true
1397 223 Acked 1222 Write 7 Done New Done true
1398 224 Acked 1223 Read 1 Done New Done true
1399 225 Acked 1224 Read 2 Done New Done true
1400 226 Acked 1225 Write 8 Done New Done true
1401 227 Acked 1226 Write 8 Done New Done true
1402 228 Acked 1227 Read 8 Done New Done true
1403 229 Acked 1228 Flush 0 Done New Done true
1404 230 Acked 1229 Write 1 Done New Done true
1405 231 Acked 1230 Flush 0 Done New Done true
1406 232 Acked 1231 Read 1 Done New Done true
1407 233 Acked 1232 Flush 0 Done New Done true
1408 234 Acked 1233 Read 4 Done New Done true
1409 235 Acked 1234 Write 2 Done New Done true
1410 236 Acked 1235 Write 8 Done New Done true
1411 237 Acked 1236 Write 1 Done New Done true
1412 238 Acked 1237 Write 7 Done New Done true
1413 239 Acked 1238 Write 8 Done New Done true
1414 240 Acked 1239 Write 6 Done New Done true
1415 241 Acked 1240 Read 7 Done New Done true
1416 242 Acked 1241 Flush 0 Done New Done true
1417 243 Acked 1242 Read 4 Done New Done true
1418 244 Acked 1243 Write 2 Done New Done true
1419 245 Acked 1244 Write 4 Done New Done true
1420 246 Acked 1245 Write 10 Done New Done true
1421 247 Acked 1246 Write 9 Done New Done true
1422 248 Acked 1247 Write 10 Done New Done true
1423 249 Acked 1248 Read 1 Done New Done true
1424 250 Acked 1249 Read 5 Done New Done true
1425 251 Acked 1250 Read 4 Done New Done true
1426 252 Acked 1251 Write 7 Done New Done true
1427 253 Acked 1252 Write 5 Done New Done true
1428 254 Acked 1253 Write 2 Done New Done true
1429 255 Acked 1254 Read 2 Done New Done true
1430 256 Acked 1255 Write 6 Done New Done true
1431 257 Acked 1256 Write 6 Done New Done true
1432 258 Acked 1257 Write 4 Done New Done true
1433 259 Acked 1258 Read 6 Done New Done true
1434 260 Acked 1259 Read 7 Done New Done true
1435 261 Acked 1260 Read 9 Done New Done true
1436 262 Acked 1261 Write 8 Done New Done true
1437 263 Acked 1262 Write 4 Done New Done true
1438 264 Acked 1263 Write 1 Done New Done true
1439 265 Acked 1264 Write 8 Done New Done true
1440 266 Acked 1265 Read 6 Done New Done true
1441 267 Acked 1266 Read 8 Done New Done true
1442 268 Acked 1267 Write 2 Done New Done true
1443 269 Acked 1268 Read 3 Done New Done true
1444 270 Acked 1269 Flush 0 Done New Done true
1445 271 Acked 1270 Write 7 Done New Done true
1446 272 Acked 1271 Read 10 Done New Done true
1447 273 Acked 1272 Write 4 Done New Done true
1448 274 Acked 1273 Read 10 Done New Done true
1449 275 Acked 1274 Read 6 Done New Done true
1450 276 Acked 1275 Read 9 Done New Done true
1451 277 Acked 1276 Read 5 Done New Done true
1452 278 Acked 1277 Write 2 Done New Done true
1453 279 Acked 1278 Read 5 Done New Done true
1454 280 Acked 1279 Write 5 Done New Done true
1455 281 Acked 1280 Write 3 Done New Done true
1456 282 Acked 1281 Read 8 Done New Done true
1457 283 Acked 1282 Write 4 Done New Done true
1458 284 Acked 1283 Read 10 Done New Done true
1459 285 Acked 1284 Read 2 Done New Done true
1460 286 Acked 1285 Write 3 Done New Done true
1461 287 Acked 1286 Write 2 Done New Done true
1462 288 Acked 1287 Read 3 Done New Done true
1463 289 Acked 1288 Flush 0 Done New Done true
1464 290 Acked 1289 Write 7 Done New Done true
1465 291 Acked 1290 Read 9 Done New Done true
1466 292 Acked 1291 Write 10 Done New Done true
1467 293 Acked 1292 Read 7 Done New Done true
1468 294 Acked 1293 Read 3 Done New Done true
1469 295 Acked 1294 Write 9 Done New Done true
1470 296 Acked 1295 Read 8 Done New Done true
1471 297 Acked 1296 Write 6 Done New Done true
1472 298 Acked 1297 Read 6 Done New Done true
1473 299 Acked 1298 Write 1 Done New Done true
1474 300 Acked 1299 Write 9 Done New Done true
1475 301 Acked 1300 Flush 0 Done New Done true
1476 STATES DS:0 DS:1 DS:2 TOTAL
1477 New 0 301 0 301
1478 Sent 0 0 0 0
1479 Done 301 0 301 602
1480 Skipped 0 0 0 0
1481 Error 0 0 0 0
1482 Last Flush: 1300 0 1300
1483 Downstairs last five completed:
1484 Upstairs last five completed: 301 300 299 298 297
1485 CLIENT: Up:0 ds:301 act:2
1486 ----------------------------------------------------------------
1487 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:301
1488 States: Active Offline Active
1489 GW_ID ACK DSID TYPE BLOCKS DS:0 DS:1 DS:2 REPLAY
1490 1 Acked 1000 Flush 0 Done New Done true
1491 2 Acked 1001 Read 2 Done New Done true
1492 3 Acked 1002 Flush 0 Done New Done true
1493 4 Acked 1003 Write 3 Done New Done true
1494 5 Acked 1004 Write 4 Done New Done true
1495 6 Acked 1005 Read 3 Done New Done true
1496 7 Acked 1006 Write 6 Done New Done true
1497 8 Acked 1007 Write 1 Done New Done true
1498 9 Acked 1008 Write 4 Done New Done true
1499 10 Acked 1009 Read 7 Done New Done true
1500 11 Acked 1010 Write 4 Done New Done true
1501 12 Acked 1011 Write 5 Done New Done true
1502 13 Acked 1012 Read 1 Done New Done true
1503 14 Acked 1013 Read 5 Done New Done true
1504 15 Acked 1014 Read 2 Done New Done true
1505 16 Acked 1015 Read 6 Done New Done true
1506 17 Acked 1016 Write 7 Done New Done true
1507 18 Acked 1017 Read 2 Done New Done true
1508 19 Acked 1018 Read 3 Done New Done true
1509 20 Acked 1019 Flush 0 Done New Done true
1510 21 Acked 1020 Read 7 Done New Done true
1511 22 Acked 1021 Read 10 Done New Done true
1512 23 Acked 1022 Read 8 Done New Done true
1513 24 Acked 1023 Write 10 Done New Done true
1514 25 Acked 1024 Read 7 Done New Done true
1515 26 Acked 1025 Write 2 Done New Done true
1516 27 Acked 1026 Write 10 Done New Done true
1517 28 Acked 1027 Write 8 Done New Done true
1518 29 Acked 1028 Write 6 Done New Done true
1519 30 Acked 1029 Read 3 Done New Done true
1520 31 Acked 1030 Write 2 Done New Done true
1521 32 Acked 1031 Write 7 Done New Done true
1522 33 Acked 1032 Read 9 Done New Done true
1523 34 Acked 1033 Read 10 Done New Done true
1524 35 Acked 1034 Read 4 Done New Done true
1525 36 Acked 1035 Write 4 Done New Done true
1526 37 Acked 1036 Write 2 Done New Done true
1527 38 Acked 1037 Read 5 Done New Done true
1528 39 Acked 1038 Read 9 Done New Done true
1529 40 Acked 1039 Write 8 Done New Done true
1530 41 Acked 1040 Read 2 Done New Done true
1531 42 Acked 1041 Write 5 Done New Done true
1532 43 Acked 1042 Read 8 Done New Done true
1533 44 Acked 1043 Write 7 Done New Done true
1534 45 Acked 1044 Read 2 Done New Done true
1535 46 Acked 1045 Flush 0 Done New Done true
1536 47 Acked 1046 Read 10 Done New Done true
1537 48 Acked 1047 Write 10 Done New Done true
1538 49 Acked 1048 Write 1 Done New Done true
1539 50 Acked 1049 Write 10 Done New Done true
1540 51 Acked 1050 Read 8 Done New Done true
1541 52 Acked 1051 Read 1 Done New Done true
1542 53 Acked 1052 Flush 0 Done New Done true
1543 54 Acked 1053 Read 6 Done New Done true
1544 55 Acked 1054 Read 5 Done New Done true
1545 56 Acked 1055 Read 6 Done New Done true
1546 57 Acked 1056 Write 3 Done New Done true
1547 58 Acked 1057 Write 2 Done New Done true
1548 59 Acked 1058 Read 7 Done New Done true
1549 60 Acked 1059 Write 8 Done New Done true
1550 61 Acked 1060 Write 1 Done New Done true
1551 62 Acked 1061 Write 7 Done New Done true
1552 63 Acked 1062 Flush 0 Done New Done true
1553 64 Acked 1063 Write 8 Done New Done true
1554 65 Acked 1064 Read 2 Done New Done true
1555 66 Acked 1065 Read 4 Done New Done true
1556 67 Acked 1066 Read 7 Done New Done true
1557 68 Acked 1067 Read 8 Done New Done true
1558 69 Acked 1068 Read 5 Done New Done true
1559 70 Acked 1069 Write 3 Done New Done true
1560 71 Acked 1070 Write 4 Done New Done true
1561 72 Acked 1071 Write 6 Done New Done true
1562 73 Acked 1072 Read 1 Done New Done true
1563 74 Acked 1073 Write 10 Done New Done true
1564 75 Acked 1074 Write 3 Done New Done true
1565 76 Acked 1075 Flush 0 Done New Done true
1566 77 Acked 1076 Read 3 Done New Done true
1567 78 Acked 1077 Write 7 Done New Done true
1568 79 Acked 1078 Write 6 Done New Done true
1569 80 Acked 1079 Read 8 Done New Done true
1570 81 Acked 1080 Read 2 Done New Done true
1571 82 Acked 1081 Flush 0 Done New Done true
1572 83 Acked 1082 Read 7 Done New Done true
1573 84 Acked 1083 Write 5 Done New Done true
1574 85 Acked 1084 Read 5 Done New Done true
1575 86 Acked 1085 Read 2 Done New Done true
1576 87 Acked 1086 Read 10 Done New Done true
1577 88 Acked 1087 Read 3 Done New Done true
1578 89 Acked 1088 Write 3 Done New Done true
1579 90 Acked 1089 Read 7 Done New Done true
1580 91 Acked 1090 Write 8 Done New Done true
1581 92 Acked 1091 Write 7 Done New Done true
1582 93 Acked 1092 Read 10 Done New Done true
1583 94 Acked 1093 Read 4 Done New Done true
1584 95 Acked 1094 Flush 0 Done New Done true
1585 96 Acked 1095 Write 8 Done New Done true
1586 97 Acked 1096 Write 10 Done New Done true
1587 98 Acked 1097 Write 7 Done New Done true
1588 99 Acked 1098 Read 3 Done New Done true
1589 100 Acked 1099 Write 4 Done New Done true
1590 101 Acked 1100 Read 4 Done New Done true
1591 102 Acked 1101 Write 6 Done New Done true
1592 103 Acked 1102 Read 10 Done New Done true
1593 104 Acked 1103 Write 5 Done New Done true
1594 105 Acked 1104 Read 5 Done New Done true
1595 106 Acked 1105 Write 6 Done New Done true
1596 107 Acked 1106 Flush 0 Done New Done true
1597 108 Acked 1107 Read 3 Done New Done true
1598 109 Acked 1108 Read 3 Done New Done true
1599 110 Acked 1109 Read 9 Done New Done true
1600 111 Acked 1110 Write 9 Done New Done true
1601 112 Acked 1111 Read 7 Done New Done true
1602 113 Acked 1112 Read 2 Done New Done true
1603 114 Acked 1113 Read 8 Done New Done true
1604 115 Acked 1114 Write 7 Done New Done true
1605 116 Acked 1115 Read 5 Done New Done true
1606 117 Acked 1116 Read 5 Done New Done true
1607 118 Acked 1117 Flush 0 Done New Done true
1608 119 Acked 1118 Write 3 Done New Done true
1609 120 Acked 1119 Read 5 Done New Done true
1610 121 Acked 1120 Read 10 Done New Done true
1611 122 Acked 1121 Read 10 Done New Done true
1612 123 Acked 1122 Write 5 Done New Done true
1613 124 Acked 1123 Read 1 Done New Done true
1614 125 Acked 1124 Write 6 Done New Done true
1615 126 Acked 1125 Read 7 Done New Done true
1616 127 Acked 1126 Read 7 Done New Done true
1617 128 Acked 1127 Read 5 Done New Done true
1618 129 Acked 1128 Read 2 Done New Done true
1619 130 Acked 1129 Read 8 Done New Done true
1620 131 Acked 1130 Write 3 Done New Done true
1621 132 Acked 1131 Read 7 Done New Done true
1622 133 Acked 1132 Write 8 Done New Done true
1623 134 Acked 1133 Read 5 Done New Done true
1624 135 Acked 1134 Flush 0 Done New Done true
1625 136 Acked 1135 Read 1 Done New Done true
1626 137 Acked 1136 Write 10 Done New Done true
1627 138 Acked 1137 Write 1 Done New Done true
1628 139 Acked 1138 Read 7 Done New Done true
1629 140 Acked 1139 Flush 0 Done New Done true
1630 141 Acked 1140 Write 4 Done New Done true
1631 142 Acked 1141 Read 5 Done New Done true
1632 143 Acked 1142 Read 8 Done New Done true
1633 144 Acked 1143 Write 1 Done New Done true
1634 145 Acked 1144 Read 2 Done New Done true
1635 146 Acked 1145 Read 2 Done New Done true
1636 147 Acked 1146 Write 7 Done New Done true
1637 148 Acked 1147 Write 1 Done New Done true
1638 149 Acked 1148 Write 3 Done New Done true
1639 150 Acked 1149 Flush 0 Done New Done true
1640 151 Acked 1150 Read 10 Done New Done true
1641 152 Acked 1151 Read 5 Done New Done true
1642 153 Acked 1152 Write 5 Done New Done true
1643 154 Acked 1153 Read 1 Done New Done true
1644 155 Acked 1154 Write 10 Done New Done true
1645 156 Acked 1155 Read 8 Done New Done true
1646 157 Acked 1156 Write 2 Done New Done true
1647 158 Acked 1157 Flush 0 Done New Done true
1648 159 Acked 1158 Read 2 Done New Done true
1649 160 Acked 1159 Write 2 Done New Done true
1650 161 Acked 1160 Read 7 Done New Done true
1651 162 Acked 1161 Read 7 Done New Done true
1652 163 Acked 1162 Write 8 Done New Done true
1653 164 Acked 1163 Write 4 Done New Done true
1654 165 Acked 1164 Write 7 Done New Done true
1655 166 Acked 1165 Read 8 Done New Done true
1656 167 Acked 1166 Read 6 Done New Done true
1657 168 Acked 1167 Read 5 Done New Done true
1658 169 Acked 1168 Read 6 Done New Done true
1659 170 Acked 1169 Flush 0 Done New Done true
1660 171 Acked 1170 Read 3 Done New Done true
1661 172 Acked 1171 Read 8 Done New Done true
1662 173 Acked 1172 Read 4 Done New Done true
1663 174 Acked 1173 Write 8 Done New Done true
1664 175 Acked 1174 Read 10 Done New Done true
1665 176 Acked 1175 Read 7 Done New Done true
1666 177 Acked 1176 Read 5 Done New Done true
1667 178 Acked 1177 Write 5 Done New Done true
1668 179 Acked 1178 Read 6 Done New Done true
1669 180 Acked 1179 Read 10 Done New Done true
1670 181 Acked 1180 Read 10 Done New Done true
1671 182 Acked 1181 Write 3 Done New Done true
1672 183 Acked 1182 Write 6 Done New Done true
1673 184 Acked 1183 Write 8 Done New Done true
1674 185 Acked 1184 Write 7 Done New Done true
1675 186 Acked 1185 Write 10 Done New Done true
1676 187 Acked 1186 Read 4 Done New Done true
1677 188 Acked 1187 Read 8 Done New Done true
1678 189 Acked 1188 Read 4 Done New Done true
1679 190 Acked 1189 Read 3 Done New Done true
1680 191 Acked 1190 Write 8 Done New Done true
1681 192 Acked 1191 Read 9 Done New Done true
1682 193 Acked 1192 Read 9 Done New Done true
1683 194 Acked 1193 Read 1 Done New Done true
1684 195 Acked 1194 Write 7 Done New Done true
1685 196 Acked 1195 Read 5 Done New Done true
1686 197 Acked 1196 Flush 0 Done New Done true
1687 198 Acked 1197 Read 5 Done New Done true
1688 199 Acked 1198 Write 3 Done New Done true
1689 200 Acked 1199 Write 4 Done New Done true
1690 201 Acked 1200 Write 10 Done New Done true
1691 202 Acked 1201 Write 9 Done New Done true
1692 203 Acked 1202 Write 7 Done New Done true
1693 204 Acked 1203 Write 3 Done New Done true
1694 205 Acked 1204 Read 2 Done New Done true
1695 206 Acked 1205 Write 9 Done New Done true
1696 207 Acked 1206 Write 7 Done New Done true
1697 208 Acked 1207 Write 8 Done New Done true
1698 209 Acked 1208 Write 8 Done New Done true
1699 210 Acked 1209 Read 1 Done New Done true
1700 211 Acked 1210 Read 3 Done New Done true
1701 212 Acked 1211 Read 2 Done New Done true
1702 213 Acked 1212 Read 5 Done New Done true
1703 214 Acked 1213 Read 7 Done New Done true
1704 215 Acked 1214 Write 1 Done New Done true
1705 216 Acked 1215 Write 3 Done New Done true
1706 217 Acked 1216 Read 7 Done New Done true
1707 218 Acked 1217 Flush 0 Done New Done true
1708 219 Acked 1218 Read 6 Done New Done true
1709 220 Acked 1219 Write 3 Done New Done true
1710 221 Acked 1220 Read 1 Done New Done true
1711 222 Acked 1221 Write 8 Done New Done true
1712 223 Acked 1222 Write 7 Done New Done true
1713 224 Acked 1223 Read 1 Done New Done true
1714 225 Acked 1224 Read 2 Done New Done true
1715 226 Acked 1225 Write 8 Done New Done true
1716 227 Acked 1226 Write 8 Done New Done true
1717 228 Acked 1227 Read 8 Done New Done true
1718 229 Acked 1228 Flush 0 Done New Done true
1719 230 Acked 1229 Write 1 Done New Done true
1720 231 Acked 1230 Flush 0 Done New Done true
1721 232 Acked 1231 Read 1 Done New Done true
1722 233 Acked 1232 Flush 0 Done New Done true
1723 234 Acked 1233 Read 4 Done New Done true
1724 235 Acked 1234 Write 2 Done New Done true
1725 236 Acked 1235 Write 8 Done New Done true
1726 237 Acked 1236 Write 1 Done New Done true
1727 238 Acked 1237 Write 7 Done New Done true
1728 239 Acked 1238 Write 8 Done New Done true
1729 240 Acked 1239 Write 6 Done New Done true
1730 241 Acked 1240 Read 7 Done New Done true
1731 242 Acked 1241 Flush 0 Done New Done true
1732 243 Acked 1242 Read 4 Done New Done true
1733 244 Acked 1243 Write 2 Done New Done true
1734 245 Acked 1244 Write 4 Done New Done true
1735 246 Acked 1245 Write 10 Done New Done true
1736 247 Acked 1246 Write 9 Done New Done true
1737 248 Acked 1247 Write 10 Done New Done true
1738 249 Acked 1248 Read 1 Done New Done true
1739 250 Acked 1249 Read 5 Done New Done true
1740 251 Acked 1250 Read 4 Done New Done true
1741 252 Acked 1251 Write 7 Done New Done true
1742 253 Acked 1252 Write 5 Done New Done true
1743 254 Acked 1253 Write 2 Done New Done true
1744 255 Acked 1254 Read 2 Done New Done true
1745 256 Acked 1255 Write 6 Done New Done true
1746 257 Acked 1256 Write 6 Done New Done true
1747 258 Acked 1257 Write 4 Done New Done true
1748 259 Acked 1258 Read 6 Done New Done true
1749 260 Acked 1259 Read 7 Done New Done true
1750 261 Acked 1260 Read 9 Done New Done true
1751 262 Acked 1261 Write 8 Done New Done true
1752 263 Acked 1262 Write 4 Done New Done true
1753 264 Acked 1263 Write 1 Done New Done true
1754 265 Acked 1264 Write 8 Done New Done true
1755 266 Acked 1265 Read 6 Done New Done true
1756 267 Acked 1266 Read 8 Done New Done true
1757 268 Acked 1267 Write 2 Done New Done true
1758 269 Acked 1268 Read 3 Done New Done true
1759 270 Acked 1269 Flush 0 Done New Done true
1760 271 Acked 1270 Write 7 Done New Done true
1761 272 Acked 1271 Read 10 Done New Done true
1762 273 Acked 1272 Write 4 Done New Done true
1763 274 Acked 1273 Read 10 Done New Done true
1764 275 Acked 1274 Read 6 Done New Done true
1765 276 Acked 1275 Read 9 Done New Done true
1766 277 Acked 1276 Read 5 Done New Done true
1767 278 Acked 1277 Write 2 Done New Done true
1768 279 Acked 1278 Read 5 Done New Done true
1769 280 Acked 1279 Write 5 Done New Done true
1770 281 Acked 1280 Write 3 Done New Done true
1771 282 Acked 1281 Read 8 Done New Done true
1772 283 Acked 1282 Write 4 Done New Done true
1773 284 Acked 1283 Read 10 Done New Done true
1774 285 Acked 1284 Read 2 Done New Done true
1775 286 Acked 1285 Write 3 Done New Done true
1776 287 Acked 1286 Write 2 Done New Done true
1777 288 Acked 1287 Read 3 Done New Done true
1778 289 Acked 1288 Flush 0 Done New Done true
1779 290 Acked 1289 Write 7 Done New Done true
1780 291 Acked 1290 Read 9 Done New Done true
1781 292 Acked 1291 Write 10 Done New Done true
1782 293 Acked 1292 Read 7 Done New Done true
1783 294 Acked 1293 Read 3 Done New Done true
1784 295 Acked 1294 Write 9 Done New Done true
1785 296 Acked 1295 Read 8 Done New Done true
1786 297 Acked 1296 Write 6 Done New Done true
1787 298 Acked 1297 Read 6 Done New Done true
1788 299 Acked 1298 Write 1 Done New Done true
1789 300 Acked 1299 Write 9 Done New Done true
1790 301 Acked 1300 Flush 0 Done New Done true
1791 STATES DS:0 DS:1 DS:2 TOTAL
1792 New 0 301 0 301
1793 Sent 0 0 0 0
1794 Done 301 0 301 602
1795 Skipped 0 0 0 0
1796 Error 0 0 0 0
1797 Last Flush: 1300 0 1300
1798 Downstairs last five completed:
1799 Upstairs last five completed: 301 300 299 298 297
1800 CLIENT: Up:0 ds:301 act:2
18012024-04-20T01:05:28.016ZINFOcrucible: connecting to 127.0.0.1:8820 = io task client = 1 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
18022024-04-20T01:05:28.016ZINFOcrucible: ds_connection connected from Ok(127.0.0.1:62044) = io task client = 1 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
18032024-04-20T01:05:28.017ZINFOcrucible: downstairs client at Some(127.0.0.1:8820) has region UUID 12345678-0000-0000-0000-000000008820 = downstairs client = 1 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
18042024-04-20T01:05:28.017ZINFOcrucible: Returning UUID:12345678-0000-0000-0000-000000008820 matches = downstairs client = 1 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
18052024-04-20T01:05:28.017ZINFOcrucible: send last flush ID to this DS: 0 = downstairs client = 1 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
18062024-04-20T01:05:28.018ZINFOcrucible: Replied this last flush ID: 0 = downstairs client = 1 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
18072024-04-20T01:05:28.018ZINFOcrucible: ds_transition from Offline to Replay = downstairs client = 1 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
18082024-04-20T01:05:28.018ZINFOcrucible: [1] Transition from Offline to Replay = downstairs client = 1 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
18092024-04-20T01:05:28.018ZINFOcrucible: ds_transition from Replay to Active = downstairs client = 1 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
18102024-04-20T01:05:28.018ZINFOcrucible: [1] Transition from Replay to Active = downstairs client = 1 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
1811 ----------------------------------------------------------------
1812 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:0
1813 Downstairs last five completed: 1300 1299 1298 1297 1296
1814 Upstairs last five completed: 301 300 299 298 297
1815 CLIENT: Up:0 ds:0 act:3
1816 Replay: All jobs finished, all DS active.
1817 Main task has work to do, go find it
1818 got dsc Stop(0)
1819 stop 0
1820 Apr 20 01:05:28.355 INFO request completed, latency_us: 338, response_code: 204, uri: /stop/cid/0, method: POST, req_id: 26605ebd-f9da-478d-bb79-c7730b7d96d2, remote_addr: 127.0.0.1:60352, local_addr: 127.0.[8810] Got stop action so:false kr:false
1821 0.1:9998
18222024-04-20T01:05:28.356ZWARNcrucible: downstairs disconnected = io task client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
18232024-04-20T01:05:28.356ZWARNcrucible: client task is sending Done(Finished) = io task client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
18242024-04-20T01:05:28.356ZWARNcrucible: downstairs task for 0 stopped due to Finished session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
18252024-04-20T01:05:28.356ZINFOcrucible: Gone missing, transition from Active to Offline = downstairs client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
18262024-04-20T01:05:28.356ZINFOcrucible: [0] client re-new 0 jobs since flush 1300 = downstairs session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
18272024-04-20T01:05:28.356ZINFOcrucible: [0] Marked 0 jobs for replay since flush: 1300 = downstairs session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
1828 Apr 20 01:05:28.356 INFO request completed, latency_us: {"msg":"client task is exiting","v":0,"name":"crucible","level":30,"time":"2024-04-20T01:05:28.356422926Z","hostname":"w-01HVWGBJP7HK0H9TQ26T6N3X8M","pid":1196,"":"io task","client":"0","":"downstairs","session_id":"132b460a-26a0-4532-b1ab-4f8c07d4c6c7"}
1829 124, response_code: 200, uri: /state/cid/0, method: GET, req_id: cf6bc34c-372a-4301-b557-70b6271bd0ac, remote_addr: 127.0.0.1:60352, local_addr: 127.0.0.1:9998
1830 [8810] Exited with: ExitStatus(unix_wait_status(9))
1831 [8810][0] reports Exit
1832 Apr 20 01:05:32.359 INFO request completed, latency_us: 184, response_code: 200, uri: /state/cid/0, method: GET, req_id: fe41e319-d20d-49ed-b323-ff9008ef9179, remote_addr: 127.0.0.1:60352, local_addr: 127.0.0.1:9998
1833 001/300 Read block 1220 len 20480
1834 002/300 Read block 321 len 36864
1835 003/300 Read block 4566 len 28672
1836 004/300 Read block 3279 len 12288
1837 005/300 Write block 4456 len 8192 data: 2 2
1838 006/300 Write block 2020 len 28672 data: 2 2 2 2 2 2 2
1839 007/300 Write block 3269 len 4096 data: 2
1840 008/300 Read block 1747 len 8192
1841 009/300 Read block 3445 len 28672
1842 010/300 Read block 3630 len 24576
1843 011/300 Read block 3135 len 36864
1844 012/300 Read block 2492 len 40960
1845 013/300 Write block 2391 len 36864 data: 3 3 3 2 2 2 2 2 2
1846 014/300 Write block 2089 len 36864 data: 2 2 2 2 2 2 2 2 2
1847 015/300 Read block 3677 len 4096
1848 016/300 Read block 3568 len 36864
1849 017/300 Write block 3441 len 8192 data: 2 2
1850 018/300 Read block 1225 len 4096
1851 019/300 Read block 4270 len 32768
1852 020/300 Read block 3457 len 40960
1853 021/300 Read block 4293 len 40960
1854 022/300 Write block 4042 len 24576 data: 2 2 2 2 2 2
1855 023/300 Read block 3074 len 40960
1856 024/300 Flush
1857 025/300 Write block 3400 len 8192 data: 2 2
1858 026/300 Write block 4723 len 16384 data: 2 2 2 2
1859 027/300 Flush
1860 028/300 Write block 4252 len 40960 data: 2 2 2 2 2 2 2 2 2 2
1861 029/300 Write block 2006 len 40960 data: 2 3 3 3 3 2 2 2 2 2
1862 030/300 Write block 1893 len 20480 data: 2 2 2 2 2
1863 031/300 Read block 904 len 28672
1864 032/300 Read block 4359 len 40960
1865 033/300 Write block 1667 len 40960 data: 3 3 2 2 2 2 2 2 2 2
1866 034/300 Write block 3899 len 8192 data: 2 2
1867 035/300 Read block 347 len 8192
1868 036/300 Write block 818 len 4096 data: 2
1869 037/300 Write block 3733 len 36864 data: 3 2 2 2 2 2 2 2 2
1870 038/300 Flush
1871 039/300 Read block 4269 len 20480
1872 040/300 Flush
1873 041/300 Read block 189 len 12288
1874 042/300 Write block 4001 len 16384 data: 3 3 3 3
1875 043/300 Write block 1243 len 8192 data: 3 3
1876 044/300 Write block 4896 len 4096 data: 2
1877 045/300 Write block 368 len 40960 data: 2 2 2 2 2 2 2 2 2 2
1878 046/300 Read block 472 len 20480
1879 047/300 Read block 1220 len 8192
1880 048/300 Write block 1172 len 20480 data: 2 2 2 2 2
1881 049/300 Write block 4867 len 36864 data: 2 2 2 2 2 2 2 2 2
1882 050/300 Read block 4226 len 16384
1883 051/300 Read block 3891 len 4096
1884 052/300 Read block 2667 len 8192
1885 053/300 Read block 4010 len 24576
1886 054/300 Flush
1887 055/300 Write block 2719 len 4096 data: 2
1888 056/300 Write block 1625 len 4096 data: 2
1889 057/300 Write block 1261 len 16384 data: 2 2 2 3
1890 058/300 Read block 4053 len 32768
1891 059/300 Read block 1450 len 36864
1892 060/300 Read block 4745 len 20480
1893 061/300 Write block 756 len 40960 data: 2 2 2 2 2 2 2 2 2 2
1894 062/300 Read block 4465 len 40960
1895 063/300 Read block 518 len 8192
1896 064/300 Read block 4028 len 16384
1897 065/300 Read block 3188 len 20480
1898 066/300 Write block 245 len 32768 data: 2 2 2 2 2 3 3 3
1899 067/300 Read block 1970 len 8192
1900 068/300 Read block 2482 len 32768
1901 069/300 Write block 645 len 4096 data: 2
1902 070/300 Read block 551 len 40960
1903 071/300 Write block 395 len 36864 data: 4 4 4 4 3 3 3 3 2
1904 072/300 Read block 4308 len 20480
1905 073/300 Flush
1906 074/300 Write block 4450 len 16384 data: 3 2 2 2
1907 075/300 Write block 4113 len 16384 data: 2 2 2 2
1908 076/300 Write block 3649 len 12288 data: 2 2 2
1909 077/300 Flush
1910 078/300 Read block 4382 len 36864
1911 079/300 Write block 1082 len 12288 data: 2 2 2
1912 080/300 Write block 414 len 40960 data: 2 2 2 2 2 2 2 2 2 2
1913 081/300 Write block 873 len 24576 data: 2 2 2 2 2 2
1914 082/300 Write block 1081 len 4096 data: 2
1915 083/300 Flush
1916 084/300 Flush
1917 085/300 Read block 1136 len 8192
1918 086/300 Read block 2145 len 28672
1919 087/300 Write block 4482 len 36864 data: 2 3 3 2 2 2 2 2 2
1920 088/300 Flush
1921 089/300 Read block 183 len 8192
1922 090/300 Write block 2081 len 4096 data: 2
1923 091/300 Read block 3665 len 28672
1924 092/300 Write block 2056 len 32768 data: 2 2 2 2 2 2 2 2
1925 093/300 Read block 1018 len 16384
1926 094/300 Read block 1626 len 32768
1927 095/300 Flush
1928 096/300 Write block 3003 len 32768 data: 2 2 2 2 2 2 2 2
1929 097/300 Write block 390 len 4096 data: 3
1930 098/300 Read block 4708 len 20480
1931 099/300 Read block 4531 len 20480
1932 100/300 Read block 1789 len 28672
1933 101/300 Read block 810 len 40960
1934 102/300 Read block 4882 len 16384
1935 103/300 Flush
1936 104/300 Read block 2254 len 28672
1937 105/300 Read block 3397 len 4096
1938 106/300 Read block 595 len 12288
1939 107/300 Read block 329 len 12288
1940 108/300 Read block 789 len 40960
1941 109/300 Read block 1039 len 28672
1942 110/300 Read block 509 len 32768
1943 111/300 Read block 1236 len 28672
1944 112/300 Write block 1530 len 16384 data: 2 2 2 2
1945 113/300 Read block 4415 len 40960
1946 114/300 Write block 1625 len 28672 data: 3 2 2 2 2 2 2
1947 115/300 Write block 4267 len 40960 data: 2 2 2 2 2 2 2 2 2 2
1948 116/300 Write block 3020 len 36864 data: 3 3 2 2 3 3 2 2 2
1949 117/300 Write block 3455 len 12288 data: 2 2 2
1950 118/300 Read block 2097 len 24576
1951 119/300 Read block 562 len 28672
1952 120/300 Write block 4872 len 32768 data: 3 3 3 3 2 2 2 2
1953 121/300 Write block 4199 len 16384 data: 3 3 3 3
1954 122/300 Write block 2221 len 20480 data: 2 2 2 2 2
1955 123/300 Read block 657 len 40960
1956 124/300 Write block 1121 len 28672 data: 2 2 2 2 2 2 2
1957 125/300 Read block 3898 len 32768
1958 126/300 Read block 3758 len 12288
1959 127/300 Read block 250 len 32768
1960 128/300 Write block 3038 len 4096 data: 2
1961 129/300 Write block 3515 len 32768 data: 2 2 2 2 2 2 2 2
1962 130/300 Write block 4950 len 4096 data: 2
1963 131/300 Read block 1135 len 40960
1964 132/300 Write block 2896 len 12288 data: 2 2 2
1965 133/300 Write block 2023 len 8192 data: 3 3
1966 134/300 Read block 946 len 16384
1967 135/300 Write block 846 len 16384 data: 2 2 2 2
1968 136/300 Write block 245 len 32768 data: 3 3 3 3 3 4 4 4
1969 137/300 Read block 1976 len 40960
1970 138/300 Write block 4730 len 36864 data: 2 2 2 2 2 2 2 2 4
1971 139/300 Write block 2108 len 4096 data: 2
1972 140/300 Write block 111 len 24576 data: 2 2 2 2 2 2
1973 141/300 Flush
1974 142/300 Read block 1452 len 12288
1975 143/300 Read block 4098 len 28672
1976 144/300 Write block 2086 len 28672 data: 2 2 2 3 3 3 3
1977 145/300 Flush
1978 146/300 Write block 4743 len 32768 data: 3 3 3 2 2 2 2 2
1979 147/300 Read block 2773 len 40960
1980 148/300 Read block 3112 len 24576
1981 149/300 Read block 2784 len 32768
1982 150/300 Write block 3426 len 32768 data: 2 2 2 2 2 3 3 3
1983 151/300 Write block 1359 len 32768 data: 2 2 2 2 2 2 2 2
1984 152/300 Read block 2059 len 4096
1985 153/300 Write block 2906 len 28672 data: 2 2 2 2 2 2 2
1986 154/300 Read block 1595 len 4096
1987 155/300 Read block 956 len 4096
1988 156/300 Read block 4242 len 36864
1989 157/300 Write block 275 len 24576 data: 2 2 3 3 3 2
1990 158/300 Read block 400 len 32768
1991 159/300 Write block 453 len 16384 data: 2 2 2 2
1992 160/300 Write block 2793 len 28672 data: 2 2 2 2 2 2 3
1993 161/300 Read block 2011 len 36864
1994 162/300 Read block 2198 len 28672
1995 163/300 Write block 4835 len 12288 data: 2 2 2
1996 164/300 Write block 430 len 12288 data: 2 2 2
1997 165/300 Write block 4482 len 16384 data: 3 4 4 3
1998 166/300 Flush
1999 167/300 Write block 4169 len 24576 data: 3 4 4 4 3 3
2000 168/300 Read block 1798 len 36864
2001 169/300 Read block 879 len 28672
2002 170/300 Read block 643 len 32768
2003 171/300 Write block 728 len 36864 data: 3 3 3 2 2 2 2 2 2
2004 172/300 Read block 1301 len 16384
2005 173/300 Write block 2169 len 40960 data: 2 2 2 2 2 2 2 2 2 2
2006 174/300 Read block 4677 len 12288
2007 175/300 Read block 3062 len 4096
2008 176/300 Read block 2445 len 4096
2009 177/300 Read block 1772 len 32768
2010 178/300 Write block 788 len 4096 data: 2
2011 179/300 Read block 1532 len 28672
2012 180/300 Read block 3294 len 36864
2013 181/300 Read block 2091 len 36864
2014 182/300 Flush
2015 183/300 Read block 4185 len 28672
2016 184/300 Write block 1654 len 16384 data: 3 2 2 2
2017 185/300 Write block 667 len 32768 data: 2 2 2 2 2 2 2 2
2018 186/300 Write block 4472 len 28672 data: 2 2 2 2 2 2 2
2019 187/300 Write block 3514 len 36864 data: 2 3 3 3 3 3 3 3 3
2020 188/300 Read block 280 len 36864
2021 189/300 Read block 1707 len 20480
2022 190/300 Read block 1740 len 28672
2023 191/300 Write block 3884 len 8192 data: 2 2
2024 192/300 Read block 1493 len 8192
2025 193/300 Read block 3021 len 20480
2026 194/300 Read block 4274 len 8192
2027 195/300 Read block 1598 len 24576
2028 196/300 Write block 1826 len 16384 data: 2 2 2 2
2029 197/300 Read block 2103 len 20480
2030 198/300 Read block 4618 len 4096
2031 199/300 Read block 4577 len 8192
2032 200/300 Write block 4917 len 8192 data: 2 2
2033 201/300 Read block 1355 len 20480
2034 202/300 Read block 3548 len 36864
2035 203/300 Write block 4042 len 20480 data: 3 3 3 3 3
2036 204/300 Write block 243 len 12288 data: 2 2 4
2037 205/300 Read block 288 len 36864
2038 206/300 Read block 4643 len 16384
2039 207/300 Write block 4079 len 32768 data: 2 3 3 3 2 2 2 2
2040 208/300 Read block 876 len 8192
2041 209/300 Write block 4819 len 20480 data: 3 3 3 3 3
2042 210/300 Write block 2994 len 40960 data: 3 2 2 2 2 2 2 2 2 3
2043 211/300 Write block 4849 len 40960 data: 2 2 2 2 2 2 2 2 2 2
2044 212/300 Write block 4902 len 24576 data: 2 2 2 2 2 2
2045 213/300 Write block 2064 len 24576 data: 2 2 2 2 2 2
2046 214/300 Read block 3591 len 12288
2047 215/300 Write block 4780 len 4096 data: 2
2048 216/300 Write block 1516 len 28672 data: 2 2 2 2 2 2 2
2049 217/300 Flush
2050 218/300 Flush
2051 219/300 Read block 2775 len 12288
2052 220/300 Read block 1010 len 36864
2053 221/300 Read block 2379 len 16384
2054 222/300 Read block 2626 len 28672
2055 223/300 Read block 336 len 8192
2056 224/300 Read block 2205 len 40960
2057 225/300 Write block 2536 len 28672 data: 2 2 2 2 2 2 2
2058 226/300 Write block 696 len 20480 data: 2 2 2 2 2
2059 227/300 Write block 3705 len 20480 data: 2 2 2 2 2
2060 228/300 Read block 1783 len 40960
2061 229/300 Write block 4916 len 32768 data: 2 3 3 2 2 2 2 2
2062 230/300 Read block 4632 len 8192
2063 231/300 Read block 4732 len 8192
2064 232/300 Read block 4836 len 20480
2065 233/300 Read block 2002 len 24576
2066 234/300 Write block 2765 len 20480 data: 2 2 2 2 2
2067 235/300 Read block 4640 len 28672
2068 236/300 Read block 4672 len 36864
2069 237/300 Read block 2631 len 40960
2070 238/300 Write block 4053 len 16384 data: 2 2 2 2
2071 239/300 Read block 3847 len 4096
2072 240/300 Write block 1090 len 36864 data: 2 2 2 2 2 2 2 2 2
2073 241/300 Flush
2074 242/300 Read block 2956 len 32768
2075 243/300 Flush
2076 244/300 Read block 2782 len 4096
2077 245/300 Read block 505 len 32768
2078 246/300 Write block 3406 len 28672 data: 2 2 2 2 2 3 3
2079 247/300 Read block 4820 len 36864
2080 248/300 Read block 1998 len 28672
2081 249/300 Read block 1400 len 40960
2082 250/300 Flush
2083 251/300 Flush
2084 252/300 Read block 2680 len 20480
2085 253/300 Read block 1589 len 28672
2086 254/300 Flush
2087 255/300 Read block 822 len 40960
2088 256/300 Write block 1778 len 8192 data: 3 2
2089 257/300 Write block 4769 len 24576 data: 2 2 2 2 2 2
2090 258/300 Write block 2203 len 12288 data: 2 2 2
2091 259/300 Write block 3870 len 8192 data: 3 3
2092 260/300 Read block 4694 len 8192
2093 261/300 Read block 2467 len 8192
2094 262/300 Write block 1707 len 32768 data: 2 2 2 2 2 2 2 2
2095 263/300 Flush
2096 264/300 Read block 1949 len 20480
2097 265/300 Write block 2264 len 4096 data: 3
2098 266/300 Read block 1943 len 32768
2099 267/300 Read block 3070 len 12288
2100 268/300 Read block 399 len 24576
2101 269/300 Read block 2237 len 16384
2102 270/300 Write block 1380 len 12288 data: 2 2 2
2103 271/300 Write block 267 len 16384 data: 2 2 2 2
2104 272/300 Read block 4110 len 20480
2105 273/300 Write block 3917 len 16384 data: 2 2 2 2
2106 274/300 Read block 3073 len 32768
2107 275/300 Read block 3719 len 20480
2108 276/300 Read block 357 len 32768
2109 277/300 Write block 1004 len 4096 data: 2
2110 278/300 Write block 81 len 4096 data: 2
2111 279/300 Read block 702 len 12288
2112 280/300 Write block 4701 len 28672 data: 2 2 2 2 2 2 2
2113 281/300 Write block 3415 len 24576 data: 2 2 2 2 2 2
2114 282/300 Write block 3118 len 4096 data: 2
2115 283/300 Read block 3801 len 24576
2116 284/300 Read block 3421 len 40960
2117 285/300 Write block 3424 len 16384 data: 2 2 3 3
2118 286/300 Read block 2535 len 28672
2119 287/300 Read block 3843 len 24576
2120 288/300 Write block 3178 len 32768 data: 3 3 3 3 3 3 3 3
2121 289/300 Read block 3577 len 24576
2122 290/300 Read block 501 len 40960
2123 291/300 Read block 1730 len 20480
2124 292/300 Read block 3975 len 4096
2125 293/300 Read block 3208 len 32768
2126 294/300 Read block 3321 len 32768
2127 295/300 Read block 4852 len 36864
2128 296/300 Read block 370 len 36864
2129 297/300 Write block 2962 len 32768 data: 2 2 2 2 2 2 2 2
2130 298/300 Write block 2302 len 16384 data: 2 2 2 2
2131 299/300 Flush
2132 300/300 Write block 1542 len 36864 data: 2 2 2 2 3 3 2 2 2
2133 Main task has work to do, go find it
2134 got dsc Start(0)
2135 start 0
2136 Apr 20 01:05:32.663 INFO request completed, latency_us: 207, response_code: 204, uri: /start/cid/0, method: POST, req_id: bc70bba8-d305-4017-bbce-d5698c4a1a5f, remote_addr: 127.0.0.1:60352, local_addr: 127.0.0.1:9998
2137 Replay: started 0, returned:Ok(())
2138 ----------------------------------------------------------------
2139 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:301
2140 States: Offline Active Active
2141 GW_ID ACK DSID TYPE BLOCKS DS:0 DS:1 DS:2 REPLAY
2142 302 Acked 1301 Read 5 New Done Done false
2143 303 Acked 1302 Read 9 New Done Done false
2144 304 Acked 1303 Read 7 New Done Done false
2145 305 Acked 1304 Read 3 New Done Done false
2146 306 Acked 1305 Write 2 New Done Done false
2147 307 Acked 1306 Write 7 New Done Done false
2148 308 Acked 1307 Write 1 New Done Done false
2149 309 Acked 1308 Read 2 New Done Done false
2150 310 Acked 1309 Read 7 New Done Done false
2151 311 Acked 1310 Read 6 New Done Done false
2152 312 Acked 1311 Read 9 New Done Done false
2153 313 Acked 1312 Read 10 New Done Done false
2154 314 Acked 1313 Write 9 New Done Done false
2155 315 Acked 1314 Write 9 New Done Done false
2156 316 Acked 1315 Read 1 New Done Done false
2157 317 Acked 1316 Read 9 New Done Done false
2158 318 Acked 1317 Write 2 New Done Done false
2159 319 Acked 1318 Read 1 New Done Done false
2160 320 Acked 1319 Read 8 New Done Done false
2161 321 Acked 1320 Read 10 New Done Done false
2162 322 Acked 1321 Read 10 New Done Done false
2163 323 Acked 1322 Write 6 New Done Done false
2164 324 Acked 1323 Read 10 New Done Done false
2165 325 Acked 1324 Flush 0 New Done Done false
2166 326 Acked 1325 Write 2 New Done Done false
2167 327 Acked 1326 Write 4 New Done Done false
2168 328 Acked 1327 Flush 0 New Done Done false
2169 329 Acked 1328 Write 10 New Done Done false
2170 330 Acked 1329 Write 10 New Done Done false
2171 331 Acked 1330 Write 5 New Done Done false
2172 332 Acked 1331 Read 7 New Done Done false
2173 333 Acked 1332 Read 10 New Done Done false
2174 334 Acked 1333 Write 10 New Done Done false
2175 335 Acked 1334 Write 2 New Done Done false
2176 336 Acked 1335 Read 2 New Done Done false
2177 337 Acked 1336 Write 1 New Done Done false
2178 338 Acked 1337 Write 9 New Done Done false
2179 339 Acked 1338 Flush 0 New Done Done false
2180 340 Acked 1339 Read 5 New Done Done false
2181 341 Acked 1340 Flush 0 New Done Done false
2182 342 Acked 1341 Read 3 New Done Done false
2183 343 Acked 1342 Write 4 New Done Done false
2184 344 Acked 1343 Write 2 New Done Done false
2185 345 Acked 1344 Write 1 New Done Done false
2186 346 Acked 1345 Write 10 New Done Done false
2187 347 Acked 1346 Read 5 New Done Done false
2188 348 Acked 1347 Read 2 New Done Done false
2189 349 Acked 1348 Write 5 New Done Done false
2190 350 Acked 1349 Write 9 New Done Done false
2191 351 Acked 1350 Read 4 New Done Done false
2192 352 Acked 1351 Read 1 New Done Done false
2193 353 Acked 1352 Read 2 New Done Done false
2194 354 Acked 1353 Read 6 New Done Done false
2195 355 Acked 1354 Flush 0 New Done Done false
2196 356 Acked 1355 Write 1 New Done Done false
2197 357 Acked 1356 Write 1 New Done Done false
2198 358 Acked 1357 Write 4 New Done Done false
2199 359 Acked 1358 Read 8 New Done Done false
2200 360 Acked 1359 Read 9 New Done Done false
2201 361 Acked 1360 Read 5 New Done Done false
2202 362 Acked 1361 Write 10 New Done Done false
2203 363 Acked 1362 Read 10 New Done Done false
2204 364 Acked 1363 Read 2 New Done Done false
2205 365 Acked 1364 Read 4 New Done Done false
2206 366 Acked 1365 Read 5 New Done Done false
2207 367 Acked 1366 Write 8 New Done Done false
2208 368 Acked 1367 Read 2 New Done Done false
2209 369 Acked 1368 Read 8 New Done Done false
2210 370 Acked 1369 Write 1 New Done Done false
2211 371 Acked 1370 Read 10 New Done Done false
2212 372 Acked 1371 Write 9 New Done Done false
2213 373 Acked 1372 Read 5 New Done Done false
2214 374 Acked 1373 Flush 0 New Done Done false
2215 375 Acked 1374 Write 4 New Done Done false
2216 376 Acked 1375 Write 4 New Done Done false
2217 377 Acked 1376 Write 3 New Done Done false
2218 378 Acked 1377 Flush 0 New Done Done false
2219 379 Acked 1378 Read 9 New Done Done false
2220 380 Acked 1379 Write 3 New Done Done false
2221 381 Acked 1380 Write 10 New Done Done false
2222 382 Acked 1381 Write 6 New Done Done false
2223 383 Acked 1382 Write 1 New Done Done false
2224 384 Acked 1383 Flush 0 New Done Done false
2225 385 Acked 1384 Flush 0 New Done Done false
2226 386 Acked 1385 Read 2 New Done Done false
2227 387 Acked 1386 Read 7 New Done Done false
2228 388 Acked 1387 Write 9 New Done Done false
2229 389 Acked 1388 Flush 0 New Done Done false
2230 390 Acked 1389 Read 2 New Done Done false
2231 391 Acked 1390 Write 1 New Done Done false
2232 392 Acked 1391 Read 7 New Done Done false
2233 393 Acked 1392 Write 8 New Done Done false
2234 394 Acked 1393 Read 4 New Done Done false
2235 395 Acked 1394 Read 8 New Done Done false
2236 396 Acked 1395 Flush 0 New Done Done false
2237 397 Acked 1396 Write 8 New Done Done false
2238 398 Acked 1397 Write 1 New Done Done false
2239 399 Acked 1398 Read 5 New Done Done false
2240 400 Acked 1399 Read 5 New Done Done false
2241 401 Acked 1400 Read 7 New Done Done false
2242 402 Acked 1401 Read 10 New Done Done false
2243 403 Acked 1402 Read 4 New Done Done false
2244 404 Acked 1403 Flush 0 New Done Done false
2245 405 Acked 1404 Read 7 New Done Done false
2246 406 Acked 1405 Read 1 New Done Done false
2247 407 Acked 1406 Read 3 New Done Done false
2248 408 Acked 1407 Read 3 New Done Done false
2249 409 Acked 1408 Read 10 New Done Done false
2250 410 Acked 1409 Read 7 New Done Done false
2251 411 Acked 1410 Read 8 New Done Done false
2252 412 Acked 1411 Read 7 New Done Done false
2253 413 Acked 1412 Write 4 New Done Done false
2254 414 Acked 1413 Read 10 New Done Done false
2255 415 Acked 1414 Write 7 New Done Done false
2256 416 Acked 1415 Write 10 New Done Done false
2257 417 Acked 1416 Write 9 New Done Done false
2258 418 Acked 1417 Write 3 New Done Done false
2259 419 Acked 1418 Read 6 New Done Done false
2260 420 Acked 1419 Read 7 New Done Done false
2261 421 Acked 1420 Write 8 New Done Done false
2262 422 Acked 1421 Write 4 New Done Done false
2263 423 Acked 1422 Write 5 New Done Done false
2264 424 Acked 1423 Read 10 New Done Done false
2265 425 Acked 1424 Write 7 New Done Done false
2266 426 Acked 1425 Read 8 New Done Done false
2267 427 Acked 1426 Read 3 New Done Done false
2268 428 Acked 1427 Read 8 New Done Done false
2269 429 Acked 1428 Write 1 New Done Done false
2270 430 Acked 1429 Write 8 New Done Done false
2271 431 Acked 1430 Write 1 New Done Done false
2272 432 Acked 1431 Read 10 New Done Done false
2273 433 Acked 1432 Write 3 New Done Done false
2274 434 Acked 1433 Write 2 New Done Done false
2275 435 Acked 1434 Read 4 New Done Done false
2276 436 Acked 1435 Write 4 New Done Done false
2277 437 Acked 1436 Write 8 New Done Done false
2278 438 Acked 1437 Read 10 New Done Done false
2279 439 Acked 1438 Write 9 New Done Done false
2280 440 Acked 1439 Write 1 New Done Done false
2281 441 Acked 1440 Write 6 New Done Done false
2282 442 Acked 1441 Flush 0 New Done Done false
2283 443 Acked 1442 Read 3 New Done Done false
2284 444 Acked 1443 Read 7 New Done Done false
2285 445 Acked 1444 Write 7 New Done Done false
2286 446 Acked 1445 Flush 0 New Done Done false
2287 447 Acked 1446 Write 8 New Done Done false
2288 448 Acked 1447 Read 10 New Done Done false
2289 449 Acked 1448 Read 6 New Done Done false
2290 450 Acked 1449 Read 8 New Done Done false
2291 451 Acked 1450 Flush 0 New Done Done false
2292 452 Acked 1451 Write 8 New Done Done false
2293 453 Acked 1452 Write 8 New Done Done false
2294 454 Acked 1453 Read 1 New Done Done false
2295 455 Acked 1454 Write 7 New Done Done false
2296 456 Acked 1455 Read 1 New Done Done false
2297 457 Acked 1456 Read 1 New Done Done false
2298 458 Acked 1457 Read 9 New Done Done false
2299 459 Acked 1458 Write 6 New Done Done false
2300 460 Acked 1459 Read 8 New Done Done false
2301 461 Acked 1460 Write 4 New Done Done false
2302 462 Acked 1461 Write 7 New Done Done false
2303 463 Acked 1462 Read 9 New Done Done false
2304 464 Acked 1463 Read 7 New Done Done false
2305 465 Acked 1464 Write 3 New Done Done false
2306 466 Acked 1465 Write 3 New Done Done false
2307 467 Acked 1466 Write 4 New Done Done false
2308 468 Acked 1467 Flush 0 New Done Done false
2309 469 Acked 1468 Write 6 New Done Done false
2310 470 Acked 1469 Read 9 New Done Done false
2311 471 Acked 1470 Read 7 New Done Done false
2312 472 Acked 1471 Read 8 New Done Done false
2313 473 Acked 1472 Write 9 New Done Done false
2314 474 Acked 1473 Read 4 New Done Done false
2315 475 Acked 1474 Write 10 New Done Done false
2316 476 Acked 1475 Read 3 New Done Done false
2317 477 Acked 1476 Read 1 New Done Done false
2318 478 Acked 1477 Read 1 New Done Done false
2319 479 Acked 1478 Read 8 New Done Done false
2320 480 Acked 1479 Write 1 New Done Done false
2321 481 Acked 1480 Read 7 New Done Done false
2322 482 Acked 1481 Read 9 New Done Done false
2323 483 Acked 1482 Read 9 New Done Done false
2324 484 Acked 1483 Flush 0 New Done Done false
2325 485 Acked 1484 Read 7 New Done Done false
2326 486 Acked 1485 Write 4 New Done Done false
2327 487 Acked 1486 Write 8 New Done Done false
2328 488 Acked 1487 Write 7 New Done Done false
2329 489 Acked 1488 Write 9 New Done Done false
2330 490 Acked 1489 Read 9 New Done Done false
2331 491 Acked 1490 Read 5 New Done Done false
2332 492 Acked 1491 Read 7 New Done Done false
2333 493 Acked 1492 Write 2 New Done Done false
2334 494 Acked 1493 Read 2 New Done Done false
2335 495 Acked 1494 Read 5 New Done Done false
2336 496 Acked 1495 Read 2 New Done Done false
2337 497 Acked 1496 Read 6 New Done Done false
2338 498 Acked 1497 Write 4 New Done Done false
2339 499 Acked 1498 Read 5 New Done Done false
2340 500 Acked 1499 Read 1 New Done Done false
2341 501 Acked 1500 Read 2 New Done Done false
2342 502 Acked 1501 Write 2 New Done Done false
2343 503 Acked 1502 Read 5 New Done Done false
2344 504 Acked 1503 Read 9 New Done Done false
2345 505 Acked 1504 Write 5 New Done Done false
2346 506 Acked 1505 Write 3 New Done Done false
2347 507 Acked 1506 Read 9 New Done Done false
2348 508 Acked 1507 Read 4 New Done Done false
2349 509 Acked 1508 Write 8 New Done Done false
2350 510 Acked 1509 Read 2 New Done Done false
2351 511 Acked 1510 Write 5 New Done Done false
2352 512 Acked 1511 Write 10 New Done Done false
2353 513 Acked 1512 Write 10 New Done Done false
2354 514 Acked 1513 Write 6 New Done Done false
2355 515 Acked 1514 Write 6 New Done Done false
2356 516 Acked 1515 Read 3 New Done Done false
2357 517 Acked 1516 Write 1 New Done Done false
2358 518 Acked 1517 Write 7 New Done Done false
2359 519 Acked 1518 Flush 0 New Done Done false
2360 520 Acked 1519 Flush 0 New Done Done false
2361 521 Acked 1520 Read 3 New Done Done false
2362 522 Acked 1521 Read 9 New Done Done false
2363 523 Acked 1522 Read 4 New Done Done false
2364 524 Acked 1523 Read 7 New Done Done false
2365 525 Acked 1524 Read 2 New Done Done false
2366 526 Acked 1525 Read 10 New Done Done false
2367 527 Acked 1526 Write 7 New Done Done false
2368 528 Acked 1527 Write 5 New Done Done false
2369 529 Acked 1528 Write 5 New Done Done false
2370 530 Acked 1529 Read 10 New Done Done false
2371 531 Acked 1530 Write 8 New Done Done false
2372 532 Acked 1531 Read 2 New Done Done false
2373 533 Acked 1532 Read 2 New Done Done false
2374 534 Acked 1533 Read 5 New Done Done false
2375 535 Acked 1534 Read 6 New Done Done false
2376 536 Acked 1535 Write 5 New Done Done false
2377 537 Acked 1536 Read 7 New Done Done false
2378 538 Acked 1537 Read 9 New Done Done false
2379 539 Acked 1538 Read 10 New Done Done false
2380 540 Acked 1539 Write 4 New Done Done false
2381 541 Acked 1540 Read 1 New Done Done false
2382 542 Acked 1541 Write 9 New Done Done false
2383 543 Acked 1542 Flush 0 New Done Done false
2384 544 Acked 1543 Read 8 New Done Done false
2385 545 Acked 1544 Flush 0 New Done Done false
2386 546 Acked 1545 Read 1 New Done Done false
2387 547 Acked 1546 Read 8 New Done Done false
2388 548 Acked 1547 Write 7 New Done Done false
2389 549 Acked 1548 Read 9 New Done Done false
2390 550 Acked 1549 Read 7 New Done Done false
2391 551 Acked 1550 Read 10 New Done Done false
2392 552 Acked 1551 Flush 0 New Done Done false
2393 553 Acked 1552 Flush 0 New Done Done false
2394 554 Acked 1553 Read 5 New Done Done false
2395 555 Acked 1554 Read 7 New Done Done false
2396 556 Acked 1555 Flush 0 New Done Done false
2397 557 Acked 1556 Read 10 New Done Done false
2398 558 Acked 1557 Write 2 New Done Done false
2399 559 Acked 1558 Write 6 New Done Done false
2400 560 Acked 1559 Write 3 New Done Done false
2401 561 Acked 1560 Write 2 New Done Done false
2402 562 Acked 1561 Read 2 New Done Done false
2403 563 Acked 1562 Read 2 New Done Done false
2404 564 Acked 1563 Write 8 New Done Done false
2405 565 Acked 1564 Flush 0 New Done Done false
2406 566 Acked 1565 Read 5 New Done Done false
2407 567 Acked 1566 Write 1 New Done Done false
2408 568 Acked 1567 Read 8 New Done Done false
2409 569 Acked 1568 Read 3 New Done Done false
2410 570 Acked 1569 Read 6 New Done Done false
2411 571 Acked 1570 Read 4 New Done Done false
2412 572 Acked 1571 Write 3 New Done Done false
2413 573 Acked 1572 Write 4 New Done Done false
2414 574 Acked 1573 Read 5 New Done Done false
2415 575 Acked 1574 Write 4 New Done Done false
2416 576 Acked 1575 Read 8 New Done Done false
2417 577 Acked 1576 Read 5 New Done Done false
2418 578 Acked 1577 Read 8 New Done Done false
2419 579 Acked 1578 Write 1 New Done Done false
2420 580 Acked 1579 Write 1 New Done Done false
2421 581 Acked 1580 Read 3 New Done Done false
2422 582 Acked 1581 Write 7 New Done Done false
2423 583 Acked 1582 Write 6 New Done Done false
2424 584 Acked 1583 Write 1 New Done Done false
2425 585 Acked 1584 Read 6 New Done Done false
2426 586 Acked 1585 Read 10 New Done Done false
2427 587 Acked 1586 Write 4 New Done Done false
2428 588 Acked 1587 Read 7 New Done Done false
2429 589 Acked 1588 Read 6 New Done Done false
2430 590 Acked 1589 Write 8 New Done Done false
2431 591 Acked 1590 Read 6 New Done Done false
2432 592 Acked 1591 Read 10 New Done Done false
2433 593 Acked 1592 Read 5 New Done Done false
2434 594 Acked 1593 Read 1 New Done Done false
2435 595 Acked 1594 Read 8 New Done Done false
2436 596 Acked 1595 Read 8 New Done Done false
2437 597 Acked 1596 Read 9 New Done Done false
2438 598 Acked 1597 Read 9 New Done Done false
2439 599 Acked 1598 Write 8 New Done Done false
2440 600 Acked 1599 Write 4 New Done Done false
2441 601 Acked 1600 Flush 0 New Done Done false
2442 602 Acked 1601 Write 9 New Done Done false
2443 STATES DS:0 DS:1 DS:2 TOTAL
2444 New 301 0 0 301
2445 Sent 0 0 0 0
2446 Done 0 301 301 602
2447 Skipped 0 0 0 0
2448 Error 0 0 0 0
2449 Last Flush: 1300 1600 1600
2450 Downstairs last five completed: 1300 1299 1298 1297 1296
2451 Upstairs last five completed: 602 601 600 599 598
2452 CLIENT: Up:0 ds:301 act:2
2453 ----------------------------------------------------------------
2454 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:302
2455 States: Offline Active Active
2456 GW_ID ACK DSID TYPE BLOCKS DS:0 DS:1 DS:2 REPLAY
2457 302 Acked 1301 Read 5 New Done Done false
2458 303 Acked 1302 Read 9 New Done Done false
2459 304 Acked 1303 Read 7 New Done Done false
2460 305 Acked 1304 Read 3 New Done Done false
2461 306 Acked 1305 Write 2 New Done Done false
2462 307 Acked 1306 Write 7 New Done Done false
2463 308 Acked 1307 Write 1 New Done Done false
2464 309 Acked 1308 Read 2 New Done Done false
2465 310 Acked 1309 Read 7 New Done Done false
2466 311 Acked 1310 Read 6 New Done Done false
2467 312 Acked 1311 Read 9 New Done Done false
2468 313 Acked 1312 Read 10 New Done Done false
2469 314 Acked 1313 Write 9 New Done Done false
2470 315 Acked 1314 Write 9 New Done Done false
2471 316 Acked 1315 Read 1 New Done Done false
2472 317 Acked 1316 Read 9 New Done Done false
2473 318 Acked 1317 Write 2 New Done Done false
2474 319 Acked 1318 Read 1 New Done Done false
2475 320 Acked 1319 Read 8 New Done Done false
2476 321 Acked 1320 Read 10 New Done Done false
2477 322 Acked 1321 Read 10 New Done Done false
2478 323 Acked 1322 Write 6 New Done Done false
2479 324 Acked 1323 Read 10 New Done Done false
2480 325 Acked 1324 Flush 0 New Done Done false
2481 326 Acked 1325 Write 2 New Done Done false
2482 327 Acked 1326 Write 4 New Done Done false
2483 328 Acked 1327 Flush 0 New Done Done false
2484 329 Acked 1328 Write 10 New Done Done false
2485 330 Acked 1329 Write 10 New Done Done false
2486 331 Acked 1330 Write 5 New Done Done false
2487 332 Acked 1331 Read 7 New Done Done false
2488 333 Acked 1332 Read 10 New Done Done false
2489 334 Acked 1333 Write 10 New Done Done false
2490 335 Acked 1334 Write 2 New Done Done false
2491 336 Acked 1335 Read 2 New Done Done false
2492 337 Acked 1336 Write 1 New Done Done false
2493 338 Acked 1337 Write 9 New Done Done false
2494 339 Acked 1338 Flush 0 New Done Done false
2495 340 Acked 1339 Read 5 New Done Done false
2496 341 Acked 1340 Flush 0 New Done Done false
2497 342 Acked 1341 Read 3 New Done Done false
2498 343 Acked 1342 Write 4 New Done Done false
2499 344 Acked 1343 Write 2 New Done Done false
2500 345 Acked 1344 Write 1 New Done Done false
2501 346 Acked 1345 Write 10 New Done Done false
2502 347 Acked 1346 Read 5 New Done Done false
2503 348 Acked 1347 Read 2 New Done Done false
2504 349 Acked 1348 Write 5 New Done Done false
2505 350 Acked 1349 Write 9 New Done Done false
2506 351 Acked 1350 Read 4 New Done Done false
2507 352 Acked 1351 Read 1 New Done Done false
2508 353 Acked 1352 Read 2 New Done Done false
2509 354 Acked 1353 Read 6 New Done Done false
2510 355 Acked 1354 Flush 0 New Done Done false
2511 356 Acked 1355 Write 1 New Done Done false
2512 357 Acked 1356 Write 1 New Done Done false
2513 358 Acked 1357 Write 4 New Done Done false
2514 359 Acked 1358 Read 8 New Done Done false
2515 360 Acked 1359 Read 9 New Done Done false
2516 361 Acked 1360 Read 5 New Done Done false
2517 362 Acked 1361 Write 10 New Done Done false
2518 363 Acked 1362 Read 10 New Done Done false
2519 364 Acked 1363 Read 2 New Done Done false
2520 365 Acked 1364 Read 4 New Done Done false
2521 366 Acked 1365 Read 5 New Done Done false
2522 367 Acked 1366 Write 8 New Done Done false
2523 368 Acked 1367 Read 2 New Done Done false
2524 369 Acked 1368 Read 8 New Done Done false
2525 370 Acked 1369 Write 1 New Done Done false
2526 371 Acked 1370 Read 10 New Done Done false
2527 372 Acked 1371 Write 9 New Done Done false
2528 373 Acked 1372 Read 5 New Done Done false
2529 374 Acked 1373 Flush 0 New Done Done false
2530 375 Acked 1374 Write 4 New Done Done false
2531 376 Acked 1375 Write 4 New Done Done false
2532 377 Acked 1376 Write 3 New Done Done false
2533 378 Acked 1377 Flush 0 New Done Done false
2534 379 Acked 1378 Read 9 New Done Done false
2535 380 Acked 1379 Write 3 New Done Done false
2536 381 Acked 1380 Write 10 New Done Done false
2537 382 Acked 1381 Write 6 New Done Done false
2538 383 Acked 1382 Write 1 New Done Done false
2539 384 Acked 1383 Flush 0 New Done Done false
2540 385 Acked 1384 Flush 0 New Done Done false
2541 386 Acked 1385 Read 2 New Done Done false
2542 387 Acked 1386 Read 7 New Done Done false
2543 388 Acked 1387 Write 9 New Done Done false
2544 389 Acked 1388 Flush 0 New Done Done false
2545 390 Acked 1389 Read 2 New Done Done false
2546 391 Acked 1390 Write 1 New Done Done false
2547 392 Acked 1391 Read 7 New Done Done false
2548 393 Acked 1392 Write 8 New Done Done false
2549 394 Acked 1393 Read 4 New Done Done false
2550 395 Acked 1394 Read 8 New Done Done false
2551 396 Acked 1395 Flush 0 New Done Done false
2552 397 Acked 1396 Write 8 New Done Done false
2553 398 Acked 1397 Write 1 New Done Done false
2554 399 Acked 1398 Read 5 New Done Done false
2555 400 Acked 1399 Read 5 New Done Done false
2556 401 Acked 1400 Read 7 New Done Done false
2557 402 Acked 1401 Read 10 New Done Done false
2558 403 Acked 1402 Read 4 New Done Done false
2559 404 Acked 1403 Flush 0 New Done Done false
2560 405 Acked 1404 Read 7 New Done Done false
2561 406 Acked 1405 Read 1 New Done Done false
2562 407 Acked 1406 Read 3 New Done Done false
2563 408 Acked 1407 Read 3 New Done Done false
2564 409 Acked 1408 Read 10 New Done Done false
2565 410 Acked 1409 Read 7 New Done Done false
2566 411 Acked 1410 Read 8 New Done Done false
2567 412 Acked 1411 Read 7 New Done Done false
2568 413 Acked 1412 Write 4 New Done Done false
2569 414 Acked 1413 Read 10 New Done Done false
2570 415 Acked 1414 Write 7 New Done Done false
2571 416 Acked 1415 Write 10 New Done Done false
2572 417 Acked 1416 Write 9 New Done Done false
2573 418 Acked 1417 Write 3 New Done Done false
2574 419 Acked 1418 Read 6 New Done Done false
2575 420 Acked 1419 Read 7 New Done Done false
2576 421 Acked 1420 Write 8 New Done Done false
2577 422 Acked 1421 Write 4 New Done Done false
2578 423 Acked 1422 Write 5 New Done Done false
2579 424 Acked 1423 Read 10 New Done Done false
2580 425 Acked 1424 Write 7 New Done Done false
2581 426 Acked 1425 Read 8 New Done Done false
2582 427 Acked 1426 Read 3 New Done Done false
2583 428 Acked 1427 Read 8 New Done Done false
2584 429 Acked 1428 Write 1 New Done Done false
2585 430 Acked 1429 Write 8 New Done Done false
2586 431 Acked 1430 Write 1 New Done Done false
2587 432 Acked 1431 Read 10 New Done Done false
2588 433 Acked 1432 Write 3 New Done Done false
2589 434 Acked 1433 Write 2 New Done Done false
2590 435 Acked 1434 Read 4 New Done Done false
2591 436 Acked 1435 Write 4 New Done Done false
2592 437 Acked 1436 Write 8 New Done Done false
2593 438 Acked 1437 Read 10 New Done Done false
2594 439 Acked 1438 Write 9 New Done Done false
2595 440 Acked 1439 Write 1 New Done Done false
2596 441 Acked 1440 Write 6 New Done Done false
2597 442 Acked 1441 Flush 0 New Done Done false
2598 443 Acked 1442 Read 3 New Done Done false
2599 444 Acked 1443 Read 7 New Done Done false
2600 445 Acked 1444 Write 7 New Done Done false
2601 446 Acked 1445 Flush 0 New Done Done false
2602 447 Acked 1446 Write 8 New Done Done false
2603 448 Acked 1447 Read 10 New Done Done false
2604 449 Acked 1448 Read 6 New Done Done false
2605 450 Acked 1449 Read 8 New Done Done false
2606 451 Acked 1450 Flush 0 New Done Done false
2607 452 Acked 1451 Write 8 New Done Done false
2608 453 Acked 1452 Write 8 New Done Done false
2609 454 Acked 1453 Read 1 New Done Done false
2610 455 Acked 1454 Write 7 New Done Done false
2611 456 Acked 1455 Read 1 New Done Done false
2612 457 Acked 1456 Read 1 New Done Done false
2613 458 Acked 1457 Read 9 New Done Done false
2614 459 Acked 1458 Write 6 New Done Done false
2615 460 Acked 1459 Read 8 New Done Done false
2616 461 Acked 1460 Write 4 New Done Done false
2617 462 Acked 1461 Write 7 New Done Done false
2618 463 Acked 1462 Read 9 New Done Done false
2619 464 Acked 1463 Read 7 New Done Done false
2620 465 Acked 1464 Write 3 New Done Done false
2621 466 Acked 1465 Write 3 New Done Done false
2622 467 Acked 1466 Write 4 New Done Done false
2623 468 Acked 1467 Flush 0 New Done Done false
2624 469 Acked 1468 Write 6 New Done Done false
2625 470 Acked 1469 Read 9 New Done Done false
2626 471 Acked 1470 Read 7 New Done Done false
2627 472 Acked 1471 Read 8 New Done Done false
2628 473 Acked 1472 Write 9 New Done Done false
2629 474 Acked 1473 Read 4 New Done Done false
2630 475 Acked 1474 Write 10 New Done Done false
2631 476 Acked 1475 Read 3 New Done Done false
2632 477 Acked 1476 Read 1 New Done Done false
2633 478 Acked 1477 Read 1 New Done Done false
2634 479 Acked 1478 Read 8 New Done Done false
2635 480 Acked 1479 Write 1 New Done Done false
2636 481 Acked 1480 Read 7 New Done Done false
2637 482 Acked 1481 Read 9 New Done Done false
2638 483 Acked 1482 Read 9 New Done Done false
2639 484 Acked 1483 Flush 0 New Done Done false
2640 485 Acked 1484 Read 7 New Done Done false
2641 486 Acked 1485 Write 4 New Done Done false
2642 487 Acked 1486 Write 8 New Done Done false
2643 488 Acked 1487 Write 7 New Done Done false
2644 489 Acked 1488 Write 9 New Done Done false
2645 490 Acked 1489 Read 9 New Done Done false
2646 491 Acked 1490 Read 5 New Done Done false
2647 492 Acked 1491 Read 7 New Done Done false
2648 493 Acked 1492 Write 2 New Done Done false
2649 494 Acked 1493 Read 2 New Done Done false
2650 495 Acked 1494 Read 5 New Done Done false
2651 496 Acked 1495 Read 2 New Done Done false
2652 497 Acked 1496 Read 6 New Done Done false
2653 498 Acked 1497 Write 4 New Done Done false
2654 499 Acked 1498 Read 5 New Done Done false
2655 500 Acked 1499 Read 1 New Done Done false
2656 501 Acked 1500 Read 2 New Done Done false
2657 502 Acked 1501 Write 2 New Done Done false
2658 503 Acked 1502 Read 5 New Done Done false
2659 504 Acked 1503 Read 9 New Done Done false
2660 505 Acked 1504 Write 5 New Done Done false
2661 506 Acked 1505 Write 3 New Done Done false
2662 507 Acked 1506 Read 9 New Done Done false
2663 508 Acked 1507 Read 4 New Done Done false
2664 509 Acked 1508 Write 8 New Done Done false
2665 510 Acked 1509 Read 2 New Done Done false
2666 511 Acked 1510 Write 5 New Done Done false
2667 512 Acked 1511 Write 10 New Done Done false
2668 513 Acked 1512 Write 10 New Done Done false
2669 514 Acked 1513 Write 6 New Done Done false
2670 515 Acked 1514 Write 6 New Done Done false
2671 516 Acked 1515 Read 3 New Done Done false
2672 517 Acked 1516 Write 1 New Done Done false
2673 518 Acked 1517 Write 7 New Done Done false
2674 519 Acked 1518 Flush 0 New Done Done false
2675 520 Acked 1519 Flush 0 New Done Done false
2676 521 Acked 1520 Read 3 New Done Done false
2677 522 Acked 1521 Read 9 New Done Done false
2678 523 Acked 1522 Read 4 New Done Done false
2679 524 Acked 1523 Read 7 New Done Done false
2680 525 Acked 1524 Read 2 New Done Done false
2681 526 Acked 1525 Read 10 New Done Done false
2682 527 Acked 1526 Write 7 New Done Done false
2683 528 Acked 1527 Write 5 New Done Done false
2684 529 Acked 1528 Write 5 New Done Done false
2685 530 Acked 1529 Read 10 New Done Done false
2686 531 Acked 1530 Write 8 New Done Done false
2687 532 Acked 1531 Read 2 New Done Done false
2688 533 Acked 1532 Read 2 New Done Done false
2689 534 Acked 1533 Read 5 New Done Done false
2690 535 Acked 1534 Read 6 New Done Done false
2691 536 Acked 1535 Write 5 New Done Done false
2692 537 Acked 1536 Read 7 New Done Done false
2693 538 Acked 1537 Read 9 New Done Done false
2694 539 Acked 1538 Read 10 New Done Done false
2695 540 Acked 1539 Write 4 New Done Done false
2696 541 Acked 1540 Read 1 New Done Done false
2697 542 Acked 1541 Write 9 New Done Done false
2698 543 Acked 1542 Flush 0 New Done Done false
2699 544 Acked 1543 Read 8 New Done Done false
2700 545 Acked 1544 Flush 0 New Done Done false
2701 546 Acked 1545 Read 1 New Done Done false
2702 547 Acked 1546 Read 8 New Done Done false
2703 548 Acked 1547 Write 7 New Done Done false
2704 549 Acked 1548 Read 9 New Done Done false
2705 550 Acked 1549 Read 7 New Done Done false
2706 551 Acked 1550 Read 10 New Done Done false
2707 552 Acked 1551 Flush 0 New Done Done false
2708 553 Acked 1552 Flush 0 New Done Done false
2709 554 Acked 1553 Read 5 New Done Done false
2710 555 Acked 1554 Read 7 New Done Done false
2711 556 Acked 1555 Flush 0 New Done Done false
2712 557 Acked 1556 Read 10 New Done Done false
2713 558 Acked 1557 Write 2 New Done Done false
2714 559 Acked 1558 Write 6 New Done Done false
2715 560 Acked 1559 Write 3 New Done Done false
2716 561 Acked 1560 Write 2 New Done Done false
2717 562 Acked 1561 Read 2 New Done Done false
2718 563 Acked 1562 Read 2 New Done Done false
2719 564 Acked 1563 Write 8 New Done Done false
2720 565 Acked 1564 Flush 0 New Done Done false
2721 566 Acked 1565 Read 5 New Done Done false
2722 567 Acked 1566 Write 1 New Done Done false
2723 568 Acked 1567 Read 8 New Done Done false
2724 569 Acked 1568 Read 3 New Done Done false
2725 570 Acked 1569 Read 6 New Done Done false
2726 571 Acked 1570 Read 4 New Done Done false
2727 572 Acked 1571 Write 3 New Done Done false
2728 573 Acked 1572 Write 4 New Done Done false
2729 574 Acked 1573 Read 5 New Done Done false
2730 575 Acked 1574 Write 4 New Done Done false
2731 576 Acked 1575 Read 8 New Done Done false
2732 577 Acked 1576 Read 5 New Done Done false
2733 578 Acked 1577 Read 8 New Done Done false
2734 579 Acked 1578 Write 1 New Done Done false
2735 580 Acked 1579 Write 1 New Done Done false
2736 581 Acked 1580 Read 3 New Done Done false
2737 582 Acked 1581 Write 7 New Done Done false
2738 583 Acked 1582 Write 6 New Done Done false
2739 584 Acked 1583 Write 1 New Done Done false
2740 585 Acked 1584 Read 6 New Done Done false
2741 586 Acked 1585 Read 10 New Done Done false
2742 587 Acked 1586 Write 4 New Done Done false
2743 588 Acked 1587 Read 7 New Done Done false
2744 589 Acked 1588 Read 6 New Done Done false
2745 590 Acked 1589 Write 8 New Done Done false
2746 591 Acked 1590 Read 6 New Done Done false
2747 592 Acked 1591 Read 10 New Done Done false
2748 593 Acked 1592 Read 5 New Done Done false
2749 594 Acked 1593 Read 1 New Done Done false
2750 595 Acked 1594 Read 8 New Done Done false
2751 596 Acked 1595 Read 8 New Done Done false
2752 597 Acked 1596 Read 9 New Done Done false
2753 598 Acked 1597 Read 9 New Done Done false
2754 599 Acked 1598 Write 8 New Done Done false
2755 600 Acked 1599 Write 4 New Done Done false
2756 601 Acked 1600 Flush 0 New Done Done false
2757 602 Acked 1601 Write 9 New Done Done false
2758 603 Acked 1602 Flush 0 New Done Done false
2759 STATES DS:0 DS:1 DS:2 TOTAL
2760 New 302 0 0 302
2761 Sent 0 0 0 0
2762 Done 0 302 302 604
2763 Skipped 0 0 0 0
2764 Error 0 0 0 0
2765 Last Flush: 1300 1602 1602
2766 Downstairs last five completed: 1300 1299 1298 1297 1296
2767 Upstairs last five completed: 603 602 601 600 599
2768 CLIENT: Up:0 ds:302 act:2
27692024-04-20T01:05:38.357ZINFOcrucible: connecting to 127.0.0.1:8810 = io task client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
27702024-04-20T01:05:38.357ZWARNcrucible: ds_connection connect to 127.0.0.1:8810 failure: Os { code: 146, kind: ConnectionRefused, message: "Connection refused" } = io task client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
27712024-04-20T01:05:38.357ZWARNcrucible: client task is sending Done(ConnectionFailed(Os { code: 146, kind: ConnectionRefused, message: "Connection refused" })) = io task client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
27722024-04-20T01:05:38.357ZWARNcrucible: downstairs task for 0 stopped due to ConnectionFailed(Os { code: 146, kind: ConnectionRefused, message: "Connection refused" }) session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
27732024-04-20T01:05:38.357ZINFOcrucible: [0] client re-new 302 jobs since flush 1300 = downstairs session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
27742024-04-20T01:05:38.357ZINFOcrucible: [0] Marked 0 jobs for replay since flush: 1300 = downstairs session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
27752024-04-20T01:05:38.357ZINFOcrucible: client task is exiting = io task client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
2776 [8810] got start action
2777 [8810] I am going to restart
2778 Starting downstairs at port 8810
2779 Make output file at "/tmp/dsc/downstairs-8810.txt"
2780 [8810][0] reports Starting
2781 Downstairs /var/tmp/dsc/region/8810 port 8810 PID:Some(1198)
2782 [8810][0] reports Running
2783 ----------------------------------------------------------------
2784 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:302
2785 States: Offline Active Active
2786 GW_ID ACK DSID TYPE BLOCKS DS:0 DS:1 DS:2 REPLAY
2787 302 Acked 1301 Read 5 New Done Done true
2788 303 Acked 1302 Read 9 New Done Done true
2789 304 Acked 1303 Read 7 New Done Done true
2790 305 Acked 1304 Read 3 New Done Done true
2791 306 Acked 1305 Write 2 New Done Done true
2792 307 Acked 1306 Write 7 New Done Done true
2793 308 Acked 1307 Write 1 New Done Done true
2794 309 Acked 1308 Read 2 New Done Done true
2795 310 Acked 1309 Read 7 New Done Done true
2796 311 Acked 1310 Read 6 New Done Done true
2797 312 Acked 1311 Read 9 New Done Done true
2798 313 Acked 1312 Read 10 New Done Done true
2799 314 Acked 1313 Write 9 New Done Done true
2800 315 Acked 1314 Write 9 New Done Done true
2801 316 Acked 1315 Read 1 New Done Done true
2802 317 Acked 1316 Read 9 New Done Done true
2803 318 Acked 1317 Write 2 New Done Done true
2804 319 Acked 1318 Read 1 New Done Done true
2805 320 Acked 1319 Read 8 New Done Done true
2806 321 Acked 1320 Read 10 New Done Done true
2807 322 Acked 1321 Read 10 New Done Done true
2808 323 Acked 1322 Write 6 New Done Done true
2809 324 Acked 1323 Read 10 New Done Done true
2810 325 Acked 1324 Flush 0 New Done Done true
2811 326 Acked 1325 Write 2 New Done Done true
2812 327 Acked 1326 Write 4 New Done Done true
2813 328 Acked 1327 Flush 0 New Done Done true
2814 329 Acked 1328 Write 10 New Done Done true
2815 330 Acked 1329 Write 10 New Done Done true
2816 331 Acked 1330 Write 5 New Done Done true
2817 332 Acked 1331 Read 7 New Done Done true
2818 333 Acked 1332 Read 10 New Done Done true
2819 334 Acked 1333 Write 10 New Done Done true
2820 335 Acked 1334 Write 2 New Done Done true
2821 336 Acked 1335 Read 2 New Done Done true
2822 337 Acked 1336 Write 1 New Done Done true
2823 338 Acked 1337 Write 9 New Done Done true
2824 339 Acked 1338 Flush 0 New Done Done true
2825 340 Acked 1339 Read 5 New Done Done true
2826 341 Acked 1340 Flush 0 New Done Done true
2827 342 Acked 1341 Read 3 New Done Done true
2828 343 Acked 1342 Write 4 New Done Done true
2829 344 Acked 1343 Write 2 New Done Done true
2830 345 Acked 1344 Write 1 New Done Done true
2831 346 Acked 1345 Write 10 New Done Done true
2832 347 Acked 1346 Read 5 New Done Done true
2833 348 Acked 1347 Read 2 New Done Done true
2834 349 Acked 1348 Write 5 New Done Done true
2835 350 Acked 1349 Write 9 New Done Done true
2836 351 Acked 1350 Read 4 New Done Done true
2837 352 Acked 1351 Read 1 New Done Done true
2838 353 Acked 1352 Read 2 New Done Done true
2839 354 Acked 1353 Read 6 New Done Done true
2840 355 Acked 1354 Flush 0 New Done Done true
2841 356 Acked 1355 Write 1 New Done Done true
2842 357 Acked 1356 Write 1 New Done Done true
2843 358 Acked 1357 Write 4 New Done Done true
2844 359 Acked 1358 Read 8 New Done Done true
2845 360 Acked 1359 Read 9 New Done Done true
2846 361 Acked 1360 Read 5 New Done Done true
2847 362 Acked 1361 Write 10 New Done Done true
2848 363 Acked 1362 Read 10 New Done Done true
2849 364 Acked 1363 Read 2 New Done Done true
2850 365 Acked 1364 Read 4 New Done Done true
2851 366 Acked 1365 Read 5 New Done Done true
2852 367 Acked 1366 Write 8 New Done Done true
2853 368 Acked 1367 Read 2 New Done Done true
2854 369 Acked 1368 Read 8 New Done Done true
2855 370 Acked 1369 Write 1 New Done Done true
2856 371 Acked 1370 Read 10 New Done Done true
2857 372 Acked 1371 Write 9 New Done Done true
2858 373 Acked 1372 Read 5 New Done Done true
2859 374 Acked 1373 Flush 0 New Done Done true
2860 375 Acked 1374 Write 4 New Done Done true
2861 376 Acked 1375 Write 4 New Done Done true
2862 377 Acked 1376 Write 3 New Done Done true
2863 378 Acked 1377 Flush 0 New Done Done true
2864 379 Acked 1378 Read 9 New Done Done true
2865 380 Acked 1379 Write 3 New Done Done true
2866 381 Acked 1380 Write 10 New Done Done true
2867 382 Acked 1381 Write 6 New Done Done true
2868 383 Acked 1382 Write 1 New Done Done true
2869 384 Acked 1383 Flush 0 New Done Done true
2870 385 Acked 1384 Flush 0 New Done Done true
2871 386 Acked 1385 Read 2 New Done Done true
2872 387 Acked 1386 Read 7 New Done Done true
2873 388 Acked 1387 Write 9 New Done Done true
2874 389 Acked 1388 Flush 0 New Done Done true
2875 390 Acked 1389 Read 2 New Done Done true
2876 391 Acked 1390 Write 1 New Done Done true
2877 392 Acked 1391 Read 7 New Done Done true
2878 393 Acked 1392 Write 8 New Done Done true
2879 394 Acked 1393 Read 4 New Done Done true
2880 395 Acked 1394 Read 8 New Done Done true
2881 396 Acked 1395 Flush 0 New Done Done true
2882 397 Acked 1396 Write 8 New Done Done true
2883 398 Acked 1397 Write 1 New Done Done true
2884 399 Acked 1398 Read 5 New Done Done true
2885 400 Acked 1399 Read 5 New Done Done true
2886 401 Acked 1400 Read 7 New Done Done true
2887 402 Acked 1401 Read 10 New Done Done true
2888 403 Acked 1402 Read 4 New Done Done true
2889 404 Acked 1403 Flush 0 New Done Done true
2890 405 Acked 1404 Read 7 New Done Done true
2891 406 Acked 1405 Read 1 New Done Done true
2892 407 Acked 1406 Read 3 New Done Done true
2893 408 Acked 1407 Read 3 New Done Done true
2894 409 Acked 1408 Read 10 New Done Done true
2895 410 Acked 1409 Read 7 New Done Done true
2896 411 Acked 1410 Read 8 New Done Done true
2897 412 Acked 1411 Read 7 New Done Done true
2898 413 Acked 1412 Write 4 New Done Done true
2899 414 Acked 1413 Read 10 New Done Done true
2900 415 Acked 1414 Write 7 New Done Done true
2901 416 Acked 1415 Write 10 New Done Done true
2902 417 Acked 1416 Write 9 New Done Done true
2903 418 Acked 1417 Write 3 New Done Done true
2904 419 Acked 1418 Read 6 New Done Done true
2905 420 Acked 1419 Read 7 New Done Done true
2906 421 Acked 1420 Write 8 New Done Done true
2907 422 Acked 1421 Write 4 New Done Done true
2908 423 Acked 1422 Write 5 New Done Done true
2909 424 Acked 1423 Read 10 New Done Done true
2910 425 Acked 1424 Write 7 New Done Done true
2911 426 Acked 1425 Read 8 New Done Done true
2912 427 Acked 1426 Read 3 New Done Done true
2913 428 Acked 1427 Read 8 New Done Done true
2914 429 Acked 1428 Write 1 New Done Done true
2915 430 Acked 1429 Write 8 New Done Done true
2916 431 Acked 1430 Write 1 New Done Done true
2917 432 Acked 1431 Read 10 New Done Done true
2918 433 Acked 1432 Write 3 New Done Done true
2919 434 Acked 1433 Write 2 New Done Done true
2920 435 Acked 1434 Read 4 New Done Done true
2921 436 Acked 1435 Write 4 New Done Done true
2922 437 Acked 1436 Write 8 New Done Done true
2923 438 Acked 1437 Read 10 New Done Done true
2924 439 Acked 1438 Write 9 New Done Done true
2925 440 Acked 1439 Write 1 New Done Done true
2926 441 Acked 1440 Write 6 New Done Done true
2927 442 Acked 1441 Flush 0 New Done Done true
2928 443 Acked 1442 Read 3 New Done Done true
2929 444 Acked 1443 Read 7 New Done Done true
2930 445 Acked 1444 Write 7 New Done Done true
2931 446 Acked 1445 Flush 0 New Done Done true
2932 447 Acked 1446 Write 8 New Done Done true
2933 448 Acked 1447 Read 10 New Done Done true
2934 449 Acked 1448 Read 6 New Done Done true
2935 450 Acked 1449 Read 8 New Done Done true
2936 451 Acked 1450 Flush 0 New Done Done true
2937 452 Acked 1451 Write 8 New Done Done true
2938 453 Acked 1452 Write 8 New Done Done true
2939 454 Acked 1453 Read 1 New Done Done true
2940 455 Acked 1454 Write 7 New Done Done true
2941 456 Acked 1455 Read 1 New Done Done true
2942 457 Acked 1456 Read 1 New Done Done true
2943 458 Acked 1457 Read 9 New Done Done true
2944 459 Acked 1458 Write 6 New Done Done true
2945 460 Acked 1459 Read 8 New Done Done true
2946 461 Acked 1460 Write 4 New Done Done true
2947 462 Acked 1461 Write 7 New Done Done true
2948 463 Acked 1462 Read 9 New Done Done true
2949 464 Acked 1463 Read 7 New Done Done true
2950 465 Acked 1464 Write 3 New Done Done true
2951 466 Acked 1465 Write 3 New Done Done true
2952 467 Acked 1466 Write 4 New Done Done true
2953 468 Acked 1467 Flush 0 New Done Done true
2954 469 Acked 1468 Write 6 New Done Done true
2955 470 Acked 1469 Read 9 New Done Done true
2956 471 Acked 1470 Read 7 New Done Done true
2957 472 Acked 1471 Read 8 New Done Done true
2958 473 Acked 1472 Write 9 New Done Done true
2959 474 Acked 1473 Read 4 New Done Done true
2960 475 Acked 1474 Write 10 New Done Done true
2961 476 Acked 1475 Read 3 New Done Done true
2962 477 Acked 1476 Read 1 New Done Done true
2963 478 Acked 1477 Read 1 New Done Done true
2964 479 Acked 1478 Read 8 New Done Done true
2965 480 Acked 1479 Write 1 New Done Done true
2966 481 Acked 1480 Read 7 New Done Done true
2967 482 Acked 1481 Read 9 New Done Done true
2968 483 Acked 1482 Read 9 New Done Done true
2969 484 Acked 1483 Flush 0 New Done Done true
2970 485 Acked 1484 Read 7 New Done Done true
2971 486 Acked 1485 Write 4 New Done Done true
2972 487 Acked 1486 Write 8 New Done Done true
2973 488 Acked 1487 Write 7 New Done Done true
2974 489 Acked 1488 Write 9 New Done Done true
2975 490 Acked 1489 Read 9 New Done Done true
2976 491 Acked 1490 Read 5 New Done Done true
2977 492 Acked 1491 Read 7 New Done Done true
2978 493 Acked 1492 Write 2 New Done Done true
2979 494 Acked 1493 Read 2 New Done Done true
2980 495 Acked 1494 Read 5 New Done Done true
2981 496 Acked 1495 Read 2 New Done Done true
2982 497 Acked 1496 Read 6 New Done Done true
2983 498 Acked 1497 Write 4 New Done Done true
2984 499 Acked 1498 Read 5 New Done Done true
2985 500 Acked 1499 Read 1 New Done Done true
2986 501 Acked 1500 Read 2 New Done Done true
2987 502 Acked 1501 Write 2 New Done Done true
2988 503 Acked 1502 Read 5 New Done Done true
2989 504 Acked 1503 Read 9 New Done Done true
2990 505 Acked 1504 Write 5 New Done Done true
2991 506 Acked 1505 Write 3 New Done Done true
2992 507 Acked 1506 Read 9 New Done Done true
2993 508 Acked 1507 Read 4 New Done Done true
2994 509 Acked 1508 Write 8 New Done Done true
2995 510 Acked 1509 Read 2 New Done Done true
2996 511 Acked 1510 Write 5 New Done Done true
2997 512 Acked 1511 Write 10 New Done Done true
2998 513 Acked 1512 Write 10 New Done Done true
2999 514 Acked 1513 Write 6 New Done Done true
3000 515 Acked 1514 Write 6 New Done Done true
3001 516 Acked 1515 Read 3 New Done Done true
3002 517 Acked 1516 Write 1 New Done Done true
3003 518 Acked 1517 Write 7 New Done Done true
3004 519 Acked 1518 Flush 0 New Done Done true
3005 520 Acked 1519 Flush 0 New Done Done true
3006 521 Acked 1520 Read 3 New Done Done true
3007 522 Acked 1521 Read 9 New Done Done true
3008 523 Acked 1522 Read 4 New Done Done true
3009 524 Acked 1523 Read 7 New Done Done true
3010 525 Acked 1524 Read 2 New Done Done true
3011 526 Acked 1525 Read 10 New Done Done true
3012 527 Acked 1526 Write 7 New Done Done true
3013 528 Acked 1527 Write 5 New Done Done true
3014 529 Acked 1528 Write 5 New Done Done true
3015 530 Acked 1529 Read 10 New Done Done true
3016 531 Acked 1530 Write 8 New Done Done true
3017 532 Acked 1531 Read 2 New Done Done true
3018 533 Acked 1532 Read 2 New Done Done true
3019 534 Acked 1533 Read 5 New Done Done true
3020 535 Acked 1534 Read 6 New Done Done true
3021 536 Acked 1535 Write 5 New Done Done true
3022 537 Acked 1536 Read 7 New Done Done true
3023 538 Acked 1537 Read 9 New Done Done true
3024 539 Acked 1538 Read 10 New Done Done true
3025 540 Acked 1539 Write 4 New Done Done true
3026 541 Acked 1540 Read 1 New Done Done true
3027 542 Acked 1541 Write 9 New Done Done true
3028 543 Acked 1542 Flush 0 New Done Done true
3029 544 Acked 1543 Read 8 New Done Done true
3030 545 Acked 1544 Flush 0 New Done Done true
3031 546 Acked 1545 Read 1 New Done Done true
3032 547 Acked 1546 Read 8 New Done Done true
3033 548 Acked 1547 Write 7 New Done Done true
3034 549 Acked 1548 Read 9 New Done Done true
3035 550 Acked 1549 Read 7 New Done Done true
3036 551 Acked 1550 Read 10 New Done Done true
3037 552 Acked 1551 Flush 0 New Done Done true
3038 553 Acked 1552 Flush 0 New Done Done true
3039 554 Acked 1553 Read 5 New Done Done true
3040 555 Acked 1554 Read 7 New Done Done true
3041 556 Acked 1555 Flush 0 New Done Done true
3042 557 Acked 1556 Read 10 New Done Done true
3043 558 Acked 1557 Write 2 New Done Done true
3044 559 Acked 1558 Write 6 New Done Done true
3045 560 Acked 1559 Write 3 New Done Done true
3046 561 Acked 1560 Write 2 New Done Done true
3047 562 Acked 1561 Read 2 New Done Done true
3048 563 Acked 1562 Read 2 New Done Done true
3049 564 Acked 1563 Write 8 New Done Done true
3050 565 Acked 1564 Flush 0 New Done Done true
3051 566 Acked 1565 Read 5 New Done Done true
3052 567 Acked 1566 Write 1 New Done Done true
3053 568 Acked 1567 Read 8 New Done Done true
3054 569 Acked 1568 Read 3 New Done Done true
3055 570 Acked 1569 Read 6 New Done Done true
3056 571 Acked 1570 Read 4 New Done Done true
3057 572 Acked 1571 Write 3 New Done Done true
3058 573 Acked 1572 Write 4 New Done Done true
3059 574 Acked 1573 Read 5 New Done Done true
3060 575 Acked 1574 Write 4 New Done Done true
3061 576 Acked 1575 Read 8 New Done Done true
3062 577 Acked 1576 Read 5 New Done Done true
3063 578 Acked 1577 Read 8 New Done Done true
3064 579 Acked 1578 Write 1 New Done Done true
3065 580 Acked 1579 Write 1 New Done Done true
3066 581 Acked 1580 Read 3 New Done Done true
3067 582 Acked 1581 Write 7 New Done Done true
3068 583 Acked 1582 Write 6 New Done Done true
3069 584 Acked 1583 Write 1 New Done Done true
3070 585 Acked 1584 Read 6 New Done Done true
3071 586 Acked 1585 Read 10 New Done Done true
3072 587 Acked 1586 Write 4 New Done Done true
3073 588 Acked 1587 Read 7 New Done Done true
3074 589 Acked 1588 Read 6 New Done Done true
3075 590 Acked 1589 Write 8 New Done Done true
3076 591 Acked 1590 Read 6 New Done Done true
3077 592 Acked 1591 Read 10 New Done Done true
3078 593 Acked 1592 Read 5 New Done Done true
3079 594 Acked 1593 Read 1 New Done Done true
3080 595 Acked 1594 Read 8 New Done Done true
3081 596 Acked 1595 Read 8 New Done Done true
3082 597 Acked 1596 Read 9 New Done Done true
3083 598 Acked 1597 Read 9 New Done Done true
3084 599 Acked 1598 Write 8 New Done Done true
3085 600 Acked 1599 Write 4 New Done Done true
3086 601 Acked 1600 Flush 0 New Done Done true
3087 602 Acked 1601 Write 9 New Done Done true
3088 603 Acked 1602 Flush 0 New Done Done true
3089 STATES DS:0 DS:1 DS:2 TOTAL
3090 New 302 0 0 302
3091 Sent 0 0 0 0
3092 Done 0 302 302 604
3093 Skipped 0 0 0 0
3094 Error 0 0 0 0
3095 Last Flush: 1300 1602 1602
3096 Downstairs last five completed: 1300 1299 1298 1297 1296
3097 Upstairs last five completed: 603 602 601 600 599
3098 CLIENT: Up:0 ds:302 act:2
3099 ----------------------------------------------------------------
3100 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:302
3101 States: Offline Active Active
3102 GW_ID ACK DSID TYPE BLOCKS DS:0 DS:1 DS:2 REPLAY
3103 302 Acked 1301 Read 5 New Done Done true
3104 303 Acked 1302 Read 9 New Done Done true
3105 304 Acked 1303 Read 7 New Done Done true
3106 305 Acked 1304 Read 3 New Done Done true
3107 306 Acked 1305 Write 2 New Done Done true
3108 307 Acked 1306 Write 7 New Done Done true
3109 308 Acked 1307 Write 1 New Done Done true
3110 309 Acked 1308 Read 2 New Done Done true
3111 310 Acked 1309 Read 7 New Done Done true
3112 311 Acked 1310 Read 6 New Done Done true
3113 312 Acked 1311 Read 9 New Done Done true
3114 313 Acked 1312 Read 10 New Done Done true
3115 314 Acked 1313 Write 9 New Done Done true
3116 315 Acked 1314 Write 9 New Done Done true
3117 316 Acked 1315 Read 1 New Done Done true
3118 317 Acked 1316 Read 9 New Done Done true
3119 318 Acked 1317 Write 2 New Done Done true
3120 319 Acked 1318 Read 1 New Done Done true
3121 320 Acked 1319 Read 8 New Done Done true
3122 321 Acked 1320 Read 10 New Done Done true
3123 322 Acked 1321 Read 10 New Done Done true
3124 323 Acked 1322 Write 6 New Done Done true
3125 324 Acked 1323 Read 10 New Done Done true
3126 325 Acked 1324 Flush 0 New Done Done true
3127 326 Acked 1325 Write 2 New Done Done true
3128 327 Acked 1326 Write 4 New Done Done true
3129 328 Acked 1327 Flush 0 New Done Done true
3130 329 Acked 1328 Write 10 New Done Done true
3131 330 Acked 1329 Write 10 New Done Done true
3132 331 Acked 1330 Write 5 New Done Done true
3133 332 Acked 1331 Read 7 New Done Done true
3134 333 Acked 1332 Read 10 New Done Done true
3135 334 Acked 1333 Write 10 New Done Done true
3136 335 Acked 1334 Write 2 New Done Done true
3137 336 Acked 1335 Read 2 New Done Done true
3138 337 Acked 1336 Write 1 New Done Done true
3139 338 Acked 1337 Write 9 New Done Done true
3140 339 Acked 1338 Flush 0 New Done Done true
3141 340 Acked 1339 Read 5 New Done Done true
3142 341 Acked 1340 Flush 0 New Done Done true
3143 342 Acked 1341 Read 3 New Done Done true
3144 343 Acked 1342 Write 4 New Done Done true
3145 344 Acked 1343 Write 2 New Done Done true
3146 345 Acked 1344 Write 1 New Done Done true
3147 346 Acked 1345 Write 10 New Done Done true
3148 347 Acked 1346 Read 5 New Done Done true
3149 348 Acked 1347 Read 2 New Done Done true
3150 349 Acked 1348 Write 5 New Done Done true
3151 350 Acked 1349 Write 9 New Done Done true
3152 351 Acked 1350 Read 4 New Done Done true
3153 352 Acked 1351 Read 1 New Done Done true
3154 353 Acked 1352 Read 2 New Done Done true
3155 354 Acked 1353 Read 6 New Done Done true
3156 355 Acked 1354 Flush 0 New Done Done true
3157 356 Acked 1355 Write 1 New Done Done true
3158 357 Acked 1356 Write 1 New Done Done true
3159 358 Acked 1357 Write 4 New Done Done true
3160 359 Acked 1358 Read 8 New Done Done true
3161 360 Acked 1359 Read 9 New Done Done true
3162 361 Acked 1360 Read 5 New Done Done true
3163 362 Acked 1361 Write 10 New Done Done true
3164 363 Acked 1362 Read 10 New Done Done true
3165 364 Acked 1363 Read 2 New Done Done true
3166 365 Acked 1364 Read 4 New Done Done true
3167 366 Acked 1365 Read 5 New Done Done true
3168 367 Acked 1366 Write 8 New Done Done true
3169 368 Acked 1367 Read 2 New Done Done true
3170 369 Acked 1368 Read 8 New Done Done true
3171 370 Acked 1369 Write 1 New Done Done true
3172 371 Acked 1370 Read 10 New Done Done true
3173 372 Acked 1371 Write 9 New Done Done true
3174 373 Acked 1372 Read 5 New Done Done true
3175 374 Acked 1373 Flush 0 New Done Done true
3176 375 Acked 1374 Write 4 New Done Done true
3177 376 Acked 1375 Write 4 New Done Done true
3178 377 Acked 1376 Write 3 New Done Done true
3179 378 Acked 1377 Flush 0 New Done Done true
3180 379 Acked 1378 Read 9 New Done Done true
3181 380 Acked 1379 Write 3 New Done Done true
3182 381 Acked 1380 Write 10 New Done Done true
3183 382 Acked 1381 Write 6 New Done Done true
3184 383 Acked 1382 Write 1 New Done Done true
3185 384 Acked 1383 Flush 0 New Done Done true
3186 385 Acked 1384 Flush 0 New Done Done true
3187 386 Acked 1385 Read 2 New Done Done true
3188 387 Acked 1386 Read 7 New Done Done true
3189 388 Acked 1387 Write 9 New Done Done true
3190 389 Acked 1388 Flush 0 New Done Done true
3191 390 Acked 1389 Read 2 New Done Done true
3192 391 Acked 1390 Write 1 New Done Done true
3193 392 Acked 1391 Read 7 New Done Done true
3194 393 Acked 1392 Write 8 New Done Done true
3195 394 Acked 1393 Read 4 New Done Done true
3196 395 Acked 1394 Read 8 New Done Done true
3197 396 Acked 1395 Flush 0 New Done Done true
3198 397 Acked 1396 Write 8 New Done Done true
3199 398 Acked 1397 Write 1 New Done Done true
3200 399 Acked 1398 Read 5 New Done Done true
3201 400 Acked 1399 Read 5 New Done Done true
3202 401 Acked 1400 Read 7 New Done Done true
3203 402 Acked 1401 Read 10 New Done Done true
3204 403 Acked 1402 Read 4 New Done Done true
3205 404 Acked 1403 Flush 0 New Done Done true
3206 405 Acked 1404 Read 7 New Done Done true
3207 406 Acked 1405 Read 1 New Done Done true
3208 407 Acked 1406 Read 3 New Done Done true
3209 408 Acked 1407 Read 3 New Done Done true
3210 409 Acked 1408 Read 10 New Done Done true
3211 410 Acked 1409 Read 7 New Done Done true
3212 411 Acked 1410 Read 8 New Done Done true
3213 412 Acked 1411 Read 7 New Done Done true
3214 413 Acked 1412 Write 4 New Done Done true
3215 414 Acked 1413 Read 10 New Done Done true
3216 415 Acked 1414 Write 7 New Done Done true
3217 416 Acked 1415 Write 10 New Done Done true
3218 417 Acked 1416 Write 9 New Done Done true
3219 418 Acked 1417 Write 3 New Done Done true
3220 419 Acked 1418 Read 6 New Done Done true
3221 420 Acked 1419 Read 7 New Done Done true
3222 421 Acked 1420 Write 8 New Done Done true
3223 422 Acked 1421 Write 4 New Done Done true
3224 423 Acked 1422 Write 5 New Done Done true
3225 424 Acked 1423 Read 10 New Done Done true
3226 425 Acked 1424 Write 7 New Done Done true
3227 426 Acked 1425 Read 8 New Done Done true
3228 427 Acked 1426 Read 3 New Done Done true
3229 428 Acked 1427 Read 8 New Done Done true
3230 429 Acked 1428 Write 1 New Done Done true
3231 430 Acked 1429 Write 8 New Done Done true
3232 431 Acked 1430 Write 1 New Done Done true
3233 432 Acked 1431 Read 10 New Done Done true
3234 433 Acked 1432 Write 3 New Done Done true
3235 434 Acked 1433 Write 2 New Done Done true
3236 435 Acked 1434 Read 4 New Done Done true
3237 436 Acked 1435 Write 4 New Done Done true
3238 437 Acked 1436 Write 8 New Done Done true
3239 438 Acked 1437 Read 10 New Done Done true
3240 439 Acked 1438 Write 9 New Done Done true
3241 440 Acked 1439 Write 1 New Done Done true
3242 441 Acked 1440 Write 6 New Done Done true
3243 442 Acked 1441 Flush 0 New Done Done true
3244 443 Acked 1442 Read 3 New Done Done true
3245 444 Acked 1443 Read 7 New Done Done true
3246 445 Acked 1444 Write 7 New Done Done true
3247 446 Acked 1445 Flush 0 New Done Done true
3248 447 Acked 1446 Write 8 New Done Done true
3249 448 Acked 1447 Read 10 New Done Done true
3250 449 Acked 1448 Read 6 New Done Done true
3251 450 Acked 1449 Read 8 New Done Done true
3252 451 Acked 1450 Flush 0 New Done Done true
3253 452 Acked 1451 Write 8 New Done Done true
3254 453 Acked 1452 Write 8 New Done Done true
3255 454 Acked 1453 Read 1 New Done Done true
3256 455 Acked 1454 Write 7 New Done Done true
3257 456 Acked 1455 Read 1 New Done Done true
3258 457 Acked 1456 Read 1 New Done Done true
3259 458 Acked 1457 Read 9 New Done Done true
3260 459 Acked 1458 Write 6 New Done Done true
3261 460 Acked 1459 Read 8 New Done Done true
3262 461 Acked 1460 Write 4 New Done Done true
3263 462 Acked 1461 Write 7 New Done Done true
3264 463 Acked 1462 Read 9 New Done Done true
3265 464 Acked 1463 Read 7 New Done Done true
3266 465 Acked 1464 Write 3 New Done Done true
3267 466 Acked 1465 Write 3 New Done Done true
3268 467 Acked 1466 Write 4 New Done Done true
3269 468 Acked 1467 Flush 0 New Done Done true
3270 469 Acked 1468 Write 6 New Done Done true
3271 470 Acked 1469 Read 9 New Done Done true
3272 471 Acked 1470 Read 7 New Done Done true
3273 472 Acked 1471 Read 8 New Done Done true
3274 473 Acked 1472 Write 9 New Done Done true
3275 474 Acked 1473 Read 4 New Done Done true
3276 475 Acked 1474 Write 10 New Done Done true
3277 476 Acked 1475 Read 3 New Done Done true
3278 477 Acked 1476 Read 1 New Done Done true
3279 478 Acked 1477 Read 1 New Done Done true
3280 479 Acked 1478 Read 8 New Done Done true
3281 480 Acked 1479 Write 1 New Done Done true
3282 481 Acked 1480 Read 7 New Done Done true
3283 482 Acked 1481 Read 9 New Done Done true
3284 483 Acked 1482 Read 9 New Done Done true
3285 484 Acked 1483 Flush 0 New Done Done true
3286 485 Acked 1484 Read 7 New Done Done true
3287 486 Acked 1485 Write 4 New Done Done true
3288 487 Acked 1486 Write 8 New Done Done true
3289 488 Acked 1487 Write 7 New Done Done true
3290 489 Acked 1488 Write 9 New Done Done true
3291 490 Acked 1489 Read 9 New Done Done true
3292 491 Acked 1490 Read 5 New Done Done true
3293 492 Acked 1491 Read 7 New Done Done true
3294 493 Acked 1492 Write 2 New Done Done true
3295 494 Acked 1493 Read 2 New Done Done true
3296 495 Acked 1494 Read 5 New Done Done true
3297 496 Acked 1495 Read 2 New Done Done true
3298 497 Acked 1496 Read 6 New Done Done true
3299 498 Acked 1497 Write 4 New Done Done true
3300 499 Acked 1498 Read 5 New Done Done true
3301 500 Acked 1499 Read 1 New Done Done true
3302 501 Acked 1500 Read 2 New Done Done true
3303 502 Acked 1501 Write 2 New Done Done true
3304 503 Acked 1502 Read 5 New Done Done true
3305 504 Acked 1503 Read 9 New Done Done true
3306 505 Acked 1504 Write 5 New Done Done true
3307 506 Acked 1505 Write 3 New Done Done true
3308 507 Acked 1506 Read 9 New Done Done true
3309 508 Acked 1507 Read 4 New Done Done true
3310 509 Acked 1508 Write 8 New Done Done true
3311 510 Acked 1509 Read 2 New Done Done true
3312 511 Acked 1510 Write 5 New Done Done true
3313 512 Acked 1511 Write 10 New Done Done true
3314 513 Acked 1512 Write 10 New Done Done true
3315 514 Acked 1513 Write 6 New Done Done true
3316 515 Acked 1514 Write 6 New Done Done true
3317 516 Acked 1515 Read 3 New Done Done true
3318 517 Acked 1516 Write 1 New Done Done true
3319 518 Acked 1517 Write 7 New Done Done true
3320 519 Acked 1518 Flush 0 New Done Done true
3321 520 Acked 1519 Flush 0 New Done Done true
3322 521 Acked 1520 Read 3 New Done Done true
3323 522 Acked 1521 Read 9 New Done Done true
3324 523 Acked 1522 Read 4 New Done Done true
3325 524 Acked 1523 Read 7 New Done Done true
3326 525 Acked 1524 Read 2 New Done Done true
3327 526 Acked 1525 Read 10 New Done Done true
3328 527 Acked 1526 Write 7 New Done Done true
3329 528 Acked 1527 Write 5 New Done Done true
3330 529 Acked 1528 Write 5 New Done Done true
3331 530 Acked 1529 Read 10 New Done Done true
3332 531 Acked 1530 Write 8 New Done Done true
3333 532 Acked 1531 Read 2 New Done Done true
3334 533 Acked 1532 Read 2 New Done Done true
3335 534 Acked 1533 Read 5 New Done Done true
3336 535 Acked 1534 Read 6 New Done Done true
3337 536 Acked 1535 Write 5 New Done Done true
3338 537 Acked 1536 Read 7 New Done Done true
3339 538 Acked 1537 Read 9 New Done Done true
3340 539 Acked 1538 Read 10 New Done Done true
3341 540 Acked 1539 Write 4 New Done Done true
3342 541 Acked 1540 Read 1 New Done Done true
3343 542 Acked 1541 Write 9 New Done Done true
3344 543 Acked 1542 Flush 0 New Done Done true
3345 544 Acked 1543 Read 8 New Done Done true
3346 545 Acked 1544 Flush 0 New Done Done true
3347 546 Acked 1545 Read 1 New Done Done true
3348 547 Acked 1546 Read 8 New Done Done true
3349 548 Acked 1547 Write 7 New Done Done true
3350 549 Acked 1548 Read 9 New Done Done true
3351 550 Acked 1549 Read 7 New Done Done true
3352 551 Acked 1550 Read 10 New Done Done true
3353 552 Acked 1551 Flush 0 New Done Done true
3354 553 Acked 1552 Flush 0 New Done Done true
3355 554 Acked 1553 Read 5 New Done Done true
3356 555 Acked 1554 Read 7 New Done Done true
3357 556 Acked 1555 Flush 0 New Done Done true
3358 557 Acked 1556 Read 10 New Done Done true
3359 558 Acked 1557 Write 2 New Done Done true
3360 559 Acked 1558 Write 6 New Done Done true
3361 560 Acked 1559 Write 3 New Done Done true
3362 561 Acked 1560 Write 2 New Done Done true
3363 562 Acked 1561 Read 2 New Done Done true
3364 563 Acked 1562 Read 2 New Done Done true
3365 564 Acked 1563 Write 8 New Done Done true
3366 565 Acked 1564 Flush 0 New Done Done true
3367 566 Acked 1565 Read 5 New Done Done true
3368 567 Acked 1566 Write 1 New Done Done true
3369 568 Acked 1567 Read 8 New Done Done true
3370 569 Acked 1568 Read 3 New Done Done true
3371 570 Acked 1569 Read 6 New Done Done true
3372 571 Acked 1570 Read 4 New Done Done true
3373 572 Acked 1571 Write 3 New Done Done true
3374 573 Acked 1572 Write 4 New Done Done true
3375 574 Acked 1573 Read 5 New Done Done true
3376 575 Acked 1574 Write 4 New Done Done true
3377 576 Acked 1575 Read 8 New Done Done true
3378 577 Acked 1576 Read 5 New Done Done true
3379 578 Acked 1577 Read 8 New Done Done true
3380 579 Acked 1578 Write 1 New Done Done true
3381 580 Acked 1579 Write 1 New Done Done true
3382 581 Acked 1580 Read 3 New Done Done true
3383 582 Acked 1581 Write 7 New Done Done true
3384 583 Acked 1582 Write 6 New Done Done true
3385 584 Acked 1583 Write 1 New Done Done true
3386 585 Acked 1584 Read 6 New Done Done true
3387 586 Acked 1585 Read 10 New Done Done true
3388 587 Acked 1586 Write 4 New Done Done true
3389 588 Acked 1587 Read 7 New Done Done true
3390 589 Acked 1588 Read 6 New Done Done true
3391 590 Acked 1589 Write 8 New Done Done true
3392 591 Acked 1590 Read 6 New Done Done true
3393 592 Acked 1591 Read 10 New Done Done true
3394 593 Acked 1592 Read 5 New Done Done true
3395 594 Acked 1593 Read 1 New Done Done true
3396 595 Acked 1594 Read 8 New Done Done true
3397 596 Acked 1595 Read 8 New Done Done true
3398 597 Acked 1596 Read 9 New Done Done true
3399 598 Acked 1597 Read 9 New Done Done true
3400 599 Acked 1598 Write 8 New Done Done true
3401 600 Acked 1599 Write 4 New Done Done true
3402 601 Acked 1600 Flush 0 New Done Done true
3403 602 Acked 1601 Write 9 New Done Done true
3404 603 Acked 1602 Flush 0 New Done Done true
3405 STATES DS:0 DS:1 DS:2 TOTAL
3406 New 302 0 0 302
3407 Sent 0 0 0 0
3408 Done 0 302 302 604
3409 Skipped 0 0 0 0
3410 Error 0 0 0 0
3411 Last Flush: 1300 1602 1602
3412 Downstairs last five completed: 1300 1299 1298 1297 1296
3413 Upstairs last five completed: 603 602 601 600 599
3414 CLIENT: Up:0 ds:302 act:2
34152024-04-20T01:05:48.357ZINFOcrucible: connecting to 127.0.0.1:8810 = io task client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
34162024-04-20T01:05:48.357ZINFOcrucible: ds_connection connected from Ok(127.0.0.1:63066) = io task client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
34172024-04-20T01:05:48.359ZINFOcrucible: downstairs client at Some(127.0.0.1:8810) has region UUID 12345678-0000-0000-0000-000000008810 = downstairs client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
34182024-04-20T01:05:48.359ZINFOcrucible: Returning UUID:12345678-0000-0000-0000-000000008810 matches = downstairs client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
34192024-04-20T01:05:48.359ZINFOcrucible: send last flush ID to this DS: 1300 = downstairs client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
34202024-04-20T01:05:48.359ZINFOcrucible: Replied this last flush ID: 1300 = downstairs client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
34212024-04-20T01:05:48.359ZINFOcrucible: ds_transition from Offline to Replay = downstairs client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
34222024-04-20T01:05:48.359ZINFOcrucible: [0] Transition from Offline to Replay = downstairs client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
34232024-04-20T01:05:48.359ZINFOcrucible: ds_transition from Replay to Active = downstairs client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
34242024-04-20T01:05:48.359ZINFOcrucible: [0] Transition from Replay to Active = downstairs client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
3425 ----------------------------------------------------------------
3426 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:0
3427 Downstairs last five completed: 1602 1601 1600 1599 1598
3428 Upstairs last five completed: 603 602 601 600 599
3429 CLIENT: Up:0 ds:0 act:3
3430 Replay: All jobs finished, all DS active.
3431 Main task has work to do, go find it
3432 got dsc Stop(2)
3433 stop 2
3434 Apr 20 01:05:48.672 INFO request completed, latency_us: 327, response_code: 204, uri: /stop/cid/2, method: [8830] Got stop action so:false kr:false
3435 POST, req_id: 58b7ad23-5037-4778-9885-c7abb72779f6, remote_addr: 127.0.0.1:60352, local_addr: 127.0.0.1:9998
34362024-04-20T01:05:48.673ZWARNcrucible: downstairs disconnected = io task client = 2 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
34372024-04-20T01:05:48.673ZWARNcrucible: client task is sending Done(Finished) = io task client = 2 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
34382024-04-20T01:05:48.673ZWARNcrucible: downstairs task for 2 stopped due to Finished session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
3439 Apr 20 01:05:48.673 INFO request completed, latency_us{"msg":"Gone missing, transition from Active to Offline","v":0,"name":"crucible","level":30,"time":"2024-04-20T01:05:48.673597012Z","hostname":"w-01HVWGBJP7HK0H9TQ26T6N3X8M","pid":1196,"client":"2","":"downstairs","session_id":"132b460a-26a0-4532-b1ab-4f8c07d4c6c7"}
3440 : 99, response_code: 200, uri{"msg":"[2] client re-new 0 jobs since flush 1602","v":0,"name":"crucible","level":30,"time":"2024-04-20T01:05:48.673640021Z","hostname":"w-01HVWGBJP7HK0H9TQ26T6N3X8M","pid":1196,"":"downstairs","":"downstairs","session_id":"132b460a-26a0-4532-b1ab-4f8c07d4c6c7"}
3441 : /state/cid/2, method: GET, {"msg":"[2] Marked 0 jobs for replay since flush: 1602","v":0,"name":"crucible","level":30,"time":"2024-04-20T01:05:48.67367271Z","hostname":"w-01HVWGBJP7HK0H9TQ26T6N3X8M","pid":1196,"":"downstairs","":"downstairs","session_id":"132b460a-26a0-4532-b1ab-4f8c07d4c6c7"}
3442 req_id: 86bdb586-4376-4882-ae6d-b744f3dc35d3, remote_addr: 127.0.0.1:{"msg":"client task is exiting","v":0,"name":"crucible","level":30,"time":"2024-04-20T01:05:48.67368857Z","hostname":"w-01HVWGBJP7HK0H9TQ26T6N3X8M","pid":1196,"":"io task","client":"2","":"downstairs","session_id":"132b460a-26a0-4532-b1ab-4f8c07d4c6c7"}
3443 60352, local_addr: 127.0.0.1:9998
3444 [8830] Exited with: ExitStatus(unix_wait_status(9))
3445 [8830][2] reports Exit
3446 Apr 20 01:05:52.675 INFO request completed, latency_us: 218, response_code: 200, uri: /state/cid/2, method: GET, req_id: 8e868e1a-7df8-44ae-93e0-541473a37732, remote_addr: 127.0.0.1:60352, local_addr: 127.0.0.1:9998
3447 001/300 Write block 418 len 40960 data: 3 3 3 3 3 3 2 2 2 2
3448 002/300 Read block 4322 len 32768
3449 003/300 Flush
3450 004/300 Read block 4183 len 28672
3451 005/300 Read block 2825 len 28672
3452 006/300 Read block 118 len 36864
3453 007/300 Read block 4607 len 4096
3454 008/300 Write block 2841 len 40960 data: 2 2 2 2 2 2 2 2 2 2
3455 009/300 Read block 4491 len 16384
3456 010/300 Read block 4256 len 24576
3457 011/300 Read block 1784 len 40960
3458 012/300 Read block 4410 len 40960
3459 013/300 Read block 903 len 28672
3460 014/300 Read block 3373 len 12288
3461 015/300 Flush
3462 016/300 Read block 3372 len 12288
3463 017/300 Flush
3464 018/300 Read block 2085 len 32768
3465 019/300 Write block 4348 len 32768 data: 2 2 2 2 2 2 2 2
3466 020/300 Read block 1198 len 40960
3467 021/300 Write block 3271 len 36864 data: 2 2 2 2 2 2 2 2 2
3468 022/300 Read block 3990 len 16384
3469 023/300 Flush
3470 024/300 Write block 4374 len 36864 data: 2 2 2 2 3 3 3 3 2
3471 025/300 Write block 3842 len 4096 data: 2
3472 026/300 Flush
3473 027/300 Write block 1302 len 20480 data: 2 2 2 3 3
3474 028/300 Read block 4730 len 12288
3475 029/300 Flush
3476 030/300 Flush
3477 031/300 Read block 2494 len 16384
3478 032/300 Read block 550 len 40960
3479 033/300 Read block 1477 len 16384
3480 034/300 Read block 1774 len 4096
3481 035/300 Write block 3378 len 40960 data: 2 2 2 2 2 2 2 2 2 2
3482 036/300 Read block 94 len 20480
3483 037/300 Read block 1741 len 36864
3484 038/300 Read block 4537 len 20480
3485 039/300 Write block 781 len 40960 data: 2 2 2 2 2 2 2 3 2 2
3486 040/300 Read block 4136 len 12288
3487 041/300 Read block 2320 len 16384
3488 042/300 Write block 2475 len 8192 data: 2 2
3489 043/300 Write block 3432 len 16384 data: 4 4 3 3
3490 044/300 Write block 4411 len 40960 data: 3 3 3 2 2 2 2 2 2 2
3491 045/300 Read block 3682 len 28672
3492 046/300 Read block 351 len 36864
3493 047/300 Write block 1267 len 8192 data: 3 3
3494 048/300 Write block 1002 len 12288 data: 2 2 3
3495 049/300 Write block 1495 len 28672 data: 2 2 2 2 2 2 2
3496 050/300 Read block 188 len 12288
3497 051/300 Read block 4373 len 24576
3498 052/300 Flush
3499 053/300 Write block 1386 len 36864 data: 2 2 2 2 2 2 2 2 2
3500 054/300 Write block 4753 len 20480 data: 2 2 2 2 2
3501 055/300 Read block 2431 len 28672
3502 056/300 Write block 189 len 32768 data: 2 2 2 2 2 2 2 2
3503 057/300 Read block 4259 len 24576
3504 058/300 Read block 3782 len 24576
3505 059/300 Read block 3862 len 36864
3506 060/300 Read block 1882 len 28672
3507 061/300 Write block 4348 len 36864 data: 3 3 3 3 3 3 3 3 2
3508 062/300 Write block 244 len 12288 data: 3 5 4
3509 063/300 Write block 3489 len 24576 data: 3 3 2 2 2 2
3510 064/300 Read block 4035 len 20480
3511 065/300 Write block 4083 len 4096 data: 3
3512 066/300 Read block 2582 len 20480
3513 067/300 Flush
3514 068/300 Write block 1029 len 16384 data: 3 3 3 3
3515 069/300 Write block 3014 len 12288 data: 2 3 3
3516 070/300 Write block 4825 len 40960 data: 3 3 3 2 2 2 2 2 2 2
3517 071/300 Write block 768 len 36864 data: 2 2 2 2 2 2 2 2 2
3518 072/300 Read block 3846 len 4096
3519 073/300 Read block 3758 len 20480
3520 074/300 Read block 1135 len 12288
3521 075/300 Write block 4064 len 8192 data: 2 2
3522 076/300 Write block 450 len 16384 data: 2 2 2 3
3523 077/300 Write block 762 len 24576 data: 3 3 3 3 2 2
3524 078/300 Write block 3986 len 32768 data: 2 2 2 2 2 2 2 2
3525 079/300 Write block 1556 len 32768 data: 2 2 2 2 2 2 2 2
3526 080/300 Write block 1135 len 12288 data: 3 3 2
3527 081/300 Write block 4846 len 28672 data: 3 2 2 3 3 3 3
3528 082/300 Write block 3485 len 8192 data: 3 3
3529 083/300 Read block 4439 len 32768
3530 084/300 Write block 1815 len 4096 data: 2
3531 085/300 Read block 4499 len 28672
3532 086/300 Write block 1199 len 4096 data: 2
3533 087/300 Write block 4292 len 16384 data: 2 2 2 2
3534 088/300 Write block 4965 len 36864 data: 2 2 2 2 2 2 2 2 2
3535 089/300 Read block 2423 len 8192
3536 090/300 Write block 4471 len 32768 data: 2 3 3 3 3 3 3 3
3537 091/300 Write block 3009 len 8192 data: 3 3
3538 092/300 Read block 3879 len 4096
3539 093/300 Read block 2616 len 20480
3540 094/300 Read block 3937 len 4096
3541 095/300 Write block 1892 len 4096 data: 2
3542 096/300 Write block 618 len 24576 data: 2 2 2 2 2 2
3543 097/300 Write block 447 len 20480 data: 3 2 2 3 3
3544 098/300 Read block 14 len 4096
3545 099/300 Read block 543 len 40960
3546 100/300 Read block 4057 len 40960
3547 101/300 Read block 907 len 8192
3548 102/300 Write block 3056 len 36864 data: 2 2 2 2 2 2 2 2 2
3549 103/300 Write block 2346 len 28672 data: 2 2 3 3 2 2 2
3550 104/300 Read block 1784 len 40960
3551 105/300 Write block 4832 len 24576 data: 3 3 3 3 3 3
3552 106/300 Read block 1336 len 8192
3553 107/300 Read block 3042 len 24576
3554 108/300 Flush
3555 109/300 Flush
3556 110/300 Write block 3286 len 8192 data: 3 3
3557 111/300 Read block 3703 len 16384
3558 112/300 Write block 264 len 4096 data: 2
3559 113/300 Flush
3560 114/300 Write block 2464 len 32768 data: 2 2 2 2 3 4 4 4
3561 115/300 Read block 4898 len 24576
3562 116/300 Flush
3563 117/300 Write block 2679 len 40960 data: 2 2 2 2 2 2 2 2 2 2
3564 118/300 Read block 872 len 36864
3565 119/300 Read block 1591 len 36864
3566 120/300 Read block 4675 len 28672
3567 121/300 Read block 1613 len 36864
3568 122/300 Read block 1024 len 12288
3569 123/300 Read block 3343 len 24576
3570 124/300 Read block 1899 len 16384
3571 125/300 Write block 2110 len 8192 data: 2 2
3572 126/300 Flush
3573 127/300 Flush
3574 128/300 Read block 3655 len 12288
3575 129/300 Read block 1143 len 32768
3576 130/300 Read block 1399 len 12288
3577 131/300 Read block 1609 len 24576
3578 132/300 Write block 1578 len 4096 data: 2
3579 133/300 Write block 3749 len 8192 data: 2 2
3580 134/300 Write block 2412 len 40960 data: 2 2 2 2 2 2 2 2 2 2
3581 135/300 Write block 3631 len 28672 data: 3 2 2 2 2 2 2
3582 136/300 Read block 2240 len 4096
3583 137/300 Write block 3476 len 24576 data: 2 3 3 3 3 3
3584 138/300 Read block 4014 len 32768
3585 139/300 Read block 468 len 24576
3586 140/300 Write block 1372 len 4096 data: 2
3587 141/300 Write block 3497 len 36864 data: 2 2 2 2 2 2 2 2 2
3588 142/300 Read block 3366 len 12288
3589 143/300 Write block 521 len 28672 data: 2 2 2 2 2 2 2
3590 144/300 Write block 668 len 16384 data: 3 3 3 3
3591 145/300 Read block 2590 len 16384
3592 146/300 Read block 3206 len 24576
3593 147/300 Write block 903 len 28672 data: 2 2 2 2 2 2 2
3594 148/300 Flush
3595 149/300 Write block 1378 len 4096 data: 2
3596 150/300 Read block 4215 len 8192
3597 151/300 Write block 9 len 32768 data: 2 2 2 2 2 2 2 2
3598 152/300 Write block 3327 len 12288 data: 2 2 2
3599 153/300 Read block 3128 len 8192
3600 154/300 Write block 3419 len 24576 data: 3 3 2 2 2 3
3601 155/300 Write block 3969 len 8192 data: 2 2
3602 156/300 Read block 2547 len 8192
3603 157/300 Read block 4567 len 8192
3604 158/300 Write block 4813 len 8192 data: 2 2
3605 159/300 Read block 2785 len 32768
3606 160/300 Read block 4912 len 16384
3607 161/300 Write block 4529 len 36864 data: 3 3 3 3 2 2 2 2 2
3608 162/300 Read block 800 len 28672
3609 163/300 Read block 3140 len 24576
3610 164/300 Read block 4793 len 40960
3611 165/300 Read block 231 len 8192
3612 166/300 Read block 762 len 24576
3613 167/300 Read block 1349 len 40960
3614 168/300 Write block 227 len 28672 data: 2 2 3 3 2 2 2
3615 169/300 Write block 854 len 40960 data: 2 2 2 2 2 2 2 2 2 2
3616 170/300 Read block 3697 len 28672
3617 171/300 Read block 453 len 32768
3618 172/300 Read block 468 len 4096
3619 173/300 Flush
3620 174/300 Write block 1911 len 28672 data: 2 2 2 2 2 2 2
3621 175/300 Read block 4977 len 12288
3622 176/300 Read block 4989 len 28672
3623 177/300 Write block 1150 len 20480 data: 2 2 3 3 3
3624 178/300 Read block 4892 len 40960
3625 179/300 Write block 518 len 36864 data: 2 2 2 3 3 3 3 3 3
3626 180/300 Flush
3627 181/300 Read block 337 len 16384
3628 182/300 Read block 685 len 40960
3629 183/300 Write block 3576 len 40960 data: 3 3 2 2 2 2 2 2 2 2
3630 184/300 Write block 4808 len 8192 data: 2 2
3631 185/300 Read block 979 len 12288
3632 186/300 Write block 2599 len 32768 data: 2 2 2 2 2 2 2 2
3633 187/300 Write block 4785 len 20480 data: 2 2 2 2 2
3634 188/300 Write block 1586 len 28672 data: 2 2 2 2 2 2 2
3635 189/300 Write block 1951 len 32768 data: 2 2 2 2 2 2 2 2
3636 190/300 Write block 4041 len 8192 data: 2 4
3637 191/300 Read block 3639 len 40960
3638 192/300 Read block 1221 len 4096
3639 193/300 Read block 2483 len 8192
3640 194/300 Flush
3641 195/300 Read block 2565 len 20480
3642 196/300 Read block 1005 len 16384
3643 197/300 Write block 590 len 36864 data: 3 3 2 2 2 2 2 2 2
3644 198/300 Read block 2920 len 36864
3645 199/300 Read block 2628 len 4096
3646 200/300 Flush
3647 201/300 Write block 342 len 8192 data: 2 2
3648 202/300 Read block 4435 len 20480
3649 203/300 Write block 2358 len 32768 data: 2 2 2 2 2 2 2 2
3650 204/300 Write block 3458 len 12288 data: 2 2 2
3651 205/300 Read block 2849 len 8192
3652 206/300 Read block 2123 len 12288
3653 207/300 Read block 1381 len 16384
3654 208/300 Read block 4378 len 4096
3655 209/300 Read block 3162 len 16384
3656 210/300 Write block 3912 len 4096 data: 2
3657 211/300 Write block 2727 len 40960 data: 2 2 2 2 2 2 2 2 2 2
3658 212/300 Write block 2810 len 24576 data: 2 2 2 2 2 2
3659 213/300 Read block 1206 len 24576
3660 214/300 Read block 2700 len 4096
3661 215/300 Write block 3092 len 36864 data: 2 2 2 2 2 2 3 3 3
3662 216/300 Read block 3615 len 40960
3663 217/300 Write block 604 len 20480 data: 2 2 2 2 2
3664 218/300 Read block 3687 len 12288
3665 219/300 Write block 1242 len 20480 data: 3 4 4 2 2
3666 220/300 Write block 3614 len 4096 data: 2
3667 221/300 Write block 1874 len 12288 data: 2 2 2
3668 222/300 Write block 4126 len 8192 data: 2 2
3669 223/300 Read block 3536 len 4096
3670 224/300 Write block 2960 len 36864 data: 2 2 3 3 3 3 3 3 3
3671 225/300 Read block 1025 len 32768
3672 226/300 Read block 4426 len 4096
3673 227/300 Read block 453 len 24576
3674 228/300 Read block 2234 len 32768
3675 229/300 Read block 2088 len 4096
3676 230/300 Read block 2754 len 32768
3677 231/300 Write block 1127 len 12288 data: 3 2 2
3678 232/300 Read block 1764 len 20480
3679 233/300 Read block 1564 len 40960
3680 234/300 Read block 2091 len 12288
3681 235/300 Write block 3104 len 16384 data: 3 3 3 3
3682 236/300 Write block 3230 len 8192 data: 2 2
3683 237/300 Flush
3684 238/300 Write block 2642 len 32768 data: 2 2 2 2 2 2 2 2
3685 239/300 Write block 899 len 24576 data: 2 2 2 2 3 3
3686 240/300 Write block 1231 len 8192 data: 2 2
3687 241/300 Read block 2333 len 4096
3688 242/300 Write block 3680 len 36864 data: 2 2 2 2 2 2 2 2 2
3689 243/300 Write block 1299 len 40960 data: 2 2 2 3 3 3 4 4 3 3
3690 244/300 Write block 4755 len 28672 data: 3 3 3 2 2 2 2
3691 245/300 Write block 1703 len 4096 data: 2
3692 246/300 Write block 3645 len 32768 data: 3 3 2 2 3 3 3 2
3693 247/300 Read block 4869 len 16384
3694 248/300 Write block 4174 len 4096 data: 4
3695 249/300 Write block 4517 len 40960 data: 2 2 2 2 2 2 2 2 2 2
3696 250/300 Read block 228 len 36864
3697 251/300 Read block 1322 len 4096
3698 252/300 Flush
3699 253/300 Read block 511 len 16384
3700 254/300 Read block 4315 len 4096
3701 255/300 Write block 4990 len 32768 data: 2 2 2 2 2 2 2 2
3702 256/300 Read block 1165 len 16384
3703 257/300 Read block 4169 len 8192
3704 258/300 Write block 4274 len 8192 data: 3 3
3705 259/300 Write block 2181 len 28672 data: 2 2 2 2 2 2 2
3706 260/300 Write block 315 len 36864 data: 3 3 3 3 3 3 2 2 2
3707 261/300 Read block 71 len 16384
3708 262/300 Read block 591 len 8192
3709 263/300 Flush
3710 264/300 Write block 1530 len 28672 data: 3 3 3 3 2 2 2
3711 265/300 Write block 3121 len 20480 data: 2 2 2 2 2
3712 266/300 Read block 2902 len 36864
3713 267/300 Read block 2463 len 28672
3714 268/300 Read block 1213 len 16384
3715 269/300 Read block 3606 len 40960
3716 270/300 Write block 4782 len 24576 data: 2 2 2 3 3 3
3717 271/300 Write block 1924 len 4096 data: 2
3718 272/300 Read block 1226 len 4096
3719 273/300 Flush
3720 274/300 Read block 2895 len 24576
3721 275/300 Write block 4291 len 28672 data: 2 3 3 3 3 2 2
3722 276/300 Read block 174 len 20480
3723 277/300 Read block 2064 len 32768
3724 278/300 Write block 4885 len 24576 data: 2 3 3 3 4 4
3725 279/300 Write block 1152 len 16384 data: 4 4 4 3
3726 280/300 Read block 902 len 12288
3727 281/300 Read block 3640 len 12288
3728 282/300 Write block 4873 len 20480 data: 4 4 4 3 3
3729 283/300 Read block 3303 len 16384
3730 284/300 Read block 3946 len 40960
3731 285/300 Read block 1902 len 8192
3732 286/300 Read block 3309 len 20480
3733 287/300 Read block 3222 len 28672
3734 288/300 Write block 2235 len 24576 data: 2 2 2 2 2 2
3735 289/300 Read block 1336 len 32768
3736 290/300 Read block 2361 len 8192
3737 291/300 Read block 4592 len 16384
3738 292/300 Read block 2716 len 4096
3739 293/300 Write block 4169 len 28672 data: 4 5 5 5 4 5 2
3740 294/300 Write block 207 len 20480 data: 2 2 2 2 2
3741 295/300 Read block 719 len 28672
3742 296/300 Read block 4883 len 40960
3743 297/300 Write block 3990 len 36864 data: 3 3 3 3 2 2 2 3 3
3744 298/300 Write block 2244 len 24576 data: 2 2 2 2 2 2
3745 299/300 Write block 661 len 36864 data: 2 2 2 2 2 2 3 4 4
3746 300/300 Read block 1981 len 28672
3747 Main task has work to do, go find it
3748 got dsc Start(2)
3749 start 2
3750 Apr 20 01:05:52.981 INFO request completed, latency_us: 232, response_code: 204, uri: /start/cid/2, method: POST, req_id: 3fe90243-8413-4cb2-821e-9b06ef468cac, remote_addr: 127.0.0.1:60352, local_addr: 127.0.0.1:9998
3751 Replay: started 2, returned:Ok(())
3752 ----------------------------------------------------------------
3753 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:300
3754 States: Active Active Offline
3755 GW_ID ACK DSID TYPE BLOCKS DS:0 DS:1 DS:2 REPLAY
3756 604 Acked 1603 Write 10 Done Done New false
3757 605 Acked 1604 Read 8 Done Done New false
3758 606 Acked 1605 Flush 0 Done Done New false
3759 607 Acked 1606 Read 7 Done Done New false
3760 608 Acked 1607 Read 7 Done Done New false
3761 609 Acked 1608 Read 9 Done Done New false
3762 610 Acked 1609 Read 1 Done Done New false
3763 611 Acked 1610 Write 10 Done Done New false
3764 612 Acked 1611 Read 4 Done Done New false
3765 613 Acked 1612 Read 6 Done Done New false
3766 614 Acked 1613 Read 10 Done Done New false
3767 615 Acked 1614 Read 10 Done Done New false
3768 616 Acked 1615 Read 7 Done Done New false
3769 617 Acked 1616 Read 3 Done Done New false
3770 618 Acked 1617 Flush 0 Done Done New false
3771 619 Acked 1618 Read 3 Done Done New false
3772 620 Acked 1619 Flush 0 Done Done New false
3773 621 Acked 1620 Read 8 Done Done New false
3774 622 Acked 1621 Write 8 Done Done New false
3775 623 Acked 1622 Read 10 Done Done New false
3776 624 Acked 1623 Write 9 Done Done New false
3777 625 Acked 1624 Read 4 Done Done New false
3778 626 Acked 1625 Flush 0 Done Done New false
3779 627 Acked 1626 Write 9 Done Done New false
3780 628 Acked 1627 Write 1 Done Done New false
3781 629 Acked 1628 Flush 0 Done Done New false
3782 630 Acked 1629 Write 5 Done Done New false
3783 631 Acked 1630 Read 3 Done Done New false
3784 632 Acked 1631 Flush 0 Done Done New false
3785 633 Acked 1632 Flush 0 Done Done New false
3786 634 Acked 1633 Read 4 Done Done New false
3787 635 Acked 1634 Read 10 Done Done New false
3788 636 Acked 1635 Read 4 Done Done New false
3789 637 Acked 1636 Read 1 Done Done New false
3790 638 Acked 1637 Write 10 Done Done New false
3791 639 Acked 1638 Read 5 Done Done New false
3792 640 Acked 1639 Read 9 Done Done New false
3793 641 Acked 1640 Read 5 Done Done New false
3794 642 Acked 1641 Write 10 Done Done New false
3795 643 Acked 1642 Read 3 Done Done New false
3796 644 Acked 1643 Read 4 Done Done New false
3797 645 Acked 1644 Write 2 Done Done New false
3798 646 Acked 1645 Write 4 Done Done New false
3799 647 Acked 1646 Write 10 Done Done New false
3800 648 Acked 1647 Read 7 Done Done New false
3801 649 Acked 1648 Read 9 Done Done New false
3802 650 Acked 1649 Write 2 Done Done New false
3803 651 Acked 1650 Write 3 Done Done New false
3804 652 Acked 1651 Write 7 Done Done New false
3805 653 Acked 1652 Read 3 Done Done New false
3806 654 Acked 1653 Read 6 Done Done New false
3807 655 Acked 1654 Flush 0 Done Done New false
3808 656 Acked 1655 Write 9 Done Done New false
3809 657 Acked 1656 Write 5 Done Done New false
3810 658 Acked 1657 Read 7 Done Done New false
3811 659 Acked 1658 Write 8 Done Done New false
3812 660 Acked 1659 Read 6 Done Done New false
3813 661 Acked 1660 Read 6 Done Done New false
3814 662 Acked 1661 Read 9 Done Done New false
3815 663 Acked 1662 Read 7 Done Done New false
3816 664 Acked 1663 Write 9 Done Done New false
3817 665 Acked 1664 Write 3 Done Done New false
3818 666 Acked 1665 Write 6 Done Done New false
3819 667 Acked 1666 Read 5 Done Done New false
3820 668 Acked 1667 Write 1 Done Done New false
3821 669 Acked 1668 Read 5 Done Done New false
3822 670 Acked 1669 Flush 0 Done Done New false
3823 671 Acked 1670 Write 4 Done Done New false
3824 672 Acked 1671 Write 3 Done Done New false
3825 673 Acked 1672 Write 10 Done Done New false
3826 674 Acked 1673 Write 9 Done Done New false
3827 675 Acked 1674 Read 1 Done Done New false
3828 676 Acked 1675 Read 5 Done Done New false
3829 677 Acked 1676 Read 3 Done Done New false
3830 678 Acked 1677 Write 2 Done Done New false
3831 679 Acked 1678 Write 4 Done Done New false
3832 680 Acked 1679 Write 6 Done Done New false
3833 681 Acked 1680 Write 8 Done Done New false
3834 682 Acked 1681 Write 8 Done Done New false
3835 683 Acked 1682 Write 3 Done Done New false
3836 684 Acked 1683 Write 7 Done Done New false
3837 685 Acked 1684 Write 2 Done Done New false
3838 686 Acked 1685 Read 8 Done Done New false
3839 687 Acked 1686 Write 1 Done Done New false
3840 688 Acked 1687 Read 7 Done Done New false
3841 689 Acked 1688 Write 1 Done Done New false
3842 690 Acked 1689 Write 4 Done Done New false
3843 691 Acked 1690 Write 9 Done Done New false
3844 692 Acked 1691 Read 2 Done Done New false
3845 693 Acked 1692 Write 8 Done Done New false
3846 694 Acked 1693 Write 2 Done Done New false
3847 695 Acked 1694 Read 1 Done Done New false
3848 696 Acked 1695 Read 5 Done Done New false
3849 697 Acked 1696 Read 1 Done Done New false
3850 698 Acked 1697 Write 1 Done Done New false
3851 699 Acked 1698 Write 6 Done Done New false
3852 700 Acked 1699 Write 5 Done Done New false
3853 701 Acked 1700 Read 1 Done Done New false
3854 702 Acked 1701 Read 10 Done Done New false
3855 703 Acked 1702 Read 10 Done Done New false
3856 704 Acked 1703 Read 2 Done Done New false
3857 705 Acked 1704 Write 9 Done Done New false
3858 706 Acked 1705 Write 7 Done Done New false
3859 707 Acked 1706 Read 10 Done Done New false
3860 708 Acked 1707 Write 6 Done Done New false
3861 709 Acked 1708 Read 2 Done Done New false
3862 710 Acked 1709 Read 6 Done Done New false
3863 711 Acked 1710 Flush 0 Done Done New false
3864 712 Acked 1711 Flush 0 Done Done New false
3865 713 Acked 1712 Write 2 Done Done New false
3866 714 Acked 1713 Read 4 Done Done New false
3867 715 Acked 1714 Write 1 Done Done New false
3868 716 Acked 1715 Flush 0 Done Done New false
3869 717 Acked 1716 Write 8 Done Done New false
3870 718 Acked 1717 Read 6 Done Done New false
3871 719 Acked 1718 Flush 0 Done Done New false
3872 720 Acked 1719 Write 10 Done Done New false
3873 721 Acked 1720 Read 9 Done Done New false
3874 722 Acked 1721 Read 9 Done Done New false
3875 723 Acked 1722 Read 7 Done Done New false
3876 724 Acked 1723 Read 9 Done Done New false
3877 725 Acked 1724 Read 3 Done Done New false
3878 726 Acked 1725 Read 6 Done Done New false
3879 727 Acked 1726 Read 4 Done Done New false
3880 728 Acked 1727 Write 2 Done Done New false
3881 729 Acked 1728 Flush 0 Done Done New false
3882 730 Acked 1729 Flush 0 Done Done New false
3883 731 Acked 1730 Read 3 Done Done New false
3884 732 Acked 1731 Read 8 Done Done New false
3885 733 Acked 1732 Read 3 Done Done New false
3886 734 Acked 1733 Read 6 Done Done New false
3887 735 Acked 1734 Write 1 Done Done New false
3888 736 Acked 1735 Write 2 Done Done New false
3889 737 Acked 1736 Write 10 Done Done New false
3890 738 Acked 1737 Write 7 Done Done New false
3891 739 Acked 1738 Read 1 Done Done New false
3892 740 Acked 1739 Write 6 Done Done New false
3893 741 Acked 1740 Read 8 Done Done New false
3894 742 Acked 1741 Read 6 Done Done New false
3895 743 Acked 1742 Write 1 Done Done New false
3896 744 Acked 1743 Write 9 Done Done New false
3897 745 Acked 1744 Read 3 Done Done New false
3898 746 Acked 1745 Write 7 Done Done New false
3899 747 Acked 1746 Write 4 Done Done New false
3900 748 Acked 1747 Read 4 Done Done New false
3901 749 Acked 1748 Read 6 Done Done New false
3902 750 Acked 1749 Write 7 Done Done New false
3903 751 Acked 1750 Flush 0 Done Done New false
3904 752 Acked 1751 Write 1 Done Done New false
3905 753 Acked 1752 Read 2 Done Done New false
3906 754 Acked 1753 Write 8 Done Done New false
3907 755 Acked 1754 Write 3 Done Done New false
3908 756 Acked 1755 Read 2 Done Done New false
3909 757 Acked 1756 Write 6 Done Done New false
3910 758 Acked 1757 Write 2 Done Done New false
3911 759 Acked 1758 Read 2 Done Done New false
3912 760 Acked 1759 Read 2 Done Done New false
3913 761 Acked 1760 Write 2 Done Done New false
3914 762 Acked 1761 Read 8 Done Done New false
3915 763 Acked 1762 Read 4 Done Done New false
3916 764 Acked 1763 Write 9 Done Done New false
3917 765 Acked 1764 Read 7 Done Done New false
3918 766 Acked 1765 Read 6 Done Done New false
3919 767 Acked 1766 Read 10 Done Done New false
3920 768 Acked 1767 Read 2 Done Done New false
3921 769 Acked 1768 Read 6 Done Done New false
3922 770 Acked 1769 Read 10 Done Done New false
3923 771 Acked 1770 Write 7 Done Done New false
3924 772 Acked 1771 Write 10 Done Done New false
3925 773 Acked 1772 Read 7 Done Done New false
3926 774 Acked 1773 Read 8 Done Done New false
3927 775 Acked 1774 Read 1 Done Done New false
3928 776 Acked 1775 Flush 0 Done Done New false
3929 777 Acked 1776 Write 7 Done Done New false
3930 778 Acked 1777 Read 3 Done Done New false
3931 779 Acked 1778 Read 7 Done Done New false
3932 780 Acked 1779 Write 5 Done Done New false
3933 781 Acked 1780 Read 10 Done Done New false
3934 782 Acked 1781 Write 9 Done Done New false
3935 783 Acked 1782 Flush 0 Done Done New false
3936 784 Acked 1783 Read 4 Done Done New false
3937 785 Acked 1784 Read 10 Done Done New false
3938 786 Acked 1785 Write 10 Done Done New false
3939 787 Acked 1786 Write 2 Done Done New false
3940 788 Acked 1787 Read 3 Done Done New false
3941 789 Acked 1788 Write 8 Done Done New false
3942 790 Acked 1789 Write 5 Done Done New false
3943 791 Acked 1790 Write 7 Done Done New false
3944 792 Acked 1791 Write 8 Done Done New false
3945 793 Acked 1792 Write 2 Done Done New false
3946 794 Acked 1793 Read 10 Done Done New false
3947 795 Acked 1794 Read 1 Done Done New false
3948 796 Acked 1795 Read 2 Done Done New false
3949 797 Acked 1796 Flush 0 Done Done New false
3950 798 Acked 1797 Read 5 Done Done New false
3951 799 Acked 1798 Read 4 Done Done New false
3952 800 Acked 1799 Write 9 Done Done New false
3953 801 Acked 1800 Read 9 Done Done New false
3954 802 Acked 1801 Read 1 Done Done New false
3955 803 Acked 1802 Flush 0 Done Done New false
3956 804 Acked 1803 Write 2 Done Done New false
3957 805 Acked 1804 Read 5 Done Done New false
3958 806 Acked 1805 Write 8 Done Done New false
3959 807 Acked 1806 Write 3 Done Done New false
3960 808 Acked 1807 Read 2 Done Done New false
3961 809 Acked 1808 Read 3 Done Done New false
3962 810 Acked 1809 Read 4 Done Done New false
3963 811 Acked 1810 Read 1 Done Done New false
3964 812 Acked 1811 Read 4 Done Done New false
3965 813 Acked 1812 Write 1 Done Done New false
3966 814 Acked 1813 Write 10 Done Done New false
3967 815 Acked 1814 Write 6 Done Done New false
3968 816 Acked 1815 Read 6 Done Done New false
3969 817 Acked 1816 Read 1 Done Done New false
3970 818 Acked 1817 Write 9 Done Done New false
3971 819 Acked 1818 Read 10 Done Done New false
3972 820 Acked 1819 Write 5 Done Done New false
3973 821 Acked 1820 Read 3 Done Done New false
3974 822 Acked 1821 Write 5 Done Done New false
3975 823 Acked 1822 Write 1 Done Done New false
3976 824 Acked 1823 Write 3 Done Done New false
3977 825 Acked 1824 Write 2 Done Done New false
3978 826 Acked 1825 Read 1 Done Done New false
3979 827 Acked 1826 Write 9 Done Done New false
3980 828 Acked 1827 Read 8 Done Done New false
3981 829 Acked 1828 Read 1 Done Done New false
3982 830 Acked 1829 Read 6 Done Done New false
3983 831 Acked 1830 Read 8 Done Done New false
3984 832 Acked 1831 Read 1 Done Done New false
3985 833 Acked 1832 Read 8 Done Done New false
3986 834 Acked 1833 Write 3 Done Done New false
3987 835 Acked 1834 Read 5 Done Done New false
3988 836 Acked 1835 Read 10 Done Done New false
3989 837 Acked 1836 Read 3 Done Done New false
3990 838 Acked 1837 Write 4 Done Done New false
3991 839 Acked 1838 Write 2 Done Done New false
3992 840 Acked 1839 Flush 0 Done Done New false
3993 841 Acked 1840 Write 8 Done Done New false
3994 842 Acked 1841 Write 6 Done Done New false
3995 843 Acked 1842 Write 2 Done Done New false
3996 844 Acked 1843 Read 1 Done Done New false
3997 845 Acked 1844 Write 9 Done Done New false
3998 846 Acked 1845 Write 10 Done Done New false
3999 847 Acked 1846 Write 7 Done Done New false
4000 848 Acked 1847 Write 1 Done Done New false
4001 849 Acked 1848 Write 8 Done Done New false
4002 850 Acked 1849 Read 4 Done Done New false
4003 851 Acked 1850 Write 1 Done Done New false
4004 852 Acked 1851 Write 10 Done Done New false
4005 853 Acked 1852 Read 9 Done Done New false
4006 854 Acked 1853 Read 1 Done Done New false
4007 855 Acked 1854 Flush 0 Done Done New false
4008 856 Acked 1855 Read 4 Done Done New false
4009 857 Acked 1856 Read 1 Done Done New false
4010 858 Acked 1857 Write 8 Done Done New false
4011 859 Acked 1858 Read 4 Done Done New false
4012 860 Acked 1859 Read 2 Done Done New false
4013 861 Acked 1860 Write 2 Done Done New false
4014 862 Acked 1861 Write 7 Done Done New false
4015 863 Acked 1862 Write 9 Done Done New false
4016 864 Acked 1863 Read 4 Done Done New false
4017 865 Acked 1864 Read 2 Done Done New false
4018 866 Acked 1865 Flush 0 Done Done New false
4019 867 Acked 1866 Write 7 Done Done New false
4020 868 Acked 1867 Write 5 Done Done New false
4021 869 Acked 1868 Read 9 Done Done New false
4022 870 Acked 1869 Read 7 Done Done New false
4023 871 Acked 1870 Read 4 Done Done New false
4024 872 Acked 1871 Read 10 Done Done New false
4025 873 Acked 1872 Write 6 Done Done New false
4026 874 Acked 1873 Write 1 Done Done New false
4027 875 Acked 1874 Read 1 Done Done New false
4028 876 Acked 1875 Flush 0 Done Done New false
4029 877 Acked 1876 Read 6 Done Done New false
4030 878 Acked 1877 Write 7 Done Done New false
4031 879 Acked 1878 Read 5 Done Done New false
4032 880 Acked 1879 Read 8 Done Done New false
4033 881 Acked 1880 Write 6 Done Done New false
4034 882 Acked 1881 Write 4 Done Done New false
4035 883 Acked 1882 Read 3 Done Done New false
4036 884 Acked 1883 Read 3 Done Done New false
4037 885 Acked 1884 Write 5 Done Done New false
4038 886 Acked 1885 Read 4 Done Done New false
4039 887 Acked 1886 Read 10 Done Done New false
4040 888 Acked 1887 Read 2 Done Done New false
4041 889 Acked 1888 Read 5 Done Done New false
4042 890 Acked 1889 Read 7 Done Done New false
4043 891 Acked 1890 Write 6 Done Done New false
4044 892 Acked 1891 Read 8 Done Done New false
4045 893 Acked 1892 Read 2 Done Done New false
4046 894 Acked 1893 Read 4 Done Done New false
4047 895 Acked 1894 Read 1 Done Done New false
4048 896 Acked 1895 Write 7 Done Done New false
4049 897 Acked 1896 Write 5 Done Done New false
4050 898 Acked 1897 Read 7 Done Done New false
4051 899 Acked 1898 Read 10 Done Done New false
4052 900 Acked 1899 Write 9 Done Done New false
4053 901 Acked 1900 Write 6 Done Done New false
4054 902 Acked 1901 Write 9 Done Done New false
4055 903 Acked 1902 Read 7 Done Done New false
4056 STATES DS:0 DS:1 DS:2 TOTAL
4057 New 0 0 300 300
4058 Sent 0 0 0 0
4059 Done 300 300 0 600
4060 Skipped 0 0 0 0
4061 Error 0 0 0 0
4062 Last Flush: 1875 1875 1602
4063 Downstairs last five completed: 1602 1601 1600 1599 1598
4064 Upstairs last five completed: 903 902 901 900 899
4065 CLIENT: Up:0 ds:300 act:2
4066 ----------------------------------------------------------------
4067 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:301
4068 States: Active Active Offline
4069 GW_ID ACK DSID TYPE BLOCKS DS:0 DS:1 DS:2 REPLAY
4070 604 Acked 1603 Write 10 Done Done New false
4071 605 Acked 1604 Read 8 Done Done New false
4072 606 Acked 1605 Flush 0 Done Done New false
4073 607 Acked 1606 Read 7 Done Done New false
4074 608 Acked 1607 Read 7 Done Done New false
4075 609 Acked 1608 Read 9 Done Done New false
4076 610 Acked 1609 Read 1 Done Done New false
4077 611 Acked 1610 Write 10 Done Done New false
4078 612 Acked 1611 Read 4 Done Done New false
4079 613 Acked 1612 Read 6 Done Done New false
4080 614 Acked 1613 Read 10 Done Done New false
4081 615 Acked 1614 Read 10 Done Done New false
4082 616 Acked 1615 Read 7 Done Done New false
4083 617 Acked 1616 Read 3 Done Done New false
4084 618 Acked 1617 Flush 0 Done Done New false
4085 619 Acked 1618 Read 3 Done Done New false
4086 620 Acked 1619 Flush 0 Done Done New false
4087 621 Acked 1620 Read 8 Done Done New false
4088 622 Acked 1621 Write 8 Done Done New false
4089 623 Acked 1622 Read 10 Done Done New false
4090 624 Acked 1623 Write 9 Done Done New false
4091 625 Acked 1624 Read 4 Done Done New false
4092 626 Acked 1625 Flush 0 Done Done New false
4093 627 Acked 1626 Write 9 Done Done New false
4094 628 Acked 1627 Write 1 Done Done New false
4095 629 Acked 1628 Flush 0 Done Done New false
4096 630 Acked 1629 Write 5 Done Done New false
4097 631 Acked 1630 Read 3 Done Done New false
4098 632 Acked 1631 Flush 0 Done Done New false
4099 633 Acked 1632 Flush 0 Done Done New false
4100 634 Acked 1633 Read 4 Done Done New false
4101 635 Acked 1634 Read 10 Done Done New false
4102 636 Acked 1635 Read 4 Done Done New false
4103 637 Acked 1636 Read 1 Done Done New false
4104 638 Acked 1637 Write 10 Done Done New false
4105 639 Acked 1638 Read 5 Done Done New false
4106 640 Acked 1639 Read 9 Done Done New false
4107 641 Acked 1640 Read 5 Done Done New false
4108 642 Acked 1641 Write 10 Done Done New false
4109 643 Acked 1642 Read 3 Done Done New false
4110 644 Acked 1643 Read 4 Done Done New false
4111 645 Acked 1644 Write 2 Done Done New false
4112 646 Acked 1645 Write 4 Done Done New false
4113 647 Acked 1646 Write 10 Done Done New false
4114 648 Acked 1647 Read 7 Done Done New false
4115 649 Acked 1648 Read 9 Done Done New false
4116 650 Acked 1649 Write 2 Done Done New false
4117 651 Acked 1650 Write 3 Done Done New false
4118 652 Acked 1651 Write 7 Done Done New false
4119 653 Acked 1652 Read 3 Done Done New false
4120 654 Acked 1653 Read 6 Done Done New false
4121 655 Acked 1654 Flush 0 Done Done New false
4122 656 Acked 1655 Write 9 Done Done New false
4123 657 Acked 1656 Write 5 Done Done New false
4124 658 Acked 1657 Read 7 Done Done New false
4125 659 Acked 1658 Write 8 Done Done New false
4126 660 Acked 1659 Read 6 Done Done New false
4127 661 Acked 1660 Read 6 Done Done New false
4128 662 Acked 1661 Read 9 Done Done New false
4129 663 Acked 1662 Read 7 Done Done New false
4130 664 Acked 1663 Write 9 Done Done New false
4131 665 Acked 1664 Write 3 Done Done New false
4132 666 Acked 1665 Write 6 Done Done New false
4133 667 Acked 1666 Read 5 Done Done New false
4134 668 Acked 1667 Write 1 Done Done New false
4135 669 Acked 1668 Read 5 Done Done New false
4136 670 Acked 1669 Flush 0 Done Done New false
4137 671 Acked 1670 Write 4 Done Done New false
4138 672 Acked 1671 Write 3 Done Done New false
4139 673 Acked 1672 Write 10 Done Done New false
4140 674 Acked 1673 Write 9 Done Done New false
4141 675 Acked 1674 Read 1 Done Done New false
4142 676 Acked 1675 Read 5 Done Done New false
4143 677 Acked 1676 Read 3 Done Done New false
4144 678 Acked 1677 Write 2 Done Done New false
4145 679 Acked 1678 Write 4 Done Done New false
4146 680 Acked 1679 Write 6 Done Done New false
4147 681 Acked 1680 Write 8 Done Done New false
4148 682 Acked 1681 Write 8 Done Done New false
4149 683 Acked 1682 Write 3 Done Done New false
4150 684 Acked 1683 Write 7 Done Done New false
4151 685 Acked 1684 Write 2 Done Done New false
4152 686 Acked 1685 Read 8 Done Done New false
4153 687 Acked 1686 Write 1 Done Done New false
4154 688 Acked 1687 Read 7 Done Done New false
4155 689 Acked 1688 Write 1 Done Done New false
4156 690 Acked 1689 Write 4 Done Done New false
4157 691 Acked 1690 Write 9 Done Done New false
4158 692 Acked 1691 Read 2 Done Done New false
4159 693 Acked 1692 Write 8 Done Done New false
4160 694 Acked 1693 Write 2 Done Done New false
4161 695 Acked 1694 Read 1 Done Done New false
4162 696 Acked 1695 Read 5 Done Done New false
4163 697 Acked 1696 Read 1 Done Done New false
4164 698 Acked 1697 Write 1 Done Done New false
4165 699 Acked 1698 Write 6 Done Done New false
4166 700 Acked 1699 Write 5 Done Done New false
4167 701 Acked 1700 Read 1 Done Done New false
4168 702 Acked 1701 Read 10 Done Done New false
4169 703 Acked 1702 Read 10 Done Done New false
4170 704 Acked 1703 Read 2 Done Done New false
4171 705 Acked 1704 Write 9 Done Done New false
4172 706 Acked 1705 Write 7 Done Done New false
4173 707 Acked 1706 Read 10 Done Done New false
4174 708 Acked 1707 Write 6 Done Done New false
4175 709 Acked 1708 Read 2 Done Done New false
4176 710 Acked 1709 Read 6 Done Done New false
4177 711 Acked 1710 Flush 0 Done Done New false
4178 712 Acked 1711 Flush 0 Done Done New false
4179 713 Acked 1712 Write 2 Done Done New false
4180 714 Acked 1713 Read 4 Done Done New false
4181 715 Acked 1714 Write 1 Done Done New false
4182 716 Acked 1715 Flush 0 Done Done New false
4183 717 Acked 1716 Write 8 Done Done New false
4184 718 Acked 1717 Read 6 Done Done New false
4185 719 Acked 1718 Flush 0 Done Done New false
4186 720 Acked 1719 Write 10 Done Done New false
4187 721 Acked 1720 Read 9 Done Done New false
4188 722 Acked 1721 Read 9 Done Done New false
4189 723 Acked 1722 Read 7 Done Done New false
4190 724 Acked 1723 Read 9 Done Done New false
4191 725 Acked 1724 Read 3 Done Done New false
4192 726 Acked 1725 Read 6 Done Done New false
4193 727 Acked 1726 Read 4 Done Done New false
4194 728 Acked 1727 Write 2 Done Done New false
4195 729 Acked 1728 Flush 0 Done Done New false
4196 730 Acked 1729 Flush 0 Done Done New false
4197 731 Acked 1730 Read 3 Done Done New false
4198 732 Acked 1731 Read 8 Done Done New false
4199 733 Acked 1732 Read 3 Done Done New false
4200 734 Acked 1733 Read 6 Done Done New false
4201 735 Acked 1734 Write 1 Done Done New false
4202 736 Acked 1735 Write 2 Done Done New false
4203 737 Acked 1736 Write 10 Done Done New false
4204 738 Acked 1737 Write 7 Done Done New false
4205 739 Acked 1738 Read 1 Done Done New false
4206 740 Acked 1739 Write 6 Done Done New false
4207 741 Acked 1740 Read 8 Done Done New false
4208 742 Acked 1741 Read 6 Done Done New false
4209 743 Acked 1742 Write 1 Done Done New false
4210 744 Acked 1743 Write 9 Done Done New false
4211 745 Acked 1744 Read 3 Done Done New false
4212 746 Acked 1745 Write 7 Done Done New false
4213 747 Acked 1746 Write 4 Done Done New false
4214 748 Acked 1747 Read 4 Done Done New false
4215 749 Acked 1748 Read 6 Done Done New false
4216 750 Acked 1749 Write 7 Done Done New false
4217 751 Acked 1750 Flush 0 Done Done New false
4218 752 Acked 1751 Write 1 Done Done New false
4219 753 Acked 1752 Read 2 Done Done New false
4220 754 Acked 1753 Write 8 Done Done New false
4221 755 Acked 1754 Write 3 Done Done New false
4222 756 Acked 1755 Read 2 Done Done New false
4223 757 Acked 1756 Write 6 Done Done New false
4224 758 Acked 1757 Write 2 Done Done New false
4225 759 Acked 1758 Read 2 Done Done New false
4226 760 Acked 1759 Read 2 Done Done New false
4227 761 Acked 1760 Write 2 Done Done New false
4228 762 Acked 1761 Read 8 Done Done New false
4229 763 Acked 1762 Read 4 Done Done New false
4230 764 Acked 1763 Write 9 Done Done New false
4231 765 Acked 1764 Read 7 Done Done New false
4232 766 Acked 1765 Read 6 Done Done New false
4233 767 Acked 1766 Read 10 Done Done New false
4234 768 Acked 1767 Read 2 Done Done New false
4235 769 Acked 1768 Read 6 Done Done New false
4236 770 Acked 1769 Read 10 Done Done New false
4237 771 Acked 1770 Write 7 Done Done New false
4238 772 Acked 1771 Write 10 Done Done New false
4239 773 Acked 1772 Read 7 Done Done New false
4240 774 Acked 1773 Read 8 Done Done New false
4241 775 Acked 1774 Read 1 Done Done New false
4242 776 Acked 1775 Flush 0 Done Done New false
4243 777 Acked 1776 Write 7 Done Done New false
4244 778 Acked 1777 Read 3 Done Done New false
4245 779 Acked 1778 Read 7 Done Done New false
4246 780 Acked 1779 Write 5 Done Done New false
4247 781 Acked 1780 Read 10 Done Done New false
4248 782 Acked 1781 Write 9 Done Done New false
4249 783 Acked 1782 Flush 0 Done Done New false
4250 784 Acked 1783 Read 4 Done Done New false
4251 785 Acked 1784 Read 10 Done Done New false
4252 786 Acked 1785 Write 10 Done Done New false
4253 787 Acked 1786 Write 2 Done Done New false
4254 788 Acked 1787 Read 3 Done Done New false
4255 789 Acked 1788 Write 8 Done Done New false
4256 790 Acked 1789 Write 5 Done Done New false
4257 791 Acked 1790 Write 7 Done Done New false
4258 792 Acked 1791 Write 8 Done Done New false
4259 793 Acked 1792 Write 2 Done Done New false
4260 794 Acked 1793 Read 10 Done Done New false
4261 795 Acked 1794 Read 1 Done Done New false
4262 796 Acked 1795 Read 2 Done Done New false
4263 797 Acked 1796 Flush 0 Done Done New false
4264 798 Acked 1797 Read 5 Done Done New false
4265 799 Acked 1798 Read 4 Done Done New false
4266 800 Acked 1799 Write 9 Done Done New false
4267 801 Acked 1800 Read 9 Done Done New false
4268 802 Acked 1801 Read 1 Done Done New false
4269 803 Acked 1802 Flush 0 Done Done New false
4270 804 Acked 1803 Write 2 Done Done New false
4271 805 Acked 1804 Read 5 Done Done New false
4272 806 Acked 1805 Write 8 Done Done New false
4273 807 Acked 1806 Write 3 Done Done New false
4274 808 Acked 1807 Read 2 Done Done New false
4275 809 Acked 1808 Read 3 Done Done New false
4276 810 Acked 1809 Read 4 Done Done New false
4277 811 Acked 1810 Read 1 Done Done New false
4278 812 Acked 1811 Read 4 Done Done New false
4279 813 Acked 1812 Write 1 Done Done New false
4280 814 Acked 1813 Write 10 Done Done New false
4281 815 Acked 1814 Write 6 Done Done New false
4282 816 Acked 1815 Read 6 Done Done New false
4283 817 Acked 1816 Read 1 Done Done New false
4284 818 Acked 1817 Write 9 Done Done New false
4285 819 Acked 1818 Read 10 Done Done New false
4286 820 Acked 1819 Write 5 Done Done New false
4287 821 Acked 1820 Read 3 Done Done New false
4288 822 Acked 1821 Write 5 Done Done New false
4289 823 Acked 1822 Write 1 Done Done New false
4290 824 Acked 1823 Write 3 Done Done New false
4291 825 Acked 1824 Write 2 Done Done New false
4292 826 Acked 1825 Read 1 Done Done New false
4293 827 Acked 1826 Write 9 Done Done New false
4294 828 Acked 1827 Read 8 Done Done New false
4295 829 Acked 1828 Read 1 Done Done New false
4296 830 Acked 1829 Read 6 Done Done New false
4297 831 Acked 1830 Read 8 Done Done New false
4298 832 Acked 1831 Read 1 Done Done New false
4299 833 Acked 1832 Read 8 Done Done New false
4300 834 Acked 1833 Write 3 Done Done New false
4301 835 Acked 1834 Read 5 Done Done New false
4302 836 Acked 1835 Read 10 Done Done New false
4303 837 Acked 1836 Read 3 Done Done New false
4304 838 Acked 1837 Write 4 Done Done New false
4305 839 Acked 1838 Write 2 Done Done New false
4306 840 Acked 1839 Flush 0 Done Done New false
4307 841 Acked 1840 Write 8 Done Done New false
4308 842 Acked 1841 Write 6 Done Done New false
4309 843 Acked 1842 Write 2 Done Done New false
4310 844 Acked 1843 Read 1 Done Done New false
4311 845 Acked 1844 Write 9 Done Done New false
4312 846 Acked 1845 Write 10 Done Done New false
4313 847 Acked 1846 Write 7 Done Done New false
4314 848 Acked 1847 Write 1 Done Done New false
4315 849 Acked 1848 Write 8 Done Done New false
4316 850 Acked 1849 Read 4 Done Done New false
4317 851 Acked 1850 Write 1 Done Done New false
4318 852 Acked 1851 Write 10 Done Done New false
4319 853 Acked 1852 Read 9 Done Done New false
4320 854 Acked 1853 Read 1 Done Done New false
4321 855 Acked 1854 Flush 0 Done Done New false
4322 856 Acked 1855 Read 4 Done Done New false
4323 857 Acked 1856 Read 1 Done Done New false
4324 858 Acked 1857 Write 8 Done Done New false
4325 859 Acked 1858 Read 4 Done Done New false
4326 860 Acked 1859 Read 2 Done Done New false
4327 861 Acked 1860 Write 2 Done Done New false
4328 862 Acked 1861 Write 7 Done Done New false
4329 863 Acked 1862 Write 9 Done Done New false
4330 864 Acked 1863 Read 4 Done Done New false
4331 865 Acked 1864 Read 2 Done Done New false
4332 866 Acked 1865 Flush 0 Done Done New false
4333 867 Acked 1866 Write 7 Done Done New false
4334 868 Acked 1867 Write 5 Done Done New false
4335 869 Acked 1868 Read 9 Done Done New false
4336 870 Acked 1869 Read 7 Done Done New false
4337 871 Acked 1870 Read 4 Done Done New false
4338 872 Acked 1871 Read 10 Done Done New false
4339 873 Acked 1872 Write 6 Done Done New false
4340 874 Acked 1873 Write 1 Done Done New false
4341 875 Acked 1874 Read 1 Done Done New false
4342 876 Acked 1875 Flush 0 Done Done New false
4343 877 Acked 1876 Read 6 Done Done New false
4344 878 Acked 1877 Write 7 Done Done New false
4345 879 Acked 1878 Read 5 Done Done New false
4346 880 Acked 1879 Read 8 Done Done New false
4347 881 Acked 1880 Write 6 Done Done New false
4348 882 Acked 1881 Write 4 Done Done New false
4349 883 Acked 1882 Read 3 Done Done New false
4350 884 Acked 1883 Read 3 Done Done New false
4351 885 Acked 1884 Write 5 Done Done New false
4352 886 Acked 1885 Read 4 Done Done New false
4353 887 Acked 1886 Read 10 Done Done New false
4354 888 Acked 1887 Read 2 Done Done New false
4355 889 Acked 1888 Read 5 Done Done New false
4356 890 Acked 1889 Read 7 Done Done New false
4357 891 Acked 1890 Write 6 Done Done New false
4358 892 Acked 1891 Read 8 Done Done New false
4359 893 Acked 1892 Read 2 Done Done New false
4360 894 Acked 1893 Read 4 Done Done New false
4361 895 Acked 1894 Read 1 Done Done New false
4362 896 Acked 1895 Write 7 Done Done New false
4363 897 Acked 1896 Write 5 Done Done New false
4364 898 Acked 1897 Read 7 Done Done New false
4365 899 Acked 1898 Read 10 Done Done New false
4366 900 Acked 1899 Write 9 Done Done New false
4367 901 Acked 1900 Write 6 Done Done New false
4368 902 Acked 1901 Write 9 Done Done New false
4369 903 Acked 1902 Read 7 Done Done New false
4370 904 Acked 1903 Flush 0 Done Done New false
4371 STATES DS:0 DS:1 DS:2 TOTAL
4372 New 0 0 301 301
4373 Sent 0 0 0 0
4374 Done 301 301 0 602
4375 Skipped 0 0 0 0
4376 Error 0 0 0 0
4377 Last Flush: 1903 1903 1602
4378 Downstairs last five completed: 1602 1601 1600 1599 1598
4379 Upstairs last five completed: 904 903 902 901 900
4380 CLIENT: Up:0 ds:301 act:2
43812024-04-20T01:05:58.675ZINFOcrucible: connecting to 127.0.0.1:8830 = io task client = 2 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
43822024-04-20T01:05:58.675ZWARNcrucible: ds_connection connect to 127.0.0.1:8830 failure: Os { code: 146, kind: ConnectionRefused, message: "Connection refused" } = io task client = 2 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
43832024-04-20T01:05:58.675ZWARNcrucible: client task is sending Done(ConnectionFailed(Os { code: 146, kind: ConnectionRefused, message: "Connection refused" })) = io task client = 2 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
43842024-04-20T01:05:58.675ZWARNcrucible: downstairs task for 2 stopped due to ConnectionFailed(Os { code: 146, kind: ConnectionRefused, message: "Connection refused" }) session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
43852024-04-20T01:05:58.675ZINFOcrucible: [2] client re-new 301 jobs since flush 1602 = downstairs session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
43862024-04-20T01:05:58.675ZINFOcrucible: [2] Marked 0 jobs for replay since flush: 1602 = downstairs session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
43872024-04-20T01:05:58.675ZINFOcrucible: client task is exiting = io task client = 2 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
4388 [8830] got start action
4389 [8830] I am going to restart
4390 Starting downstairs at port 8830
4391 Make output file at "/tmp/dsc/downstairs-8830.txt"
4392 [8830][2] reports Starting
4393 Downstairs /var/tmp/dsc/region/8830 port 8830 PID:Some(1199)
4394 [8830][2] reports Running
4395 ----------------------------------------------------------------
4396 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:301
4397 States: Active Active Offline
4398 GW_ID ACK DSID TYPE BLOCKS DS:0 DS:1 DS:2 REPLAY
4399 604 Acked 1603 Write 10 Done Done New true
4400 605 Acked 1604 Read 8 Done Done New true
4401 606 Acked 1605 Flush 0 Done Done New true
4402 607 Acked 1606 Read 7 Done Done New true
4403 608 Acked 1607 Read 7 Done Done New true
4404 609 Acked 1608 Read 9 Done Done New true
4405 610 Acked 1609 Read 1 Done Done New true
4406 611 Acked 1610 Write 10 Done Done New true
4407 612 Acked 1611 Read 4 Done Done New true
4408 613 Acked 1612 Read 6 Done Done New true
4409 614 Acked 1613 Read 10 Done Done New true
4410 615 Acked 1614 Read 10 Done Done New true
4411 616 Acked 1615 Read 7 Done Done New true
4412 617 Acked 1616 Read 3 Done Done New true
4413 618 Acked 1617 Flush 0 Done Done New true
4414 619 Acked 1618 Read 3 Done Done New true
4415 620 Acked 1619 Flush 0 Done Done New true
4416 621 Acked 1620 Read 8 Done Done New true
4417 622 Acked 1621 Write 8 Done Done New true
4418 623 Acked 1622 Read 10 Done Done New true
4419 624 Acked 1623 Write 9 Done Done New true
4420 625 Acked 1624 Read 4 Done Done New true
4421 626 Acked 1625 Flush 0 Done Done New true
4422 627 Acked 1626 Write 9 Done Done New true
4423 628 Acked 1627 Write 1 Done Done New true
4424 629 Acked 1628 Flush 0 Done Done New true
4425 630 Acked 1629 Write 5 Done Done New true
4426 631 Acked 1630 Read 3 Done Done New true
4427 632 Acked 1631 Flush 0 Done Done New true
4428 633 Acked 1632 Flush 0 Done Done New true
4429 634 Acked 1633 Read 4 Done Done New true
4430 635 Acked 1634 Read 10 Done Done New true
4431 636 Acked 1635 Read 4 Done Done New true
4432 637 Acked 1636 Read 1 Done Done New true
4433 638 Acked 1637 Write 10 Done Done New true
4434 639 Acked 1638 Read 5 Done Done New true
4435 640 Acked 1639 Read 9 Done Done New true
4436 641 Acked 1640 Read 5 Done Done New true
4437 642 Acked 1641 Write 10 Done Done New true
4438 643 Acked 1642 Read 3 Done Done New true
4439 644 Acked 1643 Read 4 Done Done New true
4440 645 Acked 1644 Write 2 Done Done New true
4441 646 Acked 1645 Write 4 Done Done New true
4442 647 Acked 1646 Write 10 Done Done New true
4443 648 Acked 1647 Read 7 Done Done New true
4444 649 Acked 1648 Read 9 Done Done New true
4445 650 Acked 1649 Write 2 Done Done New true
4446 651 Acked 1650 Write 3 Done Done New true
4447 652 Acked 1651 Write 7 Done Done New true
4448 653 Acked 1652 Read 3 Done Done New true
4449 654 Acked 1653 Read 6 Done Done New true
4450 655 Acked 1654 Flush 0 Done Done New true
4451 656 Acked 1655 Write 9 Done Done New true
4452 657 Acked 1656 Write 5 Done Done New true
4453 658 Acked 1657 Read 7 Done Done New true
4454 659 Acked 1658 Write 8 Done Done New true
4455 660 Acked 1659 Read 6 Done Done New true
4456 661 Acked 1660 Read 6 Done Done New true
4457 662 Acked 1661 Read 9 Done Done New true
4458 663 Acked 1662 Read 7 Done Done New true
4459 664 Acked 1663 Write 9 Done Done New true
4460 665 Acked 1664 Write 3 Done Done New true
4461 666 Acked 1665 Write 6 Done Done New true
4462 667 Acked 1666 Read 5 Done Done New true
4463 668 Acked 1667 Write 1 Done Done New true
4464 669 Acked 1668 Read 5 Done Done New true
4465 670 Acked 1669 Flush 0 Done Done New true
4466 671 Acked 1670 Write 4 Done Done New true
4467 672 Acked 1671 Write 3 Done Done New true
4468 673 Acked 1672 Write 10 Done Done New true
4469 674 Acked 1673 Write 9 Done Done New true
4470 675 Acked 1674 Read 1 Done Done New true
4471 676 Acked 1675 Read 5 Done Done New true
4472 677 Acked 1676 Read 3 Done Done New true
4473 678 Acked 1677 Write 2 Done Done New true
4474 679 Acked 1678 Write 4 Done Done New true
4475 680 Acked 1679 Write 6 Done Done New true
4476 681 Acked 1680 Write 8 Done Done New true
4477 682 Acked 1681 Write 8 Done Done New true
4478 683 Acked 1682 Write 3 Done Done New true
4479 684 Acked 1683 Write 7 Done Done New true
4480 685 Acked 1684 Write 2 Done Done New true
4481 686 Acked 1685 Read 8 Done Done New true
4482 687 Acked 1686 Write 1 Done Done New true
4483 688 Acked 1687 Read 7 Done Done New true
4484 689 Acked 1688 Write 1 Done Done New true
4485 690 Acked 1689 Write 4 Done Done New true
4486 691 Acked 1690 Write 9 Done Done New true
4487 692 Acked 1691 Read 2 Done Done New true
4488 693 Acked 1692 Write 8 Done Done New true
4489 694 Acked 1693 Write 2 Done Done New true
4490 695 Acked 1694 Read 1 Done Done New true
4491 696 Acked 1695 Read 5 Done Done New true
4492 697 Acked 1696 Read 1 Done Done New true
4493 698 Acked 1697 Write 1 Done Done New true
4494 699 Acked 1698 Write 6 Done Done New true
4495 700 Acked 1699 Write 5 Done Done New true
4496 701 Acked 1700 Read 1 Done Done New true
4497 702 Acked 1701 Read 10 Done Done New true
4498 703 Acked 1702 Read 10 Done Done New true
4499 704 Acked 1703 Read 2 Done Done New true
4500 705 Acked 1704 Write 9 Done Done New true
4501 706 Acked 1705 Write 7 Done Done New true
4502 707 Acked 1706 Read 10 Done Done New true
4503 708 Acked 1707 Write 6 Done Done New true
4504 709 Acked 1708 Read 2 Done Done New true
4505 710 Acked 1709 Read 6 Done Done New true
4506 711 Acked 1710 Flush 0 Done Done New true
4507 712 Acked 1711 Flush 0 Done Done New true
4508 713 Acked 1712 Write 2 Done Done New true
4509 714 Acked 1713 Read 4 Done Done New true
4510 715 Acked 1714 Write 1 Done Done New true
4511 716 Acked 1715 Flush 0 Done Done New true
4512 717 Acked 1716 Write 8 Done Done New true
4513 718 Acked 1717 Read 6 Done Done New true
4514 719 Acked 1718 Flush 0 Done Done New true
4515 720 Acked 1719 Write 10 Done Done New true
4516 721 Acked 1720 Read 9 Done Done New true
4517 722 Acked 1721 Read 9 Done Done New true
4518 723 Acked 1722 Read 7 Done Done New true
4519 724 Acked 1723 Read 9 Done Done New true
4520 725 Acked 1724 Read 3 Done Done New true
4521 726 Acked 1725 Read 6 Done Done New true
4522 727 Acked 1726 Read 4 Done Done New true
4523 728 Acked 1727 Write 2 Done Done New true
4524 729 Acked 1728 Flush 0 Done Done New true
4525 730 Acked 1729 Flush 0 Done Done New true
4526 731 Acked 1730 Read 3 Done Done New true
4527 732 Acked 1731 Read 8 Done Done New true
4528 733 Acked 1732 Read 3 Done Done New true
4529 734 Acked 1733 Read 6 Done Done New true
4530 735 Acked 1734 Write 1 Done Done New true
4531 736 Acked 1735 Write 2 Done Done New true
4532 737 Acked 1736 Write 10 Done Done New true
4533 738 Acked 1737 Write 7 Done Done New true
4534 739 Acked 1738 Read 1 Done Done New true
4535 740 Acked 1739 Write 6 Done Done New true
4536 741 Acked 1740 Read 8 Done Done New true
4537 742 Acked 1741 Read 6 Done Done New true
4538 743 Acked 1742 Write 1 Done Done New true
4539 744 Acked 1743 Write 9 Done Done New true
4540 745 Acked 1744 Read 3 Done Done New true
4541 746 Acked 1745 Write 7 Done Done New true
4542 747 Acked 1746 Write 4 Done Done New true
4543 748 Acked 1747 Read 4 Done Done New true
4544 749 Acked 1748 Read 6 Done Done New true
4545 750 Acked 1749 Write 7 Done Done New true
4546 751 Acked 1750 Flush 0 Done Done New true
4547 752 Acked 1751 Write 1 Done Done New true
4548 753 Acked 1752 Read 2 Done Done New true
4549 754 Acked 1753 Write 8 Done Done New true
4550 755 Acked 1754 Write 3 Done Done New true
4551 756 Acked 1755 Read 2 Done Done New true
4552 757 Acked 1756 Write 6 Done Done New true
4553 758 Acked 1757 Write 2 Done Done New true
4554 759 Acked 1758 Read 2 Done Done New true
4555 760 Acked 1759 Read 2 Done Done New true
4556 761 Acked 1760 Write 2 Done Done New true
4557 762 Acked 1761 Read 8 Done Done New true
4558 763 Acked 1762 Read 4 Done Done New true
4559 764 Acked 1763 Write 9 Done Done New true
4560 765 Acked 1764 Read 7 Done Done New true
4561 766 Acked 1765 Read 6 Done Done New true
4562 767 Acked 1766 Read 10 Done Done New true
4563 768 Acked 1767 Read 2 Done Done New true
4564 769 Acked 1768 Read 6 Done Done New true
4565 770 Acked 1769 Read 10 Done Done New true
4566 771 Acked 1770 Write 7 Done Done New true
4567 772 Acked 1771 Write 10 Done Done New true
4568 773 Acked 1772 Read 7 Done Done New true
4569 774 Acked 1773 Read 8 Done Done New true
4570 775 Acked 1774 Read 1 Done Done New true
4571 776 Acked 1775 Flush 0 Done Done New true
4572 777 Acked 1776 Write 7 Done Done New true
4573 778 Acked 1777 Read 3 Done Done New true
4574 779 Acked 1778 Read 7 Done Done New true
4575 780 Acked 1779 Write 5 Done Done New true
4576 781 Acked 1780 Read 10 Done Done New true
4577 782 Acked 1781 Write 9 Done Done New true
4578 783 Acked 1782 Flush 0 Done Done New true
4579 784 Acked 1783 Read 4 Done Done New true
4580 785 Acked 1784 Read 10 Done Done New true
4581 786 Acked 1785 Write 10 Done Done New true
4582 787 Acked 1786 Write 2 Done Done New true
4583 788 Acked 1787 Read 3 Done Done New true
4584 789 Acked 1788 Write 8 Done Done New true
4585 790 Acked 1789 Write 5 Done Done New true
4586 791 Acked 1790 Write 7 Done Done New true
4587 792 Acked 1791 Write 8 Done Done New true
4588 793 Acked 1792 Write 2 Done Done New true
4589 794 Acked 1793 Read 10 Done Done New true
4590 795 Acked 1794 Read 1 Done Done New true
4591 796 Acked 1795 Read 2 Done Done New true
4592 797 Acked 1796 Flush 0 Done Done New true
4593 798 Acked 1797 Read 5 Done Done New true
4594 799 Acked 1798 Read 4 Done Done New true
4595 800 Acked 1799 Write 9 Done Done New true
4596 801 Acked 1800 Read 9 Done Done New true
4597 802 Acked 1801 Read 1 Done Done New true
4598 803 Acked 1802 Flush 0 Done Done New true
4599 804 Acked 1803 Write 2 Done Done New true
4600 805 Acked 1804 Read 5 Done Done New true
4601 806 Acked 1805 Write 8 Done Done New true
4602 807 Acked 1806 Write 3 Done Done New true
4603 808 Acked 1807 Read 2 Done Done New true
4604 809 Acked 1808 Read 3 Done Done New true
4605 810 Acked 1809 Read 4 Done Done New true
4606 811 Acked 1810 Read 1 Done Done New true
4607 812 Acked 1811 Read 4 Done Done New true
4608 813 Acked 1812 Write 1 Done Done New true
4609 814 Acked 1813 Write 10 Done Done New true
4610 815 Acked 1814 Write 6 Done Done New true
4611 816 Acked 1815 Read 6 Done Done New true
4612 817 Acked 1816 Read 1 Done Done New true
4613 818 Acked 1817 Write 9 Done Done New true
4614 819 Acked 1818 Read 10 Done Done New true
4615 820 Acked 1819 Write 5 Done Done New true
4616 821 Acked 1820 Read 3 Done Done New true
4617 822 Acked 1821 Write 5 Done Done New true
4618 823 Acked 1822 Write 1 Done Done New true
4619 824 Acked 1823 Write 3 Done Done New true
4620 825 Acked 1824 Write 2 Done Done New true
4621 826 Acked 1825 Read 1 Done Done New true
4622 827 Acked 1826 Write 9 Done Done New true
4623 828 Acked 1827 Read 8 Done Done New true
4624 829 Acked 1828 Read 1 Done Done New true
4625 830 Acked 1829 Read 6 Done Done New true
4626 831 Acked 1830 Read 8 Done Done New true
4627 832 Acked 1831 Read 1 Done Done New true
4628 833 Acked 1832 Read 8 Done Done New true
4629 834 Acked 1833 Write 3 Done Done New true
4630 835 Acked 1834 Read 5 Done Done New true
4631 836 Acked 1835 Read 10 Done Done New true
4632 837 Acked 1836 Read 3 Done Done New true
4633 838 Acked 1837 Write 4 Done Done New true
4634 839 Acked 1838 Write 2 Done Done New true
4635 840 Acked 1839 Flush 0 Done Done New true
4636 841 Acked 1840 Write 8 Done Done New true
4637 842 Acked 1841 Write 6 Done Done New true
4638 843 Acked 1842 Write 2 Done Done New true
4639 844 Acked 1843 Read 1 Done Done New true
4640 845 Acked 1844 Write 9 Done Done New true
4641 846 Acked 1845 Write 10 Done Done New true
4642 847 Acked 1846 Write 7 Done Done New true
4643 848 Acked 1847 Write 1 Done Done New true
4644 849 Acked 1848 Write 8 Done Done New true
4645 850 Acked 1849 Read 4 Done Done New true
4646 851 Acked 1850 Write 1 Done Done New true
4647 852 Acked 1851 Write 10 Done Done New true
4648 853 Acked 1852 Read 9 Done Done New true
4649 854 Acked 1853 Read 1 Done Done New true
4650 855 Acked 1854 Flush 0 Done Done New true
4651 856 Acked 1855 Read 4 Done Done New true
4652 857 Acked 1856 Read 1 Done Done New true
4653 858 Acked 1857 Write 8 Done Done New true
4654 859 Acked 1858 Read 4 Done Done New true
4655 860 Acked 1859 Read 2 Done Done New true
4656 861 Acked 1860 Write 2 Done Done New true
4657 862 Acked 1861 Write 7 Done Done New true
4658 863 Acked 1862 Write 9 Done Done New true
4659 864 Acked 1863 Read 4 Done Done New true
4660 865 Acked 1864 Read 2 Done Done New true
4661 866 Acked 1865 Flush 0 Done Done New true
4662 867 Acked 1866 Write 7 Done Done New true
4663 868 Acked 1867 Write 5 Done Done New true
4664 869 Acked 1868 Read 9 Done Done New true
4665 870 Acked 1869 Read 7 Done Done New true
4666 871 Acked 1870 Read 4 Done Done New true
4667 872 Acked 1871 Read 10 Done Done New true
4668 873 Acked 1872 Write 6 Done Done New true
4669 874 Acked 1873 Write 1 Done Done New true
4670 875 Acked 1874 Read 1 Done Done New true
4671 876 Acked 1875 Flush 0 Done Done New true
4672 877 Acked 1876 Read 6 Done Done New true
4673 878 Acked 1877 Write 7 Done Done New true
4674 879 Acked 1878 Read 5 Done Done New true
4675 880 Acked 1879 Read 8 Done Done New true
4676 881 Acked 1880 Write 6 Done Done New true
4677 882 Acked 1881 Write 4 Done Done New true
4678 883 Acked 1882 Read 3 Done Done New true
4679 884 Acked 1883 Read 3 Done Done New true
4680 885 Acked 1884 Write 5 Done Done New true
4681 886 Acked 1885 Read 4 Done Done New true
4682 887 Acked 1886 Read 10 Done Done New true
4683 888 Acked 1887 Read 2 Done Done New true
4684 889 Acked 1888 Read 5 Done Done New true
4685 890 Acked 1889 Read 7 Done Done New true
4686 891 Acked 1890 Write 6 Done Done New true
4687 892 Acked 1891 Read 8 Done Done New true
4688 893 Acked 1892 Read 2 Done Done New true
4689 894 Acked 1893 Read 4 Done Done New true
4690 895 Acked 1894 Read 1 Done Done New true
4691 896 Acked 1895 Write 7 Done Done New true
4692 897 Acked 1896 Write 5 Done Done New true
4693 898 Acked 1897 Read 7 Done Done New true
4694 899 Acked 1898 Read 10 Done Done New true
4695 900 Acked 1899 Write 9 Done Done New true
4696 901 Acked 1900 Write 6 Done Done New true
4697 902 Acked 1901 Write 9 Done Done New true
4698 903 Acked 1902 Read 7 Done Done New true
4699 904 Acked 1903 Flush 0 Done Done New true
4700 STATES DS:0 DS:1 DS:2 TOTAL
4701 New 0 0 301 301
4702 Sent 0 0 0 0
4703 Done 301 301 0 602
4704 Skipped 0 0 0 0
4705 Error 0 0 0 0
4706 Last Flush: 1903 1903 1602
4707 Downstairs last five completed: 1602 1601 1600 1599 1598
4708 Upstairs last five completed: 904 903 902 901 900
4709 CLIENT: Up:0 ds:301 act:2
4710 ----------------------------------------------------------------
4711 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:301
4712 States: Active Active Offline
4713 GW_ID ACK DSID TYPE BLOCKS DS:0 DS:1 DS:2 REPLAY
4714 604 Acked 1603 Write 10 Done Done New true
4715 605 Acked 1604 Read 8 Done Done New true
4716 606 Acked 1605 Flush 0 Done Done New true
4717 607 Acked 1606 Read 7 Done Done New true
4718 608 Acked 1607 Read 7 Done Done New true
4719 609 Acked 1608 Read 9 Done Done New true
4720 610 Acked 1609 Read 1 Done Done New true
4721 611 Acked 1610 Write 10 Done Done New true
4722 612 Acked 1611 Read 4 Done Done New true
4723 613 Acked 1612 Read 6 Done Done New true
4724 614 Acked 1613 Read 10 Done Done New true
4725 615 Acked 1614 Read 10 Done Done New true
4726 616 Acked 1615 Read 7 Done Done New true
4727 617 Acked 1616 Read 3 Done Done New true
4728 618 Acked 1617 Flush 0 Done Done New true
4729 619 Acked 1618 Read 3 Done Done New true
4730 620 Acked 1619 Flush 0 Done Done New true
4731 621 Acked 1620 Read 8 Done Done New true
4732 622 Acked 1621 Write 8 Done Done New true
4733 623 Acked 1622 Read 10 Done Done New true
4734 624 Acked 1623 Write 9 Done Done New true
4735 625 Acked 1624 Read 4 Done Done New true
4736 626 Acked 1625 Flush 0 Done Done New true
4737 627 Acked 1626 Write 9 Done Done New true
4738 628 Acked 1627 Write 1 Done Done New true
4739 629 Acked 1628 Flush 0 Done Done New true
4740 630 Acked 1629 Write 5 Done Done New true
4741 631 Acked 1630 Read 3 Done Done New true
4742 632 Acked 1631 Flush 0 Done Done New true
4743 633 Acked 1632 Flush 0 Done Done New true
4744 634 Acked 1633 Read 4 Done Done New true
4745 635 Acked 1634 Read 10 Done Done New true
4746 636 Acked 1635 Read 4 Done Done New true
4747 637 Acked 1636 Read 1 Done Done New true
4748 638 Acked 1637 Write 10 Done Done New true
4749 639 Acked 1638 Read 5 Done Done New true
4750 640 Acked 1639 Read 9 Done Done New true
4751 641 Acked 1640 Read 5 Done Done New true
4752 642 Acked 1641 Write 10 Done Done New true
4753 643 Acked 1642 Read 3 Done Done New true
4754 644 Acked 1643 Read 4 Done Done New true
4755 645 Acked 1644 Write 2 Done Done New true
4756 646 Acked 1645 Write 4 Done Done New true
4757 647 Acked 1646 Write 10 Done Done New true
4758 648 Acked 1647 Read 7 Done Done New true
4759 649 Acked 1648 Read 9 Done Done New true
4760 650 Acked 1649 Write 2 Done Done New true
4761 651 Acked 1650 Write 3 Done Done New true
4762 652 Acked 1651 Write 7 Done Done New true
4763 653 Acked 1652 Read 3 Done Done New true
4764 654 Acked 1653 Read 6 Done Done New true
4765 655 Acked 1654 Flush 0 Done Done New true
4766 656 Acked 1655 Write 9 Done Done New true
4767 657 Acked 1656 Write 5 Done Done New true
4768 658 Acked 1657 Read 7 Done Done New true
4769 659 Acked 1658 Write 8 Done Done New true
4770 660 Acked 1659 Read 6 Done Done New true
4771 661 Acked 1660 Read 6 Done Done New true
4772 662 Acked 1661 Read 9 Done Done New true
4773 663 Acked 1662 Read 7 Done Done New true
4774 664 Acked 1663 Write 9 Done Done New true
4775 665 Acked 1664 Write 3 Done Done New true
4776 666 Acked 1665 Write 6 Done Done New true
4777 667 Acked 1666 Read 5 Done Done New true
4778 668 Acked 1667 Write 1 Done Done New true
4779 669 Acked 1668 Read 5 Done Done New true
4780 670 Acked 1669 Flush 0 Done Done New true
4781 671 Acked 1670 Write 4 Done Done New true
4782 672 Acked 1671 Write 3 Done Done New true
4783 673 Acked 1672 Write 10 Done Done New true
4784 674 Acked 1673 Write 9 Done Done New true
4785 675 Acked 1674 Read 1 Done Done New true
4786 676 Acked 1675 Read 5 Done Done New true
4787 677 Acked 1676 Read 3 Done Done New true
4788 678 Acked 1677 Write 2 Done Done New true
4789 679 Acked 1678 Write 4 Done Done New true
4790 680 Acked 1679 Write 6 Done Done New true
4791 681 Acked 1680 Write 8 Done Done New true
4792 682 Acked 1681 Write 8 Done Done New true
4793 683 Acked 1682 Write 3 Done Done New true
4794 684 Acked 1683 Write 7 Done Done New true
4795 685 Acked 1684 Write 2 Done Done New true
4796 686 Acked 1685 Read 8 Done Done New true
4797 687 Acked 1686 Write 1 Done Done New true
4798 688 Acked 1687 Read 7 Done Done New true
4799 689 Acked 1688 Write 1 Done Done New true
4800 690 Acked 1689 Write 4 Done Done New true
4801 691 Acked 1690 Write 9 Done Done New true
4802 692 Acked 1691 Read 2 Done Done New true
4803 693 Acked 1692 Write 8 Done Done New true
4804 694 Acked 1693 Write 2 Done Done New true
4805 695 Acked 1694 Read 1 Done Done New true
4806 696 Acked 1695 Read 5 Done Done New true
4807 697 Acked 1696 Read 1 Done Done New true
4808 698 Acked 1697 Write 1 Done Done New true
4809 699 Acked 1698 Write 6 Done Done New true
4810 700 Acked 1699 Write 5 Done Done New true
4811 701 Acked 1700 Read 1 Done Done New true
4812 702 Acked 1701 Read 10 Done Done New true
4813 703 Acked 1702 Read 10 Done Done New true
4814 704 Acked 1703 Read 2 Done Done New true
4815 705 Acked 1704 Write 9 Done Done New true
4816 706 Acked 1705 Write 7 Done Done New true
4817 707 Acked 1706 Read 10 Done Done New true
4818 708 Acked 1707 Write 6 Done Done New true
4819 709 Acked 1708 Read 2 Done Done New true
4820 710 Acked 1709 Read 6 Done Done New true
4821 711 Acked 1710 Flush 0 Done Done New true
4822 712 Acked 1711 Flush 0 Done Done New true
4823 713 Acked 1712 Write 2 Done Done New true
4824 714 Acked 1713 Read 4 Done Done New true
4825 715 Acked 1714 Write 1 Done Done New true
4826 716 Acked 1715 Flush 0 Done Done New true
4827 717 Acked 1716 Write 8 Done Done New true
4828 718 Acked 1717 Read 6 Done Done New true
4829 719 Acked 1718 Flush 0 Done Done New true
4830 720 Acked 1719 Write 10 Done Done New true
4831 721 Acked 1720 Read 9 Done Done New true
4832 722 Acked 1721 Read 9 Done Done New true
4833 723 Acked 1722 Read 7 Done Done New true
4834 724 Acked 1723 Read 9 Done Done New true
4835 725 Acked 1724 Read 3 Done Done New true
4836 726 Acked 1725 Read 6 Done Done New true
4837 727 Acked 1726 Read 4 Done Done New true
4838 728 Acked 1727 Write 2 Done Done New true
4839 729 Acked 1728 Flush 0 Done Done New true
4840 730 Acked 1729 Flush 0 Done Done New true
4841 731 Acked 1730 Read 3 Done Done New true
4842 732 Acked 1731 Read 8 Done Done New true
4843 733 Acked 1732 Read 3 Done Done New true
4844 734 Acked 1733 Read 6 Done Done New true
4845 735 Acked 1734 Write 1 Done Done New true
4846 736 Acked 1735 Write 2 Done Done New true
4847 737 Acked 1736 Write 10 Done Done New true
4848 738 Acked 1737 Write 7 Done Done New true
4849 739 Acked 1738 Read 1 Done Done New true
4850 740 Acked 1739 Write 6 Done Done New true
4851 741 Acked 1740 Read 8 Done Done New true
4852 742 Acked 1741 Read 6 Done Done New true
4853 743 Acked 1742 Write 1 Done Done New true
4854 744 Acked 1743 Write 9 Done Done New true
4855 745 Acked 1744 Read 3 Done Done New true
4856 746 Acked 1745 Write 7 Done Done New true
4857 747 Acked 1746 Write 4 Done Done New true
4858 748 Acked 1747 Read 4 Done Done New true
4859 749 Acked 1748 Read 6 Done Done New true
4860 750 Acked 1749 Write 7 Done Done New true
4861 751 Acked 1750 Flush 0 Done Done New true
4862 752 Acked 1751 Write 1 Done Done New true
4863 753 Acked 1752 Read 2 Done Done New true
4864 754 Acked 1753 Write 8 Done Done New true
4865 755 Acked 1754 Write 3 Done Done New true
4866 756 Acked 1755 Read 2 Done Done New true
4867 757 Acked 1756 Write 6 Done Done New true
4868 758 Acked 1757 Write 2 Done Done New true
4869 759 Acked 1758 Read 2 Done Done New true
4870 760 Acked 1759 Read 2 Done Done New true
4871 761 Acked 1760 Write 2 Done Done New true
4872 762 Acked 1761 Read 8 Done Done New true
4873 763 Acked 1762 Read 4 Done Done New true
4874 764 Acked 1763 Write 9 Done Done New true
4875 765 Acked 1764 Read 7 Done Done New true
4876 766 Acked 1765 Read 6 Done Done New true
4877 767 Acked 1766 Read 10 Done Done New true
4878 768 Acked 1767 Read 2 Done Done New true
4879 769 Acked 1768 Read 6 Done Done New true
4880 770 Acked 1769 Read 10 Done Done New true
4881 771 Acked 1770 Write 7 Done Done New true
4882 772 Acked 1771 Write 10 Done Done New true
4883 773 Acked 1772 Read 7 Done Done New true
4884 774 Acked 1773 Read 8 Done Done New true
4885 775 Acked 1774 Read 1 Done Done New true
4886 776 Acked 1775 Flush 0 Done Done New true
4887 777 Acked 1776 Write 7 Done Done New true
4888 778 Acked 1777 Read 3 Done Done New true
4889 779 Acked 1778 Read 7 Done Done New true
4890 780 Acked 1779 Write 5 Done Done New true
4891 781 Acked 1780 Read 10 Done Done New true
4892 782 Acked 1781 Write 9 Done Done New true
4893 783 Acked 1782 Flush 0 Done Done New true
4894 784 Acked 1783 Read 4 Done Done New true
4895 785 Acked 1784 Read 10 Done Done New true
4896 786 Acked 1785 Write 10 Done Done New true
4897 787 Acked 1786 Write 2 Done Done New true
4898 788 Acked 1787 Read 3 Done Done New true
4899 789 Acked 1788 Write 8 Done Done New true
4900 790 Acked 1789 Write 5 Done Done New true
4901 791 Acked 1790 Write 7 Done Done New true
4902 792 Acked 1791 Write 8 Done Done New true
4903 793 Acked 1792 Write 2 Done Done New true
4904 794 Acked 1793 Read 10 Done Done New true
4905 795 Acked 1794 Read 1 Done Done New true
4906 796 Acked 1795 Read 2 Done Done New true
4907 797 Acked 1796 Flush 0 Done Done New true
4908 798 Acked 1797 Read 5 Done Done New true
4909 799 Acked 1798 Read 4 Done Done New true
4910 800 Acked 1799 Write 9 Done Done New true
4911 801 Acked 1800 Read 9 Done Done New true
4912 802 Acked 1801 Read 1 Done Done New true
4913 803 Acked 1802 Flush 0 Done Done New true
4914 804 Acked 1803 Write 2 Done Done New true
4915 805 Acked 1804 Read 5 Done Done New true
4916 806 Acked 1805 Write 8 Done Done New true
4917 807 Acked 1806 Write 3 Done Done New true
4918 808 Acked 1807 Read 2 Done Done New true
4919 809 Acked 1808 Read 3 Done Done New true
4920 810 Acked 1809 Read 4 Done Done New true
4921 811 Acked 1810 Read 1 Done Done New true
4922 812 Acked 1811 Read 4 Done Done New true
4923 813 Acked 1812 Write 1 Done Done New true
4924 814 Acked 1813 Write 10 Done Done New true
4925 815 Acked 1814 Write 6 Done Done New true
4926 816 Acked 1815 Read 6 Done Done New true
4927 817 Acked 1816 Read 1 Done Done New true
4928 818 Acked 1817 Write 9 Done Done New true
4929 819 Acked 1818 Read 10 Done Done New true
4930 820 Acked 1819 Write 5 Done Done New true
4931 821 Acked 1820 Read 3 Done Done New true
4932 822 Acked 1821 Write 5 Done Done New true
4933 823 Acked 1822 Write 1 Done Done New true
4934 824 Acked 1823 Write 3 Done Done New true
4935 825 Acked 1824 Write 2 Done Done New true
4936 826 Acked 1825 Read 1 Done Done New true
4937 827 Acked 1826 Write 9 Done Done New true
4938 828 Acked 1827 Read 8 Done Done New true
4939 829 Acked 1828 Read 1 Done Done New true
4940 830 Acked 1829 Read 6 Done Done New true
4941 831 Acked 1830 Read 8 Done Done New true
4942 832 Acked 1831 Read 1 Done Done New true
4943 833 Acked 1832 Read 8 Done Done New true
4944 834 Acked 1833 Write 3 Done Done New true
4945 835 Acked 1834 Read 5 Done Done New true
4946 836 Acked 1835 Read 10 Done Done New true
4947 837 Acked 1836 Read 3 Done Done New true
4948 838 Acked 1837 Write 4 Done Done New true
4949 839 Acked 1838 Write 2 Done Done New true
4950 840 Acked 1839 Flush 0 Done Done New true
4951 841 Acked 1840 Write 8 Done Done New true
4952 842 Acked 1841 Write 6 Done Done New true
4953 843 Acked 1842 Write 2 Done Done New true
4954 844 Acked 1843 Read 1 Done Done New true
4955 845 Acked 1844 Write 9 Done Done New true
4956 846 Acked 1845 Write 10 Done Done New true
4957 847 Acked 1846 Write 7 Done Done New true
4958 848 Acked 1847 Write 1 Done Done New true
4959 849 Acked 1848 Write 8 Done Done New true
4960 850 Acked 1849 Read 4 Done Done New true
4961 851 Acked 1850 Write 1 Done Done New true
4962 852 Acked 1851 Write 10 Done Done New true
4963 853 Acked 1852 Read 9 Done Done New true
4964 854 Acked 1853 Read 1 Done Done New true
4965 855 Acked 1854 Flush 0 Done Done New true
4966 856 Acked 1855 Read 4 Done Done New true
4967 857 Acked 1856 Read 1 Done Done New true
4968 858 Acked 1857 Write 8 Done Done New true
4969 859 Acked 1858 Read 4 Done Done New true
4970 860 Acked 1859 Read 2 Done Done New true
4971 861 Acked 1860 Write 2 Done Done New true
4972 862 Acked 1861 Write 7 Done Done New true
4973 863 Acked 1862 Write 9 Done Done New true
4974 864 Acked 1863 Read 4 Done Done New true
4975 865 Acked 1864 Read 2 Done Done New true
4976 866 Acked 1865 Flush 0 Done Done New true
4977 867 Acked 1866 Write 7 Done Done New true
4978 868 Acked 1867 Write 5 Done Done New true
4979 869 Acked 1868 Read 9 Done Done New true
4980 870 Acked 1869 Read 7 Done Done New true
4981 871 Acked 1870 Read 4 Done Done New true
4982 872 Acked 1871 Read 10 Done Done New true
4983 873 Acked 1872 Write 6 Done Done New true
4984 874 Acked 1873 Write 1 Done Done New true
4985 875 Acked 1874 Read 1 Done Done New true
4986 876 Acked 1875 Flush 0 Done Done New true
4987 877 Acked 1876 Read 6 Done Done New true
4988 878 Acked 1877 Write 7 Done Done New true
4989 879 Acked 1878 Read 5 Done Done New true
4990 880 Acked 1879 Read 8 Done Done New true
4991 881 Acked 1880 Write 6 Done Done New true
4992 882 Acked 1881 Write 4 Done Done New true
4993 883 Acked 1882 Read 3 Done Done New true
4994 884 Acked 1883 Read 3 Done Done New true
4995 885 Acked 1884 Write 5 Done Done New true
4996 886 Acked 1885 Read 4 Done Done New true
4997 887 Acked 1886 Read 10 Done Done New true
4998 888 Acked 1887 Read 2 Done Done New true
4999 889 Acked 1888 Read 5 Done Done New true
5000 890 Acked 1889 Read 7 Done Done New true
5001 891 Acked 1890 Write 6 Done Done New true
5002 892 Acked 1891 Read 8 Done Done New true
5003 893 Acked 1892 Read 2 Done Done New true
5004 894 Acked 1893 Read 4 Done Done New true
5005 895 Acked 1894 Read 1 Done Done New true
5006 896 Acked 1895 Write 7 Done Done New true
5007 897 Acked 1896 Write 5 Done Done New true
5008 898 Acked 1897 Read 7 Done Done New true
5009 899 Acked 1898 Read 10 Done Done New true
5010 900 Acked 1899 Write 9 Done Done New true
5011 901 Acked 1900 Write 6 Done Done New true
5012 902 Acked 1901 Write 9 Done Done New true
5013 903 Acked 1902 Read 7 Done Done New true
5014 904 Acked 1903 Flush 0 Done Done New true
5015 STATES DS:0 DS:1 DS:2 TOTAL
5016 New 0 0 301 301
5017 Sent 0 0 0 0
5018 Done 301 301 0 602
5019 Skipped 0 0 0 0
5020 Error 0 0 0 0
5021 Last Flush: 1903 1903 1602
5022 Downstairs last five completed: 1602 1601 1600 1599 1598
5023 Upstairs last five completed: 904 903 902 901 900
5024 CLIENT: Up:0 ds:301 act:2
50252024-04-20T01:06:08.677ZINFOcrucible: connecting to 127.0.0.1:8830 = io task client = 2 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
50262024-04-20T01:06:08.677ZINFOcrucible: ds_connection connected from Ok(127.0.0.1:45488) = io task client = 2 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
50272024-04-20T01:06:08.679ZINFOcrucible: downstairs client at Some(127.0.0.1:8830) has region UUID 12345678-0000-0000-0000-000000008830 = downstairs client = 2 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
50282024-04-20T01:06:08.679ZINFOcrucible: Returning UUID:12345678-0000-0000-0000-000000008830 matches = downstairs client = 2 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
50292024-04-20T01:06:08.679ZINFOcrucible: send last flush ID to this DS: 1602 = downstairs client = 2 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
50302024-04-20T01:06:08.679ZINFOcrucible: Replied this last flush ID: 1602 = downstairs client = 2 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
50312024-04-20T01:06:08.679ZINFOcrucible: ds_transition from Offline to Replay = downstairs client = 2 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
50322024-04-20T01:06:08.679ZINFOcrucible: [2] Transition from Offline to Replay = downstairs client = 2 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
50332024-04-20T01:06:08.679ZINFOcrucible: ds_transition from Replay to Active = downstairs client = 2 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
50342024-04-20T01:06:08.679ZINFOcrucible: [2] Transition from Replay to Active = downstairs client = 2 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
5035 ----------------------------------------------------------------
5036 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:0
5037 Downstairs last five completed: 1903 1902 1901 1900 1899
5038 Upstairs last five completed: 904 903 902 901 900
5039 CLIENT: Up:0 ds:0 act:3
5040 Replay: All jobs finished, all DS active.
5041 Main task has work to do, go find it
5042 got dsc Stop(2)
5043 stop 2
5044 Apr 20 01:06:08.993 INFO request completed, latency_us[8830] Got stop action so:false kr:false
5045 : 343, response_code: 204, uri: /stop/cid/2, method: POST, req_id: d9df78a0-22c6-4dcf-9c0f-228cd72adf4f, remote_addr: 127.0.0.1:60352, local_addr: 127.0.0.1:9998
50462024-04-20T01:06:08.994ZWARNcrucible: downstairs disconnected = io task client = 2 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
50472024-04-20T01:06:08.994ZWARNcrucible: client task is sending Done(Finished) = io task client = 2 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
50482024-04-20T01:06:08.994ZWARNcrucible: downstairs task for 2 stopped due to Finished session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
50492024-04-20T01:06:08.994ZINFOcrucible: Gone missing, transition from Active to Offline = downstairs client = 2 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
5050 Apr 20 01:06:08.994 INFO request completed, latency_us: 111, response_code: {"msg":"[2] client re-new 0 jobs since flush 1903","v":0,"name":"crucible","level":30,"time":"2024-04-20T01:06:08.994350629Z","hostname":"w-01HVWGBJP7HK0H9TQ26T6N3X8M","pid":1196,"":"downstairs","":"downstairs","session_id":"132b460a-26a0-4532-b1ab-4f8c07d4c6c7"}
5051 200, uri: /state/cid/2, method: GET{"msg":"[2] Marked 0 jobs for replay since flush: 1903","v":0,"name":"crucible","level":30,"time":"2024-04-20T01:06:08.994380858Z","hostname":"w-01HVWGBJP7HK0H9TQ26T6N3X8M","pid":1196,"":"downstairs","":"downstairs","session_id":"132b460a-26a0-4532-b1ab-4f8c07d4c6c7"}
5052 , req_id{"msg":"client task is exiting","v":0,"name":"crucible","level":30,"time":"2024-04-20T01:06:08.994423397Z","hostname":"w-01HVWGBJP7HK0H9TQ26T6N3X8M","pid":1196,"":"io task","client":"2","":"downstairs","session_id":"132b460a-26a0-4532-b1ab-4f8c07d4c6c7"}
5053 : 6f39bd0a-9266-45d2-a4e0-65dc410fcbd1, remote_addr: 127.0.0.1:60352, local_addr: 127.0.0.1:9998
5054 [8830] Exited with: ExitStatus(unix_wait_status(9))
5055 [8830][2] reports Exit
5056 Apr 20 01:06:12.997 INFO request completed, latency_us: 200, response_code: 200, uri: /state/cid/2, method: GET, req_id: 8eb3145c-5ada-41d8-b813-9a69e0374590, remote_addr: 127.0.0.1:60352, local_addr: 127.0.0.1:9998
5057 001/300 Write block 2641 len 16384 data: 2 3 3 3
5058 002/300 Write block 3219 len 8192 data: 2 2
5059 003/300 Read block 2520 len 4096
5060 004/300 Write block 4301 len 36864 data: 2 2 2 2 2 2 2 2 2
5061 005/300 Write block 4142 len 8192 data: 3 3
5062 006/300 Write block 4170 len 4096 data: 6
5063 007/300 Write block 1876 len 20480 data: 3 2 2 2 2
5064 008/300 Flush
5065 009/300 Read block 1330 len 8192
5066 010/300 Read block 3261 len 4096
5067 011/300 Write block 647 len 4096 data: 2
5068 012/300 Write block 3999 len 36864 data: 3 3 4 4 4 4 3 3 2
5069 013/300 Write block 1225 len 8192 data: 3 3
5070 014/300 Write block 1127 len 36864 data: 4 3 3 3 3 3 3 3 4
5071 015/300 Write block 3198 len 20480 data: 2 2 2 2 2
5072 016/300 Read block 3907 len 16384
5073 017/300 Flush
5074 018/300 Read block 4724 len 16384
5075 019/300 Read block 3325 len 12288
5076 020/300 Write block 645 len 20480 data: 3 2 3 2 2
5077 021/300 Write block 3405 len 8192 data: 2 3
5078 022/300 Read block 577 len 8192
5079 023/300 Read block 242 len 16384
5080 024/300 Write block 4861 len 4096 data: 2
5081 025/300 Write block 3595 len 20480 data: 2 2 2 2 2
5082 026/300 Flush
5083 027/300 Read block 1162 len 4096
5084 028/300 Read block 1701 len 4096
5085 029/300 Flush
5086 030/300 Read block 75 len 4096
5087 031/300 Flush
5088 032/300 Read block 294 len 32768
5089 033/300 Read block 4592 len 36864
5090 034/300 Write block 173 len 4096 data: 2
5091 035/300 Write block 4345 len 28672 data: 2 2 2 4 4 4 4
5092 036/300 Write block 1795 len 40960 data: 2 2 2 2 2 2 2 2 2 2
5093 037/300 Flush
5094 038/300 Read block 3005 len 12288
5095 039/300 Read block 1185 len 12288
5096 040/300 Read block 2271 len 4096
5097 041/300 Read block 1616 len 40960
5098 042/300 Read block 2097 len 28672
5099 043/300 Read block 3809 len 40960
5100 044/300 Write block 1358 len 24576 data: 2 3 3 3 3 3
5101 045/300 Write block 2578 len 16384 data: 2 2 2 2
5102 046/300 Flush
5103 047/300 Read block 3072 len 16384
5104 048/300 Read block 2520 len 4096
5105 049/300 Read block 3428 len 16384
5106 050/300 Write block 874 len 32768 data: 3 3 3 3 3 2 2 2
5107 051/300 Write block 3098 len 40960 data: 4 4 4 3 3 3 4 4 4 4
5108 052/300 Write block 2355 len 16384 data: 2 2 2 3
5109 053/300 Read block 1525 len 20480
5110 054/300 Read block 3093 len 40960
5111 055/300 Read block 276 len 16384
5112 056/300 Read block 1312 len 8192
5113 057/300 Read block 4250 len 12288
5114 058/300 Write block 1199 len 8192 data: 3 2
5115 059/300 Write block 2813 len 16384 data: 3 3 3 2
5116 060/300 Write block 1444 len 20480 data: 2 2 2 2 2
5117 061/300 Write block 3955 len 28672 data: 2 2 2 2 2 3 3
5118 062/300 Read block 3949 len 8192
5119 063/300 Read block 3121 len 8192
5120 064/300 Read block 865 len 4096
5121 065/300 Write block 4748 len 8192 data: 3 3
5122 066/300 Write block 4818 len 20480 data: 3 4 4 4 4
5123 067/300 Read block 1984 len 8192
5124 068/300 Write block 221 len 8192 data: 2 3
5125 069/300 Write block 3908 len 12288 data: 2 2 2
5126 070/300 Write block 12 len 24576 data: 3 3 3 3 3 2
5127 071/300 Read block 4636 len 28672
5128 072/300 Read block 3311 len 20480
5129 073/300 Read block 2191 len 36864
5130 074/300 Write block 4123 len 36864 data: 2 2 2 3 3 2 2 2 2
5131 075/300 Flush
5132 076/300 Read block 2441 len 20480
5133 077/300 Write block 1412 len 28672 data: 2 2 3 3 3 3 3
5134 078/300 Read block 4195 len 16384
5135 079/300 Flush
5136 080/300 Write block 2765 len 16384 data: 3 3 3 3
5137 081/300 Write block 361 len 32768 data: 2 2 2 2 2 2 2 3
5138 082/300 Write block 666 len 40960 data: 3 4 5 5 4 4 3 3 3 2
5139 083/300 Read block 3823 len 28672
5140 084/300 Write block 1155 len 12288 data: 4 3 3
5141 085/300 Read block 3799 len 20480
5142 086/300 Read block 376 len 4096
5143 087/300 Write block 2978 len 4096 data: 2
5144 088/300 Write block 3006 len 24576 data: 3 3 3 4 4 2
5145 089/300 Read block 2431 len 16384
5146 090/300 Read block 3437 len 40960
5147 091/300 Read block 1080 len 4096
5148 092/300 Read block 2485 len 16384
5149 093/300 Read block 3619 len 36864
5150 094/300 Write block 3900 len 4096 data: 3
5151 095/300 Read block 2296 len 24576
5152 096/300 Read block 4813 len 36864
5153 097/300 Read block 1277 len 20480
5154 098/300 Read block 2263 len 4096
5155 099/300 Write block 2366 len 28672 data: 2 2 2 2 2 2 2
5156 100/300 Write block 3917 len 24576 data: 3 3 3 3 2 2
5157 101/300 Write block 4424 len 4096 data: 2
5158 102/300 Write block 3434 len 8192 data: 4 4
5159 103/300 Flush
5160 104/300 Read block 4616 len 32768
5161 105/300 Flush
5162 106/300 Write block 2616 len 20480 data: 2 2 2 2 2
5163 107/300 Read block 4385 len 12288
5164 108/300 Read block 1949 len 4096
5165 109/300 Write block 4346 len 40960 data: 3 3 5 5 5 5 4 4 4 4
5166 110/300 Read block 453 len 36864
5167 111/300 Read block 3370 len 28672
5168 112/300 Read block 1510 len 20480
5169 113/300 Read block 1769 len 32768
5170 114/300 Read block 4898 len 20480
5171 115/300 Read block 2129 len 20480
5172 116/300 Read block 3596 len 32768
5173 117/300 Write block 1184 len 8192 data: 2 2
5174 118/300 Flush
5175 119/300 Write block 386 len 36864 data: 3 3 3 3 4 4 4 5 4
5176 120/300 Write block 325 len 4096 data: 2
5177 121/300 Read block 3129 len 12288
5178 122/300 Flush
5179 123/300 Write block 4868 len 20480 data: 3 3 3 3 4
5180 124/300 Read block 2573 len 32768
5181 125/300 Read block 2987 len 12288
5182 126/300 Read block 1552 len 32768
5183 127/300 Read block 987 len 8192
5184 128/300 Write block 3600 len 8192 data: 2 2
5185 129/300 Flush
5186 130/300 Flush
5187 131/300 Write block 3920 len 16384 data: 4 3 3 2
5188 132/300 Read block 645 len 28672
5189 133/300 Write block 1414 len 40960 data: 4 4 4 4 4 3 3 2 2 2
5190 134/300 Read block 2547 len 32768
5191 135/300 Write block 4559 len 24576 data: 2 2 2 2 2 2
5192 136/300 Read block 4175 len 16384
5193 137/300 Read block 533 len 4096
5194 138/300 Read block 4427 len 20480
5195 139/300 Read block 4806 len 8192
5196 140/300 Write block 657 len 32768 data: 2 2 2 2 3 3 3 3
5197 141/300 Flush
5198 142/300 Read block 1714 len 8192
5199 143/300 Write block 2624 len 28672 data: 2 2 2 2 2 2 2
5200 144/300 Write block 1270 len 4096 data: 3
5201 145/300 Write block 1124 len 24576 data: 3 3 3 5 4 4
5202 146/300 Read block 723 len 8192
5203 147/300 Read block 953 len 8192
5204 148/300 Read block 834 len 20480
5205 149/300 Flush
5206 150/300 Write block 189 len 16384 data: 3 3 3 3
5207 151/300 Write block 4444 len 40960 data: 3 3 3 3 3 3 4 3 3 3
5208 152/300 Read block 3156 len 4096
5209 153/300 Read block 1575 len 32768
5210 154/300 Write block 3116 len 8192 data: 2 2
5211 155/300 Write block 2423 len 20480 data: 2 2 2 2 2
5212 156/300 Write block 87 len 28672 data: 3 2 2 2 2 2 2
5213 157/300 Read block 1318 len 40960
5214 158/300 Read block 2966 len 28672
5215 159/300 Read block 1464 len 36864
5216 160/300 Write block 3391 len 40960 data: 2 2 2 2 2 2 2 2 2 3
5217 161/300 Write block 2019 len 36864 data: 2 3 3 3 4 4 3 3 2
5218 162/300 Write block 2992 len 32768 data: 3 3 4 3 3 3 3 3
5219 163/300 Read block 3679 len 24576
5220 164/300 Write block 3916 len 16384 data: 2 4 4 4
5221 165/300 Read block 951 len 16384
5222 166/300 Write block 2995 len 4096 data: 4
5223 167/300 Write block 2077 len 40960 data: 2 2 2 2 3 2 2 2 2 3
5224 168/300 Write block 682 len 20480 data: 2 2 2 2 2
5225 169/300 Write block 2835 len 8192 data: 2 2
5226 170/300 Write block 1888 len 4096 data: 2
5227 171/300 Write block 2689 len 8192 data: 2 2
5228 172/300 Read block 1809 len 16384
5229 173/300 Write block 1708 len 16384 data: 3 3 3 3
5230 174/300 Read block 249 len 20480
5231 175/300 Read block 390 len 36864
5232 176/300 Read block 2012 len 12288
5233 177/300 Read block 1253 len 4096
5234 178/300 Write block 4762 len 32768 data: 2 2 2 2 2 2 2 3
5235 179/300 Write block 4290 len 24576 data: 2 3 4 4 4 4
5236 180/300 Read block 4194 len 32768
5237 181/300 Flush
5238 182/300 Write block 4843 len 40960 data: 2 2 2 4 3 3 4 4 4 4
5239 183/300 Read block 2505 len 36864
5240 184/300 Read block 1836 len 12288
5241 185/300 Read block 3017 len 20480
5242 186/300 Read block 1923 len 36864
5243 187/300 Read block 1851 len 24576
5244 188/300 Flush
5245 189/300 Read block 3729 len 24576
5246 190/300 Flush
5247 191/300 Read block 4270 len 40960
5248 192/300 Read block 4115 len 32768
5249 193/300 Read block 424 len 16384
5250 194/300 Write block 175 len 28672 data: 2 2 2 2 2 2 2
5251 195/300 Read block 1315 len 4096
5252 196/300 Write block 888 len 32768 data: 2 2 2 2 2 2 2 2
5253 197/300 Read block 1241 len 4096
5254 198/300 Write block 4515 len 36864 data: 2 2 3 3 3 3 3 3 3
5255 199/300 Write block 3022 len 16384 data: 3 3 4 4
5256 200/300 Write block 2052 len 28672 data: 2 2 2 2 3 3 3
5257 201/300 Flush
5258 202/300 Write block 372 len 20480 data: 3 3 3 3 3
5259 203/300 Read block 1809 len 16384
5260 204/300 Write block 2527 len 16384 data: 2 2 2 2
5261 205/300 Read block 1409 len 36864
5262 206/300 Read block 1939 len 24576
5263 207/300 Write block 3855 len 20480 data: 2 2 2 2 2
5264 208/300 Write block 2377 len 24576 data: 2 2 2 2 2 2
5265 209/300 Write block 3429 len 16384 data: 3 3 4 5
5266 210/300 Read block 317 len 32768
5267 211/300 Read block 1400 len 28672
5268 212/300 Write block 1273 len 20480 data: 2 2 2 2 2
5269 213/300 Read block 910 len 36864
5270 214/300 Read block 2729 len 16384
5271 215/300 Write block 4385 len 8192 data: 2 2
5272 216/300 Write block 1775 len 40960 data: 3 3 3 4 3 2 2 2 2 2
5273 217/300 Write block 392 len 20480 data: 5 6 5 5 5
5274 218/300 Flush
5275 219/300 Read block 344 len 32768
5276 220/300 Write block 636 len 36864 data: 2 2 2 2 2 2 2 2 2
5277 221/300 Write block 1677 len 24576 data: 2 2 2 2 2 2
5278 222/300 Write block 2722 len 36864 data: 2 2 2 2 2 3 3 3 3
5279 223/300 Read block 1049 len 4096
5280 224/300 Read block 3382 len 20480
5281 225/300 Write block 3186 len 4096 data: 3
5282 226/300 Write block 3069 len 20480 data: 2 2 2 3 3
5283 227/300 Read block 85 len 8192
5284 228/300 Read block 2099 len 32768
5285 229/300 Read block 3961 len 4096
5286 230/300 Read block 1623 len 12288
5287 231/300 Read block 2185 len 4096
5288 232/300 Write block 728 len 8192 data: 4 4
5289 233/300 Write block 924 len 12288 data: 2 2 2
5290 234/300 Write block 4248 len 36864 data: 2 2 2 2 3 3 3 3 3
5291 235/300 Write block 687 len 32768 data: 2 2 2 2 2 2 2 2
5292 236/300 Read block 3242 len 28672
5293 237/300 Flush
5294 238/300 Write block 1664 len 16384 data: 3 3 3 4
5295 239/300 Read block 4978 len 28672
5296 240/300 Write block 4072 len 40960 data: 2 2 2 2 2 2 2 3 4 4
5297 241/300 Write block 2990 len 36864 data: 3 3 4 4 5 5 4 4 4
5298 242/300 Read block 3823 len 36864
5299 243/300 Read block 1835 len 4096
5300 244/300 Read block 977 len 20480
5301 245/300 Flush
5302 246/300 Read block 4307 len 4096
5303 247/300 Write block 1850 len 4096 data: 2
5304 248/300 Read block 3846 len 36864
5305 249/300 Read block 1208 len 16384
5306 250/300 Read block 1731 len 8192
5307 251/300 Write block 4327 len 4096 data: 2
5308 252/300 Write block 3859 len 32768 data: 3 2 2 2 2 2 2 2
5309 253/300 Read block 4402 len 4096
5310 254/300 Write block 4323 len 20480 data: 2 2 2 2 3
5311 255/300 Write block 1085 len 4096 data: 2
5312 256/300 Write block 40 len 28672 data: 2 2 2 2 2 2 2
5313 257/300 Flush
5314 258/300 Read block 1491 len 24576
5315 259/300 Read block 2053 len 12288
5316 260/300 Write block 867 len 4096 data: 2
5317 261/300 Write block 2470 len 4096 data: 5
5318 262/300 Write block 2226 len 36864 data: 2 2 2 2 2 2 2 2 2
5319 263/300 Flush
5320 264/300 Flush
5321 265/300 Write block 487 len 8192 data: 2 2
5322 266/300 Flush
5323 267/300 Read block 2975 len 24576
5324 268/300 Write block 20 len 32768 data: 2 2 2 2 2 2 2 2
5325 269/300 Read block 2018 len 12288
5326 270/300 Read block 1456 len 16384
5327 271/300 Flush
5328 272/300 Read block 929 len 20480
5329 273/300 Write block 4797 len 40960 data: 2 2 2 2 2 2 2 2 2 2
5330 274/300 Read block 3866 len 24576
5331 275/300 Write block 971 len 16384 data: 2 2 2 2
5332 276/300 Read block 108 len 28672
5333 277/300 Read block 497 len 20480
5334 278/300 Read block 2286 len 16384
5335 279/300 Flush
5336 280/300 Read block 3589 len 28672
5337 281/300 Read block 2129 len 16384
5338 282/300 Write block 3798 len 4096 data: 2
5339 283/300 Read block 4410 len 40960
5340 284/300 Read block 4334 len 8192
5341 285/300 Write block 3804 len 16384 data: 2 2 2 2
5342 286/300 Write block 2799 len 4096 data: 4
5343 287/300 Read block 398 len 24576
5344 288/300 Write block 4460 len 40960 data: 2 2 2 2 2 2 2 2 2 2
5345 289/300 Write block 2051 len 28672 data: 2 3 3 3 3 4 4
5346 290/300 Write block 1518 len 12288 data: 3 3 3
5347 291/300 Write block 2358 len 32768 data: 4 3 3 3 3 3 3 3
5348 292/300 Read block 171 len 28672
5349 293/300 Read block 815 len 32768
5350 294/300 Write block 4217 len 24576 data: 2 2 2 2 2 2
5351 295/300 Read block 3388 len 20480
5352 296/300 Flush
5353 297/300 Write block 236 len 20480 data: 2 2 2 2 2
5354 298/300 Write block 4099 len 20480 data: 2 2 2 2 2
5355 299/300 Read block 2821 len 32768
5356 300/300 Write block 4831 len 8192 data: 3 4
5357 Main task has work to do, go find it
5358 got dsc Start(2)
5359 start 2
5360 Apr 20 01:06:13.331 INFO request completed, latency_us: 208, response_code: 204, uri: /start/cid/2, method: POST, req_id: a5a41387-0d13-4bb1-8475-71a3176f0a48, remote_addr: 127.0.0.1:60352, local_addr: 127.0.0.1:9998
5361 Replay: started 2, returned:Ok(())
5362 ----------------------------------------------------------------
5363 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:301
5364 States: Active Active Offline
5365 GW_ID ACK DSID TYPE BLOCKS DS:0 DS:1 DS:2 REPLAY
5366 905 Acked 1904 Write 4 Done Done New false
5367 906 Acked 1905 Write 2 Done Done New false
5368 907 Acked 1906 Read 1 Done Done New false
5369 908 Acked 1907 Write 9 Done Done New false
5370 909 Acked 1908 Write 2 Done Done New false
5371 910 Acked 1909 Write 1 Done Done New false
5372 911 Acked 1910 Write 5 Done Done New false
5373 912 Acked 1911 Flush 0 Done Done New false
5374 913 Acked 1912 Read 2 Done Done New false
5375 914 Acked 1913 Read 1 Done Done New false
5376 915 Acked 1914 Write 1 Done Done New false
5377 916 Acked 1915 Write 9 Done Done New false
5378 917 Acked 1916 Write 2 Done Done New false
5379 918 Acked 1917 Write 9 Done Done New false
5380 919 Acked 1918 Write 5 Done Done New false
5381 920 Acked 1919 Read 4 Done Done New false
5382 921 Acked 1920 Flush 0 Done Done New false
5383 922 Acked 1921 Read 4 Done Done New false
5384 923 Acked 1922 Read 3 Done Done New false
5385 924 Acked 1923 Write 5 Done Done New false
5386 925 Acked 1924 Write 2 Done Done New false
5387 926 Acked 1925 Read 2 Done Done New false
5388 927 Acked 1926 Read 4 Done Done New false
5389 928 Acked 1927 Write 1 Done Done New false
5390 929 Acked 1928 Write 5 Done Done New false
5391 930 Acked 1929 Flush 0 Done Done New false
5392 931 Acked 1930 Read 1 Done Done New false
5393 932 Acked 1931 Read 1 Done Done New false
5394 933 Acked 1932 Flush 0 Done Done New false
5395 934 Acked 1933 Read 1 Done Done New false
5396 935 Acked 1934 Flush 0 Done Done New false
5397 936 Acked 1935 Read 8 Done Done New false
5398 937 Acked 1936 Read 9 Done Done New false
5399 938 Acked 1937 Write 1 Done Done New false
5400 939 Acked 1938 Write 7 Done Done New false
5401 940 Acked 1939 Write 10 Done Done New false
5402 941 Acked 1940 Flush 0 Done Done New false
5403 942 Acked 1941 Read 3 Done Done New false
5404 943 Acked 1942 Read 3 Done Done New false
5405 944 Acked 1943 Read 1 Done Done New false
5406 945 Acked 1944 Read 10 Done Done New false
5407 946 Acked 1945 Read 7 Done Done New false
5408 947 Acked 1946 Read 10 Done Done New false
5409 948 Acked 1947 Write 6 Done Done New false
5410 949 Acked 1948 Write 4 Done Done New false
5411 950 Acked 1949 Flush 0 Done Done New false
5412 951 Acked 1950 Read 4 Done Done New false
5413 952 Acked 1951 Read 1 Done Done New false
5414 953 Acked 1952 Read 4 Done Done New false
5415 954 Acked 1953 Write 8 Done Done New false
5416 955 Acked 1954 Write 10 Done Done New false
5417 956 Acked 1955 Write 4 Done Done New false
5418 957 Acked 1956 Read 5 Done Done New false
5419 958 Acked 1957 Read 10 Done Done New false
5420 959 Acked 1958 Read 4 Done Done New false
5421 960 Acked 1959 Read 2 Done Done New false
5422 961 Acked 1960 Read 3 Done Done New false
5423 962 Acked 1961 Write 2 Done Done New false
5424 963 Acked 1962 Write 4 Done Done New false
5425 964 Acked 1963 Write 5 Done Done New false
5426 965 Acked 1964 Write 7 Done Done New false
5427 966 Acked 1965 Read 2 Done Done New false
5428 967 Acked 1966 Read 2 Done Done New false
5429 968 Acked 1967 Read 1 Done Done New false
5430 969 Acked 1968 Write 2 Done Done New false
5431 970 Acked 1969 Write 5 Done Done New false
5432 971 Acked 1970 Read 2 Done Done New false
5433 972 Acked 1971 Write 2 Done Done New false
5434 973 Acked 1972 Write 3 Done Done New false
5435 974 Acked 1973 Write 6 Done Done New false
5436 975 Acked 1974 Read 7 Done Done New false
5437 976 Acked 1975 Read 5 Done Done New false
5438 977 Acked 1976 Read 9 Done Done New false
5439 978 Acked 1977 Write 9 Done Done New false
5440 979 Acked 1978 Flush 0 Done Done New false
5441 980 Acked 1979 Read 5 Done Done New false
5442 981 Acked 1980 Write 7 Done Done New false
5443 982 Acked 1981 Read 4 Done Done New false
5444 983 Acked 1982 Flush 0 Done Done New false
5445 984 Acked 1983 Write 4 Done Done New false
5446 985 Acked 1984 Write 8 Done Done New false
5447 986 Acked 1985 Write 10 Done Done New false
5448 987 Acked 1986 Read 7 Done Done New false
5449 988 Acked 1987 Write 3 Done Done New false
5450 989 Acked 1988 Read 5 Done Done New false
5451 990 Acked 1989 Read 1 Done Done New false
5452 991 Acked 1990 Write 1 Done Done New false
5453 992 Acked 1991 Write 6 Done Done New false
5454 993 Acked 1992 Read 4 Done Done New false
5455 994 Acked 1993 Read 10 Done Done New false
5456 995 Acked 1994 Read 1 Done Done New false
5457 996 Acked 1995 Read 4 Done Done New false
5458 997 Acked 1996 Read 9 Done Done New false
5459 998 Acked 1997 Write 1 Done Done New false
5460 999 Acked 1998 Read 6 Done Done New false
5461 1000 Acked 1999 Read 9 Done Done New false
5462 1001 Acked 2000 Read 5 Done Done New false
5463 1002 Acked 2001 Read 1 Done Done New false
5464 1003 Acked 2002 Write 7 Done Done New false
5465 1004 Acked 2003 Write 6 Done Done New false
5466 1005 Acked 2004 Write 1 Done Done New false
5467 1006 Acked 2005 Write 2 Done Done New false
5468 1007 Acked 2006 Flush 0 Done Done New false
5469 1008 Acked 2007 Read 8 Done Done New false
5470 1009 Acked 2008 Flush 0 Done Done New false
5471 1010 Acked 2009 Write 5 Done Done New false
5472 1011 Acked 2010 Read 3 Done Done New false
5473 1012 Acked 2011 Read 1 Done Done New false
5474 1013 Acked 2012 Write 10 Done Done New false
5475 1014 Acked 2013 Flush 0 Done Done New false
5476 1015 Acked 2014 Read 9 Done Done New false
5477 1016 Acked 2015 Read 7 Done Done New false
5478 1017 Acked 2016 Read 5 Done Done New false
5479 1018 Acked 2017 Read 8 Done Done New false
5480 1019 Acked 2018 Read 5 Done Done New false
5481 1020 Acked 2019 Read 5 Done Done New false
5482 1021 Acked 2020 Read 8 Done Done New false
5483 1022 Acked 2021 Write 2 Done Done New false
5484 1023 Acked 2022 Flush 0 Done Done New false
5485 1024 Acked 2023 Write 9 Done Done New false
5486 1025 Acked 2024 Write 1 Done Done New false
5487 1026 Acked 2025 Read 3 Done Done New false
5488 1027 Acked 2026 Flush 0 Done Done New false
5489 1028 Acked 2027 Write 5 Done Done New false
5490 1029 Acked 2028 Read 8 Done Done New false
5491 1030 Acked 2029 Read 3 Done Done New false
5492 1031 Acked 2030 Read 8 Done Done New false
5493 1032 Acked 2031 Read 2 Done Done New false
5494 1033 Acked 2032 Write 2 Done Done New false
5495 1034 Acked 2033 Flush 0 Done Done New false
5496 1035 Acked 2034 Flush 0 Done Done New false
5497 1036 Acked 2035 Write 4 Done Done New false
5498 1037 Acked 2036 Read 7 Done Done New false
5499 1038 Acked 2037 Write 10 Done Done New false
5500 1039 Acked 2038 Read 8 Done Done New false
5501 1040 Acked 2039 Write 6 Done Done New false
5502 1041 Acked 2040 Read 4 Done Done New false
5503 1042 Acked 2041 Read 1 Done Done New false
5504 1043 Acked 2042 Read 5 Done Done New false
5505 1044 Acked 2043 Read 2 Done Done New false
5506 1045 Acked 2044 Write 8 Done Done New false
5507 1046 Acked 2045 Flush 0 Done Done New false
5508 1047 Acked 2046 Read 2 Done Done New false
5509 1048 Acked 2047 Write 7 Done Done New false
5510 1049 Acked 2048 Write 1 Done Done New false
5511 1050 Acked 2049 Write 6 Done Done New false
5512 1051 Acked 2050 Read 2 Done Done New false
5513 1052 Acked 2051 Read 2 Done Done New false
5514 1053 Acked 2052 Read 5 Done Done New false
5515 1054 Acked 2053 Flush 0 Done Done New false
5516 1055 Acked 2054 Write 4 Done Done New false
5517 1056 Acked 2055 Write 10 Done Done New false
5518 1057 Acked 2056 Read 1 Done Done New false
5519 1058 Acked 2057 Read 8 Done Done New false
5520 1059 Acked 2058 Write 2 Done Done New false
5521 1060 Acked 2059 Write 5 Done Done New false
5522 1061 Acked 2060 Write 7 Done Done New false
5523 1062 Acked 2061 Read 10 Done Done New false
5524 1063 Acked 2062 Read 7 Done Done New false
5525 1064 Acked 2063 Read 9 Done Done New false
5526 1065 Acked 2064 Write 10 Done Done New false
5527 1066 Acked 2065 Write 9 Done Done New false
5528 1067 Acked 2066 Write 8 Done Done New false
5529 1068 Acked 2067 Read 6 Done Done New false
5530 1069 Acked 2068 Write 4 Done Done New false
5531 1070 Acked 2069 Read 4 Done Done New false
5532 1071 Acked 2070 Write 1 Done Done New false
5533 1072 Acked 2071 Write 10 Done Done New false
5534 1073 Acked 2072 Write 5 Done Done New false
5535 1074 Acked 2073 Write 2 Done Done New false
5536 1075 Acked 2074 Write 1 Done Done New false
5537 1076 Acked 2075 Write 2 Done Done New false
5538 1077 Acked 2076 Read 4 Done Done New false
5539 1078 Acked 2077 Write 4 Done Done New false
5540 1079 Acked 2078 Read 5 Done Done New false
5541 1080 Acked 2079 Read 9 Done Done New false
5542 1081 Acked 2080 Read 3 Done Done New false
5543 1082 Acked 2081 Read 1 Done Done New false
5544 1083 Acked 2082 Write 8 Done Done New false
5545 1084 Acked 2083 Write 6 Done Done New false
5546 1085 Acked 2084 Read 8 Done Done New false
5547 1086 Acked 2085 Flush 0 Done Done New false
5548 1087 Acked 2086 Write 10 Done Done New false
5549 1088 Acked 2087 Read 9 Done Done New false
5550 1089 Acked 2088 Read 3 Done Done New false
5551 1090 Acked 2089 Read 5 Done Done New false
5552 1091 Acked 2090 Read 9 Done Done New false
5553 1092 Acked 2091 Read 6 Done Done New false
5554 1093 Acked 2092 Flush 0 Done Done New false
5555 1094 Acked 2093 Read 6 Done Done New false
5556 1095 Acked 2094 Flush 0 Done Done New false
5557 1096 Acked 2095 Read 10 Done Done New false
5558 1097 Acked 2096 Read 8 Done Done New false
5559 1098 Acked 2097 Read 4 Done Done New false
5560 1099 Acked 2098 Write 7 Done Done New false
5561 1100 Acked 2099 Read 1 Done Done New false
5562 1101 Acked 2100 Write 8 Done Done New false
5563 1102 Acked 2101 Read 1 Done Done New false
5564 1103 Acked 2102 Write 9 Done Done New false
5565 1104 Acked 2103 Write 4 Done Done New false
5566 1105 Acked 2104 Write 7 Done Done New false
5567 1106 Acked 2105 Flush 0 Done Done New false
5568 1107 Acked 2106 Write 5 Done Done New false
5569 1108 Acked 2107 Read 4 Done Done New false
5570 1109 Acked 2108 Write 4 Done Done New false
5571 1110 Acked 2109 Read 9 Done Done New false
5572 1111 Acked 2110 Read 6 Done Done New false
5573 1112 Acked 2111 Write 5 Done Done New false
5574 1113 Acked 2112 Write 6 Done Done New false
5575 1114 Acked 2113 Write 4 Done Done New false
5576 1115 Acked 2114 Read 8 Done Done New false
5577 1116 Acked 2115 Read 7 Done Done New false
5578 1117 Acked 2116 Write 5 Done Done New false
5579 1118 Acked 2117 Read 9 Done Done New false
5580 1119 Acked 2118 Read 4 Done Done New false
5581 1120 Acked 2119 Write 2 Done Done New false
5582 1121 Acked 2120 Write 10 Done Done New false
5583 1122 Acked 2121 Write 5 Done Done New false
5584 1123 Acked 2122 Flush 0 Done Done New false
5585 1124 Acked 2123 Read 8 Done Done New false
5586 1125 Acked 2124 Write 9 Done Done New false
5587 1126 Acked 2125 Write 6 Done Done New false
5588 1127 Acked 2126 Write 9 Done Done New false
5589 1128 Acked 2127 Read 1 Done Done New false
5590 1129 Acked 2128 Read 5 Done Done New false
5591 1130 Acked 2129 Write 1 Done Done New false
5592 1131 Acked 2130 Write 5 Done Done New false
5593 1132 Acked 2131 Read 2 Done Done New false
5594 1133 Acked 2132 Read 8 Done Done New false
5595 1134 Acked 2133 Read 1 Done Done New false
5596 1135 Acked 2134 Read 3 Done Done New false
5597 1136 Acked 2135 Read 1 Done Done New false
5598 1137 Acked 2136 Write 2 Done Done New false
5599 1138 Acked 2137 Write 3 Done Done New false
5600 1139 Acked 2138 Write 9 Done Done New false
5601 1140 Acked 2139 Write 8 Done Done New false
5602 1141 Acked 2140 Read 7 Done Done New false
5603 1142 Acked 2141 Flush 0 Done Done New false
5604 1143 Acked 2142 Write 4 Done Done New false
5605 1144 Acked 2143 Read 7 Done Done New false
5606 1145 Acked 2144 Write 10 Done Done New false
5607 1146 Acked 2145 Write 9 Done Done New false
5608 1147 Acked 2146 Read 9 Done Done New false
5609 1148 Acked 2147 Read 1 Done Done New false
5610 1149 Acked 2148 Read 5 Done Done New false
5611 1150 Acked 2149 Flush 0 Done Done New false
5612 1151 Acked 2150 Read 1 Done Done New false
5613 1152 Acked 2151 Write 1 Done Done New false
5614 1153 Acked 2152 Read 9 Done Done New false
5615 1154 Acked 2153 Read 4 Done Done New false
5616 1155 Acked 2154 Read 2 Done Done New false
5617 1156 Acked 2155 Write 1 Done Done New false
5618 1157 Acked 2156 Write 8 Done Done New false
5619 1158 Acked 2157 Read 1 Done Done New false
5620 1159 Acked 2158 Write 5 Done Done New false
5621 1160 Acked 2159 Write 1 Done Done New false
5622 1161 Acked 2160 Write 7 Done Done New false
5623 1162 Acked 2161 Flush 0 Done Done New false
5624 1163 Acked 2162 Read 6 Done Done New false
5625 1164 Acked 2163 Read 3 Done Done New false
5626 1165 Acked 2164 Write 1 Done Done New false
5627 1166 Acked 2165 Write 1 Done Done New false
5628 1167 Acked 2166 Write 9 Done Done New false
5629 1168 Acked 2167 Flush 0 Done Done New false
5630 1169 Acked 2168 Flush 0 Done Done New false
5631 1170 Acked 2169 Write 2 Done Done New false
5632 1171 Acked 2170 Flush 0 Done Done New false
5633 1172 Acked 2171 Read 6 Done Done New false
5634 1173 Acked 2172 Write 8 Done Done New false
5635 1174 Acked 2173 Read 3 Done Done New false
5636 1175 Acked 2174 Read 4 Done Done New false
5637 1176 Acked 2175 Flush 0 Done Done New false
5638 1177 Acked 2176 Read 5 Done Done New false
5639 1178 Acked 2177 Write 10 Done Done New false
5640 1179 Acked 2178 Read 6 Done Done New false
5641 1180 Acked 2179 Write 4 Done Done New false
5642 1181 Acked 2180 Read 7 Done Done New false
5643 1182 Acked 2181 Read 5 Done Done New false
5644 1183 Acked 2182 Read 4 Done Done New false
5645 1184 Acked 2183 Flush 0 Done Done New false
5646 1185 Acked 2184 Read 7 Done Done New false
5647 1186 Acked 2185 Read 4 Done Done New false
5648 1187 Acked 2186 Write 1 Done Done New false
5649 1188 Acked 2187 Read 10 Done Done New false
5650 1189 Acked 2188 Read 2 Done Done New false
5651 1190 Acked 2189 Write 4 Done Done New false
5652 1191 Acked 2190 Write 1 Done Done New false
5653 1192 Acked 2191 Read 6 Done Done New false
5654 1193 Acked 2192 Write 10 Done Done New false
5655 1194 Acked 2193 Write 7 Done Done New false
5656 1195 Acked 2194 Write 3 Done Done New false
5657 1196 Acked 2195 Write 8 Done Done New false
5658 1197 Acked 2196 Read 7 Done Done New false
5659 1198 Acked 2197 Read 8 Done Done New false
5660 1199 Acked 2198 Write 6 Done Done New false
5661 1200 Acked 2199 Read 5 Done Done New false
5662 1201 Acked 2200 Flush 0 Done Done New false
5663 1202 Acked 2201 Write 5 Done Done New false
5664 1203 Acked 2202 Write 5 Done Done New false
5665 1204 Acked 2203 Read 8 Done Done New false
5666 1205 Acked 2204 Write 2 Done Done New false
5667 STATES DS:0 DS:1 DS:2 TOTAL
5668 New 0 0 301 301
5669 Sent 0 0 0 0
5670 Done 301 301 0 602
5671 Skipped 0 0 0 0
5672 Error 0 0 0 0
5673 Last Flush: 2200 2200 1903
5674 Downstairs last five completed: 1903 1902 1901 1900 1899
5675 Upstairs last five completed: 1205 1204 1203 1202 1201
5676 CLIENT: Up:0 ds:301 act:2
5677 [8830] got start action
5678 [8830] I am going to restart
5679 Starting downstairs at port 8830
5680 Make output file at "/tmp/dsc/downstairs-8830.txt"
5681 [8830][2] reports Starting
5682 Downstairs /var/tmp/dsc/region/8830 port 8830 PID:Some(1200)
5683 [8830][2] reports Running
5684 ----------------------------------------------------------------
5685 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:302
5686 States: Active Active Offline
5687 GW_ID ACK DSID TYPE BLOCKS DS:0 DS:1 DS:2 REPLAY
5688 905 Acked 1904 Write 4 Done Done New false
5689 906 Acked 1905 Write 2 Done Done New false
5690 907 Acked 1906 Read 1 Done Done New false
5691 908 Acked 1907 Write 9 Done Done New false
5692 909 Acked 1908 Write 2 Done Done New false
5693 910 Acked 1909 Write 1 Done Done New false
5694 911 Acked 1910 Write 5 Done Done New false
5695 912 Acked 1911 Flush 0 Done Done New false
5696 913 Acked 1912 Read 2 Done Done New false
5697 914 Acked 1913 Read 1 Done Done New false
5698 915 Acked 1914 Write 1 Done Done New false
5699 916 Acked 1915 Write 9 Done Done New false
5700 917 Acked 1916 Write 2 Done Done New false
5701 918 Acked 1917 Write 9 Done Done New false
5702 919 Acked 1918 Write 5 Done Done New false
5703 920 Acked 1919 Read 4 Done Done New false
5704 921 Acked 1920 Flush 0 Done Done New false
5705 922 Acked 1921 Read 4 Done Done New false
5706 923 Acked 1922 Read 3 Done Done New false
5707 924 Acked 1923 Write 5 Done Done New false
5708 925 Acked 1924 Write 2 Done Done New false
5709 926 Acked 1925 Read 2 Done Done New false
5710 927 Acked 1926 Read 4 Done Done New false
5711 928 Acked 1927 Write 1 Done Done New false
5712 929 Acked 1928 Write 5 Done Done New false
5713 930 Acked 1929 Flush 0 Done Done New false
5714 931 Acked 1930 Read 1 Done Done New false
5715 932 Acked 1931 Read 1 Done Done New false
5716 933 Acked 1932 Flush 0 Done Done New false
5717 934 Acked 1933 Read 1 Done Done New false
5718 935 Acked 1934 Flush 0 Done Done New false
5719 936 Acked 1935 Read 8 Done Done New false
5720 937 Acked 1936 Read 9 Done Done New false
5721 938 Acked 1937 Write 1 Done Done New false
5722 939 Acked 1938 Write 7 Done Done New false
5723 940 Acked 1939 Write 10 Done Done New false
5724 941 Acked 1940 Flush 0 Done Done New false
5725 942 Acked 1941 Read 3 Done Done New false
5726 943 Acked 1942 Read 3 Done Done New false
5727 944 Acked 1943 Read 1 Done Done New false
5728 945 Acked 1944 Read 10 Done Done New false
5729 946 Acked 1945 Read 7 Done Done New false
5730 947 Acked 1946 Read 10 Done Done New false
5731 948 Acked 1947 Write 6 Done Done New false
5732 949 Acked 1948 Write 4 Done Done New false
5733 950 Acked 1949 Flush 0 Done Done New false
5734 951 Acked 1950 Read 4 Done Done New false
5735 952 Acked 1951 Read 1 Done Done New false
5736 953 Acked 1952 Read 4 Done Done New false
5737 954 Acked 1953 Write 8 Done Done New false
5738 955 Acked 1954 Write 10 Done Done New false
5739 956 Acked 1955 Write 4 Done Done New false
5740 957 Acked 1956 Read 5 Done Done New false
5741 958 Acked 1957 Read 10 Done Done New false
5742 959 Acked 1958 Read 4 Done Done New false
5743 960 Acked 1959 Read 2 Done Done New false
5744 961 Acked 1960 Read 3 Done Done New false
5745 962 Acked 1961 Write 2 Done Done New false
5746 963 Acked 1962 Write 4 Done Done New false
5747 964 Acked 1963 Write 5 Done Done New false
5748 965 Acked 1964 Write 7 Done Done New false
5749 966 Acked 1965 Read 2 Done Done New false
5750 967 Acked 1966 Read 2 Done Done New false
5751 968 Acked 1967 Read 1 Done Done New false
5752 969 Acked 1968 Write 2 Done Done New false
5753 970 Acked 1969 Write 5 Done Done New false
5754 971 Acked 1970 Read 2 Done Done New false
5755 972 Acked 1971 Write 2 Done Done New false
5756 973 Acked 1972 Write 3 Done Done New false
5757 974 Acked 1973 Write 6 Done Done New false
5758 975 Acked 1974 Read 7 Done Done New false
5759 976 Acked 1975 Read 5 Done Done New false
5760 977 Acked 1976 Read 9 Done Done New false
5761 978 Acked 1977 Write 9 Done Done New false
5762 979 Acked 1978 Flush 0 Done Done New false
5763 980 Acked 1979 Read 5 Done Done New false
5764 981 Acked 1980 Write 7 Done Done New false
5765 982 Acked 1981 Read 4 Done Done New false
5766 983 Acked 1982 Flush 0 Done Done New false
5767 984 Acked 1983 Write 4 Done Done New false
5768 985 Acked 1984 Write 8 Done Done New false
5769 986 Acked 1985 Write 10 Done Done New false
5770 987 Acked 1986 Read 7 Done Done New false
5771 988 Acked 1987 Write 3 Done Done New false
5772 989 Acked 1988 Read 5 Done Done New false
5773 990 Acked 1989 Read 1 Done Done New false
5774 991 Acked 1990 Write 1 Done Done New false
5775 992 Acked 1991 Write 6 Done Done New false
5776 993 Acked 1992 Read 4 Done Done New false
5777 994 Acked 1993 Read 10 Done Done New false
5778 995 Acked 1994 Read 1 Done Done New false
5779 996 Acked 1995 Read 4 Done Done New false
5780 997 Acked 1996 Read 9 Done Done New false
5781 998 Acked 1997 Write 1 Done Done New false
5782 999 Acked 1998 Read 6 Done Done New false
5783 1000 Acked 1999 Read 9 Done Done New false
5784 1001 Acked 2000 Read 5 Done Done New false
5785 1002 Acked 2001 Read 1 Done Done New false
5786 1003 Acked 2002 Write 7 Done Done New false
5787 1004 Acked 2003 Write 6 Done Done New false
5788 1005 Acked 2004 Write 1 Done Done New false
5789 1006 Acked 2005 Write 2 Done Done New false
5790 1007 Acked 2006 Flush 0 Done Done New false
5791 1008 Acked 2007 Read 8 Done Done New false
5792 1009 Acked 2008 Flush 0 Done Done New false
5793 1010 Acked 2009 Write 5 Done Done New false
5794 1011 Acked 2010 Read 3 Done Done New false
5795 1012 Acked 2011 Read 1 Done Done New false
5796 1013 Acked 2012 Write 10 Done Done New false
5797 1014 Acked 2013 Flush 0 Done Done New false
5798 1015 Acked 2014 Read 9 Done Done New false
5799 1016 Acked 2015 Read 7 Done Done New false
5800 1017 Acked 2016 Read 5 Done Done New false
5801 1018 Acked 2017 Read 8 Done Done New false
5802 1019 Acked 2018 Read 5 Done Done New false
5803 1020 Acked 2019 Read 5 Done Done New false
5804 1021 Acked 2020 Read 8 Done Done New false
5805 1022 Acked 2021 Write 2 Done Done New false
5806 1023 Acked 2022 Flush 0 Done Done New false
5807 1024 Acked 2023 Write 9 Done Done New false
5808 1025 Acked 2024 Write 1 Done Done New false
5809 1026 Acked 2025 Read 3 Done Done New false
5810 1027 Acked 2026 Flush 0 Done Done New false
5811 1028 Acked 2027 Write 5 Done Done New false
5812 1029 Acked 2028 Read 8 Done Done New false
5813 1030 Acked 2029 Read 3 Done Done New false
5814 1031 Acked 2030 Read 8 Done Done New false
5815 1032 Acked 2031 Read 2 Done Done New false
5816 1033 Acked 2032 Write 2 Done Done New false
5817 1034 Acked 2033 Flush 0 Done Done New false
5818 1035 Acked 2034 Flush 0 Done Done New false
5819 1036 Acked 2035 Write 4 Done Done New false
5820 1037 Acked 2036 Read 7 Done Done New false
5821 1038 Acked 2037 Write 10 Done Done New false
5822 1039 Acked 2038 Read 8 Done Done New false
5823 1040 Acked 2039 Write 6 Done Done New false
5824 1041 Acked 2040 Read 4 Done Done New false
5825 1042 Acked 2041 Read 1 Done Done New false
5826 1043 Acked 2042 Read 5 Done Done New false
5827 1044 Acked 2043 Read 2 Done Done New false
5828 1045 Acked 2044 Write 8 Done Done New false
5829 1046 Acked 2045 Flush 0 Done Done New false
5830 1047 Acked 2046 Read 2 Done Done New false
5831 1048 Acked 2047 Write 7 Done Done New false
5832 1049 Acked 2048 Write 1 Done Done New false
5833 1050 Acked 2049 Write 6 Done Done New false
5834 1051 Acked 2050 Read 2 Done Done New false
5835 1052 Acked 2051 Read 2 Done Done New false
5836 1053 Acked 2052 Read 5 Done Done New false
5837 1054 Acked 2053 Flush 0 Done Done New false
5838 1055 Acked 2054 Write 4 Done Done New false
5839 1056 Acked 2055 Write 10 Done Done New false
5840 1057 Acked 2056 Read 1 Done Done New false
5841 1058 Acked 2057 Read 8 Done Done New false
5842 1059 Acked 2058 Write 2 Done Done New false
5843 1060 Acked 2059 Write 5 Done Done New false
5844 1061 Acked 2060 Write 7 Done Done New false
5845 1062 Acked 2061 Read 10 Done Done New false
5846 1063 Acked 2062 Read 7 Done Done New false
5847 1064 Acked 2063 Read 9 Done Done New false
5848 1065 Acked 2064 Write 10 Done Done New false
5849 1066 Acked 2065 Write 9 Done Done New false
5850 1067 Acked 2066 Write 8 Done Done New false
5851 1068 Acked 2067 Read 6 Done Done New false
5852 1069 Acked 2068 Write 4 Done Done New false
5853 1070 Acked 2069 Read 4 Done Done New false
5854 1071 Acked 2070 Write 1 Done Done New false
5855 1072 Acked 2071 Write 10 Done Done New false
5856 1073 Acked 2072 Write 5 Done Done New false
5857 1074 Acked 2073 Write 2 Done Done New false
5858 1075 Acked 2074 Write 1 Done Done New false
5859 1076 Acked 2075 Write 2 Done Done New false
5860 1077 Acked 2076 Read 4 Done Done New false
5861 1078 Acked 2077 Write 4 Done Done New false
5862 1079 Acked 2078 Read 5 Done Done New false
5863 1080 Acked 2079 Read 9 Done Done New false
5864 1081 Acked 2080 Read 3 Done Done New false
5865 1082 Acked 2081 Read 1 Done Done New false
5866 1083 Acked 2082 Write 8 Done Done New false
5867 1084 Acked 2083 Write 6 Done Done New false
5868 1085 Acked 2084 Read 8 Done Done New false
5869 1086 Acked 2085 Flush 0 Done Done New false
5870 1087 Acked 2086 Write 10 Done Done New false
5871 1088 Acked 2087 Read 9 Done Done New false
5872 1089 Acked 2088 Read 3 Done Done New false
5873 1090 Acked 2089 Read 5 Done Done New false
5874 1091 Acked 2090 Read 9 Done Done New false
5875 1092 Acked 2091 Read 6 Done Done New false
5876 1093 Acked 2092 Flush 0 Done Done New false
5877 1094 Acked 2093 Read 6 Done Done New false
5878 1095 Acked 2094 Flush 0 Done Done New false
5879 1096 Acked 2095 Read 10 Done Done New false
5880 1097 Acked 2096 Read 8 Done Done New false
5881 1098 Acked 2097 Read 4 Done Done New false
5882 1099 Acked 2098 Write 7 Done Done New false
5883 1100 Acked 2099 Read 1 Done Done New false
5884 1101 Acked 2100 Write 8 Done Done New false
5885 1102 Acked 2101 Read 1 Done Done New false
5886 1103 Acked 2102 Write 9 Done Done New false
5887 1104 Acked 2103 Write 4 Done Done New false
5888 1105 Acked 2104 Write 7 Done Done New false
5889 1106 Acked 2105 Flush 0 Done Done New false
5890 1107 Acked 2106 Write 5 Done Done New false
5891 1108 Acked 2107 Read 4 Done Done New false
5892 1109 Acked 2108 Write 4 Done Done New false
5893 1110 Acked 2109 Read 9 Done Done New false
5894 1111 Acked 2110 Read 6 Done Done New false
5895 1112 Acked 2111 Write 5 Done Done New false
5896 1113 Acked 2112 Write 6 Done Done New false
5897 1114 Acked 2113 Write 4 Done Done New false
5898 1115 Acked 2114 Read 8 Done Done New false
5899 1116 Acked 2115 Read 7 Done Done New false
5900 1117 Acked 2116 Write 5 Done Done New false
5901 1118 Acked 2117 Read 9 Done Done New false
5902 1119 Acked 2118 Read 4 Done Done New false
5903 1120 Acked 2119 Write 2 Done Done New false
5904 1121 Acked 2120 Write 10 Done Done New false
5905 1122 Acked 2121 Write 5 Done Done New false
5906 1123 Acked 2122 Flush 0 Done Done New false
5907 1124 Acked 2123 Read 8 Done Done New false
5908 1125 Acked 2124 Write 9 Done Done New false
5909 1126 Acked 2125 Write 6 Done Done New false
5910 1127 Acked 2126 Write 9 Done Done New false
5911 1128 Acked 2127 Read 1 Done Done New false
5912 1129 Acked 2128 Read 5 Done Done New false
5913 1130 Acked 2129 Write 1 Done Done New false
5914 1131 Acked 2130 Write 5 Done Done New false
5915 1132 Acked 2131 Read 2 Done Done New false
5916 1133 Acked 2132 Read 8 Done Done New false
5917 1134 Acked 2133 Read 1 Done Done New false
5918 1135 Acked 2134 Read 3 Done Done New false
5919 1136 Acked 2135 Read 1 Done Done New false
5920 1137 Acked 2136 Write 2 Done Done New false
5921 1138 Acked 2137 Write 3 Done Done New false
5922 1139 Acked 2138 Write 9 Done Done New false
5923 1140 Acked 2139 Write 8 Done Done New false
5924 1141 Acked 2140 Read 7 Done Done New false
5925 1142 Acked 2141 Flush 0 Done Done New false
5926 1143 Acked 2142 Write 4 Done Done New false
5927 1144 Acked 2143 Read 7 Done Done New false
5928 1145 Acked 2144 Write 10 Done Done New false
5929 1146 Acked 2145 Write 9 Done Done New false
5930 1147 Acked 2146 Read 9 Done Done New false
5931 1148 Acked 2147 Read 1 Done Done New false
5932 1149 Acked 2148 Read 5 Done Done New false
5933 1150 Acked 2149 Flush 0 Done Done New false
5934 1151 Acked 2150 Read 1 Done Done New false
5935 1152 Acked 2151 Write 1 Done Done New false
5936 1153 Acked 2152 Read 9 Done Done New false
5937 1154 Acked 2153 Read 4 Done Done New false
5938 1155 Acked 2154 Read 2 Done Done New false
5939 1156 Acked 2155 Write 1 Done Done New false
5940 1157 Acked 2156 Write 8 Done Done New false
5941 1158 Acked 2157 Read 1 Done Done New false
5942 1159 Acked 2158 Write 5 Done Done New false
5943 1160 Acked 2159 Write 1 Done Done New false
5944 1161 Acked 2160 Write 7 Done Done New false
5945 1162 Acked 2161 Flush 0 Done Done New false
5946 1163 Acked 2162 Read 6 Done Done New false
5947 1164 Acked 2163 Read 3 Done Done New false
5948 1165 Acked 2164 Write 1 Done Done New false
5949 1166 Acked 2165 Write 1 Done Done New false
5950 1167 Acked 2166 Write 9 Done Done New false
5951 1168 Acked 2167 Flush 0 Done Done New false
5952 1169 Acked 2168 Flush 0 Done Done New false
5953 1170 Acked 2169 Write 2 Done Done New false
5954 1171 Acked 2170 Flush 0 Done Done New false
5955 1172 Acked 2171 Read 6 Done Done New false
5956 1173 Acked 2172 Write 8 Done Done New false
5957 1174 Acked 2173 Read 3 Done Done New false
5958 1175 Acked 2174 Read 4 Done Done New false
5959 1176 Acked 2175 Flush 0 Done Done New false
5960 1177 Acked 2176 Read 5 Done Done New false
5961 1178 Acked 2177 Write 10 Done Done New false
5962 1179 Acked 2178 Read 6 Done Done New false
5963 1180 Acked 2179 Write 4 Done Done New false
5964 1181 Acked 2180 Read 7 Done Done New false
5965 1182 Acked 2181 Read 5 Done Done New false
5966 1183 Acked 2182 Read 4 Done Done New false
5967 1184 Acked 2183 Flush 0 Done Done New false
5968 1185 Acked 2184 Read 7 Done Done New false
5969 1186 Acked 2185 Read 4 Done Done New false
5970 1187 Acked 2186 Write 1 Done Done New false
5971 1188 Acked 2187 Read 10 Done Done New false
5972 1189 Acked 2188 Read 2 Done Done New false
5973 1190 Acked 2189 Write 4 Done Done New false
5974 1191 Acked 2190 Write 1 Done Done New false
5975 1192 Acked 2191 Read 6 Done Done New false
5976 1193 Acked 2192 Write 10 Done Done New false
5977 1194 Acked 2193 Write 7 Done Done New false
5978 1195 Acked 2194 Write 3 Done Done New false
5979 1196 Acked 2195 Write 8 Done Done New false
5980 1197 Acked 2196 Read 7 Done Done New false
5981 1198 Acked 2197 Read 8 Done Done New false
5982 1199 Acked 2198 Write 6 Done Done New false
5983 1200 Acked 2199 Read 5 Done Done New false
5984 1201 Acked 2200 Flush 0 Done Done New false
5985 1202 Acked 2201 Write 5 Done Done New false
5986 1203 Acked 2202 Write 5 Done Done New false
5987 1204 Acked 2203 Read 8 Done Done New false
5988 1205 Acked 2204 Write 2 Done Done New false
5989 1206 Acked 2205 Flush 0 Done Done New false
5990 STATES DS:0 DS:1 DS:2 TOTAL
5991 New 0 0 302 302
5992 Sent 0 0 0 0
5993 Done 302 302 0 604
5994 Skipped 0 0 0 0
5995 Error 0 0 0 0
5996 Last Flush: 2205 2205 1903
5997 Downstairs last five completed: 1903 1902 1901 1900 1899
5998 Upstairs last five completed: 1206 1205 1204 1203 1202
5999 CLIENT: Up:0 ds:302 act:2
60002024-04-20T01:06:18.995ZINFOcrucible: connecting to 127.0.0.1:8830 = io task client = 2 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
60012024-04-20T01:06:18.995ZINFOcrucible: ds_connection connected from Ok(127.0.0.1:62673) = io task client = 2 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
60022024-04-20T01:06:18.996ZINFOcrucible: downstairs client at Some(127.0.0.1:8830) has region UUID 12345678-0000-0000-0000-000000008830 = downstairs client = 2 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
60032024-04-20T01:06:18.996ZINFOcrucible: Returning UUID:12345678-0000-0000-0000-000000008830 matches = downstairs client = 2 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
60042024-04-20T01:06:18.996ZINFOcrucible: send last flush ID to this DS: 1903 = downstairs client = 2 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
60052024-04-20T01:06:18.996ZINFOcrucible: Replied this last flush ID: 1903 = downstairs client = 2 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
60062024-04-20T01:06:18.996ZINFOcrucible: ds_transition from Offline to Replay = downstairs client = 2 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
60072024-04-20T01:06:18.996ZINFOcrucible: [2] Transition from Offline to Replay = downstairs client = 2 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
60082024-04-20T01:06:18.996ZINFOcrucible: ds_transition from Replay to Active = downstairs client = 2 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
60092024-04-20T01:06:18.996ZINFOcrucible: [2] Transition from Replay to Active = downstairs client = 2 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
6010 ----------------------------------------------------------------
6011 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:0
6012 Downstairs last five completed: 2205 2204 2203 2202 2201
6013 Upstairs last five completed: 1206 1205 1204 1203 1202
6014 CLIENT: Up:0 ds:0 act:3
6015 Replay: All jobs finished, all DS active.
6016 Main task has work to do, go find it
6017 got dsc Stop(2)
6018 stop 2
6019 Apr 20 01:06:21.335 INFO request completed, latency_us: 356, response_code: 204, uri: [8830] Got stop action so:false kr:false
6020 /stop/cid/2, method: POST, req_id: 4438e889-0453-4e1f-b231-3498d2e11fd9, remote_addr: 127.0.0.1:60352, local_addr: 127.0.0.1:9998
6021 Apr 20 01:06:21.336 INFO request completed, latency_us: 111, response_code: 200, uri: /state/cid/2, method: GET, req_id: 107ce68c-f35f-456d-97f1-68235dbf560d, remote_addr: 127.0.0.1:60352, local_addr: 127.0.0.1:9998
60222024-04-20T01:06:21.336ZWARNcrucible: downstairs disconnected = io task client = 2 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
60232024-04-20T01:06:21.336ZWARNcrucible: client task is sending Done(Finished) = io task client = 2 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
60242024-04-20T01:06:21.336ZWARNcrucible: downstairs task for 2 stopped due to Finished session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
60252024-04-20T01:06:21.336ZINFOcrucible: Gone missing, transition from Active to Offline = downstairs client = 2 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
60262024-04-20T01:06:21.336ZINFOcrucible: [2] client re-new 0 jobs since flush 2205 = downstairs session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
60272024-04-20T01:06:21.336ZINFOcrucible: [2] Marked 0 jobs for replay since flush: 2205 = downstairs session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
60282024-04-20T01:06:21.336ZINFOcrucible: client task is exiting = io task client = 2 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
6029 [8830] Exited with: ExitStatus(unix_wait_status(9))
6030 [8830][2] reports Exit
6031 Apr 20 01:06:25.338 INFO request completed, latency_us: 194, response_code: 200, uri: /state/cid/2, method: GET, req_id: 72b57075-fe06-4f03-83d7-d6fc02b27cc4, remote_addr: 127.0.0.1:60352, local_addr: 127.0.0.1:9998
6032 001/300 Read block 2063 len 36864
6033 002/300 Read block 1849 len 12288
6034 003/300 Read block 4201 len 32768
6035 004/300 Read block 92 len 36864
6036 005/300 Write block 3558 len 12288 data: 2 2 2
6037 006/300 Read block 3631 len 28672
6038 007/300 Flush
6039 008/300 Read block 1439 len 12288
6040 009/300 Write block 2531 len 8192 data: 2 2
6041 010/300 Write block 4022 len 40960 data: 2 2 2 2 2 2 2 2 2 2
6042 011/300 Read block 1760 len 24576
6043 012/300 Read block 1737 len 16384
6044 013/300 Write block 823 len 28672 data: 2 2 2 2 2 2 2
6045 014/300 Read block 4248 len 12288
6046 015/300 Write block 268 len 20480 data: 3 3 3 2 2
6047 016/300 Flush
6048 017/300 Write block 4544 len 16384 data: 3 3 3 2
6049 018/300 Read block 3779 len 20480
6050 019/300 Write block 4491 len 24576 data: 2 2 2 2 2 2
6051 020/300 Write block 1835 len 36864 data: 2 2 2 2 2 2 2 2 2
6052 021/300 Read block 4311 len 28672
6053 022/300 Read block 4366 len 24576
6054 023/300 Read block 747 len 4096
6055 024/300 Read block 2008 len 32768
6056 025/300 Read block 763 len 32768
6057 026/300 Write block 4981 len 20480 data: 2 2 2 2 2
6058 027/300 Read block 320 len 32768
6059 028/300 Read block 448 len 36864
6060 029/300 Read block 1152 len 20480
6061 030/300 Read block 2911 len 36864
6062 031/300 Flush
6063 032/300 Read block 4335 len 32768
6064 033/300 Write block 1985 len 36864 data: 2 2 2 2 2 2 2 2 2
6065 034/300 Write block 815 len 12288 data: 2 2 2
6066 035/300 Write block 963 len 12288 data: 2 2 2
6067 036/300 Write block 2717 len 12288 data: 2 2 3
6068 037/300 Write block 4311 len 36864 data: 2 2 2 2 2 2 2 2 2
6069 038/300 Write block 4291 len 16384 data: 4 5 5 5
6070 039/300 Write block 2908 len 28672 data: 3 3 3 3 3 2 2
6071 040/300 Read block 643 len 32768
6072 041/300 Write block 4876 len 24576 data: 4 4 3 3 2 2
6073 042/300 Read block 1504 len 12288
6074 043/300 Read block 248 len 12288
6075 044/300 Write block 3354 len 20480 data: 2 2 2 2 2
6076 045/300 Write block 1079 len 36864 data: 2 2 3 3 3 3 3 2 2
6077 046/300 Flush
6078 047/300 Write block 4806 len 24576 data: 3 2 3 3 2 2
6079 048/300 Write block 2334 len 12288 data: 2 2 2
6080 049/300 Write block 3767 len 8192 data: 2 2
6081 050/300 Write block 113 len 20480 data: 3 3 3 3 2
6082 051/300 Flush
6083 052/300 Write block 783 len 4096 data: 3
6084 053/300 Flush
6085 054/300 Write block 3858 len 40960 data: 3 4 3 3 3 3 3 3 3 2
6086 055/300 Read block 1371 len 24576
6087 056/300 Read block 4771 len 4096
6088 057/300 Write block 437 len 36864 data: 2 2 2 2 2 2 2 2 2
6089 058/300 Read block 492 len 40960
6090 059/300 Write block 85 len 32768 data: 3 3 4 3 3 3 3 3
6091 060/300 Read block 4623 len 28672
6092 061/300 Read block 412 len 28672
6093 062/300 Read block 4272 len 36864
6094 063/300 Write block 269 len 12288 data: 4 4 3
6095 064/300 Read block 630 len 8192
6096 065/300 Read block 137 len 36864
6097 066/300 Read block 3393 len 20480
6098 067/300 Write block 3440 len 12288 data: 2 3 3
6099 068/300 Read block 1450 len 40960
6100 069/300 Flush
6101 070/300 Write block 4943 len 20480 data: 3 3 3 3 3
6102 071/300 Read block 1173 len 36864
6103 072/300 Read block 1696 len 16384
6104 073/300 Read block 3354 len 4096
6105 074/300 Read block 3266 len 40960
6106 075/300 Write block 1618 len 36864 data: 2 2 2 2 2 2 2 4 3
6107 076/300 Flush
6108 077/300 Read block 2736 len 28672
6109 078/300 Read block 2629 len 16384
6110 079/300 Write block 4076 len 20480 data: 3 3 3 4 5
6111 080/300 Write block 3953 len 40960 data: 2 2 3 3 3 3 3 4 4 3
6112 081/300 Read block 1987 len 4096
6113 082/300 Write block 1680 len 28672 data: 3 3 3 2 2 2 2
6114 083/300 Write block 295 len 36864 data: 2 2 2 2 2 2 2 2 2
6115 084/300 Write block 1895 len 20480 data: 3 3 3 2 2
6116 085/300 Read block 4041 len 32768
6117 086/300 Read block 2711 len 32768
6118 087/300 Read block 169 len 4096
6119 088/300 Read block 2619 len 28672
6120 089/300 Write block 3276 len 16384 data: 3 3 3 3
6121 090/300 Flush
6122 091/300 Write block 1637 len 8192 data: 2 2
6123 092/300 Read block 1919 len 12288
6124 093/300 Read block 205 len 12288
6125 094/300 Read block 1390 len 40960
6126 095/300 Write block 847 len 28672 data: 3 3 3 2 2 2 2
6127 096/300 Write block 2377 len 4096 data: 3
6128 097/300 Write block 4875 len 12288 data: 5 5 5
6129 098/300 Read block 1291 len 28672
6130 099/300 Write block 2664 len 12288 data: 2 2 2
6131 100/300 Read block 4774 len 4096
6132 101/300 Read block 884 len 4096
6133 102/300 Read block 2102 len 20480
6134 103/300 Write block 4989 len 32768 data: 2 3 3 3 3 3 3 3
6135 104/300 Write block 2160 len 36864 data: 2 2 2 2 2 2 2 2 2
6136 105/300 Write block 3715 len 40960 data: 2 2 2 2 2 2 2 2 2 2
6137 106/300 Write block 1341 len 32768 data: 2 2 2 2 2 2 2 2
6138 107/300 Read block 3939 len 36864
6139 108/300 Write block 270 len 8192 data: 5 4
6140 109/300 Write block 4681 len 40960 data: 3 3 3 3 2 2 2 2 2 2
6141 110/300 Read block 4911 len 32768
6142 111/300 Write block 2047 len 8192 data: 2 2
6143 112/300 Read block 4128 len 32768
6144 113/300 Write block 4917 len 24576 data: 4 4 3 3 3 3
6145 114/300 Flush
6146 115/300 Write block 2157 len 28672 data: 2 2 2 3 3 3 3
6147 116/300 Write block 3078 len 16384 data: 3 3 3 3
6148 117/300 Write block 307 len 40960 data: 2 2 2 2 2 2 2 2 4 4
6149 118/300 Read block 692 len 12288
6150 119/300 Read block 4738 len 4096
6151 120/300 Write block 1986 len 24576 data: 3 3 3 3 3 3
6152 121/300 Read block 3264 len 8192
6153 122/300 Write block 310 len 8192 data: 3 3
6154 123/300 Read block 597 len 12288
6155 124/300 Read block 1633 len 24576
6156 125/300 Read block 2371 len 12288
6157 126/300 Read block 3346 len 20480
6158 127/300 Write block 2288 len 16384 data: 2 2 2 2
6159 128/300 Read block 342 len 24576
6160 129/300 Flush
6161 130/300 Write block 3458 len 40960 data: 3 3 3 2 2 2 2 2 2 2
6162 131/300 Read block 3321 len 40960
6163 132/300 Read block 860 len 12288
6164 133/300 Read block 3051 len 40960
6165 134/300 Write block 506 len 32768 data: 3 3 3 3 3 2 2 2
6166 135/300 Read block 1321 len 4096
6167 136/300 Read block 761 len 12288
6168 137/300 Read block 2052 len 4096
6169 138/300 Write block 2847 len 4096 data: 3
6170 139/300 Write block 3426 len 32768 data: 4 4 3 4 4 5 6 5
6171 140/300 Read block 831 len 32768
6172 141/300 Read block 3518 len 4096
6173 142/300 Read block 359 len 40960
6174 143/300 Read block 4668 len 32768
6175 144/300 Read block 1528 len 20480
6176 145/300 Read block 1084 len 8192
6177 146/300 Write block 1205 len 40960 data: 2 2 2 2 2 2 2 2 2 2
6178 147/300 Write block 220 len 12288 data: 2 3 4
6179 148/300 Flush
6180 149/300 Flush
6181 150/300 Read block 664 len 32768
6182 151/300 Write block 550 len 16384 data: 2 2 2 2
6183 152/300 Read block 3720 len 20480
6184 153/300 Read block 4599 len 36864
6185 154/300 Read block 384 len 8192
6186 155/300 Read block 2328 len 8192
6187 156/300 Read block 2084 len 40960
6188 157/300 Write block 1534 len 32768 data: 3 3 3 2 2 2 2 2
6189 158/300 Read block 915 len 16384
6190 159/300 Read block 1517 len 20480
6191 160/300 Write block 2804 len 40960 data: 2 2 2 2 2 2 3 3 3 4
6192 161/300 Read block 4522 len 4096
6193 162/300 Read block 3949 len 32768
6194 163/300 Write block 4359 len 24576 data: 2 2 2 2 2 2
6195 164/300 Write block 2091 len 36864 data: 4 4 3 3 3 3 3 2 2
6196 165/300 Read block 3676 len 36864
6197 166/300 Read block 3448 len 16384
6198 167/300 Read block 4606 len 4096
6199 168/300 Write block 894 len 32768 data: 3 3 2 2 2 3 3 3
6200 169/300 Write block 2829 len 12288 data: 2 2 2
6201 170/300 Write block 3545 len 16384 data: 2 2 2 2
6202 171/300 Flush
6203 172/300 Write block 2141 len 24576 data: 2 2 2 2 2 2
6204 173/300 Write block 1602 len 32768 data: 2 2 2 2 2 2 2 2
6205 174/300 Read block 1601 len 4096
6206 175/300 Write block 1177 len 28672 data: 2 2 2 2 2 2 2
6207 176/300 Read block 3671 len 4096
6208 177/300 Read block 4090 len 36864
6209 178/300 Flush
6210 179/300 Write block 3956 len 32768 data: 4 4 4 4 5 5 4 3
6211 180/300 Read block 3668 len 40960
6212 181/300 Read block 1186 len 8192
6213 182/300 Flush
6214 183/300 Read block 542 len 4096
6215 184/300 Write block 2 len 36864 data: 2 2 2 2 2 2 2 3 3
6216 185/300 Read block 3767 len 24576
6217 186/300 Read block 1782 len 4096
6218 187/300 Read block 2487 len 24576
6219 188/300 Write block 2426 len 24576 data: 3 3 2 2 2 2
6220 189/300 Read block 3469 len 32768
6221 190/300 Write block 2312 len 20480 data: 2 2 2 2 2
6222 191/300 Write block 2749 len 12288 data: 2 2 2
6223 192/300 Read block 1156 len 28672
6224 193/300 Write block 2988 len 8192 data: 3 3
6225 194/300 Flush
6226 195/300 Read block 3457 len 28672
6227 196/300 Read block 1864 len 16384
6228 197/300 Write block 2573 len 12288 data: 2 2 2
6229 198/300 Write block 13 len 36864 data: 4 4 4 4 3 2 2 3 3
6230 199/300 Write block 4785 len 12288 data: 4 4 4
6231 200/300 Flush
6232 201/300 Read block 3855 len 8192
6233 202/300 Read block 3715 len 12288
6234 203/300 Flush
6235 204/300 Write block 2748 len 12288 data: 2 3 3
6236 205/300 Read block 3925 len 8192
6237 206/300 Write block 343 len 16384 data: 3 2 2 2
6238 207/300 Read block 834 len 16384
6239 208/300 Read block 2268 len 12288
6240 209/300 Flush
6241 210/300 Read block 3029 len 36864
6242 211/300 Flush
6243 212/300 Write block 1676 len 8192 data: 3 3
6244 213/300 Read block 1275 len 24576
6245 214/300 Read block 3822 len 4096
6246 215/300 Read block 4986 len 24576
6247 216/300 Flush
6248 217/300 Write block 1445 len 36864 data: 3 3 3 3 2 2 2 2 2
6249 218/300 Flush
6250 219/300 Read block 4644 len 36864
6251 220/300 Read block 2442 len 36864
6252 221/300 Write block 747 len 20480 data: 4 4 4 3 3
6253 222/300 Read block 2036 len 12288
6254 223/300 Read block 4221 len 32768
6255 224/300 Write block 358 len 16384 data: 2 2 2 3
6256 225/300 Read block 156 len 8192
6257 226/300 Read block 1979 len 36864
6258 227/300 Write block 2348 len 12288 data: 4 4 3
6259 228/300 Write block 1282 len 4096 data: 2
6260 229/300 Flush
6261 230/300 Read block 3866 len 36864
6262 231/300 Read block 4609 len 4096
6263 232/300 Read block 107 len 36864
6264 233/300 Write block 2155 len 24576 data: 2 2 3 3 3 4
6265 234/300 Read block 2345 len 28672
6266 235/300 Write block 4351 len 32768 data: 6 5 5 5 5 3 2 2
6267 236/300 Read block 4892 len 36864
6268 237/300 Write block 2899 len 8192 data: 2 2
6269 238/300 Read block 4398 len 8192
6270 239/300 Read block 1700 len 4096
6271 240/300 Read block 3898 len 32768
6272 241/300 Flush
6273 242/300 Write block 2126 len 36864 data: 2 2 2 2 2 2 2 2 2
6274 243/300 Read block 2120 len 8192
6275 244/300 Read block 4925 len 4096
6276 245/300 Read block 2538 len 24576
6277 246/300 Read block 79 len 8192
6278 247/300 Read block 4177 len 12288
6279 248/300 Write block 3701 len 16384 data: 2 2 2 2
6280 249/300 Read block 4575 len 20480
6281 250/300 Write block 2475 len 12288 data: 3 3 2
6282 251/300 Write block 770 len 24576 data: 3 3 3 3 3 3
6283 252/300 Write block 874 len 8192 data: 4 4
6284 253/300 Flush
6285 254/300 Flush
6286 255/300 Write block 4031 len 24576 data: 3 2 2 2 2 2
6287 256/300 Flush
6288 257/300 Read block 2199 len 16384
6289 258/300 Read block 922 len 24576
6290 259/300 Read block 4290 len 12288
6291 260/300 Read block 3834 len 24576
6292 261/300 Read block 547 len 36864
6293 262/300 Flush
6294 263/300 Read block 3407 len 12288
6295 264/300 Read block 3637 len 12288
6296 265/300 Read block 1901 len 40960
6297 266/300 Read block 1954 len 28672
6298 267/300 Flush
6299 268/300 Read block 2172 len 20480
6300 269/300 Write block 1097 len 32768 data: 3 3 2 2 2 2 2 2
6301 270/300 Write block 1582 len 24576 data: 2 2 2 2 3 3
6302 271/300 Read block 2944 len 28672
6303 272/300 Read block 4819 len 40960
6304 273/300 Read block 4036 len 8192
6305 274/300 Read block 2807 len 32768
6306 275/300 Read block 311 len 36864
6307 276/300 Write block 2504 len 8192 data: 2 2
6308 277/300 Read block 1740 len 24576
6309 278/300 Read block 1710 len 32768
6310 279/300 Flush
6311 280/300 Read block 4807 len 20480
6312 281/300 Read block 4567 len 16384
6313 282/300 Read block 4780 len 28672
6314 283/300 Read block 4800 len 36864
6315 284/300 Read block 3014 len 24576
6316 285/300 Write block 1710 len 8192 data: 4 4
6317 286/300 Flush
6318 287/300 Read block 3257 len 32768
6319 288/300 Write block 4123 len 28672 data: 3 3 3 4 4 3 3
6320 289/300 Read block 1194 len 8192
6321 290/300 Write block 2459 len 12288 data: 2 2 2
6322 291/300 Read block 1438 len 36864
6323 292/300 Flush
6324 293/300 Write block 746 len 32768 data: 4 5 5 5 4 4 3 2
6325 294/300 Write block 4821 len 8192 data: 5 5
6326 295/300 Read block 1338 len 20480
6327 296/300 Read block 1084 len 12288
6328 297/300 Read block 1238 len 24576
6329 298/300 Write block 2068 len 8192 data: 3 3
6330 299/300 Read block 254 len 16384
6331 300/300 Write block 3290 len 12288 data: 2 2 2
6332 Main task has work to do, go find it
6333 got dsc Start(2)
6334 start 2
6335 Apr 20 01:06:25.644 INFO request completed, latency_us: 204, response_code: 204, uri: /start/cid/2, method: POST, req_id: 732cb50e-d77c-4a80-adfa-5a09d3e242c9, remote_addr: 127.0.0.1:60352, local_addr: 127.0.0.1:9998
6336 Replay: started 2, returned:Ok(())
6337 ----------------------------------------------------------------
6338 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:301
6339 States: Active Active Offline
6340 GW_ID ACK DSID TYPE BLOCKS DS:0 DS:1 DS:2 REPLAY
6341 1207 Acked 2206 Read 9 Done Done New false
6342 1208 Acked 2207 Read 3 Done Done New false
6343 1209 Acked 2208 Read 8 Done Done New false
6344 1210 Acked 2209 Read 9 Done Done New false
6345 1211 Acked 2210 Write 3 Done Done New false
6346 1212 Acked 2211 Read 7 Done Done New false
6347 1213 Acked 2212 Flush 0 Done Done New false
6348 1214 Acked 2213 Read 3 Done Done New false
6349 1215 Acked 2214 Write 2 Done Done New false
6350 1216 Acked 2215 Write 10 Done Done New false
6351 1217 Acked 2216 Read 6 Done Done New false
6352 1218 Acked 2217 Read 4 Done Done New false
6353 1219 Acked 2218 Write 7 Done Done New false
6354 1220 Acked 2219 Read 3 Done Done New false
6355 1221 Acked 2220 Write 5 Done Done New false
6356 1222 Acked 2221 Flush 0 Done Done New false
6357 1223 Acked 2222 Write 4 Done Done New false
6358 1224 Acked 2223 Read 5 Done Done New false
6359 1225 Acked 2224 Write 6 Done Done New false
6360 1226 Acked 2225 Write 9 Done Done New false
6361 1227 Acked 2226 Read 7 Done Done New false
6362 1228 Acked 2227 Read 6 Done Done New false
6363 1229 Acked 2228 Read 1 Done Done New false
6364 1230 Acked 2229 Read 8 Done Done New false
6365 1231 Acked 2230 Read 8 Done Done New false
6366 1232 Acked 2231 Write 5 Done Done New false
6367 1233 Acked 2232 Read 8 Done Done New false
6368 1234 Acked 2233 Read 9 Done Done New false
6369 1235 Acked 2234 Read 5 Done Done New false
6370 1236 Acked 2235 Read 9 Done Done New false
6371 1237 Acked 2236 Flush 0 Done Done New false
6372 1238 Acked 2237 Read 8 Done Done New false
6373 1239 Acked 2238 Write 9 Done Done New false
6374 1240 Acked 2239 Write 3 Done Done New false
6375 1241 Acked 2240 Write 3 Done Done New false
6376 1242 Acked 2241 Write 3 Done Done New false
6377 1243 Acked 2242 Write 9 Done Done New false
6378 1244 Acked 2243 Write 4 Done Done New false
6379 1245 Acked 2244 Write 7 Done Done New false
6380 1246 Acked 2245 Read 8 Done Done New false
6381 1247 Acked 2246 Write 6 Done Done New false
6382 1248 Acked 2247 Read 3 Done Done New false
6383 1249 Acked 2248 Read 3 Done Done New false
6384 1250 Acked 2249 Write 5 Done Done New false
6385 1251 Acked 2250 Write 9 Done Done New false
6386 1252 Acked 2251 Flush 0 Done Done New false
6387 1253 Acked 2252 Write 6 Done Done New false
6388 1254 Acked 2253 Write 3 Done Done New false
6389 1255 Acked 2254 Write 2 Done Done New false
6390 1256 Acked 2255 Write 5 Done Done New false
6391 1257 Acked 2256 Flush 0 Done Done New false
6392 1258 Acked 2257 Write 1 Done Done New false
6393 1259 Acked 2258 Flush 0 Done Done New false
6394 1260 Acked 2259 Write 10 Done Done New false
6395 1261 Acked 2260 Read 6 Done Done New false
6396 1262 Acked 2261 Read 1 Done Done New false
6397 1263 Acked 2262 Write 9 Done Done New false
6398 1264 Acked 2263 Read 10 Done Done New false
6399 1265 Acked 2264 Write 8 Done Done New false
6400 1266 Acked 2265 Read 7 Done Done New false
6401 1267 Acked 2266 Read 7 Done Done New false
6402 1268 Acked 2267 Read 9 Done Done New false
6403 1269 Acked 2268 Write 3 Done Done New false
6404 1270 Acked 2269 Read 2 Done Done New false
6405 1271 Acked 2270 Read 9 Done Done New false
6406 1272 Acked 2271 Read 5 Done Done New false
6407 1273 Acked 2272 Write 3 Done Done New false
6408 1274 Acked 2273 Read 10 Done Done New false
6409 1275 Acked 2274 Flush 0 Done Done New false
6410 1276 Acked 2275 Write 5 Done Done New false
6411 1277 Acked 2276 Read 9 Done Done New false
6412 1278 Acked 2277 Read 4 Done Done New false
6413 1279 Acked 2278 Read 1 Done Done New false
6414 1280 Acked 2279 Read 10 Done Done New false
6415 1281 Acked 2280 Write 9 Done Done New false
6416 1282 Acked 2281 Flush 0 Done Done New false
6417 1283 Acked 2282 Read 7 Done Done New false
6418 1284 Acked 2283 Read 4 Done Done New false
6419 1285 Acked 2284 Write 5 Done Done New false
6420 1286 Acked 2285 Write 10 Done Done New false
6421 1287 Acked 2286 Read 1 Done Done New false
6422 1288 Acked 2287 Write 7 Done Done New false
6423 1289 Acked 2288 Write 9 Done Done New false
6424 1290 Acked 2289 Write 5 Done Done New false
6425 1291 Acked 2290 Read 8 Done Done New false
6426 1292 Acked 2291 Read 8 Done Done New false
6427 1293 Acked 2292 Read 1 Done Done New false
6428 1294 Acked 2293 Read 7 Done Done New false
6429 1295 Acked 2294 Write 4 Done Done New false
6430 1296 Acked 2295 Flush 0 Done Done New false
6431 1297 Acked 2296 Write 2 Done Done New false
6432 1298 Acked 2297 Read 3 Done Done New false
6433 1299 Acked 2298 Read 3 Done Done New false
6434 1300 Acked 2299 Read 10 Done Done New false
6435 1301 Acked 2300 Write 7 Done Done New false
6436 1302 Acked 2301 Write 1 Done Done New false
6437 1303 Acked 2302 Write 3 Done Done New false
6438 1304 Acked 2303 Read 7 Done Done New false
6439 1305 Acked 2304 Write 3 Done Done New false
6440 1306 Acked 2305 Read 1 Done Done New false
6441 1307 Acked 2306 Read 1 Done Done New false
6442 1308 Acked 2307 Read 5 Done Done New false
6443 1309 Acked 2308 Write 8 Done Done New false
6444 1310 Acked 2309 Write 9 Done Done New false
6445 1311 Acked 2310 Write 10 Done Done New false
6446 1312 Acked 2311 Write 8 Done Done New false
6447 1313 Acked 2312 Read 9 Done Done New false
6448 1314 Acked 2313 Write 2 Done Done New false
6449 1315 Acked 2314 Write 10 Done Done New false
6450 1316 Acked 2315 Read 8 Done Done New false
6451 1317 Acked 2316 Write 2 Done Done New false
6452 1318 Acked 2317 Read 8 Done Done New false
6453 1319 Acked 2318 Write 6 Done Done New false
6454 1320 Acked 2319 Flush 0 Done Done New false
6455 1321 Acked 2320 Write 7 Done Done New false
6456 1322 Acked 2321 Write 4 Done Done New false
6457 1323 Acked 2322 Write 10 Done Done New false
6458 1324 Acked 2323 Read 3 Done Done New false
6459 1325 Acked 2324 Read 1 Done Done New false
6460 1326 Acked 2325 Write 6 Done Done New false
6461 1327 Acked 2326 Read 2 Done Done New false
6462 1328 Acked 2327 Write 2 Done Done New false
6463 1329 Acked 2328 Read 3 Done Done New false
6464 1330 Acked 2329 Read 6 Done Done New false
6465 1331 Acked 2330 Read 3 Done Done New false
6466 1332 Acked 2331 Read 5 Done Done New false
6467 1333 Acked 2332 Write 4 Done Done New false
6468 1334 Acked 2333 Read 6 Done Done New false
6469 1335 Acked 2334 Flush 0 Done Done New false
6470 1336 Acked 2335 Write 10 Done Done New false
6471 1337 Acked 2336 Read 10 Done Done New false
6472 1338 Acked 2337 Read 3 Done Done New false
6473 1339 Acked 2338 Read 10 Done Done New false
6474 1340 Acked 2339 Write 8 Done Done New false
6475 1341 Acked 2340 Read 1 Done Done New false
6476 1342 Acked 2341 Read 3 Done Done New false
6477 1343 Acked 2342 Read 1 Done Done New false
6478 1344 Acked 2343 Write 1 Done Done New false
6479 1345 Acked 2344 Write 8 Done Done New false
6480 1346 Acked 2345 Read 8 Done Done New false
6481 1347 Acked 2346 Read 1 Done Done New false
6482 1348 Acked 2347 Read 10 Done Done New false
6483 1349 Acked 2348 Read 8 Done Done New false
6484 1350 Acked 2349 Read 5 Done Done New false
6485 1351 Acked 2350 Read 2 Done Done New false
6486 1352 Acked 2351 Write 10 Done Done New false
6487 1353 Acked 2352 Write 3 Done Done New false
6488 1354 Acked 2353 Flush 0 Done Done New false
6489 1355 Acked 2354 Flush 0 Done Done New false
6490 1356 Acked 2355 Read 8 Done Done New false
6491 1357 Acked 2356 Write 4 Done Done New false
6492 1358 Acked 2357 Read 5 Done Done New false
6493 1359 Acked 2358 Read 9 Done Done New false
6494 1360 Acked 2359 Read 2 Done Done New false
6495 1361 Acked 2360 Read 2 Done Done New false
6496 1362 Acked 2361 Read 10 Done Done New false
6497 1363 Acked 2362 Write 8 Done Done New false
6498 1364 Acked 2363 Read 4 Done Done New false
6499 1365 Acked 2364 Read 5 Done Done New false
6500 1366 Acked 2365 Write 10 Done Done New false
6501 1367 Acked 2366 Read 1 Done Done New false
6502 1368 Acked 2367 Read 8 Done Done New false
6503 1369 Acked 2368 Write 6 Done Done New false
6504 1370 Acked 2369 Write 9 Done Done New false
6505 1371 Acked 2370 Read 9 Done Done New false
6506 1372 Acked 2371 Read 4 Done Done New false
6507 1373 Acked 2372 Read 1 Done Done New false
6508 1374 Acked 2373 Write 8 Done Done New false
6509 1375 Acked 2374 Write 3 Done Done New false
6510 1376 Acked 2375 Write 4 Done Done New false
6511 1377 Acked 2376 Flush 0 Done Done New false
6512 1378 Acked 2377 Write 6 Done Done New false
6513 1379 Acked 2378 Write 8 Done Done New false
6514 1380 Acked 2379 Read 1 Done Done New false
6515 1381 Acked 2380 Write 7 Done Done New false
6516 1382 Acked 2381 Read 1 Done Done New false
6517 1383 Acked 2382 Read 9 Done Done New false
6518 1384 Acked 2383 Flush 0 Done Done New false
6519 1385 Acked 2384 Write 8 Done Done New false
6520 1386 Acked 2385 Read 10 Done Done New false
6521 1387 Acked 2386 Read 2 Done Done New false
6522 1388 Acked 2387 Flush 0 Done Done New false
6523 1389 Acked 2388 Read 1 Done Done New false
6524 1390 Acked 2389 Write 9 Done Done New false
6525 1391 Acked 2390 Read 6 Done Done New false
6526 1392 Acked 2391 Read 1 Done Done New false
6527 1393 Acked 2392 Read 6 Done Done New false
6528 1394 Acked 2393 Write 6 Done Done New false
6529 1395 Acked 2394 Read 8 Done Done New false
6530 1396 Acked 2395 Write 5 Done Done New false
6531 1397 Acked 2396 Write 3 Done Done New false
6532 1398 Acked 2397 Read 7 Done Done New false
6533 1399 Acked 2398 Write 2 Done Done New false
6534 1400 Acked 2399 Flush 0 Done Done New false
6535 1401 Acked 2400 Read 7 Done Done New false
6536 1402 Acked 2401 Read 4 Done Done New false
6537 1403 Acked 2402 Write 3 Done Done New false
6538 1404 Acked 2403 Write 9 Done Done New false
6539 1405 Acked 2404 Write 3 Done Done New false
6540 1406 Acked 2405 Flush 0 Done Done New false
6541 1407 Acked 2406 Read 2 Done Done New false
6542 1408 Acked 2407 Read 3 Done Done New false
6543 1409 Acked 2408 Flush 0 Done Done New false
6544 1410 Acked 2409 Write 3 Done Done New false
6545 1411 Acked 2410 Read 2 Done Done New false
6546 1412 Acked 2411 Write 4 Done Done New false
6547 1413 Acked 2412 Read 4 Done Done New false
6548 1414 Acked 2413 Read 3 Done Done New false
6549 1415 Acked 2414 Flush 0 Done Done New false
6550 1416 Acked 2415 Read 9 Done Done New false
6551 1417 Acked 2416 Flush 0 Done Done New false
6552 1418 Acked 2417 Write 2 Done Done New false
6553 1419 Acked 2418 Read 6 Done Done New false
6554 1420 Acked 2419 Read 1 Done Done New false
6555 1421 Acked 2420 Read 6 Done Done New false
6556 1422 Acked 2421 Flush 0 Done Done New false
6557 1423 Acked 2422 Write 9 Done Done New false
6558 1424 Acked 2423 Flush 0 Done Done New false
6559 1425 Acked 2424 Read 9 Done Done New false
6560 1426 Acked 2425 Read 9 Done Done New false
6561 1427 Acked 2426 Write 5 Done Done New false
6562 1428 Acked 2427 Read 3 Done Done New false
6563 1429 Acked 2428 Read 8 Done Done New false
6564 1430 Acked 2429 Write 4 Done Done New false
6565 1431 Acked 2430 Read 2 Done Done New false
6566 1432 Acked 2431 Read 9 Done Done New false
6567 1433 Acked 2432 Write 3 Done Done New false
6568 1434 Acked 2433 Write 1 Done Done New false
6569 1435 Acked 2434 Flush 0 Done Done New false
6570 1436 Acked 2435 Read 9 Done Done New false
6571 1437 Acked 2436 Read 1 Done Done New false
6572 1438 Acked 2437 Read 9 Done Done New false
6573 1439 Acked 2438 Write 6 Done Done New false
6574 1440 Acked 2439 Read 7 Done Done New false
6575 1441 Acked 2440 Write 8 Done Done New false
6576 1442 Acked 2441 Read 9 Done Done New false
6577 1443 Acked 2442 Write 2 Done Done New false
6578 1444 Acked 2443 Read 2 Done Done New false
6579 1445 Acked 2444 Read 1 Done Done New false
6580 1446 Acked 2445 Read 8 Done Done New false
6581 1447 Acked 2446 Flush 0 Done Done New false
6582 1448 Acked 2447 Write 9 Done Done New false
6583 1449 Acked 2448 Read 2 Done Done New false
6584 1450 Acked 2449 Read 1 Done Done New false
6585 1451 Acked 2450 Read 6 Done Done New false
6586 1452 Acked 2451 Read 2 Done Done New false
6587 1453 Acked 2452 Read 3 Done Done New false
6588 1454 Acked 2453 Write 4 Done Done New false
6589 1455 Acked 2454 Read 5 Done Done New false
6590 1456 Acked 2455 Write 3 Done Done New false
6591 1457 Acked 2456 Write 6 Done Done New false
6592 1458 Acked 2457 Write 2 Done Done New false
6593 1459 Acked 2458 Flush 0 Done Done New false
6594 1460 Acked 2459 Flush 0 Done Done New false
6595 1461 Acked 2460 Write 6 Done Done New false
6596 1462 Acked 2461 Flush 0 Done Done New false
6597 1463 Acked 2462 Read 4 Done Done New false
6598 1464 Acked 2463 Read 6 Done Done New false
6599 1465 Acked 2464 Read 3 Done Done New false
6600 1466 Acked 2465 Read 6 Done Done New false
6601 1467 Acked 2466 Read 9 Done Done New false
6602 1468 Acked 2467 Flush 0 Done Done New false
6603 1469 Acked 2468 Read 3 Done Done New false
6604 1470 Acked 2469 Read 3 Done Done New false
6605 1471 Acked 2470 Read 10 Done Done New false
6606 1472 Acked 2471 Read 7 Done Done New false
6607 1473 Acked 2472 Flush 0 Done Done New false
6608 1474 Acked 2473 Read 5 Done Done New false
6609 1475 Acked 2474 Write 8 Done Done New false
6610 1476 Acked 2475 Write 6 Done Done New false
6611 1477 Acked 2476 Read 7 Done Done New false
6612 1478 Acked 2477 Read 10 Done Done New false
6613 1479 Acked 2478 Read 2 Done Done New false
6614 1480 Acked 2479 Read 8 Done Done New false
6615 1481 Acked 2480 Read 9 Done Done New false
6616 1482 Acked 2481 Write 2 Done Done New false
6617 1483 Acked 2482 Read 6 Done Done New false
6618 1484 Acked 2483 Read 8 Done Done New false
6619 1485 Acked 2484 Flush 0 Done Done New false
6620 1486 Acked 2485 Read 5 Done Done New false
6621 1487 Acked 2486 Read 4 Done Done New false
6622 1488 Acked 2487 Read 7 Done Done New false
6623 1489 Acked 2488 Flush 0 Done Done New false
6624 1490 Acked 2489 Read 9 Done Done New false
6625 1491 Acked 2490 Read 6 Done Done New false
6626 1492 Acked 2491 Write 2 Done Done New false
6627 1493 Acked 2492 Flush 0 Done Done New false
6628 1494 Acked 2493 Read 8 Done Done New false
6629 1495 Acked 2494 Write 7 Done Done New false
6630 1496 Acked 2495 Read 2 Done Done New false
6631 1497 Acked 2496 Write 3 Done Done New false
6632 1498 Acked 2497 Read 9 Done Done New false
6633 1499 Acked 2498 Flush 0 Done Done New false
6634 1500 Acked 2499 Write 8 Done Done New false
6635 1501 Acked 2500 Write 2 Done Done New false
6636 1502 Acked 2501 Read 5 Done Done New false
6637 1503 Acked 2502 Read 3 Done Done New false
6638 1504 Acked 2503 Read 6 Done Done New false
6639 1505 Acked 2504 Write 2 Done Done New false
6640 1506 Acked 2505 Read 4 Done Done New false
6641 1507 Acked 2506 Write 3 Done Done New false
6642 STATES DS:0 DS:1 DS:2 TOTAL
6643 New 0 0 301 301
6644 Sent 0 0 0 0
6645 Done 301 301 0 602
6646 Skipped 0 0 0 0
6647 Error 0 0 0 0
6648 Last Flush: 2498 2498 2205
6649 Downstairs last five completed: 2205 2204 2203 2202 2201
6650 Upstairs last five completed: 1507 1506 1505 1504 1503
6651 CLIENT: Up:0 ds:301 act:2
6652 [8830] got start action
6653 [8830] I am going to restart
6654 Starting downstairs at port 8830
6655 Make output file at "/tmp/dsc/downstairs-8830.txt"
6656 [8830][2] reports Starting
6657 Downstairs /var/tmp/dsc/region/8830 port 8830 PID:Some(1201)
6658 [8830][2] reports Running
6659 ----------------------------------------------------------------
6660 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:302
6661 States: Active Active Offline
6662 GW_ID ACK DSID TYPE BLOCKS DS:0 DS:1 DS:2 REPLAY
6663 1207 Acked 2206 Read 9 Done Done New false
6664 1208 Acked 2207 Read 3 Done Done New false
6665 1209 Acked 2208 Read 8 Done Done New false
6666 1210 Acked 2209 Read 9 Done Done New false
6667 1211 Acked 2210 Write 3 Done Done New false
6668 1212 Acked 2211 Read 7 Done Done New false
6669 1213 Acked 2212 Flush 0 Done Done New false
6670 1214 Acked 2213 Read 3 Done Done New false
6671 1215 Acked 2214 Write 2 Done Done New false
6672 1216 Acked 2215 Write 10 Done Done New false
6673 1217 Acked 2216 Read 6 Done Done New false
6674 1218 Acked 2217 Read 4 Done Done New false
6675 1219 Acked 2218 Write 7 Done Done New false
6676 1220 Acked 2219 Read 3 Done Done New false
6677 1221 Acked 2220 Write 5 Done Done New false
6678 1222 Acked 2221 Flush 0 Done Done New false
6679 1223 Acked 2222 Write 4 Done Done New false
6680 1224 Acked 2223 Read 5 Done Done New false
6681 1225 Acked 2224 Write 6 Done Done New false
6682 1226 Acked 2225 Write 9 Done Done New false
6683 1227 Acked 2226 Read 7 Done Done New false
6684 1228 Acked 2227 Read 6 Done Done New false
6685 1229 Acked 2228 Read 1 Done Done New false
6686 1230 Acked 2229 Read 8 Done Done New false
6687 1231 Acked 2230 Read 8 Done Done New false
6688 1232 Acked 2231 Write 5 Done Done New false
6689 1233 Acked 2232 Read 8 Done Done New false
6690 1234 Acked 2233 Read 9 Done Done New false
6691 1235 Acked 2234 Read 5 Done Done New false
6692 1236 Acked 2235 Read 9 Done Done New false
6693 1237 Acked 2236 Flush 0 Done Done New false
6694 1238 Acked 2237 Read 8 Done Done New false
6695 1239 Acked 2238 Write 9 Done Done New false
6696 1240 Acked 2239 Write 3 Done Done New false
6697 1241 Acked 2240 Write 3 Done Done New false
6698 1242 Acked 2241 Write 3 Done Done New false
6699 1243 Acked 2242 Write 9 Done Done New false
6700 1244 Acked 2243 Write 4 Done Done New false
6701 1245 Acked 2244 Write 7 Done Done New false
6702 1246 Acked 2245 Read 8 Done Done New false
6703 1247 Acked 2246 Write 6 Done Done New false
6704 1248 Acked 2247 Read 3 Done Done New false
6705 1249 Acked 2248 Read 3 Done Done New false
6706 1250 Acked 2249 Write 5 Done Done New false
6707 1251 Acked 2250 Write 9 Done Done New false
6708 1252 Acked 2251 Flush 0 Done Done New false
6709 1253 Acked 2252 Write 6 Done Done New false
6710 1254 Acked 2253 Write 3 Done Done New false
6711 1255 Acked 2254 Write 2 Done Done New false
6712 1256 Acked 2255 Write 5 Done Done New false
6713 1257 Acked 2256 Flush 0 Done Done New false
6714 1258 Acked 2257 Write 1 Done Done New false
6715 1259 Acked 2258 Flush 0 Done Done New false
6716 1260 Acked 2259 Write 10 Done Done New false
6717 1261 Acked 2260 Read 6 Done Done New false
6718 1262 Acked 2261 Read 1 Done Done New false
6719 1263 Acked 2262 Write 9 Done Done New false
6720 1264 Acked 2263 Read 10 Done Done New false
6721 1265 Acked 2264 Write 8 Done Done New false
6722 1266 Acked 2265 Read 7 Done Done New false
6723 1267 Acked 2266 Read 7 Done Done New false
6724 1268 Acked 2267 Read 9 Done Done New false
6725 1269 Acked 2268 Write 3 Done Done New false
6726 1270 Acked 2269 Read 2 Done Done New false
6727 1271 Acked 2270 Read 9 Done Done New false
6728 1272 Acked 2271 Read 5 Done Done New false
6729 1273 Acked 2272 Write 3 Done Done New false
6730 1274 Acked 2273 Read 10 Done Done New false
6731 1275 Acked 2274 Flush 0 Done Done New false
6732 1276 Acked 2275 Write 5 Done Done New false
6733 1277 Acked 2276 Read 9 Done Done New false
6734 1278 Acked 2277 Read 4 Done Done New false
6735 1279 Acked 2278 Read 1 Done Done New false
6736 1280 Acked 2279 Read 10 Done Done New false
6737 1281 Acked 2280 Write 9 Done Done New false
6738 1282 Acked 2281 Flush 0 Done Done New false
6739 1283 Acked 2282 Read 7 Done Done New false
6740 1284 Acked 2283 Read 4 Done Done New false
6741 1285 Acked 2284 Write 5 Done Done New false
6742 1286 Acked 2285 Write 10 Done Done New false
6743 1287 Acked 2286 Read 1 Done Done New false
6744 1288 Acked 2287 Write 7 Done Done New false
6745 1289 Acked 2288 Write 9 Done Done New false
6746 1290 Acked 2289 Write 5 Done Done New false
6747 1291 Acked 2290 Read 8 Done Done New false
6748 1292 Acked 2291 Read 8 Done Done New false
6749 1293 Acked 2292 Read 1 Done Done New false
6750 1294 Acked 2293 Read 7 Done Done New false
6751 1295 Acked 2294 Write 4 Done Done New false
6752 1296 Acked 2295 Flush 0 Done Done New false
6753 1297 Acked 2296 Write 2 Done Done New false
6754 1298 Acked 2297 Read 3 Done Done New false
6755 1299 Acked 2298 Read 3 Done Done New false
6756 1300 Acked 2299 Read 10 Done Done New false
6757 1301 Acked 2300 Write 7 Done Done New false
6758 1302 Acked 2301 Write 1 Done Done New false
6759 1303 Acked 2302 Write 3 Done Done New false
6760 1304 Acked 2303 Read 7 Done Done New false
6761 1305 Acked 2304 Write 3 Done Done New false
6762 1306 Acked 2305 Read 1 Done Done New false
6763 1307 Acked 2306 Read 1 Done Done New false
6764 1308 Acked 2307 Read 5 Done Done New false
6765 1309 Acked 2308 Write 8 Done Done New false
6766 1310 Acked 2309 Write 9 Done Done New false
6767 1311 Acked 2310 Write 10 Done Done New false
6768 1312 Acked 2311 Write 8 Done Done New false
6769 1313 Acked 2312 Read 9 Done Done New false
6770 1314 Acked 2313 Write 2 Done Done New false
6771 1315 Acked 2314 Write 10 Done Done New false
6772 1316 Acked 2315 Read 8 Done Done New false
6773 1317 Acked 2316 Write 2 Done Done New false
6774 1318 Acked 2317 Read 8 Done Done New false
6775 1319 Acked 2318 Write 6 Done Done New false
6776 1320 Acked 2319 Flush 0 Done Done New false
6777 1321 Acked 2320 Write 7 Done Done New false
6778 1322 Acked 2321 Write 4 Done Done New false
6779 1323 Acked 2322 Write 10 Done Done New false
6780 1324 Acked 2323 Read 3 Done Done New false
6781 1325 Acked 2324 Read 1 Done Done New false
6782 1326 Acked 2325 Write 6 Done Done New false
6783 1327 Acked 2326 Read 2 Done Done New false
6784 1328 Acked 2327 Write 2 Done Done New false
6785 1329 Acked 2328 Read 3 Done Done New false
6786 1330 Acked 2329 Read 6 Done Done New false
6787 1331 Acked 2330 Read 3 Done Done New false
6788 1332 Acked 2331 Read 5 Done Done New false
6789 1333 Acked 2332 Write 4 Done Done New false
6790 1334 Acked 2333 Read 6 Done Done New false
6791 1335 Acked 2334 Flush 0 Done Done New false
6792 1336 Acked 2335 Write 10 Done Done New false
6793 1337 Acked 2336 Read 10 Done Done New false
6794 1338 Acked 2337 Read 3 Done Done New false
6795 1339 Acked 2338 Read 10 Done Done New false
6796 1340 Acked 2339 Write 8 Done Done New false
6797 1341 Acked 2340 Read 1 Done Done New false
6798 1342 Acked 2341 Read 3 Done Done New false
6799 1343 Acked 2342 Read 1 Done Done New false
6800 1344 Acked 2343 Write 1 Done Done New false
6801 1345 Acked 2344 Write 8 Done Done New false
6802 1346 Acked 2345 Read 8 Done Done New false
6803 1347 Acked 2346 Read 1 Done Done New false
6804 1348 Acked 2347 Read 10 Done Done New false
6805 1349 Acked 2348 Read 8 Done Done New false
6806 1350 Acked 2349 Read 5 Done Done New false
6807 1351 Acked 2350 Read 2 Done Done New false
6808 1352 Acked 2351 Write 10 Done Done New false
6809 1353 Acked 2352 Write 3 Done Done New false
6810 1354 Acked 2353 Flush 0 Done Done New false
6811 1355 Acked 2354 Flush 0 Done Done New false
6812 1356 Acked 2355 Read 8 Done Done New false
6813 1357 Acked 2356 Write 4 Done Done New false
6814 1358 Acked 2357 Read 5 Done Done New false
6815 1359 Acked 2358 Read 9 Done Done New false
6816 1360 Acked 2359 Read 2 Done Done New false
6817 1361 Acked 2360 Read 2 Done Done New false
6818 1362 Acked 2361 Read 10 Done Done New false
6819 1363 Acked 2362 Write 8 Done Done New false
6820 1364 Acked 2363 Read 4 Done Done New false
6821 1365 Acked 2364 Read 5 Done Done New false
6822 1366 Acked 2365 Write 10 Done Done New false
6823 1367 Acked 2366 Read 1 Done Done New false
6824 1368 Acked 2367 Read 8 Done Done New false
6825 1369 Acked 2368 Write 6 Done Done New false
6826 1370 Acked 2369 Write 9 Done Done New false
6827 1371 Acked 2370 Read 9 Done Done New false
6828 1372 Acked 2371 Read 4 Done Done New false
6829 1373 Acked 2372 Read 1 Done Done New false
6830 1374 Acked 2373 Write 8 Done Done New false
6831 1375 Acked 2374 Write 3 Done Done New false
6832 1376 Acked 2375 Write 4 Done Done New false
6833 1377 Acked 2376 Flush 0 Done Done New false
6834 1378 Acked 2377 Write 6 Done Done New false
6835 1379 Acked 2378 Write 8 Done Done New false
6836 1380 Acked 2379 Read 1 Done Done New false
6837 1381 Acked 2380 Write 7 Done Done New false
6838 1382 Acked 2381 Read 1 Done Done New false
6839 1383 Acked 2382 Read 9 Done Done New false
6840 1384 Acked 2383 Flush 0 Done Done New false
6841 1385 Acked 2384 Write 8 Done Done New false
6842 1386 Acked 2385 Read 10 Done Done New false
6843 1387 Acked 2386 Read 2 Done Done New false
6844 1388 Acked 2387 Flush 0 Done Done New false
6845 1389 Acked 2388 Read 1 Done Done New false
6846 1390 Acked 2389 Write 9 Done Done New false
6847 1391 Acked 2390 Read 6 Done Done New false
6848 1392 Acked 2391 Read 1 Done Done New false
6849 1393 Acked 2392 Read 6 Done Done New false
6850 1394 Acked 2393 Write 6 Done Done New false
6851 1395 Acked 2394 Read 8 Done Done New false
6852 1396 Acked 2395 Write 5 Done Done New false
6853 1397 Acked 2396 Write 3 Done Done New false
6854 1398 Acked 2397 Read 7 Done Done New false
6855 1399 Acked 2398 Write 2 Done Done New false
6856 1400 Acked 2399 Flush 0 Done Done New false
6857 1401 Acked 2400 Read 7 Done Done New false
6858 1402 Acked 2401 Read 4 Done Done New false
6859 1403 Acked 2402 Write 3 Done Done New false
6860 1404 Acked 2403 Write 9 Done Done New false
6861 1405 Acked 2404 Write 3 Done Done New false
6862 1406 Acked 2405 Flush 0 Done Done New false
6863 1407 Acked 2406 Read 2 Done Done New false
6864 1408 Acked 2407 Read 3 Done Done New false
6865 1409 Acked 2408 Flush 0 Done Done New false
6866 1410 Acked 2409 Write 3 Done Done New false
6867 1411 Acked 2410 Read 2 Done Done New false
6868 1412 Acked 2411 Write 4 Done Done New false
6869 1413 Acked 2412 Read 4 Done Done New false
6870 1414 Acked 2413 Read 3 Done Done New false
6871 1415 Acked 2414 Flush 0 Done Done New false
6872 1416 Acked 2415 Read 9 Done Done New false
6873 1417 Acked 2416 Flush 0 Done Done New false
6874 1418 Acked 2417 Write 2 Done Done New false
6875 1419 Acked 2418 Read 6 Done Done New false
6876 1420 Acked 2419 Read 1 Done Done New false
6877 1421 Acked 2420 Read 6 Done Done New false
6878 1422 Acked 2421 Flush 0 Done Done New false
6879 1423 Acked 2422 Write 9 Done Done New false
6880 1424 Acked 2423 Flush 0 Done Done New false
6881 1425 Acked 2424 Read 9 Done Done New false
6882 1426 Acked 2425 Read 9 Done Done New false
6883 1427 Acked 2426 Write 5 Done Done New false
6884 1428 Acked 2427 Read 3 Done Done New false
6885 1429 Acked 2428 Read 8 Done Done New false
6886 1430 Acked 2429 Write 4 Done Done New false
6887 1431 Acked 2430 Read 2 Done Done New false
6888 1432 Acked 2431 Read 9 Done Done New false
6889 1433 Acked 2432 Write 3 Done Done New false
6890 1434 Acked 2433 Write 1 Done Done New false
6891 1435 Acked 2434 Flush 0 Done Done New false
6892 1436 Acked 2435 Read 9 Done Done New false
6893 1437 Acked 2436 Read 1 Done Done New false
6894 1438 Acked 2437 Read 9 Done Done New false
6895 1439 Acked 2438 Write 6 Done Done New false
6896 1440 Acked 2439 Read 7 Done Done New false
6897 1441 Acked 2440 Write 8 Done Done New false
6898 1442 Acked 2441 Read 9 Done Done New false
6899 1443 Acked 2442 Write 2 Done Done New false
6900 1444 Acked 2443 Read 2 Done Done New false
6901 1445 Acked 2444 Read 1 Done Done New false
6902 1446 Acked 2445 Read 8 Done Done New false
6903 1447 Acked 2446 Flush 0 Done Done New false
6904 1448 Acked 2447 Write 9 Done Done New false
6905 1449 Acked 2448 Read 2 Done Done New false
6906 1450 Acked 2449 Read 1 Done Done New false
6907 1451 Acked 2450 Read 6 Done Done New false
6908 1452 Acked 2451 Read 2 Done Done New false
6909 1453 Acked 2452 Read 3 Done Done New false
6910 1454 Acked 2453 Write 4 Done Done New false
6911 1455 Acked 2454 Read 5 Done Done New false
6912 1456 Acked 2455 Write 3 Done Done New false
6913 1457 Acked 2456 Write 6 Done Done New false
6914 1458 Acked 2457 Write 2 Done Done New false
6915 1459 Acked 2458 Flush 0 Done Done New false
6916 1460 Acked 2459 Flush 0 Done Done New false
6917 1461 Acked 2460 Write 6 Done Done New false
6918 1462 Acked 2461 Flush 0 Done Done New false
6919 1463 Acked 2462 Read 4 Done Done New false
6920 1464 Acked 2463 Read 6 Done Done New false
6921 1465 Acked 2464 Read 3 Done Done New false
6922 1466 Acked 2465 Read 6 Done Done New false
6923 1467 Acked 2466 Read 9 Done Done New false
6924 1468 Acked 2467 Flush 0 Done Done New false
6925 1469 Acked 2468 Read 3 Done Done New false
6926 1470 Acked 2469 Read 3 Done Done New false
6927 1471 Acked 2470 Read 10 Done Done New false
6928 1472 Acked 2471 Read 7 Done Done New false
6929 1473 Acked 2472 Flush 0 Done Done New false
6930 1474 Acked 2473 Read 5 Done Done New false
6931 1475 Acked 2474 Write 8 Done Done New false
6932 1476 Acked 2475 Write 6 Done Done New false
6933 1477 Acked 2476 Read 7 Done Done New false
6934 1478 Acked 2477 Read 10 Done Done New false
6935 1479 Acked 2478 Read 2 Done Done New false
6936 1480 Acked 2479 Read 8 Done Done New false
6937 1481 Acked 2480 Read 9 Done Done New false
6938 1482 Acked 2481 Write 2 Done Done New false
6939 1483 Acked 2482 Read 6 Done Done New false
6940 1484 Acked 2483 Read 8 Done Done New false
6941 1485 Acked 2484 Flush 0 Done Done New false
6942 1486 Acked 2485 Read 5 Done Done New false
6943 1487 Acked 2486 Read 4 Done Done New false
6944 1488 Acked 2487 Read 7 Done Done New false
6945 1489 Acked 2488 Flush 0 Done Done New false
6946 1490 Acked 2489 Read 9 Done Done New false
6947 1491 Acked 2490 Read 6 Done Done New false
6948 1492 Acked 2491 Write 2 Done Done New false
6949 1493 Acked 2492 Flush 0 Done Done New false
6950 1494 Acked 2493 Read 8 Done Done New false
6951 1495 Acked 2494 Write 7 Done Done New false
6952 1496 Acked 2495 Read 2 Done Done New false
6953 1497 Acked 2496 Write 3 Done Done New false
6954 1498 Acked 2497 Read 9 Done Done New false
6955 1499 Acked 2498 Flush 0 Done Done New false
6956 1500 Acked 2499 Write 8 Done Done New false
6957 1501 Acked 2500 Write 2 Done Done New false
6958 1502 Acked 2501 Read 5 Done Done New false
6959 1503 Acked 2502 Read 3 Done Done New false
6960 1504 Acked 2503 Read 6 Done Done New false
6961 1505 Acked 2504 Write 2 Done Done New false
6962 1506 Acked 2505 Read 4 Done Done New false
6963 1507 Acked 2506 Write 3 Done Done New false
6964 1508 Acked 2507 Flush 0 Done Done New false
6965 STATES DS:0 DS:1 DS:2 TOTAL
6966 New 0 0 302 302
6967 Sent 0 0 0 0
6968 Done 302 302 0 604
6969 Skipped 0 0 0 0
6970 Error 0 0 0 0
6971 Last Flush: 2507 2507 2205
6972 Downstairs last five completed: 2205 2204 2203 2202 2201
6973 Upstairs last five completed: 1508 1507 1506 1505 1504
6974 CLIENT: Up:0 ds:302 act:2
69752024-04-20T01:06:31.337ZINFOcrucible: connecting to 127.0.0.1:8830 = io task client = 2 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
69762024-04-20T01:06:31.337ZINFOcrucible: ds_connection connected from Ok(127.0.0.1:62609) = io task client = 2 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
69772024-04-20T01:06:31.339ZINFOcrucible: downstairs client at Some(127.0.0.1:8830) has region UUID 12345678-0000-0000-0000-000000008830 = downstairs client = 2 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
69782024-04-20T01:06:31.339ZINFOcrucible: Returning UUID:12345678-0000-0000-0000-000000008830 matches = downstairs client = 2 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
69792024-04-20T01:06:31.339ZINFOcrucible: send last flush ID to this DS: 2205 = downstairs client = 2 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
69802024-04-20T01:06:31.339ZINFOcrucible: Replied this last flush ID: 2205 = downstairs client = 2 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
69812024-04-20T01:06:31.339ZINFOcrucible: ds_transition from Offline to Replay = downstairs client = 2 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
69822024-04-20T01:06:31.339ZINFOcrucible: [2] Transition from Offline to Replay = downstairs client = 2 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
69832024-04-20T01:06:31.339ZINFOcrucible: ds_transition from Replay to Active = downstairs client = 2 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
69842024-04-20T01:06:31.339ZINFOcrucible: [2] Transition from Replay to Active = downstairs client = 2 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
6985 ----------------------------------------------------------------
6986 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:0
6987 Downstairs last five completed: 2507 2506 2505 2504 2503
6988 Upstairs last five completed: 1508 1507 1506 1505 1504
6989 CLIENT: Up:0 ds:0 act:3
6990 Replay: All jobs finished, all DS active.
6991 Main task has work to do, go find it
6992 got dsc Stop(1)
6993 stop 1
6994 Apr 20 01:06:33.650 INFO request completed, latency_us: 328, response_code: 204[8820] Got stop action so:false kr:false
6995 , uri: /stop/cid/1, method: POST, req_id: e37fdfc3-8c44-4df8-9bf6-81913ecda726, remote_addr: 127.0.0.1:60352, local_addr: 127.0.0.1:9998
69962024-04-20T01:06:33.650ZWARNcrucible: downstairs disconnected = io task client = 1 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
69972024-04-20T01:06:33.651ZWARNcrucible: client task is sending Done(Finished) = io task client = 1 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
69982024-04-20T01:06:33.651ZWARNcrucible: downstairs task for 1 stopped due to Finished session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
69992024-04-20T01:06:33.651ZINFOcrucible: Gone missing, transition from Active to Offline = downstairs client = 1 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
7000 Apr 20 01:06:33.651 INFO request completed, latency_us: 138, response_code: 200, {"msg":"[1] client re-new 0 jobs since flush 2507","v":0,"name":"crucible","level":30,"time":"2024-04-20T01:06:33.651093855Z","hostname":"w-01HVWGBJP7HK0H9TQ26T6N3X8M","pid":1196,"":"downstairs","":"downstairs","session_id":"132b460a-26a0-4532-b1ab-4f8c07d4c6c7"}
7001 uri: /state/cid/1, method: GET, req_id: 7bc07c2e-efcd-487d-acfd-632f0a9fdb2f, remote_addr: 127.0.0.1:60352, local_addr:{"msg":"[1] Marked 0 jobs for replay since flush: 2507","v":0,"name":"crucible","level":30,"time":"2024-04-20T01:06:33.651125114Z","hostname":"w-01HVWGBJP7HK0H9TQ26T6N3X8M","pid":1196,"":"downstairs","":"downstairs","session_id":"132b460a-26a0-4532-b1ab-4f8c07d4c6c7"}
7002 127.0.0.1:9998
70032024-04-20T01:06:33.651ZINFOcrucible: client task is exiting = io task client = 1 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
7004 [8820] Exited with: ExitStatus(unix_wait_status(9))
7005 [8820][1] reports Exit
7006 Apr 20 01:06:37.653 INFO request completed, latency_us: 185, response_code: 200, uri: /state/cid/1, method: GET, req_id: 5b43d4a2-37bf-4209-b9e4-08815c6d0bb6, remote_addr: 127.0.0.1:60352, local_addr: 127.0.0.1:9998
7007 001/300 Read block 3758 len 12288
7008 002/300 Write block 4112 len 12288 data: 2 3 3
7009 003/300 Read block 692 len 12288
7010 004/300 Read block 3756 len 40960
7011 005/300 Read block 40 len 12288
7012 006/300 Write block 3581 len 12288 data: 3 3 3
7013 007/300 Write block 4964 len 4096 data: 2
7014 008/300 Write block 4520 len 40960 data: 4 4 4 4 3 3 3 2 2 4
7015 009/300 Write block 4952 len 16384 data: 2 2 2 2
7016 010/300 Flush
7017 011/300 Read block 423 len 32768
7018 012/300 Write block 1883 len 4096 data: 2
7019 013/300 Read block 611 len 16384
7020 014/300 Read block 1893 len 40960
7021 015/300 Read block 2425 len 8192
7022 016/300 Read block 396 len 28672
7023 017/300 Write block 4139 len 16384 data: 3 3 3 4
7024 018/300 Write block 864 len 28672 data: 2 2 2 3 2 2 2
7025 019/300 Read block 671 len 4096
7026 020/300 Read block 3072 len 8192
7027 021/300 Read block 924 len 28672
7028 022/300 Read block 2225 len 40960
7029 023/300 Write block 4197 len 20480 data: 2 2 4 4 4
7030 024/300 Write block 2387 len 40960 data: 3 3 3 3 4 4 4 3 3 3
7031 025/300 Read block 3687 len 8192
7032 026/300 Read block 1425 len 36864
7033 027/300 Read block 4896 len 40960
7034 028/300 Read block 4447 len 24576
7035 029/300 Write block 2811 len 32768 data: 4 4 5 4 4 3 2 2
7036 030/300 Read block 1332 len 20480
7037 031/300 Write block 952 len 8192 data: 2 2
7038 032/300 Read block 4499 len 40960
7039 033/300 Read block 1766 len 12288
7040 034/300 Read block 426 len 12288
7041 035/300 Flush
7042 036/300 Flush
7043 037/300 Flush
7044 038/300 Write block 3006 len 28672 data: 4 4 4 5 5 3 2
7045 039/300 Flush
7046 040/300 Write block 1613 len 4096 data: 2
7047 041/300 Read block 846 len 4096
7048 042/300 Read block 631 len 40960
7049 043/300 Write block 2724 len 32768 data: 3 3 3 4 4 4 4 3
7050 044/300 Read block 2894 len 32768
7051 045/300 Read block 643 len 16384
7052 046/300 Write block 573 len 36864 data: 3 3 3 3 3 3 3 3 3
7053 047/300 Flush
7054 048/300 Read block 411 len 24576
7055 049/300 Write block 3079 len 28672 data: 4 4 4 2 2 3 3
7056 050/300 Write block 1539 len 36864 data: 3 3 3 3 3 3 3 4 4
7057 051/300 Read block 3516 len 28672
7058 052/300 Read block 3004 len 32768
7059 053/300 Write block 4273 len 4096 data: 3
7060 054/300 Read block 4887 len 8192
7061 055/300 Read block 4254 len 4096
7062 056/300 Write block 2824 len 4096 data: 2
7063 057/300 Read block 4837 len 28672
7064 058/300 Read block 1360 len 28672
7065 059/300 Read block 2011 len 20480
7066 060/300 Read block 570 len 8192
7067 061/300 Flush
7068 062/300 Write block 3110 len 36864 data: 2 2 2 2 2 2 3 3 3
7069 063/300 Write block 3558 len 20480 data: 3 3 3 2 2
7070 064/300 Read block 296 len 8192
7071 065/300 Write block 1859 len 4096 data: 2
7072 066/300 Read block 3432 len 36864
7073 067/300 Read block 3462 len 32768
7074 068/300 Read block 3079 len 4096
7075 069/300 Write block 607 len 36864 data: 3 3 2 2 2 2 2 2 2
7076 070/300 Write block 4320 len 16384 data: 2 2 2 3
7077 071/300 Flush
7078 072/300 Read block 3347 len 36864
7079 073/300 Flush
7080 074/300 Read block 1419 len 16384
7081 075/300 Write block 3059 len 32768 data: 3 3 3 3 3 3 2 2
7082 076/300 Read block 1032 len 20480
7083 077/300 Read block 1442 len 20480
7084 078/300 Read block 2674 len 24576
7085 079/300 Read block 3075 len 20480
7086 080/300 Write block 592 len 24576 data: 3 3 3 3 3 3
7087 081/300 Read block 1131 len 12288
7088 082/300 Read block 2838 len 4096
7089 083/300 Write block 4430 len 16384 data: 2 2 2 2
7090 084/300 Write block 4785 len 12288 data: 5 5 5
7091 085/300 Read block 4194 len 20480
7092 086/300 Read block 4151 len 12288
7093 087/300 Read block 2810 len 40960
7094 088/300 Read block 4373 len 20480
7095 089/300 Read block 4625 len 20480
7096 090/300 Read block 4997 len 12288
7097 091/300 Write block 382 len 20480 data: 2 2 3 3 4
7098 092/300 Read block 234 len 20480
7099 093/300 Read block 4123 len 12288
7100 094/300 Read block 4283 len 16384
7101 095/300 Write block 3212 len 8192 data: 3 3
7102 096/300 Read block 2682 len 16384
7103 097/300 Read block 2631 len 20480
7104 098/300 Write block 1076 len 32768 data: 2 2 2 3 3 4 4 4
7105 099/300 Write block 1196 len 36864 data: 2 2 2 4 3 2 2 2 2
7106 100/300 Write block 501 len 16384 data: 3 2 3 3
7107 101/300 Write block 747 len 40960 data: 6 6 6 5 5 4 3 2 2 3
7108 102/300 Flush
7109 103/300 Write block 1980 len 12288 data: 2 2 2
7110 104/300 Write block 3726 len 16384 data: 3 3 3 3
7111 105/300 Write block 2724 len 28672 data: 4 4 4 5 5 5 5
7112 106/300 Read block 4097 len 16384
7113 107/300 Write block 2923 len 24576 data: 2 2 2 2 2 2
7114 108/300 Write block 3417 len 8192 data: 3 3
7115 109/300 Read block 2327 len 32768
7116 110/300 Write block 2641 len 24576 data: 3 4 4 4 3 3
7117 111/300 Flush
7118 112/300 Read block 3430 len 8192
7119 113/300 Write block 2164 len 16384 data: 3 3 3 3
7120 114/300 Read block 1807 len 28672
7121 115/300 Read block 866 len 16384
7122 116/300 Flush
7123 117/300 Flush
7124 118/300 Read block 27 len 40960
7125 119/300 Write block 3200 len 12288 data: 3 3 3
7126 120/300 Read block 2329 len 16384
7127 121/300 Write block 1544 len 40960 data: 4 4 5 5 3 3 3 2 2 2
7128 122/300 Read block 3119 len 36864
7129 123/300 Flush
7130 124/300 Write block 4462 len 12288 data: 3 3 3
7131 125/300 Write block 621 len 24576 data: 3 3 3 2 2 2
7132 126/300 Read block 3152 len 8192
7133 127/300 Write block 4073 len 24576 data: 3 3 3 4 4 4
7134 128/300 Write block 100 len 20480 data: 2 2 2 2 2
7135 129/300 Read block 1160 len 12288
7136 130/300 Write block 773 len 20480 data: 4 4 4 3 2
7137 131/300 Read block 510 len 24576
7138 132/300 Write block 2780 len 36864 data: 2 2 2 2 2 2 2 2 2
7139 133/300 Read block 2491 len 32768
7140 134/300 Read block 453 len 36864
7141 135/300 Read block 834 len 16384
7142 136/300 Write block 4911 len 12288 data: 2 2 2
7143 137/300 Write block 3566 len 8192 data: 2 2
7144 138/300 Flush
7145 139/300 Write block 1706 len 16384 data: 2 3 4 4
7146 140/300 Write block 2771 len 32768 data: 2 2 2 2 2 2 2 2
7147 141/300 Read block 709 len 16384
7148 142/300 Read block 4362 len 8192
7149 143/300 Write block 3767 len 40960 data: 3 3 2 2 2 2 2 2 2 2
7150 144/300 Write block 2187 len 32768 data: 3 2 2 2 2 2 2 2
7151 145/300 Write block 2093 len 24576 data: 4 4 4 4 4 3
7152 146/300 Flush
7153 147/300 Write block 213 len 4096 data: 2
7154 148/300 Read block 2495 len 28672
7155 149/300 Read block 1149 len 24576
7156 150/300 Write block 4135 len 12288 data: 2 2 3
7157 151/300 Write block 3499 len 12288 data: 3 3 3
7158 152/300 Read block 4770 len 8192
7159 153/300 Flush
7160 154/300 Read block 531 len 20480
7161 155/300 Read block 3547 len 40960
7162 156/300 Read block 3058 len 36864
7163 157/300 Read block 2174 len 4096
7164 158/300 Read block 657 len 24576
7165 159/300 Read block 1777 len 28672
7166 160/300 Write block 3281 len 32768 data: 3 3 3 3 3 4 4 2
7167 161/300 Write block 4024 len 24576 data: 3 3 3 3 3 3
7168 162/300 Write block 935 len 20480 data: 2 2 2 2 2
7169 163/300 Read block 3061 len 20480
7170 164/300 Write block 2711 len 20480 data: 2 2 2 2 2
7171 165/300 Read block 1906 len 36864
7172 166/300 Write block 2153 len 32768 data: 2 2 3 3 4 4 4 5
7173 167/300 Write block 2515 len 36864 data: 2 2 3 3 3 3 3 3 3
7174 168/300 Write block 4365 len 24576 data: 2 2 2 2 2 2
7175 169/300 Write block 4803 len 16384 data: 3 3 3 4
7176 170/300 Write block 653 len 8192 data: 2 2
7177 171/300 Read block 2321 len 36864
7178 172/300 Write block 4797 len 8192 data: 3 3
7179 173/300 Write block 4013 len 24576 data: 2 2 2 2 2 2
7180 174/300 Write block 2073 len 28672 data: 2 2 2 2 3 3 3
7181 175/300 Write block 2592 len 4096 data: 2
7182 176/300 Read block 1312 len 32768
7183 177/300 Read block 3003 len 4096
7184 178/300 Read block 3023 len 4096
7185 179/300 Read block 2003 len 4096
7186 180/300 Read block 2181 len 28672
7187 181/300 Read block 825 len 32768
7188 182/300 Read block 3478 len 4096
7189 183/300 Read block 1757 len 28672
7190 184/300 Read block 610 len 12288
7191 185/300 Read block 4428 len 4096
7192 186/300 Write block 386 len 4096 data: 5
7193 187/300 Write block 4570 len 40960 data: 2 2 2 2 2 2 2 2 2 2
7194 188/300 Read block 4193 len 8192
7195 189/300 Flush
7196 190/300 Read block 529 len 24576
7197 191/300 Write block 3100 len 4096 data: 5
7198 192/300 Read block 1148 len 36864
7199 193/300 Read block 2836 len 12288
7200 194/300 Read block 577 len 4096
7201 195/300 Write block 1768 len 36864 data: 2 2 3 3 3 3 3 4 4
7202 196/300 Read block 4711 len 16384
7203 197/300 Read block 238 len 24576
7204 198/300 Read block 2253 len 32768
7205 199/300 Write block 4208 len 16384 data: 2 2 2 2
7206 200/300 Write block 2239 len 28672 data: 3 3 2 2 2 3 3
7207 201/300 Write block 3362 len 32768 data: 2 2 2 2 2 2 2 2
7208 202/300 Read block 1070 len 40960
7209 203/300 Read block 2507 len 32768
7210 204/300 Write block 1011 len 4096 data: 2
7211 205/300 Write block 1490 len 8192 data: 2 2
7212 206/300 Read block 993 len 4096
7213 207/300 Read block 3961 len 8192
7214 208/300 Write block 2275 len 4096 data: 2
7215 209/300 Write block 4867 len 20480 data: 3 4 4 4 4
7216 210/300 Read block 1300 len 20480
7217 211/300 Read block 2313 len 24576
7218 212/300 Write block 4996 len 12288 data: 4 3 2
7219 213/300 Read block 1133 len 16384
7220 214/300 Flush
7221 215/300 Read block 3007 len 32768
7222 216/300 Write block 1269 len 12288 data: 3 4 2
7223 217/300 Read block 1932 len 24576
7224 218/300 Write block 1663 len 24576 data: 3 4 4 4 5 4
7225 219/300 Write block 2348 len 4096 data: 5
7226 220/300 Flush
7227 221/300 Write block 606 len 40960 data: 3 4 4 3 3 3 3 3 3 3
7228 222/300 Read block 1826 len 28672
7229 223/300 Read block 1276 len 12288
7230 224/300 Read block 3409 len 32768
7231 225/300 Read block 4726 len 28672
7232 226/300 Read block 926 len 40960
7233 227/300 Write block 147 len 16384 data: 2 2 2 2
7234 228/300 Write block 1975 len 32768 data: 2 2 2 2 2 3 3 3
7235 229/300 Write block 475 len 40960 data: 2 2 2 2 2 2 2 2 2 2
7236 230/300 Read block 38 len 32768
7237 231/300 Write block 2053 len 40960 data: 4 4 4 5 5 4 3 3 3 3
7238 232/300 Write block 643 len 20480 data: 3 3 4 3 4
7239 233/300 Read block 2842 len 32768
7240 234/300 Write block 2843 len 4096 data: 3
7241 235/300 Write block 3334 len 8192 data: 2 2
7242 236/300 Read block 4858 len 20480
7243 237/300 Read block 2499 len 12288
7244 238/300 Read block 1564 len 40960
7245 239/300 Read block 4669 len 36864
7246 240/300 Read block 4783 len 4096
7247 241/300 Write block 1399 len 40960 data: 2 2 2 2 2 2 2 2 2 2
7248 242/300 Read block 4496 len 8192
7249 243/300 Write block 1781 len 16384 data: 3 3 3 3
7250 244/300 Write block 3026 len 24576 data: 3 3 3 2 2 2
7251 245/300 Write block 3468 len 8192 data: 2 2
7252 246/300 Read block 3613 len 24576
7253 247/300 Read block 3362 len 12288
7254 248/300 Read block 1383 len 36864
7255 249/300 Read block 527 len 12288
7256 250/300 Read block 3938 len 16384
7257 251/300 Flush
7258 252/300 Write block 3972 len 20480 data: 2 2 2 2 2
7259 253/300 Write block 1449 len 16384 data: 3 3 3 3
7260 254/300 Flush
7261 255/300 Write block 2993 len 8192 data: 5 6
7262 256/300 Read block 1448 len 32768
7263 257/300 Flush
7264 258/300 Write block 1135 len 28672 data: 5 4 3 2 2 2 2
7265 259/300 Write block 2647 len 20480 data: 3 3 3 2 2
7266 260/300 Write block 1438 len 20480 data: 2 2 2 2 2
7267 261/300 Read block 4242 len 24576
7268 262/300 Read block 3438 len 8192
7269 263/300 Write block 411 len 32768 data: 2 2 2 3 3 3 3 4
7270 264/300 Read block 2613 len 8192
7271 265/300 Flush
7272 266/300 Read block 2519 len 20480
7273 267/300 Write block 3602 len 4096 data: 2
7274 268/300 Read block 1196 len 12288
7275 269/300 Read block 682 len 12288
7276 270/300 Read block 601 len 12288
7277 271/300 Flush
7278 272/300 Flush
7279 273/300 Read block 3981 len 28672
7280 274/300 Write block 1606 len 20480 data: 3 3 3 3 2
7281 275/300 Read block 4168 len 8192
7282 276/300 Write block 4897 len 24576 data: 2 2 2 2 2 3
7283 277/300 Write block 3303 len 4096 data: 2
7284 278/300 Write block 817 len 4096 data: 3
7285 279/300 Write block 1794 len 28672 data: 2 3 3 3 3 3 3
7286 280/300 Write block 3438 len 20480 data: 2 2 3 4 4
7287 281/300 Flush
7288 282/300 Write block 2768 len 28672 data: 4 3 2 3 3 3 3
7289 283/300 Write block 4854 len 36864 data: 3 3 3 3 3 2 2 3 2
7290 284/300 Read block 1516 len 36864
7291 285/300 Read block 3940 len 12288
7292 286/300 Read block 2531 len 8192
7293 287/300 Read block 4171 len 4096
7294 288/300 Write block 3964 len 20480 data: 2 2 2 2 2
7295 289/300 Read block 51 len 12288
7296 290/300 Read block 3259 len 40960
7297 291/300 Read block 1573 len 36864
7298 292/300 Read block 2165 len 4096
7299 293/300 Read block 2817 len 32768
7300 294/300 Read block 1434 len 8192
7301 295/300 Write block 2593 len 4096 data: 2
7302 296/300 Read block 1924 len 28672
7303 297/300 Write block 2664 len 32768 data: 3 3 3 2 2 2 2 2
7304 298/300 Read block 560 len 36864
7305 299/300 Read block 2237 len 32768
7306 300/300 Read block 1563 len 8192
7307 Main task has work to do, go find it
7308 got dsc Start(1)
7309 start 1
7310 Apr 20 01:06:37.948 INFO request completed, latency_us: 202, response_code: 204, uri: /start/cid/1, method: POST, req_id: 06b1b38b-ad1c-4367-96bc-7716b11ec52e, remote_addr: 127.0.0.1:60352, local_addr: 127.0.0.1:9998
7311 Replay: started 1, returned:Ok(())
7312 ----------------------------------------------------------------
7313 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:300
7314 States: Active Offline Active
7315 GW_ID ACK DSID TYPE BLOCKS DS:0 DS:1 DS:2 REPLAY
7316 1509 Acked 2508 Read 3 Done New Done false
7317 1510 Acked 2509 Write 3 Done New Done false
7318 1511 Acked 2510 Read 3 Done New Done false
7319 1512 Acked 2511 Read 10 Done New Done false
7320 1513 Acked 2512 Read 3 Done New Done false
7321 1514 Acked 2513 Write 3 Done New Done false
7322 1515 Acked 2514 Write 1 Done New Done false
7323 1516 Acked 2515 Write 10 Done New Done false
7324 1517 Acked 2516 Write 4 Done New Done false
7325 1518 Acked 2517 Flush 0 Done New Done false
7326 1519 Acked 2518 Read 8 Done New Done false
7327 1520 Acked 2519 Write 1 Done New Done false
7328 1521 Acked 2520 Read 4 Done New Done false
7329 1522 Acked 2521 Read 10 Done New Done false
7330 1523 Acked 2522 Read 2 Done New Done false
7331 1524 Acked 2523 Read 7 Done New Done false
7332 1525 Acked 2524 Write 4 Done New Done false
7333 1526 Acked 2525 Write 7 Done New Done false
7334 1527 Acked 2526 Read 1 Done New Done false
7335 1528 Acked 2527 Read 2 Done New Done false
7336 1529 Acked 2528 Read 7 Done New Done false
7337 1530 Acked 2529 Read 10 Done New Done false
7338 1531 Acked 2530 Write 5 Done New Done false
7339 1532 Acked 2531 Write 10 Done New Done false
7340 1533 Acked 2532 Read 2 Done New Done false
7341 1534 Acked 2533 Read 9 Done New Done false
7342 1535 Acked 2534 Read 10 Done New Done false
7343 1536 Acked 2535 Read 6 Done New Done false
7344 1537 Acked 2536 Write 8 Done New Done false
7345 1538 Acked 2537 Read 5 Done New Done false
7346 1539 Acked 2538 Write 2 Done New Done false
7347 1540 Acked 2539 Read 10 Done New Done false
7348 1541 Acked 2540 Read 3 Done New Done false
7349 1542 Acked 2541 Read 3 Done New Done false
7350 1543 Acked 2542 Flush 0 Done New Done false
7351 1544 Acked 2543 Flush 0 Done New Done false
7352 1545 Acked 2544 Flush 0 Done New Done false
7353 1546 Acked 2545 Write 7 Done New Done false
7354 1547 Acked 2546 Flush 0 Done New Done false
7355 1548 Acked 2547 Write 1 Done New Done false
7356 1549 Acked 2548 Read 1 Done New Done false
7357 1550 Acked 2549 Read 10 Done New Done false
7358 1551 Acked 2550 Write 8 Done New Done false
7359 1552 Acked 2551 Read 8 Done New Done false
7360 1553 Acked 2552 Read 4 Done New Done false
7361 1554 Acked 2553 Write 9 Done New Done false
7362 1555 Acked 2554 Flush 0 Done New Done false
7363 1556 Acked 2555 Read 6 Done New Done false
7364 1557 Acked 2556 Write 7 Done New Done false
7365 1558 Acked 2557 Write 9 Done New Done false
7366 1559 Acked 2558 Read 7 Done New Done false
7367 1560 Acked 2559 Read 8 Done New Done false
7368 1561 Acked 2560 Write 1 Done New Done false
7369 1562 Acked 2561 Read 2 Done New Done false
7370 1563 Acked 2562 Read 1 Done New Done false
7371 1564 Acked 2563 Write 1 Done New Done false
7372 1565 Acked 2564 Read 7 Done New Done false
7373 1566 Acked 2565 Read 7 Done New Done false
7374 1567 Acked 2566 Read 5 Done New Done false
7375 1568 Acked 2567 Read 2 Done New Done false
7376 1569 Acked 2568 Flush 0 Done New Done false
7377 1570 Acked 2569 Write 9 Done New Done false
7378 1571 Acked 2570 Write 5 Done New Done false
7379 1572 Acked 2571 Read 2 Done New Done false
7380 1573 Acked 2572 Write 1 Done New Done false
7381 1574 Acked 2573 Read 9 Done New Done false
7382 1575 Acked 2574 Read 8 Done New Done false
7383 1576 Acked 2575 Read 1 Done New Done false
7384 1577 Acked 2576 Write 9 Done New Done false
7385 1578 Acked 2577 Write 4 Done New Done false
7386 1579 Acked 2578 Flush 0 Done New Done false
7387 1580 Acked 2579 Read 9 Done New Done false
7388 1581 Acked 2580 Flush 0 Done New Done false
7389 1582 Acked 2581 Read 4 Done New Done false
7390 1583 Acked 2582 Write 8 Done New Done false
7391 1584 Acked 2583 Read 5 Done New Done false
7392 1585 Acked 2584 Read 5 Done New Done false
7393 1586 Acked 2585 Read 6 Done New Done false
7394 1587 Acked 2586 Read 5 Done New Done false
7395 1588 Acked 2587 Write 6 Done New Done false
7396 1589 Acked 2588 Read 3 Done New Done false
7397 1590 Acked 2589 Read 1 Done New Done false
7398 1591 Acked 2590 Write 4 Done New Done false
7399 1592 Acked 2591 Write 3 Done New Done false
7400 1593 Acked 2592 Read 5 Done New Done false
7401 1594 Acked 2593 Read 3 Done New Done false
7402 1595 Acked 2594 Read 10 Done New Done false
7403 1596 Acked 2595 Read 5 Done New Done false
7404 1597 Acked 2596 Read 5 Done New Done false
7405 1598 Acked 2597 Read 3 Done New Done false
7406 1599 Acked 2598 Write 5 Done New Done false
7407 1600 Acked 2599 Read 5 Done New Done false
7408 1601 Acked 2600 Read 3 Done New Done false
7409 1602 Acked 2601 Read 4 Done New Done false
7410 1603 Acked 2602 Write 2 Done New Done false
7411 1604 Acked 2603 Read 4 Done New Done false
7412 1605 Acked 2604 Read 5 Done New Done false
7413 1606 Acked 2605 Write 8 Done New Done false
7414 1607 Acked 2606 Write 9 Done New Done false
7415 1608 Acked 2607 Write 4 Done New Done false
7416 1609 Acked 2608 Write 10 Done New Done false
7417 1610 Acked 2609 Flush 0 Done New Done false
7418 1611 Acked 2610 Write 3 Done New Done false
7419 1612 Acked 2611 Write 4 Done New Done false
7420 1613 Acked 2612 Write 7 Done New Done false
7421 1614 Acked 2613 Read 4 Done New Done false
7422 1615 Acked 2614 Write 6 Done New Done false
7423 1616 Acked 2615 Write 2 Done New Done false
7424 1617 Acked 2616 Read 8 Done New Done false
7425 1618 Acked 2617 Write 6 Done New Done false
7426 1619 Acked 2618 Flush 0 Done New Done false
7427 1620 Acked 2619 Read 2 Done New Done false
7428 1621 Acked 2620 Write 4 Done New Done false
7429 1622 Acked 2621 Read 7 Done New Done false
7430 1623 Acked 2622 Read 4 Done New Done false
7431 1624 Acked 2623 Flush 0 Done New Done false
7432 1625 Acked 2624 Flush 0 Done New Done false
7433 1626 Acked 2625 Read 10 Done New Done false
7434 1627 Acked 2626 Write 3 Done New Done false
7435 1628 Acked 2627 Read 4 Done New Done false
7436 1629 Acked 2628 Write 10 Done New Done false
7437 1630 Acked 2629 Read 9 Done New Done false
7438 1631 Acked 2630 Flush 0 Done New Done false
7439 1632 Acked 2631 Write 3 Done New Done false
7440 1633 Acked 2632 Write 6 Done New Done false
7441 1634 Acked 2633 Read 2 Done New Done false
7442 1635 Acked 2634 Write 6 Done New Done false
7443 1636 Acked 2635 Write 5 Done New Done false
7444 1637 Acked 2636 Read 3 Done New Done false
7445 1638 Acked 2637 Write 5 Done New Done false
7446 1639 Acked 2638 Read 6 Done New Done false
7447 1640 Acked 2639 Write 9 Done New Done false
7448 1641 Acked 2640 Read 8 Done New Done false
7449 1642 Acked 2641 Read 9 Done New Done false
7450 1643 Acked 2642 Read 4 Done New Done false
7451 1644 Acked 2643 Write 3 Done New Done false
7452 1645 Acked 2644 Write 2 Done New Done false
7453 1646 Acked 2645 Flush 0 Done New Done false
7454 1647 Acked 2646 Write 4 Done New Done false
7455 1648 Acked 2647 Write 8 Done New Done false
7456 1649 Acked 2648 Read 4 Done New Done false
7457 1650 Acked 2649 Read 2 Done New Done false
7458 1651 Acked 2650 Write 10 Done New Done false
7459 1652 Acked 2651 Write 8 Done New Done false
7460 1653 Acked 2652 Write 6 Done New Done false
7461 1654 Acked 2653 Flush 0 Done New Done false
7462 1655 Acked 2654 Write 1 Done New Done false
7463 1656 Acked 2655 Read 7 Done New Done false
7464 1657 Acked 2656 Read 6 Done New Done false
7465 1658 Acked 2657 Write 3 Done New Done false
7466 1659 Acked 2658 Write 3 Done New Done false
7467 1660 Acked 2659 Read 2 Done New Done false
7468 1661 Acked 2660 Flush 0 Done New Done false
7469 1662 Acked 2661 Read 5 Done New Done false
7470 1663 Acked 2662 Read 10 Done New Done false
7471 1664 Acked 2663 Read 9 Done New Done false
7472 1665 Acked 2664 Read 1 Done New Done false
7473 1666 Acked 2665 Read 6 Done New Done false
7474 1667 Acked 2666 Read 7 Done New Done false
7475 1668 Acked 2667 Write 8 Done New Done false
7476 1669 Acked 2668 Write 6 Done New Done false
7477 1670 Acked 2669 Write 5 Done New Done false
7478 1671 Acked 2670 Read 5 Done New Done false
7479 1672 Acked 2671 Write 5 Done New Done false
7480 1673 Acked 2672 Read 9 Done New Done false
7481 1674 Acked 2673 Write 8 Done New Done false
7482 1675 Acked 2674 Write 9 Done New Done false
7483 1676 Acked 2675 Write 6 Done New Done false
7484 1677 Acked 2676 Write 4 Done New Done false
7485 1678 Acked 2677 Write 2 Done New Done false
7486 1679 Acked 2678 Read 9 Done New Done false
7487 1680 Acked 2679 Write 2 Done New Done false
7488 1681 Acked 2680 Write 6 Done New Done false
7489 1682 Acked 2681 Write 7 Done New Done false
7490 1683 Acked 2682 Write 1 Done New Done false
7491 1684 Acked 2683 Read 8 Done New Done false
7492 1685 Acked 2684 Read 1 Done New Done false
7493 1686 Acked 2685 Read 1 Done New Done false
7494 1687 Acked 2686 Read 1 Done New Done false
7495 1688 Acked 2687 Read 7 Done New Done false
7496 1689 Acked 2688 Read 8 Done New Done false
7497 1690 Acked 2689 Read 1 Done New Done false
7498 1691 Acked 2690 Read 7 Done New Done false
7499 1692 Acked 2691 Read 3 Done New Done false
7500 1693 Acked 2692 Read 1 Done New Done false
7501 1694 Acked 2693 Write 1 Done New Done false
7502 1695 Acked 2694 Write 10 Done New Done false
7503 1696 Acked 2695 Read 2 Done New Done false
7504 1697 Acked 2696 Flush 0 Done New Done false
7505 1698 Acked 2697 Read 6 Done New Done false
7506 1699 Acked 2698 Write 1 Done New Done false
7507 1700 Acked 2699 Read 9 Done New Done false
7508 1701 Acked 2700 Read 3 Done New Done false
7509 1702 Acked 2701 Read 1 Done New Done false
7510 1703 Acked 2702 Write 9 Done New Done false
7511 1704 Acked 2703 Read 4 Done New Done false
7512 1705 Acked 2704 Read 6 Done New Done false
7513 1706 Acked 2705 Read 8 Done New Done false
7514 1707 Acked 2706 Write 4 Done New Done false
7515 1708 Acked 2707 Write 7 Done New Done false
7516 1709 Acked 2708 Write 8 Done New Done false
7517 1710 Acked 2709 Read 10 Done New Done false
7518 1711 Acked 2710 Read 8 Done New Done false
7519 1712 Acked 2711 Write 1 Done New Done false
7520 1713 Acked 2712 Write 2 Done New Done false
7521 1714 Acked 2713 Read 1 Done New Done false
7522 1715 Acked 2714 Read 2 Done New Done false
7523 1716 Acked 2715 Write 1 Done New Done false
7524 1717 Acked 2716 Write 5 Done New Done false
7525 1718 Acked 2717 Read 5 Done New Done false
7526 1719 Acked 2718 Read 6 Done New Done false
7527 1720 Acked 2719 Write 3 Done New Done false
7528 1721 Acked 2720 Read 4 Done New Done false
7529 1722 Acked 2721 Flush 0 Done New Done false
7530 1723 Acked 2722 Read 8 Done New Done false
7531 1724 Acked 2723 Write 3 Done New Done false
7532 1725 Acked 2724 Read 6 Done New Done false
7533 1726 Acked 2725 Write 6 Done New Done false
7534 1727 Acked 2726 Write 1 Done New Done false
7535 1728 Acked 2727 Flush 0 Done New Done false
7536 1729 Acked 2728 Write 10 Done New Done false
7537 1730 Acked 2729 Read 7 Done New Done false
7538 1731 Acked 2730 Read 3 Done New Done false
7539 1732 Acked 2731 Read 8 Done New Done false
7540 1733 Acked 2732 Read 7 Done New Done false
7541 1734 Acked 2733 Read 10 Done New Done false
7542 1735 Acked 2734 Write 4 Done New Done false
7543 1736 Acked 2735 Write 8 Done New Done false
7544 1737 Acked 2736 Write 10 Done New Done false
7545 1738 Acked 2737 Read 8 Done New Done false
7546 1739 Acked 2738 Write 10 Done New Done false
7547 1740 Acked 2739 Write 5 Done New Done false
7548 1741 Acked 2740 Read 8 Done New Done false
7549 1742 Acked 2741 Write 1 Done New Done false
7550 1743 Acked 2742 Write 2 Done New Done false
7551 1744 Acked 2743 Read 5 Done New Done false
7552 1745 Acked 2744 Read 3 Done New Done false
7553 1746 Acked 2745 Read 10 Done New Done false
7554 1747 Acked 2746 Read 9 Done New Done false
7555 1748 Acked 2747 Read 1 Done New Done false
7556 1749 Acked 2748 Write 10 Done New Done false
7557 1750 Acked 2749 Read 2 Done New Done false
7558 1751 Acked 2750 Write 4 Done New Done false
7559 1752 Acked 2751 Write 6 Done New Done false
7560 1753 Acked 2752 Write 2 Done New Done false
7561 1754 Acked 2753 Read 6 Done New Done false
7562 1755 Acked 2754 Read 3 Done New Done false
7563 1756 Acked 2755 Read 9 Done New Done false
7564 1757 Acked 2756 Read 3 Done New Done false
7565 1758 Acked 2757 Read 4 Done New Done false
7566 1759 Acked 2758 Flush 0 Done New Done false
7567 1760 Acked 2759 Write 5 Done New Done false
7568 1761 Acked 2760 Write 4 Done New Done false
7569 1762 Acked 2761 Flush 0 Done New Done false
7570 1763 Acked 2762 Write 2 Done New Done false
7571 1764 Acked 2763 Read 8 Done New Done false
7572 1765 Acked 2764 Flush 0 Done New Done false
7573 1766 Acked 2765 Write 7 Done New Done false
7574 1767 Acked 2766 Write 5 Done New Done false
7575 1768 Acked 2767 Write 5 Done New Done false
7576 1769 Acked 2768 Read 6 Done New Done false
7577 1770 Acked 2769 Read 2 Done New Done false
7578 1771 Acked 2770 Write 8 Done New Done false
7579 1772 Acked 2771 Read 2 Done New Done false
7580 1773 Acked 2772 Flush 0 Done New Done false
7581 1774 Acked 2773 Read 5 Done New Done false
7582 1775 Acked 2774 Write 1 Done New Done false
7583 1776 Acked 2775 Read 3 Done New Done false
7584 1777 Acked 2776 Read 3 Done New Done false
7585 1778 Acked 2777 Read 3 Done New Done false
7586 1779 Acked 2778 Flush 0 Done New Done false
7587 1780 Acked 2779 Flush 0 Done New Done false
7588 1781 Acked 2780 Read 7 Done New Done false
7589 1782 Acked 2781 Write 5 Done New Done false
7590 1783 Acked 2782 Read 2 Done New Done false
7591 1784 Acked 2783 Write 6 Done New Done false
7592 1785 Acked 2784 Write 1 Done New Done false
7593 1786 Acked 2785 Write 1 Done New Done false
7594 1787 Acked 2786 Write 7 Done New Done false
7595 1788 Acked 2787 Write 5 Done New Done false
7596 1789 Acked 2788 Flush 0 Done New Done false
7597 1790 Acked 2789 Write 7 Done New Done false
7598 1791 Acked 2790 Write 9 Done New Done false
7599 1792 Acked 2791 Read 9 Done New Done false
7600 1793 Acked 2792 Read 3 Done New Done false
7601 1794 Acked 2793 Read 2 Done New Done false
7602 1795 Acked 2794 Read 1 Done New Done false
7603 1796 Acked 2795 Write 5 Done New Done false
7604 1797 Acked 2796 Read 3 Done New Done false
7605 1798 Acked 2797 Read 10 Done New Done false
7606 1799 Acked 2798 Read 9 Done New Done false
7607 1800 Acked 2799 Read 1 Done New Done false
7608 1801 Acked 2800 Read 8 Done New Done false
7609 1802 Acked 2801 Read 2 Done New Done false
7610 1803 Acked 2802 Write 1 Done New Done false
7611 1804 Acked 2803 Read 7 Done New Done false
7612 1805 Acked 2804 Write 8 Done New Done false
7613 1806 Acked 2805 Read 9 Done New Done false
7614 1807 Acked 2806 Read 8 Done New Done false
7615 1808 Acked 2807 Read 2 Done New Done false
7616 STATES DS:0 DS:1 DS:2 TOTAL
7617 New 0 300 0 300
7618 Sent 0 0 0 0
7619 Done 300 0 300 600
7620 Skipped 0 0 0 0
7621 Error 0 0 0 0
7622 Last Flush: 2788 2507 2788
7623 Downstairs last five completed: 2507 2506 2505 2504 2503
7624 Upstairs last five completed: 1808 1807 1806 1805 1804
7625 CLIENT: Up:0 ds:300 act:2
7626 ----------------------------------------------------------------
7627 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:301
7628 States: Active Offline Active
7629 GW_ID ACK DSID TYPE BLOCKS DS:0 DS:1 DS:2 REPLAY
7630 1509 Acked 2508 Read 3 Done New Done false
7631 1510 Acked 2509 Write 3 Done New Done false
7632 1511 Acked 2510 Read 3 Done New Done false
7633 1512 Acked 2511 Read 10 Done New Done false
7634 1513 Acked 2512 Read 3 Done New Done false
7635 1514 Acked 2513 Write 3 Done New Done false
7636 1515 Acked 2514 Write 1 Done New Done false
7637 1516 Acked 2515 Write 10 Done New Done false
7638 1517 Acked 2516 Write 4 Done New Done false
7639 1518 Acked 2517 Flush 0 Done New Done false
7640 1519 Acked 2518 Read 8 Done New Done false
7641 1520 Acked 2519 Write 1 Done New Done false
7642 1521 Acked 2520 Read 4 Done New Done false
7643 1522 Acked 2521 Read 10 Done New Done false
7644 1523 Acked 2522 Read 2 Done New Done false
7645 1524 Acked 2523 Read 7 Done New Done false
7646 1525 Acked 2524 Write 4 Done New Done false
7647 1526 Acked 2525 Write 7 Done New Done false
7648 1527 Acked 2526 Read 1 Done New Done false
7649 1528 Acked 2527 Read 2 Done New Done false
7650 1529 Acked 2528 Read 7 Done New Done false
7651 1530 Acked 2529 Read 10 Done New Done false
7652 1531 Acked 2530 Write 5 Done New Done false
7653 1532 Acked 2531 Write 10 Done New Done false
7654 1533 Acked 2532 Read 2 Done New Done false
7655 1534 Acked 2533 Read 9 Done New Done false
7656 1535 Acked 2534 Read 10 Done New Done false
7657 1536 Acked 2535 Read 6 Done New Done false
7658 1537 Acked 2536 Write 8 Done New Done false
7659 1538 Acked 2537 Read 5 Done New Done false
7660 1539 Acked 2538 Write 2 Done New Done false
7661 1540 Acked 2539 Read 10 Done New Done false
7662 1541 Acked 2540 Read 3 Done New Done false
7663 1542 Acked 2541 Read 3 Done New Done false
7664 1543 Acked 2542 Flush 0 Done New Done false
7665 1544 Acked 2543 Flush 0 Done New Done false
7666 1545 Acked 2544 Flush 0 Done New Done false
7667 1546 Acked 2545 Write 7 Done New Done false
7668 1547 Acked 2546 Flush 0 Done New Done false
7669 1548 Acked 2547 Write 1 Done New Done false
7670 1549 Acked 2548 Read 1 Done New Done false
7671 1550 Acked 2549 Read 10 Done New Done false
7672 1551 Acked 2550 Write 8 Done New Done false
7673 1552 Acked 2551 Read 8 Done New Done false
7674 1553 Acked 2552 Read 4 Done New Done false
7675 1554 Acked 2553 Write 9 Done New Done false
7676 1555 Acked 2554 Flush 0 Done New Done false
7677 1556 Acked 2555 Read 6 Done New Done false
7678 1557 Acked 2556 Write 7 Done New Done false
7679 1558 Acked 2557 Write 9 Done New Done false
7680 1559 Acked 2558 Read 7 Done New Done false
7681 1560 Acked 2559 Read 8 Done New Done false
7682 1561 Acked 2560 Write 1 Done New Done false
7683 1562 Acked 2561 Read 2 Done New Done false
7684 1563 Acked 2562 Read 1 Done New Done false
7685 1564 Acked 2563 Write 1 Done New Done false
7686 1565 Acked 2564 Read 7 Done New Done false
7687 1566 Acked 2565 Read 7 Done New Done false
7688 1567 Acked 2566 Read 5 Done New Done false
7689 1568 Acked 2567 Read 2 Done New Done false
7690 1569 Acked 2568 Flush 0 Done New Done false
7691 1570 Acked 2569 Write 9 Done New Done false
7692 1571 Acked 2570 Write 5 Done New Done false
7693 1572 Acked 2571 Read 2 Done New Done false
7694 1573 Acked 2572 Write 1 Done New Done false
7695 1574 Acked 2573 Read 9 Done New Done false
7696 1575 Acked 2574 Read 8 Done New Done false
7697 1576 Acked 2575 Read 1 Done New Done false
7698 1577 Acked 2576 Write 9 Done New Done false
7699 1578 Acked 2577 Write 4 Done New Done false
7700 1579 Acked 2578 Flush 0 Done New Done false
7701 1580 Acked 2579 Read 9 Done New Done false
7702 1581 Acked 2580 Flush 0 Done New Done false
7703 1582 Acked 2581 Read 4 Done New Done false
7704 1583 Acked 2582 Write 8 Done New Done false
7705 1584 Acked 2583 Read 5 Done New Done false
7706 1585 Acked 2584 Read 5 Done New Done false
7707 1586 Acked 2585 Read 6 Done New Done false
7708 1587 Acked 2586 Read 5 Done New Done false
7709 1588 Acked 2587 Write 6 Done New Done false
7710 1589 Acked 2588 Read 3 Done New Done false
7711 1590 Acked 2589 Read 1 Done New Done false
7712 1591 Acked 2590 Write 4 Done New Done false
7713 1592 Acked 2591 Write 3 Done New Done false
7714 1593 Acked 2592 Read 5 Done New Done false
7715 1594 Acked 2593 Read 3 Done New Done false
7716 1595 Acked 2594 Read 10 Done New Done false
7717 1596 Acked 2595 Read 5 Done New Done false
7718 1597 Acked 2596 Read 5 Done New Done false
7719 1598 Acked 2597 Read 3 Done New Done false
7720 1599 Acked 2598 Write 5 Done New Done false
7721 1600 Acked 2599 Read 5 Done New Done false
7722 1601 Acked 2600 Read 3 Done New Done false
7723 1602 Acked 2601 Read 4 Done New Done false
7724 1603 Acked 2602 Write 2 Done New Done false
7725 1604 Acked 2603 Read 4 Done New Done false
7726 1605 Acked 2604 Read 5 Done New Done false
7727 1606 Acked 2605 Write 8 Done New Done false
7728 1607 Acked 2606 Write 9 Done New Done false
7729 1608 Acked 2607 Write 4 Done New Done false
7730 1609 Acked 2608 Write 10 Done New Done false
7731 1610 Acked 2609 Flush 0 Done New Done false
7732 1611 Acked 2610 Write 3 Done New Done false
7733 1612 Acked 2611 Write 4 Done New Done false
7734 1613 Acked 2612 Write 7 Done New Done false
7735 1614 Acked 2613 Read 4 Done New Done false
7736 1615 Acked 2614 Write 6 Done New Done false
7737 1616 Acked 2615 Write 2 Done New Done false
7738 1617 Acked 2616 Read 8 Done New Done false
7739 1618 Acked 2617 Write 6 Done New Done false
7740 1619 Acked 2618 Flush 0 Done New Done false
7741 1620 Acked 2619 Read 2 Done New Done false
7742 1621 Acked 2620 Write 4 Done New Done false
7743 1622 Acked 2621 Read 7 Done New Done false
7744 1623 Acked 2622 Read 4 Done New Done false
7745 1624 Acked 2623 Flush 0 Done New Done false
7746 1625 Acked 2624 Flush 0 Done New Done false
7747 1626 Acked 2625 Read 10 Done New Done false
7748 1627 Acked 2626 Write 3 Done New Done false
7749 1628 Acked 2627 Read 4 Done New Done false
7750 1629 Acked 2628 Write 10 Done New Done false
7751 1630 Acked 2629 Read 9 Done New Done false
7752 1631 Acked 2630 Flush 0 Done New Done false
7753 1632 Acked 2631 Write 3 Done New Done false
7754 1633 Acked 2632 Write 6 Done New Done false
7755 1634 Acked 2633 Read 2 Done New Done false
7756 1635 Acked 2634 Write 6 Done New Done false
7757 1636 Acked 2635 Write 5 Done New Done false
7758 1637 Acked 2636 Read 3 Done New Done false
7759 1638 Acked 2637 Write 5 Done New Done false
7760 1639 Acked 2638 Read 6 Done New Done false
7761 1640 Acked 2639 Write 9 Done New Done false
7762 1641 Acked 2640 Read 8 Done New Done false
7763 1642 Acked 2641 Read 9 Done New Done false
7764 1643 Acked 2642 Read 4 Done New Done false
7765 1644 Acked 2643 Write 3 Done New Done false
7766 1645 Acked 2644 Write 2 Done New Done false
7767 1646 Acked 2645 Flush 0 Done New Done false
7768 1647 Acked 2646 Write 4 Done New Done false
7769 1648 Acked 2647 Write 8 Done New Done false
7770 1649 Acked 2648 Read 4 Done New Done false
7771 1650 Acked 2649 Read 2 Done New Done false
7772 1651 Acked 2650 Write 10 Done New Done false
7773 1652 Acked 2651 Write 8 Done New Done false
7774 1653 Acked 2652 Write 6 Done New Done false
7775 1654 Acked 2653 Flush 0 Done New Done false
7776 1655 Acked 2654 Write 1 Done New Done false
7777 1656 Acked 2655 Read 7 Done New Done false
7778 1657 Acked 2656 Read 6 Done New Done false
7779 1658 Acked 2657 Write 3 Done New Done false
7780 1659 Acked 2658 Write 3 Done New Done false
7781 1660 Acked 2659 Read 2 Done New Done false
7782 1661 Acked 2660 Flush 0 Done New Done false
7783 1662 Acked 2661 Read 5 Done New Done false
7784 1663 Acked 2662 Read 10 Done New Done false
7785 1664 Acked 2663 Read 9 Done New Done false
7786 1665 Acked 2664 Read 1 Done New Done false
7787 1666 Acked 2665 Read 6 Done New Done false
7788 1667 Acked 2666 Read 7 Done New Done false
7789 1668 Acked 2667 Write 8 Done New Done false
7790 1669 Acked 2668 Write 6 Done New Done false
7791 1670 Acked 2669 Write 5 Done New Done false
7792 1671 Acked 2670 Read 5 Done New Done false
7793 1672 Acked 2671 Write 5 Done New Done false
7794 1673 Acked 2672 Read 9 Done New Done false
7795 1674 Acked 2673 Write 8 Done New Done false
7796 1675 Acked 2674 Write 9 Done New Done false
7797 1676 Acked 2675 Write 6 Done New Done false
7798 1677 Acked 2676 Write 4 Done New Done false
7799 1678 Acked 2677 Write 2 Done New Done false
7800 1679 Acked 2678 Read 9 Done New Done false
7801 1680 Acked 2679 Write 2 Done New Done false
7802 1681 Acked 2680 Write 6 Done New Done false
7803 1682 Acked 2681 Write 7 Done New Done false
7804 1683 Acked 2682 Write 1 Done New Done false
7805 1684 Acked 2683 Read 8 Done New Done false
7806 1685 Acked 2684 Read 1 Done New Done false
7807 1686 Acked 2685 Read 1 Done New Done false
7808 1687 Acked 2686 Read 1 Done New Done false
7809 1688 Acked 2687 Read 7 Done New Done false
7810 1689 Acked 2688 Read 8 Done New Done false
7811 1690 Acked 2689 Read 1 Done New Done false
7812 1691 Acked 2690 Read 7 Done New Done false
7813 1692 Acked 2691 Read 3 Done New Done false
7814 1693 Acked 2692 Read 1 Done New Done false
7815 1694 Acked 2693 Write 1 Done New Done false
7816 1695 Acked 2694 Write 10 Done New Done false
7817 1696 Acked 2695 Read 2 Done New Done false
7818 1697 Acked 2696 Flush 0 Done New Done false
7819 1698 Acked 2697 Read 6 Done New Done false
7820 1699 Acked 2698 Write 1 Done New Done false
7821 1700 Acked 2699 Read 9 Done New Done false
7822 1701 Acked 2700 Read 3 Done New Done false
7823 1702 Acked 2701 Read 1 Done New Done false
7824 1703 Acked 2702 Write 9 Done New Done false
7825 1704 Acked 2703 Read 4 Done New Done false
7826 1705 Acked 2704 Read 6 Done New Done false
7827 1706 Acked 2705 Read 8 Done New Done false
7828 1707 Acked 2706 Write 4 Done New Done false
7829 1708 Acked 2707 Write 7 Done New Done false
7830 1709 Acked 2708 Write 8 Done New Done false
7831 1710 Acked 2709 Read 10 Done New Done false
7832 1711 Acked 2710 Read 8 Done New Done false
7833 1712 Acked 2711 Write 1 Done New Done false
7834 1713 Acked 2712 Write 2 Done New Done false
7835 1714 Acked 2713 Read 1 Done New Done false
7836 1715 Acked 2714 Read 2 Done New Done false
7837 1716 Acked 2715 Write 1 Done New Done false
7838 1717 Acked 2716 Write 5 Done New Done false
7839 1718 Acked 2717 Read 5 Done New Done false
7840 1719 Acked 2718 Read 6 Done New Done false
7841 1720 Acked 2719 Write 3 Done New Done false
7842 1721 Acked 2720 Read 4 Done New Done false
7843 1722 Acked 2721 Flush 0 Done New Done false
7844 1723 Acked 2722 Read 8 Done New Done false
7845 1724 Acked 2723 Write 3 Done New Done false
7846 1725 Acked 2724 Read 6 Done New Done false
7847 1726 Acked 2725 Write 6 Done New Done false
7848 1727 Acked 2726 Write 1 Done New Done false
7849 1728 Acked 2727 Flush 0 Done New Done false
7850 1729 Acked 2728 Write 10 Done New Done false
7851 1730 Acked 2729 Read 7 Done New Done false
7852 1731 Acked 2730 Read 3 Done New Done false
7853 1732 Acked 2731 Read 8 Done New Done false
7854 1733 Acked 2732 Read 7 Done New Done false
7855 1734 Acked 2733 Read 10 Done New Done false
7856 1735 Acked 2734 Write 4 Done New Done false
7857 1736 Acked 2735 Write 8 Done New Done false
7858 1737 Acked 2736 Write 10 Done New Done false
7859 1738 Acked 2737 Read 8 Done New Done false
7860 1739 Acked 2738 Write 10 Done New Done false
7861 1740 Acked 2739 Write 5 Done New Done false
7862 1741 Acked 2740 Read 8 Done New Done false
7863 1742 Acked 2741 Write 1 Done New Done false
7864 1743 Acked 2742 Write 2 Done New Done false
7865 1744 Acked 2743 Read 5 Done New Done false
7866 1745 Acked 2744 Read 3 Done New Done false
7867 1746 Acked 2745 Read 10 Done New Done false
7868 1747 Acked 2746 Read 9 Done New Done false
7869 1748 Acked 2747 Read 1 Done New Done false
7870 1749 Acked 2748 Write 10 Done New Done false
7871 1750 Acked 2749 Read 2 Done New Done false
7872 1751 Acked 2750 Write 4 Done New Done false
7873 1752 Acked 2751 Write 6 Done New Done false
7874 1753 Acked 2752 Write 2 Done New Done false
7875 1754 Acked 2753 Read 6 Done New Done false
7876 1755 Acked 2754 Read 3 Done New Done false
7877 1756 Acked 2755 Read 9 Done New Done false
7878 1757 Acked 2756 Read 3 Done New Done false
7879 1758 Acked 2757 Read 4 Done New Done false
7880 1759 Acked 2758 Flush 0 Done New Done false
7881 1760 Acked 2759 Write 5 Done New Done false
7882 1761 Acked 2760 Write 4 Done New Done false
7883 1762 Acked 2761 Flush 0 Done New Done false
7884 1763 Acked 2762 Write 2 Done New Done false
7885 1764 Acked 2763 Read 8 Done New Done false
7886 1765 Acked 2764 Flush 0 Done New Done false
7887 1766 Acked 2765 Write 7 Done New Done false
7888 1767 Acked 2766 Write 5 Done New Done false
7889 1768 Acked 2767 Write 5 Done New Done false
7890 1769 Acked 2768 Read 6 Done New Done false
7891 1770 Acked 2769 Read 2 Done New Done false
7892 1771 Acked 2770 Write 8 Done New Done false
7893 1772 Acked 2771 Read 2 Done New Done false
7894 1773 Acked 2772 Flush 0 Done New Done false
7895 1774 Acked 2773 Read 5 Done New Done false
7896 1775 Acked 2774 Write 1 Done New Done false
7897 1776 Acked 2775 Read 3 Done New Done false
7898 1777 Acked 2776 Read 3 Done New Done false
7899 1778 Acked 2777 Read 3 Done New Done false
7900 1779 Acked 2778 Flush 0 Done New Done false
7901 1780 Acked 2779 Flush 0 Done New Done false
7902 1781 Acked 2780 Read 7 Done New Done false
7903 1782 Acked 2781 Write 5 Done New Done false
7904 1783 Acked 2782 Read 2 Done New Done false
7905 1784 Acked 2783 Write 6 Done New Done false
7906 1785 Acked 2784 Write 1 Done New Done false
7907 1786 Acked 2785 Write 1 Done New Done false
7908 1787 Acked 2786 Write 7 Done New Done false
7909 1788 Acked 2787 Write 5 Done New Done false
7910 1789 Acked 2788 Flush 0 Done New Done false
7911 1790 Acked 2789 Write 7 Done New Done false
7912 1791 Acked 2790 Write 9 Done New Done false
7913 1792 Acked 2791 Read 9 Done New Done false
7914 1793 Acked 2792 Read 3 Done New Done false
7915 1794 Acked 2793 Read 2 Done New Done false
7916 1795 Acked 2794 Read 1 Done New Done false
7917 1796 Acked 2795 Write 5 Done New Done false
7918 1797 Acked 2796 Read 3 Done New Done false
7919 1798 Acked 2797 Read 10 Done New Done false
7920 1799 Acked 2798 Read 9 Done New Done false
7921 1800 Acked 2799 Read 1 Done New Done false
7922 1801 Acked 2800 Read 8 Done New Done false
7923 1802 Acked 2801 Read 2 Done New Done false
7924 1803 Acked 2802 Write 1 Done New Done false
7925 1804 Acked 2803 Read 7 Done New Done false
7926 1805 Acked 2804 Write 8 Done New Done false
7927 1806 Acked 2805 Read 9 Done New Done false
7928 1807 Acked 2806 Read 8 Done New Done false
7929 1808 Acked 2807 Read 2 Done New Done false
7930 1809 Acked 2808 Flush 0 Done New Done false
7931 STATES DS:0 DS:1 DS:2 TOTAL
7932 New 0 301 0 301
7933 Sent 0 0 0 0
7934 Done 301 0 301 602
7935 Skipped 0 0 0 0
7936 Error 0 0 0 0
7937 Last Flush: 2808 2507 2808
7938 Downstairs last five completed: 2507 2506 2505 2504 2503
7939 Upstairs last five completed: 1809 1808 1807 1806 1805
7940 CLIENT: Up:0 ds:301 act:2
79412024-04-20T01:06:43.651ZINFOcrucible: connecting to 127.0.0.1:8820 = io task client = 1 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
79422024-04-20T01:06:43.651ZWARNcrucible: ds_connection connect to 127.0.0.1:8820 failure: Os { code: 146, kind: ConnectionRefused, message: "Connection refused" } = io task client = 1 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
79432024-04-20T01:06:43.651ZWARNcrucible: client task is sending Done(ConnectionFailed(Os { code: 146, kind: ConnectionRefused, message: "Connection refused" })) = io task client = 1 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
79442024-04-20T01:06:43.652ZWARNcrucible: downstairs task for 1 stopped due to ConnectionFailed(Os { code: 146, kind: ConnectionRefused, message: "Connection refused" }) session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
79452024-04-20T01:06:43.652ZINFOcrucible: [1] client re-new 301 jobs since flush 2507 = downstairs session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
79462024-04-20T01:06:43.652ZINFOcrucible: [1] Marked 0 jobs for replay since flush: 2507 = downstairs session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
79472024-04-20T01:06:43.652ZINFOcrucible: client task is exiting = io task client = 1 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
7948 [8820] got start action
7949 [8820] I am going to restart
7950 Starting downstairs at port 8820
7951 Make output file at "/tmp/dsc/downstairs-8820.txt"
7952 [8820][1] reports Starting
7953 Downstairs /var/tmp/dsc/region/8820 port 8820 PID:Some(1202)
7954 [8820][1] reports Running
7955 ----------------------------------------------------------------
7956 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:301
7957 States: Active Offline Active
7958 GW_ID ACK DSID TYPE BLOCKS DS:0 DS:1 DS:2 REPLAY
7959 1509 Acked 2508 Read 3 Done New Done true
7960 1510 Acked 2509 Write 3 Done New Done true
7961 1511 Acked 2510 Read 3 Done New Done true
7962 1512 Acked 2511 Read 10 Done New Done true
7963 1513 Acked 2512 Read 3 Done New Done true
7964 1514 Acked 2513 Write 3 Done New Done true
7965 1515 Acked 2514 Write 1 Done New Done true
7966 1516 Acked 2515 Write 10 Done New Done true
7967 1517 Acked 2516 Write 4 Done New Done true
7968 1518 Acked 2517 Flush 0 Done New Done true
7969 1519 Acked 2518 Read 8 Done New Done true
7970 1520 Acked 2519 Write 1 Done New Done true
7971 1521 Acked 2520 Read 4 Done New Done true
7972 1522 Acked 2521 Read 10 Done New Done true
7973 1523 Acked 2522 Read 2 Done New Done true
7974 1524 Acked 2523 Read 7 Done New Done true
7975 1525 Acked 2524 Write 4 Done New Done true
7976 1526 Acked 2525 Write 7 Done New Done true
7977 1527 Acked 2526 Read 1 Done New Done true
7978 1528 Acked 2527 Read 2 Done New Done true
7979 1529 Acked 2528 Read 7 Done New Done true
7980 1530 Acked 2529 Read 10 Done New Done true
7981 1531 Acked 2530 Write 5 Done New Done true
7982 1532 Acked 2531 Write 10 Done New Done true
7983 1533 Acked 2532 Read 2 Done New Done true
7984 1534 Acked 2533 Read 9 Done New Done true
7985 1535 Acked 2534 Read 10 Done New Done true
7986 1536 Acked 2535 Read 6 Done New Done true
7987 1537 Acked 2536 Write 8 Done New Done true
7988 1538 Acked 2537 Read 5 Done New Done true
7989 1539 Acked 2538 Write 2 Done New Done true
7990 1540 Acked 2539 Read 10 Done New Done true
7991 1541 Acked 2540 Read 3 Done New Done true
7992 1542 Acked 2541 Read 3 Done New Done true
7993 1543 Acked 2542 Flush 0 Done New Done true
7994 1544 Acked 2543 Flush 0 Done New Done true
7995 1545 Acked 2544 Flush 0 Done New Done true
7996 1546 Acked 2545 Write 7 Done New Done true
7997 1547 Acked 2546 Flush 0 Done New Done true
7998 1548 Acked 2547 Write 1 Done New Done true
7999 1549 Acked 2548 Read 1 Done New Done true
8000 1550 Acked 2549 Read 10 Done New Done true
8001 1551 Acked 2550 Write 8 Done New Done true
8002 1552 Acked 2551 Read 8 Done New Done true
8003 1553 Acked 2552 Read 4 Done New Done true
8004 1554 Acked 2553 Write 9 Done New Done true
8005 1555 Acked 2554 Flush 0 Done New Done true
8006 1556 Acked 2555 Read 6 Done New Done true
8007 1557 Acked 2556 Write 7 Done New Done true
8008 1558 Acked 2557 Write 9 Done New Done true
8009 1559 Acked 2558 Read 7 Done New Done true
8010 1560 Acked 2559 Read 8 Done New Done true
8011 1561 Acked 2560 Write 1 Done New Done true
8012 1562 Acked 2561 Read 2 Done New Done true
8013 1563 Acked 2562 Read 1 Done New Done true
8014 1564 Acked 2563 Write 1 Done New Done true
8015 1565 Acked 2564 Read 7 Done New Done true
8016 1566 Acked 2565 Read 7 Done New Done true
8017 1567 Acked 2566 Read 5 Done New Done true
8018 1568 Acked 2567 Read 2 Done New Done true
8019 1569 Acked 2568 Flush 0 Done New Done true
8020 1570 Acked 2569 Write 9 Done New Done true
8021 1571 Acked 2570 Write 5 Done New Done true
8022 1572 Acked 2571 Read 2 Done New Done true
8023 1573 Acked 2572 Write 1 Done New Done true
8024 1574 Acked 2573 Read 9 Done New Done true
8025 1575 Acked 2574 Read 8 Done New Done true
8026 1576 Acked 2575 Read 1 Done New Done true
8027 1577 Acked 2576 Write 9 Done New Done true
8028 1578 Acked 2577 Write 4 Done New Done true
8029 1579 Acked 2578 Flush 0 Done New Done true
8030 1580 Acked 2579 Read 9 Done New Done true
8031 1581 Acked 2580 Flush 0 Done New Done true
8032 1582 Acked 2581 Read 4 Done New Done true
8033 1583 Acked 2582 Write 8 Done New Done true
8034 1584 Acked 2583 Read 5 Done New Done true
8035 1585 Acked 2584 Read 5 Done New Done true
8036 1586 Acked 2585 Read 6 Done New Done true
8037 1587 Acked 2586 Read 5 Done New Done true
8038 1588 Acked 2587 Write 6 Done New Done true
8039 1589 Acked 2588 Read 3 Done New Done true
8040 1590 Acked 2589 Read 1 Done New Done true
8041 1591 Acked 2590 Write 4 Done New Done true
8042 1592 Acked 2591 Write 3 Done New Done true
8043 1593 Acked 2592 Read 5 Done New Done true
8044 1594 Acked 2593 Read 3 Done New Done true
8045 1595 Acked 2594 Read 10 Done New Done true
8046 1596 Acked 2595 Read 5 Done New Done true
8047 1597 Acked 2596 Read 5 Done New Done true
8048 1598 Acked 2597 Read 3 Done New Done true
8049 1599 Acked 2598 Write 5 Done New Done true
8050 1600 Acked 2599 Read 5 Done New Done true
8051 1601 Acked 2600 Read 3 Done New Done true
8052 1602 Acked 2601 Read 4 Done New Done true
8053 1603 Acked 2602 Write 2 Done New Done true
8054 1604 Acked 2603 Read 4 Done New Done true
8055 1605 Acked 2604 Read 5 Done New Done true
8056 1606 Acked 2605 Write 8 Done New Done true
8057 1607 Acked 2606 Write 9 Done New Done true
8058 1608 Acked 2607 Write 4 Done New Done true
8059 1609 Acked 2608 Write 10 Done New Done true
8060 1610 Acked 2609 Flush 0 Done New Done true
8061 1611 Acked 2610 Write 3 Done New Done true
8062 1612 Acked 2611 Write 4 Done New Done true
8063 1613 Acked 2612 Write 7 Done New Done true
8064 1614 Acked 2613 Read 4 Done New Done true
8065 1615 Acked 2614 Write 6 Done New Done true
8066 1616 Acked 2615 Write 2 Done New Done true
8067 1617 Acked 2616 Read 8 Done New Done true
8068 1618 Acked 2617 Write 6 Done New Done true
8069 1619 Acked 2618 Flush 0 Done New Done true
8070 1620 Acked 2619 Read 2 Done New Done true
8071 1621 Acked 2620 Write 4 Done New Done true
8072 1622 Acked 2621 Read 7 Done New Done true
8073 1623 Acked 2622 Read 4 Done New Done true
8074 1624 Acked 2623 Flush 0 Done New Done true
8075 1625 Acked 2624 Flush 0 Done New Done true
8076 1626 Acked 2625 Read 10 Done New Done true
8077 1627 Acked 2626 Write 3 Done New Done true
8078 1628 Acked 2627 Read 4 Done New Done true
8079 1629 Acked 2628 Write 10 Done New Done true
8080 1630 Acked 2629 Read 9 Done New Done true
8081 1631 Acked 2630 Flush 0 Done New Done true
8082 1632 Acked 2631 Write 3 Done New Done true
8083 1633 Acked 2632 Write 6 Done New Done true
8084 1634 Acked 2633 Read 2 Done New Done true
8085 1635 Acked 2634 Write 6 Done New Done true
8086 1636 Acked 2635 Write 5 Done New Done true
8087 1637 Acked 2636 Read 3 Done New Done true
8088 1638 Acked 2637 Write 5 Done New Done true
8089 1639 Acked 2638 Read 6 Done New Done true
8090 1640 Acked 2639 Write 9 Done New Done true
8091 1641 Acked 2640 Read 8 Done New Done true
8092 1642 Acked 2641 Read 9 Done New Done true
8093 1643 Acked 2642 Read 4 Done New Done true
8094 1644 Acked 2643 Write 3 Done New Done true
8095 1645 Acked 2644 Write 2 Done New Done true
8096 1646 Acked 2645 Flush 0 Done New Done true
8097 1647 Acked 2646 Write 4 Done New Done true
8098 1648 Acked 2647 Write 8 Done New Done true
8099 1649 Acked 2648 Read 4 Done New Done true
8100 1650 Acked 2649 Read 2 Done New Done true
8101 1651 Acked 2650 Write 10 Done New Done true
8102 1652 Acked 2651 Write 8 Done New Done true
8103 1653 Acked 2652 Write 6 Done New Done true
8104 1654 Acked 2653 Flush 0 Done New Done true
8105 1655 Acked 2654 Write 1 Done New Done true
8106 1656 Acked 2655 Read 7 Done New Done true
8107 1657 Acked 2656 Read 6 Done New Done true
8108 1658 Acked 2657 Write 3 Done New Done true
8109 1659 Acked 2658 Write 3 Done New Done true
8110 1660 Acked 2659 Read 2 Done New Done true
8111 1661 Acked 2660 Flush 0 Done New Done true
8112 1662 Acked 2661 Read 5 Done New Done true
8113 1663 Acked 2662 Read 10 Done New Done true
8114 1664 Acked 2663 Read 9 Done New Done true
8115 1665 Acked 2664 Read 1 Done New Done true
8116 1666 Acked 2665 Read 6 Done New Done true
8117 1667 Acked 2666 Read 7 Done New Done true
8118 1668 Acked 2667 Write 8 Done New Done true
8119 1669 Acked 2668 Write 6 Done New Done true
8120 1670 Acked 2669 Write 5 Done New Done true
8121 1671 Acked 2670 Read 5 Done New Done true
8122 1672 Acked 2671 Write 5 Done New Done true
8123 1673 Acked 2672 Read 9 Done New Done true
8124 1674 Acked 2673 Write 8 Done New Done true
8125 1675 Acked 2674 Write 9 Done New Done true
8126 1676 Acked 2675 Write 6 Done New Done true
8127 1677 Acked 2676 Write 4 Done New Done true
8128 1678 Acked 2677 Write 2 Done New Done true
8129 1679 Acked 2678 Read 9 Done New Done true
8130 1680 Acked 2679 Write 2 Done New Done true
8131 1681 Acked 2680 Write 6 Done New Done true
8132 1682 Acked 2681 Write 7 Done New Done true
8133 1683 Acked 2682 Write 1 Done New Done true
8134 1684 Acked 2683 Read 8 Done New Done true
8135 1685 Acked 2684 Read 1 Done New Done true
8136 1686 Acked 2685 Read 1 Done New Done true
8137 1687 Acked 2686 Read 1 Done New Done true
8138 1688 Acked 2687 Read 7 Done New Done true
8139 1689 Acked 2688 Read 8 Done New Done true
8140 1690 Acked 2689 Read 1 Done New Done true
8141 1691 Acked 2690 Read 7 Done New Done true
8142 1692 Acked 2691 Read 3 Done New Done true
8143 1693 Acked 2692 Read 1 Done New Done true
8144 1694 Acked 2693 Write 1 Done New Done true
8145 1695 Acked 2694 Write 10 Done New Done true
8146 1696 Acked 2695 Read 2 Done New Done true
8147 1697 Acked 2696 Flush 0 Done New Done true
8148 1698 Acked 2697 Read 6 Done New Done true
8149 1699 Acked 2698 Write 1 Done New Done true
8150 1700 Acked 2699 Read 9 Done New Done true
8151 1701 Acked 2700 Read 3 Done New Done true
8152 1702 Acked 2701 Read 1 Done New Done true
8153 1703 Acked 2702 Write 9 Done New Done true
8154 1704 Acked 2703 Read 4 Done New Done true
8155 1705 Acked 2704 Read 6 Done New Done true
8156 1706 Acked 2705 Read 8 Done New Done true
8157 1707 Acked 2706 Write 4 Done New Done true
8158 1708 Acked 2707 Write 7 Done New Done true
8159 1709 Acked 2708 Write 8 Done New Done true
8160 1710 Acked 2709 Read 10 Done New Done true
8161 1711 Acked 2710 Read 8 Done New Done true
8162 1712 Acked 2711 Write 1 Done New Done true
8163 1713 Acked 2712 Write 2 Done New Done true
8164 1714 Acked 2713 Read 1 Done New Done true
8165 1715 Acked 2714 Read 2 Done New Done true
8166 1716 Acked 2715 Write 1 Done New Done true
8167 1717 Acked 2716 Write 5 Done New Done true
8168 1718 Acked 2717 Read 5 Done New Done true
8169 1719 Acked 2718 Read 6 Done New Done true
8170 1720 Acked 2719 Write 3 Done New Done true
8171 1721 Acked 2720 Read 4 Done New Done true
8172 1722 Acked 2721 Flush 0 Done New Done true
8173 1723 Acked 2722 Read 8 Done New Done true
8174 1724 Acked 2723 Write 3 Done New Done true
8175 1725 Acked 2724 Read 6 Done New Done true
8176 1726 Acked 2725 Write 6 Done New Done true
8177 1727 Acked 2726 Write 1 Done New Done true
8178 1728 Acked 2727 Flush 0 Done New Done true
8179 1729 Acked 2728 Write 10 Done New Done true
8180 1730 Acked 2729 Read 7 Done New Done true
8181 1731 Acked 2730 Read 3 Done New Done true
8182 1732 Acked 2731 Read 8 Done New Done true
8183 1733 Acked 2732 Read 7 Done New Done true
8184 1734 Acked 2733 Read 10 Done New Done true
8185 1735 Acked 2734 Write 4 Done New Done true
8186 1736 Acked 2735 Write 8 Done New Done true
8187 1737 Acked 2736 Write 10 Done New Done true
8188 1738 Acked 2737 Read 8 Done New Done true
8189 1739 Acked 2738 Write 10 Done New Done true
8190 1740 Acked 2739 Write 5 Done New Done true
8191 1741 Acked 2740 Read 8 Done New Done true
8192 1742 Acked 2741 Write 1 Done New Done true
8193 1743 Acked 2742 Write 2 Done New Done true
8194 1744 Acked 2743 Read 5 Done New Done true
8195 1745 Acked 2744 Read 3 Done New Done true
8196 1746 Acked 2745 Read 10 Done New Done true
8197 1747 Acked 2746 Read 9 Done New Done true
8198 1748 Acked 2747 Read 1 Done New Done true
8199 1749 Acked 2748 Write 10 Done New Done true
8200 1750 Acked 2749 Read 2 Done New Done true
8201 1751 Acked 2750 Write 4 Done New Done true
8202 1752 Acked 2751 Write 6 Done New Done true
8203 1753 Acked 2752 Write 2 Done New Done true
8204 1754 Acked 2753 Read 6 Done New Done true
8205 1755 Acked 2754 Read 3 Done New Done true
8206 1756 Acked 2755 Read 9 Done New Done true
8207 1757 Acked 2756 Read 3 Done New Done true
8208 1758 Acked 2757 Read 4 Done New Done true
8209 1759 Acked 2758 Flush 0 Done New Done true
8210 1760 Acked 2759 Write 5 Done New Done true
8211 1761 Acked 2760 Write 4 Done New Done true
8212 1762 Acked 2761 Flush 0 Done New Done true
8213 1763 Acked 2762 Write 2 Done New Done true
8214 1764 Acked 2763 Read 8 Done New Done true
8215 1765 Acked 2764 Flush 0 Done New Done true
8216 1766 Acked 2765 Write 7 Done New Done true
8217 1767 Acked 2766 Write 5 Done New Done true
8218 1768 Acked 2767 Write 5 Done New Done true
8219 1769 Acked 2768 Read 6 Done New Done true
8220 1770 Acked 2769 Read 2 Done New Done true
8221 1771 Acked 2770 Write 8 Done New Done true
8222 1772 Acked 2771 Read 2 Done New Done true
8223 1773 Acked 2772 Flush 0 Done New Done true
8224 1774 Acked 2773 Read 5 Done New Done true
8225 1775 Acked 2774 Write 1 Done New Done true
8226 1776 Acked 2775 Read 3 Done New Done true
8227 1777 Acked 2776 Read 3 Done New Done true
8228 1778 Acked 2777 Read 3 Done New Done true
8229 1779 Acked 2778 Flush 0 Done New Done true
8230 1780 Acked 2779 Flush 0 Done New Done true
8231 1781 Acked 2780 Read 7 Done New Done true
8232 1782 Acked 2781 Write 5 Done New Done true
8233 1783 Acked 2782 Read 2 Done New Done true
8234 1784 Acked 2783 Write 6 Done New Done true
8235 1785 Acked 2784 Write 1 Done New Done true
8236 1786 Acked 2785 Write 1 Done New Done true
8237 1787 Acked 2786 Write 7 Done New Done true
8238 1788 Acked 2787 Write 5 Done New Done true
8239 1789 Acked 2788 Flush 0 Done New Done true
8240 1790 Acked 2789 Write 7 Done New Done true
8241 1791 Acked 2790 Write 9 Done New Done true
8242 1792 Acked 2791 Read 9 Done New Done true
8243 1793 Acked 2792 Read 3 Done New Done true
8244 1794 Acked 2793 Read 2 Done New Done true
8245 1795 Acked 2794 Read 1 Done New Done true
8246 1796 Acked 2795 Write 5 Done New Done true
8247 1797 Acked 2796 Read 3 Done New Done true
8248 1798 Acked 2797 Read 10 Done New Done true
8249 1799 Acked 2798 Read 9 Done New Done true
8250 1800 Acked 2799 Read 1 Done New Done true
8251 1801 Acked 2800 Read 8 Done New Done true
8252 1802 Acked 2801 Read 2 Done New Done true
8253 1803 Acked 2802 Write 1 Done New Done true
8254 1804 Acked 2803 Read 7 Done New Done true
8255 1805 Acked 2804 Write 8 Done New Done true
8256 1806 Acked 2805 Read 9 Done New Done true
8257 1807 Acked 2806 Read 8 Done New Done true
8258 1808 Acked 2807 Read 2 Done New Done true
8259 1809 Acked 2808 Flush 0 Done New Done true
8260 STATES DS:0 DS:1 DS:2 TOTAL
8261 New 0 301 0 301
8262 Sent 0 0 0 0
8263 Done 301 0 301 602
8264 Skipped 0 0 0 0
8265 Error 0 0 0 0
8266 Last Flush: 2808 2507 2808
8267 Downstairs last five completed: 2507 2506 2505 2504 2503
8268 Upstairs last five completed: 1809 1808 1807 1806 1805
8269 CLIENT: Up:0 ds:301 act:2
8270 ----------------------------------------------------------------
8271 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:301
8272 States: Active Offline Active
8273 GW_ID ACK DSID TYPE BLOCKS DS:0 DS:1 DS:2 REPLAY
8274 1509 Acked 2508 Read 3 Done New Done true
8275 1510 Acked 2509 Write 3 Done New Done true
8276 1511 Acked 2510 Read 3 Done New Done true
8277 1512 Acked 2511 Read 10 Done New Done true
8278 1513 Acked 2512 Read 3 Done New Done true
8279 1514 Acked 2513 Write 3 Done New Done true
8280 1515 Acked 2514 Write 1 Done New Done true
8281 1516 Acked 2515 Write 10 Done New Done true
8282 1517 Acked 2516 Write 4 Done New Done true
8283 1518 Acked 2517 Flush 0 Done New Done true
8284 1519 Acked 2518 Read 8 Done New Done true
8285 1520 Acked 2519 Write 1 Done New Done true
8286 1521 Acked 2520 Read 4 Done New Done true
8287 1522 Acked 2521 Read 10 Done New Done true
8288 1523 Acked 2522 Read 2 Done New Done true
8289 1524 Acked 2523 Read 7 Done New Done true
8290 1525 Acked 2524 Write 4 Done New Done true
8291 1526 Acked 2525 Write 7 Done New Done true
8292 1527 Acked 2526 Read 1 Done New Done true
8293 1528 Acked 2527 Read 2 Done New Done true
8294 1529 Acked 2528 Read 7 Done New Done true
8295 1530 Acked 2529 Read 10 Done New Done true
8296 1531 Acked 2530 Write 5 Done New Done true
8297 1532 Acked 2531 Write 10 Done New Done true
8298 1533 Acked 2532 Read 2 Done New Done true
8299 1534 Acked 2533 Read 9 Done New Done true
8300 1535 Acked 2534 Read 10 Done New Done true
8301 1536 Acked 2535 Read 6 Done New Done true
8302 1537 Acked 2536 Write 8 Done New Done true
8303 1538 Acked 2537 Read 5 Done New Done true
8304 1539 Acked 2538 Write 2 Done New Done true
8305 1540 Acked 2539 Read 10 Done New Done true
8306 1541 Acked 2540 Read 3 Done New Done true
8307 1542 Acked 2541 Read 3 Done New Done true
8308 1543 Acked 2542 Flush 0 Done New Done true
8309 1544 Acked 2543 Flush 0 Done New Done true
8310 1545 Acked 2544 Flush 0 Done New Done true
8311 1546 Acked 2545 Write 7 Done New Done true
8312 1547 Acked 2546 Flush 0 Done New Done true
8313 1548 Acked 2547 Write 1 Done New Done true
8314 1549 Acked 2548 Read 1 Done New Done true
8315 1550 Acked 2549 Read 10 Done New Done true
8316 1551 Acked 2550 Write 8 Done New Done true
8317 1552 Acked 2551 Read 8 Done New Done true
8318 1553 Acked 2552 Read 4 Done New Done true
8319 1554 Acked 2553 Write 9 Done New Done true
8320 1555 Acked 2554 Flush 0 Done New Done true
8321 1556 Acked 2555 Read 6 Done New Done true
8322 1557 Acked 2556 Write 7 Done New Done true
8323 1558 Acked 2557 Write 9 Done New Done true
8324 1559 Acked 2558 Read 7 Done New Done true
8325 1560 Acked 2559 Read 8 Done New Done true
8326 1561 Acked 2560 Write 1 Done New Done true
8327 1562 Acked 2561 Read 2 Done New Done true
8328 1563 Acked 2562 Read 1 Done New Done true
8329 1564 Acked 2563 Write 1 Done New Done true
8330 1565 Acked 2564 Read 7 Done New Done true
8331 1566 Acked 2565 Read 7 Done New Done true
8332 1567 Acked 2566 Read 5 Done New Done true
8333 1568 Acked 2567 Read 2 Done New Done true
8334 1569 Acked 2568 Flush 0 Done New Done true
8335 1570 Acked 2569 Write 9 Done New Done true
8336 1571 Acked 2570 Write 5 Done New Done true
8337 1572 Acked 2571 Read 2 Done New Done true
8338 1573 Acked 2572 Write 1 Done New Done true
8339 1574 Acked 2573 Read 9 Done New Done true
8340 1575 Acked 2574 Read 8 Done New Done true
8341 1576 Acked 2575 Read 1 Done New Done true
8342 1577 Acked 2576 Write 9 Done New Done true
8343 1578 Acked 2577 Write 4 Done New Done true
8344 1579 Acked 2578 Flush 0 Done New Done true
8345 1580 Acked 2579 Read 9 Done New Done true
8346 1581 Acked 2580 Flush 0 Done New Done true
8347 1582 Acked 2581 Read 4 Done New Done true
8348 1583 Acked 2582 Write 8 Done New Done true
8349 1584 Acked 2583 Read 5 Done New Done true
8350 1585 Acked 2584 Read 5 Done New Done true
8351 1586 Acked 2585 Read 6 Done New Done true
8352 1587 Acked 2586 Read 5 Done New Done true
8353 1588 Acked 2587 Write 6 Done New Done true
8354 1589 Acked 2588 Read 3 Done New Done true
8355 1590 Acked 2589 Read 1 Done New Done true
8356 1591 Acked 2590 Write 4 Done New Done true
8357 1592 Acked 2591 Write 3 Done New Done true
8358 1593 Acked 2592 Read 5 Done New Done true
8359 1594 Acked 2593 Read 3 Done New Done true
8360 1595 Acked 2594 Read 10 Done New Done true
8361 1596 Acked 2595 Read 5 Done New Done true
8362 1597 Acked 2596 Read 5 Done New Done true
8363 1598 Acked 2597 Read 3 Done New Done true
8364 1599 Acked 2598 Write 5 Done New Done true
8365 1600 Acked 2599 Read 5 Done New Done true
8366 1601 Acked 2600 Read 3 Done New Done true
8367 1602 Acked 2601 Read 4 Done New Done true
8368 1603 Acked 2602 Write 2 Done New Done true
8369 1604 Acked 2603 Read 4 Done New Done true
8370 1605 Acked 2604 Read 5 Done New Done true
8371 1606 Acked 2605 Write 8 Done New Done true
8372 1607 Acked 2606 Write 9 Done New Done true
8373 1608 Acked 2607 Write 4 Done New Done true
8374 1609 Acked 2608 Write 10 Done New Done true
8375 1610 Acked 2609 Flush 0 Done New Done true
8376 1611 Acked 2610 Write 3 Done New Done true
8377 1612 Acked 2611 Write 4 Done New Done true
8378 1613 Acked 2612 Write 7 Done New Done true
8379 1614 Acked 2613 Read 4 Done New Done true
8380 1615 Acked 2614 Write 6 Done New Done true
8381 1616 Acked 2615 Write 2 Done New Done true
8382 1617 Acked 2616 Read 8 Done New Done true
8383 1618 Acked 2617 Write 6 Done New Done true
8384 1619 Acked 2618 Flush 0 Done New Done true
8385 1620 Acked 2619 Read 2 Done New Done true
8386 1621 Acked 2620 Write 4 Done New Done true
8387 1622 Acked 2621 Read 7 Done New Done true
8388 1623 Acked 2622 Read 4 Done New Done true
8389 1624 Acked 2623 Flush 0 Done New Done true
8390 1625 Acked 2624 Flush 0 Done New Done true
8391 1626 Acked 2625 Read 10 Done New Done true
8392 1627 Acked 2626 Write 3 Done New Done true
8393 1628 Acked 2627 Read 4 Done New Done true
8394 1629 Acked 2628 Write 10 Done New Done true
8395 1630 Acked 2629 Read 9 Done New Done true
8396 1631 Acked 2630 Flush 0 Done New Done true
8397 1632 Acked 2631 Write 3 Done New Done true
8398 1633 Acked 2632 Write 6 Done New Done true
8399 1634 Acked 2633 Read 2 Done New Done true
8400 1635 Acked 2634 Write 6 Done New Done true
8401 1636 Acked 2635 Write 5 Done New Done true
8402 1637 Acked 2636 Read 3 Done New Done true
8403 1638 Acked 2637 Write 5 Done New Done true
8404 1639 Acked 2638 Read 6 Done New Done true
8405 1640 Acked 2639 Write 9 Done New Done true
8406 1641 Acked 2640 Read 8 Done New Done true
8407 1642 Acked 2641 Read 9 Done New Done true
8408 1643 Acked 2642 Read 4 Done New Done true
8409 1644 Acked 2643 Write 3 Done New Done true
8410 1645 Acked 2644 Write 2 Done New Done true
8411 1646 Acked 2645 Flush 0 Done New Done true
8412 1647 Acked 2646 Write 4 Done New Done true
8413 1648 Acked 2647 Write 8 Done New Done true
8414 1649 Acked 2648 Read 4 Done New Done true
8415 1650 Acked 2649 Read 2 Done New Done true
8416 1651 Acked 2650 Write 10 Done New Done true
8417 1652 Acked 2651 Write 8 Done New Done true
8418 1653 Acked 2652 Write 6 Done New Done true
8419 1654 Acked 2653 Flush 0 Done New Done true
8420 1655 Acked 2654 Write 1 Done New Done true
8421 1656 Acked 2655 Read 7 Done New Done true
8422 1657 Acked 2656 Read 6 Done New Done true
8423 1658 Acked 2657 Write 3 Done New Done true
8424 1659 Acked 2658 Write 3 Done New Done true
8425 1660 Acked 2659 Read 2 Done New Done true
8426 1661 Acked 2660 Flush 0 Done New Done true
8427 1662 Acked 2661 Read 5 Done New Done true
8428 1663 Acked 2662 Read 10 Done New Done true
8429 1664 Acked 2663 Read 9 Done New Done true
8430 1665 Acked 2664 Read 1 Done New Done true
8431 1666 Acked 2665 Read 6 Done New Done true
8432 1667 Acked 2666 Read 7 Done New Done true
8433 1668 Acked 2667 Write 8 Done New Done true
8434 1669 Acked 2668 Write 6 Done New Done true
8435 1670 Acked 2669 Write 5 Done New Done true
8436 1671 Acked 2670 Read 5 Done New Done true
8437 1672 Acked 2671 Write 5 Done New Done true
8438 1673 Acked 2672 Read 9 Done New Done true
8439 1674 Acked 2673 Write 8 Done New Done true
8440 1675 Acked 2674 Write 9 Done New Done true
8441 1676 Acked 2675 Write 6 Done New Done true
8442 1677 Acked 2676 Write 4 Done New Done true
8443 1678 Acked 2677 Write 2 Done New Done true
8444 1679 Acked 2678 Read 9 Done New Done true
8445 1680 Acked 2679 Write 2 Done New Done true
8446 1681 Acked 2680 Write 6 Done New Done true
8447 1682 Acked 2681 Write 7 Done New Done true
8448 1683 Acked 2682 Write 1 Done New Done true
8449 1684 Acked 2683 Read 8 Done New Done true
8450 1685 Acked 2684 Read 1 Done New Done true
8451 1686 Acked 2685 Read 1 Done New Done true
8452 1687 Acked 2686 Read 1 Done New Done true
8453 1688 Acked 2687 Read 7 Done New Done true
8454 1689 Acked 2688 Read 8 Done New Done true
8455 1690 Acked 2689 Read 1 Done New Done true
8456 1691 Acked 2690 Read 7 Done New Done true
8457 1692 Acked 2691 Read 3 Done New Done true
8458 1693 Acked 2692 Read 1 Done New Done true
8459 1694 Acked 2693 Write 1 Done New Done true
8460 1695 Acked 2694 Write 10 Done New Done true
8461 1696 Acked 2695 Read 2 Done New Done true
8462 1697 Acked 2696 Flush 0 Done New Done true
8463 1698 Acked 2697 Read 6 Done New Done true
8464 1699 Acked 2698 Write 1 Done New Done true
8465 1700 Acked 2699 Read 9 Done New Done true
8466 1701 Acked 2700 Read 3 Done New Done true
8467 1702 Acked 2701 Read 1 Done New Done true
8468 1703 Acked 2702 Write 9 Done New Done true
8469 1704 Acked 2703 Read 4 Done New Done true
8470 1705 Acked 2704 Read 6 Done New Done true
8471 1706 Acked 2705 Read 8 Done New Done true
8472 1707 Acked 2706 Write 4 Done New Done true
8473 1708 Acked 2707 Write 7 Done New Done true
8474 1709 Acked 2708 Write 8 Done New Done true
8475 1710 Acked 2709 Read 10 Done New Done true
8476 1711 Acked 2710 Read 8 Done New Done true
8477 1712 Acked 2711 Write 1 Done New Done true
8478 1713 Acked 2712 Write 2 Done New Done true
8479 1714 Acked 2713 Read 1 Done New Done true
8480 1715 Acked 2714 Read 2 Done New Done true
8481 1716 Acked 2715 Write 1 Done New Done true
8482 1717 Acked 2716 Write 5 Done New Done true
8483 1718 Acked 2717 Read 5 Done New Done true
8484 1719 Acked 2718 Read 6 Done New Done true
8485 1720 Acked 2719 Write 3 Done New Done true
8486 1721 Acked 2720 Read 4 Done New Done true
8487 1722 Acked 2721 Flush 0 Done New Done true
8488 1723 Acked 2722 Read 8 Done New Done true
8489 1724 Acked 2723 Write 3 Done New Done true
8490 1725 Acked 2724 Read 6 Done New Done true
8491 1726 Acked 2725 Write 6 Done New Done true
8492 1727 Acked 2726 Write 1 Done New Done true
8493 1728 Acked 2727 Flush 0 Done New Done true
8494 1729 Acked 2728 Write 10 Done New Done true
8495 1730 Acked 2729 Read 7 Done New Done true
8496 1731 Acked 2730 Read 3 Done New Done true
8497 1732 Acked 2731 Read 8 Done New Done true
8498 1733 Acked 2732 Read 7 Done New Done true
8499 1734 Acked 2733 Read 10 Done New Done true
8500 1735 Acked 2734 Write 4 Done New Done true
8501 1736 Acked 2735 Write 8 Done New Done true
8502 1737 Acked 2736 Write 10 Done New Done true
8503 1738 Acked 2737 Read 8 Done New Done true
8504 1739 Acked 2738 Write 10 Done New Done true
8505 1740 Acked 2739 Write 5 Done New Done true
8506 1741 Acked 2740 Read 8 Done New Done true
8507 1742 Acked 2741 Write 1 Done New Done true
8508 1743 Acked 2742 Write 2 Done New Done true
8509 1744 Acked 2743 Read 5 Done New Done true
8510 1745 Acked 2744 Read 3 Done New Done true
8511 1746 Acked 2745 Read 10 Done New Done true
8512 1747 Acked 2746 Read 9 Done New Done true
8513 1748 Acked 2747 Read 1 Done New Done true
8514 1749 Acked 2748 Write 10 Done New Done true
8515 1750 Acked 2749 Read 2 Done New Done true
8516 1751 Acked 2750 Write 4 Done New Done true
8517 1752 Acked 2751 Write 6 Done New Done true
8518 1753 Acked 2752 Write 2 Done New Done true
8519 1754 Acked 2753 Read 6 Done New Done true
8520 1755 Acked 2754 Read 3 Done New Done true
8521 1756 Acked 2755 Read 9 Done New Done true
8522 1757 Acked 2756 Read 3 Done New Done true
8523 1758 Acked 2757 Read 4 Done New Done true
8524 1759 Acked 2758 Flush 0 Done New Done true
8525 1760 Acked 2759 Write 5 Done New Done true
8526 1761 Acked 2760 Write 4 Done New Done true
8527 1762 Acked 2761 Flush 0 Done New Done true
8528 1763 Acked 2762 Write 2 Done New Done true
8529 1764 Acked 2763 Read 8 Done New Done true
8530 1765 Acked 2764 Flush 0 Done New Done true
8531 1766 Acked 2765 Write 7 Done New Done true
8532 1767 Acked 2766 Write 5 Done New Done true
8533 1768 Acked 2767 Write 5 Done New Done true
8534 1769 Acked 2768 Read 6 Done New Done true
8535 1770 Acked 2769 Read 2 Done New Done true
8536 1771 Acked 2770 Write 8 Done New Done true
8537 1772 Acked 2771 Read 2 Done New Done true
8538 1773 Acked 2772 Flush 0 Done New Done true
8539 1774 Acked 2773 Read 5 Done New Done true
8540 1775 Acked 2774 Write 1 Done New Done true
8541 1776 Acked 2775 Read 3 Done New Done true
8542 1777 Acked 2776 Read 3 Done New Done true
8543 1778 Acked 2777 Read 3 Done New Done true
8544 1779 Acked 2778 Flush 0 Done New Done true
8545 1780 Acked 2779 Flush 0 Done New Done true
8546 1781 Acked 2780 Read 7 Done New Done true
8547 1782 Acked 2781 Write 5 Done New Done true
8548 1783 Acked 2782 Read 2 Done New Done true
8549 1784 Acked 2783 Write 6 Done New Done true
8550 1785 Acked 2784 Write 1 Done New Done true
8551 1786 Acked 2785 Write 1 Done New Done true
8552 1787 Acked 2786 Write 7 Done New Done true
8553 1788 Acked 2787 Write 5 Done New Done true
8554 1789 Acked 2788 Flush 0 Done New Done true
8555 1790 Acked 2789 Write 7 Done New Done true
8556 1791 Acked 2790 Write 9 Done New Done true
8557 1792 Acked 2791 Read 9 Done New Done true
8558 1793 Acked 2792 Read 3 Done New Done true
8559 1794 Acked 2793 Read 2 Done New Done true
8560 1795 Acked 2794 Read 1 Done New Done true
8561 1796 Acked 2795 Write 5 Done New Done true
8562 1797 Acked 2796 Read 3 Done New Done true
8563 1798 Acked 2797 Read 10 Done New Done true
8564 1799 Acked 2798 Read 9 Done New Done true
8565 1800 Acked 2799 Read 1 Done New Done true
8566 1801 Acked 2800 Read 8 Done New Done true
8567 1802 Acked 2801 Read 2 Done New Done true
8568 1803 Acked 2802 Write 1 Done New Done true
8569 1804 Acked 2803 Read 7 Done New Done true
8570 1805 Acked 2804 Write 8 Done New Done true
8571 1806 Acked 2805 Read 9 Done New Done true
8572 1807 Acked 2806 Read 8 Done New Done true
8573 1808 Acked 2807 Read 2 Done New Done true
8574 1809 Acked 2808 Flush 0 Done New Done true
8575 STATES DS:0 DS:1 DS:2 TOTAL
8576 New 0 301 0 301
8577 Sent 0 0 0 0
8578 Done 301 0 301 602
8579 Skipped 0 0 0 0
8580 Error 0 0 0 0
8581 Last Flush: 2808 2507 2808
8582 Downstairs last five completed: 2507 2506 2505 2504 2503
8583 Upstairs last five completed: 1809 1808 1807 1806 1805
8584 CLIENT: Up:0 ds:301 act:2
85852024-04-20T01:06:53.653ZINFOcrucible: connecting to 127.0.0.1:8820 = io task client = 1 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
85862024-04-20T01:06:53.653ZINFOcrucible: ds_connection connected from Ok(127.0.0.1:53668) = io task client = 1 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
85872024-04-20T01:06:53.654ZINFOcrucible: downstairs client at Some(127.0.0.1:8820) has region UUID 12345678-0000-0000-0000-000000008820 = downstairs client = 1 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
85882024-04-20T01:06:53.654ZINFOcrucible: Returning UUID:12345678-0000-0000-0000-000000008820 matches = downstairs client = 1 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
85892024-04-20T01:06:53.654ZINFOcrucible: send last flush ID to this DS: 2507 = downstairs client = 1 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
85902024-04-20T01:06:53.655ZINFOcrucible: Replied this last flush ID: 2507 = downstairs client = 1 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
85912024-04-20T01:06:53.655ZINFOcrucible: ds_transition from Offline to Replay = downstairs client = 1 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
85922024-04-20T01:06:53.655ZINFOcrucible: [1] Transition from Offline to Replay = downstairs client = 1 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
85932024-04-20T01:06:53.655ZINFOcrucible: ds_transition from Replay to Active = downstairs client = 1 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
85942024-04-20T01:06:53.655ZINFOcrucible: [1] Transition from Replay to Active = downstairs client = 1 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
8595 ----------------------------------------------------------------
8596 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:0
8597 Downstairs last five completed: 2808 2807 2806 2805 2804
8598 Upstairs last five completed: 1809 1808 1807 1806 1805
8599 CLIENT: Up:0 ds:0 act:3
8600 Replay: All jobs finished, all DS active.
8601 Main task has work to do, go find it
8602 got dsc Stop(1)
8603 stop 1
8604 Apr 20 01:06:53.958 INFO request completed, latency_us: 326[8820] Got stop action so:false kr:false
8605 , response_code: 204, uri: /stop/cid/1, method: POST, req_id: a9de862b-01c0-498f-835f-cf6274f31bcb, remote_addr: 127.0.0.1:60352, local_addr: 127.0.0.1:9998
86062024-04-20T01:06:53.959ZWARNcrucible: downstairs disconnected = io task client = 1 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
8607 Apr 20 01:06:53.959 INFO {"msg":"client task is sending Done(Finished)","v":0,"name":"crucible","level":40,"time":"2024-04-20T01:06:53.959473031Z","hostname":"w-01HVWGBJP7HK0H9TQ26T6N3X8M","pid":1196,"":"io task","client":"1","":"downstairs","session_id":"132b460a-26a0-4532-b1ab-4f8c07d4c6c7"}
8608 request completed, latency_us: 120, response_code: 200, uri: /state/cid/1{"msg":"downstairs task for 1 stopped due to Finished","v":0,"name":"crucible","level":40,"time":"2024-04-20T01:06:53.95949324Z","hostname":"w-01HVWGBJP7HK0H9TQ26T6N3X8M","pid":1196,"session_id":"132b460a-26a0-4532-b1ab-4f8c07d4c6c7"}
8609 , method: GET, req_id:{"msg":"Gone missing, transition from Active to Offline","v":0,"name":"crucible","level":30,"time":"2024-04-20T01:06:53.95950829Z","hostname":"w-01HVWGBJP7HK0H9TQ26T6N3X8M","pid":1196,"client":"1","":"downstairs","session_id":"132b460a-26a0-4532-b1ab-4f8c07d4c6c7"}
8610 d898d6ec-199c-4176-acc2-9fd2f83bdf39, remote_addr: 127.0.0.1:60352, local_addr: 127.0.0.{"msg":"[1] client re-new 0 jobs since flush 2808","v":0,"name":"crucible","level":30,"time":"2024-04-20T01:06:53.959550978Z","hostname":"w-01HVWGBJP7HK0H9TQ26T6N3X8M","pid":1196,"":"downstairs","":"downstairs","session_id":"132b460a-26a0-4532-b1ab-4f8c07d4c6c7"}
8611 1:9998
86122024-04-20T01:06:53.959ZINFOcrucible: [1] Marked 0 jobs for replay since flush: 2808 = downstairs session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
86132024-04-20T01:06:53.959ZINFOcrucible: client task is exiting = io task client = 1 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
8614 [8820] Exited with: ExitStatus(unix_wait_status(9))
8615 [8820][1] reports Exit
8616 Apr 20 01:06:57.961 INFO request completed, latency_us: 228, response_code: 200, uri: /state/cid/1, method: GET, req_id: 7d3f1b10-d1b5-4126-9c40-b7737e4744b2, remote_addr: 127.0.0.1:60352, local_addr: 127.0.0.1:9998
8617 001/300 Write block 1110 len 8192 data: 2 2
8618 002/300 Write block 4529 len 12288 data: 5 4 4
8619 003/300 Write block 401 len 36864 data: 4 4 3 2 2 2 2 2 2
8620 004/300 Write block 1154 len 16384 data: 5 5 4 4
8621 005/300 Write block 4742 len 16384 data: 3 4 4 4
8622 006/300 Read block 934 len 8192
8623 007/300 Write block 4307 len 16384 data: 3 3 3 2
8624 008/300 Read block 3405 len 4096
8625 009/300 Write block 1707 len 32768 data: 4 5 5 5 5 3 3 3
8626 010/300 Read block 4542 len 16384
8627 011/300 Read block 1000 len 12288
8628 012/300 Write block 4518 len 20480 data: 4 4 5 5 5
8629 013/300 Write block 3954 len 4096 data: 3
8630 014/300 Flush
8631 015/300 Write block 130 len 20480 data: 2 2 2 2 2
8632 016/300 Read block 1350 len 20480
8633 017/300 Read block 2809 len 4096
8634 018/300 Write block 1743 len 16384 data: 2 2 2 2
8635 019/300 Write block 4565 len 32768 data: 2 2 2 2 2 3 3 3
8636 020/300 Read block 2546 len 12288
8637 021/300 Write block 4776 len 36864 data: 2 2 2 2 3 2 3 3 3
8638 022/300 Read block 2520 len 36864
8639 023/300 Write block 515 len 28672 data: 2 2 2 3 3 3 4
8640 024/300 Read block 2854 len 36864
8641 025/300 Write block 1916 len 4096 data: 3
8642 026/300 Flush
8643 027/300 Read block 4816 len 12288
8644 028/300 Flush
8645 029/300 Read block 4057 len 36864
8646 030/300 Write block 1122 len 32768 data: 3 3 4 4 4 6 5 5
8647 031/300 Write block 2884 len 40960 data: 2 2 2 2 2 2 2 2 2 2
8648 032/300 Write block 210 len 4096 data: 3
8649 033/300 Read block 1329 len 32768
8650 034/300 Read block 4115 len 4096
8651 035/300 Read block 828 len 32768
8652 036/300 Read block 1152 len 20480
8653 037/300 Read block 1502 len 24576
8654 038/300 Read block 3718 len 24576
8655 039/300 Write block 2207 len 4096 data: 2
8656 040/300 Read block 2644 len 4096
8657 041/300 Write block 2930 len 16384 data: 2 2 2 2
8658 042/300 Write block 2786 len 20480 data: 3 3 3 2 2
8659 043/300 Read block 2644 len 8192
8660 044/300 Read block 2748 len 12288
8661 045/300 Write block 2616 len 28672 data: 3 3 3 3 3 2 2
8662 046/300 Write block 1955 len 40960 data: 3 3 3 3 2 2 2 2 2 2
8663 047/300 Read block 986 len 4096
8664 048/300 Write block 2976 len 8192 data: 2 2
8665 049/300 Write block 4521 len 16384 data: 6 6 5 4
8666 050/300 Write block 223 len 40960 data: 3 2 2 2 3 3 4 4 3 3
8667 051/300 Write block 4751 len 8192 data: 2 2
8668 052/300 Write block 3530 len 40960 data: 2 2 2 2 2 2 2 2 2 2
8669 053/300 Read block 1851 len 32768
8670 054/300 Write block 1031 len 24576 data: 4 4 3 3 2 2
8671 055/300 Read block 3635 len 16384
8672 056/300 Read block 3037 len 12288
8673 057/300 Read block 4058 len 36864
8674 058/300 Read block 2680 len 16384
8675 059/300 Write block 2004 len 28672 data: 3 3 3 4 4 4 4
8676 060/300 Read block 3577 len 24576
8677 061/300 Write block 2207 len 36864 data: 3 2 2 2 2 2 2 2 2
8678 062/300 Read block 4181 len 40960
8679 063/300 Flush
8680 064/300 Read block 2567 len 24576
8681 065/300 Write block 797 len 32768 data: 2 2 2 2 2 2 2 2
8682 066/300 Flush
8683 067/300 Read block 1805 len 16384
8684 068/300 Flush
8685 069/300 Flush
8686 070/300 Read block 768 len 8192
8687 071/300 Read block 2715 len 24576
8688 072/300 Read block 3318 len 32768
8689 073/300 Write block 3498 len 28672 data: 3 4 4 4 3 3 3
8690 074/300 Flush
8691 075/300 Flush
8692 076/300 Read block 2747 len 20480
8693 077/300 Read block 2026 len 32768
8694 078/300 Write block 226 len 24576 data: 3 4 4 5 5 4
8695 079/300 Read block 2247 len 20480
8696 080/300 Flush
8697 081/300 Read block 1569 len 20480
8698 082/300 Read block 1922 len 24576
8699 083/300 Read block 3052 len 16384
8700 084/300 Read block 830 len 40960
8701 085/300 Read block 2368 len 28672
8702 086/300 Read block 361 len 16384
8703 087/300 Read block 3357 len 4096
8704 088/300 Read block 980 len 40960
8705 089/300 Read block 4455 len 12288
8706 090/300 Read block 3542 len 20480
8707 091/300 Write block 3023 len 28672 data: 4 5 5 4 4 4 3
8708 092/300 Write block 60 len 8192 data: 2 3
8709 093/300 Read block 3293 len 20480
8710 094/300 Write block 1129 len 12288 data: 6 4 4
8711 095/300 Write block 2839 len 32768 data: 2 2 3 3 4 3 3 3
8712 096/300 Write block 3900 len 40960 data: 4 2 2 2 2 2 2 2 3 3
8713 097/300 Read block 1983 len 16384
8714 098/300 Read block 2522 len 24576
8715 099/300 Read block 3153 len 28672
8716 100/300 Read block 4257 len 24576
8717 101/300 Read block 2775 len 32768
8718 102/300 Write block 3904 len 40960 data: 3 3 3 3 4 4 3 2 3 2
8719 103/300 Flush
8720 104/300 Flush
8721 105/300 Read block 1587 len 20480
8722 106/300 Read block 3249 len 12288
8723 107/300 Read block 1085 len 28672
8724 108/300 Write block 558 len 40960 data: 2 2 2 2 2 2 2 2 2 2
8725 109/300 Write block 3812 len 4096 data: 2
8726 110/300 Read block 2883 len 32768
8727 111/300 Write block 3888 len 16384 data: 2 2 2 2
8728 112/300 Write block 1678 len 4096 data: 3
8729 113/300 Write block 3098 len 24576 data: 5 5 6 4 4 4
8730 114/300 Read block 4584 len 40960
8731 115/300 Read block 315 len 24576
8732 116/300 Read block 4382 len 36864
8733 117/300 Read block 4975 len 24576
8734 118/300 Read block 978 len 12288
8735 119/300 Write block 2611 len 24576 data: 2 2 2 2 2 4
8736 120/300 Read block 1452 len 4096
8737 121/300 Write block 4906 len 40960 data: 3 3 2 2 2 3 3 3 2 2
8738 122/300 Read block 2106 len 40960
8739 123/300 Flush
8740 124/300 Read block 1555 len 32768
8741 125/300 Write block 4444 len 20480 data: 4 4 4 4 4
8742 126/300 Flush
8743 127/300 Read block 2117 len 4096
8744 128/300 Read block 2502 len 16384
8745 129/300 Write block 2400 len 20480 data: 2 2 2 2 2
8746 130/300 Read block 3791 len 16384
8747 131/300 Write block 1652 len 24576 data: 2 2 4 3 3 3
8748 132/300 Write block 610 len 36864 data: 4 4 4 4 4 4 2 2 3
8749 133/300 Read block 3761 len 20480
8750 134/300 Read block 1901 len 36864
8751 135/300 Write block 2895 len 40960 data: 2 3 3 3 3 3 2 2 2 2
8752 136/300 Flush
8753 137/300 Read block 4366 len 4096
8754 138/300 Read block 2058 len 40960
8755 139/300 Read block 2096 len 16384
8756 140/300 Write block 3796 len 32768 data: 2 2 3 2 2 2 2 2
8757 141/300 Read block 3110 len 4096
8758 142/300 Read block 3862 len 36864
8759 143/300 Read block 4550 len 28672
8760 144/300 Read block 1252 len 32768
8761 145/300 Read block 1950 len 16384
8762 146/300 Write block 1823 len 8192 data: 2 2
8763 147/300 Read block 2713 len 24576
8764 148/300 Read block 3359 len 4096
8765 149/300 Read block 720 len 8192
8766 150/300 Write block 4182 len 4096 data: 3
8767 151/300 Read block 1427 len 28672
8768 152/300 Write block 1788 len 36864 data: 2 2 2 2 2 2 3 4 4
8769 153/300 Read block 651 len 24576
8770 154/300 Read block 1951 len 16384
8771 155/300 Write block 4481 len 8192 data: 2 4
8772 156/300 Read block 4273 len 8192
8773 157/300 Write block 622 len 16384 data: 4 4 3 3
8774 158/300 Flush
8775 159/300 Write block 2015 len 20480 data: 3 2 2 2 3
8776 160/300 Write block 2810 len 28672 data: 4 5 5 6 5 5 4
8777 161/300 Read block 3947 len 20480
8778 162/300 Write block 2716 len 16384 data: 2 3 3 4
8779 163/300 Read block 4620 len 32768
8780 164/300 Write block 4240 len 28672 data: 2 2 2 2 2 3 3
8781 165/300 Read block 1652 len 24576
8782 166/300 Read block 2757 len 20480
8783 167/300 Write block 651 len 12288 data: 2 2 3
8784 168/300 Write block 4295 len 36864 data: 5 3 3 2 2 2 3 3 3
8785 169/300 Read block 2771 len 36864
8786 170/300 Flush
8787 171/300 Read block 2636 len 36864
8788 172/300 Read block 3029 len 4096
8789 173/300 Read block 100 len 4096
8790 174/300 Read block 3965 len 28672
8791 175/300 Read block 2707 len 16384
8792 176/300 Write block 1584 len 4096 data: 3
8793 177/300 Read block 1079 len 16384
8794 178/300 Flush
8795 179/300 Read block 1814 len 32768
8796 180/300 Write block 904 len 32768 data: 4 3 3 3 3 3 2 2
8797 181/300 Write block 4869 len 4096 data: 5
8798 182/300 Write block 1041 len 36864 data: 2 2 2 2 2 2 2 2 2
8799 183/300 Read block 1388 len 20480
8800 184/300 Write block 3808 len 24576 data: 2 2 2 2 3 2
8801 185/300 Read block 1045 len 20480
8802 186/300 Flush
8803 187/300 Flush
8804 188/300 Read block 3769 len 28672
8805 189/300 Read block 3250 len 16384
8806 190/300 Read block 3871 len 40960
8807 191/300 Read block 4682 len 36864
8808 192/300 Write block 574 len 8192 data: 4 4
8809 193/300 Read block 4493 len 28672
8810 194/300 Read block 2719 len 4096
8811 195/300 Read block 582 len 20480
8812 196/300 Write block 4107 len 28672 data: 2 2 2 2 2 3 4
8813 197/300 Flush
8814 198/300 Write block 4470 len 8192 data: 2 3
8815 199/300 Write block 4261 len 20480 data: 3 2 2 2 2
8816 200/300 Read block 2967 len 40960
8817 201/300 Read block 2907 len 4096
8818 202/300 Read block 2986 len 28672
8819 203/300 Write block 381 len 28672 data: 2 3 3 4 4 6 4
8820 204/300 Write block 1309 len 20480 data: 2 2 2 2 2
8821 205/300 Write block 73 len 12288 data: 2 2 2
8822 206/300 Read block 1425 len 16384
8823 207/300 Write block 608 len 16384 data: 5 4 5 5
8824 208/300 Read block 3977 len 28672
8825 209/300 Write block 798 len 24576 data: 3 3 3 3 3 3
8826 210/300 Read block 4013 len 20480
8827 211/300 Read block 807 len 8192
8828 212/300 Read block 2719 len 40960
8829 213/300 Read block 3992 len 8192
8830 214/300 Read block 1400 len 12288
8831 215/300 Read block 4270 len 28672
8832 216/300 Write block 76 len 4096 data: 2
8833 217/300 Write block 403 len 8192 data: 4 3
8834 218/300 Read block 991 len 12288
8835 219/300 Read block 3324 len 28672
8836 220/300 Read block 1660 len 4096
8837 221/300 Read block 4212 len 20480
8838 222/300 Flush
8839 223/300 Read block 2711 len 4096
8840 224/300 Read block 4201 len 16384
8841 225/300 Write block 1517 len 36864 data: 3 4 4 4 3 3 2 2 2
8842 226/300 Flush
8843 227/300 Write block 1893 len 20480 data: 3 3 4 4 4
8844 228/300 Read block 2579 len 28672
8845 229/300 Read block 3726 len 16384
8846 230/300 Read block 4702 len 32768
8847 231/300 Read block 4463 len 4096
8848 232/300 Read block 1360 len 36864
8849 233/300 Write block 2422 len 32768 data: 2 3 3 3 4 4 3 3
8850 234/300 Read block 1746 len 24576
8851 235/300 Read block 879 len 12288
8852 236/300 Flush
8853 237/300 Read block 4767 len 12288
8854 238/300 Read block 197 len 16384
8855 239/300 Write block 1879 len 36864 data: 3 3 2 2 3 2 2 2 2
8856 240/300 Write block 3813 len 24576 data: 3 2 3 4 4 4
8857 241/300 Write block 4000 len 28672 data: 4 5 5 5 5 4 4
8858 242/300 Read block 1498 len 40960
8859 243/300 Read block 2068 len 12288
8860 244/300 Flush
8861 245/300 Flush
8862 246/300 Read block 1000 len 8192
8863 247/300 Read block 2759 len 24576
8864 248/300 Write block 1814 len 4096 data: 2
8865 249/300 Write block 2176 len 4096 data: 3
8866 250/300 Read block 1738 len 36864
8867 251/300 Write block 4198 len 24576 data: 3 5 5 5 4 3
8868 252/300 Read block 4228 len 8192
8869 253/300 Read block 204 len 20480
8870 254/300 Write block 1289 len 24576 data: 2 2 2 2 2 2
8871 255/300 Write block 94 len 40960 data: 2 2 2 2 2 2 3 3 3 3
8872 256/300 Read block 4285 len 24576
8873 257/300 Write block 2512 len 4096 data: 2
8874 258/300 Write block 4310 len 40960 data: 3 3 3 3 3 3 3 3 3 3
8875 259/300 Write block 964 len 12288 data: 3 3 2
8876 260/300 Read block 2286 len 12288
8877 261/300 Read block 2194 len 8192
8878 262/300 Write block 2510 len 8192 data: 2 2
8879 263/300 Write block 657 len 4096 data: 3
8880 264/300 Write block 1359 len 4096 data: 4
8881 265/300 Read block 4735 len 40960
8882 266/300 Read block 2096 len 20480
8883 267/300 Read block 1782 len 20480
8884 268/300 Read block 2236 len 40960
8885 269/300 Read block 4464 len 28672
8886 270/300 Read block 4857 len 12288
8887 271/300 Read block 3477 len 36864
8888 272/300 Write block 2906 len 4096 data: 3
8889 273/300 Write block 2965 len 4096 data: 4
8890 274/300 Read block 570 len 20480
8891 275/300 Read block 2575 len 36864
8892 276/300 Write block 3908 len 24576 data: 5 5 4 3 4 3
8893 277/300 Write block 71 len 20480 data: 2 2 3 3 3
8894 278/300 Read block 938 len 32768
8895 279/300 Write block 2135 len 40960 data: 2 2 2 2 2 2 3 3 3 3
8896 280/300 Write block 4903 len 4096 data: 3
8897 281/300 Read block 1754 len 12288
8898 282/300 Write block 3836 len 20480 data: 2 2 2 2 2
8899 283/300 Write block 2836 len 4096 data: 3
8900 284/300 Read block 4327 len 28672
8901 285/300 Read block 2939 len 20480
8902 286/300 Read block 4196 len 16384
8903 287/300 Read block 3257 len 40960
8904 288/300 Read block 2258 len 32768
8905 289/300 Read block 3876 len 20480
8906 290/300 Write block 4597 len 16384 data: 3 3 3 3
8907 291/300 Read block 2123 len 16384
8908 292/300 Read block 3293 len 36864
8909 293/300 Read block 3226 len 12288
8910 294/300 Write block 1435 len 32768 data: 3 3 3 3 3 3 3 3
8911 295/300 Read block 1391 len 16384
8912 296/300 Write block 1757 len 4096 data: 2
8913 297/300 Write block 4662 len 40960 data: 3 3 2 2 2 2 2 2 2 2
8914 298/300 Read block 4910 len 16384
8915 299/300 Flush
8916 300/300 Read block 4142 len 16384
8917 Main task has work to do, go find it
8918 got dsc Start(1)
8919 start 1
8920 Apr 20 01:06:58.262 INFO request completed, latency_us: 205, response_code: 204, uri: /start/cid/1, method: POST, req_id: 9e32c18f-3084-4c4e-a64b-191bb22b3596, remote_addr: 127.0.0.1:60352, local_addr: 127.0.0.1:9998
8921 Replay: started 1, returned:Ok(())
8922 ----------------------------------------------------------------
8923 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:301
8924 States: Active Offline Active
8925 GW_ID ACK DSID TYPE BLOCKS DS:0 DS:1 DS:2 REPLAY
8926 1810 Acked 2809 Write 2 Done New Done false
8927 1811 Acked 2810 Write 3 Done New Done false
8928 1812 Acked 2811 Write 9 Done New Done false
8929 1813 Acked 2812 Write 4 Done New Done false
8930 1814 Acked 2813 Write 4 Done New Done false
8931 1815 Acked 2814 Read 2 Done New Done false
8932 1816 Acked 2815 Write 4 Done New Done false
8933 1817 Acked 2816 Read 1 Done New Done false
8934 1818 Acked 2817 Write 8 Done New Done false
8935 1819 Acked 2818 Read 4 Done New Done false
8936 1820 Acked 2819 Read 3 Done New Done false
8937 1821 Acked 2820 Write 5 Done New Done false
8938 1822 Acked 2821 Write 1 Done New Done false
8939 1823 Acked 2822 Flush 0 Done New Done false
8940 1824 Acked 2823 Write 5 Done New Done false
8941 1825 Acked 2824 Read 5 Done New Done false
8942 1826 Acked 2825 Read 1 Done New Done false
8943 1827 Acked 2826 Write 4 Done New Done false
8944 1828 Acked 2827 Write 8 Done New Done false
8945 1829 Acked 2828 Read 3 Done New Done false
8946 1830 Acked 2829 Write 9 Done New Done false
8947 1831 Acked 2830 Read 9 Done New Done false
8948 1832 Acked 2831 Write 7 Done New Done false
8949 1833 Acked 2832 Read 9 Done New Done false
8950 1834 Acked 2833 Write 1 Done New Done false
8951 1835 Acked 2834 Flush 0 Done New Done false
8952 1836 Acked 2835 Read 3 Done New Done false
8953 1837 Acked 2836 Flush 0 Done New Done false
8954 1838 Acked 2837 Read 9 Done New Done false
8955 1839 Acked 2838 Write 8 Done New Done false
8956 1840 Acked 2839 Write 10 Done New Done false
8957 1841 Acked 2840 Write 1 Done New Done false
8958 1842 Acked 2841 Read 8 Done New Done false
8959 1843 Acked 2842 Read 1 Done New Done false
8960 1844 Acked 2843 Read 8 Done New Done false
8961 1845 Acked 2844 Read 5 Done New Done false
8962 1846 Acked 2845 Read 6 Done New Done false
8963 1847 Acked 2846 Read 6 Done New Done false
8964 1848 Acked 2847 Write 1 Done New Done false
8965 1849 Acked 2848 Read 1 Done New Done false
8966 1850 Acked 2849 Write 4 Done New Done false
8967 1851 Acked 2850 Write 5 Done New Done false
8968 1852 Acked 2851 Read 2 Done New Done false
8969 1853 Acked 2852 Read 3 Done New Done false
8970 1854 Acked 2853 Write 7 Done New Done false
8971 1855 Acked 2854 Write 10 Done New Done false
8972 1856 Acked 2855 Read 1 Done New Done false
8973 1857 Acked 2856 Write 2 Done New Done false
8974 1858 Acked 2857 Write 4 Done New Done false
8975 1859 Acked 2858 Write 10 Done New Done false
8976 1860 Acked 2859 Write 2 Done New Done false
8977 1861 Acked 2860 Write 10 Done New Done false
8978 1862 Acked 2861 Read 8 Done New Done false
8979 1863 Acked 2862 Write 6 Done New Done false
8980 1864 Acked 2863 Read 4 Done New Done false
8981 1865 Acked 2864 Read 3 Done New Done false
8982 1866 Acked 2865 Read 9 Done New Done false
8983 1867 Acked 2866 Read 4 Done New Done false
8984 1868 Acked 2867 Write 7 Done New Done false
8985 1869 Acked 2868 Read 6 Done New Done false
8986 1870 Acked 2869 Write 9 Done New Done false
8987 1871 Acked 2870 Read 10 Done New Done false
8988 1872 Acked 2871 Flush 0 Done New Done false
8989 1873 Acked 2872 Read 6 Done New Done false
8990 1874 Acked 2873 Write 8 Done New Done false
8991 1875 Acked 2874 Flush 0 Done New Done false
8992 1876 Acked 2875 Read 4 Done New Done false
8993 1877 Acked 2876 Flush 0 Done New Done false
8994 1878 Acked 2877 Flush 0 Done New Done false
8995 1879 Acked 2878 Read 2 Done New Done false
8996 1880 Acked 2879 Read 6 Done New Done false
8997 1881 Acked 2880 Read 8 Done New Done false
8998 1882 Acked 2881 Write 7 Done New Done false
8999 1883 Acked 2882 Flush 0 Done New Done false
9000 1884 Acked 2883 Flush 0 Done New Done false
9001 1885 Acked 2884 Read 5 Done New Done false
9002 1886 Acked 2885 Read 8 Done New Done false
9003 1887 Acked 2886 Write 6 Done New Done false
9004 1888 Acked 2887 Read 5 Done New Done false
9005 1889 Acked 2888 Flush 0 Done New Done false
9006 1890 Acked 2889 Read 5 Done New Done false
9007 1891 Acked 2890 Read 6 Done New Done false
9008 1892 Acked 2891 Read 4 Done New Done false
9009 1893 Acked 2892 Read 10 Done New Done false
9010 1894 Acked 2893 Read 7 Done New Done false
9011 1895 Acked 2894 Read 4 Done New Done false
9012 1896 Acked 2895 Read 1 Done New Done false
9013 1897 Acked 2896 Read 10 Done New Done false
9014 1898 Acked 2897 Read 3 Done New Done false
9015 1899 Acked 2898 Read 5 Done New Done false
9016 1900 Acked 2899 Write 7 Done New Done false
9017 1901 Acked 2900 Write 2 Done New Done false
9018 1902 Acked 2901 Read 5 Done New Done false
9019 1903 Acked 2902 Write 3 Done New Done false
9020 1904 Acked 2903 Write 8 Done New Done false
9021 1905 Acked 2904 Write 10 Done New Done false
9022 1906 Acked 2905 Read 4 Done New Done false
9023 1907 Acked 2906 Read 6 Done New Done false
9024 1908 Acked 2907 Read 7 Done New Done false
9025 1909 Acked 2908 Read 6 Done New Done false
9026 1910 Acked 2909 Read 8 Done New Done false
9027 1911 Acked 2910 Write 10 Done New Done false
9028 1912 Acked 2911 Flush 0 Done New Done false
9029 1913 Acked 2912 Flush 0 Done New Done false
9030 1914 Acked 2913 Read 5 Done New Done false
9031 1915 Acked 2914 Read 3 Done New Done false
9032 1916 Acked 2915 Read 7 Done New Done false
9033 1917 Acked 2916 Write 10 Done New Done false
9034 1918 Acked 2917 Write 1 Done New Done false
9035 1919 Acked 2918 Read 8 Done New Done false
9036 1920 Acked 2919 Write 4 Done New Done false
9037 1921 Acked 2920 Write 1 Done New Done false
9038 1922 Acked 2921 Write 6 Done New Done false
9039 1923 Acked 2922 Read 10 Done New Done false
9040 1924 Acked 2923 Read 6 Done New Done false
9041 1925 Acked 2924 Read 9 Done New Done false
9042 1926 Acked 2925 Read 6 Done New Done false
9043 1927 Acked 2926 Read 3 Done New Done false
9044 1928 Acked 2927 Write 6 Done New Done false
9045 1929 Acked 2928 Read 1 Done New Done false
9046 1930 Acked 2929 Write 10 Done New Done false
9047 1931 Acked 2930 Read 10 Done New Done false
9048 1932 Acked 2931 Flush 0 Done New Done false
9049 1933 Acked 2932 Read 8 Done New Done false
9050 1934 Acked 2933 Write 5 Done New Done false
9051 1935 Acked 2934 Flush 0 Done New Done false
9052 1936 Acked 2935 Read 1 Done New Done false
9053 1937 Acked 2936 Read 4 Done New Done false
9054 1938 Acked 2937 Write 5 Done New Done false
9055 1939 Acked 2938 Read 4 Done New Done false
9056 1940 Acked 2939 Write 6 Done New Done false
9057 1941 Acked 2940 Write 9 Done New Done false
9058 1942 Acked 2941 Read 5 Done New Done false
9059 1943 Acked 2942 Read 9 Done New Done false
9060 1944 Acked 2943 Write 10 Done New Done false
9061 1945 Acked 2944 Flush 0 Done New Done false
9062 1946 Acked 2945 Read 1 Done New Done false
9063 1947 Acked 2946 Read 10 Done New Done false
9064 1948 Acked 2947 Read 4 Done New Done false
9065 1949 Acked 2948 Write 8 Done New Done false
9066 1950 Acked 2949 Read 1 Done New Done false
9067 1951 Acked 2950 Read 9 Done New Done false
9068 1952 Acked 2951 Read 7 Done New Done false
9069 1953 Acked 2952 Read 8 Done New Done false
9070 1954 Acked 2953 Read 4 Done New Done false
9071 1955 Acked 2954 Write 2 Done New Done false
9072 1956 Acked 2955 Read 6 Done New Done false
9073 1957 Acked 2956 Read 1 Done New Done false
9074 1958 Acked 2957 Read 2 Done New Done false
9075 1959 Acked 2958 Write 1 Done New Done false
9076 1960 Acked 2959 Read 7 Done New Done false
9077 1961 Acked 2960 Write 9 Done New Done false
9078 1962 Acked 2961 Read 6 Done New Done false
9079 1963 Acked 2962 Read 4 Done New Done false
9080 1964 Acked 2963 Write 2 Done New Done false
9081 1965 Acked 2964 Read 2 Done New Done false
9082 1966 Acked 2965 Write 4 Done New Done false
9083 1967 Acked 2966 Flush 0 Done New Done false
9084 1968 Acked 2967 Write 5 Done New Done false
9085 1969 Acked 2968 Write 7 Done New Done false
9086 1970 Acked 2969 Read 5 Done New Done false
9087 1971 Acked 2970 Write 4 Done New Done false
9088 1972 Acked 2971 Read 8 Done New Done false
9089 1973 Acked 2972 Write 7 Done New Done false
9090 1974 Acked 2973 Read 6 Done New Done false
9091 1975 Acked 2974 Read 5 Done New Done false
9092 1976 Acked 2975 Write 3 Done New Done false
9093 1977 Acked 2976 Write 9 Done New Done false
9094 1978 Acked 2977 Read 9 Done New Done false
9095 1979 Acked 2978 Flush 0 Done New Done false
9096 1980 Acked 2979 Read 9 Done New Done false
9097 1981 Acked 2980 Read 1 Done New Done false
9098 1982 Acked 2981 Read 1 Done New Done false
9099 1983 Acked 2982 Read 7 Done New Done false
9100 1984 Acked 2983 Read 4 Done New Done false
9101 1985 Acked 2984 Write 1 Done New Done false
9102 1986 Acked 2985 Read 4 Done New Done false
9103 1987 Acked 2986 Flush 0 Done New Done false
9104 1988 Acked 2987 Read 8 Done New Done false
9105 1989 Acked 2988 Write 8 Done New Done false
9106 1990 Acked 2989 Write 1 Done New Done false
9107 1991 Acked 2990 Write 9 Done New Done false
9108 1992 Acked 2991 Read 5 Done New Done false
9109 1993 Acked 2992 Write 6 Done New Done false
9110 1994 Acked 2993 Read 5 Done New Done false
9111 1995 Acked 2994 Flush 0 Done New Done false
9112 1996 Acked 2995 Flush 0 Done New Done false
9113 1997 Acked 2996 Read 7 Done New Done false
9114 1998 Acked 2997 Read 4 Done New Done false
9115 1999 Acked 2998 Read 10 Done New Done false
9116 2000 Acked 2999 Read 9 Done New Done false
9117 2001 Acked 3000 Write 2 Done New Done false
9118 2002 Acked 3001 Read 7 Done New Done false
9119 2003 Acked 3002 Read 1 Done New Done false
9120 2004 Acked 3003 Read 5 Done New Done false
9121 2005 Acked 3004 Write 7 Done New Done false
9122 2006 Acked 3005 Flush 0 Done New Done false
9123 2007 Acked 3006 Write 2 Done New Done false
9124 2008 Acked 3007 Write 5 Done New Done false
9125 2009 Acked 3008 Read 10 Done New Done false
9126 2010 Acked 3009 Read 1 Done New Done false
9127 2011 Acked 3010 Read 7 Done New Done false
9128 2012 Acked 3011 Write 7 Done New Done false
9129 2013 Acked 3012 Write 5 Done New Done false
9130 2014 Acked 3013 Write 3 Done New Done false
9131 2015 Acked 3014 Read 4 Done New Done false
9132 2016 Acked 3015 Write 4 Done New Done false
9133 2017 Acked 3016 Read 7 Done New Done false
9134 2018 Acked 3017 Write 6 Done New Done false
9135 2019 Acked 3018 Read 5 Done New Done false
9136 2020 Acked 3019 Read 2 Done New Done false
9137 2021 Acked 3020 Read 10 Done New Done false
9138 2022 Acked 3021 Read 2 Done New Done false
9139 2023 Acked 3022 Read 3 Done New Done false
9140 2024 Acked 3023 Read 7 Done New Done false
9141 2025 Acked 3024 Write 1 Done New Done false
9142 2026 Acked 3025 Write 2 Done New Done false
9143 2027 Acked 3026 Read 3 Done New Done false
9144 2028 Acked 3027 Read 7 Done New Done false
9145 2029 Acked 3028 Read 1 Done New Done false
9146 2030 Acked 3029 Read 5 Done New Done false
9147 2031 Acked 3030 Flush 0 Done New Done false
9148 2032 Acked 3031 Read 1 Done New Done false
9149 2033 Acked 3032 Read 4 Done New Done false
9150 2034 Acked 3033 Write 9 Done New Done false
9151 2035 Acked 3034 Flush 0 Done New Done false
9152 2036 Acked 3035 Write 5 Done New Done false
9153 2037 Acked 3036 Read 7 Done New Done false
9154 2038 Acked 3037 Read 4 Done New Done false
9155 2039 Acked 3038 Read 8 Done New Done false
9156 2040 Acked 3039 Read 1 Done New Done false
9157 2041 Acked 3040 Read 9 Done New Done false
9158 2042 Acked 3041 Flush 0 Done New Done false
9159 2043 Acked 3042 Write 8 Done New Done false
9160 2044 Acked 3043 Read 6 Done New Done false
9161 2045 Acked 3044 Read 3 Done New Done false
9162 2046 Acked 3045 Flush 0 Done New Done false
9163 2047 Acked 3046 Read 3 Done New Done false
9164 2048 Acked 3047 Read 4 Done New Done false
9165 2049 Acked 3048 Write 9 Done New Done false
9166 2050 Acked 3049 Write 6 Done New Done false
9167 2051 Acked 3050 Write 7 Done New Done false
9168 2052 Acked 3051 Read 10 Done New Done false
9169 2053 Acked 3052 Read 3 Done New Done false
9170 2054 Acked 3053 Flush 0 Done New Done false
9171 2055 Acked 3054 Flush 0 Done New Done false
9172 2056 Acked 3055 Read 2 Done New Done false
9173 2057 Acked 3056 Read 6 Done New Done false
9174 2058 Acked 3057 Write 1 Done New Done false
9175 2059 Acked 3058 Write 1 Done New Done false
9176 2060 Acked 3059 Read 9 Done New Done false
9177 2061 Acked 3060 Write 6 Done New Done false
9178 2062 Acked 3061 Read 2 Done New Done false
9179 2063 Acked 3062 Read 5 Done New Done false
9180 2064 Acked 3063 Write 6 Done New Done false
9181 2065 Acked 3064 Write 10 Done New Done false
9182 2066 Acked 3065 Read 6 Done New Done false
9183 2067 Acked 3066 Write 1 Done New Done false
9184 2068 Acked 3067 Write 10 Done New Done false
9185 2069 Acked 3068 Write 3 Done New Done false
9186 2070 Acked 3069 Read 3 Done New Done false
9187 2071 Acked 3070 Read 2 Done New Done false
9188 2072 Acked 3071 Write 2 Done New Done false
9189 2073 Acked 3072 Write 1 Done New Done false
9190 2074 Acked 3073 Write 1 Done New Done false
9191 2075 Acked 3074 Read 10 Done New Done false
9192 2076 Acked 3075 Read 5 Done New Done false
9193 2077 Acked 3076 Read 5 Done New Done false
9194 2078 Acked 3077 Read 10 Done New Done false
9195 2079 Acked 3078 Read 7 Done New Done false
9196 2080 Acked 3079 Read 3 Done New Done false
9197 2081 Acked 3080 Read 9 Done New Done false
9198 2082 Acked 3081 Write 1 Done New Done false
9199 2083 Acked 3082 Write 1 Done New Done false
9200 2084 Acked 3083 Read 5 Done New Done false
9201 2085 Acked 3084 Read 9 Done New Done false
9202 2086 Acked 3085 Write 6 Done New Done false
9203 2087 Acked 3086 Write 5 Done New Done false
9204 2088 Acked 3087 Read 8 Done New Done false
9205 2089 Acked 3088 Write 10 Done New Done false
9206 2090 Acked 3089 Write 1 Done New Done false
9207 2091 Acked 3090 Read 3 Done New Done false
9208 2092 Acked 3091 Write 5 Done New Done false
9209 2093 Acked 3092 Write 1 Done New Done false
9210 2094 Acked 3093 Read 7 Done New Done false
9211 2095 Acked 3094 Read 5 Done New Done false
9212 2096 Acked 3095 Read 4 Done New Done false
9213 2097 Acked 3096 Read 10 Done New Done false
9214 2098 Acked 3097 Read 8 Done New Done false
9215 2099 Acked 3098 Read 5 Done New Done false
9216 2100 Acked 3099 Write 4 Done New Done false
9217 2101 Acked 3100 Read 4 Done New Done false
9218 2102 Acked 3101 Read 9 Done New Done false
9219 2103 Acked 3102 Read 3 Done New Done false
9220 2104 Acked 3103 Write 8 Done New Done false
9221 2105 Acked 3104 Read 4 Done New Done false
9222 2106 Acked 3105 Write 1 Done New Done false
9223 2107 Acked 3106 Write 10 Done New Done false
9224 2108 Acked 3107 Read 4 Done New Done false
9225 2109 Acked 3108 Flush 0 Done New Done false
9226 2110 Acked 3109 Read 4 Done New Done false
9227 STATES DS:0 DS:1 DS:2 TOTAL
9228 New 0 301 0 301
9229 Sent 0 0 0 0
9230 Done 301 0 301 602
9231 Skipped 0 0 0 0
9232 Error 0 0 0 0
9233 Last Flush: 3108 2808 3108
9234 Downstairs last five completed: 2808 2807 2806 2805 2804
9235 Upstairs last five completed: 2110 2109 2108 2107 2106
9236 CLIENT: Up:0 ds:301 act:2
9237 [8820] got start action
9238 [8820] I am going to restart
9239 Starting downstairs at port 8820
9240 Make output file at "/tmp/dsc/downstairs-8820.txt"
9241 [8820][1] reports Starting
9242 Downstairs /var/tmp/dsc/region/8820 port 8820 PID:Some(1203)
9243 [8820][1] reports Running
9244 ----------------------------------------------------------------
9245 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:302
9246 States: Active Offline Active
9247 GW_ID ACK DSID TYPE BLOCKS DS:0 DS:1 DS:2 REPLAY
9248 1810 Acked 2809 Write 2 Done New Done false
9249 1811 Acked 2810 Write 3 Done New Done false
9250 1812 Acked 2811 Write 9 Done New Done false
9251 1813 Acked 2812 Write 4 Done New Done false
9252 1814 Acked 2813 Write 4 Done New Done false
9253 1815 Acked 2814 Read 2 Done New Done false
9254 1816 Acked 2815 Write 4 Done New Done false
9255 1817 Acked 2816 Read 1 Done New Done false
9256 1818 Acked 2817 Write 8 Done New Done false
9257 1819 Acked 2818 Read 4 Done New Done false
9258 1820 Acked 2819 Read 3 Done New Done false
9259 1821 Acked 2820 Write 5 Done New Done false
9260 1822 Acked 2821 Write 1 Done New Done false
9261 1823 Acked 2822 Flush 0 Done New Done false
9262 1824 Acked 2823 Write 5 Done New Done false
9263 1825 Acked 2824 Read 5 Done New Done false
9264 1826 Acked 2825 Read 1 Done New Done false
9265 1827 Acked 2826 Write 4 Done New Done false
9266 1828 Acked 2827 Write 8 Done New Done false
9267 1829 Acked 2828 Read 3 Done New Done false
9268 1830 Acked 2829 Write 9 Done New Done false
9269 1831 Acked 2830 Read 9 Done New Done false
9270 1832 Acked 2831 Write 7 Done New Done false
9271 1833 Acked 2832 Read 9 Done New Done false
9272 1834 Acked 2833 Write 1 Done New Done false
9273 1835 Acked 2834 Flush 0 Done New Done false
9274 1836 Acked 2835 Read 3 Done New Done false
9275 1837 Acked 2836 Flush 0 Done New Done false
9276 1838 Acked 2837 Read 9 Done New Done false
9277 1839 Acked 2838 Write 8 Done New Done false
9278 1840 Acked 2839 Write 10 Done New Done false
9279 1841 Acked 2840 Write 1 Done New Done false
9280 1842 Acked 2841 Read 8 Done New Done false
9281 1843 Acked 2842 Read 1 Done New Done false
9282 1844 Acked 2843 Read 8 Done New Done false
9283 1845 Acked 2844 Read 5 Done New Done false
9284 1846 Acked 2845 Read 6 Done New Done false
9285 1847 Acked 2846 Read 6 Done New Done false
9286 1848 Acked 2847 Write 1 Done New Done false
9287 1849 Acked 2848 Read 1 Done New Done false
9288 1850 Acked 2849 Write 4 Done New Done false
9289 1851 Acked 2850 Write 5 Done New Done false
9290 1852 Acked 2851 Read 2 Done New Done false
9291 1853 Acked 2852 Read 3 Done New Done false
9292 1854 Acked 2853 Write 7 Done New Done false
9293 1855 Acked 2854 Write 10 Done New Done false
9294 1856 Acked 2855 Read 1 Done New Done false
9295 1857 Acked 2856 Write 2 Done New Done false
9296 1858 Acked 2857 Write 4 Done New Done false
9297 1859 Acked 2858 Write 10 Done New Done false
9298 1860 Acked 2859 Write 2 Done New Done false
9299 1861 Acked 2860 Write 10 Done New Done false
9300 1862 Acked 2861 Read 8 Done New Done false
9301 1863 Acked 2862 Write 6 Done New Done false
9302 1864 Acked 2863 Read 4 Done New Done false
9303 1865 Acked 2864 Read 3 Done New Done false
9304 1866 Acked 2865 Read 9 Done New Done false
9305 1867 Acked 2866 Read 4 Done New Done false
9306 1868 Acked 2867 Write 7 Done New Done false
9307 1869 Acked 2868 Read 6 Done New Done false
9308 1870 Acked 2869 Write 9 Done New Done false
9309 1871 Acked 2870 Read 10 Done New Done false
9310 1872 Acked 2871 Flush 0 Done New Done false
9311 1873 Acked 2872 Read 6 Done New Done false
9312 1874 Acked 2873 Write 8 Done New Done false
9313 1875 Acked 2874 Flush 0 Done New Done false
9314 1876 Acked 2875 Read 4 Done New Done false
9315 1877 Acked 2876 Flush 0 Done New Done false
9316 1878 Acked 2877 Flush 0 Done New Done false
9317 1879 Acked 2878 Read 2 Done New Done false
9318 1880 Acked 2879 Read 6 Done New Done false
9319 1881 Acked 2880 Read 8 Done New Done false
9320 1882 Acked 2881 Write 7 Done New Done false
9321 1883 Acked 2882 Flush 0 Done New Done false
9322 1884 Acked 2883 Flush 0 Done New Done false
9323 1885 Acked 2884 Read 5 Done New Done false
9324 1886 Acked 2885 Read 8 Done New Done false
9325 1887 Acked 2886 Write 6 Done New Done false
9326 1888 Acked 2887 Read 5 Done New Done false
9327 1889 Acked 2888 Flush 0 Done New Done false
9328 1890 Acked 2889 Read 5 Done New Done false
9329 1891 Acked 2890 Read 6 Done New Done false
9330 1892 Acked 2891 Read 4 Done New Done false
9331 1893 Acked 2892 Read 10 Done New Done false
9332 1894 Acked 2893 Read 7 Done New Done false
9333 1895 Acked 2894 Read 4 Done New Done false
9334 1896 Acked 2895 Read 1 Done New Done false
9335 1897 Acked 2896 Read 10 Done New Done false
9336 1898 Acked 2897 Read 3 Done New Done false
9337 1899 Acked 2898 Read 5 Done New Done false
9338 1900 Acked 2899 Write 7 Done New Done false
9339 1901 Acked 2900 Write 2 Done New Done false
9340 1902 Acked 2901 Read 5 Done New Done false
9341 1903 Acked 2902 Write 3 Done New Done false
9342 1904 Acked 2903 Write 8 Done New Done false
9343 1905 Acked 2904 Write 10 Done New Done false
9344 1906 Acked 2905 Read 4 Done New Done false
9345 1907 Acked 2906 Read 6 Done New Done false
9346 1908 Acked 2907 Read 7 Done New Done false
9347 1909 Acked 2908 Read 6 Done New Done false
9348 1910 Acked 2909 Read 8 Done New Done false
9349 1911 Acked 2910 Write 10 Done New Done false
9350 1912 Acked 2911 Flush 0 Done New Done false
9351 1913 Acked 2912 Flush 0 Done New Done false
9352 1914 Acked 2913 Read 5 Done New Done false
9353 1915 Acked 2914 Read 3 Done New Done false
9354 1916 Acked 2915 Read 7 Done New Done false
9355 1917 Acked 2916 Write 10 Done New Done false
9356 1918 Acked 2917 Write 1 Done New Done false
9357 1919 Acked 2918 Read 8 Done New Done false
9358 1920 Acked 2919 Write 4 Done New Done false
9359 1921 Acked 2920 Write 1 Done New Done false
9360 1922 Acked 2921 Write 6 Done New Done false
9361 1923 Acked 2922 Read 10 Done New Done false
9362 1924 Acked 2923 Read 6 Done New Done false
9363 1925 Acked 2924 Read 9 Done New Done false
9364 1926 Acked 2925 Read 6 Done New Done false
9365 1927 Acked 2926 Read 3 Done New Done false
9366 1928 Acked 2927 Write 6 Done New Done false
9367 1929 Acked 2928 Read 1 Done New Done false
9368 1930 Acked 2929 Write 10 Done New Done false
9369 1931 Acked 2930 Read 10 Done New Done false
9370 1932 Acked 2931 Flush 0 Done New Done false
9371 1933 Acked 2932 Read 8 Done New Done false
9372 1934 Acked 2933 Write 5 Done New Done false
9373 1935 Acked 2934 Flush 0 Done New Done false
9374 1936 Acked 2935 Read 1 Done New Done false
9375 1937 Acked 2936 Read 4 Done New Done false
9376 1938 Acked 2937 Write 5 Done New Done false
9377 1939 Acked 2938 Read 4 Done New Done false
9378 1940 Acked 2939 Write 6 Done New Done false
9379 1941 Acked 2940 Write 9 Done New Done false
9380 1942 Acked 2941 Read 5 Done New Done false
9381 1943 Acked 2942 Read 9 Done New Done false
9382 1944 Acked 2943 Write 10 Done New Done false
9383 1945 Acked 2944 Flush 0 Done New Done false
9384 1946 Acked 2945 Read 1 Done New Done false
9385 1947 Acked 2946 Read 10 Done New Done false
9386 1948 Acked 2947 Read 4 Done New Done false
9387 1949 Acked 2948 Write 8 Done New Done false
9388 1950 Acked 2949 Read 1 Done New Done false
9389 1951 Acked 2950 Read 9 Done New Done false
9390 1952 Acked 2951 Read 7 Done New Done false
9391 1953 Acked 2952 Read 8 Done New Done false
9392 1954 Acked 2953 Read 4 Done New Done false
9393 1955 Acked 2954 Write 2 Done New Done false
9394 1956 Acked 2955 Read 6 Done New Done false
9395 1957 Acked 2956 Read 1 Done New Done false
9396 1958 Acked 2957 Read 2 Done New Done false
9397 1959 Acked 2958 Write 1 Done New Done false
9398 1960 Acked 2959 Read 7 Done New Done false
9399 1961 Acked 2960 Write 9 Done New Done false
9400 1962 Acked 2961 Read 6 Done New Done false
9401 1963 Acked 2962 Read 4 Done New Done false
9402 1964 Acked 2963 Write 2 Done New Done false
9403 1965 Acked 2964 Read 2 Done New Done false
9404 1966 Acked 2965 Write 4 Done New Done false
9405 1967 Acked 2966 Flush 0 Done New Done false
9406 1968 Acked 2967 Write 5 Done New Done false
9407 1969 Acked 2968 Write 7 Done New Done false
9408 1970 Acked 2969 Read 5 Done New Done false
9409 1971 Acked 2970 Write 4 Done New Done false
9410 1972 Acked 2971 Read 8 Done New Done false
9411 1973 Acked 2972 Write 7 Done New Done false
9412 1974 Acked 2973 Read 6 Done New Done false
9413 1975 Acked 2974 Read 5 Done New Done false
9414 1976 Acked 2975 Write 3 Done New Done false
9415 1977 Acked 2976 Write 9 Done New Done false
9416 1978 Acked 2977 Read 9 Done New Done false
9417 1979 Acked 2978 Flush 0 Done New Done false
9418 1980 Acked 2979 Read 9 Done New Done false
9419 1981 Acked 2980 Read 1 Done New Done false
9420 1982 Acked 2981 Read 1 Done New Done false
9421 1983 Acked 2982 Read 7 Done New Done false
9422 1984 Acked 2983 Read 4 Done New Done false
9423 1985 Acked 2984 Write 1 Done New Done false
9424 1986 Acked 2985 Read 4 Done New Done false
9425 1987 Acked 2986 Flush 0 Done New Done false
9426 1988 Acked 2987 Read 8 Done New Done false
9427 1989 Acked 2988 Write 8 Done New Done false
9428 1990 Acked 2989 Write 1 Done New Done false
9429 1991 Acked 2990 Write 9 Done New Done false
9430 1992 Acked 2991 Read 5 Done New Done false
9431 1993 Acked 2992 Write 6 Done New Done false
9432 1994 Acked 2993 Read 5 Done New Done false
9433 1995 Acked 2994 Flush 0 Done New Done false
9434 1996 Acked 2995 Flush 0 Done New Done false
9435 1997 Acked 2996 Read 7 Done New Done false
9436 1998 Acked 2997 Read 4 Done New Done false
9437 1999 Acked 2998 Read 10 Done New Done false
9438 2000 Acked 2999 Read 9 Done New Done false
9439 2001 Acked 3000 Write 2 Done New Done false
9440 2002 Acked 3001 Read 7 Done New Done false
9441 2003 Acked 3002 Read 1 Done New Done false
9442 2004 Acked 3003 Read 5 Done New Done false
9443 2005 Acked 3004 Write 7 Done New Done false
9444 2006 Acked 3005 Flush 0 Done New Done false
9445 2007 Acked 3006 Write 2 Done New Done false
9446 2008 Acked 3007 Write 5 Done New Done false
9447 2009 Acked 3008 Read 10 Done New Done false
9448 2010 Acked 3009 Read 1 Done New Done false
9449 2011 Acked 3010 Read 7 Done New Done false
9450 2012 Acked 3011 Write 7 Done New Done false
9451 2013 Acked 3012 Write 5 Done New Done false
9452 2014 Acked 3013 Write 3 Done New Done false
9453 2015 Acked 3014 Read 4 Done New Done false
9454 2016 Acked 3015 Write 4 Done New Done false
9455 2017 Acked 3016 Read 7 Done New Done false
9456 2018 Acked 3017 Write 6 Done New Done false
9457 2019 Acked 3018 Read 5 Done New Done false
9458 2020 Acked 3019 Read 2 Done New Done false
9459 2021 Acked 3020 Read 10 Done New Done false
9460 2022 Acked 3021 Read 2 Done New Done false
9461 2023 Acked 3022 Read 3 Done New Done false
9462 2024 Acked 3023 Read 7 Done New Done false
9463 2025 Acked 3024 Write 1 Done New Done false
9464 2026 Acked 3025 Write 2 Done New Done false
9465 2027 Acked 3026 Read 3 Done New Done false
9466 2028 Acked 3027 Read 7 Done New Done false
9467 2029 Acked 3028 Read 1 Done New Done false
9468 2030 Acked 3029 Read 5 Done New Done false
9469 2031 Acked 3030 Flush 0 Done New Done false
9470 2032 Acked 3031 Read 1 Done New Done false
9471 2033 Acked 3032 Read 4 Done New Done false
9472 2034 Acked 3033 Write 9 Done New Done false
9473 2035 Acked 3034 Flush 0 Done New Done false
9474 2036 Acked 3035 Write 5 Done New Done false
9475 2037 Acked 3036 Read 7 Done New Done false
9476 2038 Acked 3037 Read 4 Done New Done false
9477 2039 Acked 3038 Read 8 Done New Done false
9478 2040 Acked 3039 Read 1 Done New Done false
9479 2041 Acked 3040 Read 9 Done New Done false
9480 2042 Acked 3041 Flush 0 Done New Done false
9481 2043 Acked 3042 Write 8 Done New Done false
9482 2044 Acked 3043 Read 6 Done New Done false
9483 2045 Acked 3044 Read 3 Done New Done false
9484 2046 Acked 3045 Flush 0 Done New Done false
9485 2047 Acked 3046 Read 3 Done New Done false
9486 2048 Acked 3047 Read 4 Done New Done false
9487 2049 Acked 3048 Write 9 Done New Done false
9488 2050 Acked 3049 Write 6 Done New Done false
9489 2051 Acked 3050 Write 7 Done New Done false
9490 2052 Acked 3051 Read 10 Done New Done false
9491 2053 Acked 3052 Read 3 Done New Done false
9492 2054 Acked 3053 Flush 0 Done New Done false
9493 2055 Acked 3054 Flush 0 Done New Done false
9494 2056 Acked 3055 Read 2 Done New Done false
9495 2057 Acked 3056 Read 6 Done New Done false
9496 2058 Acked 3057 Write 1 Done New Done false
9497 2059 Acked 3058 Write 1 Done New Done false
9498 2060 Acked 3059 Read 9 Done New Done false
9499 2061 Acked 3060 Write 6 Done New Done false
9500 2062 Acked 3061 Read 2 Done New Done false
9501 2063 Acked 3062 Read 5 Done New Done false
9502 2064 Acked 3063 Write 6 Done New Done false
9503 2065 Acked 3064 Write 10 Done New Done false
9504 2066 Acked 3065 Read 6 Done New Done false
9505 2067 Acked 3066 Write 1 Done New Done false
9506 2068 Acked 3067 Write 10 Done New Done false
9507 2069 Acked 3068 Write 3 Done New Done false
9508 2070 Acked 3069 Read 3 Done New Done false
9509 2071 Acked 3070 Read 2 Done New Done false
9510 2072 Acked 3071 Write 2 Done New Done false
9511 2073 Acked 3072 Write 1 Done New Done false
9512 2074 Acked 3073 Write 1 Done New Done false
9513 2075 Acked 3074 Read 10 Done New Done false
9514 2076 Acked 3075 Read 5 Done New Done false
9515 2077 Acked 3076 Read 5 Done New Done false
9516 2078 Acked 3077 Read 10 Done New Done false
9517 2079 Acked 3078 Read 7 Done New Done false
9518 2080 Acked 3079 Read 3 Done New Done false
9519 2081 Acked 3080 Read 9 Done New Done false
9520 2082 Acked 3081 Write 1 Done New Done false
9521 2083 Acked 3082 Write 1 Done New Done false
9522 2084 Acked 3083 Read 5 Done New Done false
9523 2085 Acked 3084 Read 9 Done New Done false
9524 2086 Acked 3085 Write 6 Done New Done false
9525 2087 Acked 3086 Write 5 Done New Done false
9526 2088 Acked 3087 Read 8 Done New Done false
9527 2089 Acked 3088 Write 10 Done New Done false
9528 2090 Acked 3089 Write 1 Done New Done false
9529 2091 Acked 3090 Read 3 Done New Done false
9530 2092 Acked 3091 Write 5 Done New Done false
9531 2093 Acked 3092 Write 1 Done New Done false
9532 2094 Acked 3093 Read 7 Done New Done false
9533 2095 Acked 3094 Read 5 Done New Done false
9534 2096 Acked 3095 Read 4 Done New Done false
9535 2097 Acked 3096 Read 10 Done New Done false
9536 2098 Acked 3097 Read 8 Done New Done false
9537 2099 Acked 3098 Read 5 Done New Done false
9538 2100 Acked 3099 Write 4 Done New Done false
9539 2101 Acked 3100 Read 4 Done New Done false
9540 2102 Acked 3101 Read 9 Done New Done false
9541 2103 Acked 3102 Read 3 Done New Done false
9542 2104 Acked 3103 Write 8 Done New Done false
9543 2105 Acked 3104 Read 4 Done New Done false
9544 2106 Acked 3105 Write 1 Done New Done false
9545 2107 Acked 3106 Write 10 Done New Done false
9546 2108 Acked 3107 Read 4 Done New Done false
9547 2109 Acked 3108 Flush 0 Done New Done false
9548 2110 Acked 3109 Read 4 Done New Done false
9549 2111 Acked 3110 Flush 0 Done New Done false
9550 STATES DS:0 DS:1 DS:2 TOTAL
9551 New 0 302 0 302
9552 Sent 0 0 0 0
9553 Done 302 0 302 604
9554 Skipped 0 0 0 0
9555 Error 0 0 0 0
9556 Last Flush: 3110 2808 3110
9557 Downstairs last five completed: 2808 2807 2806 2805 2804
9558 Upstairs last five completed: 2111 2110 2109 2108 2107
9559 CLIENT: Up:0 ds:302 act:2
95602024-04-20T01:07:03.961ZINFOcrucible: connecting to 127.0.0.1:8820 = io task client = 1 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
95612024-04-20T01:07:03.961ZINFOcrucible: ds_connection connected from Ok(127.0.0.1:62359) = io task client = 1 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
95622024-04-20T01:07:03.962ZINFOcrucible: downstairs client at Some(127.0.0.1:8820) has region UUID 12345678-0000-0000-0000-000000008820 = downstairs client = 1 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
95632024-04-20T01:07:03.962ZINFOcrucible: Returning UUID:12345678-0000-0000-0000-000000008820 matches = downstairs client = 1 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
95642024-04-20T01:07:03.962ZINFOcrucible: send last flush ID to this DS: 2808 = downstairs client = 1 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
95652024-04-20T01:07:03.962ZINFOcrucible: Replied this last flush ID: 2808 = downstairs client = 1 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
95662024-04-20T01:07:03.962ZINFOcrucible: ds_transition from Offline to Replay = downstairs client = 1 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
95672024-04-20T01:07:03.962ZINFOcrucible: [1] Transition from Offline to Replay = downstairs client = 1 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
95682024-04-20T01:07:03.962ZINFOcrucible: ds_transition from Replay to Active = downstairs client = 1 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
95692024-04-20T01:07:03.962ZINFOcrucible: [1] Transition from Replay to Active = downstairs client = 1 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
9570 ----------------------------------------------------------------
9571 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:0
9572 Downstairs last five completed: 3110 3109 3108 3107 3106
9573 Upstairs last five completed: 2111 2110 2109 2108 2107
9574 CLIENT: Up:0 ds:0 act:3
9575 Replay: All jobs finished, all DS active.
9576 Main task has work to do, go find it
9577 got dsc Stop(0)
9578 stop 0
9579 Apr 20 01:07:06.267 INFO request completed, latency_us: 307, response_code:[8810] Got stop action so:false kr:false
9580 204, uri: /stop/cid/0, method: POST, req_id: acd180f6-0c02-48d2-9f6a-8b8bd894f206, remote_addr: 127.0.0.1:60352, local_addr: 127.0.0.1:9998
95812024-04-20T01:07:06.268ZWARNcrucible: downstairs disconnected = io task client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
9582 Apr 20 01:07:06.268 INFO request completed, latency_us: 105, response_code:{"msg":"client task is sending Done(Finished)","v":0,"name":"crucible","level":40,"time":"2024-04-20T01:07:06.268339898Z","hostname":"w-01HVWGBJP7HK0H9TQ26T6N3X8M","pid":1196,"":"io task","client":"0","":"downstairs","session_id":"132b460a-26a0-4532-b1ab-4f8c07d4c6c7"}
95832024-04-20T01:07:06.268ZWARNcrucible: downstairs task for 0 stopped due to Finished session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
9584 200, uri: /state/cid/0, method: GET, req_id: 2f378f1b-2435-41a7-932e-a299c779efd5, remote_addr: {"msg":"Gone missing, transition from Active to Offline","v":0,"name":"crucible","level":30,"time":"2024-04-20T01:07:06.268392337Z","hostname":"w-01HVWGBJP7HK0H9TQ26T6N3X8M","pid":1196,"client":"0","":"downstairs","session_id":"132b460a-26a0-4532-b1ab-4f8c07d4c6c7"}
9585 127.0.0.1{"msg":"[0] client re-new 0 jobs since flush 3110","v":0,"name":"crucible","level":30,"time":"2024-04-20T01:07:06.268424326Z","hostname":"w-01HVWGBJP7HK0H9TQ26T6N3X8M","pid":1196,"":"downstairs","":"downstairs","session_id":"132b460a-26a0-4532-b1ab-4f8c07d4c6c7"}
9586 :60352, local_addr: 127.0.0.1:9998{"msg":"[0] Marked 0 jobs for replay since flush: 3110","v":0,"name":"crucible","level":30,"time":"2024-04-20T01:07:06.268475474Z","hostname":"w-01HVWGBJP7HK0H9TQ26T6N3X8M","pid":1196,"":"downstairs","":"downstairs","session_id":"132b460a-26a0-4532-b1ab-4f8c07d4c6c7"}
9587 
95882024-04-20T01:07:06.268ZINFOcrucible: client task is exiting = io task client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
9589 [8810] Exited with: ExitStatus(unix_wait_status(9))
9590 [8810][0] reports Exit
9591 Apr 20 01:07:10.271 INFO request completed, latency_us: 197, response_code: 200, uri: /state/cid/0, method: GET, req_id: 334a5359-74e9-453c-9e15-808a9b62d46b, remote_addr: 127.0.0.1:60352, local_addr: 127.0.0.1:9998
9592 001/300 Write block 1851 len 28672 data: 2 2 2 2 2 2 2
9593 002/300 Read block 798 len 16384
9594 003/300 Read block 3198 len 32768
9595 004/300 Write block 2645 len 12288 data: 4 4 4
9596 005/300 Read block 231 len 16384
9597 006/300 Read block 29 len 16384
9598 007/300 Write block 1862 len 8192 data: 2 2
9599 008/300 Read block 4566 len 8192
9600 009/300 Write block 3339 len 40960 data: 2 2 2 2 2 2 2 2 2 2
9601 010/300 Write block 2264 len 8192 data: 4 3
9602 011/300 Flush
9603 012/300 Write block 1160 len 24576 data: 2 2 2 2 2 2
9604 013/300 Write block 325 len 20480 data: 3 2 2 2 2
9605 014/300 Flush
9606 015/300 Read block 4045 len 40960
9607 016/300 Read block 292 len 32768
9608 017/300 Write block 3465 len 20480 data: 3 3 3 3 3
9609 018/300 Read block 4813 len 4096
9610 019/300 Read block 3018 len 8192
9611 020/300 Read block 1916 len 16384
9612 021/300 Read block 1846 len 24576
9613 022/300 Read block 1416 len 40960
9614 023/300 Write block 521 len 28672 data: 5 4 4 4 4 4 3
9615 024/300 Read block 1857 len 32768
9616 025/300 Read block 3121 len 28672
9617 026/300 Read block 2935 len 24576
9618 027/300 Write block 3494 len 12288 data: 3 2 2
9619 028/300 Write block 3449 len 4096 data: 2
9620 029/300 Read block 1521 len 16384
9621 030/300 Write block 1271 len 40960 data: 3 2 3 3 3 3 3 2 2 2
9622 031/300 Read block 1094 len 16384
9623 032/300 Flush
9624 033/300 Write block 1614 len 8192 data: 2 2
9625 034/300 Flush
9626 035/300 Read block 3031 len 20480
9627 036/300 Write block 2220 len 12288 data: 2 3 3
9628 037/300 Read block 2460 len 36864
9629 038/300 Write block 3161 len 12288 data: 2 2 2
9630 039/300 Read block 1210 len 36864
9631 040/300 Write block 2866 len 24576 data: 2 2 2 2 2 2
9632 041/300 Flush
9633 042/300 Write block 4738 len 16384 data: 5 4 4 3
9634 043/300 Write block 2195 len 24576 data: 2 2 2 2 2 2
9635 044/300 Write block 445 len 40960 data: 3 3 4 3 3 4 4 3 4 3
9636 045/300 Write block 4960 len 28672 data: 2 2 2 2 3 3 3
9637 046/300 Read block 403 len 32768
9638 047/300 Read block 754 len 16384
9639 048/300 Read block 3657 len 40960
9640 049/300 Read block 949 len 36864
9641 050/300 Read block 973 len 40960
9642 051/300 Write block 2458 len 32768 data: 2 3 3 3 2 2 3 3
9643 052/300 Write block 3399 len 36864 data: 3 4 3 2 2 2 3 4 3
9644 053/300 Write block 1264 len 8192 data: 4 3
9645 054/300 Read block 2858 len 4096
9646 055/300 Flush
9647 056/300 Write block 3745 len 28672 data: 2 2 2 2 3 3 2
9648 057/300 Write block 3673 len 40960 data: 2 2 2 2 2 2 2 3 3 3
9649 058/300 Read block 307 len 4096
9650 059/300 Read block 3392 len 40960
9651 060/300 Read block 3863 len 36864
9652 061/300 Write block 4446 len 4096 data: 5
9653 062/300 Read block 1956 len 32768
9654 063/300 Write block 3636 len 20480 data: 3 3 2 2 2
9655 064/300 Flush
9656 065/300 Read block 1947 len 32768
9657 066/300 Read block 4165 len 24576
9658 067/300 Write block 3605 len 40960 data: 3 3 3 3 3 3 2 2 2 3
9659 068/300 Read block 1402 len 40960
9660 069/300 Read block 4399 len 12288
9661 070/300 Write block 810 len 16384 data: 2 2 2 2
9662 071/300 Read block 308 len 16384
9663 072/300 Write block 2355 len 8192 data: 3 3
9664 073/300 Read block 1951 len 28672
9665 074/300 Read block 2019 len 8192
9666 075/300 Flush
9667 076/300 Read block 1545 len 8192
9668 077/300 Read block 38 len 32768
9669 078/300 Read block 871 len 24576
9670 079/300 Write block 767 len 36864 data: 3 3 3 4 4 4 5 5 5
9671 080/300 Read block 844 len 40960
9672 081/300 Read block 3939 len 20480
9673 082/300 Read block 1923 len 36864
9674 083/300 Flush
9675 084/300 Read block 3408 len 20480
9676 085/300 Write block 2817 len 16384 data: 3 3 2 2
9677 086/300 Read block 4311 len 20480
9678 087/300 Read block 850 len 16384
9679 088/300 Write block 4564 len 40960 data: 3 3 3 3 3 3 4 4 4 3
9680 089/300 Read block 3645 len 40960
9681 090/300 Read block 3522 len 4096
9682 091/300 Write block 4621 len 40960 data: 2 2 2 2 2 3 3 3 2 2
9683 092/300 Read block 2260 len 4096
9684 093/300 Write block 2090 len 32768 data: 4 5 5 5 5 5 5 5
9685 094/300 Write block 2318 len 32768 data: 2 2 2 2 2 2 2 2
9686 095/300 Read block 3353 len 24576
9687 096/300 Read block 3840 len 20480
9688 097/300 Write block 1252 len 40960 data: 2 2 2 2 2 2 2 2 2 3
9689 098/300 Write block 3448 len 16384 data: 2 3 2 2
9690 099/300 Read block 978 len 40960
9691 100/300 Write block 52 len 16384 data: 3 3 3 2
9692 101/300 Read block 3800 len 8192
9693 102/300 Read block 3354 len 12288
9694 103/300 Write block 3120 len 4096 data: 2
9695 104/300 Write block 4001 len 40960 data: 6 6 6 6 5 5 3 2 2 2
9696 105/300 Read block 4504 len 40960
9697 106/300 Read block 2753 len 32768
9698 107/300 Write block 3160 len 20480 data: 2 3 3 3 3
9699 108/300 Read block 2025 len 36864
9700 109/300 Write block 2093 len 4096 data: 6
9701 110/300 Read block 2596 len 36864
9702 111/300 Write block 1083 len 36864 data: 5 4 4 3 3 2 2 3 3
9703 112/300 Write block 1093 len 4096 data: 3
9704 113/300 Read block 2672 len 16384
9705 114/300 Write block 4871 len 40960 data: 5 5 5 5 6 6 6 4 4 3
9706 115/300 Read block 4879 len 12288
9707 116/300 Write block 1217 len 4096 data: 2
9708 117/300 Read block 620 len 16384
9709 118/300 Write block 1050 len 36864 data: 2 2 2 2 2 2 3 3 3
9710 119/300 Flush
9711 120/300 Read block 3947 len 36864
9712 121/300 Write block 2444 len 12288 data: 2 2 3
9713 122/300 Read block 4869 len 20480
9714 123/300 Read block 469 len 40960
9715 124/300 Write block 4279 len 4096 data: 2
9716 125/300 Read block 4471 len 12288
9717 126/300 Write block 19 len 20480 data: 3 4 4 3 3
9718 127/300 Write block 4912 len 40960 data: 4 4 3 3 3 5 5 4 4 4
9719 128/300 Read block 184 len 8192
9720 129/300 Read block 2957 len 8192
9721 130/300 Read block 4923 len 4096
9722 131/300 Read block 2415 len 4096
9723 132/300 Read block 1052 len 20480
9724 133/300 Read block 4203 len 36864
9725 134/300 Read block 2029 len 40960
9726 135/300 Read block 2419 len 16384
9727 136/300 Write block 2086 len 4096 data: 4
9728 137/300 Write block 4706 len 36864 data: 3 3 2 2 2 3 2 2 2
9729 138/300 Write block 4142 len 24576 data: 5 4 3 2 2 2
9730 139/300 Read block 802 len 28672
9731 140/300 Read block 2637 len 12288
9732 141/300 Flush
9733 142/300 Read block 1856 len 16384
9734 143/300 Read block 1168 len 16384
9735 144/300 Flush
9736 145/300 Write block 175 len 4096 data: 3
9737 146/300 Write block 4227 len 8192 data: 4 4
9738 147/300 Read block 4145 len 32768
9739 148/300 Write block 3097 len 40960 data: 3 6 6 7 5 5 5 5 5 5
9740 149/300 Write block 2253 len 16384 data: 2 2 2 2
9741 150/300 Write block 1104 len 20480 data: 3 2 2 2 2
9742 151/300 Flush
9743 152/300 Read block 178 len 36864
9744 153/300 Flush
9745 154/300 Read block 4722 len 8192
9746 155/300 Read block 4610 len 20480
9747 156/300 Read block 1183 len 12288
9748 157/300 Read block 812 len 16384
9749 158/300 Flush
9750 159/300 Write block 1874 len 12288 data: 3 3 4
9751 160/300 Write block 1589 len 28672 data: 3 3 3 3 2 2 2
9752 161/300 Read block 4881 len 20480
9753 162/300 Write block 3738 len 28672 data: 3 3 3 3 2 2 2
9754 163/300 Write block 951 len 4096 data: 3
9755 164/300 Write block 1511 len 12288 data: 2 2 2
9756 165/300 Write block 1097 len 28672 data: 4 4 3 3 3 3 3
9757 166/300 Write block 2689 len 12288 data: 3 3 2
9758 167/300 Read block 4537 len 8192
9759 168/300 Flush
9760 169/300 Write block 800 len 28672 data: 4 4 4 4 3 2 2
9761 170/300 Flush
9762 171/300 Write block 2872 len 12288 data: 2 2 2
9763 172/300 Read block 3500 len 28672
9764 173/300 Read block 146 len 28672
9765 174/300 Read block 2133 len 40960
9766 175/300 Flush
9767 176/300 Read block 4469 len 24576
9768 177/300 Read block 4570 len 32768
9769 178/300 Flush
9770 179/300 Write block 2663 len 32768 data: 2 4 4 4 3 3 3 3
9771 180/300 Write block 1914 len 20480 data: 3 3 4 3 2
9772 181/300 Write block 3371 len 28672 data: 2 2 2 2 2 2 2
9773 182/300 Read block 1763 len 12288
9774 183/300 Write block 3695 len 4096 data: 3
9775 184/300 Read block 2816 len 28672
9776 185/300 Flush
9777 186/300 Write block 37 len 12288 data: 2 2 2
9778 187/300 Read block 654 len 40960
9779 188/300 Write block 1899 len 8192 data: 3 2
9780 189/300 Read block 3621 len 36864
9781 190/300 Write block 219 len 12288 data: 2 3 4
9782 191/300 Read block 1094 len 20480
9783 192/300 Write block 1255 len 8192 data: 3 3
9784 193/300 Read block 1257 len 12288
9785 194/300 Write block 3490 len 36864 data: 4 3 3 3 4 3 3 3 4
9786 195/300 Read block 413 len 20480
9787 196/300 Read block 2329 len 32768
9788 197/300 Read block 787 len 24576
9789 198/300 Read block 3575 len 28672
9790 199/300 Write block 2550 len 16384 data: 2 2 2 2
9791 200/300 Write block 2967 len 36864 data: 4 4 3 2 2 2 2 2 2
9792 201/300 Read block 3958 len 40960
9793 202/300 Flush
9794 203/300 Write block 2903 len 20480 data: 3 3 2 4 3
9795 204/300 Read block 4751 len 24576
9796 205/300 Write block 1589 len 16384 data: 4 4 4 4
9797 206/300 Read block 3992 len 8192
9798 207/300 Read block 2773 len 20480
9799 208/300 Write block 4579 len 32768 data: 3 2 2 2 2 2 2 2
9800 209/300 Write block 3861 len 36864 data: 4 4 4 4 4 4 3 2 2
9801 210/300 Flush
9802 211/300 Write block 3680 len 36864 data: 4 4 4 3 3 3 3 3 3
9803 212/300 Read block 1047 len 36864
9804 213/300 Read block 226 len 8192
9805 214/300 Write block 4044 len 16384 data: 4 4 4 3
9806 215/300 Read block 1506 len 8192
9807 216/300 Write block 1497 len 28672 data: 3 3 3 3 3 2 2
9808 217/300 Read block 3812 len 40960
9809 218/300 Write block 1139 len 16384 data: 3 3 3 2
9810 219/300 Read block 935 len 24576
9811 220/300 Read block 2443 len 12288
9812 221/300 Write block 434 len 24576 data: 2 2 2 3 3 3
9813 222/300 Write block 4357 len 24576 data: 3 3 3 3 3 3
9814 223/300 Read block 3417 len 20480
9815 224/300 Read block 1304 len 28672
9816 225/300 Write block 1440 len 24576 data: 4 4 4 2 3 4
9817 226/300 Read block 3343 len 28672
9818 227/300 Flush
9819 228/300 Write block 3683 len 40960 data: 4 4 4 4 4 4 2 2 2 2
9820 229/300 Write block 2068 len 20480 data: 4 4 2 2 2
9821 230/300 Read block 3721 len 36864
9822 231/300 Read block 1807 len 32768
9823 232/300 Read block 3558 len 24576
9824 233/300 Read block 1509 len 12288
9825 234/300 Write block 4691 len 20480 data: 2 2 2 2 2
9826 235/300 Read block 649 len 24576
9827 236/300 Flush
9828 237/300 Read block 3268 len 24576
9829 238/300 Read block 4366 len 20480
9830 239/300 Write block 1100 len 28672 data: 4 4 4 4 4 3 3
9831 240/300 Read block 571 len 8192
9832 241/300 Read block 1093 len 8192
9833 242/300 Read block 4710 len 16384
9834 243/300 Write block 4682 len 12288 data: 4 4 4
9835 244/300 Write block 3899 len 24576 data: 3 5 3 3 3 4
9836 245/300 Read block 3706 len 4096
9837 246/300 Write block 2625 len 20480 data: 3 3 3 3 3
9838 247/300 Write block 3487 len 32768 data: 3 3 4 5 4 4 4 5
9839 248/300 Read block 413 len 40960
9840 249/300 Write block 3187 len 40960 data: 2 2 2 2 2 2 2 2 2 2
9841 250/300 Read block 809 len 28672
9842 251/300 Read block 3607 len 28672
9843 252/300 Flush
9844 253/300 Read block 69 len 16384
9845 254/300 Read block 2359 len 40960
9846 255/300 Read block 4635 len 24576
9847 256/300 Read block 4798 len 24576
9848 257/300 Flush
9849 258/300 Write block 2982 len 20480 data: 3 3 3 4 4
9850 259/300 Read block 480 len 32768
9851 260/300 Read block 4645 len 20480
9852 261/300 Flush
9853 262/300 Read block 1820 len 4096
9854 263/300 Read block 1647 len 4096
9855 264/300 Read block 174 len 36864
9856 265/300 Write block 3388 len 16384 data: 2 2 2 3
9857 266/300 Write block 4606 len 12288 data: 2 2 2
9858 267/300 Write block 1826 len 40960 data: 3 3 3 3 2 2 2 2 2 3
9859 268/300 Read block 2552 len 8192
9860 269/300 Read block 4982 len 24576
9861 270/300 Write block 1041 len 28672 data: 3 3 3 3 3 3 3
9862 271/300 Read block 253 len 40960
9863 272/300 Read block 3498 len 40960
9864 273/300 Read block 574 len 24576
9865 274/300 Write block 2752 len 36864 data: 2 3 3 3 3 2 2 2 2
9866 275/300 Write block 4481 len 16384 data: 3 5 5 5
9867 276/300 Read block 3751 len 40960
9868 277/300 Write block 1304 len 36864 data: 4 5 5 4 4 3 3 3 3
9869 278/300 Write block 543 len 8192 data: 2 2
9870 279/300 Flush
9871 280/300 Read block 1095 len 12288
9872 281/300 Read block 4201 len 4096
9873 282/300 Flush
9874 283/300 Read block 725 len 36864
9875 284/300 Read block 4115 len 40960
9876 285/300 Read block 426 len 24576
9877 286/300 Flush
9878 287/300 Write block 964 len 24576 data: 4 4 3 2 2 2
9879 288/300 Read block 3104 len 32768
9880 289/300 Write block 3711 len 24576 data: 2 2 2 2 3 3
9881 290/300 Read block 3233 len 16384
9882 291/300 Flush
9883 292/300 Write block 3166 len 4096 data: 3
9884 293/300 Write block 814 len 8192 data: 2 3
9885 294/300 Read block 1991 len 28672
9886 295/300 Read block 2756 len 20480
9887 296/300 Read block 2036 len 8192
9888 297/300 Read block 3187 len 16384
9889 298/300 Read block 3306 len 12288
9890 299/300 Read block 1113 len 28672
9891 300/300 Read block 3414 len 20480
9892 Main task has work to do, go find it
9893 got dsc Start(0)
9894 start 0
9895 Apr 20 01:07:10.578 INFO request completed, latency_us: 199, response_code: 204, uri: /start/cid/0, method: POST, req_id: c895e16b-8d40-4a08-af66-1289341e7967, remote_addr: 127.0.0.1:60352, local_addr: 127.0.0.1:9998
9896 Replay: started 0, returned:Ok(())
9897 ----------------------------------------------------------------
9898 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:300
9899 States: Offline Active Active
9900 GW_ID ACK DSID TYPE BLOCKS DS:0 DS:1 DS:2 REPLAY
9901 2112 Acked 3111 Write 7 New Done Done false
9902 2113 Acked 3112 Read 4 New Done Done false
9903 2114 Acked 3113 Read 8 New Done Done false
9904 2115 Acked 3114 Write 3 New Done Done false
9905 2116 Acked 3115 Read 4 New Done Done false
9906 2117 Acked 3116 Read 4 New Done Done false
9907 2118 Acked 3117 Write 2 New Done Done false
9908 2119 Acked 3118 Read 2 New Done Done false
9909 2120 Acked 3119 Write 10 New Done Done false
9910 2121 Acked 3120 Write 2 New Done Done false
9911 2122 Acked 3121 Flush 0 New Done Done false
9912 2123 Acked 3122 Write 6 New Done Done false
9913 2124 Acked 3123 Write 5 New Done Done false
9914 2125 Acked 3124 Flush 0 New Done Done false
9915 2126 Acked 3125 Read 10 New Done Done false
9916 2127 Acked 3126 Read 8 New Done Done false
9917 2128 Acked 3127 Write 5 New Done Done false
9918 2129 Acked 3128 Read 1 New Done Done false
9919 2130 Acked 3129 Read 2 New Done Done false
9920 2131 Acked 3130 Read 4 New Done Done false
9921 2132 Acked 3131 Read 6 New Done Done false
9922 2133 Acked 3132 Read 10 New Done Done false
9923 2134 Acked 3133 Write 7 New Done Done false
9924 2135 Acked 3134 Read 8 New Done Done false
9925 2136 Acked 3135 Read 7 New Done Done false
9926 2137 Acked 3136 Read 6 New Done Done false
9927 2138 Acked 3137 Write 3 New Done Done false
9928 2139 Acked 3138 Write 1 New Done Done false
9929 2140 Acked 3139 Read 4 New Done Done false
9930 2141 Acked 3140 Write 10 New Done Done false
9931 2142 Acked 3141 Read 4 New Done Done false
9932 2143 Acked 3142 Flush 0 New Done Done false
9933 2144 Acked 3143 Write 2 New Done Done false
9934 2145 Acked 3144 Flush 0 New Done Done false
9935 2146 Acked 3145 Read 5 New Done Done false
9936 2147 Acked 3146 Write 3 New Done Done false
9937 2148 Acked 3147 Read 9 New Done Done false
9938 2149 Acked 3148 Write 3 New Done Done false
9939 2150 Acked 3149 Read 9 New Done Done false
9940 2151 Acked 3150 Write 6 New Done Done false
9941 2152 Acked 3151 Flush 0 New Done Done false
9942 2153 Acked 3152 Write 4 New Done Done false
9943 2154 Acked 3153 Write 6 New Done Done false
9944 2155 Acked 3154 Write 10 New Done Done false
9945 2156 Acked 3155 Write 7 New Done Done false
9946 2157 Acked 3156 Read 8 New Done Done false
9947 2158 Acked 3157 Read 4 New Done Done false
9948 2159 Acked 3158 Read 10 New Done Done false
9949 2160 Acked 3159 Read 9 New Done Done false
9950 2161 Acked 3160 Read 10 New Done Done false
9951 2162 Acked 3161 Write 8 New Done Done false
9952 2163 Acked 3162 Write 9 New Done Done false
9953 2164 Acked 3163 Write 2 New Done Done false
9954 2165 Acked 3164 Read 1 New Done Done false
9955 2166 Acked 3165 Flush 0 New Done Done false
9956 2167 Acked 3166 Write 7 New Done Done false
9957 2168 Acked 3167 Write 10 New Done Done false
9958 2169 Acked 3168 Read 1 New Done Done false
9959 2170 Acked 3169 Read 10 New Done Done false
9960 2171 Acked 3170 Read 9 New Done Done false
9961 2172 Acked 3171 Write 1 New Done Done false
9962 2173 Acked 3172 Read 8 New Done Done false
9963 2174 Acked 3173 Write 5 New Done Done false
9964 2175 Acked 3174 Flush 0 New Done Done false
9965 2176 Acked 3175 Read 8 New Done Done false
9966 2177 Acked 3176 Read 6 New Done Done false
9967 2178 Acked 3177 Write 10 New Done Done false
9968 2179 Acked 3178 Read 10 New Done Done false
9969 2180 Acked 3179 Read 3 New Done Done false
9970 2181 Acked 3180 Write 4 New Done Done false
9971 2182 Acked 3181 Read 4 New Done Done false
9972 2183 Acked 3182 Write 2 New Done Done false
9973 2184 Acked 3183 Read 7 New Done Done false
9974 2185 Acked 3184 Read 2 New Done Done false
9975 2186 Acked 3185 Flush 0 New Done Done false
9976 2187 Acked 3186 Read 2 New Done Done false
9977 2188 Acked 3187 Read 8 New Done Done false
9978 2189 Acked 3188 Read 6 New Done Done false
9979 2190 Acked 3189 Write 9 New Done Done false
9980 2191 Acked 3190 Read 10 New Done Done false
9981 2192 Acked 3191 Read 5 New Done Done false
9982 2193 Acked 3192 Read 9 New Done Done false
9983 2194 Acked 3193 Flush 0 New Done Done false
9984 2195 Acked 3194 Read 5 New Done Done false
9985 2196 Acked 3195 Write 4 New Done Done false
9986 2197 Acked 3196 Read 5 New Done Done false
9987 2198 Acked 3197 Read 4 New Done Done false
9988 2199 Acked 3198 Write 10 New Done Done false
9989 2200 Acked 3199 Read 10 New Done Done false
9990 2201 Acked 3200 Read 1 New Done Done false
9991 2202 Acked 3201 Write 10 New Done Done false
9992 2203 Acked 3202 Read 1 New Done Done false
9993 2204 Acked 3203 Write 8 New Done Done false
9994 2205 Acked 3204 Write 8 New Done Done false
9995 2206 Acked 3205 Read 6 New Done Done false
9996 2207 Acked 3206 Read 5 New Done Done false
9997 2208 Acked 3207 Write 10 New Done Done false
9998 2209 Acked 3208 Write 4 New Done Done false
9999 2210 Acked 3209 Read 10 New Done Done false
10000 2211 Acked 3210 Write 4 New Done Done false
10001 2212 Acked 3211 Read 2 New Done Done false
10002 2213 Acked 3212 Read 3 New Done Done false
10003 2214 Acked 3213 Write 1 New Done Done false
10004 2215 Acked 3214 Write 10 New Done Done false
10005 2216 Acked 3215 Read 10 New Done Done false
10006 2217 Acked 3216 Read 8 New Done Done false
10007 2218 Acked 3217 Write 5 New Done Done false
10008 2219 Acked 3218 Read 9 New Done Done false
10009 2220 Acked 3219 Write 1 New Done Done false
10010 2221 Acked 3220 Read 9 New Done Done false
10011 2222 Acked 3221 Write 9 New Done Done false
10012 2223 Acked 3222 Write 1 New Done Done false
10013 2224 Acked 3223 Read 4 New Done Done false
10014 2225 Acked 3224 Write 10 New Done Done false
10015 2226 Acked 3225 Read 3 New Done Done false
10016 2227 Acked 3226 Write 1 New Done Done false
10017 2228 Acked 3227 Read 4 New Done Done false
10018 2229 Acked 3228 Write 9 New Done Done false
10019 2230 Acked 3229 Flush 0 New Done Done false
10020 2231 Acked 3230 Read 9 New Done Done false
10021 2232 Acked 3231 Write 3 New Done Done false
10022 2233 Acked 3232 Read 5 New Done Done false
10023 2234 Acked 3233 Read 10 New Done Done false
10024 2235 Acked 3234 Write 1 New Done Done false
10025 2236 Acked 3235 Read 3 New Done Done false
10026 2237 Acked 3236 Write 5 New Done Done false
10027 2238 Acked 3237 Write 10 New Done Done false
10028 2239 Acked 3238 Read 2 New Done Done false
10029 2240 Acked 3239 Read 2 New Done Done false
10030 2241 Acked 3240 Read 1 New Done Done false
10031 2242 Acked 3241 Read 1 New Done Done false
10032 2243 Acked 3242 Read 5 New Done Done false
10033 2244 Acked 3243 Read 9 New Done Done false
10034 2245 Acked 3244 Read 10 New Done Done false
10035 2246 Acked 3245 Read 4 New Done Done false
10036 2247 Acked 3246 Write 1 New Done Done false
10037 2248 Acked 3247 Write 9 New Done Done false
10038 2249 Acked 3248 Write 6 New Done Done false
10039 2250 Acked 3249 Read 7 New Done Done false
10040 2251 Acked 3250 Read 3 New Done Done false
10041 2252 Acked 3251 Flush 0 New Done Done false
10042 2253 Acked 3252 Read 4 New Done Done false
10043 2254 Acked 3253 Read 4 New Done Done false
10044 2255 Acked 3254 Flush 0 New Done Done false
10045 2256 Acked 3255 Write 1 New Done Done false
10046 2257 Acked 3256 Write 2 New Done Done false
10047 2258 Acked 3257 Read 8 New Done Done false
10048 2259 Acked 3258 Write 10 New Done Done false
10049 2260 Acked 3259 Write 4 New Done Done false
10050 2261 Acked 3260 Write 5 New Done Done false
10051 2262 Acked 3261 Flush 0 New Done Done false
10052 2263 Acked 3262 Read 9 New Done Done false
10053 2264 Acked 3263 Flush 0 New Done Done false
10054 2265 Acked 3264 Read 2 New Done Done false
10055 2266 Acked 3265 Read 5 New Done Done false
10056 2267 Acked 3266 Read 3 New Done Done false
10057 2268 Acked 3267 Read 4 New Done Done false
10058 2269 Acked 3268 Flush 0 New Done Done false
10059 2270 Acked 3269 Write 3 New Done Done false
10060 2271 Acked 3270 Write 7 New Done Done false
10061 2272 Acked 3271 Read 5 New Done Done false
10062 2273 Acked 3272 Write 7 New Done Done false
10063 2274 Acked 3273 Write 1 New Done Done false
10064 2275 Acked 3274 Write 3 New Done Done false
10065 2276 Acked 3275 Write 7 New Done Done false
10066 2277 Acked 3276 Write 3 New Done Done false
10067 2278 Acked 3277 Read 2 New Done Done false
10068 2279 Acked 3278 Flush 0 New Done Done false
10069 2280 Acked 3279 Write 7 New Done Done false
10070 2281 Acked 3280 Flush 0 New Done Done false
10071 2282 Acked 3281 Write 3 New Done Done false
10072 2283 Acked 3282 Read 7 New Done Done false
10073 2284 Acked 3283 Read 7 New Done Done false
10074 2285 Acked 3284 Read 10 New Done Done false
10075 2286 Acked 3285 Flush 0 New Done Done false
10076 2287 Acked 3286 Read 6 New Done Done false
10077 2288 Acked 3287 Read 8 New Done Done false
10078 2289 Acked 3288 Flush 0 New Done Done false
10079 2290 Acked 3289 Write 8 New Done Done false
10080 2291 Acked 3290 Write 5 New Done Done false
10081 2292 Acked 3291 Write 7 New Done Done false
10082 2293 Acked 3292 Read 3 New Done Done false
10083 2294 Acked 3293 Write 1 New Done Done false
10084 2295 Acked 3294 Read 7 New Done Done false
10085 2296 Acked 3295 Flush 0 New Done Done false
10086 2297 Acked 3296 Write 3 New Done Done false
10087 2298 Acked 3297 Read 10 New Done Done false
10088 2299 Acked 3298 Write 2 New Done Done false
10089 2300 Acked 3299 Read 9 New Done Done false
10090 2301 Acked 3300 Write 3 New Done Done false
10091 2302 Acked 3301 Read 5 New Done Done false
10092 2303 Acked 3302 Write 2 New Done Done false
10093 2304 Acked 3303 Read 3 New Done Done false
10094 2305 Acked 3304 Write 9 New Done Done false
10095 2306 Acked 3305 Read 5 New Done Done false
10096 2307 Acked 3306 Read 8 New Done Done false
10097 2308 Acked 3307 Read 6 New Done Done false
10098 2309 Acked 3308 Read 7 New Done Done false
10099 2310 Acked 3309 Write 4 New Done Done false
10100 2311 Acked 3310 Write 9 New Done Done false
10101 2312 Acked 3311 Read 10 New Done Done false
10102 2313 Acked 3312 Flush 0 New Done Done false
10103 2314 Acked 3313 Write 5 New Done Done false
10104 2315 Acked 3314 Read 6 New Done Done false
10105 2316 Acked 3315 Write 4 New Done Done false
10106 2317 Acked 3316 Read 2 New Done Done false
10107 2318 Acked 3317 Read 5 New Done Done false
10108 2319 Acked 3318 Write 8 New Done Done false
10109 2320 Acked 3319 Write 9 New Done Done false
10110 2321 Acked 3320 Flush 0 New Done Done false
10111 2322 Acked 3321 Write 9 New Done Done false
10112 2323 Acked 3322 Read 9 New Done Done false
10113 2324 Acked 3323 Read 2 New Done Done false
10114 2325 Acked 3324 Write 4 New Done Done false
10115 2326 Acked 3325 Read 2 New Done Done false
10116 2327 Acked 3326 Write 7 New Done Done false
10117 2328 Acked 3327 Read 10 New Done Done false
10118 2329 Acked 3328 Write 4 New Done Done false
10119 2330 Acked 3329 Read 6 New Done Done false
10120 2331 Acked 3330 Read 3 New Done Done false
10121 2332 Acked 3331 Write 6 New Done Done false
10122 2333 Acked 3332 Write 6 New Done Done false
10123 2334 Acked 3333 Read 5 New Done Done false
10124 2335 Acked 3334 Read 7 New Done Done false
10125 2336 Acked 3335 Write 6 New Done Done false
10126 2337 Acked 3336 Read 7 New Done Done false
10127 2338 Acked 3337 Flush 0 New Done Done false
10128 2339 Acked 3338 Write 10 New Done Done false
10129 2340 Acked 3339 Write 5 New Done Done false
10130 2341 Acked 3340 Read 9 New Done Done false
10131 2342 Acked 3341 Read 8 New Done Done false
10132 2343 Acked 3342 Read 6 New Done Done false
10133 2344 Acked 3343 Read 3 New Done Done false
10134 2345 Acked 3344 Write 5 New Done Done false
10135 2346 Acked 3345 Read 6 New Done Done false
10136 2347 Acked 3346 Flush 0 New Done Done false
10137 2348 Acked 3347 Read 6 New Done Done false
10138 2349 Acked 3348 Read 5 New Done Done false
10139 2350 Acked 3349 Write 7 New Done Done false
10140 2351 Acked 3350 Read 2 New Done Done false
10141 2352 Acked 3351 Read 2 New Done Done false
10142 2353 Acked 3352 Read 4 New Done Done false
10143 2354 Acked 3353 Write 3 New Done Done false
10144 2355 Acked 3354 Write 6 New Done Done false
10145 2356 Acked 3355 Read 1 New Done Done false
10146 2357 Acked 3356 Write 5 New Done Done false
10147 2358 Acked 3357 Write 8 New Done Done false
10148 2359 Acked 3358 Read 10 New Done Done false
10149 2360 Acked 3359 Write 10 New Done Done false
10150 2361 Acked 3360 Read 7 New Done Done false
10151 2362 Acked 3361 Read 7 New Done Done false
10152 2363 Acked 3362 Flush 0 New Done Done false
10153 2364 Acked 3363 Read 4 New Done Done false
10154 2365 Acked 3364 Read 10 New Done Done false
10155 2366 Acked 3365 Read 6 New Done Done false
10156 2367 Acked 3366 Read 6 New Done Done false
10157 2368 Acked 3367 Flush 0 New Done Done false
10158 2369 Acked 3368 Write 5 New Done Done false
10159 2370 Acked 3369 Read 8 New Done Done false
10160 2371 Acked 3370 Read 5 New Done Done false
10161 2372 Acked 3371 Flush 0 New Done Done false
10162 2373 Acked 3372 Read 1 New Done Done false
10163 2374 Acked 3373 Read 1 New Done Done false
10164 2375 Acked 3374 Read 9 New Done Done false
10165 2376 Acked 3375 Write 4 New Done Done false
10166 2377 Acked 3376 Write 3 New Done Done false
10167 2378 Acked 3377 Write 10 New Done Done false
10168 2379 Acked 3378 Read 2 New Done Done false
10169 2380 Acked 3379 Read 6 New Done Done false
10170 2381 Acked 3380 Write 7 New Done Done false
10171 2382 Acked 3381 Read 10 New Done Done false
10172 2383 Acked 3382 Read 10 New Done Done false
10173 2384 Acked 3383 Read 6 New Done Done false
10174 2385 Acked 3384 Write 9 New Done Done false
10175 2386 Acked 3385 Write 4 New Done Done false
10176 2387 Acked 3386 Read 10 New Done Done false
10177 2388 Acked 3387 Write 9 New Done Done false
10178 2389 Acked 3388 Write 2 New Done Done false
10179 2390 Acked 3389 Flush 0 New Done Done false
10180 2391 Acked 3390 Read 3 New Done Done false
10181 2392 Acked 3391 Read 1 New Done Done false
10182 2393 Acked 3392 Flush 0 New Done Done false
10183 2394 Acked 3393 Read 9 New Done Done false
10184 2395 Acked 3394 Read 10 New Done Done false
10185 2396 Acked 3395 Read 6 New Done Done false
10186 2397 Acked 3396 Flush 0 New Done Done false
10187 2398 Acked 3397 Write 6 New Done Done false
10188 2399 Acked 3398 Read 8 New Done Done false
10189 2400 Acked 3399 Write 6 New Done Done false
10190 2401 Acked 3400 Read 4 New Done Done false
10191 2402 Acked 3401 Flush 0 New Done Done false
10192 2403 Acked 3402 Write 1 New Done Done false
10193 2404 Acked 3403 Write 2 New Done Done false
10194 2405 Acked 3404 Read 7 New Done Done false
10195 2406 Acked 3405 Read 5 New Done Done false
10196 2407 Acked 3406 Read 2 New Done Done false
10197 2408 Acked 3407 Read 4 New Done Done false
10198 2409 Acked 3408 Read 3 New Done Done false
10199 2410 Acked 3409 Read 7 New Done Done false
10200 2411 Acked 3410 Read 5 New Done Done false
10201 STATES DS:0 DS:1 DS:2 TOTAL
10202 New 300 0 0 300
10203 Sent 0 0 0 0
10204 Done 0 300 300 600
10205 Skipped 0 0 0 0
10206 Error 0 0 0 0
10207 Last Flush: 3110 3401 3401
10208 Downstairs last five completed: 3110 3109 3108 3107 3106
10209 Upstairs last five completed: 2411 2410 2409 2408 2407
10210 CLIENT: Up:0 ds:300 act:2
10211 ----------------------------------------------------------------
10212 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:301
10213 States: Offline Active Active
10214 GW_ID ACK DSID TYPE BLOCKS DS:0 DS:1 DS:2 REPLAY
10215 2112 Acked 3111 Write 7 New Done Done false
10216 2113 Acked 3112 Read 4 New Done Done false
10217 2114 Acked 3113 Read 8 New Done Done false
10218 2115 Acked 3114 Write 3 New Done Done false
10219 2116 Acked 3115 Read 4 New Done Done false
10220 2117 Acked 3116 Read 4 New Done Done false
10221 2118 Acked 3117 Write 2 New Done Done false
10222 2119 Acked 3118 Read 2 New Done Done false
10223 2120 Acked 3119 Write 10 New Done Done false
10224 2121 Acked 3120 Write 2 New Done Done false
10225 2122 Acked 3121 Flush 0 New Done Done false
10226 2123 Acked 3122 Write 6 New Done Done false
10227 2124 Acked 3123 Write 5 New Done Done false
10228 2125 Acked 3124 Flush 0 New Done Done false
10229 2126 Acked 3125 Read 10 New Done Done false
10230 2127 Acked 3126 Read 8 New Done Done false
10231 2128 Acked 3127 Write 5 New Done Done false
10232 2129 Acked 3128 Read 1 New Done Done false
10233 2130 Acked 3129 Read 2 New Done Done false
10234 2131 Acked 3130 Read 4 New Done Done false
10235 2132 Acked 3131 Read 6 New Done Done false
10236 2133 Acked 3132 Read 10 New Done Done false
10237 2134 Acked 3133 Write 7 New Done Done false
10238 2135 Acked 3134 Read 8 New Done Done false
10239 2136 Acked 3135 Read 7 New Done Done false
10240 2137 Acked 3136 Read 6 New Done Done false
10241 2138 Acked 3137 Write 3 New Done Done false
10242 2139 Acked 3138 Write 1 New Done Done false
10243 2140 Acked 3139 Read 4 New Done Done false
10244 2141 Acked 3140 Write 10 New Done Done false
10245 2142 Acked 3141 Read 4 New Done Done false
10246 2143 Acked 3142 Flush 0 New Done Done false
10247 2144 Acked 3143 Write 2 New Done Done false
10248 2145 Acked 3144 Flush 0 New Done Done false
10249 2146 Acked 3145 Read 5 New Done Done false
10250 2147 Acked 3146 Write 3 New Done Done false
10251 2148 Acked 3147 Read 9 New Done Done false
10252 2149 Acked 3148 Write 3 New Done Done false
10253 2150 Acked 3149 Read 9 New Done Done false
10254 2151 Acked 3150 Write 6 New Done Done false
10255 2152 Acked 3151 Flush 0 New Done Done false
10256 2153 Acked 3152 Write 4 New Done Done false
10257 2154 Acked 3153 Write 6 New Done Done false
10258 2155 Acked 3154 Write 10 New Done Done false
10259 2156 Acked 3155 Write 7 New Done Done false
10260 2157 Acked 3156 Read 8 New Done Done false
10261 2158 Acked 3157 Read 4 New Done Done false
10262 2159 Acked 3158 Read 10 New Done Done false
10263 2160 Acked 3159 Read 9 New Done Done false
10264 2161 Acked 3160 Read 10 New Done Done false
10265 2162 Acked 3161 Write 8 New Done Done false
10266 2163 Acked 3162 Write 9 New Done Done false
10267 2164 Acked 3163 Write 2 New Done Done false
10268 2165 Acked 3164 Read 1 New Done Done false
10269 2166 Acked 3165 Flush 0 New Done Done false
10270 2167 Acked 3166 Write 7 New Done Done false
10271 2168 Acked 3167 Write 10 New Done Done false
10272 2169 Acked 3168 Read 1 New Done Done false
10273 2170 Acked 3169 Read 10 New Done Done false
10274 2171 Acked 3170 Read 9 New Done Done false
10275 2172 Acked 3171 Write 1 New Done Done false
10276 2173 Acked 3172 Read 8 New Done Done false
10277 2174 Acked 3173 Write 5 New Done Done false
10278 2175 Acked 3174 Flush 0 New Done Done false
10279 2176 Acked 3175 Read 8 New Done Done false
10280 2177 Acked 3176 Read 6 New Done Done false
10281 2178 Acked 3177 Write 10 New Done Done false
10282 2179 Acked 3178 Read 10 New Done Done false
10283 2180 Acked 3179 Read 3 New Done Done false
10284 2181 Acked 3180 Write 4 New Done Done false
10285 2182 Acked 3181 Read 4 New Done Done false
10286 2183 Acked 3182 Write 2 New Done Done false
10287 2184 Acked 3183 Read 7 New Done Done false
10288 2185 Acked 3184 Read 2 New Done Done false
10289 2186 Acked 3185 Flush 0 New Done Done false
10290 2187 Acked 3186 Read 2 New Done Done false
10291 2188 Acked 3187 Read 8 New Done Done false
10292 2189 Acked 3188 Read 6 New Done Done false
10293 2190 Acked 3189 Write 9 New Done Done false
10294 2191 Acked 3190 Read 10 New Done Done false
10295 2192 Acked 3191 Read 5 New Done Done false
10296 2193 Acked 3192 Read 9 New Done Done false
10297 2194 Acked 3193 Flush 0 New Done Done false
10298 2195 Acked 3194 Read 5 New Done Done false
10299 2196 Acked 3195 Write 4 New Done Done false
10300 2197 Acked 3196 Read 5 New Done Done false
10301 2198 Acked 3197 Read 4 New Done Done false
10302 2199 Acked 3198 Write 10 New Done Done false
10303 2200 Acked 3199 Read 10 New Done Done false
10304 2201 Acked 3200 Read 1 New Done Done false
10305 2202 Acked 3201 Write 10 New Done Done false
10306 2203 Acked 3202 Read 1 New Done Done false
10307 2204 Acked 3203 Write 8 New Done Done false
10308 2205 Acked 3204 Write 8 New Done Done false
10309 2206 Acked 3205 Read 6 New Done Done false
10310 2207 Acked 3206 Read 5 New Done Done false
10311 2208 Acked 3207 Write 10 New Done Done false
10312 2209 Acked 3208 Write 4 New Done Done false
10313 2210 Acked 3209 Read 10 New Done Done false
10314 2211 Acked 3210 Write 4 New Done Done false
10315 2212 Acked 3211 Read 2 New Done Done false
10316 2213 Acked 3212 Read 3 New Done Done false
10317 2214 Acked 3213 Write 1 New Done Done false
10318 2215 Acked 3214 Write 10 New Done Done false
10319 2216 Acked 3215 Read 10 New Done Done false
10320 2217 Acked 3216 Read 8 New Done Done false
10321 2218 Acked 3217 Write 5 New Done Done false
10322 2219 Acked 3218 Read 9 New Done Done false
10323 2220 Acked 3219 Write 1 New Done Done false
10324 2221 Acked 3220 Read 9 New Done Done false
10325 2222 Acked 3221 Write 9 New Done Done false
10326 2223 Acked 3222 Write 1 New Done Done false
10327 2224 Acked 3223 Read 4 New Done Done false
10328 2225 Acked 3224 Write 10 New Done Done false
10329 2226 Acked 3225 Read 3 New Done Done false
10330 2227 Acked 3226 Write 1 New Done Done false
10331 2228 Acked 3227 Read 4 New Done Done false
10332 2229 Acked 3228 Write 9 New Done Done false
10333 2230 Acked 3229 Flush 0 New Done Done false
10334 2231 Acked 3230 Read 9 New Done Done false
10335 2232 Acked 3231 Write 3 New Done Done false
10336 2233 Acked 3232 Read 5 New Done Done false
10337 2234 Acked 3233 Read 10 New Done Done false
10338 2235 Acked 3234 Write 1 New Done Done false
10339 2236 Acked 3235 Read 3 New Done Done false
10340 2237 Acked 3236 Write 5 New Done Done false
10341 2238 Acked 3237 Write 10 New Done Done false
10342 2239 Acked 3238 Read 2 New Done Done false
10343 2240 Acked 3239 Read 2 New Done Done false
10344 2241 Acked 3240 Read 1 New Done Done false
10345 2242 Acked 3241 Read 1 New Done Done false
10346 2243 Acked 3242 Read 5 New Done Done false
10347 2244 Acked 3243 Read 9 New Done Done false
10348 2245 Acked 3244 Read 10 New Done Done false
10349 2246 Acked 3245 Read 4 New Done Done false
10350 2247 Acked 3246 Write 1 New Done Done false
10351 2248 Acked 3247 Write 9 New Done Done false
10352 2249 Acked 3248 Write 6 New Done Done false
10353 2250 Acked 3249 Read 7 New Done Done false
10354 2251 Acked 3250 Read 3 New Done Done false
10355 2252 Acked 3251 Flush 0 New Done Done false
10356 2253 Acked 3252 Read 4 New Done Done false
10357 2254 Acked 3253 Read 4 New Done Done false
10358 2255 Acked 3254 Flush 0 New Done Done false
10359 2256 Acked 3255 Write 1 New Done Done false
10360 2257 Acked 3256 Write 2 New Done Done false
10361 2258 Acked 3257 Read 8 New Done Done false
10362 2259 Acked 3258 Write 10 New Done Done false
10363 2260 Acked 3259 Write 4 New Done Done false
10364 2261 Acked 3260 Write 5 New Done Done false
10365 2262 Acked 3261 Flush 0 New Done Done false
10366 2263 Acked 3262 Read 9 New Done Done false
10367 2264 Acked 3263 Flush 0 New Done Done false
10368 2265 Acked 3264 Read 2 New Done Done false
10369 2266 Acked 3265 Read 5 New Done Done false
10370 2267 Acked 3266 Read 3 New Done Done false
10371 2268 Acked 3267 Read 4 New Done Done false
10372 2269 Acked 3268 Flush 0 New Done Done false
10373 2270 Acked 3269 Write 3 New Done Done false
10374 2271 Acked 3270 Write 7 New Done Done false
10375 2272 Acked 3271 Read 5 New Done Done false
10376 2273 Acked 3272 Write 7 New Done Done false
10377 2274 Acked 3273 Write 1 New Done Done false
10378 2275 Acked 3274 Write 3 New Done Done false
10379 2276 Acked 3275 Write 7 New Done Done false
10380 2277 Acked 3276 Write 3 New Done Done false
10381 2278 Acked 3277 Read 2 New Done Done false
10382 2279 Acked 3278 Flush 0 New Done Done false
10383 2280 Acked 3279 Write 7 New Done Done false
10384 2281 Acked 3280 Flush 0 New Done Done false
10385 2282 Acked 3281 Write 3 New Done Done false
10386 2283 Acked 3282 Read 7 New Done Done false
10387 2284 Acked 3283 Read 7 New Done Done false
10388 2285 Acked 3284 Read 10 New Done Done false
10389 2286 Acked 3285 Flush 0 New Done Done false
10390 2287 Acked 3286 Read 6 New Done Done false
10391 2288 Acked 3287 Read 8 New Done Done false
10392 2289 Acked 3288 Flush 0 New Done Done false
10393 2290 Acked 3289 Write 8 New Done Done false
10394 2291 Acked 3290 Write 5 New Done Done false
10395 2292 Acked 3291 Write 7 New Done Done false
10396 2293 Acked 3292 Read 3 New Done Done false
10397 2294 Acked 3293 Write 1 New Done Done false
10398 2295 Acked 3294 Read 7 New Done Done false
10399 2296 Acked 3295 Flush 0 New Done Done false
10400 2297 Acked 3296 Write 3 New Done Done false
10401 2298 Acked 3297 Read 10 New Done Done false
10402 2299 Acked 3298 Write 2 New Done Done false
10403 2300 Acked 3299 Read 9 New Done Done false
10404 2301 Acked 3300 Write 3 New Done Done false
10405 2302 Acked 3301 Read 5 New Done Done false
10406 2303 Acked 3302 Write 2 New Done Done false
10407 2304 Acked 3303 Read 3 New Done Done false
10408 2305 Acked 3304 Write 9 New Done Done false
10409 2306 Acked 3305 Read 5 New Done Done false
10410 2307 Acked 3306 Read 8 New Done Done false
10411 2308 Acked 3307 Read 6 New Done Done false
10412 2309 Acked 3308 Read 7 New Done Done false
10413 2310 Acked 3309 Write 4 New Done Done false
10414 2311 Acked 3310 Write 9 New Done Done false
10415 2312 Acked 3311 Read 10 New Done Done false
10416 2313 Acked 3312 Flush 0 New Done Done false
10417 2314 Acked 3313 Write 5 New Done Done false
10418 2315 Acked 3314 Read 6 New Done Done false
10419 2316 Acked 3315 Write 4 New Done Done false
10420 2317 Acked 3316 Read 2 New Done Done false
10421 2318 Acked 3317 Read 5 New Done Done false
10422 2319 Acked 3318 Write 8 New Done Done false
10423 2320 Acked 3319 Write 9 New Done Done false
10424 2321 Acked 3320 Flush 0 New Done Done false
10425 2322 Acked 3321 Write 9 New Done Done false
10426 2323 Acked 3322 Read 9 New Done Done false
10427 2324 Acked 3323 Read 2 New Done Done false
10428 2325 Acked 3324 Write 4 New Done Done false
10429 2326 Acked 3325 Read 2 New Done Done false
10430 2327 Acked 3326 Write 7 New Done Done false
10431 2328 Acked 3327 Read 10 New Done Done false
10432 2329 Acked 3328 Write 4 New Done Done false
10433 2330 Acked 3329 Read 6 New Done Done false
10434 2331 Acked 3330 Read 3 New Done Done false
10435 2332 Acked 3331 Write 6 New Done Done false
10436 2333 Acked 3332 Write 6 New Done Done false
10437 2334 Acked 3333 Read 5 New Done Done false
10438 2335 Acked 3334 Read 7 New Done Done false
10439 2336 Acked 3335 Write 6 New Done Done false
10440 2337 Acked 3336 Read 7 New Done Done false
10441 2338 Acked 3337 Flush 0 New Done Done false
10442 2339 Acked 3338 Write 10 New Done Done false
10443 2340 Acked 3339 Write 5 New Done Done false
10444 2341 Acked 3340 Read 9 New Done Done false
10445 2342 Acked 3341 Read 8 New Done Done false
10446 2343 Acked 3342 Read 6 New Done Done false
10447 2344 Acked 3343 Read 3 New Done Done false
10448 2345 Acked 3344 Write 5 New Done Done false
10449 2346 Acked 3345 Read 6 New Done Done false
10450 2347 Acked 3346 Flush 0 New Done Done false
10451 2348 Acked 3347 Read 6 New Done Done false
10452 2349 Acked 3348 Read 5 New Done Done false
10453 2350 Acked 3349 Write 7 New Done Done false
10454 2351 Acked 3350 Read 2 New Done Done false
10455 2352 Acked 3351 Read 2 New Done Done false
10456 2353 Acked 3352 Read 4 New Done Done false
10457 2354 Acked 3353 Write 3 New Done Done false
10458 2355 Acked 3354 Write 6 New Done Done false
10459 2356 Acked 3355 Read 1 New Done Done false
10460 2357 Acked 3356 Write 5 New Done Done false
10461 2358 Acked 3357 Write 8 New Done Done false
10462 2359 Acked 3358 Read 10 New Done Done false
10463 2360 Acked 3359 Write 10 New Done Done false
10464 2361 Acked 3360 Read 7 New Done Done false
10465 2362 Acked 3361 Read 7 New Done Done false
10466 2363 Acked 3362 Flush 0 New Done Done false
10467 2364 Acked 3363 Read 4 New Done Done false
10468 2365 Acked 3364 Read 10 New Done Done false
10469 2366 Acked 3365 Read 6 New Done Done false
10470 2367 Acked 3366 Read 6 New Done Done false
10471 2368 Acked 3367 Flush 0 New Done Done false
10472 2369 Acked 3368 Write 5 New Done Done false
10473 2370 Acked 3369 Read 8 New Done Done false
10474 2371 Acked 3370 Read 5 New Done Done false
10475 2372 Acked 3371 Flush 0 New Done Done false
10476 2373 Acked 3372 Read 1 New Done Done false
10477 2374 Acked 3373 Read 1 New Done Done false
10478 2375 Acked 3374 Read 9 New Done Done false
10479 2376 Acked 3375 Write 4 New Done Done false
10480 2377 Acked 3376 Write 3 New Done Done false
10481 2378 Acked 3377 Write 10 New Done Done false
10482 2379 Acked 3378 Read 2 New Done Done false
10483 2380 Acked 3379 Read 6 New Done Done false
10484 2381 Acked 3380 Write 7 New Done Done false
10485 2382 Acked 3381 Read 10 New Done Done false
10486 2383 Acked 3382 Read 10 New Done Done false
10487 2384 Acked 3383 Read 6 New Done Done false
10488 2385 Acked 3384 Write 9 New Done Done false
10489 2386 Acked 3385 Write 4 New Done Done false
10490 2387 Acked 3386 Read 10 New Done Done false
10491 2388 Acked 3387 Write 9 New Done Done false
10492 2389 Acked 3388 Write 2 New Done Done false
10493 2390 Acked 3389 Flush 0 New Done Done false
10494 2391 Acked 3390 Read 3 New Done Done false
10495 2392 Acked 3391 Read 1 New Done Done false
10496 2393 Acked 3392 Flush 0 New Done Done false
10497 2394 Acked 3393 Read 9 New Done Done false
10498 2395 Acked 3394 Read 10 New Done Done false
10499 2396 Acked 3395 Read 6 New Done Done false
10500 2397 Acked 3396 Flush 0 New Done Done false
10501 2398 Acked 3397 Write 6 New Done Done false
10502 2399 Acked 3398 Read 8 New Done Done false
10503 2400 Acked 3399 Write 6 New Done Done false
10504 2401 Acked 3400 Read 4 New Done Done false
10505 2402 Acked 3401 Flush 0 New Done Done false
10506 2403 Acked 3402 Write 1 New Done Done false
10507 2404 Acked 3403 Write 2 New Done Done false
10508 2405 Acked 3404 Read 7 New Done Done false
10509 2406 Acked 3405 Read 5 New Done Done false
10510 2407 Acked 3406 Read 2 New Done Done false
10511 2408 Acked 3407 Read 4 New Done Done false
10512 2409 Acked 3408 Read 3 New Done Done false
10513 2410 Acked 3409 Read 7 New Done Done false
10514 2411 Acked 3410 Read 5 New Done Done false
10515 2412 Acked 3411 Flush 0 New Done Done false
10516 STATES DS:0 DS:1 DS:2 TOTAL
10517 New 301 0 0 301
10518 Sent 0 0 0 0
10519 Done 0 301 301 602
10520 Skipped 0 0 0 0
10521 Error 0 0 0 0
10522 Last Flush: 3110 3411 3411
10523 Downstairs last five completed: 3110 3109 3108 3107 3106
10524 Upstairs last five completed: 2412 2411 2410 2409 2408
10525 CLIENT: Up:0 ds:301 act:2
105262024-04-20T01:07:16.268ZINFOcrucible: connecting to 127.0.0.1:8810 = io task client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
105272024-04-20T01:07:16.268ZWARNcrucible: ds_connection connect to 127.0.0.1:8810 failure: Os { code: 146, kind: ConnectionRefused, message: "Connection refused" } = io task client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
105282024-04-20T01:07:16.268ZWARNcrucible: client task is sending Done(ConnectionFailed(Os { code: 146, kind: ConnectionRefused, message: "Connection refused" })) = io task client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
105292024-04-20T01:07:16.269ZWARNcrucible: downstairs task for 0 stopped due to ConnectionFailed(Os { code: 146, kind: ConnectionRefused, message: "Connection refused" }) session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
105302024-04-20T01:07:16.269ZINFOcrucible: [0] client re-new 301 jobs since flush 3110 = downstairs session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
105312024-04-20T01:07:16.269ZINFOcrucible: [0] Marked 0 jobs for replay since flush: 3110 = downstairs session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
105322024-04-20T01:07:16.269ZINFOcrucible: client task is exiting = io task client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
10533 [8810] got start action
10534 [8810] I am going to restart
10535 Starting downstairs at port 8810
10536 Make output file at "/tmp/dsc/downstairs-8810.txt"
10537 [8810][0] reports Starting
10538 Downstairs /var/tmp/dsc/region/8810 port 8810 PID:Some(1204)
10539 [8810][0] reports Running
10540 ----------------------------------------------------------------
10541 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:301
10542 States: Offline Active Active
10543 GW_ID ACK DSID TYPE BLOCKS DS:0 DS:1 DS:2 REPLAY
10544 2112 Acked 3111 Write 7 New Done Done true
10545 2113 Acked 3112 Read 4 New Done Done true
10546 2114 Acked 3113 Read 8 New Done Done true
10547 2115 Acked 3114 Write 3 New Done Done true
10548 2116 Acked 3115 Read 4 New Done Done true
10549 2117 Acked 3116 Read 4 New Done Done true
10550 2118 Acked 3117 Write 2 New Done Done true
10551 2119 Acked 3118 Read 2 New Done Done true
10552 2120 Acked 3119 Write 10 New Done Done true
10553 2121 Acked 3120 Write 2 New Done Done true
10554 2122 Acked 3121 Flush 0 New Done Done true
10555 2123 Acked 3122 Write 6 New Done Done true
10556 2124 Acked 3123 Write 5 New Done Done true
10557 2125 Acked 3124 Flush 0 New Done Done true
10558 2126 Acked 3125 Read 10 New Done Done true
10559 2127 Acked 3126 Read 8 New Done Done true
10560 2128 Acked 3127 Write 5 New Done Done true
10561 2129 Acked 3128 Read 1 New Done Done true
10562 2130 Acked 3129 Read 2 New Done Done true
10563 2131 Acked 3130 Read 4 New Done Done true
10564 2132 Acked 3131 Read 6 New Done Done true
10565 2133 Acked 3132 Read 10 New Done Done true
10566 2134 Acked 3133 Write 7 New Done Done true
10567 2135 Acked 3134 Read 8 New Done Done true
10568 2136 Acked 3135 Read 7 New Done Done true
10569 2137 Acked 3136 Read 6 New Done Done true
10570 2138 Acked 3137 Write 3 New Done Done true
10571 2139 Acked 3138 Write 1 New Done Done true
10572 2140 Acked 3139 Read 4 New Done Done true
10573 2141 Acked 3140 Write 10 New Done Done true
10574 2142 Acked 3141 Read 4 New Done Done true
10575 2143 Acked 3142 Flush 0 New Done Done true
10576 2144 Acked 3143 Write 2 New Done Done true
10577 2145 Acked 3144 Flush 0 New Done Done true
10578 2146 Acked 3145 Read 5 New Done Done true
10579 2147 Acked 3146 Write 3 New Done Done true
10580 2148 Acked 3147 Read 9 New Done Done true
10581 2149 Acked 3148 Write 3 New Done Done true
10582 2150 Acked 3149 Read 9 New Done Done true
10583 2151 Acked 3150 Write 6 New Done Done true
10584 2152 Acked 3151 Flush 0 New Done Done true
10585 2153 Acked 3152 Write 4 New Done Done true
10586 2154 Acked 3153 Write 6 New Done Done true
10587 2155 Acked 3154 Write 10 New Done Done true
10588 2156 Acked 3155 Write 7 New Done Done true
10589 2157 Acked 3156 Read 8 New Done Done true
10590 2158 Acked 3157 Read 4 New Done Done true
10591 2159 Acked 3158 Read 10 New Done Done true
10592 2160 Acked 3159 Read 9 New Done Done true
10593 2161 Acked 3160 Read 10 New Done Done true
10594 2162 Acked 3161 Write 8 New Done Done true
10595 2163 Acked 3162 Write 9 New Done Done true
10596 2164 Acked 3163 Write 2 New Done Done true
10597 2165 Acked 3164 Read 1 New Done Done true
10598 2166 Acked 3165 Flush 0 New Done Done true
10599 2167 Acked 3166 Write 7 New Done Done true
10600 2168 Acked 3167 Write 10 New Done Done true
10601 2169 Acked 3168 Read 1 New Done Done true
10602 2170 Acked 3169 Read 10 New Done Done true
10603 2171 Acked 3170 Read 9 New Done Done true
10604 2172 Acked 3171 Write 1 New Done Done true
10605 2173 Acked 3172 Read 8 New Done Done true
10606 2174 Acked 3173 Write 5 New Done Done true
10607 2175 Acked 3174 Flush 0 New Done Done true
10608 2176 Acked 3175 Read 8 New Done Done true
10609 2177 Acked 3176 Read 6 New Done Done true
10610 2178 Acked 3177 Write 10 New Done Done true
10611 2179 Acked 3178 Read 10 New Done Done true
10612 2180 Acked 3179 Read 3 New Done Done true
10613 2181 Acked 3180 Write 4 New Done Done true
10614 2182 Acked 3181 Read 4 New Done Done true
10615 2183 Acked 3182 Write 2 New Done Done true
10616 2184 Acked 3183 Read 7 New Done Done true
10617 2185 Acked 3184 Read 2 New Done Done true
10618 2186 Acked 3185 Flush 0 New Done Done true
10619 2187 Acked 3186 Read 2 New Done Done true
10620 2188 Acked 3187 Read 8 New Done Done true
10621 2189 Acked 3188 Read 6 New Done Done true
10622 2190 Acked 3189 Write 9 New Done Done true
10623 2191 Acked 3190 Read 10 New Done Done true
10624 2192 Acked 3191 Read 5 New Done Done true
10625 2193 Acked 3192 Read 9 New Done Done true
10626 2194 Acked 3193 Flush 0 New Done Done true
10627 2195 Acked 3194 Read 5 New Done Done true
10628 2196 Acked 3195 Write 4 New Done Done true
10629 2197 Acked 3196 Read 5 New Done Done true
10630 2198 Acked 3197 Read 4 New Done Done true
10631 2199 Acked 3198 Write 10 New Done Done true
10632 2200 Acked 3199 Read 10 New Done Done true
10633 2201 Acked 3200 Read 1 New Done Done true
10634 2202 Acked 3201 Write 10 New Done Done true
10635 2203 Acked 3202 Read 1 New Done Done true
10636 2204 Acked 3203 Write 8 New Done Done true
10637 2205 Acked 3204 Write 8 New Done Done true
10638 2206 Acked 3205 Read 6 New Done Done true
10639 2207 Acked 3206 Read 5 New Done Done true
10640 2208 Acked 3207 Write 10 New Done Done true
10641 2209 Acked 3208 Write 4 New Done Done true
10642 2210 Acked 3209 Read 10 New Done Done true
10643 2211 Acked 3210 Write 4 New Done Done true
10644 2212 Acked 3211 Read 2 New Done Done true
10645 2213 Acked 3212 Read 3 New Done Done true
10646 2214 Acked 3213 Write 1 New Done Done true
10647 2215 Acked 3214 Write 10 New Done Done true
10648 2216 Acked 3215 Read 10 New Done Done true
10649 2217 Acked 3216 Read 8 New Done Done true
10650 2218 Acked 3217 Write 5 New Done Done true
10651 2219 Acked 3218 Read 9 New Done Done true
10652 2220 Acked 3219 Write 1 New Done Done true
10653 2221 Acked 3220 Read 9 New Done Done true
10654 2222 Acked 3221 Write 9 New Done Done true
10655 2223 Acked 3222 Write 1 New Done Done true
10656 2224 Acked 3223 Read 4 New Done Done true
10657 2225 Acked 3224 Write 10 New Done Done true
10658 2226 Acked 3225 Read 3 New Done Done true
10659 2227 Acked 3226 Write 1 New Done Done true
10660 2228 Acked 3227 Read 4 New Done Done true
10661 2229 Acked 3228 Write 9 New Done Done true
10662 2230 Acked 3229 Flush 0 New Done Done true
10663 2231 Acked 3230 Read 9 New Done Done true
10664 2232 Acked 3231 Write 3 New Done Done true
10665 2233 Acked 3232 Read 5 New Done Done true
10666 2234 Acked 3233 Read 10 New Done Done true
10667 2235 Acked 3234 Write 1 New Done Done true
10668 2236 Acked 3235 Read 3 New Done Done true
10669 2237 Acked 3236 Write 5 New Done Done true
10670 2238 Acked 3237 Write 10 New Done Done true
10671 2239 Acked 3238 Read 2 New Done Done true
10672 2240 Acked 3239 Read 2 New Done Done true
10673 2241 Acked 3240 Read 1 New Done Done true
10674 2242 Acked 3241 Read 1 New Done Done true
10675 2243 Acked 3242 Read 5 New Done Done true
10676 2244 Acked 3243 Read 9 New Done Done true
10677 2245 Acked 3244 Read 10 New Done Done true
10678 2246 Acked 3245 Read 4 New Done Done true
10679 2247 Acked 3246 Write 1 New Done Done true
10680 2248 Acked 3247 Write 9 New Done Done true
10681 2249 Acked 3248 Write 6 New Done Done true
10682 2250 Acked 3249 Read 7 New Done Done true
10683 2251 Acked 3250 Read 3 New Done Done true
10684 2252 Acked 3251 Flush 0 New Done Done true
10685 2253 Acked 3252 Read 4 New Done Done true
10686 2254 Acked 3253 Read 4 New Done Done true
10687 2255 Acked 3254 Flush 0 New Done Done true
10688 2256 Acked 3255 Write 1 New Done Done true
10689 2257 Acked 3256 Write 2 New Done Done true
10690 2258 Acked 3257 Read 8 New Done Done true
10691 2259 Acked 3258 Write 10 New Done Done true
10692 2260 Acked 3259 Write 4 New Done Done true
10693 2261 Acked 3260 Write 5 New Done Done true
10694 2262 Acked 3261 Flush 0 New Done Done true
10695 2263 Acked 3262 Read 9 New Done Done true
10696 2264 Acked 3263 Flush 0 New Done Done true
10697 2265 Acked 3264 Read 2 New Done Done true
10698 2266 Acked 3265 Read 5 New Done Done true
10699 2267 Acked 3266 Read 3 New Done Done true
10700 2268 Acked 3267 Read 4 New Done Done true
10701 2269 Acked 3268 Flush 0 New Done Done true
10702 2270 Acked 3269 Write 3 New Done Done true
10703 2271 Acked 3270 Write 7 New Done Done true
10704 2272 Acked 3271 Read 5 New Done Done true
10705 2273 Acked 3272 Write 7 New Done Done true
10706 2274 Acked 3273 Write 1 New Done Done true
10707 2275 Acked 3274 Write 3 New Done Done true
10708 2276 Acked 3275 Write 7 New Done Done true
10709 2277 Acked 3276 Write 3 New Done Done true
10710 2278 Acked 3277 Read 2 New Done Done true
10711 2279 Acked 3278 Flush 0 New Done Done true
10712 2280 Acked 3279 Write 7 New Done Done true
10713 2281 Acked 3280 Flush 0 New Done Done true
10714 2282 Acked 3281 Write 3 New Done Done true
10715 2283 Acked 3282 Read 7 New Done Done true
10716 2284 Acked 3283 Read 7 New Done Done true
10717 2285 Acked 3284 Read 10 New Done Done true
10718 2286 Acked 3285 Flush 0 New Done Done true
10719 2287 Acked 3286 Read 6 New Done Done true
10720 2288 Acked 3287 Read 8 New Done Done true
10721 2289 Acked 3288 Flush 0 New Done Done true
10722 2290 Acked 3289 Write 8 New Done Done true
10723 2291 Acked 3290 Write 5 New Done Done true
10724 2292 Acked 3291 Write 7 New Done Done true
10725 2293 Acked 3292 Read 3 New Done Done true
10726 2294 Acked 3293 Write 1 New Done Done true
10727 2295 Acked 3294 Read 7 New Done Done true
10728 2296 Acked 3295 Flush 0 New Done Done true
10729 2297 Acked 3296 Write 3 New Done Done true
10730 2298 Acked 3297 Read 10 New Done Done true
10731 2299 Acked 3298 Write 2 New Done Done true
10732 2300 Acked 3299 Read 9 New Done Done true
10733 2301 Acked 3300 Write 3 New Done Done true
10734 2302 Acked 3301 Read 5 New Done Done true
10735 2303 Acked 3302 Write 2 New Done Done true
10736 2304 Acked 3303 Read 3 New Done Done true
10737 2305 Acked 3304 Write 9 New Done Done true
10738 2306 Acked 3305 Read 5 New Done Done true
10739 2307 Acked 3306 Read 8 New Done Done true
10740 2308 Acked 3307 Read 6 New Done Done true
10741 2309 Acked 3308 Read 7 New Done Done true
10742 2310 Acked 3309 Write 4 New Done Done true
10743 2311 Acked 3310 Write 9 New Done Done true
10744 2312 Acked 3311 Read 10 New Done Done true
10745 2313 Acked 3312 Flush 0 New Done Done true
10746 2314 Acked 3313 Write 5 New Done Done true
10747 2315 Acked 3314 Read 6 New Done Done true
10748 2316 Acked 3315 Write 4 New Done Done true
10749 2317 Acked 3316 Read 2 New Done Done true
10750 2318 Acked 3317 Read 5 New Done Done true
10751 2319 Acked 3318 Write 8 New Done Done true
10752 2320 Acked 3319 Write 9 New Done Done true
10753 2321 Acked 3320 Flush 0 New Done Done true
10754 2322 Acked 3321 Write 9 New Done Done true
10755 2323 Acked 3322 Read 9 New Done Done true
10756 2324 Acked 3323 Read 2 New Done Done true
10757 2325 Acked 3324 Write 4 New Done Done true
10758 2326 Acked 3325 Read 2 New Done Done true
10759 2327 Acked 3326 Write 7 New Done Done true
10760 2328 Acked 3327 Read 10 New Done Done true
10761 2329 Acked 3328 Write 4 New Done Done true
10762 2330 Acked 3329 Read 6 New Done Done true
10763 2331 Acked 3330 Read 3 New Done Done true
10764 2332 Acked 3331 Write 6 New Done Done true
10765 2333 Acked 3332 Write 6 New Done Done true
10766 2334 Acked 3333 Read 5 New Done Done true
10767 2335 Acked 3334 Read 7 New Done Done true
10768 2336 Acked 3335 Write 6 New Done Done true
10769 2337 Acked 3336 Read 7 New Done Done true
10770 2338 Acked 3337 Flush 0 New Done Done true
10771 2339 Acked 3338 Write 10 New Done Done true
10772 2340 Acked 3339 Write 5 New Done Done true
10773 2341 Acked 3340 Read 9 New Done Done true
10774 2342 Acked 3341 Read 8 New Done Done true
10775 2343 Acked 3342 Read 6 New Done Done true
10776 2344 Acked 3343 Read 3 New Done Done true
10777 2345 Acked 3344 Write 5 New Done Done true
10778 2346 Acked 3345 Read 6 New Done Done true
10779 2347 Acked 3346 Flush 0 New Done Done true
10780 2348 Acked 3347 Read 6 New Done Done true
10781 2349 Acked 3348 Read 5 New Done Done true
10782 2350 Acked 3349 Write 7 New Done Done true
10783 2351 Acked 3350 Read 2 New Done Done true
10784 2352 Acked 3351 Read 2 New Done Done true
10785 2353 Acked 3352 Read 4 New Done Done true
10786 2354 Acked 3353 Write 3 New Done Done true
10787 2355 Acked 3354 Write 6 New Done Done true
10788 2356 Acked 3355 Read 1 New Done Done true
10789 2357 Acked 3356 Write 5 New Done Done true
10790 2358 Acked 3357 Write 8 New Done Done true
10791 2359 Acked 3358 Read 10 New Done Done true
10792 2360 Acked 3359 Write 10 New Done Done true
10793 2361 Acked 3360 Read 7 New Done Done true
10794 2362 Acked 3361 Read 7 New Done Done true
10795 2363 Acked 3362 Flush 0 New Done Done true
10796 2364 Acked 3363 Read 4 New Done Done true
10797 2365 Acked 3364 Read 10 New Done Done true
10798 2366 Acked 3365 Read 6 New Done Done true
10799 2367 Acked 3366 Read 6 New Done Done true
10800 2368 Acked 3367 Flush 0 New Done Done true
10801 2369 Acked 3368 Write 5 New Done Done true
10802 2370 Acked 3369 Read 8 New Done Done true
10803 2371 Acked 3370 Read 5 New Done Done true
10804 2372 Acked 3371 Flush 0 New Done Done true
10805 2373 Acked 3372 Read 1 New Done Done true
10806 2374 Acked 3373 Read 1 New Done Done true
10807 2375 Acked 3374 Read 9 New Done Done true
10808 2376 Acked 3375 Write 4 New Done Done true
10809 2377 Acked 3376 Write 3 New Done Done true
10810 2378 Acked 3377 Write 10 New Done Done true
10811 2379 Acked 3378 Read 2 New Done Done true
10812 2380 Acked 3379 Read 6 New Done Done true
10813 2381 Acked 3380 Write 7 New Done Done true
10814 2382 Acked 3381 Read 10 New Done Done true
10815 2383 Acked 3382 Read 10 New Done Done true
10816 2384 Acked 3383 Read 6 New Done Done true
10817 2385 Acked 3384 Write 9 New Done Done true
10818 2386 Acked 3385 Write 4 New Done Done true
10819 2387 Acked 3386 Read 10 New Done Done true
10820 2388 Acked 3387 Write 9 New Done Done true
10821 2389 Acked 3388 Write 2 New Done Done true
10822 2390 Acked 3389 Flush 0 New Done Done true
10823 2391 Acked 3390 Read 3 New Done Done true
10824 2392 Acked 3391 Read 1 New Done Done true
10825 2393 Acked 3392 Flush 0 New Done Done true
10826 2394 Acked 3393 Read 9 New Done Done true
10827 2395 Acked 3394 Read 10 New Done Done true
10828 2396 Acked 3395 Read 6 New Done Done true
10829 2397 Acked 3396 Flush 0 New Done Done true
10830 2398 Acked 3397 Write 6 New Done Done true
10831 2399 Acked 3398 Read 8 New Done Done true
10832 2400 Acked 3399 Write 6 New Done Done true
10833 2401 Acked 3400 Read 4 New Done Done true
10834 2402 Acked 3401 Flush 0 New Done Done true
10835 2403 Acked 3402 Write 1 New Done Done true
10836 2404 Acked 3403 Write 2 New Done Done true
10837 2405 Acked 3404 Read 7 New Done Done true
10838 2406 Acked 3405 Read 5 New Done Done true
10839 2407 Acked 3406 Read 2 New Done Done true
10840 2408 Acked 3407 Read 4 New Done Done true
10841 2409 Acked 3408 Read 3 New Done Done true
10842 2410 Acked 3409 Read 7 New Done Done true
10843 2411 Acked 3410 Read 5 New Done Done true
10844 2412 Acked 3411 Flush 0 New Done Done true
10845 STATES DS:0 DS:1 DS:2 TOTAL
10846 New 301 0 0 301
10847 Sent 0 0 0 0
10848 Done 0 301 301 602
10849 Skipped 0 0 0 0
10850 Error 0 0 0 0
10851 Last Flush: 3110 3411 3411
10852 Downstairs last five completed: 3110 3109 3108 3107 3106
10853 Upstairs last five completed: 2412 2411 2410 2409 2408
10854 CLIENT: Up:0 ds:301 act:2
10855 ----------------------------------------------------------------
10856 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:301
10857 States: Offline Active Active
10858 GW_ID ACK DSID TYPE BLOCKS DS:0 DS:1 DS:2 REPLAY
10859 2112 Acked 3111 Write 7 New Done Done true
10860 2113 Acked 3112 Read 4 New Done Done true
10861 2114 Acked 3113 Read 8 New Done Done true
10862 2115 Acked 3114 Write 3 New Done Done true
10863 2116 Acked 3115 Read 4 New Done Done true
10864 2117 Acked 3116 Read 4 New Done Done true
10865 2118 Acked 3117 Write 2 New Done Done true
10866 2119 Acked 3118 Read 2 New Done Done true
10867 2120 Acked 3119 Write 10 New Done Done true
10868 2121 Acked 3120 Write 2 New Done Done true
10869 2122 Acked 3121 Flush 0 New Done Done true
10870 2123 Acked 3122 Write 6 New Done Done true
10871 2124 Acked 3123 Write 5 New Done Done true
10872 2125 Acked 3124 Flush 0 New Done Done true
10873 2126 Acked 3125 Read 10 New Done Done true
10874 2127 Acked 3126 Read 8 New Done Done true
10875 2128 Acked 3127 Write 5 New Done Done true
10876 2129 Acked 3128 Read 1 New Done Done true
10877 2130 Acked 3129 Read 2 New Done Done true
10878 2131 Acked 3130 Read 4 New Done Done true
10879 2132 Acked 3131 Read 6 New Done Done true
10880 2133 Acked 3132 Read 10 New Done Done true
10881 2134 Acked 3133 Write 7 New Done Done true
10882 2135 Acked 3134 Read 8 New Done Done true
10883 2136 Acked 3135 Read 7 New Done Done true
10884 2137 Acked 3136 Read 6 New Done Done true
10885 2138 Acked 3137 Write 3 New Done Done true
10886 2139 Acked 3138 Write 1 New Done Done true
10887 2140 Acked 3139 Read 4 New Done Done true
10888 2141 Acked 3140 Write 10 New Done Done true
10889 2142 Acked 3141 Read 4 New Done Done true
10890 2143 Acked 3142 Flush 0 New Done Done true
10891 2144 Acked 3143 Write 2 New Done Done true
10892 2145 Acked 3144 Flush 0 New Done Done true
10893 2146 Acked 3145 Read 5 New Done Done true
10894 2147 Acked 3146 Write 3 New Done Done true
10895 2148 Acked 3147 Read 9 New Done Done true
10896 2149 Acked 3148 Write 3 New Done Done true
10897 2150 Acked 3149 Read 9 New Done Done true
10898 2151 Acked 3150 Write 6 New Done Done true
10899 2152 Acked 3151 Flush 0 New Done Done true
10900 2153 Acked 3152 Write 4 New Done Done true
10901 2154 Acked 3153 Write 6 New Done Done true
10902 2155 Acked 3154 Write 10 New Done Done true
10903 2156 Acked 3155 Write 7 New Done Done true
10904 2157 Acked 3156 Read 8 New Done Done true
10905 2158 Acked 3157 Read 4 New Done Done true
10906 2159 Acked 3158 Read 10 New Done Done true
10907 2160 Acked 3159 Read 9 New Done Done true
10908 2161 Acked 3160 Read 10 New Done Done true
10909 2162 Acked 3161 Write 8 New Done Done true
10910 2163 Acked 3162 Write 9 New Done Done true
10911 2164 Acked 3163 Write 2 New Done Done true
10912 2165 Acked 3164 Read 1 New Done Done true
10913 2166 Acked 3165 Flush 0 New Done Done true
10914 2167 Acked 3166 Write 7 New Done Done true
10915 2168 Acked 3167 Write 10 New Done Done true
10916 2169 Acked 3168 Read 1 New Done Done true
10917 2170 Acked 3169 Read 10 New Done Done true
10918 2171 Acked 3170 Read 9 New Done Done true
10919 2172 Acked 3171 Write 1 New Done Done true
10920 2173 Acked 3172 Read 8 New Done Done true
10921 2174 Acked 3173 Write 5 New Done Done true
10922 2175 Acked 3174 Flush 0 New Done Done true
10923 2176 Acked 3175 Read 8 New Done Done true
10924 2177 Acked 3176 Read 6 New Done Done true
10925 2178 Acked 3177 Write 10 New Done Done true
10926 2179 Acked 3178 Read 10 New Done Done true
10927 2180 Acked 3179 Read 3 New Done Done true
10928 2181 Acked 3180 Write 4 New Done Done true
10929 2182 Acked 3181 Read 4 New Done Done true
10930 2183 Acked 3182 Write 2 New Done Done true
10931 2184 Acked 3183 Read 7 New Done Done true
10932 2185 Acked 3184 Read 2 New Done Done true
10933 2186 Acked 3185 Flush 0 New Done Done true
10934 2187 Acked 3186 Read 2 New Done Done true
10935 2188 Acked 3187 Read 8 New Done Done true
10936 2189 Acked 3188 Read 6 New Done Done true
10937 2190 Acked 3189 Write 9 New Done Done true
10938 2191 Acked 3190 Read 10 New Done Done true
10939 2192 Acked 3191 Read 5 New Done Done true
10940 2193 Acked 3192 Read 9 New Done Done true
10941 2194 Acked 3193 Flush 0 New Done Done true
10942 2195 Acked 3194 Read 5 New Done Done true
10943 2196 Acked 3195 Write 4 New Done Done true
10944 2197 Acked 3196 Read 5 New Done Done true
10945 2198 Acked 3197 Read 4 New Done Done true
10946 2199 Acked 3198 Write 10 New Done Done true
10947 2200 Acked 3199 Read 10 New Done Done true
10948 2201 Acked 3200 Read 1 New Done Done true
10949 2202 Acked 3201 Write 10 New Done Done true
10950 2203 Acked 3202 Read 1 New Done Done true
10951 2204 Acked 3203 Write 8 New Done Done true
10952 2205 Acked 3204 Write 8 New Done Done true
10953 2206 Acked 3205 Read 6 New Done Done true
10954 2207 Acked 3206 Read 5 New Done Done true
10955 2208 Acked 3207 Write 10 New Done Done true
10956 2209 Acked 3208 Write 4 New Done Done true
10957 2210 Acked 3209 Read 10 New Done Done true
10958 2211 Acked 3210 Write 4 New Done Done true
10959 2212 Acked 3211 Read 2 New Done Done true
10960 2213 Acked 3212 Read 3 New Done Done true
10961 2214 Acked 3213 Write 1 New Done Done true
10962 2215 Acked 3214 Write 10 New Done Done true
10963 2216 Acked 3215 Read 10 New Done Done true
10964 2217 Acked 3216 Read 8 New Done Done true
10965 2218 Acked 3217 Write 5 New Done Done true
10966 2219 Acked 3218 Read 9 New Done Done true
10967 2220 Acked 3219 Write 1 New Done Done true
10968 2221 Acked 3220 Read 9 New Done Done true
10969 2222 Acked 3221 Write 9 New Done Done true
10970 2223 Acked 3222 Write 1 New Done Done true
10971 2224 Acked 3223 Read 4 New Done Done true
10972 2225 Acked 3224 Write 10 New Done Done true
10973 2226 Acked 3225 Read 3 New Done Done true
10974 2227 Acked 3226 Write 1 New Done Done true
10975 2228 Acked 3227 Read 4 New Done Done true
10976 2229 Acked 3228 Write 9 New Done Done true
10977 2230 Acked 3229 Flush 0 New Done Done true
10978 2231 Acked 3230 Read 9 New Done Done true
10979 2232 Acked 3231 Write 3 New Done Done true
10980 2233 Acked 3232 Read 5 New Done Done true
10981 2234 Acked 3233 Read 10 New Done Done true
10982 2235 Acked 3234 Write 1 New Done Done true
10983 2236 Acked 3235 Read 3 New Done Done true
10984 2237 Acked 3236 Write 5 New Done Done true
10985 2238 Acked 3237 Write 10 New Done Done true
10986 2239 Acked 3238 Read 2 New Done Done true
10987 2240 Acked 3239 Read 2 New Done Done true
10988 2241 Acked 3240 Read 1 New Done Done true
10989 2242 Acked 3241 Read 1 New Done Done true
10990 2243 Acked 3242 Read 5 New Done Done true
10991 2244 Acked 3243 Read 9 New Done Done true
10992 2245 Acked 3244 Read 10 New Done Done true
10993 2246 Acked 3245 Read 4 New Done Done true
10994 2247 Acked 3246 Write 1 New Done Done true
10995 2248 Acked 3247 Write 9 New Done Done true
10996 2249 Acked 3248 Write 6 New Done Done true
10997 2250 Acked 3249 Read 7 New Done Done true
10998 2251 Acked 3250 Read 3 New Done Done true
10999 2252 Acked 3251 Flush 0 New Done Done true
11000 2253 Acked 3252 Read 4 New Done Done true
11001 2254 Acked 3253 Read 4 New Done Done true
11002 2255 Acked 3254 Flush 0 New Done Done true
11003 2256 Acked 3255 Write 1 New Done Done true
11004 2257 Acked 3256 Write 2 New Done Done true
11005 2258 Acked 3257 Read 8 New Done Done true
11006 2259 Acked 3258 Write 10 New Done Done true
11007 2260 Acked 3259 Write 4 New Done Done true
11008 2261 Acked 3260 Write 5 New Done Done true
11009 2262 Acked 3261 Flush 0 New Done Done true
11010 2263 Acked 3262 Read 9 New Done Done true
11011 2264 Acked 3263 Flush 0 New Done Done true
11012 2265 Acked 3264 Read 2 New Done Done true
11013 2266 Acked 3265 Read 5 New Done Done true
11014 2267 Acked 3266 Read 3 New Done Done true
11015 2268 Acked 3267 Read 4 New Done Done true
11016 2269 Acked 3268 Flush 0 New Done Done true
11017 2270 Acked 3269 Write 3 New Done Done true
11018 2271 Acked 3270 Write 7 New Done Done true
11019 2272 Acked 3271 Read 5 New Done Done true
11020 2273 Acked 3272 Write 7 New Done Done true
11021 2274 Acked 3273 Write 1 New Done Done true
11022 2275 Acked 3274 Write 3 New Done Done true
11023 2276 Acked 3275 Write 7 New Done Done true
11024 2277 Acked 3276 Write 3 New Done Done true
11025 2278 Acked 3277 Read 2 New Done Done true
11026 2279 Acked 3278 Flush 0 New Done Done true
11027 2280 Acked 3279 Write 7 New Done Done true
11028 2281 Acked 3280 Flush 0 New Done Done true
11029 2282 Acked 3281 Write 3 New Done Done true
11030 2283 Acked 3282 Read 7 New Done Done true
11031 2284 Acked 3283 Read 7 New Done Done true
11032 2285 Acked 3284 Read 10 New Done Done true
11033 2286 Acked 3285 Flush 0 New Done Done true
11034 2287 Acked 3286 Read 6 New Done Done true
11035 2288 Acked 3287 Read 8 New Done Done true
11036 2289 Acked 3288 Flush 0 New Done Done true
11037 2290 Acked 3289 Write 8 New Done Done true
11038 2291 Acked 3290 Write 5 New Done Done true
11039 2292 Acked 3291 Write 7 New Done Done true
11040 2293 Acked 3292 Read 3 New Done Done true
11041 2294 Acked 3293 Write 1 New Done Done true
11042 2295 Acked 3294 Read 7 New Done Done true
11043 2296 Acked 3295 Flush 0 New Done Done true
11044 2297 Acked 3296 Write 3 New Done Done true
11045 2298 Acked 3297 Read 10 New Done Done true
11046 2299 Acked 3298 Write 2 New Done Done true
11047 2300 Acked 3299 Read 9 New Done Done true
11048 2301 Acked 3300 Write 3 New Done Done true
11049 2302 Acked 3301 Read 5 New Done Done true
11050 2303 Acked 3302 Write 2 New Done Done true
11051 2304 Acked 3303 Read 3 New Done Done true
11052 2305 Acked 3304 Write 9 New Done Done true
11053 2306 Acked 3305 Read 5 New Done Done true
11054 2307 Acked 3306 Read 8 New Done Done true
11055 2308 Acked 3307 Read 6 New Done Done true
11056 2309 Acked 3308 Read 7 New Done Done true
11057 2310 Acked 3309 Write 4 New Done Done true
11058 2311 Acked 3310 Write 9 New Done Done true
11059 2312 Acked 3311 Read 10 New Done Done true
11060 2313 Acked 3312 Flush 0 New Done Done true
11061 2314 Acked 3313 Write 5 New Done Done true
11062 2315 Acked 3314 Read 6 New Done Done true
11063 2316 Acked 3315 Write 4 New Done Done true
11064 2317 Acked 3316 Read 2 New Done Done true
11065 2318 Acked 3317 Read 5 New Done Done true
11066 2319 Acked 3318 Write 8 New Done Done true
11067 2320 Acked 3319 Write 9 New Done Done true
11068 2321 Acked 3320 Flush 0 New Done Done true
11069 2322 Acked 3321 Write 9 New Done Done true
11070 2323 Acked 3322 Read 9 New Done Done true
11071 2324 Acked 3323 Read 2 New Done Done true
11072 2325 Acked 3324 Write 4 New Done Done true
11073 2326 Acked 3325 Read 2 New Done Done true
11074 2327 Acked 3326 Write 7 New Done Done true
11075 2328 Acked 3327 Read 10 New Done Done true
11076 2329 Acked 3328 Write 4 New Done Done true
11077 2330 Acked 3329 Read 6 New Done Done true
11078 2331 Acked 3330 Read 3 New Done Done true
11079 2332 Acked 3331 Write 6 New Done Done true
11080 2333 Acked 3332 Write 6 New Done Done true
11081 2334 Acked 3333 Read 5 New Done Done true
11082 2335 Acked 3334 Read 7 New Done Done true
11083 2336 Acked 3335 Write 6 New Done Done true
11084 2337 Acked 3336 Read 7 New Done Done true
11085 2338 Acked 3337 Flush 0 New Done Done true
11086 2339 Acked 3338 Write 10 New Done Done true
11087 2340 Acked 3339 Write 5 New Done Done true
11088 2341 Acked 3340 Read 9 New Done Done true
11089 2342 Acked 3341 Read 8 New Done Done true
11090 2343 Acked 3342 Read 6 New Done Done true
11091 2344 Acked 3343 Read 3 New Done Done true
11092 2345 Acked 3344 Write 5 New Done Done true
11093 2346 Acked 3345 Read 6 New Done Done true
11094 2347 Acked 3346 Flush 0 New Done Done true
11095 2348 Acked 3347 Read 6 New Done Done true
11096 2349 Acked 3348 Read 5 New Done Done true
11097 2350 Acked 3349 Write 7 New Done Done true
11098 2351 Acked 3350 Read 2 New Done Done true
11099 2352 Acked 3351 Read 2 New Done Done true
11100 2353 Acked 3352 Read 4 New Done Done true
11101 2354 Acked 3353 Write 3 New Done Done true
11102 2355 Acked 3354 Write 6 New Done Done true
11103 2356 Acked 3355 Read 1 New Done Done true
11104 2357 Acked 3356 Write 5 New Done Done true
11105 2358 Acked 3357 Write 8 New Done Done true
11106 2359 Acked 3358 Read 10 New Done Done true
11107 2360 Acked 3359 Write 10 New Done Done true
11108 2361 Acked 3360 Read 7 New Done Done true
11109 2362 Acked 3361 Read 7 New Done Done true
11110 2363 Acked 3362 Flush 0 New Done Done true
11111 2364 Acked 3363 Read 4 New Done Done true
11112 2365 Acked 3364 Read 10 New Done Done true
11113 2366 Acked 3365 Read 6 New Done Done true
11114 2367 Acked 3366 Read 6 New Done Done true
11115 2368 Acked 3367 Flush 0 New Done Done true
11116 2369 Acked 3368 Write 5 New Done Done true
11117 2370 Acked 3369 Read 8 New Done Done true
11118 2371 Acked 3370 Read 5 New Done Done true
11119 2372 Acked 3371 Flush 0 New Done Done true
11120 2373 Acked 3372 Read 1 New Done Done true
11121 2374 Acked 3373 Read 1 New Done Done true
11122 2375 Acked 3374 Read 9 New Done Done true
11123 2376 Acked 3375 Write 4 New Done Done true
11124 2377 Acked 3376 Write 3 New Done Done true
11125 2378 Acked 3377 Write 10 New Done Done true
11126 2379 Acked 3378 Read 2 New Done Done true
11127 2380 Acked 3379 Read 6 New Done Done true
11128 2381 Acked 3380 Write 7 New Done Done true
11129 2382 Acked 3381 Read 10 New Done Done true
11130 2383 Acked 3382 Read 10 New Done Done true
11131 2384 Acked 3383 Read 6 New Done Done true
11132 2385 Acked 3384 Write 9 New Done Done true
11133 2386 Acked 3385 Write 4 New Done Done true
11134 2387 Acked 3386 Read 10 New Done Done true
11135 2388 Acked 3387 Write 9 New Done Done true
11136 2389 Acked 3388 Write 2 New Done Done true
11137 2390 Acked 3389 Flush 0 New Done Done true
11138 2391 Acked 3390 Read 3 New Done Done true
11139 2392 Acked 3391 Read 1 New Done Done true
11140 2393 Acked 3392 Flush 0 New Done Done true
11141 2394 Acked 3393 Read 9 New Done Done true
11142 2395 Acked 3394 Read 10 New Done Done true
11143 2396 Acked 3395 Read 6 New Done Done true
11144 2397 Acked 3396 Flush 0 New Done Done true
11145 2398 Acked 3397 Write 6 New Done Done true
11146 2399 Acked 3398 Read 8 New Done Done true
11147 2400 Acked 3399 Write 6 New Done Done true
11148 2401 Acked 3400 Read 4 New Done Done true
11149 2402 Acked 3401 Flush 0 New Done Done true
11150 2403 Acked 3402 Write 1 New Done Done true
11151 2404 Acked 3403 Write 2 New Done Done true
11152 2405 Acked 3404 Read 7 New Done Done true
11153 2406 Acked 3405 Read 5 New Done Done true
11154 2407 Acked 3406 Read 2 New Done Done true
11155 2408 Acked 3407 Read 4 New Done Done true
11156 2409 Acked 3408 Read 3 New Done Done true
11157 2410 Acked 3409 Read 7 New Done Done true
11158 2411 Acked 3410 Read 5 New Done Done true
11159 2412 Acked 3411 Flush 0 New Done Done true
11160 STATES DS:0 DS:1 DS:2 TOTAL
11161 New 301 0 0 301
11162 Sent 0 0 0 0
11163 Done 0 301 301 602
11164 Skipped 0 0 0 0
11165 Error 0 0 0 0
11166 Last Flush: 3110 3411 3411
11167 Downstairs last five completed: 3110 3109 3108 3107 3106
11168 Upstairs last five completed: 2412 2411 2410 2409 2408
11169 CLIENT: Up:0 ds:301 act:2
111702024-04-20T01:07:26.269ZINFOcrucible: connecting to 127.0.0.1:8810 = io task client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
111712024-04-20T01:07:26.269ZINFOcrucible: ds_connection connected from Ok(127.0.0.1:40807) = io task client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
111722024-04-20T01:07:26.271ZINFOcrucible: downstairs client at Some(127.0.0.1:8810) has region UUID 12345678-0000-0000-0000-000000008810 = downstairs client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
111732024-04-20T01:07:26.271ZINFOcrucible: Returning UUID:12345678-0000-0000-0000-000000008810 matches = downstairs client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
111742024-04-20T01:07:26.271ZINFOcrucible: send last flush ID to this DS: 3110 = downstairs client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
111752024-04-20T01:07:26.271ZINFOcrucible: Replied this last flush ID: 3110 = downstairs client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
111762024-04-20T01:07:26.271ZINFOcrucible: ds_transition from Offline to Replay = downstairs client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
111772024-04-20T01:07:26.271ZINFOcrucible: [0] Transition from Offline to Replay = downstairs client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
111782024-04-20T01:07:26.271ZINFOcrucible: ds_transition from Replay to Active = downstairs client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
111792024-04-20T01:07:26.271ZINFOcrucible: [0] Transition from Replay to Active = downstairs client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
11180 ----------------------------------------------------------------
11181 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:0
11182 Downstairs last five completed: 3411 3410 3409 3408 3407
11183 Upstairs last five completed: 2412 2411 2410 2409 2408
11184 CLIENT: Up:0 ds:0 act:3
11185 Replay: All jobs finished, all DS active.
11186 Main task has work to do, go find it
11187 got dsc Stop(1)
11188 stop 1
11189 Apr 20 01:07:26.587 INFO request completed, latency_us: 306, response_code: 204, uri: /stop/cid/1, method: POST, req_id[8820] Got stop action so:false kr:false
11190 : 0d7d094d-5ef6-4055-9e96-b319b74ad475, remote_addr: 127.0.0.1:60352, local_addr: 127.0.0.1:9998
111912024-04-20T01:07:26.587ZWARNcrucible: downstairs disconnected = io task client = 1 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
111922024-04-20T01:07:26.587ZWARNcrucible: client task is sending Done(Finished) = io task client = 1 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
111932024-04-20T01:07:26.587ZWARNcrucible: downstairs task for 1 stopped due to Finished session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
111942024-04-20T01:07:26.587ZINFOcrucible: Gone missing, transition from Active to Offline = downstairs client = 1 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
11195 Apr 20 01:07:26.587 INFO request completed, latency_us: 105, response_code: 200, uri: {"msg":"[1] client re-new 0 jobs since flush 3411","v":0,"name":"crucible","level":30,"time":"2024-04-20T01:07:26.587967774Z","hostname":"w-01HVWGBJP7HK0H9TQ26T6N3X8M","pid":1196,"":"downstairs","":"downstairs","session_id":"132b460a-26a0-4532-b1ab-4f8c07d4c6c7"}
11196 /state/cid/1, method: GET, req_id: 06f18f33-9bbb-496d-8974-a1570ddee638, remote_addr: 127.0.0.1:60352{"msg":"[1] Marked 0 jobs for replay since flush: 3411","v":0,"name":"crucible","level":30,"time":"2024-04-20T01:07:26.587992463Z","hostname":"w-01HVWGBJP7HK0H9TQ26T6N3X8M","pid":1196,"":"downstairs","":"downstairs","session_id":"132b460a-26a0-4532-b1ab-4f8c07d4c6c7"}
11197 , local_addr: 127.0.0.1:9998
111982024-04-20T01:07:26.588ZINFOcrucible: client task is exiting = io task client = 1 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
11199 [8820] Exited with: ExitStatus(unix_wait_status(9))
11200 [8820][1] reports Exit
11201 Apr 20 01:07:30.589 INFO request completed, latency_us: 191, response_code: 200, uri: /state/cid/1, method: GET, req_id: c1e62be2-62d1-4fc3-a60f-0bee2dd049d8, remote_addr: 127.0.0.1:60352, local_addr: 127.0.0.1:9998
11202 001/300 Read block 185 len 12288
11203 002/300 Write block 996 len 28672 data: 2 2 2 2 2 2 3
11204 003/300 Write block 260 len 16384 data: 2 2 2 2
11205 004/300 Read block 1322 len 8192
11206 005/300 Write block 934 len 20480 data: 2 3 3 3 3
11207 006/300 Write block 1542 len 16384 data: 4 4 5 5
11208 007/300 Write block 4173 len 16384 data: 5 6 3 2
11209 008/300 Write block 2385 len 36864 data: 2 3 4 4 4 4 5 5 5
11210 009/300 Read block 2611 len 20480
11211 010/300 Write block 358 len 36864 data: 3 3 3 4 3 3 3 3 3
11212 011/300 Read block 2359 len 4096
11213 012/300 Write block 1957 len 28672 data: 4 4 3 3 3 3 3
11214 013/300 Read block 1090 len 8192
11215 014/300 Read block 3056 len 28672
11216 015/300 Write block 4887 len 12288 data: 4 4 5
11217 016/300 Write block 986 len 12288 data: 2 2 2
11218 017/300 Write block 2002 len 28672 data: 3 3 4 4 4 5 5
11219 018/300 Read block 3531 len 28672
11220 019/300 Read block 1675 len 8192
11221 020/300 Write block 3488 len 4096 data: 4
11222 021/300 Read block 4222 len 20480
11223 022/300 Write block 1382 len 28672 data: 3 2 2 2 3 3 3
11224 023/300 Read block 2913 len 4096
11225 024/300 Read block 3144 len 32768
11226 025/300 Read block 280 len 40960
11227 026/300 Write block 300 len 20480 data: 3 3 3 3 2
11228 027/300 Read block 989 len 32768
11229 028/300 Flush
11230 029/300 Write block 2890 len 12288 data: 3 3 3
11231 030/300 Write block 4081 len 16384 data: 5 4 4 3
11232 031/300 Flush
11233 032/300 Read block 2777 len 16384
11234 033/300 Read block 3099 len 32768
11235 034/300 Write block 318 len 28672 data: 4 4 4 3 3 3 2
11236 035/300 Read block 4315 len 12288
11237 036/300 Read block 215 len 24576
11238 037/300 Write block 2292 len 28672 data: 2 2 2 2 2 2 2
11239 038/300 Write block 67 len 16384 data: 2 2 2 2
11240 039/300 Read block 3898 len 32768
11241 040/300 Read block 4652 len 36864
11242 041/300 Write block 523 len 28672 data: 5 5 5 5 4 2 2
11243 042/300 Write block 64 len 32768 data: 3 3 3 3 3 3 3 3
11244 043/300 Write block 1570 len 20480 data: 2 2 2 2 2
11245 044/300 Read block 119 len 32768
11246 045/300 Write block 1019 len 8192 data: 2 2
11247 046/300 Read block 3516 len 40960
11248 047/300 Read block 3777 len 20480
11249 048/300 Read block 1556 len 36864
11250 049/300 Write block 1557 len 20480 data: 3 3 3 3 3
11251 050/300 Read block 4871 len 36864
11252 051/300 Flush
11253 052/300 Read block 3244 len 28672
11254 053/300 Write block 769 len 40960 data: 4 5 5 5 6 6 6 4 3 2
11255 054/300 Read block 2283 len 16384
11256 055/300 Read block 3926 len 4096
11257 056/300 Write block 4568 len 20480 data: 4 4 5 5 5
11258 057/300 Write block 218 len 40960 data: 2 3 4 5 5 4 3 3 4 5
11259 058/300 Write block 3456 len 12288 data: 3 3 4
11260 059/300 Read block 669 len 4096
11261 060/300 Read block 760 len 4096
11262 061/300 Read block 1999 len 8192
11263 062/300 Read block 1902 len 40960
11264 063/300 Flush
11265 064/300 Read block 4383 len 24576
11266 065/300 Write block 1391 len 40960 data: 3 3 3 3 2 2 2 2 3 3
11267 066/300 Read block 756 len 4096
11268 067/300 Write block 2212 len 32768 data: 3 3 3 3 2 2 2 2
11269 068/300 Write block 1384 len 36864 data: 3 3 4 4 4 3 3 4 4
11270 069/300 Read block 4776 len 16384
11271 070/300 Flush
11272 071/300 Write block 967 len 8192 data: 3 3
11273 072/300 Read block 362 len 40960
11274 073/300 Read block 4572 len 40960
11275 074/300 Flush
11276 075/300 Read block 2535 len 8192
11277 076/300 Read block 1549 len 40960
11278 077/300 Write block 1694 len 40960 data: 2 2 2 2 2 2 2 2 2 3
11279 078/300 Read block 2770 len 4096
11280 079/300 Read block 1514 len 36864
11281 080/300 Read block 2193 len 40960
11282 081/300 Write block 2617 len 28672 data: 4 4 4 4 3 3 2
11283 082/300 Read block 336 len 20480
11284 083/300 Read block 1427 len 4096
11285 084/300 Read block 732 len 16384
11286 085/300 Read block 1264 len 20480
11287 086/300 Read block 2700 len 28672
11288 087/300 Read block 4915 len 20480
11289 088/300 Read block 66 len 24576
11290 089/300 Read block 3380 len 12288
11291 090/300 Flush
11292 091/300 Write block 2525 len 32768 data: 3 3 3 3 3 3 3 3
11293 092/300 Read block 4330 len 32768
11294 093/300 Read block 2521 len 36864
11295 094/300 Read block 1592 len 40960
11296 095/300 Read block 1834 len 8192
11297 096/300 Write block 3711 len 36864 data: 3 3 3 3 4 4 3 3 3
11298 097/300 Write block 3913 len 20480 data: 4 2 2 3 5
11299 098/300 Read block 997 len 28672
11300 099/300 Write block 2766 len 8192 data: 4 4
11301 100/300 Write block 86 len 16384 data: 4 5 4 4
11302 101/300 Read block 787 len 16384
11303 102/300 Write block 4607 len 4096 data: 3
11304 103/300 Write block 1470 len 16384 data: 2 2 2 2
11305 104/300 Read block 3962 len 28672
11306 105/300 Read block 3058 len 32768
11307 106/300 Read block 3852 len 28672
11308 107/300 Write block 4152 len 4096 data: 2
11309 108/300 Read block 2799 len 16384
11310 109/300 Write block 323 len 12288 data: 4 3 4
11311 110/300 Read block 190 len 4096
11312 111/300 Read block 3132 len 40960
11313 112/300 Read block 3717 len 32768
11314 113/300 Write block 2597 len 20480 data: 2 2 3 3 3
11315 114/300 Read block 1353 len 8192
11316 115/300 Read block 1175 len 20480
11317 116/300 Write block 3126 len 20480 data: 2 2 2 3 3
11318 117/300 Read block 2025 len 24576
11319 118/300 Write block 2045 len 32768 data: 3 3 3 3 2 2 3 4
11320 119/300 Read block 2052 len 20480
11321 120/300 Read block 4328 len 36864
11322 121/300 Read block 1860 len 36864
11323 122/300 Read block 3514 len 28672
11324 123/300 Write block 4588 len 8192 data: 2 2
11325 124/300 Read block 2347 len 28672
11326 125/300 Read block 176 len 12288
11327 126/300 Read block 3249 len 36864
11328 127/300 Read block 2362 len 4096
11329 128/300 Read block 511 len 20480
11330 129/300 Write block 1606 len 16384 data: 4 4 4 4
11331 130/300 Read block 3736 len 4096
11332 131/300 Write block 722 len 40960 data: 4 4 3 3 3 3 5 5 4 3
11333 132/300 Read block 3255 len 36864
11334 133/300 Write block 270 len 20480 data: 6 5 3 2 2
11335 134/300 Read block 3745 len 40960
11336 135/300 Read block 2651 len 4096
11337 136/300 Write block 177 len 8192 data: 3 3
11338 137/300 Write block 3128 len 36864 data: 3 4 4 3 3 3 4 4 4
11339 138/300 Write block 2995 len 20480 data: 6 5 5 5 4
11340 139/300 Read block 3626 len 28672
11341 140/300 Read block 1123 len 40960
11342 141/300 Read block 987 len 16384
11343 142/300 Read block 3218 len 40960
11344 143/300 Read block 3862 len 16384
11345 144/300 Flush
11346 145/300 Write block 4574 len 12288 data: 3 3 3
11347 146/300 Write block 3081 len 4096 data: 5
11348 147/300 Read block 3623 len 36864
11349 148/300 Read block 4302 len 36864
11350 149/300 Flush
11351 150/300 Write block 3806 len 12288 data: 3 3 3
11352 151/300 Flush
11353 152/300 Write block 4821 len 32768 data: 6 6 4 3 4 4 4 3
11354 153/300 Write block 3698 len 36864 data: 3 2 2 3 3 3 3 3 3
11355 154/300 Write block 2083 len 20480 data: 3 3 3 5 3
11356 155/300 Write block 1918 len 36864 data: 3 2 2 2 2 2 3 2 2
11357 156/300 Read block 3763 len 28672
11358 157/300 Write block 892 len 4096 data: 3
11359 158/300 Read block 4604 len 16384
11360 159/300 Read block 1823 len 24576
11361 160/300 Write block 2022 len 8192 data: 4 5
11362 161/300 Write block 3116 len 16384 data: 4 4 4 2
11363 162/300 Read block 490 len 40960
11364 163/300 Write block 3202 len 24576 data: 4 2 2 2 3 3
11365 164/300 Write block 1784 len 12288 data: 4 2 2
11366 165/300 Read block 3498 len 20480
11367 166/300 Write block 2498 len 36864 data: 2 2 2 2 2 2 3 3 2
11368 167/300 Read block 3822 len 24576
11369 168/300 Read block 1717 len 40960
11370 169/300 Flush
11371 170/300 Write block 2993 len 20480 data: 6 7 7 6 6
11372 171/300 Read block 4819 len 4096
11373 172/300 Write block 1747 len 16384 data: 2 2 2 2
11374 173/300 Write block 1427 len 28672 data: 2 2 2 2 2 2 3
11375 174/300 Read block 79 len 20480
11376 175/300 Read block 846 len 16384
11377 176/300 Write block 952 len 8192 data: 3 3
11378 177/300 Read block 948 len 28672
11379 178/300 Read block 557 len 32768
11380 179/300 Read block 4677 len 8192
11381 180/300 Read block 3095 len 40960
11382 181/300 Write block 2051 len 36864 data: 4 5 5 5 5 6 6 5 4
11383 182/300 Write block 3596 len 28672 data: 3 3 3 3 3 3 3
11384 183/300 Flush
11385 184/300 Write block 1206 len 8192 data: 3 3
11386 185/300 Read block 1519 len 12288
11387 186/300 Write block 2297 len 40960 data: 3 3 2 2 2 3 3 3 3 2
11388 187/300 Read block 2873 len 4096
11389 188/300 Flush
11390 189/300 Write block 1876 len 4096 data: 5
11391 190/300 Write block 1030 len 12288 data: 4 5 5
11392 191/300 Flush
11393 192/300 Read block 3558 len 24576
11394 193/300 Write block 963 len 28672 data: 3 5 5 4 4 4 3
11395 194/300 Write block 4413 len 24576 data: 4 3 3 3 3 3
11396 195/300 Read block 2248 len 32768
11397 196/300 Read block 4969 len 36864
11398 197/300 Read block 2107 len 16384
11399 198/300 Write block 121 len 32768 data: 2 2 2 2 2 2 2 2
11400 199/300 Flush
11401 200/300 Write block 784 len 36864 data: 3 3 3 3 4 3 3 2 2
11402 201/300 Read block 3839 len 20480
11403 202/300 Read block 1490 len 24576
11404 203/300 Read block 4402 len 12288
11405 204/300 Read block 2373 len 32768
11406 205/300 Read block 2084 len 16384
11407 206/300 Write block 478 len 40960 data: 3 3 3 3 3 3 3 2 2 3
11408 207/300 Read block 1857 len 40960
11409 208/300 Write block 1770 len 28672 data: 4 4 4 4 4 5 5
11410 209/300 Flush
11411 210/300 Read block 200 len 16384
11412 211/300 Write block 686 len 36864 data: 3 3 3 3 3 3 3 3 3
11413 212/300 Write block 531 len 16384 data: 2 2 2 2
11414 213/300 Read block 3029 len 16384
11415 214/300 Write block 1529 len 32768 data: 2 4 4 4 4 4 4 4
11416 215/300 Write block 239 len 28672 data: 3 3 2 2 3 4 6
11417 216/300 Read block 167 len 40960
11418 217/300 Write block 2098 len 40960 data: 4 3 2 2 2 2 2 2 2 2
11419 218/300 Write block 2138 len 4096 data: 3
11420 219/300 Read block 1745 len 8192
11421 220/300 Write block 2071 len 12288 data: 3 3 3
11422 221/300 Read block 3417 len 24576
11423 222/300 Write block 595 len 4096 data: 4
11424 223/300 Write block 3720 len 40960 data: 3 3 3 3 3 3 4 4 4 4
11425 224/300 Read block 2990 len 4096
11426 225/300 Read block 4820 len 24576
11427 226/300 Read block 3226 len 28672
11428 227/300 Write block 2423 len 16384 data: 4 4 4 5
11429 228/300 Read block 3433 len 28672
11430 229/300 Read block 1099 len 28672
11431 230/300 Read block 4733 len 4096
11432 231/300 Read block 4176 len 28672
11433 232/300 Flush
11434 233/300 Read block 2339 len 28672
11435 234/300 Read block 3058 len 28672
11436 235/300 Read block 241 len 24576
11437 236/300 Read block 1462 len 16384
11438 237/300 Write block 598 len 8192 data: 3 2
11439 238/300 Read block 2968 len 40960
11440 239/300 Write block 3186 len 16384 data: 4 3 3 3
11441 240/300 Read block 3390 len 32768
11442 241/300 Flush
11443 242/300 Write block 3761 len 32768 data: 2 2 2 2 2 2 4 4
11444 243/300 Write block 4860 len 20480 data: 3 4 3 2 2
11445 244/300 Write block 4700 len 40960 data: 2 3 3 3 3 3 4 4 3 3
11446 245/300 Read block 887 len 24576
11447 246/300 Write block 1686 len 24576 data: 3 2 2 2 2 2
11448 247/300 Read block 982 len 28672
11449 248/300 Write block 263 len 28672 data: 3 3 2 2 3 4 5
11450 249/300 Flush
11451 250/300 Write block 2994 len 36864 data: 8 8 7 7 6 5 3 3 3
11452 251/300 Read block 3709 len 32768
11453 252/300 Write block 913 len 16384 data: 2 2 2 2
11454 253/300 Read block 2030 len 36864
11455 254/300 Flush
11456 255/300 Read block 1149 len 28672
11457 256/300 Write block 3789 len 40960 data: 2 2 2 2 2 2 2 3 3 4
11458 257/300 Read block 990 len 40960
11459 258/300 Flush
11460 259/300 Flush
11461 260/300 Write block 2742 len 12288 data: 2 2 2
11462 261/300 Flush
11463 262/300 Write block 359 len 36864 data: 4 4 5 4 4 4 4 4 3
11464 263/300 Write block 3183 len 40960 data: 4 4 4 5 4 4 4 3 3 3
11465 264/300 Read block 1226 len 28672
11466 265/300 Write block 2682 len 12288 data: 3 3 3
11467 266/300 Read block 3929 len 4096
11468 267/300 Read block 4412 len 12288
11469 268/300 Write block 1830 len 16384 data: 3 3 3 3
11470 269/300 Write block 4246 len 40960 data: 4 2 3 3 3 3 4 4 4 4
11471 270/300 Read block 3532 len 24576
11472 271/300 Read block 852 len 28672
11473 272/300 Write block 872 len 36864 data: 2 3 5 5 4 4 4 3 3
11474 273/300 Write block 2325 len 16384 data: 3 2 2 2
11475 274/300 Write block 3707 len 16384 data: 3 3 3 2
11476 275/300 Read block 3226 len 36864
11477 276/300 Read block 2583 len 4096
11478 277/300 Write block 1828 len 12288 data: 4 4 4
11479 278/300 Write block 994 len 24576 data: 3 2 3 3 3 3
11480 279/300 Read block 1172 len 12288
11481 280/300 Flush
11482 281/300 Write block 2845 len 4096 data: 4
11483 282/300 Read block 2947 len 40960
11484 283/300 Flush
11485 284/300 Read block 3066 len 12288
11486 285/300 Read block 17 len 4096
11487 286/300 Read block 4205 len 28672
11488 287/300 Read block 3936 len 12288
11489 288/300 Flush
11490 289/300 Write block 4656 len 16384 data: 3 3 3 3
11491 290/300 Read block 4649 len 24576
11492 291/300 Write block 2861 len 36864 data: 2 2 2 2 2 3 3 3 3
11493 292/300 Write block 3781 len 4096 data: 2
11494 293/300 Write block 2362 len 24576 data: 4 4 4 4 3 3
11495 294/300 Read block 2140 len 8192
11496 295/300 Read block 2638 len 16384
11497 296/300 Read block 2409 len 32768
11498 297/300 Read block 1433 len 24576
11499 298/300 Write block 1434 len 12288 data: 3 4 4
11500 299/300 Write block 2141 len 20480 data: 4 4 4 4 3
11501 300/300 Read block 475 len 28672
11502 Main task has work to do, go find it
11503 got dsc Start(1)
11504 start 1
11505 Apr 20 01:07:30.977 INFO request completed, latency_us: 213, response_code: 204, uri: /start/cid/1, method: POST, req_id: 6647756e-25fe-436d-a9e4-76d5f333c26c, remote_addr: 127.0.0.1:60352, local_addr: 127.0.0.1:9998
11506 Replay: started 1, returned:Ok(())
11507 ----------------------------------------------------------------
11508 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:301
11509 States: Active Offline Active
11510 GW_ID ACK DSID TYPE BLOCKS DS:0 DS:1 DS:2 REPLAY
11511 2413 Acked 3412 Read 3 Done New Done false
11512 2414 Acked 3413 Write 7 Done New Done false
11513 2415 Acked 3414 Write 4 Done New Done false
11514 2416 Acked 3415 Read 2 Done New Done false
11515 2417 Acked 3416 Write 5 Done New Done false
11516 2418 Acked 3417 Write 4 Done New Done false
11517 2419 Acked 3418 Write 4 Done New Done false
11518 2420 Acked 3419 Write 9 Done New Done false
11519 2421 Acked 3420 Read 5 Done New Done false
11520 2422 Acked 3421 Write 9 Done New Done false
11521 2423 Acked 3422 Read 1 Done New Done false
11522 2424 Acked 3423 Write 7 Done New Done false
11523 2425 Acked 3424 Read 2 Done New Done false
11524 2426 Acked 3425 Read 7 Done New Done false
11525 2427 Acked 3426 Write 3 Done New Done false
11526 2428 Acked 3427 Write 3 Done New Done false
11527 2429 Acked 3428 Write 7 Done New Done false
11528 2430 Acked 3429 Read 7 Done New Done false
11529 2431 Acked 3430 Read 2 Done New Done false
11530 2432 Acked 3431 Write 1 Done New Done false
11531 2433 Acked 3432 Read 5 Done New Done false
11532 2434 Acked 3433 Write 7 Done New Done false
11533 2435 Acked 3434 Read 1 Done New Done false
11534 2436 Acked 3435 Read 8 Done New Done false
11535 2437 Acked 3436 Read 10 Done New Done false
11536 2438 Acked 3437 Write 5 Done New Done false
11537 2439 Acked 3438 Read 8 Done New Done false
11538 2440 Acked 3439 Flush 0 Done New Done false
11539 2441 Acked 3440 Write 3 Done New Done false
11540 2442 Acked 3441 Write 4 Done New Done false
11541 2443 Acked 3442 Flush 0 Done New Done false
11542 2444 Acked 3443 Read 4 Done New Done false
11543 2445 Acked 3444 Read 8 Done New Done false
11544 2446 Acked 3445 Write 7 Done New Done false
11545 2447 Acked 3446 Read 3 Done New Done false
11546 2448 Acked 3447 Read 6 Done New Done false
11547 2449 Acked 3448 Write 7 Done New Done false
11548 2450 Acked 3449 Write 4 Done New Done false
11549 2451 Acked 3450 Read 8 Done New Done false
11550 2452 Acked 3451 Read 9 Done New Done false
11551 2453 Acked 3452 Write 7 Done New Done false
11552 2454 Acked 3453 Write 8 Done New Done false
11553 2455 Acked 3454 Write 5 Done New Done false
11554 2456 Acked 3455 Read 8 Done New Done false
11555 2457 Acked 3456 Write 2 Done New Done false
11556 2458 Acked 3457 Read 10 Done New Done false
11557 2459 Acked 3458 Read 5 Done New Done false
11558 2460 Acked 3459 Read 9 Done New Done false
11559 2461 Acked 3460 Write 5 Done New Done false
11560 2462 Acked 3461 Read 9 Done New Done false
11561 2463 Acked 3462 Flush 0 Done New Done false
11562 2464 Acked 3463 Read 7 Done New Done false
11563 2465 Acked 3464 Write 10 Done New Done false
11564 2466 Acked 3465 Read 4 Done New Done false
11565 2467 Acked 3466 Read 1 Done New Done false
11566 2468 Acked 3467 Write 5 Done New Done false
11567 2469 Acked 3468 Write 10 Done New Done false
11568 2470 Acked 3469 Write 3 Done New Done false
11569 2471 Acked 3470 Read 1 Done New Done false
11570 2472 Acked 3471 Read 1 Done New Done false
11571 2473 Acked 3472 Read 2 Done New Done false
11572 2474 Acked 3473 Read 10 Done New Done false
11573 2475 Acked 3474 Flush 0 Done New Done false
11574 2476 Acked 3475 Read 6 Done New Done false
11575 2477 Acked 3476 Write 10 Done New Done false
11576 2478 Acked 3477 Read 1 Done New Done false
11577 2479 Acked 3478 Write 8 Done New Done false
11578 2480 Acked 3479 Write 9 Done New Done false
11579 2481 Acked 3480 Read 4 Done New Done false
11580 2482 Acked 3481 Flush 0 Done New Done false
11581 2483 Acked 3482 Write 2 Done New Done false
11582 2484 Acked 3483 Read 10 Done New Done false
11583 2485 Acked 3484 Read 10 Done New Done false
11584 2486 Acked 3485 Flush 0 Done New Done false
11585 2487 Acked 3486 Read 2 Done New Done false
11586 2488 Acked 3487 Read 10 Done New Done false
11587 2489 Acked 3488 Write 10 Done New Done false
11588 2490 Acked 3489 Read 1 Done New Done false
11589 2491 Acked 3490 Read 9 Done New Done false
11590 2492 Acked 3491 Read 10 Done New Done false
11591 2493 Acked 3492 Write 7 Done New Done false
11592 2494 Acked 3493 Read 5 Done New Done false
11593 2495 Acked 3494 Read 1 Done New Done false
11594 2496 Acked 3495 Read 4 Done New Done false
11595 2497 Acked 3496 Read 5 Done New Done false
11596 2498 Acked 3497 Read 7 Done New Done false
11597 2499 Acked 3498 Read 5 Done New Done false
11598 2500 Acked 3499 Read 6 Done New Done false
11599 2501 Acked 3500 Read 3 Done New Done false
11600 2502 Acked 3501 Flush 0 Done New Done false
11601 2503 Acked 3502 Write 8 Done New Done false
11602 2504 Acked 3503 Read 8 Done New Done false
11603 2505 Acked 3504 Read 9 Done New Done false
11604 2506 Acked 3505 Read 10 Done New Done false
11605 2507 Acked 3506 Read 2 Done New Done false
11606 2508 Acked 3507 Write 9 Done New Done false
11607 2509 Acked 3508 Write 5 Done New Done false
11608 2510 Acked 3509 Read 7 Done New Done false
11609 2511 Acked 3510 Write 2 Done New Done false
11610 2512 Acked 3511 Write 4 Done New Done false
11611 2513 Acked 3512 Read 4 Done New Done false
11612 2514 Acked 3513 Write 1 Done New Done false
11613 2515 Acked 3514 Write 4 Done New Done false
11614 2516 Acked 3515 Read 7 Done New Done false
11615 2517 Acked 3516 Read 8 Done New Done false
11616 2518 Acked 3517 Read 7 Done New Done false
11617 2519 Acked 3518 Write 1 Done New Done false
11618 2520 Acked 3519 Read 4 Done New Done false
11619 2521 Acked 3520 Write 3 Done New Done false
11620 2522 Acked 3521 Read 1 Done New Done false
11621 2523 Acked 3522 Read 10 Done New Done false
11622 2524 Acked 3523 Read 8 Done New Done false
11623 2525 Acked 3524 Write 5 Done New Done false
11624 2526 Acked 3525 Read 2 Done New Done false
11625 2527 Acked 3526 Read 5 Done New Done false
11626 2528 Acked 3527 Write 5 Done New Done false
11627 2529 Acked 3528 Read 6 Done New Done false
11628 2530 Acked 3529 Write 8 Done New Done false
11629 2531 Acked 3530 Read 5 Done New Done false
11630 2532 Acked 3531 Read 9 Done New Done false
11631 2533 Acked 3532 Read 9 Done New Done false
11632 2534 Acked 3533 Read 7 Done New Done false
11633 2535 Acked 3534 Write 2 Done New Done false
11634 2536 Acked 3535 Read 7 Done New Done false
11635 2537 Acked 3536 Read 3 Done New Done false
11636 2538 Acked 3537 Read 9 Done New Done false
11637 2539 Acked 3538 Read 1 Done New Done false
11638 2540 Acked 3539 Read 5 Done New Done false
11639 2541 Acked 3540 Write 4 Done New Done false
11640 2542 Acked 3541 Read 1 Done New Done false
11641 2543 Acked 3542 Write 10 Done New Done false
11642 2544 Acked 3543 Read 9 Done New Done false
11643 2545 Acked 3544 Write 5 Done New Done false
11644 2546 Acked 3545 Read 10 Done New Done false
11645 2547 Acked 3546 Read 1 Done New Done false
11646 2548 Acked 3547 Write 2 Done New Done false
11647 2549 Acked 3548 Write 9 Done New Done false
11648 2550 Acked 3549 Write 5 Done New Done false
11649 2551 Acked 3550 Read 7 Done New Done false
11650 2552 Acked 3551 Read 10 Done New Done false
11651 2553 Acked 3552 Read 4 Done New Done false
11652 2554 Acked 3553 Read 10 Done New Done false
11653 2555 Acked 3554 Read 4 Done New Done false
11654 2556 Acked 3555 Flush 0 Done New Done false
11655 2557 Acked 3556 Write 3 Done New Done false
11656 2558 Acked 3557 Write 1 Done New Done false
11657 2559 Acked 3558 Read 9 Done New Done false
11658 2560 Acked 3559 Read 9 Done New Done false
11659 2561 Acked 3560 Flush 0 Done New Done false
11660 2562 Acked 3561 Write 3 Done New Done false
11661 2563 Acked 3562 Flush 0 Done New Done false
11662 2564 Acked 3563 Write 8 Done New Done false
11663 2565 Acked 3564 Write 9 Done New Done false
11664 2566 Acked 3565 Write 5 Done New Done false
11665 2567 Acked 3566 Write 9 Done New Done false
11666 2568 Acked 3567 Read 7 Done New Done false
11667 2569 Acked 3568 Write 1 Done New Done false
11668 2570 Acked 3569 Read 4 Done New Done false
11669 2571 Acked 3570 Read 6 Done New Done false
11670 2572 Acked 3571 Write 2 Done New Done false
11671 2573 Acked 3572 Write 4 Done New Done false
11672 2574 Acked 3573 Read 10 Done New Done false
11673 2575 Acked 3574 Write 6 Done New Done false
11674 2576 Acked 3575 Write 3 Done New Done false
11675 2577 Acked 3576 Read 5 Done New Done false
11676 2578 Acked 3577 Write 9 Done New Done false
11677 2579 Acked 3578 Read 6 Done New Done false
11678 2580 Acked 3579 Read 10 Done New Done false
11679 2581 Acked 3580 Flush 0 Done New Done false
11680 2582 Acked 3581 Write 5 Done New Done false
11681 2583 Acked 3582 Flush 0 Done New Done false
11682 2584 Acked 3583 Read 1 Done New Done false
11683 2585 Acked 3584 Write 4 Done New Done false
11684 2586 Acked 3585 Write 7 Done New Done false
11685 2587 Acked 3586 Read 5 Done New Done false
11686 2588 Acked 3587 Read 4 Done New Done false
11687 2589 Acked 3588 Write 2 Done New Done false
11688 2590 Acked 3589 Read 7 Done New Done false
11689 2591 Acked 3590 Read 8 Done New Done false
11690 2592 Acked 3591 Read 2 Done New Done false
11691 2593 Acked 3592 Read 10 Done New Done false
11692 2594 Acked 3593 Write 9 Done New Done false
11693 2595 Acked 3594 Write 7 Done New Done false
11694 2596 Acked 3595 Flush 0 Done New Done false
11695 2597 Acked 3596 Write 2 Done New Done false
11696 2598 Acked 3597 Read 3 Done New Done false
11697 2599 Acked 3598 Write 10 Done New Done false
11698 2600 Acked 3599 Read 1 Done New Done false
11699 2601 Acked 3600 Flush 0 Done New Done false
11700 2602 Acked 3601 Write 1 Done New Done false
11701 2603 Acked 3602 Write 3 Done New Done false
11702 2604 Acked 3603 Flush 0 Done New Done false
11703 2605 Acked 3604 Read 6 Done New Done false
11704 2606 Acked 3605 Write 7 Done New Done false
11705 2607 Acked 3606 Write 6 Done New Done false
11706 2608 Acked 3607 Read 8 Done New Done false
11707 2609 Acked 3608 Read 9 Done New Done false
11708 2610 Acked 3609 Read 4 Done New Done false
11709 2611 Acked 3610 Write 8 Done New Done false
11710 2612 Acked 3611 Flush 0 Done New Done false
11711 2613 Acked 3612 Write 9 Done New Done false
11712 2614 Acked 3613 Read 5 Done New Done false
11713 2615 Acked 3614 Read 6 Done New Done false
11714 2616 Acked 3615 Read 3 Done New Done false
11715 2617 Acked 3616 Read 8 Done New Done false
11716 2618 Acked 3617 Read 4 Done New Done false
11717 2619 Acked 3618 Write 10 Done New Done false
11718 2620 Acked 3619 Read 10 Done New Done false
11719 2621 Acked 3620 Write 7 Done New Done false
11720 2622 Acked 3621 Flush 0 Done New Done false
11721 2623 Acked 3622 Read 4 Done New Done false
11722 2624 Acked 3623 Write 9 Done New Done false
11723 2625 Acked 3624 Write 4 Done New Done false
11724 2626 Acked 3625 Read 4 Done New Done false
11725 2627 Acked 3626 Write 8 Done New Done false
11726 2628 Acked 3627 Write 7 Done New Done false
11727 2629 Acked 3628 Read 10 Done New Done false
11728 2630 Acked 3629 Write 10 Done New Done false
11729 2631 Acked 3630 Write 1 Done New Done false
11730 2632 Acked 3631 Read 2 Done New Done false
11731 2633 Acked 3632 Write 3 Done New Done false
11732 2634 Acked 3633 Read 6 Done New Done false
11733 2635 Acked 3634 Write 1 Done New Done false
11734 2636 Acked 3635 Write 10 Done New Done false
11735 2637 Acked 3636 Read 1 Done New Done false
11736 2638 Acked 3637 Read 6 Done New Done false
11737 2639 Acked 3638 Read 7 Done New Done false
11738 2640 Acked 3639 Write 4 Done New Done false
11739 2641 Acked 3640 Read 7 Done New Done false
11740 2642 Acked 3641 Read 7 Done New Done false
11741 2643 Acked 3642 Read 1 Done New Done false
11742 2644 Acked 3643 Read 7 Done New Done false
11743 2645 Acked 3644 Flush 0 Done New Done false
11744 2646 Acked 3645 Read 7 Done New Done false
11745 2647 Acked 3646 Read 7 Done New Done false
11746 2648 Acked 3647 Read 6 Done New Done false
11747 2649 Acked 3648 Read 4 Done New Done false
11748 2650 Acked 3649 Write 2 Done New Done false
11749 2651 Acked 3650 Read 10 Done New Done false
11750 2652 Acked 3651 Write 4 Done New Done false
11751 2653 Acked 3652 Read 8 Done New Done false
11752 2654 Acked 3653 Flush 0 Done New Done false
11753 2655 Acked 3654 Write 8 Done New Done false
11754 2656 Acked 3655 Write 5 Done New Done false
11755 2657 Acked 3656 Write 10 Done New Done false
11756 2658 Acked 3657 Read 6 Done New Done false
11757 2659 Acked 3658 Write 6 Done New Done false
11758 2660 Acked 3659 Read 7 Done New Done false
11759 2661 Acked 3660 Write 7 Done New Done false
11760 2662 Acked 3661 Flush 0 Done New Done false
11761 2663 Acked 3662 Write 9 Done New Done false
11762 2664 Acked 3663 Read 8 Done New Done false
11763 2665 Acked 3664 Write 4 Done New Done false
11764 2666 Acked 3665 Read 9 Done New Done false
11765 2667 Acked 3666 Flush 0 Done New Done false
11766 2668 Acked 3667 Read 7 Done New Done false
11767 2669 Acked 3668 Write 10 Done New Done false
11768 2670 Acked 3669 Read 10 Done New Done false
11769 2671 Acked 3670 Flush 0 Done New Done false
11770 2672 Acked 3671 Flush 0 Done New Done false
11771 2673 Acked 3672 Write 3 Done New Done false
11772 2674 Acked 3673 Flush 0 Done New Done false
11773 2675 Acked 3674 Write 9 Done New Done false
11774 2676 Acked 3675 Write 10 Done New Done false
11775 2677 Acked 3676 Read 7 Done New Done false
11776 2678 Acked 3677 Write 3 Done New Done false
11777 2679 Acked 3678 Read 1 Done New Done false
11778 2680 Acked 3679 Read 3 Done New Done false
11779 2681 Acked 3680 Write 4 Done New Done false
11780 2682 Acked 3681 Write 10 Done New Done false
11781 2683 Acked 3682 Read 6 Done New Done false
11782 2684 Acked 3683 Read 7 Done New Done false
11783 2685 Acked 3684 Write 9 Done New Done false
11784 2686 Acked 3685 Write 4 Done New Done false
11785 2687 Acked 3686 Write 4 Done New Done false
11786 2688 Acked 3687 Read 9 Done New Done false
11787 2689 Acked 3688 Read 1 Done New Done false
11788 2690 Acked 3689 Write 3 Done New Done false
11789 2691 Acked 3690 Write 6 Done New Done false
11790 2692 Acked 3691 Read 3 Done New Done false
11791 2693 Acked 3692 Flush 0 Done New Done false
11792 2694 Acked 3693 Write 1 Done New Done false
11793 2695 Acked 3694 Read 10 Done New Done false
11794 2696 Acked 3695 Flush 0 Done New Done false
11795 2697 Acked 3696 Read 3 Done New Done false
11796 2698 Acked 3697 Read 1 Done New Done false
11797 2699 Acked 3698 Read 7 Done New Done false
11798 2700 Acked 3699 Read 3 Done New Done false
11799 2701 Acked 3700 Flush 0 Done New Done false
11800 2702 Acked 3701 Write 4 Done New Done false
11801 2703 Acked 3702 Read 6 Done New Done false
11802 2704 Acked 3703 Write 9 Done New Done false
11803 2705 Acked 3704 Write 1 Done New Done false
11804 2706 Acked 3705 Write 6 Done New Done false
11805 2707 Acked 3706 Read 2 Done New Done false
11806 2708 Acked 3707 Read 4 Done New Done false
11807 2709 Acked 3708 Read 8 Done New Done false
11808 2710 Acked 3709 Read 6 Done New Done false
11809 2711 Acked 3710 Write 3 Done New Done false
11810 2712 Acked 3711 Write 5 Done New Done false
11811 2713 Acked 3712 Read 7 Done New Done false
11812 STATES DS:0 DS:1 DS:2 TOTAL
11813 New 0 301 0 301
11814 Sent 0 0 0 0
11815 Done 301 0 301 602
11816 Skipped 0 0 0 0
11817 Error 0 0 0 0
11818 Last Flush: 3700 3411 3700
11819 Downstairs last five completed: 3411 3410 3409 3408 3407
11820 Upstairs last five completed: 2713 2712 2711 2710 2709
11821 CLIENT: Up:0 ds:301 act:2
11822 [8820] got start action
11823 [8820] I am going to restart
11824 Starting downstairs at port 8820
11825 Make output file at "/tmp/dsc/downstairs-8820.txt"
11826 [8820][1] reports Starting
11827 Downstairs /var/tmp/dsc/region/8820 port 8820 PID:Some(1205)
11828 [8820][1] reports Running
11829 ----------------------------------------------------------------
11830 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:302
11831 States: Active Offline Active
11832 GW_ID ACK DSID TYPE BLOCKS DS:0 DS:1 DS:2 REPLAY
11833 2413 Acked 3412 Read 3 Done New Done false
11834 2414 Acked 3413 Write 7 Done New Done false
11835 2415 Acked 3414 Write 4 Done New Done false
11836 2416 Acked 3415 Read 2 Done New Done false
11837 2417 Acked 3416 Write 5 Done New Done false
11838 2418 Acked 3417 Write 4 Done New Done false
11839 2419 Acked 3418 Write 4 Done New Done false
11840 2420 Acked 3419 Write 9 Done New Done false
11841 2421 Acked 3420 Read 5 Done New Done false
11842 2422 Acked 3421 Write 9 Done New Done false
11843 2423 Acked 3422 Read 1 Done New Done false
11844 2424 Acked 3423 Write 7 Done New Done false
11845 2425 Acked 3424 Read 2 Done New Done false
11846 2426 Acked 3425 Read 7 Done New Done false
11847 2427 Acked 3426 Write 3 Done New Done false
11848 2428 Acked 3427 Write 3 Done New Done false
11849 2429 Acked 3428 Write 7 Done New Done false
11850 2430 Acked 3429 Read 7 Done New Done false
11851 2431 Acked 3430 Read 2 Done New Done false
11852 2432 Acked 3431 Write 1 Done New Done false
11853 2433 Acked 3432 Read 5 Done New Done false
11854 2434 Acked 3433 Write 7 Done New Done false
11855 2435 Acked 3434 Read 1 Done New Done false
11856 2436 Acked 3435 Read 8 Done New Done false
11857 2437 Acked 3436 Read 10 Done New Done false
11858 2438 Acked 3437 Write 5 Done New Done false
11859 2439 Acked 3438 Read 8 Done New Done false
11860 2440 Acked 3439 Flush 0 Done New Done false
11861 2441 Acked 3440 Write 3 Done New Done false
11862 2442 Acked 3441 Write 4 Done New Done false
11863 2443 Acked 3442 Flush 0 Done New Done false
11864 2444 Acked 3443 Read 4 Done New Done false
11865 2445 Acked 3444 Read 8 Done New Done false
11866 2446 Acked 3445 Write 7 Done New Done false
11867 2447 Acked 3446 Read 3 Done New Done false
11868 2448 Acked 3447 Read 6 Done New Done false
11869 2449 Acked 3448 Write 7 Done New Done false
11870 2450 Acked 3449 Write 4 Done New Done false
11871 2451 Acked 3450 Read 8 Done New Done false
11872 2452 Acked 3451 Read 9 Done New Done false
11873 2453 Acked 3452 Write 7 Done New Done false
11874 2454 Acked 3453 Write 8 Done New Done false
11875 2455 Acked 3454 Write 5 Done New Done false
11876 2456 Acked 3455 Read 8 Done New Done false
11877 2457 Acked 3456 Write 2 Done New Done false
11878 2458 Acked 3457 Read 10 Done New Done false
11879 2459 Acked 3458 Read 5 Done New Done false
11880 2460 Acked 3459 Read 9 Done New Done false
11881 2461 Acked 3460 Write 5 Done New Done false
11882 2462 Acked 3461 Read 9 Done New Done false
11883 2463 Acked 3462 Flush 0 Done New Done false
11884 2464 Acked 3463 Read 7 Done New Done false
11885 2465 Acked 3464 Write 10 Done New Done false
11886 2466 Acked 3465 Read 4 Done New Done false
11887 2467 Acked 3466 Read 1 Done New Done false
11888 2468 Acked 3467 Write 5 Done New Done false
11889 2469 Acked 3468 Write 10 Done New Done false
11890 2470 Acked 3469 Write 3 Done New Done false
11891 2471 Acked 3470 Read 1 Done New Done false
11892 2472 Acked 3471 Read 1 Done New Done false
11893 2473 Acked 3472 Read 2 Done New Done false
11894 2474 Acked 3473 Read 10 Done New Done false
11895 2475 Acked 3474 Flush 0 Done New Done false
11896 2476 Acked 3475 Read 6 Done New Done false
11897 2477 Acked 3476 Write 10 Done New Done false
11898 2478 Acked 3477 Read 1 Done New Done false
11899 2479 Acked 3478 Write 8 Done New Done false
11900 2480 Acked 3479 Write 9 Done New Done false
11901 2481 Acked 3480 Read 4 Done New Done false
11902 2482 Acked 3481 Flush 0 Done New Done false
11903 2483 Acked 3482 Write 2 Done New Done false
11904 2484 Acked 3483 Read 10 Done New Done false
11905 2485 Acked 3484 Read 10 Done New Done false
11906 2486 Acked 3485 Flush 0 Done New Done false
11907 2487 Acked 3486 Read 2 Done New Done false
11908 2488 Acked 3487 Read 10 Done New Done false
11909 2489 Acked 3488 Write 10 Done New Done false
11910 2490 Acked 3489 Read 1 Done New Done false
11911 2491 Acked 3490 Read 9 Done New Done false
11912 2492 Acked 3491 Read 10 Done New Done false
11913 2493 Acked 3492 Write 7 Done New Done false
11914 2494 Acked 3493 Read 5 Done New Done false
11915 2495 Acked 3494 Read 1 Done New Done false
11916 2496 Acked 3495 Read 4 Done New Done false
11917 2497 Acked 3496 Read 5 Done New Done false
11918 2498 Acked 3497 Read 7 Done New Done false
11919 2499 Acked 3498 Read 5 Done New Done false
11920 2500 Acked 3499 Read 6 Done New Done false
11921 2501 Acked 3500 Read 3 Done New Done false
11922 2502 Acked 3501 Flush 0 Done New Done false
11923 2503 Acked 3502 Write 8 Done New Done false
11924 2504 Acked 3503 Read 8 Done New Done false
11925 2505 Acked 3504 Read 9 Done New Done false
11926 2506 Acked 3505 Read 10 Done New Done false
11927 2507 Acked 3506 Read 2 Done New Done false
11928 2508 Acked 3507 Write 9 Done New Done false
11929 2509 Acked 3508 Write 5 Done New Done false
11930 2510 Acked 3509 Read 7 Done New Done false
11931 2511 Acked 3510 Write 2 Done New Done false
11932 2512 Acked 3511 Write 4 Done New Done false
11933 2513 Acked 3512 Read 4 Done New Done false
11934 2514 Acked 3513 Write 1 Done New Done false
11935 2515 Acked 3514 Write 4 Done New Done false
11936 2516 Acked 3515 Read 7 Done New Done false
11937 2517 Acked 3516 Read 8 Done New Done false
11938 2518 Acked 3517 Read 7 Done New Done false
11939 2519 Acked 3518 Write 1 Done New Done false
11940 2520 Acked 3519 Read 4 Done New Done false
11941 2521 Acked 3520 Write 3 Done New Done false
11942 2522 Acked 3521 Read 1 Done New Done false
11943 2523 Acked 3522 Read 10 Done New Done false
11944 2524 Acked 3523 Read 8 Done New Done false
11945 2525 Acked 3524 Write 5 Done New Done false
11946 2526 Acked 3525 Read 2 Done New Done false
11947 2527 Acked 3526 Read 5 Done New Done false
11948 2528 Acked 3527 Write 5 Done New Done false
11949 2529 Acked 3528 Read 6 Done New Done false
11950 2530 Acked 3529 Write 8 Done New Done false
11951 2531 Acked 3530 Read 5 Done New Done false
11952 2532 Acked 3531 Read 9 Done New Done false
11953 2533 Acked 3532 Read 9 Done New Done false
11954 2534 Acked 3533 Read 7 Done New Done false
11955 2535 Acked 3534 Write 2 Done New Done false
11956 2536 Acked 3535 Read 7 Done New Done false
11957 2537 Acked 3536 Read 3 Done New Done false
11958 2538 Acked 3537 Read 9 Done New Done false
11959 2539 Acked 3538 Read 1 Done New Done false
11960 2540 Acked 3539 Read 5 Done New Done false
11961 2541 Acked 3540 Write 4 Done New Done false
11962 2542 Acked 3541 Read 1 Done New Done false
11963 2543 Acked 3542 Write 10 Done New Done false
11964 2544 Acked 3543 Read 9 Done New Done false
11965 2545 Acked 3544 Write 5 Done New Done false
11966 2546 Acked 3545 Read 10 Done New Done false
11967 2547 Acked 3546 Read 1 Done New Done false
11968 2548 Acked 3547 Write 2 Done New Done false
11969 2549 Acked 3548 Write 9 Done New Done false
11970 2550 Acked 3549 Write 5 Done New Done false
11971 2551 Acked 3550 Read 7 Done New Done false
11972 2552 Acked 3551 Read 10 Done New Done false
11973 2553 Acked 3552 Read 4 Done New Done false
11974 2554 Acked 3553 Read 10 Done New Done false
11975 2555 Acked 3554 Read 4 Done New Done false
11976 2556 Acked 3555 Flush 0 Done New Done false
11977 2557 Acked 3556 Write 3 Done New Done false
11978 2558 Acked 3557 Write 1 Done New Done false
11979 2559 Acked 3558 Read 9 Done New Done false
11980 2560 Acked 3559 Read 9 Done New Done false
11981 2561 Acked 3560 Flush 0 Done New Done false
11982 2562 Acked 3561 Write 3 Done New Done false
11983 2563 Acked 3562 Flush 0 Done New Done false
11984 2564 Acked 3563 Write 8 Done New Done false
11985 2565 Acked 3564 Write 9 Done New Done false
11986 2566 Acked 3565 Write 5 Done New Done false
11987 2567 Acked 3566 Write 9 Done New Done false
11988 2568 Acked 3567 Read 7 Done New Done false
11989 2569 Acked 3568 Write 1 Done New Done false
11990 2570 Acked 3569 Read 4 Done New Done false
11991 2571 Acked 3570 Read 6 Done New Done false
11992 2572 Acked 3571 Write 2 Done New Done false
11993 2573 Acked 3572 Write 4 Done New Done false
11994 2574 Acked 3573 Read 10 Done New Done false
11995 2575 Acked 3574 Write 6 Done New Done false
11996 2576 Acked 3575 Write 3 Done New Done false
11997 2577 Acked 3576 Read 5 Done New Done false
11998 2578 Acked 3577 Write 9 Done New Done false
11999 2579 Acked 3578 Read 6 Done New Done false
12000 2580 Acked 3579 Read 10 Done New Done false
12001 2581 Acked 3580 Flush 0 Done New Done false
12002 2582 Acked 3581 Write 5 Done New Done false
12003 2583 Acked 3582 Flush 0 Done New Done false
12004 2584 Acked 3583 Read 1 Done New Done false
12005 2585 Acked 3584 Write 4 Done New Done false
12006 2586 Acked 3585 Write 7 Done New Done false
12007 2587 Acked 3586 Read 5 Done New Done false
12008 2588 Acked 3587 Read 4 Done New Done false
12009 2589 Acked 3588 Write 2 Done New Done false
12010 2590 Acked 3589 Read 7 Done New Done false
12011 2591 Acked 3590 Read 8 Done New Done false
12012 2592 Acked 3591 Read 2 Done New Done false
12013 2593 Acked 3592 Read 10 Done New Done false
12014 2594 Acked 3593 Write 9 Done New Done false
12015 2595 Acked 3594 Write 7 Done New Done false
12016 2596 Acked 3595 Flush 0 Done New Done false
12017 2597 Acked 3596 Write 2 Done New Done false
12018 2598 Acked 3597 Read 3 Done New Done false
12019 2599 Acked 3598 Write 10 Done New Done false
12020 2600 Acked 3599 Read 1 Done New Done false
12021 2601 Acked 3600 Flush 0 Done New Done false
12022 2602 Acked 3601 Write 1 Done New Done false
12023 2603 Acked 3602 Write 3 Done New Done false
12024 2604 Acked 3603 Flush 0 Done New Done false
12025 2605 Acked 3604 Read 6 Done New Done false
12026 2606 Acked 3605 Write 7 Done New Done false
12027 2607 Acked 3606 Write 6 Done New Done false
12028 2608 Acked 3607 Read 8 Done New Done false
12029 2609 Acked 3608 Read 9 Done New Done false
12030 2610 Acked 3609 Read 4 Done New Done false
12031 2611 Acked 3610 Write 8 Done New Done false
12032 2612 Acked 3611 Flush 0 Done New Done false
12033 2613 Acked 3612 Write 9 Done New Done false
12034 2614 Acked 3613 Read 5 Done New Done false
12035 2615 Acked 3614 Read 6 Done New Done false
12036 2616 Acked 3615 Read 3 Done New Done false
12037 2617 Acked 3616 Read 8 Done New Done false
12038 2618 Acked 3617 Read 4 Done New Done false
12039 2619 Acked 3618 Write 10 Done New Done false
12040 2620 Acked 3619 Read 10 Done New Done false
12041 2621 Acked 3620 Write 7 Done New Done false
12042 2622 Acked 3621 Flush 0 Done New Done false
12043 2623 Acked 3622 Read 4 Done New Done false
12044 2624 Acked 3623 Write 9 Done New Done false
12045 2625 Acked 3624 Write 4 Done New Done false
12046 2626 Acked 3625 Read 4 Done New Done false
12047 2627 Acked 3626 Write 8 Done New Done false
12048 2628 Acked 3627 Write 7 Done New Done false
12049 2629 Acked 3628 Read 10 Done New Done false
12050 2630 Acked 3629 Write 10 Done New Done false
12051 2631 Acked 3630 Write 1 Done New Done false
12052 2632 Acked 3631 Read 2 Done New Done false
12053 2633 Acked 3632 Write 3 Done New Done false
12054 2634 Acked 3633 Read 6 Done New Done false
12055 2635 Acked 3634 Write 1 Done New Done false
12056 2636 Acked 3635 Write 10 Done New Done false
12057 2637 Acked 3636 Read 1 Done New Done false
12058 2638 Acked 3637 Read 6 Done New Done false
12059 2639 Acked 3638 Read 7 Done New Done false
12060 2640 Acked 3639 Write 4 Done New Done false
12061 2641 Acked 3640 Read 7 Done New Done false
12062 2642 Acked 3641 Read 7 Done New Done false
12063 2643 Acked 3642 Read 1 Done New Done false
12064 2644 Acked 3643 Read 7 Done New Done false
12065 2645 Acked 3644 Flush 0 Done New Done false
12066 2646 Acked 3645 Read 7 Done New Done false
12067 2647 Acked 3646 Read 7 Done New Done false
12068 2648 Acked 3647 Read 6 Done New Done false
12069 2649 Acked 3648 Read 4 Done New Done false
12070 2650 Acked 3649 Write 2 Done New Done false
12071 2651 Acked 3650 Read 10 Done New Done false
12072 2652 Acked 3651 Write 4 Done New Done false
12073 2653 Acked 3652 Read 8 Done New Done false
12074 2654 Acked 3653 Flush 0 Done New Done false
12075 2655 Acked 3654 Write 8 Done New Done false
12076 2656 Acked 3655 Write 5 Done New Done false
12077 2657 Acked 3656 Write 10 Done New Done false
12078 2658 Acked 3657 Read 6 Done New Done false
12079 2659 Acked 3658 Write 6 Done New Done false
12080 2660 Acked 3659 Read 7 Done New Done false
12081 2661 Acked 3660 Write 7 Done New Done false
12082 2662 Acked 3661 Flush 0 Done New Done false
12083 2663 Acked 3662 Write 9 Done New Done false
12084 2664 Acked 3663 Read 8 Done New Done false
12085 2665 Acked 3664 Write 4 Done New Done false
12086 2666 Acked 3665 Read 9 Done New Done false
12087 2667 Acked 3666 Flush 0 Done New Done false
12088 2668 Acked 3667 Read 7 Done New Done false
12089 2669 Acked 3668 Write 10 Done New Done false
12090 2670 Acked 3669 Read 10 Done New Done false
12091 2671 Acked 3670 Flush 0 Done New Done false
12092 2672 Acked 3671 Flush 0 Done New Done false
12093 2673 Acked 3672 Write 3 Done New Done false
12094 2674 Acked 3673 Flush 0 Done New Done false
12095 2675 Acked 3674 Write 9 Done New Done false
12096 2676 Acked 3675 Write 10 Done New Done false
12097 2677 Acked 3676 Read 7 Done New Done false
12098 2678 Acked 3677 Write 3 Done New Done false
12099 2679 Acked 3678 Read 1 Done New Done false
12100 2680 Acked 3679 Read 3 Done New Done false
12101 2681 Acked 3680 Write 4 Done New Done false
12102 2682 Acked 3681 Write 10 Done New Done false
12103 2683 Acked 3682 Read 6 Done New Done false
12104 2684 Acked 3683 Read 7 Done New Done false
12105 2685 Acked 3684 Write 9 Done New Done false
12106 2686 Acked 3685 Write 4 Done New Done false
12107 2687 Acked 3686 Write 4 Done New Done false
12108 2688 Acked 3687 Read 9 Done New Done false
12109 2689 Acked 3688 Read 1 Done New Done false
12110 2690 Acked 3689 Write 3 Done New Done false
12111 2691 Acked 3690 Write 6 Done New Done false
12112 2692 Acked 3691 Read 3 Done New Done false
12113 2693 Acked 3692 Flush 0 Done New Done false
12114 2694 Acked 3693 Write 1 Done New Done false
12115 2695 Acked 3694 Read 10 Done New Done false
12116 2696 Acked 3695 Flush 0 Done New Done false
12117 2697 Acked 3696 Read 3 Done New Done false
12118 2698 Acked 3697 Read 1 Done New Done false
12119 2699 Acked 3698 Read 7 Done New Done false
12120 2700 Acked 3699 Read 3 Done New Done false
12121 2701 Acked 3700 Flush 0 Done New Done false
12122 2702 Acked 3701 Write 4 Done New Done false
12123 2703 Acked 3702 Read 6 Done New Done false
12124 2704 Acked 3703 Write 9 Done New Done false
12125 2705 Acked 3704 Write 1 Done New Done false
12126 2706 Acked 3705 Write 6 Done New Done false
12127 2707 Acked 3706 Read 2 Done New Done false
12128 2708 Acked 3707 Read 4 Done New Done false
12129 2709 Acked 3708 Read 8 Done New Done false
12130 2710 Acked 3709 Read 6 Done New Done false
12131 2711 Acked 3710 Write 3 Done New Done false
12132 2712 Acked 3711 Write 5 Done New Done false
12133 2713 Acked 3712 Read 7 Done New Done false
12134 2714 Acked 3713 Flush 0 Done New Done false
12135 STATES DS:0 DS:1 DS:2 TOTAL
12136 New 0 302 0 302
12137 Sent 0 0 0 0
12138 Done 302 0 302 604
12139 Skipped 0 0 0 0
12140 Error 0 0 0 0
12141 Last Flush: 3713 3411 3713
12142 Downstairs last five completed: 3411 3410 3409 3408 3407
12143 Upstairs last five completed: 2714 2713 2712 2711 2710
12144 CLIENT: Up:0 ds:302 act:2
121452024-04-20T01:07:36.589ZINFOcrucible: connecting to 127.0.0.1:8820 = io task client = 1 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
121462024-04-20T01:07:36.589ZINFOcrucible: ds_connection connected from Ok(127.0.0.1:37947) = io task client = 1 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
121472024-04-20T01:07:36.591ZINFOcrucible: downstairs client at Some(127.0.0.1:8820) has region UUID 12345678-0000-0000-0000-000000008820 = downstairs client = 1 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
121482024-04-20T01:07:36.591ZINFOcrucible: Returning UUID:12345678-0000-0000-0000-000000008820 matches = downstairs client = 1 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
121492024-04-20T01:07:36.591ZINFOcrucible: send last flush ID to this DS: 3411 = downstairs client = 1 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
121502024-04-20T01:07:36.591ZINFOcrucible: Replied this last flush ID: 3411 = downstairs client = 1 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
121512024-04-20T01:07:36.591ZINFOcrucible: ds_transition from Offline to Replay = downstairs client = 1 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
121522024-04-20T01:07:36.591ZINFOcrucible: [1] Transition from Offline to Replay = downstairs client = 1 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
121532024-04-20T01:07:36.591ZINFOcrucible: ds_transition from Replay to Active = downstairs client = 1 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
121542024-04-20T01:07:36.591ZINFOcrucible: [1] Transition from Replay to Active = downstairs client = 1 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
12155 ----------------------------------------------------------------
12156 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:0
12157 Downstairs last five completed: 3713 3712 3711 3710 3709
12158 Upstairs last five completed: 2714 2713 2712 2711 2710
12159 CLIENT: Up:0 ds:0 act:3
12160 Replay: All jobs finished, all DS active.
12161 Main task has work to do, go find it
12162 got dsc Stop(0)
12163 stop 0
12164 Apr 20 01:07:38.982 INFO request completed, latency_us: 322, response_code: 204, uri:[8810] Got stop action so:false kr:false
12165 /stop/cid/0, method: POST, req_id: 23a36832-639f-4b4f-9840-9549f40902fc, remote_addr: 127.0.0.1:60352, local_addr: 127.0.0.1:9998
121662024-04-20T01:07:38.983ZWARNcrucible: downstairs disconnected = io task client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
121672024-04-20T01:07:38.983ZWARNcrucible: client task is sending Done(Finished) = io task client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
121682024-04-20T01:07:38.983ZWARNcrucible: downstairs task for 0 stopped due to Finished session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
12169 Apr 20 01:07:38.983 INFO request completed, latency_us:{"msg":"Gone missing, transition from Active to Offline","v":0,"name":"crucible","level":30,"time":"2024-04-20T01:07:38.983517255Z","hostname":"w-01HVWGBJP7HK0H9TQ26T6N3X8M","pid":1196,"client":"0","":"downstairs","session_id":"132b460a-26a0-4532-b1ab-4f8c07d4c6c7"}
12170 120, response_code: 200, uri: /state/cid/0, method: GET, req_id: e34e52c8-2c69-4e2d-9d67-50d2744b4f39, remote_addr: 127.0.0.1:60352{"msg":"[0] client re-new 0 jobs since flush 3713","v":0,"name":"crucible","level":30,"time":"2024-04-20T01:07:38.983570253Z","hostname":"w-01HVWGBJP7HK0H9TQ26T6N3X8M","pid":1196,"":"downstairs","":"downstairs","session_id":"132b460a-26a0-4532-b1ab-4f8c07d4c6c7"}
12171 , local_addr: 127.0.{"msg":"[0] Marked 0 jobs for replay since flush: 3713","v":0,"name":"crucible","level":30,"time":"2024-04-20T01:07:38.983601953Z","hostname":"w-01HVWGBJP7HK0H9TQ26T6N3X8M","pid":1196,"":"downstairs","":"downstairs","session_id":"132b460a-26a0-4532-b1ab-4f8c07d4c6c7"}
12172 0.1:9998
121732024-04-20T01:07:38.983ZINFOcrucible: client task is exiting = io task client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
12174 [8810] Exited with: ExitStatus(unix_wait_status(9))
12175 [8810][0] reports Exit
12176 Apr 20 01:07:42.986 INFO request completed, latency_us: 195, response_code: 200, uri: /state/cid/0, method: GET, req_id: df3586a4-1a4c-4cfe-adc7-6d59f9de05ab, remote_addr: 127.0.0.1:60352, local_addr: 127.0.0.1:9998
12177 001/300 Write block 2746 len 8192 data: 2 2
12178 002/300 Read block 2189 len 40960
12179 003/300 Read block 2540 len 40960
12180 004/300 Read block 1297 len 16384
12181 005/300 Write block 3746 len 8192 data: 3 3
12182 006/300 Flush
12183 007/300 Write block 2971 len 20480 data: 3 3 3 3 3
12184 008/300 Flush
12185 009/300 Read block 3116 len 24576
12186 010/300 Read block 3704 len 16384
12187 011/300 Read block 948 len 28672
12188 012/300 Write block 3284 len 8192 data: 4 4
12189 013/300 Read block 2132 len 36864
12190 014/300 Flush
12191 015/300 Flush
12192 016/300 Read block 2954 len 12288
12193 017/300 Read block 4642 len 12288
12194 018/300 Write block 2853 len 16384 data: 2 2 2 2
12195 019/300 Flush
12196 020/300 Read block 4630 len 4096
12197 021/300 Read block 1540 len 28672
12198 022/300 Read block 4065 len 4096
12199 023/300 Write block 2577 len 12288 data: 2 3 3
12200 024/300 Read block 1417 len 28672
12201 025/300 Flush
12202 026/300 Read block 2402 len 20480
12203 027/300 Write block 2496 len 40960 data: 2 2 3 3 3 3 3 3 4 4
12204 028/300 Read block 3271 len 28672
12205 029/300 Read block 1114 len 24576
12206 030/300 Read block 1779 len 20480
12207 031/300 Read block 4731 len 16384
12208 032/300 Read block 206 len 12288
12209 033/300 Write block 126 len 12288 data: 3 3 3
12210 034/300 Write block 2508 len 20480 data: 2 2 3 3 3
12211 035/300 Read block 1043 len 36864
12212 036/300 Read block 4378 len 20480
12213 037/300 Flush
12214 038/300 Read block 2921 len 4096
12215 039/300 Read block 2871 len 24576
12216 040/300 Write block 913 len 8192 data: 3 3
12217 041/300 Read block 3522 len 24576
12218 042/300 Write block 3785 len 28672 data: 2 2 2 2 3 3 3
12219 043/300 Read block 944 len 4096
12220 044/300 Read block 1533 len 4096
12221 045/300 Read block 2931 len 40960
12222 046/300 Write block 3536 len 24576 data: 3 3 3 3 2 2
12223 047/300 Flush
12224 048/300 Write block 58 len 16384 data: 2 2 3 4
12225 049/300 Read block 4734 len 36864
12226 050/300 Read block 2272 len 32768
12227 051/300 Write block 1572 len 20480 data: 3 3 3 2 2
12228 052/300 Read block 3018 len 32768
12229 053/300 Write block 2398 len 16384 data: 3 3 3 3
12230 054/300 Read block 320 len 32768
12231 055/300 Write block 1043 len 24576 data: 4 4 4 4 4 3
12232 056/300 Read block 4275 len 40960
12233 057/300 Read block 559 len 12288
12234 058/300 Write block 3021 len 20480 data: 4 4 5 6 6
12235 059/300 Read block 1605 len 28672
12236 060/300 Read block 3936 len 36864
12237 061/300 Write block 3701 len 16384 data: 4 4 4 4
12238 062/300 Write block 3954 len 24576 data: 4 4 5 5 5 5
12239 063/300 Read block 4801 len 36864
12240 064/300 Read block 1513 len 16384
12241 065/300 Read block 3666 len 28672
12242 066/300 Write block 4714 len 4096 data: 3
12243 067/300 Read block 3336 len 28672
12244 068/300 Flush
12245 069/300 Read block 4302 len 40960
12246 070/300 Read block 2470 len 24576
12247 071/300 Write block 3011 len 8192 data: 4 3
12248 072/300 Write block 1038 len 12288 data: 2 2 2
12249 073/300 Flush
12250 074/300 Read block 572 len 4096
12251 075/300 Read block 1131 len 4096
12252 076/300 Read block 1149 len 32768
12253 077/300 Flush
12254 078/300 Write block 4090 len 32768 data: 2 2 2 2 2 2 2 2
12255 079/300 Write block 513 len 32768 data: 3 2 3 3 3 4 4 4
12256 080/300 Read block 2770 len 20480
12257 081/300 Read block 4275 len 4096
12258 082/300 Write block 2741 len 24576 data: 2 3 3 3 2 3
12259 083/300 Read block 2292 len 4096
12260 084/300 Read block 844 len 8192
12261 085/300 Read block 3283 len 16384
12262 086/300 Write block 1168 len 36864 data: 2 2 2 2 3 3 3 3 3
12263 087/300 Read block 4806 len 16384
12264 088/300 Read block 3769 len 28672
12265 089/300 Read block 2587 len 16384
12266 090/300 Read block 4883 len 36864
12267 091/300 Write block 2193 len 24576 data: 3 3 3 3 3 3
12268 092/300 Read block 1155 len 20480
12269 093/300 Read block 1171 len 4096
12270 094/300 Read block 990 len 16384
12271 095/300 Read block 137 len 24576
12272 096/300 Write block 4861 len 8192 data: 5 4
12273 097/300 Write block 2988 len 24576 data: 4 4 4 4 5 7
12274 098/300 Write block 1928 len 36864 data: 2 2 2 2 2 2 2 2 2
12275 099/300 Read block 2006 len 12288
12276 100/300 Read block 3775 len 16384
12277 101/300 Read block 665 len 40960
12278 102/300 Read block 4982 len 12288
12279 103/300 Write block 1517 len 28672 data: 4 5 5 5 4 4 3
12280 104/300 Read block 4648 len 36864
12281 105/300 Write block 4152 len 40960 data: 3 2 2 2 2 2 2 2 2 2
12282 106/300 Read block 2356 len 36864
12283 107/300 Write block 1704 len 20480 data: 2 2 3 5 6
12284 108/300 Read block 2993 len 16384
12285 109/300 Write block 1316 len 4096 data: 2
12286 110/300 Read block 3840 len 40960
12287 111/300 Read block 1452 len 32768
12288 112/300 Read block 276 len 28672
12289 113/300 Write block 1493 len 20480 data: 2 2 3 3 4
12290 114/300 Write block 1972 len 4096 data: 2
12291 115/300 Write block 112 len 28672 data: 3 4 4 4 4 3 2
12292 116/300 Write block 3513 len 20480 data: 2 3 4 4 4
12293 117/300 Write block 2762 len 12288 data: 2 2 2
12294 118/300 Flush
12295 119/300 Write block 4452 len 8192 data: 4 4
12296 120/300 Write block 1056 len 8192 data: 4 4
12297 121/300 Read block 4593 len 32768
12298 122/300 Read block 3496 len 28672
12299 123/300 Read block 3471 len 20480
12300 124/300 Write block 2017 len 40960 data: 3 3 4 4 4 5 6 5 4 4
12301 125/300 Read block 1596 len 4096
12302 126/300 Read block 61 len 12288
12303 127/300 Read block 4634 len 40960
12304 128/300 Write block 4948 len 20480 data: 3 2 3 2 3
12305 129/300 Read block 4071 len 40960
12306 130/300 Flush
12307 131/300 Write block 1902 len 8192 data: 3 4
12308 132/300 Read block 3335 len 8192
12309 133/300 Read block 4684 len 24576
12310 134/300 Read block 3553 len 20480
12311 135/300 Read block 273 len 32768
12312 136/300 Read block 1411 len 12288
12313 137/300 Read block 4313 len 24576
12314 138/300 Write block 12 len 16384 data: 4 5 5 5
12315 139/300 Write block 4426 len 16384 data: 2 2 2 2
12316 140/300 Write block 2178 len 12288 data: 3 2 2
12317 141/300 Read block 3705 len 36864
12318 142/300 Flush
12319 143/300 Read block 902 len 32768
12320 144/300 Write block 2449 len 40960 data: 3 2 2 2 2 2 2 2 2 3
12321 145/300 Read block 3616 len 20480
12322 146/300 Write block 3432 len 20480 data: 7 6 5 5 3
12323 147/300 Write block 2089 len 20480 data: 4 5 6 6 7
12324 148/300 Write block 91 len 16384 data: 4 4 3 3
12325 149/300 Flush
12326 150/300 Write block 2801 len 36864 data: 2 2 2 3 3 3 3 3 3
12327 151/300 Write block 426 len 20480 data: 3 3 2 2 3
12328 152/300 Read block 35 len 40960
12329 153/300 Read block 3076 len 8192
12330 154/300 Read block 555 len 40960
12331 155/300 Write block 1123 len 40960 data: 4 5 5 5 7 6 7 5 5 4
12332 156/300 Read block 2506 len 28672
12333 157/300 Read block 2590 len 4096
12334 158/300 Read block 4027 len 20480
12335 159/300 Write block 625 len 12288 data: 4 3 2
12336 160/300 Write block 2085 len 16384 data: 4 6 4 3
12337 161/300 Read block 1455 len 28672
12338 162/300 Read block 2078 len 12288
12339 163/300 Read block 900 len 12288
12340 164/300 Write block 1738 len 28672 data: 3 3 2 2 2 3 3
12341 165/300 Read block 3392 len 24576
12342 166/300 Read block 410 len 40960
12343 167/300 Write block 2089 len 16384 data: 5 6 7 7
12344 168/300 Flush
12345 169/300 Read block 4625 len 20480
12346 170/300 Write block 2431 len 36864 data: 3 2 2 2 2 2 2 2 2
12347 171/300 Read block 2425 len 28672
12348 172/300 Write block 1295 len 4096 data: 2
12349 173/300 Read block 3689 len 16384
12350 174/300 Read block 2334 len 16384
12351 175/300 Write block 1396 len 8192 data: 3 3
12352 176/300 Flush
12353 177/300 Flush
12354 178/300 Read block 3486 len 4096
12355 179/300 Read block 3783 len 36864
12356 180/300 Read block 2969 len 40960
12357 181/300 Read block 3990 len 32768
12358 182/300 Read block 3675 len 36864
12359 183/300 Read block 391 len 32768
12360 184/300 Read block 3897 len 16384
12361 185/300 Read block 4958 len 40960
12362 186/300 Read block 1159 len 12288
12363 187/300 Read block 2076 len 28672
12364 188/300 Read block 11 len 32768
12365 189/300 Write block 3233 len 20480 data: 2 2 2 2 2
12366 190/300 Flush
12367 191/300 Write block 295 len 8192 data: 3 3
12368 192/300 Read block 2128 len 32768
12369 193/300 Write block 346 len 4096 data: 3
12370 194/300 Write block 2804 len 4096 data: 4
12371 195/300 Flush
12372 196/300 Read block 200 len 32768
12373 197/300 Write block 3067 len 8192 data: 2 2
12374 198/300 Write block 119 len 20480 data: 2 2 3 3 3
12375 199/300 Write block 2937 len 32768 data: 2 2 2 2 2 2 2 3
12376 200/300 Write block 2542 len 36864 data: 3 2 2 2 2 2 2 2 3
12377 201/300 Read block 2929 len 16384
12378 202/300 Read block 4545 len 16384
12379 203/300 Read block 3375 len 16384
12380 204/300 Read block 963 len 12288
12381 205/300 Read block 4221 len 40960
12382 206/300 Write block 2350 len 28672 data: 4 3 3 2 2 4 4
12383 207/300 Write block 83 len 28672 data: 3 3 4 5 6 5 5
12384 208/300 Write block 2644 len 20480 data: 5 5 5 5 4
12385 209/300 Read block 4093 len 40960
12386 210/300 Read block 3264 len 8192
12387 211/300 Read block 4524 len 20480
12388 212/300 Write block 4938 len 24576 data: 2 2 3 2 3 4
12389 213/300 Read block 2092 len 36864
12390 214/300 Read block 1145 len 36864
12391 215/300 Read block 1790 len 36864
12392 216/300 Read block 3752 len 8192
12393 217/300 Read block 798 len 12288
12394 218/300 Read block 2314 len 36864
12395 219/300 Read block 686 len 4096
12396 220/300 Read block 543 len 28672
12397 221/300 Read block 3242 len 32768
12398 222/300 Read block 1058 len 32768
12399 223/300 Read block 171 len 4096
12400 224/300 Flush
12401 225/300 Read block 2685 len 24576
12402 226/300 Read block 4352 len 24576
12403 227/300 Write block 3245 len 32768 data: 2 2 2 2 2 2 2 2
12404 228/300 Read block 1039 len 4096
12405 229/300 Flush
12406 230/300 Read block 306 len 16384
12407 231/300 Read block 3248 len 32768
12408 232/300 Write block 1385 len 4096 data: 4
12409 233/300 Read block 2614 len 36864
12410 234/300 Write block 4788 len 12288 data: 3 3 2
12411 235/300 Read block 4016 len 20480
12412 236/300 Read block 689 len 16384
12413 237/300 Write block 158 len 20480 data: 2 2 2 2 2
12414 238/300 Write block 4700 len 16384 data: 3 4 4 4
12415 239/300 Read block 3346 len 24576
12416 240/300 Write block 4254 len 28672 data: 5 5 4 3 3 3 3
12417 241/300 Write block 2343 len 24576 data: 2 2 2 3 3 6
12418 242/300 Write block 2796 len 32768 data: 3 3 3 5 2 3 3 3
12419 243/300 Write block 3530 len 4096 data: 3
12420 244/300 Read block 3917 len 20480
12421 245/300 Write block 4315 len 28672 data: 4 4 4 4 4 3 3
12422 246/300 Write block 2340 len 24576 data: 2 2 2 3 3 3
12423 247/300 Read block 1557 len 12288
12424 248/300 Read block 483 len 20480
12425 249/300 Read block 176 len 36864
12426 250/300 Read block 925 len 12288
12427 251/300 Flush
12428 252/300 Read block 3380 len 8192
12429 253/300 Read block 1333 len 20480
12430 254/300 Write block 2938 len 4096 data: 3
12431 255/300 Write block 1832 len 20480 data: 4 4 3 4 3
12432 256/300 Write block 452 len 16384 data: 4 5 4 3
12433 257/300 Write block 325 len 24576 data: 5 3 3 3 3 2
12434 258/300 Write block 4898 len 8192 data: 3 3
12435 259/300 Read block 3094 len 12288
12436 260/300 Read block 4453 len 32768
12437 261/300 Read block 2455 len 24576
12438 262/300 Read block 2903 len 20480
12439 263/300 Read block 1629 len 4096
12440 264/300 Read block 601 len 28672
12441 265/300 Write block 2980 len 20480 data: 3 3 4 4 4
12442 266/300 Read block 1505 len 24576
12443 267/300 Read block 4505 len 40960
12444 268/300 Write block 4114 len 24576 data: 4 3 3 2 2 2
12445 269/300 Write block 43 len 16384 data: 3 3 3 3
12446 270/300 Read block 3266 len 32768
12447 271/300 Read block 3892 len 40960
12448 272/300 Write block 540 len 36864 data: 2 2 2 3 3 2 2 2 2
12449 273/300 Flush
12450 274/300 Write block 1442 len 16384 data: 5 3 4 5
12451 275/300 Write block 2246 len 24576 data: 3 3 3 3 2 2
12452 276/300 Flush
12453 277/300 Read block 3490 len 40960
12454 278/300 Flush
12455 279/300 Write block 2287 len 24576 data: 2 3 3 3 3 3
12456 280/300 Write block 2331 len 28672 data: 2 2 2 3 3 3 2
12457 281/300 Read block 4967 len 28672
12458 282/300 Write block 3119 len 8192 data: 3 3
12459 283/300 Read block 541 len 8192
12460 284/300 Write block 733 len 36864 data: 3 3 3 3 2 2 2 2 2
12461 285/300 Read block 526 len 28672
12462 286/300 Write block 2867 len 4096 data: 4
12463 287/300 Read block 4562 len 4096
12464 288/300 Read block 4301 len 4096
12465 289/300 Write block 2696 len 24576 data: 2 2 2 2 2 2
12466 290/300 Read block 4148 len 40960
12467 291/300 Flush
12468 292/300 Write block 1356 len 16384 data: 2 2 3 5
12469 293/300 Read block 1541 len 4096
12470 294/300 Read block 2068 len 36864
12471 295/300 Write block 2226 len 20480 data: 3 3 3 3 3
12472 296/300 Read block 2846 len 8192
12473 297/300 Write block 3996 len 12288 data: 3 4 4
12474 298/300 Read block 646 len 32768
12475 299/300 Flush
12476 300/300 Write block 4269 len 20480 data: 3 3 3 3 4
12477 Main task has work to do, go find it
12478 got dsc Start(0)
12479 start 0
12480 Apr 20 01:07:43.281 INFO request completed, latency_us: 206, response_code: 204, uri: /start/cid/0, method: POST, req_id: e5d7883c-d9fb-49b6-b7b2-fa288806a2a8, remote_addr: 127.0.0.1:60352, local_addr: 127.0.0.1:9998
12481 Replay: started 0, returned:Ok(())
12482 ----------------------------------------------------------------
12483 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:300
12484 States: Offline Active Active
12485 GW_ID ACK DSID TYPE BLOCKS DS:0 DS:1 DS:2 REPLAY
12486 2715 Acked 3714 Write 2 New Done Done false
12487 2716 Acked 3715 Read 10 New Done Done false
12488 2717 Acked 3716 Read 10 New Done Done false
12489 2718 Acked 3717 Read 4 New Done Done false
12490 2719 Acked 3718 Write 2 New Done Done false
12491 2720 Acked 3719 Flush 0 New Done Done false
12492 2721 Acked 3720 Write 5 New Done Done false
12493 2722 Acked 3721 Flush 0 New Done Done false
12494 2723 Acked 3722 Read 6 New Done Done false
12495 2724 Acked 3723 Read 4 New Done Done false
12496 2725 Acked 3724 Read 7 New Done Done false
12497 2726 Acked 3725 Write 2 New Done Done false
12498 2727 Acked 3726 Read 9 New Done Done false
12499 2728 Acked 3727 Flush 0 New Done Done false
12500 2729 Acked 3728 Flush 0 New Done Done false
12501 2730 Acked 3729 Read 3 New Done Done false
12502 2731 Acked 3730 Read 3 New Done Done false
12503 2732 Acked 3731 Write 4 New Done Done false
12504 2733 Acked 3732 Flush 0 New Done Done false
12505 2734 Acked 3733 Read 1 New Done Done false
12506 2735 Acked 3734 Read 7 New Done Done false
12507 2736 Acked 3735 Read 1 New Done Done false
12508 2737 Acked 3736 Write 3 New Done Done false
12509 2738 Acked 3737 Read 7 New Done Done false
12510 2739 Acked 3738 Flush 0 New Done Done false
12511 2740 Acked 3739 Read 5 New Done Done false
12512 2741 Acked 3740 Write 10 New Done Done false
12513 2742 Acked 3741 Read 7 New Done Done false
12514 2743 Acked 3742 Read 6 New Done Done false
12515 2744 Acked 3743 Read 5 New Done Done false
12516 2745 Acked 3744 Read 4 New Done Done false
12517 2746 Acked 3745 Read 3 New Done Done false
12518 2747 Acked 3746 Write 3 New Done Done false
12519 2748 Acked 3747 Write 5 New Done Done false
12520 2749 Acked 3748 Read 9 New Done Done false
12521 2750 Acked 3749 Read 5 New Done Done false
12522 2751 Acked 3750 Flush 0 New Done Done false
12523 2752 Acked 3751 Read 1 New Done Done false
12524 2753 Acked 3752 Read 6 New Done Done false
12525 2754 Acked 3753 Write 2 New Done Done false
12526 2755 Acked 3754 Read 6 New Done Done false
12527 2756 Acked 3755 Write 7 New Done Done false
12528 2757 Acked 3756 Read 1 New Done Done false
12529 2758 Acked 3757 Read 1 New Done Done false
12530 2759 Acked 3758 Read 10 New Done Done false
12531 2760 Acked 3759 Write 6 New Done Done false
12532 2761 Acked 3760 Flush 0 New Done Done false
12533 2762 Acked 3761 Write 4 New Done Done false
12534 2763 Acked 3762 Read 9 New Done Done false
12535 2764 Acked 3763 Read 8 New Done Done false
12536 2765 Acked 3764 Write 5 New Done Done false
12537 2766 Acked 3765 Read 8 New Done Done false
12538 2767 Acked 3766 Write 4 New Done Done false
12539 2768 Acked 3767 Read 8 New Done Done false
12540 2769 Acked 3768 Write 6 New Done Done false
12541 2770 Acked 3769 Read 10 New Done Done false
12542 2771 Acked 3770 Read 3 New Done Done false
12543 2772 Acked 3771 Write 5 New Done Done false
12544 2773 Acked 3772 Read 7 New Done Done false
12545 2774 Acked 3773 Read 9 New Done Done false
12546 2775 Acked 3774 Write 4 New Done Done false
12547 2776 Acked 3775 Write 6 New Done Done false
12548 2777 Acked 3776 Read 9 New Done Done false
12549 2778 Acked 3777 Read 4 New Done Done false
12550 2779 Acked 3778 Read 7 New Done Done false
12551 2780 Acked 3779 Write 1 New Done Done false
12552 2781 Acked 3780 Read 7 New Done Done false
12553 2782 Acked 3781 Flush 0 New Done Done false
12554 2783 Acked 3782 Read 10 New Done Done false
12555 2784 Acked 3783 Read 6 New Done Done false
12556 2785 Acked 3784 Write 2 New Done Done false
12557 2786 Acked 3785 Write 3 New Done Done false
12558 2787 Acked 3786 Flush 0 New Done Done false
12559 2788 Acked 3787 Read 1 New Done Done false
12560 2789 Acked 3788 Read 1 New Done Done false
12561 2790 Acked 3789 Read 8 New Done Done false
12562 2791 Acked 3790 Flush 0 New Done Done false
12563 2792 Acked 3791 Write 8 New Done Done false
12564 2793 Acked 3792 Write 8 New Done Done false
12565 2794 Acked 3793 Read 5 New Done Done false
12566 2795 Acked 3794 Read 1 New Done Done false
12567 2796 Acked 3795 Write 6 New Done Done false
12568 2797 Acked 3796 Read 1 New Done Done false
12569 2798 Acked 3797 Read 2 New Done Done false
12570 2799 Acked 3798 Read 4 New Done Done false
12571 2800 Acked 3799 Write 9 New Done Done false
12572 2801 Acked 3800 Read 4 New Done Done false
12573 2802 Acked 3801 Read 7 New Done Done false
12574 2803 Acked 3802 Read 4 New Done Done false
12575 2804 Acked 3803 Read 9 New Done Done false
12576 2805 Acked 3804 Write 6 New Done Done false
12577 2806 Acked 3805 Read 5 New Done Done false
12578 2807 Acked 3806 Read 1 New Done Done false
12579 2808 Acked 3807 Read 4 New Done Done false
12580 2809 Acked 3808 Read 6 New Done Done false
12581 2810 Acked 3809 Write 2 New Done Done false
12582 2811 Acked 3810 Write 6 New Done Done false
12583 2812 Acked 3811 Write 9 New Done Done false
12584 2813 Acked 3812 Read 3 New Done Done false
12585 2814 Acked 3813 Read 4 New Done Done false
12586 2815 Acked 3814 Read 10 New Done Done false
12587 2816 Acked 3815 Read 3 New Done Done false
12588 2817 Acked 3816 Write 7 New Done Done false
12589 2818 Acked 3817 Read 9 New Done Done false
12590 2819 Acked 3818 Write 10 New Done Done false
12591 2820 Acked 3819 Read 9 New Done Done false
12592 2821 Acked 3820 Write 5 New Done Done false
12593 2822 Acked 3821 Read 4 New Done Done false
12594 2823 Acked 3822 Write 1 New Done Done false
12595 2824 Acked 3823 Read 10 New Done Done false
12596 2825 Acked 3824 Read 8 New Done Done false
12597 2826 Acked 3825 Read 7 New Done Done false
12598 2827 Acked 3826 Write 5 New Done Done false
12599 2828 Acked 3827 Write 1 New Done Done false
12600 2829 Acked 3828 Write 7 New Done Done false
12601 2830 Acked 3829 Write 5 New Done Done false
12602 2831 Acked 3830 Write 3 New Done Done false
12603 2832 Acked 3831 Flush 0 New Done Done false
12604 2833 Acked 3832 Write 2 New Done Done false
12605 2834 Acked 3833 Write 2 New Done Done false
12606 2835 Acked 3834 Read 8 New Done Done false
12607 2836 Acked 3835 Read 7 New Done Done false
12608 2837 Acked 3836 Read 5 New Done Done false
12609 2838 Acked 3837 Write 10 New Done Done false
12610 2839 Acked 3838 Read 1 New Done Done false
12611 2840 Acked 3839 Read 3 New Done Done false
12612 2841 Acked 3840 Read 10 New Done Done false
12613 2842 Acked 3841 Write 5 New Done Done false
12614 2843 Acked 3842 Read 10 New Done Done false
12615 2844 Acked 3843 Flush 0 New Done Done false
12616 2845 Acked 3844 Write 2 New Done Done false
12617 2846 Acked 3845 Read 2 New Done Done false
12618 2847 Acked 3846 Read 6 New Done Done false
12619 2848 Acked 3847 Read 5 New Done Done false
12620 2849 Acked 3848 Read 8 New Done Done false
12621 2850 Acked 3849 Read 3 New Done Done false
12622 2851 Acked 3850 Read 6 New Done Done false
12623 2852 Acked 3851 Write 4 New Done Done false
12624 2853 Acked 3852 Write 4 New Done Done false
12625 2854 Acked 3853 Write 3 New Done Done false
12626 2855 Acked 3854 Read 9 New Done Done false
12627 2856 Acked 3855 Flush 0 New Done Done false
12628 2857 Acked 3856 Read 8 New Done Done false
12629 2858 Acked 3857 Write 10 New Done Done false
12630 2859 Acked 3858 Read 5 New Done Done false
12631 2860 Acked 3859 Write 5 New Done Done false
12632 2861 Acked 3860 Write 5 New Done Done false
12633 2862 Acked 3861 Write 4 New Done Done false
12634 2863 Acked 3862 Flush 0 New Done Done false
12635 2864 Acked 3863 Write 9 New Done Done false
12636 2865 Acked 3864 Write 5 New Done Done false
12637 2866 Acked 3865 Read 10 New Done Done false
12638 2867 Acked 3866 Read 2 New Done Done false
12639 2868 Acked 3867 Read 10 New Done Done false
12640 2869 Acked 3868 Write 10 New Done Done false
12641 2870 Acked 3869 Read 7 New Done Done false
12642 2871 Acked 3870 Read 1 New Done Done false
12643 2872 Acked 3871 Read 5 New Done Done false
12644 2873 Acked 3872 Write 3 New Done Done false
12645 2874 Acked 3873 Write 4 New Done Done false
12646 2875 Acked 3874 Read 7 New Done Done false
12647 2876 Acked 3875 Read 3 New Done Done false
12648 2877 Acked 3876 Read 3 New Done Done false
12649 2878 Acked 3877 Write 7 New Done Done false
12650 2879 Acked 3878 Read 6 New Done Done false
12651 2880 Acked 3879 Read 10 New Done Done false
12652 2881 Acked 3880 Write 4 New Done Done false
12653 2882 Acked 3881 Flush 0 New Done Done false
12654 2883 Acked 3882 Read 5 New Done Done false
12655 2884 Acked 3883 Write 9 New Done Done false
12656 2885 Acked 3884 Read 7 New Done Done false
12657 2886 Acked 3885 Write 1 New Done Done false
12658 2887 Acked 3886 Read 4 New Done Done false
12659 2888 Acked 3887 Read 4 New Done Done false
12660 2889 Acked 3888 Write 2 New Done Done false
12661 2890 Acked 3889 Flush 0 New Done Done false
12662 2891 Acked 3890 Flush 0 New Done Done false
12663 2892 Acked 3891 Read 1 New Done Done false
12664 2893 Acked 3892 Read 9 New Done Done false
12665 2894 Acked 3893 Read 10 New Done Done false
12666 2895 Acked 3894 Read 8 New Done Done false
12667 2896 Acked 3895 Read 9 New Done Done false
12668 2897 Acked 3896 Read 8 New Done Done false
12669 2898 Acked 3897 Read 4 New Done Done false
12670 2899 Acked 3898 Read 10 New Done Done false
12671 2900 Acked 3899 Read 3 New Done Done false
12672 2901 Acked 3900 Read 7 New Done Done false
12673 2902 Acked 3901 Read 8 New Done Done false
12674 2903 Acked 3902 Write 5 New Done Done false
12675 2904 Acked 3903 Flush 0 New Done Done false
12676 2905 Acked 3904 Write 2 New Done Done false
12677 2906 Acked 3905 Read 8 New Done Done false
12678 2907 Acked 3906 Write 1 New Done Done false
12679 2908 Acked 3907 Write 1 New Done Done false
12680 2909 Acked 3908 Flush 0 New Done Done false
12681 2910 Acked 3909 Read 8 New Done Done false
12682 2911 Acked 3910 Write 2 New Done Done false
12683 2912 Acked 3911 Write 5 New Done Done false
12684 2913 Acked 3912 Write 8 New Done Done false
12685 2914 Acked 3913 Write 9 New Done Done false
12686 2915 Acked 3914 Read 4 New Done Done false
12687 2916 Acked 3915 Read 4 New Done Done false
12688 2917 Acked 3916 Read 4 New Done Done false
12689 2918 Acked 3917 Read 3 New Done Done false
12690 2919 Acked 3918 Read 10 New Done Done false
12691 2920 Acked 3919 Write 7 New Done Done false
12692 2921 Acked 3920 Write 7 New Done Done false
12693 2922 Acked 3921 Write 5 New Done Done false
12694 2923 Acked 3922 Read 10 New Done Done false
12695 2924 Acked 3923 Read 2 New Done Done false
12696 2925 Acked 3924 Read 5 New Done Done false
12697 2926 Acked 3925 Write 6 New Done Done false
12698 2927 Acked 3926 Read 9 New Done Done false
12699 2928 Acked 3927 Read 9 New Done Done false
12700 2929 Acked 3928 Read 9 New Done Done false
12701 2930 Acked 3929 Read 2 New Done Done false
12702 2931 Acked 3930 Read 3 New Done Done false
12703 2932 Acked 3931 Read 9 New Done Done false
12704 2933 Acked 3932 Read 1 New Done Done false
12705 2934 Acked 3933 Read 7 New Done Done false
12706 2935 Acked 3934 Read 8 New Done Done false
12707 2936 Acked 3935 Read 8 New Done Done false
12708 2937 Acked 3936 Read 1 New Done Done false
12709 2938 Acked 3937 Flush 0 New Done Done false
12710 2939 Acked 3938 Read 6 New Done Done false
12711 2940 Acked 3939 Read 6 New Done Done false
12712 2941 Acked 3940 Write 8 New Done Done false
12713 2942 Acked 3941 Read 1 New Done Done false
12714 2943 Acked 3942 Flush 0 New Done Done false
12715 2944 Acked 3943 Read 4 New Done Done false
12716 2945 Acked 3944 Read 8 New Done Done false
12717 2946 Acked 3945 Write 1 New Done Done false
12718 2947 Acked 3946 Read 9 New Done Done false
12719 2948 Acked 3947 Write 3 New Done Done false
12720 2949 Acked 3948 Read 5 New Done Done false
12721 2950 Acked 3949 Read 4 New Done Done false
12722 2951 Acked 3950 Write 5 New Done Done false
12723 2952 Acked 3951 Write 4 New Done Done false
12724 2953 Acked 3952 Read 6 New Done Done false
12725 2954 Acked 3953 Write 7 New Done Done false
12726 2955 Acked 3954 Write 6 New Done Done false
12727 2956 Acked 3955 Write 8 New Done Done false
12728 2957 Acked 3956 Write 1 New Done Done false
12729 2958 Acked 3957 Read 5 New Done Done false
12730 2959 Acked 3958 Write 7 New Done Done false
12731 2960 Acked 3959 Write 6 New Done Done false
12732 2961 Acked 3960 Read 3 New Done Done false
12733 2962 Acked 3961 Read 5 New Done Done false
12734 2963 Acked 3962 Read 9 New Done Done false
12735 2964 Acked 3963 Read 3 New Done Done false
12736 2965 Acked 3964 Flush 0 New Done Done false
12737 2966 Acked 3965 Read 2 New Done Done false
12738 2967 Acked 3966 Read 5 New Done Done false
12739 2968 Acked 3967 Write 1 New Done Done false
12740 2969 Acked 3968 Write 5 New Done Done false
12741 2970 Acked 3969 Write 4 New Done Done false
12742 2971 Acked 3970 Write 6 New Done Done false
12743 2972 Acked 3971 Write 2 New Done Done false
12744 2973 Acked 3972 Read 3 New Done Done false
12745 2974 Acked 3973 Read 8 New Done Done false
12746 2975 Acked 3974 Read 6 New Done Done false
12747 2976 Acked 3975 Read 5 New Done Done false
12748 2977 Acked 3976 Read 1 New Done Done false
12749 2978 Acked 3977 Read 7 New Done Done false
12750 2979 Acked 3978 Write 5 New Done Done false
12751 2980 Acked 3979 Read 6 New Done Done false
12752 2981 Acked 3980 Read 10 New Done Done false
12753 2982 Acked 3981 Write 6 New Done Done false
12754 2983 Acked 3982 Write 4 New Done Done false
12755 2984 Acked 3983 Read 8 New Done Done false
12756 2985 Acked 3984 Read 10 New Done Done false
12757 2986 Acked 3985 Write 9 New Done Done false
12758 2987 Acked 3986 Flush 0 New Done Done false
12759 2988 Acked 3987 Write 4 New Done Done false
12760 2989 Acked 3988 Write 6 New Done Done false
12761 2990 Acked 3989 Flush 0 New Done Done false
12762 2991 Acked 3990 Read 10 New Done Done false
12763 2992 Acked 3991 Flush 0 New Done Done false
12764 2993 Acked 3992 Write 6 New Done Done false
12765 2994 Acked 3993 Write 7 New Done Done false
12766 2995 Acked 3994 Read 7 New Done Done false
12767 2996 Acked 3995 Write 2 New Done Done false
12768 2997 Acked 3996 Read 2 New Done Done false
12769 2998 Acked 3997 Write 9 New Done Done false
12770 2999 Acked 3998 Read 7 New Done Done false
12771 3000 Acked 3999 Write 1 New Done Done false
12772 3001 Acked 4000 Read 1 New Done Done false
12773 3002 Acked 4001 Read 1 New Done Done false
12774 3003 Acked 4002 Write 6 New Done Done false
12775 3004 Acked 4003 Read 10 New Done Done false
12776 3005 Acked 4004 Flush 0 New Done Done false
12777 3006 Acked 4005 Write 4 New Done Done false
12778 3007 Acked 4006 Read 1 New Done Done false
12779 3008 Acked 4007 Read 9 New Done Done false
12780 3009 Acked 4008 Write 5 New Done Done false
12781 3010 Acked 4009 Read 2 New Done Done false
12782 3011 Acked 4010 Write 3 New Done Done false
12783 3012 Acked 4011 Read 8 New Done Done false
12784 3013 Acked 4012 Flush 0 New Done Done false
12785 3014 Acked 4013 Write 5 New Done Done false
12786 STATES DS:0 DS:1 DS:2 TOTAL
12787 New 300 0 0 300
12788 Sent 0 0 0 0
12789 Done 0 300 300 600
12790 Skipped 0 0 0 0
12791 Error 0 0 0 0
12792 Last Flush: 3713 4012 4012
12793 Downstairs last five completed: 3713 3712 3711 3710 3709
12794 Upstairs last five completed: 3014 3013 3012 3011 3010
12795 CLIENT: Up:0 ds:300 act:2
12796 [8810] got start action
12797 [8810] I am going to restart
12798 Starting downstairs at port 8810
12799 Make output file at "/tmp/dsc/downstairs-8810.txt"
12800 [8810][0] reports Starting
12801 Downstairs /var/tmp/dsc/region/8810 port 8810 PID:Some(1206)
12802 [8810][0] reports Running
12803 ----------------------------------------------------------------
12804 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:301
12805 States: Offline Active Active
12806 GW_ID ACK DSID TYPE BLOCKS DS:0 DS:1 DS:2 REPLAY
12807 2715 Acked 3714 Write 2 New Done Done false
12808 2716 Acked 3715 Read 10 New Done Done false
12809 2717 Acked 3716 Read 10 New Done Done false
12810 2718 Acked 3717 Read 4 New Done Done false
12811 2719 Acked 3718 Write 2 New Done Done false
12812 2720 Acked 3719 Flush 0 New Done Done false
12813 2721 Acked 3720 Write 5 New Done Done false
12814 2722 Acked 3721 Flush 0 New Done Done false
12815 2723 Acked 3722 Read 6 New Done Done false
12816 2724 Acked 3723 Read 4 New Done Done false
12817 2725 Acked 3724 Read 7 New Done Done false
12818 2726 Acked 3725 Write 2 New Done Done false
12819 2727 Acked 3726 Read 9 New Done Done false
12820 2728 Acked 3727 Flush 0 New Done Done false
12821 2729 Acked 3728 Flush 0 New Done Done false
12822 2730 Acked 3729 Read 3 New Done Done false
12823 2731 Acked 3730 Read 3 New Done Done false
12824 2732 Acked 3731 Write 4 New Done Done false
12825 2733 Acked 3732 Flush 0 New Done Done false
12826 2734 Acked 3733 Read 1 New Done Done false
12827 2735 Acked 3734 Read 7 New Done Done false
12828 2736 Acked 3735 Read 1 New Done Done false
12829 2737 Acked 3736 Write 3 New Done Done false
12830 2738 Acked 3737 Read 7 New Done Done false
12831 2739 Acked 3738 Flush 0 New Done Done false
12832 2740 Acked 3739 Read 5 New Done Done false
12833 2741 Acked 3740 Write 10 New Done Done false
12834 2742 Acked 3741 Read 7 New Done Done false
12835 2743 Acked 3742 Read 6 New Done Done false
12836 2744 Acked 3743 Read 5 New Done Done false
12837 2745 Acked 3744 Read 4 New Done Done false
12838 2746 Acked 3745 Read 3 New Done Done false
12839 2747 Acked 3746 Write 3 New Done Done false
12840 2748 Acked 3747 Write 5 New Done Done false
12841 2749 Acked 3748 Read 9 New Done Done false
12842 2750 Acked 3749 Read 5 New Done Done false
12843 2751 Acked 3750 Flush 0 New Done Done false
12844 2752 Acked 3751 Read 1 New Done Done false
12845 2753 Acked 3752 Read 6 New Done Done false
12846 2754 Acked 3753 Write 2 New Done Done false
12847 2755 Acked 3754 Read 6 New Done Done false
12848 2756 Acked 3755 Write 7 New Done Done false
12849 2757 Acked 3756 Read 1 New Done Done false
12850 2758 Acked 3757 Read 1 New Done Done false
12851 2759 Acked 3758 Read 10 New Done Done false
12852 2760 Acked 3759 Write 6 New Done Done false
12853 2761 Acked 3760 Flush 0 New Done Done false
12854 2762 Acked 3761 Write 4 New Done Done false
12855 2763 Acked 3762 Read 9 New Done Done false
12856 2764 Acked 3763 Read 8 New Done Done false
12857 2765 Acked 3764 Write 5 New Done Done false
12858 2766 Acked 3765 Read 8 New Done Done false
12859 2767 Acked 3766 Write 4 New Done Done false
12860 2768 Acked 3767 Read 8 New Done Done false
12861 2769 Acked 3768 Write 6 New Done Done false
12862 2770 Acked 3769 Read 10 New Done Done false
12863 2771 Acked 3770 Read 3 New Done Done false
12864 2772 Acked 3771 Write 5 New Done Done false
12865 2773 Acked 3772 Read 7 New Done Done false
12866 2774 Acked 3773 Read 9 New Done Done false
12867 2775 Acked 3774 Write 4 New Done Done false
12868 2776 Acked 3775 Write 6 New Done Done false
12869 2777 Acked 3776 Read 9 New Done Done false
12870 2778 Acked 3777 Read 4 New Done Done false
12871 2779 Acked 3778 Read 7 New Done Done false
12872 2780 Acked 3779 Write 1 New Done Done false
12873 2781 Acked 3780 Read 7 New Done Done false
12874 2782 Acked 3781 Flush 0 New Done Done false
12875 2783 Acked 3782 Read 10 New Done Done false
12876 2784 Acked 3783 Read 6 New Done Done false
12877 2785 Acked 3784 Write 2 New Done Done false
12878 2786 Acked 3785 Write 3 New Done Done false
12879 2787 Acked 3786 Flush 0 New Done Done false
12880 2788 Acked 3787 Read 1 New Done Done false
12881 2789 Acked 3788 Read 1 New Done Done false
12882 2790 Acked 3789 Read 8 New Done Done false
12883 2791 Acked 3790 Flush 0 New Done Done false
12884 2792 Acked 3791 Write 8 New Done Done false
12885 2793 Acked 3792 Write 8 New Done Done false
12886 2794 Acked 3793 Read 5 New Done Done false
12887 2795 Acked 3794 Read 1 New Done Done false
12888 2796 Acked 3795 Write 6 New Done Done false
12889 2797 Acked 3796 Read 1 New Done Done false
12890 2798 Acked 3797 Read 2 New Done Done false
12891 2799 Acked 3798 Read 4 New Done Done false
12892 2800 Acked 3799 Write 9 New Done Done false
12893 2801 Acked 3800 Read 4 New Done Done false
12894 2802 Acked 3801 Read 7 New Done Done false
12895 2803 Acked 3802 Read 4 New Done Done false
12896 2804 Acked 3803 Read 9 New Done Done false
12897 2805 Acked 3804 Write 6 New Done Done false
12898 2806 Acked 3805 Read 5 New Done Done false
12899 2807 Acked 3806 Read 1 New Done Done false
12900 2808 Acked 3807 Read 4 New Done Done false
12901 2809 Acked 3808 Read 6 New Done Done false
12902 2810 Acked 3809 Write 2 New Done Done false
12903 2811 Acked 3810 Write 6 New Done Done false
12904 2812 Acked 3811 Write 9 New Done Done false
12905 2813 Acked 3812 Read 3 New Done Done false
12906 2814 Acked 3813 Read 4 New Done Done false
12907 2815 Acked 3814 Read 10 New Done Done false
12908 2816 Acked 3815 Read 3 New Done Done false
12909 2817 Acked 3816 Write 7 New Done Done false
12910 2818 Acked 3817 Read 9 New Done Done false
12911 2819 Acked 3818 Write 10 New Done Done false
12912 2820 Acked 3819 Read 9 New Done Done false
12913 2821 Acked 3820 Write 5 New Done Done false
12914 2822 Acked 3821 Read 4 New Done Done false
12915 2823 Acked 3822 Write 1 New Done Done false
12916 2824 Acked 3823 Read 10 New Done Done false
12917 2825 Acked 3824 Read 8 New Done Done false
12918 2826 Acked 3825 Read 7 New Done Done false
12919 2827 Acked 3826 Write 5 New Done Done false
12920 2828 Acked 3827 Write 1 New Done Done false
12921 2829 Acked 3828 Write 7 New Done Done false
12922 2830 Acked 3829 Write 5 New Done Done false
12923 2831 Acked 3830 Write 3 New Done Done false
12924 2832 Acked 3831 Flush 0 New Done Done false
12925 2833 Acked 3832 Write 2 New Done Done false
12926 2834 Acked 3833 Write 2 New Done Done false
12927 2835 Acked 3834 Read 8 New Done Done false
12928 2836 Acked 3835 Read 7 New Done Done false
12929 2837 Acked 3836 Read 5 New Done Done false
12930 2838 Acked 3837 Write 10 New Done Done false
12931 2839 Acked 3838 Read 1 New Done Done false
12932 2840 Acked 3839 Read 3 New Done Done false
12933 2841 Acked 3840 Read 10 New Done Done false
12934 2842 Acked 3841 Write 5 New Done Done false
12935 2843 Acked 3842 Read 10 New Done Done false
12936 2844 Acked 3843 Flush 0 New Done Done false
12937 2845 Acked 3844 Write 2 New Done Done false
12938 2846 Acked 3845 Read 2 New Done Done false
12939 2847 Acked 3846 Read 6 New Done Done false
12940 2848 Acked 3847 Read 5 New Done Done false
12941 2849 Acked 3848 Read 8 New Done Done false
12942 2850 Acked 3849 Read 3 New Done Done false
12943 2851 Acked 3850 Read 6 New Done Done false
12944 2852 Acked 3851 Write 4 New Done Done false
12945 2853 Acked 3852 Write 4 New Done Done false
12946 2854 Acked 3853 Write 3 New Done Done false
12947 2855 Acked 3854 Read 9 New Done Done false
12948 2856 Acked 3855 Flush 0 New Done Done false
12949 2857 Acked 3856 Read 8 New Done Done false
12950 2858 Acked 3857 Write 10 New Done Done false
12951 2859 Acked 3858 Read 5 New Done Done false
12952 2860 Acked 3859 Write 5 New Done Done false
12953 2861 Acked 3860 Write 5 New Done Done false
12954 2862 Acked 3861 Write 4 New Done Done false
12955 2863 Acked 3862 Flush 0 New Done Done false
12956 2864 Acked 3863 Write 9 New Done Done false
12957 2865 Acked 3864 Write 5 New Done Done false
12958 2866 Acked 3865 Read 10 New Done Done false
12959 2867 Acked 3866 Read 2 New Done Done false
12960 2868 Acked 3867 Read 10 New Done Done false
12961 2869 Acked 3868 Write 10 New Done Done false
12962 2870 Acked 3869 Read 7 New Done Done false
12963 2871 Acked 3870 Read 1 New Done Done false
12964 2872 Acked 3871 Read 5 New Done Done false
12965 2873 Acked 3872 Write 3 New Done Done false
12966 2874 Acked 3873 Write 4 New Done Done false
12967 2875 Acked 3874 Read 7 New Done Done false
12968 2876 Acked 3875 Read 3 New Done Done false
12969 2877 Acked 3876 Read 3 New Done Done false
12970 2878 Acked 3877 Write 7 New Done Done false
12971 2879 Acked 3878 Read 6 New Done Done false
12972 2880 Acked 3879 Read 10 New Done Done false
12973 2881 Acked 3880 Write 4 New Done Done false
12974 2882 Acked 3881 Flush 0 New Done Done false
12975 2883 Acked 3882 Read 5 New Done Done false
12976 2884 Acked 3883 Write 9 New Done Done false
12977 2885 Acked 3884 Read 7 New Done Done false
12978 2886 Acked 3885 Write 1 New Done Done false
12979 2887 Acked 3886 Read 4 New Done Done false
12980 2888 Acked 3887 Read 4 New Done Done false
12981 2889 Acked 3888 Write 2 New Done Done false
12982 2890 Acked 3889 Flush 0 New Done Done false
12983 2891 Acked 3890 Flush 0 New Done Done false
12984 2892 Acked 3891 Read 1 New Done Done false
12985 2893 Acked 3892 Read 9 New Done Done false
12986 2894 Acked 3893 Read 10 New Done Done false
12987 2895 Acked 3894 Read 8 New Done Done false
12988 2896 Acked 3895 Read 9 New Done Done false
12989 2897 Acked 3896 Read 8 New Done Done false
12990 2898 Acked 3897 Read 4 New Done Done false
12991 2899 Acked 3898 Read 10 New Done Done false
12992 2900 Acked 3899 Read 3 New Done Done false
12993 2901 Acked 3900 Read 7 New Done Done false
12994 2902 Acked 3901 Read 8 New Done Done false
12995 2903 Acked 3902 Write 5 New Done Done false
12996 2904 Acked 3903 Flush 0 New Done Done false
12997 2905 Acked 3904 Write 2 New Done Done false
12998 2906 Acked 3905 Read 8 New Done Done false
12999 2907 Acked 3906 Write 1 New Done Done false
13000 2908 Acked 3907 Write 1 New Done Done false
13001 2909 Acked 3908 Flush 0 New Done Done false
13002 2910 Acked 3909 Read 8 New Done Done false
13003 2911 Acked 3910 Write 2 New Done Done false
13004 2912 Acked 3911 Write 5 New Done Done false
13005 2913 Acked 3912 Write 8 New Done Done false
13006 2914 Acked 3913 Write 9 New Done Done false
13007 2915 Acked 3914 Read 4 New Done Done false
13008 2916 Acked 3915 Read 4 New Done Done false
13009 2917 Acked 3916 Read 4 New Done Done false
13010 2918 Acked 3917 Read 3 New Done Done false
13011 2919 Acked 3918 Read 10 New Done Done false
13012 2920 Acked 3919 Write 7 New Done Done false
13013 2921 Acked 3920 Write 7 New Done Done false
13014 2922 Acked 3921 Write 5 New Done Done false
13015 2923 Acked 3922 Read 10 New Done Done false
13016 2924 Acked 3923 Read 2 New Done Done false
13017 2925 Acked 3924 Read 5 New Done Done false
13018 2926 Acked 3925 Write 6 New Done Done false
13019 2927 Acked 3926 Read 9 New Done Done false
13020 2928 Acked 3927 Read 9 New Done Done false
13021 2929 Acked 3928 Read 9 New Done Done false
13022 2930 Acked 3929 Read 2 New Done Done false
13023 2931 Acked 3930 Read 3 New Done Done false
13024 2932 Acked 3931 Read 9 New Done Done false
13025 2933 Acked 3932 Read 1 New Done Done false
13026 2934 Acked 3933 Read 7 New Done Done false
13027 2935 Acked 3934 Read 8 New Done Done false
13028 2936 Acked 3935 Read 8 New Done Done false
13029 2937 Acked 3936 Read 1 New Done Done false
13030 2938 Acked 3937 Flush 0 New Done Done false
13031 2939 Acked 3938 Read 6 New Done Done false
13032 2940 Acked 3939 Read 6 New Done Done false
13033 2941 Acked 3940 Write 8 New Done Done false
13034 2942 Acked 3941 Read 1 New Done Done false
13035 2943 Acked 3942 Flush 0 New Done Done false
13036 2944 Acked 3943 Read 4 New Done Done false
13037 2945 Acked 3944 Read 8 New Done Done false
13038 2946 Acked 3945 Write 1 New Done Done false
13039 2947 Acked 3946 Read 9 New Done Done false
13040 2948 Acked 3947 Write 3 New Done Done false
13041 2949 Acked 3948 Read 5 New Done Done false
13042 2950 Acked 3949 Read 4 New Done Done false
13043 2951 Acked 3950 Write 5 New Done Done false
13044 2952 Acked 3951 Write 4 New Done Done false
13045 2953 Acked 3952 Read 6 New Done Done false
13046 2954 Acked 3953 Write 7 New Done Done false
13047 2955 Acked 3954 Write 6 New Done Done false
13048 2956 Acked 3955 Write 8 New Done Done false
13049 2957 Acked 3956 Write 1 New Done Done false
13050 2958 Acked 3957 Read 5 New Done Done false
13051 2959 Acked 3958 Write 7 New Done Done false
13052 2960 Acked 3959 Write 6 New Done Done false
13053 2961 Acked 3960 Read 3 New Done Done false
13054 2962 Acked 3961 Read 5 New Done Done false
13055 2963 Acked 3962 Read 9 New Done Done false
13056 2964 Acked 3963 Read 3 New Done Done false
13057 2965 Acked 3964 Flush 0 New Done Done false
13058 2966 Acked 3965 Read 2 New Done Done false
13059 2967 Acked 3966 Read 5 New Done Done false
13060 2968 Acked 3967 Write 1 New Done Done false
13061 2969 Acked 3968 Write 5 New Done Done false
13062 2970 Acked 3969 Write 4 New Done Done false
13063 2971 Acked 3970 Write 6 New Done Done false
13064 2972 Acked 3971 Write 2 New Done Done false
13065 2973 Acked 3972 Read 3 New Done Done false
13066 2974 Acked 3973 Read 8 New Done Done false
13067 2975 Acked 3974 Read 6 New Done Done false
13068 2976 Acked 3975 Read 5 New Done Done false
13069 2977 Acked 3976 Read 1 New Done Done false
13070 2978 Acked 3977 Read 7 New Done Done false
13071 2979 Acked 3978 Write 5 New Done Done false
13072 2980 Acked 3979 Read 6 New Done Done false
13073 2981 Acked 3980 Read 10 New Done Done false
13074 2982 Acked 3981 Write 6 New Done Done false
13075 2983 Acked 3982 Write 4 New Done Done false
13076 2984 Acked 3983 Read 8 New Done Done false
13077 2985 Acked 3984 Read 10 New Done Done false
13078 2986 Acked 3985 Write 9 New Done Done false
13079 2987 Acked 3986 Flush 0 New Done Done false
13080 2988 Acked 3987 Write 4 New Done Done false
13081 2989 Acked 3988 Write 6 New Done Done false
13082 2990 Acked 3989 Flush 0 New Done Done false
13083 2991 Acked 3990 Read 10 New Done Done false
13084 2992 Acked 3991 Flush 0 New Done Done false
13085 2993 Acked 3992 Write 6 New Done Done false
13086 2994 Acked 3993 Write 7 New Done Done false
13087 2995 Acked 3994 Read 7 New Done Done false
13088 2996 Acked 3995 Write 2 New Done Done false
13089 2997 Acked 3996 Read 2 New Done Done false
13090 2998 Acked 3997 Write 9 New Done Done false
13091 2999 Acked 3998 Read 7 New Done Done false
13092 3000 Acked 3999 Write 1 New Done Done false
13093 3001 Acked 4000 Read 1 New Done Done false
13094 3002 Acked 4001 Read 1 New Done Done false
13095 3003 Acked 4002 Write 6 New Done Done false
13096 3004 Acked 4003 Read 10 New Done Done false
13097 3005 Acked 4004 Flush 0 New Done Done false
13098 3006 Acked 4005 Write 4 New Done Done false
13099 3007 Acked 4006 Read 1 New Done Done false
13100 3008 Acked 4007 Read 9 New Done Done false
13101 3009 Acked 4008 Write 5 New Done Done false
13102 3010 Acked 4009 Read 2 New Done Done false
13103 3011 Acked 4010 Write 3 New Done Done false
13104 3012 Acked 4011 Read 8 New Done Done false
13105 3013 Acked 4012 Flush 0 New Done Done false
13106 3014 Acked 4013 Write 5 New Done Done false
13107 3015 Acked 4014 Flush 0 New Done Done false
13108 STATES DS:0 DS:1 DS:2 TOTAL
13109 New 301 0 0 301
13110 Sent 0 0 0 0
13111 Done 0 301 301 602
13112 Skipped 0 0 0 0
13113 Error 0 0 0 0
13114 Last Flush: 3713 4014 4014
13115 Downstairs last five completed: 3713 3712 3711 3710 3709
13116 Upstairs last five completed: 3015 3014 3013 3012 3011
13117 CLIENT: Up:0 ds:301 act:2
131182024-04-20T01:07:48.985ZINFOcrucible: connecting to 127.0.0.1:8810 = io task client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
131192024-04-20T01:07:48.985ZINFOcrucible: ds_connection connected from Ok(127.0.0.1:58251) = io task client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
131202024-04-20T01:07:48.986ZINFOcrucible: downstairs client at Some(127.0.0.1:8810) has region UUID 12345678-0000-0000-0000-000000008810 = downstairs client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
131212024-04-20T01:07:48.986ZINFOcrucible: Returning UUID:12345678-0000-0000-0000-000000008810 matches = downstairs client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
131222024-04-20T01:07:48.986ZINFOcrucible: send last flush ID to this DS: 3713 = downstairs client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
131232024-04-20T01:07:48.986ZINFOcrucible: Replied this last flush ID: 3713 = downstairs client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
131242024-04-20T01:07:48.986ZINFOcrucible: ds_transition from Offline to Replay = downstairs client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
131252024-04-20T01:07:48.986ZINFOcrucible: [0] Transition from Offline to Replay = downstairs client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
131262024-04-20T01:07:48.986ZINFOcrucible: ds_transition from Replay to Active = downstairs client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
131272024-04-20T01:07:48.986ZINFOcrucible: [0] Transition from Replay to Active = downstairs client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
13128 ----------------------------------------------------------------
13129 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:0
13130 Downstairs last five completed: 4014 4013 4012 4011 4010
13131 Upstairs last five completed: 3015 3014 3013 3012 3011
13132 CLIENT: Up:0 ds:0 act:3
13133 Replay: All jobs finished, all DS active.
13134 Main task has work to do, go find it
13135 got dsc Stop(0)
13136 stop 0
13137 Apr 20 01:07:51.286 INFO request completed, latency_us: 365, response_code: 204, uri: /stop/cid/0, method: POST, req_id: 6e11fb5c-86f3-45b7-8adb-6bcb089cd1c7, remote_addr: 127.[8810] Got stop action so:false kr:false
13138 0.0.1:60352, local_addr: 127.0.0.1:9998
131392024-04-20T01:07:51.287ZWARNcrucible: downstairs disconnected = io task client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
131402024-04-20T01:07:51.287ZWARNcrucible: client task is sending Done(Finished) = io task client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
131412024-04-20T01:07:51.287ZWARNcrucible: downstairs task for 0 stopped due to Finished session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
131422024-04-20T01:07:51.287ZINFOcrucible: Gone missing, transition from Active to Offline = downstairs client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
13143 Apr 20 01:07:51.287 INFO request completed, latency_us: 148, response_code: 200, uri: /state/cid/0, method: GET, req_id: c21d5dcc-7a10-43d3-aa3e-2c030b2b3b5e, remote_addr: 127.0.0.1:60352, local_addr: 127.0.0.1:9998{"msg":"[0] client re-new 0 jobs since flush 4014","v":0,"name":"crucible","level":30,"time":"2024-04-20T01:07:51.287846935Z","hostname":"w-01HVWGBJP7HK0H9TQ26T6N3X8M","pid":1196,"":"downstairs","":"downstairs","session_id":"132b460a-26a0-4532-b1ab-4f8c07d4c6c7"}
13144 
131452024-04-20T01:07:51.287ZINFOcrucible: [0] Marked 0 jobs for replay since flush: 4014 = downstairs session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
131462024-04-20T01:07:51.287ZINFOcrucible: client task is exiting = io task client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
13147 [8810] Exited with: ExitStatus(unix_wait_status(9))
13148 [8810][0] reports Exit
13149 Apr 20 01:07:55.289 INFO request completed, latency_us: 201, response_code: 200, uri: /state/cid/0, method: GET, req_id: e4b8c50d-034b-435b-a7a7-87e9a6f5308f, remote_addr: 127.0.0.1:60352, local_addr: 127.0.0.1:9998
13150 001/300 Write block 442 len 12288 data: 3 3 3
13151 002/300 Write block 2356 len 8192 data: 5 3
13152 003/300 Write block 4005 len 4096 data: 6
13153 004/300 Read block 3613 len 28672
13154 005/300 Read block 4100 len 36864
13155 006/300 Read block 1631 len 8192
13156 007/300 Read block 589 len 36864
13157 008/300 Write block 4121 len 36864 data: 2 2 4 4 4 5 5 4 4
13158 009/300 Write block 673 len 28672 data: 4 4 3 2 2 2 2
13159 010/300 Read block 3812 len 40960
13160 011/300 Read block 1252 len 40960
13161 012/300 Read block 1998 len 24576
13162 013/300 Read block 2000 len 36864
13163 014/300 Write block 2392 len 24576 data: 6 6 4 4 4 3
13164 015/300 Read block 4672 len 40960
13165 016/300 Read block 3720 len 20480
13166 017/300 Write block 4074 len 28672 data: 4 4 5 5 5 5 6
13167 018/300 Write block 4101 len 8192 data: 3 3
13168 019/300 Read block 4076 len 36864
13169 020/300 Read block 821 len 40960
13170 021/300 Write block 3694 len 4096 data: 3
13171 022/300 Read block 4031 len 36864
13172 023/300 Write block 1951 len 36864 data: 3 3 3 3 4 4 5 5 4
13173 024/300 Read block 868 len 36864
13174 025/300 Write block 192 len 8192 data: 4 3
13175 026/300 Read block 1899 len 12288
13176 027/300 Write block 3983 len 16384 data: 2 2 2 3
13177 028/300 Flush
13178 029/300 Read block 3455 len 32768
13179 030/300 Write block 602 len 16384 data: 2 2 3 3
13180 031/300 Write block 1378 len 16384 data: 3 2 3 3
13181 032/300 Write block 2463 len 20480 data: 3 4 4 3 3
13182 033/300 Write block 4151 len 16384 data: 2 4 3 3
13183 034/300 Read block 3518 len 32768
13184 035/300 Write block 1468 len 40960 data: 2 2 3 3 3 3 2 2 2 2
13185 036/300 Read block 3063 len 32768
13186 037/300 Read block 2352 len 12288
13187 038/300 Read block 1052 len 12288
13188 039/300 Write block 1485 len 12288 data: 2 2 2
13189 040/300 Read block 2402 len 36864
13190 041/300 Write block 2889 len 28672 data: 3 4 4 4 3 2 3
13191 042/300 Read block 1895 len 16384
13192 043/300 Read block 2823 len 36864
13193 044/300 Read block 182 len 12288
13194 045/300 Read block 4594 len 24576
13195 046/300 Read block 2351 len 8192
13196 047/300 Read block 229 len 40960
13197 048/300 Read block 1942 len 12288
13198 049/300 Flush
13199 050/300 Read block 1462 len 8192
13200 051/300 Write block 504 len 40960 data: 4 3 4 4 4 4 4 3 3 4
13201 052/300 Read block 3349 len 32768
13202 053/300 Write block 4982 len 8192 data: 3 3
13203 054/300 Read block 266 len 24576
13204 055/300 Write block 2602 len 20480 data: 3 3 3 3 3
13205 056/300 Read block 1609 len 4096
13206 057/300 Read block 652 len 20480
13207 058/300 Read block 844 len 4096
13208 059/300 Read block 230 len 28672
13209 060/300 Read block 3535 len 36864
13210 061/300 Read block 3734 len 24576
13211 062/300 Write block 2829 len 20480 data: 3 3 3 2 2
13212 063/300 Read block 2573 len 4096
13213 064/300 Write block 1760 len 36864 data: 2 2 2 2 2 2 3 3 3
13214 065/300 Read block 1403 len 40960
13215 066/300 Write block 2850 len 4096 data: 3
13216 067/300 Write block 2672 len 24576 data: 2 2 2 2 2 2
13217 068/300 Write block 4800 len 20480 data: 3 3 3 4 4
13218 069/300 Read block 171 len 4096
13219 070/300 Read block 4194 len 28672
13220 071/300 Read block 4397 len 8192
13221 072/300 Flush
13222 073/300 Read block 1789 len 12288
13223 074/300 Read block 1641 len 24576
13224 075/300 Read block 3158 len 40960
13225 076/300 Read block 3038 len 4096
13226 077/300 Read block 2446 len 12288
13227 078/300 Flush
13228 079/300 Flush
13229 080/300 Write block 3321 len 36864 data: 2 2 2 2 2 2 3 3 3
13230 081/300 Write block 1169 len 32768 data: 3 3 3 4 4 4 4 4
13231 082/300 Write block 3755 len 28672 data: 2 2 2 2 2 2 3
13232 083/300 Read block 4736 len 16384
13233 084/300 Write block 625 len 28672 data: 5 4 3 2 2 2 2
13234 085/300 Read block 824 len 16384
13235 086/300 Read block 1760 len 12288
13236 087/300 Read block 1666 len 28672
13237 088/300 Write block 3234 len 16384 data: 3 3 3 3
13238 089/300 Read block 2462 len 16384
13239 090/300 Read block 2796 len 40960
13240 091/300 Flush
13241 092/300 Flush
13242 093/300 Write block 1771 len 36864 data: 5 5 5 5 6 6 4 5 4
13243 094/300 Read block 3667 len 16384
13244 095/300 Read block 3964 len 36864
13245 096/300 Read block 3132 len 12288
13246 097/300 Read block 872 len 12288
13247 098/300 Write block 3046 len 20480 data: 2 2 2 2 2
13248 099/300 Write block 535 len 40960 data: 2 2 2 2 2 3 3 3 4 4
13249 100/300 Flush
13250 101/300 Read block 345 len 16384
13251 102/300 Flush
13252 103/300 Read block 4541 len 8192
13253 104/300 Read block 4797 len 24576
13254 105/300 Read block 3094 len 36864
13255 106/300 Write block 4951 len 24576 data: 3 4 3 3 3 2
13256 107/300 Write block 4914 len 40960 data: 4 4 4 6 6 5 5 5 4 3
13257 108/300 Write block 3591 len 32768 data: 2 2 2 2 3 4 4 4
13258 109/300 Write block 2874 len 36864 data: 3 2 2 2 2 2 2 2 2
13259 110/300 Read block 2369 len 20480
13260 111/300 Flush
13261 112/300 Read block 1397 len 4096
13262 113/300 Write block 394 len 12288 data: 6 6 6
13263 114/300 Read block 4876 len 16384
13264 115/300 Write block 348 len 4096 data: 2
13265 116/300 Read block 1842 len 20480
13266 117/300 Write block 2270 len 12288 data: 2 2 2
13267 118/300 Read block 1068 len 8192
13268 119/300 Write block 3663 len 8192 data: 2 2
13269 120/300 Read block 652 len 4096
13270 121/300 Read block 2806 len 28672
13271 122/300 Read block 66 len 28672
13272 123/300 Write block 3756 len 12288 data: 3 3 3
13273 124/300 Read block 879 len 28672
13274 125/300 Write block 3307 len 8192 data: 2 2
13275 126/300 Write block 4115 len 28672 data: 4 4 3 3 3 2 3
13276 127/300 Write block 3927 len 8192 data: 2 2
13277 128/300 Write block 1333 len 24576 data: 2 2 2 2 2 2
13278 129/300 Flush
13279 130/300 Read block 507 len 24576
13280 131/300 Read block 1935 len 28672
13281 132/300 Read block 2286 len 40960
13282 133/300 Read block 79 len 20480
13283 134/300 Read block 2729 len 16384
13284 135/300 Read block 3624 len 40960
13285 136/300 Read block 1099 len 24576
13286 137/300 Read block 4020 len 12288
13287 138/300 Flush
13288 139/300 Read block 2713 len 4096
13289 140/300 Read block 3220 len 4096
13290 141/300 Write block 1047 len 28672 data: 5 4 3 3 3 3 3
13291 142/300 Read block 2534 len 28672
13292 143/300 Write block 4799 len 12288 data: 3 4 4
13293 144/300 Write block 1106 len 12288 data: 4 3 3
13294 145/300 Read block 4781 len 20480
13295 146/300 Read block 1970 len 40960
13296 147/300 Read block 3556 len 36864
13297 148/300 Read block 306 len 8192
13298 149/300 Read block 1333 len 32768
13299 150/300 Read block 3522 len 32768
13300 151/300 Write block 2858 len 28672 data: 2 2 2 3 3 3 3
13301 152/300 Read block 4478 len 8192
13302 153/300 Write block 2619 len 24576 data: 5 5 4 4 3 3
13303 154/300 Read block 3202 len 40960
13304 155/300 Write block 499 len 16384 data: 3 3 4 3
13305 156/300 Read block 461 len 40960
13306 157/300 Flush
13307 158/300 Flush
13308 159/300 Read block 976 len 8192
13309 160/300 Write block 4336 len 16384 data: 2 2 2 2
13310 161/300 Write block 1551 len 12288 data: 3 3 3
13311 162/300 Read block 4291 len 36864
13312 163/300 Read block 4805 len 8192
13313 164/300 Write block 443 len 36864 data: 4 4 4 4 5 4 4 5 5
13314 165/300 Read block 1410 len 36864
13315 166/300 Write block 3718 len 32768 data: 4 4 4 4 4 4 4 4
13316 167/300 Read block 505 len 36864
13317 168/300 Read block 1360 len 36864
13318 169/300 Flush
13319 170/300 Read block 2318 len 4096
13320 171/300 Read block 3539 len 16384
13321 172/300 Read block 1377 len 40960
13322 173/300 Read block 3265 len 24576
13323 174/300 Read block 291 len 8192
13324 175/300 Read block 2256 len 32768
13325 176/300 Read block 4766 len 20480
13326 177/300 Read block 1235 len 20480
13327 178/300 Flush
13328 179/300 Write block 3453 len 36864 data: 2 2 3 4 4 5 4 4 3
13329 180/300 Read block 1106 len 40960
13330 181/300 Read block 3711 len 32768
13331 182/300 Read block 2026 len 16384
13332 183/300 Read block 4252 len 8192
13333 184/300 Write block 2096 len 4096 data: 6
13334 185/300 Write block 1695 len 8192 data: 3 3
13335 186/300 Read block 1360 len 20480
13336 187/300 Flush
13337 188/300 Read block 2038 len 24576
13338 189/300 Read block 2720 len 24576
13339 190/300 Write block 4841 len 8192 data: 2 2
13340 191/300 Write block 2065 len 40960 data: 3 3 3 5 5 3 4 4 4 3
13341 192/300 Read block 327 len 24576
13342 193/300 Write block 681 len 24576 data: 2 3 3 3 3 4
13343 194/300 Read block 1121 len 24576
13344 195/300 Write block 4970 len 16384 data: 3 3 3 3
13345 196/300 Flush
13346 197/300 Read block 2242 len 32768
13347 198/300 Read block 4548 len 12288
13348 199/300 Flush
13349 200/300 Flush
13350 201/300 Read block 1567 len 20480
13351 202/300 Write block 1867 len 24576 data: 2 2 2 2 2 2
13352 203/300 Flush
13353 204/300 Write block 4274 len 32768 data: 4 4 3 2 2 3 2 2
13354 205/300 Read block 2956 len 12288
13355 206/300 Write block 3236 len 20480 data: 4 4 2 2 2
13356 207/300 Read block 4785 len 12288
13357 208/300 Read block 4553 len 28672
13358 209/300 Read block 3001 len 20480
13359 210/300 Read block 2353 len 40960
13360 211/300 Write block 1406 len 36864 data: 3 3 3 2 2 2 3 3 5
13361 212/300 Flush
13362 213/300 Read block 3553 len 24576
13363 214/300 Write block 4597 len 12288 data: 4 4 4
13364 215/300 Flush
13365 216/300 Read block 2675 len 8192
13366 217/300 Flush
13367 218/300 Write block 446 len 8192 data: 5 6
13368 219/300 Write block 2931 len 16384 data: 3 3 3 2
13369 220/300 Read block 3125 len 32768
13370 221/300 Read block 3734 len 40960
13371 222/300 Write block 1891 len 36864 data: 2 3 4 4 5 5 5 3 4
13372 223/300 Read block 2225 len 28672
13373 224/300 Read block 2448 len 4096
13374 225/300 Write block 3746 len 28672 data: 4 4 3 4 4 3 2
13375 226/300 Write block 1280 len 32768 data: 3 2 3 2 2 2 2 2
13376 227/300 Read block 4036 len 4096
13377 228/300 Write block 4986 len 28672 data: 2 2 2 3 4 4 4
13378 229/300 Read block 3741 len 36864
13379 230/300 Read block 4062 len 8192
13380 231/300 Read block 2309 len 28672
13381 232/300 Read block 1705 len 40960
13382 233/300 Read block 4944 len 24576
13383 234/300 Read block 2554 len 8192
13384 235/300 Write block 3882 len 24576 data: 2 2 3 3 2 2
13385 236/300 Write block 3284 len 24576 data: 5 5 5 5 3 2
13386 237/300 Read block 1651 len 4096
13387 238/300 Read block 3977 len 16384
13388 239/300 Write block 1059 len 16384 data: 3 3 3 3
13389 240/300 Read block 4091 len 28672
13390 241/300 Read block 4045 len 24576
13391 242/300 Read block 4052 len 12288
13392 243/300 Read block 1635 len 20480
13393 244/300 Write block 1768 len 24576 data: 4 3 5 6 6 6
13394 245/300 Write block 3311 len 20480 data: 2 2 2 2 2
13395 246/300 Write block 4732 len 16384 data: 3 3 3 3
13396 247/300 Read block 1620 len 32768
13397 248/300 Write block 1088 len 20480 data: 3 3 4 4 3
13398 249/300 Write block 1698 len 36864 data: 3 3 3 3 3 4 3 3 4
13399 250/300 Read block 73 len 40960
13400 251/300 Read block 555 len 16384
13401 252/300 Read block 2516 len 24576
13402 253/300 Write block 3097 len 36864 data: 4 7 7 8 6 6 6 6 6
13403 254/300 Flush
13404 255/300 Read block 3462 len 16384
13405 256/300 Flush
13406 257/300 Read block 405 len 40960
13407 258/300 Write block 2752 len 32768 data: 3 4 4 4 4 3 3 3
13408 259/300 Flush
13409 260/300 Write block 3579 len 12288 data: 3 3 4
13410 261/300 Write block 3220 len 32768 data: 3 2 2 2 2 2 2 2
13411 262/300 Write block 3546 len 36864 data: 3 3 3 2 2 2 2 2 2
13412 263/300 Write block 3924 len 20480 data: 2 2 2 3 3
13413 264/300 Write block 2439 len 12288 data: 3 2 2
13414 265/300 Read block 1407 len 8192
13415 266/300 Read block 2580 len 40960
13416 267/300 Read block 1686 len 8192
13417 268/300 Read block 923 len 32768
13418 269/300 Read block 4741 len 8192
13419 270/300 Write block 554 len 32768 data: 2 2 2 2 3 3 3 3
13420 271/300 Read block 4905 len 20480
13421 272/300 Flush
13422 273/300 Read block 85 len 20480
13423 274/300 Read block 2658 len 32768
13424 275/300 Read block 399 len 40960
13425 276/300 Write block 2664 len 40960 data: 5 5 5 4 4 4 4 3 3 3
13426 277/300 Write block 4574 len 8192 data: 4 4
13427 278/300 Write block 1213 len 36864 data: 3 3 2 2 3 2 2 2 2
13428 279/300 Flush
13429 280/300 Write block 2863 len 32768 data: 4 4 3 4 5 4 4 3
13430 281/300 Read block 1781 len 20480
13431 282/300 Flush
13432 283/300 Read block 4802 len 24576
13433 284/300 Read block 387 len 8192
13434 285/300 Read block 4370 len 28672
13435 286/300 Write block 422 len 8192 data: 4 4
13436 287/300 Write block 396 len 28672 data: 7 5 5 4 4 5 5
13437 288/300 Read block 4781 len 28672
13438 289/300 Write block 2698 len 32768 data: 3 3 3 3 2 2 2 2
13439 290/300 Write block 953 len 40960 data: 4 2 2 2 2 2 2 2 2 2
13440 291/300 Flush
13441 292/300 Read block 4665 len 40960
13442 293/300 Read block 4333 len 36864
13443 294/300 Read block 4133 len 40960
13444 295/300 Write block 403 len 16384 data: 5 4 3 3
13445 296/300 Read block 1372 len 8192
13446 297/300 Write block 3835 len 28672 data: 2 3 3 3 3 3 2
13447 298/300 Write block 3516 len 36864 data: 5 5 4 4 4 4 4 2 2
13448 299/300 Write block 4722 len 28672 data: 2 3 3 3 3 3 3
13449 300/300 Write block 3914 len 40960 data: 3 3 4 6 5 5 5 4 4 3
13450 Main task has work to do, go find it
13451 got dsc Start(0)
13452 start 0
13453 Apr 20 01:07:55.586 INFO request completed, latency_us: 200, response_code: 204, uri: /start/cid/0, method: POST, req_id: 87466a57-90e2-4812-badf-01a6a4be604f, remote_addr: 127.0.0.1:60352, local_addr: 127.0.0.1:9998
13454 Replay: started 0, returned:Ok(())
13455 ----------------------------------------------------------------
13456 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:301
13457 States: Offline Active Active
13458 GW_ID ACK DSID TYPE BLOCKS DS:0 DS:1 DS:2 REPLAY
13459 3016 Acked 4015 Write 3 New Done Done false
13460 3017 Acked 4016 Write 2 New Done Done false
13461 3018 Acked 4017 Write 1 New Done Done false
13462 3019 Acked 4018 Read 7 New Done Done false
13463 3020 Acked 4019 Read 9 New Done Done false
13464 3021 Acked 4020 Read 2 New Done Done false
13465 3022 Acked 4021 Read 9 New Done Done false
13466 3023 Acked 4022 Write 9 New Done Done false
13467 3024 Acked 4023 Write 7 New Done Done false
13468 3025 Acked 4024 Read 10 New Done Done false
13469 3026 Acked 4025 Read 10 New Done Done false
13470 3027 Acked 4026 Read 6 New Done Done false
13471 3028 Acked 4027 Read 9 New Done Done false
13472 3029 Acked 4028 Write 6 New Done Done false
13473 3030 Acked 4029 Read 10 New Done Done false
13474 3031 Acked 4030 Read 5 New Done Done false
13475 3032 Acked 4031 Write 7 New Done Done false
13476 3033 Acked 4032 Write 2 New Done Done false
13477 3034 Acked 4033 Read 9 New Done Done false
13478 3035 Acked 4034 Read 10 New Done Done false
13479 3036 Acked 4035 Write 1 New Done Done false
13480 3037 Acked 4036 Read 9 New Done Done false
13481 3038 Acked 4037 Write 9 New Done Done false
13482 3039 Acked 4038 Read 9 New Done Done false
13483 3040 Acked 4039 Write 2 New Done Done false
13484 3041 Acked 4040 Read 3 New Done Done false
13485 3042 Acked 4041 Write 4 New Done Done false
13486 3043 Acked 4042 Flush 0 New Done Done false
13487 3044 Acked 4043 Read 8 New Done Done false
13488 3045 Acked 4044 Write 4 New Done Done false
13489 3046 Acked 4045 Write 4 New Done Done false
13490 3047 Acked 4046 Write 5 New Done Done false
13491 3048 Acked 4047 Write 4 New Done Done false
13492 3049 Acked 4048 Read 8 New Done Done false
13493 3050 Acked 4049 Write 10 New Done Done false
13494 3051 Acked 4050 Read 8 New Done Done false
13495 3052 Acked 4051 Flush 0 New Done Done false
13496 3053 Acked 4052 Read 3 New Done Done false
13497 3054 Acked 4053 Read 3 New Done Done false
13498 3055 Acked 4054 Write 3 New Done Done false
13499 3056 Acked 4055 Read 9 New Done Done false
13500 3057 Acked 4056 Write 7 New Done Done false
13501 3058 Acked 4057 Read 4 New Done Done false
13502 3059 Acked 4058 Read 9 New Done Done false
13503 3060 Acked 4059 Read 3 New Done Done false
13504 3061 Acked 4060 Read 6 New Done Done false
13505 3062 Acked 4061 Read 2 New Done Done false
13506 3063 Acked 4062 Read 10 New Done Done false
13507 3064 Acked 4063 Read 3 New Done Done false
13508 3065 Acked 4064 Flush 0 New Done Done false
13509 3066 Acked 4065 Read 2 New Done Done false
13510 3067 Acked 4066 Write 10 New Done Done false
13511 3068 Acked 4067 Read 8 New Done Done false
13512 3069 Acked 4068 Write 2 New Done Done false
13513 3070 Acked 4069 Read 6 New Done Done false
13514 3071 Acked 4070 Write 5 New Done Done false
13515 3072 Acked 4071 Read 1 New Done Done false
13516 3073 Acked 4072 Read 5 New Done Done false
13517 3074 Acked 4073 Read 1 New Done Done false
13518 3075 Acked 4074 Read 7 New Done Done false
13519 3076 Acked 4075 Read 9 New Done Done false
13520 3077 Acked 4076 Read 6 New Done Done false
13521 3078 Acked 4077 Write 5 New Done Done false
13522 3079 Acked 4078 Read 1 New Done Done false
13523 3080 Acked 4079 Write 9 New Done Done false
13524 3081 Acked 4080 Read 10 New Done Done false
13525 3082 Acked 4081 Write 1 New Done Done false
13526 3083 Acked 4082 Write 6 New Done Done false
13527 3084 Acked 4083 Write 5 New Done Done false
13528 3085 Acked 4084 Read 1 New Done Done false
13529 3086 Acked 4085 Read 7 New Done Done false
13530 3087 Acked 4086 Read 2 New Done Done false
13531 3088 Acked 4087 Flush 0 New Done Done false
13532 3089 Acked 4088 Read 3 New Done Done false
13533 3090 Acked 4089 Read 6 New Done Done false
13534 3091 Acked 4090 Read 10 New Done Done false
13535 3092 Acked 4091 Read 1 New Done Done false
13536 3093 Acked 4092 Read 3 New Done Done false
13537 3094 Acked 4093 Flush 0 New Done Done false
13538 3095 Acked 4094 Flush 0 New Done Done false
13539 3096 Acked 4095 Write 9 New Done Done false
13540 3097 Acked 4096 Write 8 New Done Done false
13541 3098 Acked 4097 Write 7 New Done Done false
13542 3099 Acked 4098 Read 4 New Done Done false
13543 3100 Acked 4099 Write 7 New Done Done false
13544 3101 Acked 4100 Read 4 New Done Done false
13545 3102 Acked 4101 Read 3 New Done Done false
13546 3103 Acked 4102 Read 7 New Done Done false
13547 3104 Acked 4103 Write 4 New Done Done false
13548 3105 Acked 4104 Read 4 New Done Done false
13549 3106 Acked 4105 Read 10 New Done Done false
13550 3107 Acked 4106 Flush 0 New Done Done false
13551 3108 Acked 4107 Flush 0 New Done Done false
13552 3109 Acked 4108 Write 9 New Done Done false
13553 3110 Acked 4109 Read 4 New Done Done false
13554 3111 Acked 4110 Read 9 New Done Done false
13555 3112 Acked 4111 Read 3 New Done Done false
13556 3113 Acked 4112 Read 3 New Done Done false
13557 3114 Acked 4113 Write 5 New Done Done false
13558 3115 Acked 4114 Write 10 New Done Done false
13559 3116 Acked 4115 Flush 0 New Done Done false
13560 3117 Acked 4116 Read 4 New Done Done false
13561 3118 Acked 4117 Flush 0 New Done Done false
13562 3119 Acked 4118 Read 2 New Done Done false
13563 3120 Acked 4119 Read 6 New Done Done false
13564 3121 Acked 4120 Read 9 New Done Done false
13565 3122 Acked 4121 Write 6 New Done Done false
13566 3123 Acked 4122 Write 10 New Done Done false
13567 3124 Acked 4123 Write 8 New Done Done false
13568 3125 Acked 4124 Write 9 New Done Done false
13569 3126 Acked 4125 Read 5 New Done Done false
13570 3127 Acked 4126 Flush 0 New Done Done false
13571 3128 Acked 4127 Read 1 New Done Done false
13572 3129 Acked 4128 Write 3 New Done Done false
13573 3130 Acked 4129 Read 4 New Done Done false
13574 3131 Acked 4130 Write 1 New Done Done false
13575 3132 Acked 4131 Read 5 New Done Done false
13576 3133 Acked 4132 Write 3 New Done Done false
13577 3134 Acked 4133 Read 2 New Done Done false
13578 3135 Acked 4134 Write 2 New Done Done false
13579 3136 Acked 4135 Read 1 New Done Done false
13580 3137 Acked 4136 Read 7 New Done Done false
13581 3138 Acked 4137 Read 7 New Done Done false
13582 3139 Acked 4138 Write 3 New Done Done false
13583 3140 Acked 4139 Read 7 New Done Done false
13584 3141 Acked 4140 Write 2 New Done Done false
13585 3142 Acked 4141 Write 7 New Done Done false
13586 3143 Acked 4142 Write 2 New Done Done false
13587 3144 Acked 4143 Write 6 New Done Done false
13588 3145 Acked 4144 Flush 0 New Done Done false
13589 3146 Acked 4145 Read 6 New Done Done false
13590 3147 Acked 4146 Read 7 New Done Done false
13591 3148 Acked 4147 Read 10 New Done Done false
13592 3149 Acked 4148 Read 5 New Done Done false
13593 3150 Acked 4149 Read 4 New Done Done false
13594 3151 Acked 4150 Read 10 New Done Done false
13595 3152 Acked 4151 Read 6 New Done Done false
13596 3153 Acked 4152 Read 3 New Done Done false
13597 3154 Acked 4153 Flush 0 New Done Done false
13598 3155 Acked 4154 Read 1 New Done Done false
13599 3156 Acked 4155 Read 1 New Done Done false
13600 3157 Acked 4156 Write 7 New Done Done false
13601 3158 Acked 4157 Read 7 New Done Done false
13602 3159 Acked 4158 Write 3 New Done Done false
13603 3160 Acked 4159 Write 3 New Done Done false
13604 3161 Acked 4160 Read 5 New Done Done false
13605 3162 Acked 4161 Read 10 New Done Done false
13606 3163 Acked 4162 Read 9 New Done Done false
13607 3164 Acked 4163 Read 2 New Done Done false
13608 3165 Acked 4164 Read 8 New Done Done false
13609 3166 Acked 4165 Read 8 New Done Done false
13610 3167 Acked 4166 Write 7 New Done Done false
13611 3168 Acked 4167 Read 2 New Done Done false
13612 3169 Acked 4168 Write 6 New Done Done false
13613 3170 Acked 4169 Read 10 New Done Done false
13614 3171 Acked 4170 Write 4 New Done Done false
13615 3172 Acked 4171 Read 10 New Done Done false
13616 3173 Acked 4172 Flush 0 New Done Done false
13617 3174 Acked 4173 Flush 0 New Done Done false
13618 3175 Acked 4174 Read 2 New Done Done false
13619 3176 Acked 4175 Write 4 New Done Done false
13620 3177 Acked 4176 Write 3 New Done Done false
13621 3178 Acked 4177 Read 9 New Done Done false
13622 3179 Acked 4178 Read 2 New Done Done false
13623 3180 Acked 4179 Write 9 New Done Done false
13624 3181 Acked 4180 Read 9 New Done Done false
13625 3182 Acked 4181 Write 8 New Done Done false
13626 3183 Acked 4182 Read 9 New Done Done false
13627 3184 Acked 4183 Read 9 New Done Done false
13628 3185 Acked 4184 Flush 0 New Done Done false
13629 3186 Acked 4185 Read 1 New Done Done false
13630 3187 Acked 4186 Read 4 New Done Done false
13631 3188 Acked 4187 Read 10 New Done Done false
13632 3189 Acked 4188 Read 6 New Done Done false
13633 3190 Acked 4189 Read 2 New Done Done false
13634 3191 Acked 4190 Read 8 New Done Done false
13635 3192 Acked 4191 Read 5 New Done Done false
13636 3193 Acked 4192 Read 5 New Done Done false
13637 3194 Acked 4193 Flush 0 New Done Done false
13638 3195 Acked 4194 Write 9 New Done Done false
13639 3196 Acked 4195 Read 10 New Done Done false
13640 3197 Acked 4196 Read 8 New Done Done false
13641 3198 Acked 4197 Read 4 New Done Done false
13642 3199 Acked 4198 Read 2 New Done Done false
13643 3200 Acked 4199 Write 1 New Done Done false
13644 3201 Acked 4200 Write 2 New Done Done false
13645 3202 Acked 4201 Read 5 New Done Done false
13646 3203 Acked 4202 Flush 0 New Done Done false
13647 3204 Acked 4203 Read 6 New Done Done false
13648 3205 Acked 4204 Read 6 New Done Done false
13649 3206 Acked 4205 Write 2 New Done Done false
13650 3207 Acked 4206 Write 10 New Done Done false
13651 3208 Acked 4207 Read 6 New Done Done false
13652 3209 Acked 4208 Write 6 New Done Done false
13653 3210 Acked 4209 Read 6 New Done Done false
13654 3211 Acked 4210 Write 4 New Done Done false
13655 3212 Acked 4211 Flush 0 New Done Done false
13656 3213 Acked 4212 Read 8 New Done Done false
13657 3214 Acked 4213 Read 3 New Done Done false
13658 3215 Acked 4214 Flush 0 New Done Done false
13659 3216 Acked 4215 Flush 0 New Done Done false
13660 3217 Acked 4216 Read 5 New Done Done false
13661 3218 Acked 4217 Write 6 New Done Done false
13662 3219 Acked 4218 Flush 0 New Done Done false
13663 3220 Acked 4219 Write 8 New Done Done false
13664 3221 Acked 4220 Read 3 New Done Done false
13665 3222 Acked 4221 Write 5 New Done Done false
13666 3223 Acked 4222 Read 3 New Done Done false
13667 3224 Acked 4223 Read 7 New Done Done false
13668 3225 Acked 4224 Read 5 New Done Done false
13669 3226 Acked 4225 Read 10 New Done Done false
13670 3227 Acked 4226 Write 9 New Done Done false
13671 3228 Acked 4227 Flush 0 New Done Done false
13672 3229 Acked 4228 Read 6 New Done Done false
13673 3230 Acked 4229 Write 3 New Done Done false
13674 3231 Acked 4230 Flush 0 New Done Done false
13675 3232 Acked 4231 Read 2 New Done Done false
13676 3233 Acked 4232 Flush 0 New Done Done false
13677 3234 Acked 4233 Write 2 New Done Done false
13678 3235 Acked 4234 Write 4 New Done Done false
13679 3236 Acked 4235 Read 8 New Done Done false
13680 3237 Acked 4236 Read 10 New Done Done false
13681 3238 Acked 4237 Write 9 New Done Done false
13682 3239 Acked 4238 Read 7 New Done Done false
13683 3240 Acked 4239 Read 1 New Done Done false
13684 3241 Acked 4240 Write 7 New Done Done false
13685 3242 Acked 4241 Write 8 New Done Done false
13686 3243 Acked 4242 Read 1 New Done Done false
13687 3244 Acked 4243 Write 7 New Done Done false
13688 3245 Acked 4244 Read 9 New Done Done false
13689 3246 Acked 4245 Read 2 New Done Done false
13690 3247 Acked 4246 Read 7 New Done Done false
13691 3248 Acked 4247 Read 10 New Done Done false
13692 3249 Acked 4248 Read 6 New Done Done false
13693 3250 Acked 4249 Read 2 New Done Done false
13694 3251 Acked 4250 Write 6 New Done Done false
13695 3252 Acked 4251 Write 6 New Done Done false
13696 3253 Acked 4252 Read 1 New Done Done false
13697 3254 Acked 4253 Read 4 New Done Done false
13698 3255 Acked 4254 Write 4 New Done Done false
13699 3256 Acked 4255 Read 7 New Done Done false
13700 3257 Acked 4256 Read 6 New Done Done false
13701 3258 Acked 4257 Read 3 New Done Done false
13702 3259 Acked 4258 Read 5 New Done Done false
13703 3260 Acked 4259 Write 6 New Done Done false
13704 3261 Acked 4260 Write 5 New Done Done false
13705 3262 Acked 4261 Write 4 New Done Done false
13706 3263 Acked 4262 Read 8 New Done Done false
13707 3264 Acked 4263 Write 5 New Done Done false
13708 3265 Acked 4264 Write 9 New Done Done false
13709 3266 Acked 4265 Read 10 New Done Done false
13710 3267 Acked 4266 Read 4 New Done Done false
13711 3268 Acked 4267 Read 6 New Done Done false
13712 3269 Acked 4268 Write 9 New Done Done false
13713 3270 Acked 4269 Flush 0 New Done Done false
13714 3271 Acked 4270 Read 4 New Done Done false
13715 3272 Acked 4271 Flush 0 New Done Done false
13716 3273 Acked 4272 Read 10 New Done Done false
13717 3274 Acked 4273 Write 8 New Done Done false
13718 3275 Acked 4274 Flush 0 New Done Done false
13719 3276 Acked 4275 Write 3 New Done Done false
13720 3277 Acked 4276 Write 8 New Done Done false
13721 3278 Acked 4277 Write 9 New Done Done false
13722 3279 Acked 4278 Write 5 New Done Done false
13723 3280 Acked 4279 Write 3 New Done Done false
13724 3281 Acked 4280 Read 2 New Done Done false
13725 3282 Acked 4281 Read 10 New Done Done false
13726 3283 Acked 4282 Read 2 New Done Done false
13727 3284 Acked 4283 Read 8 New Done Done false
13728 3285 Acked 4284 Read 2 New Done Done false
13729 3286 Acked 4285 Write 8 New Done Done false
13730 3287 Acked 4286 Read 5 New Done Done false
13731 3288 Acked 4287 Flush 0 New Done Done false
13732 3289 Acked 4288 Read 5 New Done Done false
13733 3290 Acked 4289 Read 8 New Done Done false
13734 3291 Acked 4290 Read 10 New Done Done false
13735 3292 Acked 4291 Write 10 New Done Done false
13736 3293 Acked 4292 Write 2 New Done Done false
13737 3294 Acked 4293 Write 9 New Done Done false
13738 3295 Acked 4294 Flush 0 New Done Done false
13739 3296 Acked 4295 Write 8 New Done Done false
13740 3297 Acked 4296 Read 5 New Done Done false
13741 3298 Acked 4297 Flush 0 New Done Done false
13742 3299 Acked 4298 Read 6 New Done Done false
13743 3300 Acked 4299 Read 2 New Done Done false
13744 3301 Acked 4300 Read 7 New Done Done false
13745 3302 Acked 4301 Write 2 New Done Done false
13746 3303 Acked 4302 Write 7 New Done Done false
13747 3304 Acked 4303 Read 7 New Done Done false
13748 3305 Acked 4304 Write 8 New Done Done false
13749 3306 Acked 4305 Write 10 New Done Done false
13750 3307 Acked 4306 Flush 0 New Done Done false
13751 3308 Acked 4307 Read 10 New Done Done false
13752 3309 Acked 4308 Read 9 New Done Done false
13753 3310 Acked 4309 Read 10 New Done Done false
13754 3311 Acked 4310 Write 4 New Done Done false
13755 3312 Acked 4311 Read 2 New Done Done false
13756 3313 Acked 4312 Write 7 New Done Done false
13757 3314 Acked 4313 Write 9 New Done Done false
13758 3315 Acked 4314 Write 7 New Done Done false
13759 3316 Acked 4315 Write 10 New Done Done false
13760 STATES DS:0 DS:1 DS:2 TOTAL
13761 New 301 0 0 301
13762 Sent 0 0 0 0
13763 Done 0 301 301 602
13764 Skipped 0 0 0 0
13765 Error 0 0 0 0
13766 Last Flush: 4014 4306 4306
13767 Downstairs last five completed: 4014 4013 4012 4011 4010
13768 Upstairs last five completed: 3316 3315 3314 3313 3312
13769 CLIENT: Up:0 ds:301 act:2
13770 [8810] got start action
13771 [8810] I am going to restart
13772 Starting downstairs at port 8810
13773 Make output file at "/tmp/dsc/downstairs-8810.txt"
13774 [8810][0] reports Starting
13775 Downstairs /var/tmp/dsc/region/8810 port 8810 PID:Some(1207)
13776 [8810][0] reports Running
13777 ----------------------------------------------------------------
13778 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:302
13779 States: Offline Active Active
13780 GW_ID ACK DSID TYPE BLOCKS DS:0 DS:1 DS:2 REPLAY
13781 3016 Acked 4015 Write 3 New Done Done false
13782 3017 Acked 4016 Write 2 New Done Done false
13783 3018 Acked 4017 Write 1 New Done Done false
13784 3019 Acked 4018 Read 7 New Done Done false
13785 3020 Acked 4019 Read 9 New Done Done false
13786 3021 Acked 4020 Read 2 New Done Done false
13787 3022 Acked 4021 Read 9 New Done Done false
13788 3023 Acked 4022 Write 9 New Done Done false
13789 3024 Acked 4023 Write 7 New Done Done false
13790 3025 Acked 4024 Read 10 New Done Done false
13791 3026 Acked 4025 Read 10 New Done Done false
13792 3027 Acked 4026 Read 6 New Done Done false
13793 3028 Acked 4027 Read 9 New Done Done false
13794 3029 Acked 4028 Write 6 New Done Done false
13795 3030 Acked 4029 Read 10 New Done Done false
13796 3031 Acked 4030 Read 5 New Done Done false
13797 3032 Acked 4031 Write 7 New Done Done false
13798 3033 Acked 4032 Write 2 New Done Done false
13799 3034 Acked 4033 Read 9 New Done Done false
13800 3035 Acked 4034 Read 10 New Done Done false
13801 3036 Acked 4035 Write 1 New Done Done false
13802 3037 Acked 4036 Read 9 New Done Done false
13803 3038 Acked 4037 Write 9 New Done Done false
13804 3039 Acked 4038 Read 9 New Done Done false
13805 3040 Acked 4039 Write 2 New Done Done false
13806 3041 Acked 4040 Read 3 New Done Done false
13807 3042 Acked 4041 Write 4 New Done Done false
13808 3043 Acked 4042 Flush 0 New Done Done false
13809 3044 Acked 4043 Read 8 New Done Done false
13810 3045 Acked 4044 Write 4 New Done Done false
13811 3046 Acked 4045 Write 4 New Done Done false
13812 3047 Acked 4046 Write 5 New Done Done false
13813 3048 Acked 4047 Write 4 New Done Done false
13814 3049 Acked 4048 Read 8 New Done Done false
13815 3050 Acked 4049 Write 10 New Done Done false
13816 3051 Acked 4050 Read 8 New Done Done false
13817 3052 Acked 4051 Flush 0 New Done Done false
13818 3053 Acked 4052 Read 3 New Done Done false
13819 3054 Acked 4053 Read 3 New Done Done false
13820 3055 Acked 4054 Write 3 New Done Done false
13821 3056 Acked 4055 Read 9 New Done Done false
13822 3057 Acked 4056 Write 7 New Done Done false
13823 3058 Acked 4057 Read 4 New Done Done false
13824 3059 Acked 4058 Read 9 New Done Done false
13825 3060 Acked 4059 Read 3 New Done Done false
13826 3061 Acked 4060 Read 6 New Done Done false
13827 3062 Acked 4061 Read 2 New Done Done false
13828 3063 Acked 4062 Read 10 New Done Done false
13829 3064 Acked 4063 Read 3 New Done Done false
13830 3065 Acked 4064 Flush 0 New Done Done false
13831 3066 Acked 4065 Read 2 New Done Done false
13832 3067 Acked 4066 Write 10 New Done Done false
13833 3068 Acked 4067 Read 8 New Done Done false
13834 3069 Acked 4068 Write 2 New Done Done false
13835 3070 Acked 4069 Read 6 New Done Done false
13836 3071 Acked 4070 Write 5 New Done Done false
13837 3072 Acked 4071 Read 1 New Done Done false
13838 3073 Acked 4072 Read 5 New Done Done false
13839 3074 Acked 4073 Read 1 New Done Done false
13840 3075 Acked 4074 Read 7 New Done Done false
13841 3076 Acked 4075 Read 9 New Done Done false
13842 3077 Acked 4076 Read 6 New Done Done false
13843 3078 Acked 4077 Write 5 New Done Done false
13844 3079 Acked 4078 Read 1 New Done Done false
13845 3080 Acked 4079 Write 9 New Done Done false
13846 3081 Acked 4080 Read 10 New Done Done false
13847 3082 Acked 4081 Write 1 New Done Done false
13848 3083 Acked 4082 Write 6 New Done Done false
13849 3084 Acked 4083 Write 5 New Done Done false
13850 3085 Acked 4084 Read 1 New Done Done false
13851 3086 Acked 4085 Read 7 New Done Done false
13852 3087 Acked 4086 Read 2 New Done Done false
13853 3088 Acked 4087 Flush 0 New Done Done false
13854 3089 Acked 4088 Read 3 New Done Done false
13855 3090 Acked 4089 Read 6 New Done Done false
13856 3091 Acked 4090 Read 10 New Done Done false
13857 3092 Acked 4091 Read 1 New Done Done false
13858 3093 Acked 4092 Read 3 New Done Done false
13859 3094 Acked 4093 Flush 0 New Done Done false
13860 3095 Acked 4094 Flush 0 New Done Done false
13861 3096 Acked 4095 Write 9 New Done Done false
13862 3097 Acked 4096 Write 8 New Done Done false
13863 3098 Acked 4097 Write 7 New Done Done false
13864 3099 Acked 4098 Read 4 New Done Done false
13865 3100 Acked 4099 Write 7 New Done Done false
13866 3101 Acked 4100 Read 4 New Done Done false
13867 3102 Acked 4101 Read 3 New Done Done false
13868 3103 Acked 4102 Read 7 New Done Done false
13869 3104 Acked 4103 Write 4 New Done Done false
13870 3105 Acked 4104 Read 4 New Done Done false
13871 3106 Acked 4105 Read 10 New Done Done false
13872 3107 Acked 4106 Flush 0 New Done Done false
13873 3108 Acked 4107 Flush 0 New Done Done false
13874 3109 Acked 4108 Write 9 New Done Done false
13875 3110 Acked 4109 Read 4 New Done Done false
13876 3111 Acked 4110 Read 9 New Done Done false
13877 3112 Acked 4111 Read 3 New Done Done false
13878 3113 Acked 4112 Read 3 New Done Done false
13879 3114 Acked 4113 Write 5 New Done Done false
13880 3115 Acked 4114 Write 10 New Done Done false
13881 3116 Acked 4115 Flush 0 New Done Done false
13882 3117 Acked 4116 Read 4 New Done Done false
13883 3118 Acked 4117 Flush 0 New Done Done false
13884 3119 Acked 4118 Read 2 New Done Done false
13885 3120 Acked 4119 Read 6 New Done Done false
13886 3121 Acked 4120 Read 9 New Done Done false
13887 3122 Acked 4121 Write 6 New Done Done false
13888 3123 Acked 4122 Write 10 New Done Done false
13889 3124 Acked 4123 Write 8 New Done Done false
13890 3125 Acked 4124 Write 9 New Done Done false
13891 3126 Acked 4125 Read 5 New Done Done false
13892 3127 Acked 4126 Flush 0 New Done Done false
13893 3128 Acked 4127 Read 1 New Done Done false
13894 3129 Acked 4128 Write 3 New Done Done false
13895 3130 Acked 4129 Read 4 New Done Done false
13896 3131 Acked 4130 Write 1 New Done Done false
13897 3132 Acked 4131 Read 5 New Done Done false
13898 3133 Acked 4132 Write 3 New Done Done false
13899 3134 Acked 4133 Read 2 New Done Done false
13900 3135 Acked 4134 Write 2 New Done Done false
13901 3136 Acked 4135 Read 1 New Done Done false
13902 3137 Acked 4136 Read 7 New Done Done false
13903 3138 Acked 4137 Read 7 New Done Done false
13904 3139 Acked 4138 Write 3 New Done Done false
13905 3140 Acked 4139 Read 7 New Done Done false
13906 3141 Acked 4140 Write 2 New Done Done false
13907 3142 Acked 4141 Write 7 New Done Done false
13908 3143 Acked 4142 Write 2 New Done Done false
13909 3144 Acked 4143 Write 6 New Done Done false
13910 3145 Acked 4144 Flush 0 New Done Done false
13911 3146 Acked 4145 Read 6 New Done Done false
13912 3147 Acked 4146 Read 7 New Done Done false
13913 3148 Acked 4147 Read 10 New Done Done false
13914 3149 Acked 4148 Read 5 New Done Done false
13915 3150 Acked 4149 Read 4 New Done Done false
13916 3151 Acked 4150 Read 10 New Done Done false
13917 3152 Acked 4151 Read 6 New Done Done false
13918 3153 Acked 4152 Read 3 New Done Done false
13919 3154 Acked 4153 Flush 0 New Done Done false
13920 3155 Acked 4154 Read 1 New Done Done false
13921 3156 Acked 4155 Read 1 New Done Done false
13922 3157 Acked 4156 Write 7 New Done Done false
13923 3158 Acked 4157 Read 7 New Done Done false
13924 3159 Acked 4158 Write 3 New Done Done false
13925 3160 Acked 4159 Write 3 New Done Done false
13926 3161 Acked 4160 Read 5 New Done Done false
13927 3162 Acked 4161 Read 10 New Done Done false
13928 3163 Acked 4162 Read 9 New Done Done false
13929 3164 Acked 4163 Read 2 New Done Done false
13930 3165 Acked 4164 Read 8 New Done Done false
13931 3166 Acked 4165 Read 8 New Done Done false
13932 3167 Acked 4166 Write 7 New Done Done false
13933 3168 Acked 4167 Read 2 New Done Done false
13934 3169 Acked 4168 Write 6 New Done Done false
13935 3170 Acked 4169 Read 10 New Done Done false
13936 3171 Acked 4170 Write 4 New Done Done false
13937 3172 Acked 4171 Read 10 New Done Done false
13938 3173 Acked 4172 Flush 0 New Done Done false
13939 3174 Acked 4173 Flush 0 New Done Done false
13940 3175 Acked 4174 Read 2 New Done Done false
13941 3176 Acked 4175 Write 4 New Done Done false
13942 3177 Acked 4176 Write 3 New Done Done false
13943 3178 Acked 4177 Read 9 New Done Done false
13944 3179 Acked 4178 Read 2 New Done Done false
13945 3180 Acked 4179 Write 9 New Done Done false
13946 3181 Acked 4180 Read 9 New Done Done false
13947 3182 Acked 4181 Write 8 New Done Done false
13948 3183 Acked 4182 Read 9 New Done Done false
13949 3184 Acked 4183 Read 9 New Done Done false
13950 3185 Acked 4184 Flush 0 New Done Done false
13951 3186 Acked 4185 Read 1 New Done Done false
13952 3187 Acked 4186 Read 4 New Done Done false
13953 3188 Acked 4187 Read 10 New Done Done false
13954 3189 Acked 4188 Read 6 New Done Done false
13955 3190 Acked 4189 Read 2 New Done Done false
13956 3191 Acked 4190 Read 8 New Done Done false
13957 3192 Acked 4191 Read 5 New Done Done false
13958 3193 Acked 4192 Read 5 New Done Done false
13959 3194 Acked 4193 Flush 0 New Done Done false
13960 3195 Acked 4194 Write 9 New Done Done false
13961 3196 Acked 4195 Read 10 New Done Done false
13962 3197 Acked 4196 Read 8 New Done Done false
13963 3198 Acked 4197 Read 4 New Done Done false
13964 3199 Acked 4198 Read 2 New Done Done false
13965 3200 Acked 4199 Write 1 New Done Done false
13966 3201 Acked 4200 Write 2 New Done Done false
13967 3202 Acked 4201 Read 5 New Done Done false
13968 3203 Acked 4202 Flush 0 New Done Done false
13969 3204 Acked 4203 Read 6 New Done Done false
13970 3205 Acked 4204 Read 6 New Done Done false
13971 3206 Acked 4205 Write 2 New Done Done false
13972 3207 Acked 4206 Write 10 New Done Done false
13973 3208 Acked 4207 Read 6 New Done Done false
13974 3209 Acked 4208 Write 6 New Done Done false
13975 3210 Acked 4209 Read 6 New Done Done false
13976 3211 Acked 4210 Write 4 New Done Done false
13977 3212 Acked 4211 Flush 0 New Done Done false
13978 3213 Acked 4212 Read 8 New Done Done false
13979 3214 Acked 4213 Read 3 New Done Done false
13980 3215 Acked 4214 Flush 0 New Done Done false
13981 3216 Acked 4215 Flush 0 New Done Done false
13982 3217 Acked 4216 Read 5 New Done Done false
13983 3218 Acked 4217 Write 6 New Done Done false
13984 3219 Acked 4218 Flush 0 New Done Done false
13985 3220 Acked 4219 Write 8 New Done Done false
13986 3221 Acked 4220 Read 3 New Done Done false
13987 3222 Acked 4221 Write 5 New Done Done false
13988 3223 Acked 4222 Read 3 New Done Done false
13989 3224 Acked 4223 Read 7 New Done Done false
13990 3225 Acked 4224 Read 5 New Done Done false
13991 3226 Acked 4225 Read 10 New Done Done false
13992 3227 Acked 4226 Write 9 New Done Done false
13993 3228 Acked 4227 Flush 0 New Done Done false
13994 3229 Acked 4228 Read 6 New Done Done false
13995 3230 Acked 4229 Write 3 New Done Done false
13996 3231 Acked 4230 Flush 0 New Done Done false
13997 3232 Acked 4231 Read 2 New Done Done false
13998 3233 Acked 4232 Flush 0 New Done Done false
13999 3234 Acked 4233 Write 2 New Done Done false
14000 3235 Acked 4234 Write 4 New Done Done false
14001 3236 Acked 4235 Read 8 New Done Done false
14002 3237 Acked 4236 Read 10 New Done Done false
14003 3238 Acked 4237 Write 9 New Done Done false
14004 3239 Acked 4238 Read 7 New Done Done false
14005 3240 Acked 4239 Read 1 New Done Done false
14006 3241 Acked 4240 Write 7 New Done Done false
14007 3242 Acked 4241 Write 8 New Done Done false
14008 3243 Acked 4242 Read 1 New Done Done false
14009 3244 Acked 4243 Write 7 New Done Done false
14010 3245 Acked 4244 Read 9 New Done Done false
14011 3246 Acked 4245 Read 2 New Done Done false
14012 3247 Acked 4246 Read 7 New Done Done false
14013 3248 Acked 4247 Read 10 New Done Done false
14014 3249 Acked 4248 Read 6 New Done Done false
14015 3250 Acked 4249 Read 2 New Done Done false
14016 3251 Acked 4250 Write 6 New Done Done false
14017 3252 Acked 4251 Write 6 New Done Done false
14018 3253 Acked 4252 Read 1 New Done Done false
14019 3254 Acked 4253 Read 4 New Done Done false
14020 3255 Acked 4254 Write 4 New Done Done false
14021 3256 Acked 4255 Read 7 New Done Done false
14022 3257 Acked 4256 Read 6 New Done Done false
14023 3258 Acked 4257 Read 3 New Done Done false
14024 3259 Acked 4258 Read 5 New Done Done false
14025 3260 Acked 4259 Write 6 New Done Done false
14026 3261 Acked 4260 Write 5 New Done Done false
14027 3262 Acked 4261 Write 4 New Done Done false
14028 3263 Acked 4262 Read 8 New Done Done false
14029 3264 Acked 4263 Write 5 New Done Done false
14030 3265 Acked 4264 Write 9 New Done Done false
14031 3266 Acked 4265 Read 10 New Done Done false
14032 3267 Acked 4266 Read 4 New Done Done false
14033 3268 Acked 4267 Read 6 New Done Done false
14034 3269 Acked 4268 Write 9 New Done Done false
14035 3270 Acked 4269 Flush 0 New Done Done false
14036 3271 Acked 4270 Read 4 New Done Done false
14037 3272 Acked 4271 Flush 0 New Done Done false
14038 3273 Acked 4272 Read 10 New Done Done false
14039 3274 Acked 4273 Write 8 New Done Done false
14040 3275 Acked 4274 Flush 0 New Done Done false
14041 3276 Acked 4275 Write 3 New Done Done false
14042 3277 Acked 4276 Write 8 New Done Done false
14043 3278 Acked 4277 Write 9 New Done Done false
14044 3279 Acked 4278 Write 5 New Done Done false
14045 3280 Acked 4279 Write 3 New Done Done false
14046 3281 Acked 4280 Read 2 New Done Done false
14047 3282 Acked 4281 Read 10 New Done Done false
14048 3283 Acked 4282 Read 2 New Done Done false
14049 3284 Acked 4283 Read 8 New Done Done false
14050 3285 Acked 4284 Read 2 New Done Done false
14051 3286 Acked 4285 Write 8 New Done Done false
14052 3287 Acked 4286 Read 5 New Done Done false
14053 3288 Acked 4287 Flush 0 New Done Done false
14054 3289 Acked 4288 Read 5 New Done Done false
14055 3290 Acked 4289 Read 8 New Done Done false
14056 3291 Acked 4290 Read 10 New Done Done false
14057 3292 Acked 4291 Write 10 New Done Done false
14058 3293 Acked 4292 Write 2 New Done Done false
14059 3294 Acked 4293 Write 9 New Done Done false
14060 3295 Acked 4294 Flush 0 New Done Done false
14061 3296 Acked 4295 Write 8 New Done Done false
14062 3297 Acked 4296 Read 5 New Done Done false
14063 3298 Acked 4297 Flush 0 New Done Done false
14064 3299 Acked 4298 Read 6 New Done Done false
14065 3300 Acked 4299 Read 2 New Done Done false
14066 3301 Acked 4300 Read 7 New Done Done false
14067 3302 Acked 4301 Write 2 New Done Done false
14068 3303 Acked 4302 Write 7 New Done Done false
14069 3304 Acked 4303 Read 7 New Done Done false
14070 3305 Acked 4304 Write 8 New Done Done false
14071 3306 Acked 4305 Write 10 New Done Done false
14072 3307 Acked 4306 Flush 0 New Done Done false
14073 3308 Acked 4307 Read 10 New Done Done false
14074 3309 Acked 4308 Read 9 New Done Done false
14075 3310 Acked 4309 Read 10 New Done Done false
14076 3311 Acked 4310 Write 4 New Done Done false
14077 3312 Acked 4311 Read 2 New Done Done false
14078 3313 Acked 4312 Write 7 New Done Done false
14079 3314 Acked 4313 Write 9 New Done Done false
14080 3315 Acked 4314 Write 7 New Done Done false
14081 3316 Acked 4315 Write 10 New Done Done false
14082 3317 Acked 4316 Flush 0 New Done Done false
14083 STATES DS:0 DS:1 DS:2 TOTAL
14084 New 302 0 0 302
14085 Sent 0 0 0 0
14086 Done 0 302 302 604
14087 Skipped 0 0 0 0
14088 Error 0 0 0 0
14089 Last Flush: 4014 4316 4316
14090 Downstairs last five completed: 4014 4013 4012 4011 4010
14091 Upstairs last five completed: 3317 3316 3315 3314 3313
14092 CLIENT: Up:0 ds:302 act:2
140932024-04-20T01:08:01.288ZINFOcrucible: connecting to 127.0.0.1:8810 = io task client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
140942024-04-20T01:08:01.289ZINFOcrucible: ds_connection connected from Ok(127.0.0.1:64156) = io task client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
140952024-04-20T01:08:01.290ZINFOcrucible: downstairs client at Some(127.0.0.1:8810) has region UUID 12345678-0000-0000-0000-000000008810 = downstairs client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
140962024-04-20T01:08:01.290ZINFOcrucible: Returning UUID:12345678-0000-0000-0000-000000008810 matches = downstairs client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
140972024-04-20T01:08:01.290ZINFOcrucible: send last flush ID to this DS: 4014 = downstairs client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
140982024-04-20T01:08:01.290ZINFOcrucible: Replied this last flush ID: 4014 = downstairs client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
140992024-04-20T01:08:01.290ZINFOcrucible: ds_transition from Offline to Replay = downstairs client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
141002024-04-20T01:08:01.290ZINFOcrucible: [0] Transition from Offline to Replay = downstairs client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
141012024-04-20T01:08:01.290ZINFOcrucible: ds_transition from Replay to Active = downstairs client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
141022024-04-20T01:08:01.290ZINFOcrucible: [0] Transition from Replay to Active = downstairs client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
14103 ----------------------------------------------------------------
14104 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:0
14105 Downstairs last five completed: 4316 4315 4314 4313 4312
14106 Upstairs last five completed: 3317 3316 3315 3314 3313
14107 CLIENT: Up:0 ds:0 act:3
14108 Replay: All jobs finished, all DS active.
14109 Main task has work to do, go find it
14110 got dsc Stop(1)
14111 stop 1
14112 [8820] Got stop action so:false kr:false
14113 Apr 20 01:08:03.591 INFO request completed, latency_us: 299, response_code: 204, uri: /stop/cid/1, method: POST, req_id: d18a958f-8659-410b-841e-cf66f7a80187, remote_addr: 127.0.0.1:60352, local_addr: 127.0.0.1:9998
141142024-04-20T01:08:03.592ZWARNcrucible: downstairs disconnected = io task client = 1 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
141152024-04-20T01:08:03.592ZWARNcrucible: client task is sending Done(Finished) = io task client = 1 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
14116 Apr 20 01:08:03.592 INFO request completed, latency_us{"msg":"downstairs task for 1 stopped due to Finished","v":0,"name":"crucible","level":40,"time":"2024-04-20T01:08:03.592714125Z","hostname":"w-01HVWGBJP7HK0H9TQ26T6N3X8M","pid":1196,"session_id":"132b460a-26a0-4532-b1ab-4f8c07d4c6c7"}
14117 : 102, response_code: 200, uri: /state/cid/1, method{"msg":"Gone missing, transition from Active to Offline","v":0,"name":"crucible","level":30,"time":"2024-04-20T01:08:03.592727564Z","hostname":"w-01HVWGBJP7HK0H9TQ26T6N3X8M","pid":1196,"client":"1","":"downstairs","session_id":"132b460a-26a0-4532-b1ab-4f8c07d4c6c7"}
14118 : GET, req_id: b73b4290-fdc3-45ee-944e-2076e37cd10a, remote_addr: 127.0.0.1:60352, local_addr: 127.0.0.1:9998
141192024-04-20T01:08:03.592ZINFOcrucible: [1] client re-new 0 jobs since flush 4316 = downstairs session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
141202024-04-20T01:08:03.592ZINFOcrucible: [1] Marked 0 jobs for replay since flush: 4316 = downstairs session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
141212024-04-20T01:08:03.592ZINFOcrucible: client task is exiting = io task client = 1 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
14122 [8820] Exited with: ExitStatus(unix_wait_status(9))
14123 [8820][1] reports Exit
14124 Apr 20 01:08:07.594 INFO request completed, latency_us: 180, response_code: 200, uri: /state/cid/1, method: GET, req_id: 9e5378a1-b9e6-48ed-a8ee-9cc1a3b2f2a0, remote_addr: 127.0.0.1:60352, local_addr: 127.0.0.1:9998
14125 001/300 Read block 395 len 8192
14126 002/300 Write block 3279 len 20480 data: 4 3 4 4 4
14127 003/300 Write block 3194 len 36864 data: 3 3 3 2 3 3 4 4 5
14128 004/300 Read block 722 len 40960
14129 005/300 Read block 148 len 36864
14130 006/300 Write block 2504 len 36864 data: 5 5 3 2 3 3 4 4 4
14131 007/300 Read block 542 len 8192
14132 008/300 Read block 2452 len 8192
14133 009/300 Read block 3653 len 24576
14134 010/300 Read block 3165 len 24576
14135 011/300 Read block 4932 len 8192
14136 012/300 Read block 3317 len 24576
14137 013/300 Read block 3405 len 12288
14138 014/300 Write block 3437 len 16384 data: 2 3 3 4
14139 015/300 Read block 4393 len 32768
14140 016/300 Write block 60 len 28672 data: 4 5 3 3 4 4 4
14141 017/300 Read block 307 len 12288
14142 018/300 Write block 3751 len 20480 data: 4 3 2 2 3
14143 019/300 Write block 2348 len 28672 data: 7 5 5 4 4 3 3
14144 020/300 Write block 1821 len 16384 data: 2 2 3 3
14145 021/300 Read block 1074 len 32768
14146 022/300 Write block 1439 len 36864 data: 4 5 5 6 4 5 6 4 4
14147 023/300 Read block 1402 len 36864
14148 024/300 Write block 2469 len 4096 data: 5
14149 025/300 Read block 3516 len 36864
14150 026/300 Write block 788 len 20480 data: 5 4 4 3 3
14151 027/300 Read block 2946 len 36864
14152 028/300 Read block 952 len 32768
14153 029/300 Read block 3030 len 28672
14154 030/300 Write block 274 len 32768 data: 3 3 3 4 4 4 3 2
14155 031/300 Write block 3674 len 4096 data: 3
14156 032/300 Read block 2735 len 40960
14157 033/300 Flush
14158 034/300 Read block 4551 len 4096
14159 035/300 Flush
14160 036/300 Write block 513 len 8192 data: 5 3
14161 037/300 Read block 4476 len 8192
14162 038/300 Write block 2603 len 32768 data: 4 4 4 4 2 2 2 2
14163 039/300 Write block 2834 len 40960 data: 2 3 4 2 2 3 3 4 4 5
14164 040/300 Read block 1940 len 4096
14165 041/300 Read block 1115 len 24576
14166 042/300 Read block 1558 len 12288
14167 043/300 Read block 3945 len 20480
14168 044/300 Read block 4010 len 4096
14169 045/300 Write block 1749 len 12288 data: 3 3 2
14170 046/300 Write block 4627 len 8192 data: 4 4
14171 047/300 Read block 2891 len 4096
14172 048/300 Read block 1108 len 20480
14173 049/300 Read block 2355 len 12288
14174 050/300 Write block 2819 len 20480 data: 3 3 2 2 2
14175 051/300 Flush
14176 052/300 Read block 2932 len 32768
14177 053/300 Read block 4874 len 12288
14178 054/300 Write block 673 len 20480 data: 5 5 4 3 3
14179 055/300 Flush
14180 056/300 Read block 480 len 24576
14181 057/300 Write block 3339 len 8192 data: 3 3
14182 058/300 Flush
14183 059/300 Read block 1715 len 16384
14184 060/300 Write block 2348 len 24576 data: 8 6 6 5 5 4
14185 061/300 Read block 227 len 36864
14186 062/300 Write block 1896 len 40960 data: 6 6 4 5 3 2 4 5 4 4
14187 063/300 Flush
14188 064/300 Read block 2262 len 24576
14189 065/300 Write block 1940 len 8192 data: 2 2
14190 066/300 Read block 4920 len 36864
14191 067/300 Write block 4948 len 28672 data: 4 3 4 4 5 4 4
14192 068/300 Write block 3393 len 8192 data: 3 3
14193 069/300 Write block 1667 len 40960 data: 6 5 3 3 3 3 3 3 3 4
14194 070/300 Flush
14195 071/300 Read block 3776 len 16384
14196 072/300 Read block 1365 len 28672
14197 073/300 Write block 1720 len 36864 data: 2 2 2 2 2 2 2 2 2
14198 074/300 Write block 4675 len 20480 data: 4 4 4 4 4
14199 075/300 Write block 684 len 12288 data: 4 4 5
14200 076/300 Read block 473 len 16384
14201 077/300 Read block 309 len 36864
14202 078/300 Write block 1187 len 24576 data: 2 2 2 2 2 2
14203 079/300 Read block 2801 len 32768
14204 080/300 Write block 4170 len 12288 data: 7 6 6
14205 081/300 Write block 2726 len 16384 data: 5 6 6 6
14206 082/300 Write block 2124 len 40960 data: 2 2 3 3 3 3 3 3 3 3
14207 083/300 Write block 4655 len 12288 data: 2 4 4
14208 084/300 Flush
14209 085/300 Flush
14210 086/300 Write block 3784 len 24576 data: 2 3 3 3 3 4
14211 087/300 Write block 2653 len 24576 data: 2 2 2 2 2 2
14212 088/300 Read block 812 len 28672
14213 089/300 Read block 4772 len 16384
14214 090/300 Read block 3212 len 32768
14215 091/300 Read block 4173 len 32768
14216 092/300 Flush
14217 093/300 Flush
14218 094/300 Write block 4777 len 8192 data: 3 3
14219 095/300 Write block 659 len 24576 data: 3 3 4 4 4 4
14220 096/300 Read block 1500 len 40960
14221 097/300 Read block 203 len 28672
14222 098/300 Write block 4052 len 24576 data: 2 3 3 3 3 2
14223 099/300 Read block 2528 len 28672
14224 100/300 Read block 4114 len 40960
14225 101/300 Write block 2358 len 8192 data: 5 4
14226 102/300 Read block 3973 len 32768
14227 103/300 Write block 4495 len 8192 data: 3 3
14228 104/300 Write block 1029 len 20480 data: 4 5 6 6 4
14229 105/300 Write block 4931 len 36864 data: 2 2 2 2 2 2 2 3 3
14230 106/300 Read block 2760 len 16384
14231 107/300 Read block 4636 len 28672
14232 108/300 Read block 3563 len 20480
14233 109/300 Write block 3035 len 28672 data: 2 2 3 3 2 2 2
14234 110/300 Write block 860 len 16384 data: 3 3 3 3
14235 111/300 Write block 2582 len 4096 data: 2
14236 112/300 Read block 1186 len 12288
14237 113/300 Write block 2229 len 4096 data: 4
14238 114/300 Read block 2460 len 8192
14239 115/300 Read block 1472 len 40960
14240 116/300 Flush
14241 117/300 Write block 3363 len 36864 data: 3 3 3 3 3 3 3 2 3
14242 118/300 Write block 486 len 4096 data: 3
14243 119/300 Read block 929 len 4096
14244 120/300 Write block 2248 len 24576 data: 4 4 3 3 2 3
14245 121/300 Flush
14246 122/300 Read block 326 len 16384
14247 123/300 Write block 1206 len 28672 data: 4 4 3 3 3 3 3
14248 124/300 Write block 3955 len 24576 data: 5 6 6 6 6 6
14249 125/300 Read block 951 len 28672
14250 126/300 Read block 3480 len 36864
14251 127/300 Read block 933 len 16384
14252 128/300 Write block 1577 len 12288 data: 2 3 2
14253 129/300 Write block 4237 len 28672 data: 2 2 2 3 3 3 3
14254 130/300 Write block 3838 len 12288 data: 4 4 4
14255 131/300 Write block 1304 len 24576 data: 5 6 6 5 5 4
14256 132/300 Read block 2306 len 28672
14257 133/300 Write block 323 len 28672 data: 5 4 6 4 4 4 4
14258 134/300 Read block 2401 len 4096
14259 135/300 Read block 2756 len 4096
14260 136/300 Flush
14261 137/300 Read block 4062 len 16384
14262 138/300 Read block 2227 len 20480
14263 139/300 Read block 187 len 8192
14264 140/300 Write block 2600 len 8192 data: 4 4
14265 141/300 Write block 1777 len 8192 data: 5 6
14266 142/300 Read block 4015 len 36864
14267 143/300 Flush
14268 144/300 Read block 2346 len 4096
14269 145/300 Read block 400 len 4096
14270 146/300 Write block 556 len 36864 data: 3 3 4 4 4 4 3 3 3
14271 147/300 Read block 4838 len 40960
14272 148/300 Read block 4222 len 4096
14273 149/300 Read block 2902 len 8192
14274 150/300 Read block 4558 len 16384
14275 151/300 Read block 2068 len 32768
14276 152/300 Write block 2938 len 12288 data: 4 3 3
14277 153/300 Flush
14278 154/300 Read block 357 len 4096
14279 155/300 Write block 2315 len 4096 data: 3
14280 156/300 Read block 4173 len 16384
14281 157/300 Read block 2967 len 40960
14282 158/300 Write block 3419 len 24576 data: 4 4 3 3 3 4
14283 159/300 Read block 379 len 28672
14284 160/300 Read block 3903 len 24576
14285 161/300 Write block 567 len 28672 data: 3 2 2 3 3 3 4
14286 162/300 Read block 46 len 12288
14287 163/300 Write block 4763 len 12288 data: 3 3 3
14288 164/300 Write block 1524 len 24576 data: 3 3 2 2 2 3
14289 165/300 Read block 4897 len 24576
14290 166/300 Read block 4715 len 24576
14291 167/300 Read block 3439 len 20480
14292 168/300 Write block 462 len 36864 data: 2 2 2 2 4 4 3 3 3
14293 169/300 Read block 3399 len 32768
14294 170/300 Write block 516 len 4096 data: 4
14295 171/300 Read block 3458 len 36864
14296 172/300 Read block 1617 len 12288
14297 173/300 Read block 4198 len 8192
14298 174/300 Read block 2056 len 12288
14299 175/300 Read block 689 len 20480
14300 176/300 Read block 1135 len 20480
14301 177/300 Write block 1914 len 28672 data: 4 4 5 4 4 3 3
14302 178/300 Read block 2003 len 16384
14303 179/300 Write block 729 len 40960 data: 6 5 4 3 4 4 4 4 3 3
14304 180/300 Read block 728 len 20480
14305 181/300 Write block 4892 len 20480 data: 3 3 3 2 3
14306 182/300 Write block 3911 len 12288 data: 4 5 5
14307 183/300 Read block 2218 len 20480
14308 184/300 Write block 2022 len 32768 data: 6 7 6 5 5 3 2 2
14309 185/300 Write block 3009 len 12288 data: 6 6 5
14310 186/300 Write block 4708 len 20480 data: 4 4 3 4 3
14311 187/300 Read block 2932 len 16384
14312 188/300 Flush
14313 189/300 Read block 631 len 36864
14314 190/300 Write block 320 len 32768 data: 5 4 4 6 5 7 5 5
14315 191/300 Read block 4380 len 24576
14316 192/300 Read block 2595 len 36864
14317 193/300 Read block 501 len 4096
14318 194/300 Flush
14319 195/300 Write block 4402 len 8192 data: 2 2
14320 196/300 Read block 2647 len 24576
14321 197/300 Write block 2980 len 16384 data: 4 4 5 5
14322 198/300 Read block 4405 len 28672
14323 199/300 Read block 737 len 32768
14324 200/300 Write block 865 len 8192 data: 3 3
14325 201/300 Write block 717 len 20480 data: 3 3 3 3 3
14326 202/300 Read block 4510 len 16384
14327 203/300 Read block 3380 len 40960
14328 204/300 Read block 2664 len 8192
14329 205/300 Write block 696 len 36864 data: 3 3 3 3 3 2 2 2 2
14330 206/300 Read block 714 len 12288
14331 207/300 Read block 543 len 36864
14332 208/300 Read block 2397 len 4096
14333 209/300 Read block 3586 len 4096
14334 210/300 Write block 234 len 4096 data: 2
14335 211/300 Read block 1040 len 8192
14336 212/300 Write block 1496 len 16384 data: 4 5 4 4
14337 213/300 Flush
14338 214/300 Read block 1676 len 24576
14339 215/300 Write block 4873 len 40960 data: 6 6 7 7 7 5 5 4 3 2
14340 216/300 Write block 3956 len 20480 data: 7 7 7 7 7
14341 217/300 Read block 1819 len 4096
14342 218/300 Read block 1511 len 20480
14343 219/300 Write block 4823 len 36864 data: 5 4 5 5 5 4 3 3 4
14344 220/300 Read block 3888 len 20480
14345 221/300 Write block 245 len 40960 data: 7 5 4 4 4 5 5 5 3 4
14346 222/300 Write block 580 len 40960 data: 4 4 3 2 2 2 2 2 2 3
14347 223/300 Read block 3106 len 40960
14348 224/300 Read block 4302 len 20480
14349 225/300 Flush
14350 226/300 Read block 1591 len 8192
14351 227/300 Read block 3288 len 20480
14352 228/300 Read block 4077 len 24576
14353 229/300 Read block 4018 len 8192
14354 230/300 Read block 451 len 12288
14355 231/300 Read block 559 len 40960
14356 232/300 Write block 4425 len 32768 data: 2 3 3 3 3 3 3 3
14357 233/300 Read block 1199 len 20480
14358 234/300 Write block 2170 len 12288 data: 3 3 3
14359 235/300 Write block 4927 len 4096 data: 2
14360 236/300 Read block 4690 len 40960
14361 237/300 Read block 4868 len 20480
14362 238/300 Read block 3633 len 28672
14363 239/300 Read block 996 len 8192
14364 240/300 Read block 1086 len 8192
14365 241/300 Read block 3675 len 32768
14366 242/300 Flush
14367 243/300 Read block 4075 len 28672
14368 244/300 Flush
14369 245/300 Read block 3537 len 40960
14370 246/300 Write block 1191 len 12288 data: 3 3 2
14371 247/300 Write block 4670 len 8192 data: 3 3
14372 248/300 Read block 2322 len 28672
14373 249/300 Write block 4244 len 20480 data: 3 4 5 3 4
14374 250/300 Read block 2778 len 20480
14375 251/300 Read block 2348 len 36864
14376 252/300 Read block 2815 len 32768
14377 253/300 Read block 3581 len 32768
14378 254/300 Read block 4237 len 40960
14379 255/300 Flush
14380 256/300 Write block 1614 len 8192 data: 3 3
14381 257/300 Write block 2912 len 4096 data: 4
14382 258/300 Write block 2163 len 28672 data: 4 4 4 4 4 3 3
14383 259/300 Write block 4307 len 12288 data: 4 4 4
14384 260/300 Read block 3858 len 28672
14385 261/300 Write block 1753 len 40960 data: 2 2 2 2 3 2 2 3 3 3
14386 262/300 Write block 2163 len 40960 data: 5 5 5 5 5 4 4 4 4 4
14387 263/300 Write block 3341 len 12288 data: 3 3 3
14388 264/300 Read block 520 len 16384
14389 265/300 Write block 1366 len 12288 data: 3 2 2
14390 266/300 Read block 4578 len 40960
14391 267/300 Write block 992 len 16384 data: 3 3 4 3
14392 268/300 Flush
14393 269/300 Flush
14394 270/300 Write block 1253 len 24576 data: 3 3 4 4 3 3
14395 271/300 Read block 3367 len 28672
14396 272/300 Read block 2980 len 24576
14397 273/300 Write block 4143 len 4096 data: 5
14398 274/300 Read block 112 len 12288
14399 275/300 Read block 4655 len 20480
14400 276/300 Read block 3173 len 4096
14401 277/300 Read block 2024 len 24576
14402 278/300 Write block 106 len 32768 data: 2 2 2 2 2 3 4 5
14403 279/300 Write block 2326 len 36864 data: 3 3 3 2 2 3 3 3 4
14404 280/300 Write block 4583 len 16384 data: 3 3 3 3
14405 281/300 Read block 4981 len 40960
14406 282/300 Write block 602 len 16384 data: 3 3 4 4
14407 283/300 Write block 3369 len 28672 data: 4 3 4 3 3 3 3
14408 284/300 Read block 469 len 4096
14409 285/300 Read block 3751 len 32768
14410 286/300 Write block 1054 len 24576 data: 3 3 5 5 4 4
14411 287/300 Read block 1388 len 16384
14412 288/300 Read block 2611 len 28672
14413 289/300 Read block 1007 len 32768
14414 290/300 Write block 407 len 8192 data: 3 3
14415 291/300 Read block 3215 len 28672
14416 292/300 Read block 1864 len 16384
14417 293/300 Read block 1164 len 36864
14418 294/300 Read block 2245 len 12288
14419 295/300 Read block 3540 len 20480
14420 296/300 Write block 818 len 32768 data: 3 2 2 2 2 3 3 3
14421 297/300 Read block 460 len 16384
14422 298/300 Read block 91 len 8192
14423 299/300 Flush
14424 300/300 Read block 804 len 36864
14425 Main task has work to do, go find it
14426 got dsc Start(1)
14427 start 1
14428 Apr 20 01:08:07.892 INFO request completed, latency_us: 219, response_code: 204, uri: /start/cid/1, method: POST, req_id: ba9ecaf1-527c-4587-ac58-9edff2905700, remote_addr: 127.0.0.1:60352, local_addr: 127.0.0.1:9998
14429 Replay: started 1, returned:Ok(())
14430 ----------------------------------------------------------------
14431 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:301
14432 States: Active Offline Active
14433 GW_ID ACK DSID TYPE BLOCKS DS:0 DS:1 DS:2 REPLAY
14434 3318 Acked 4317 Read 2 Done New Done false
14435 3319 Acked 4318 Write 5 Done New Done false
14436 3320 Acked 4319 Write 9 Done New Done false
14437 3321 Acked 4320 Read 10 Done New Done false
14438 3322 Acked 4321 Read 9 Done New Done false
14439 3323 Acked 4322 Write 9 Done New Done false
14440 3324 Acked 4323 Read 2 Done New Done false
14441 3325 Acked 4324 Read 2 Done New Done false
14442 3326 Acked 4325 Read 6 Done New Done false
14443 3327 Acked 4326 Read 6 Done New Done false
14444 3328 Acked 4327 Read 2 Done New Done false
14445 3329 Acked 4328 Read 6 Done New Done false
14446 3330 Acked 4329 Read 3 Done New Done false
14447 3331 Acked 4330 Write 4 Done New Done false
14448 3332 Acked 4331 Read 8 Done New Done false
14449 3333 Acked 4332 Write 7 Done New Done false
14450 3334 Acked 4333 Read 3 Done New Done false
14451 3335 Acked 4334 Write 5 Done New Done false
14452 3336 Acked 4335 Write 7 Done New Done false
14453 3337 Acked 4336 Write 4 Done New Done false
14454 3338 Acked 4337 Read 8 Done New Done false
14455 3339 Acked 4338 Write 9 Done New Done false
14456 3340 Acked 4339 Read 9 Done New Done false
14457 3341 Acked 4340 Write 1 Done New Done false
14458 3342 Acked 4341 Read 9 Done New Done false
14459 3343 Acked 4342 Write 5 Done New Done false
14460 3344 Acked 4343 Read 9 Done New Done false
14461 3345 Acked 4344 Read 8 Done New Done false
14462 3346 Acked 4345 Read 7 Done New Done false
14463 3347 Acked 4346 Write 8 Done New Done false
14464 3348 Acked 4347 Write 1 Done New Done false
14465 3349 Acked 4348 Read 10 Done New Done false
14466 3350 Acked 4349 Flush 0 Done New Done false
14467 3351 Acked 4350 Read 1 Done New Done false
14468 3352 Acked 4351 Flush 0 Done New Done false
14469 3353 Acked 4352 Write 2 Done New Done false
14470 3354 Acked 4353 Read 2 Done New Done false
14471 3355 Acked 4354 Write 8 Done New Done false
14472 3356 Acked 4355 Write 10 Done New Done false
14473 3357 Acked 4356 Read 1 Done New Done false
14474 3358 Acked 4357 Read 6 Done New Done false
14475 3359 Acked 4358 Read 3 Done New Done false
14476 3360 Acked 4359 Read 5 Done New Done false
14477 3361 Acked 4360 Read 1 Done New Done false
14478 3362 Acked 4361 Write 3 Done New Done false
14479 3363 Acked 4362 Write 2 Done New Done false
14480 3364 Acked 4363 Read 1 Done New Done false
14481 3365 Acked 4364 Read 5 Done New Done false
14482 3366 Acked 4365 Read 3 Done New Done false
14483 3367 Acked 4366 Write 5 Done New Done false
14484 3368 Acked 4367 Flush 0 Done New Done false
14485 3369 Acked 4368 Read 8 Done New Done false
14486 3370 Acked 4369 Read 3 Done New Done false
14487 3371 Acked 4370 Write 5 Done New Done false
14488 3372 Acked 4371 Flush 0 Done New Done false
14489 3373 Acked 4372 Read 6 Done New Done false
14490 3374 Acked 4373 Write 2 Done New Done false
14491 3375 Acked 4374 Flush 0 Done New Done false
14492 3376 Acked 4375 Read 4 Done New Done false
14493 3377 Acked 4376 Write 6 Done New Done false
14494 3378 Acked 4377 Read 9 Done New Done false
14495 3379 Acked 4378 Write 10 Done New Done false
14496 3380 Acked 4379 Flush 0 Done New Done false
14497 3381 Acked 4380 Read 6 Done New Done false
14498 3382 Acked 4381 Write 2 Done New Done false
14499 3383 Acked 4382 Read 9 Done New Done false
14500 3384 Acked 4383 Write 7 Done New Done false
14501 3385 Acked 4384 Write 2 Done New Done false
14502 3386 Acked 4385 Write 10 Done New Done false
14503 3387 Acked 4386 Flush 0 Done New Done false
14504 3388 Acked 4387 Read 4 Done New Done false
14505 3389 Acked 4388 Read 7 Done New Done false
14506 3390 Acked 4389 Write 9 Done New Done false
14507 3391 Acked 4390 Write 5 Done New Done false
14508 3392 Acked 4391 Write 3 Done New Done false
14509 3393 Acked 4392 Read 4 Done New Done false
14510 3394 Acked 4393 Read 9 Done New Done false
14511 3395 Acked 4394 Write 6 Done New Done false
14512 3396 Acked 4395 Read 8 Done New Done false
14513 3397 Acked 4396 Write 3 Done New Done false
14514 3398 Acked 4397 Write 4 Done New Done false
14515 3399 Acked 4398 Write 10 Done New Done false
14516 3400 Acked 4399 Write 3 Done New Done false
14517 3401 Acked 4400 Flush 0 Done New Done false
14518 3402 Acked 4401 Flush 0 Done New Done false
14519 3403 Acked 4402 Write 6 Done New Done false
14520 3404 Acked 4403 Write 6 Done New Done false
14521 3405 Acked 4404 Read 7 Done New Done false
14522 3406 Acked 4405 Read 4 Done New Done false
14523 3407 Acked 4406 Read 8 Done New Done false
14524 3408 Acked 4407 Read 8 Done New Done false
14525 3409 Acked 4408 Flush 0 Done New Done false
14526 3410 Acked 4409 Flush 0 Done New Done false
14527 3411 Acked 4410 Write 2 Done New Done false
14528 3412 Acked 4411 Write 6 Done New Done false
14529 3413 Acked 4412 Read 10 Done New Done false
14530 3414 Acked 4413 Read 7 Done New Done false
14531 3415 Acked 4414 Write 6 Done New Done false
14532 3416 Acked 4415 Read 7 Done New Done false
14533 3417 Acked 4416 Read 10 Done New Done false
14534 3418 Acked 4417 Write 2 Done New Done false
14535 3419 Acked 4418 Read 8 Done New Done false
14536 3420 Acked 4419 Write 2 Done New Done false
14537 3421 Acked 4420 Write 5 Done New Done false
14538 3422 Acked 4421 Write 9 Done New Done false
14539 3423 Acked 4422 Read 4 Done New Done false
14540 3424 Acked 4423 Read 7 Done New Done false
14541 3425 Acked 4424 Read 5 Done New Done false
14542 3426 Acked 4425 Write 7 Done New Done false
14543 3427 Acked 4426 Write 4 Done New Done false
14544 3428 Acked 4427 Write 1 Done New Done false
14545 3429 Acked 4428 Read 3 Done New Done false
14546 3430 Acked 4429 Write 1 Done New Done false
14547 3431 Acked 4430 Read 2 Done New Done false
14548 3432 Acked 4431 Read 10 Done New Done false
14549 3433 Acked 4432 Flush 0 Done New Done false
14550 3434 Acked 4433 Write 9 Done New Done false
14551 3435 Acked 4434 Write 1 Done New Done false
14552 3436 Acked 4435 Read 1 Done New Done false
14553 3437 Acked 4436 Write 6 Done New Done false
14554 3438 Acked 4437 Flush 0 Done New Done false
14555 3439 Acked 4438 Read 4 Done New Done false
14556 3440 Acked 4439 Write 7 Done New Done false
14557 3441 Acked 4440 Write 6 Done New Done false
14558 3442 Acked 4441 Read 7 Done New Done false
14559 3443 Acked 4442 Read 9 Done New Done false
14560 3444 Acked 4443 Read 4 Done New Done false
14561 3445 Acked 4444 Write 3 Done New Done false
14562 3446 Acked 4445 Write 7 Done New Done false
14563 3447 Acked 4446 Write 3 Done New Done false
14564 3448 Acked 4447 Write 6 Done New Done false
14565 3449 Acked 4448 Read 7 Done New Done false
14566 3450 Acked 4449 Write 7 Done New Done false
14567 3451 Acked 4450 Read 1 Done New Done false
14568 3452 Acked 4451 Read 1 Done New Done false
14569 3453 Acked 4452 Flush 0 Done New Done false
14570 3454 Acked 4453 Read 4 Done New Done false
14571 3455 Acked 4454 Read 5 Done New Done false
14572 3456 Acked 4455 Read 2 Done New Done false
14573 3457 Acked 4456 Write 2 Done New Done false
14574 3458 Acked 4457 Write 2 Done New Done false
14575 3459 Acked 4458 Read 9 Done New Done false
14576 3460 Acked 4459 Flush 0 Done New Done false
14577 3461 Acked 4460 Read 1 Done New Done false
14578 3462 Acked 4461 Read 1 Done New Done false
14579 3463 Acked 4462 Write 9 Done New Done false
14580 3464 Acked 4463 Read 10 Done New Done false
14581 3465 Acked 4464 Read 1 Done New Done false
14582 3466 Acked 4465 Read 2 Done New Done false
14583 3467 Acked 4466 Read 4 Done New Done false
14584 3468 Acked 4467 Read 8 Done New Done false
14585 3469 Acked 4468 Write 3 Done New Done false
14586 3470 Acked 4469 Flush 0 Done New Done false
14587 3471 Acked 4470 Read 1 Done New Done false
14588 3472 Acked 4471 Write 1 Done New Done false
14589 3473 Acked 4472 Read 4 Done New Done false
14590 3474 Acked 4473 Read 10 Done New Done false
14591 3475 Acked 4474 Write 6 Done New Done false
14592 3476 Acked 4475 Read 7 Done New Done false
14593 3477 Acked 4476 Read 6 Done New Done false
14594 3478 Acked 4477 Write 7 Done New Done false
14595 3479 Acked 4478 Read 3 Done New Done false
14596 3480 Acked 4479 Write 3 Done New Done false
14597 3481 Acked 4480 Write 6 Done New Done false
14598 3482 Acked 4481 Read 6 Done New Done false
14599 3483 Acked 4482 Read 6 Done New Done false
14600 3484 Acked 4483 Read 5 Done New Done false
14601 3485 Acked 4484 Write 9 Done New Done false
14602 3486 Acked 4485 Read 8 Done New Done false
14603 3487 Acked 4486 Write 1 Done New Done false
14604 3488 Acked 4487 Read 9 Done New Done false
14605 3489 Acked 4488 Read 3 Done New Done false
14606 3490 Acked 4489 Read 2 Done New Done false
14607 3491 Acked 4490 Read 3 Done New Done false
14608 3492 Acked 4491 Read 5 Done New Done false
14609 3493 Acked 4492 Read 5 Done New Done false
14610 3494 Acked 4493 Write 7 Done New Done false
14611 3495 Acked 4494 Read 4 Done New Done false
14612 3496 Acked 4495 Write 10 Done New Done false
14613 3497 Acked 4496 Read 5 Done New Done false
14614 3498 Acked 4497 Write 5 Done New Done false
14615 3499 Acked 4498 Write 3 Done New Done false
14616 3500 Acked 4499 Read 5 Done New Done false
14617 3501 Acked 4500 Write 8 Done New Done false
14618 3502 Acked 4501 Write 3 Done New Done false
14619 3503 Acked 4502 Write 5 Done New Done false
14620 3504 Acked 4503 Read 4 Done New Done false
14621 3505 Acked 4504 Flush 0 Done New Done false
14622 3506 Acked 4505 Read 9 Done New Done false
14623 3507 Acked 4506 Write 8 Done New Done false
14624 3508 Acked 4507 Read 6 Done New Done false
14625 3509 Acked 4508 Read 9 Done New Done false
14626 3510 Acked 4509 Read 1 Done New Done false
14627 3511 Acked 4510 Flush 0 Done New Done false
14628 3512 Acked 4511 Write 2 Done New Done false
14629 3513 Acked 4512 Read 6 Done New Done false
14630 3514 Acked 4513 Write 4 Done New Done false
14631 3515 Acked 4514 Read 7 Done New Done false
14632 3516 Acked 4515 Read 8 Done New Done false
14633 3517 Acked 4516 Write 2 Done New Done false
14634 3518 Acked 4517 Write 5 Done New Done false
14635 3519 Acked 4518 Read 4 Done New Done false
14636 3520 Acked 4519 Read 10 Done New Done false
14637 3521 Acked 4520 Read 2 Done New Done false
14638 3522 Acked 4521 Write 9 Done New Done false
14639 3523 Acked 4522 Read 3 Done New Done false
14640 3524 Acked 4523 Read 9 Done New Done false
14641 3525 Acked 4524 Read 1 Done New Done false
14642 3526 Acked 4525 Read 1 Done New Done false
14643 3527 Acked 4526 Write 1 Done New Done false
14644 3528 Acked 4527 Read 2 Done New Done false
14645 3529 Acked 4528 Write 4 Done New Done false
14646 3530 Acked 4529 Flush 0 Done New Done false
14647 3531 Acked 4530 Read 6 Done New Done false
14648 3532 Acked 4531 Write 10 Done New Done false
14649 3533 Acked 4532 Write 5 Done New Done false
14650 3534 Acked 4533 Read 1 Done New Done false
14651 3535 Acked 4534 Read 5 Done New Done false
14652 3536 Acked 4535 Write 9 Done New Done false
14653 3537 Acked 4536 Read 5 Done New Done false
14654 3538 Acked 4537 Write 10 Done New Done false
14655 3539 Acked 4538 Write 10 Done New Done false
14656 3540 Acked 4539 Read 10 Done New Done false
14657 3541 Acked 4540 Read 5 Done New Done false
14658 3542 Acked 4541 Flush 0 Done New Done false
14659 3543 Acked 4542 Read 2 Done New Done false
14660 3544 Acked 4543 Read 5 Done New Done false
14661 3545 Acked 4544 Read 6 Done New Done false
14662 3546 Acked 4545 Read 2 Done New Done false
14663 3547 Acked 4546 Read 3 Done New Done false
14664 3548 Acked 4547 Read 10 Done New Done false
14665 3549 Acked 4548 Write 8 Done New Done false
14666 3550 Acked 4549 Read 5 Done New Done false
14667 3551 Acked 4550 Write 3 Done New Done false
14668 3552 Acked 4551 Write 1 Done New Done false
14669 3553 Acked 4552 Read 10 Done New Done false
14670 3554 Acked 4553 Read 5 Done New Done false
14671 3555 Acked 4554 Read 7 Done New Done false
14672 3556 Acked 4555 Read 2 Done New Done false
14673 3557 Acked 4556 Read 2 Done New Done false
14674 3558 Acked 4557 Read 8 Done New Done false
14675 3559 Acked 4558 Flush 0 Done New Done false
14676 3560 Acked 4559 Read 7 Done New Done false
14677 3561 Acked 4560 Flush 0 Done New Done false
14678 3562 Acked 4561 Read 10 Done New Done false
14679 3563 Acked 4562 Write 3 Done New Done false
14680 3564 Acked 4563 Write 2 Done New Done false
14681 3565 Acked 4564 Read 7 Done New Done false
14682 3566 Acked 4565 Write 5 Done New Done false
14683 3567 Acked 4566 Read 5 Done New Done false
14684 3568 Acked 4567 Read 9 Done New Done false
14685 3569 Acked 4568 Read 8 Done New Done false
14686 3570 Acked 4569 Read 8 Done New Done false
14687 3571 Acked 4570 Read 10 Done New Done false
14688 3572 Acked 4571 Flush 0 Done New Done false
14689 3573 Acked 4572 Write 2 Done New Done false
14690 3574 Acked 4573 Write 1 Done New Done false
14691 3575 Acked 4574 Flush 0 Done New Done false
14692 3576 Acked 4575 Write 7 Done New Done false
14693 3577 Acked 4576 Write 3 Done New Done false
14694 3578 Acked 4577 Read 7 Done New Done false
14695 3579 Acked 4578 Write 10 Done New Done false
14696 3580 Acked 4579 Write 10 Done New Done false
14697 3581 Acked 4580 Write 3 Done New Done false
14698 3582 Acked 4581 Read 4 Done New Done false
14699 3583 Acked 4582 Write 3 Done New Done false
14700 3584 Acked 4583 Read 10 Done New Done false
14701 3585 Acked 4584 Write 4 Done New Done false
14702 3586 Acked 4585 Flush 0 Done New Done false
14703 3587 Acked 4586 Flush 0 Done New Done false
14704 3588 Acked 4587 Write 6 Done New Done false
14705 3589 Acked 4588 Read 7 Done New Done false
14706 3590 Acked 4589 Read 6 Done New Done false
14707 3591 Acked 4590 Write 1 Done New Done false
14708 3592 Acked 4591 Read 3 Done New Done false
14709 3593 Acked 4592 Read 5 Done New Done false
14710 3594 Acked 4593 Read 1 Done New Done false
14711 3595 Acked 4594 Read 6 Done New Done false
14712 3596 Acked 4595 Write 8 Done New Done false
14713 3597 Acked 4596 Write 9 Done New Done false
14714 3598 Acked 4597 Write 4 Done New Done false
14715 3599 Acked 4598 Read 10 Done New Done false
14716 3600 Acked 4599 Write 4 Done New Done false
14717 3601 Acked 4600 Write 7 Done New Done false
14718 3602 Acked 4601 Read 1 Done New Done false
14719 3603 Acked 4602 Read 8 Done New Done false
14720 3604 Acked 4603 Write 6 Done New Done false
14721 3605 Acked 4604 Read 4 Done New Done false
14722 3606 Acked 4605 Read 7 Done New Done false
14723 3607 Acked 4606 Read 8 Done New Done false
14724 3608 Acked 4607 Write 2 Done New Done false
14725 3609 Acked 4608 Read 7 Done New Done false
14726 3610 Acked 4609 Read 4 Done New Done false
14727 3611 Acked 4610 Read 9 Done New Done false
14728 3612 Acked 4611 Read 3 Done New Done false
14729 3613 Acked 4612 Read 5 Done New Done false
14730 3614 Acked 4613 Write 8 Done New Done false
14731 3615 Acked 4614 Read 4 Done New Done false
14732 3616 Acked 4615 Read 2 Done New Done false
14733 3617 Acked 4616 Flush 0 Done New Done false
14734 3618 Acked 4617 Read 9 Done New Done false
14735 STATES DS:0 DS:1 DS:2 TOTAL
14736 New 0 301 0 301
14737 Sent 0 0 0 0
14738 Done 301 0 301 602
14739 Skipped 0 0 0 0
14740 Error 0 0 0 0
14741 Last Flush: 4616 4316 4616
14742 Downstairs last five completed: 4316 4315 4314 4313 4312
14743 Upstairs last five completed: 3618 3617 3616 3615 3614
14744 CLIENT: Up:0 ds:301 act:2
14745 [8820] got start action
14746 [8820] I am going to restart
14747 Starting downstairs at port 8820
14748 Make output file at "/tmp/dsc/downstairs-8820.txt"
14749 [8820][1] reports Starting
14750 Downstairs /var/tmp/dsc/region/8820 port 8820 PID:Some(1208)
14751 [8820][1] reports Running
14752 ----------------------------------------------------------------
14753 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:302
14754 States: Active Offline Active
14755 GW_ID ACK DSID TYPE BLOCKS DS:0 DS:1 DS:2 REPLAY
14756 3318 Acked 4317 Read 2 Done New Done false
14757 3319 Acked 4318 Write 5 Done New Done false
14758 3320 Acked 4319 Write 9 Done New Done false
14759 3321 Acked 4320 Read 10 Done New Done false
14760 3322 Acked 4321 Read 9 Done New Done false
14761 3323 Acked 4322 Write 9 Done New Done false
14762 3324 Acked 4323 Read 2 Done New Done false
14763 3325 Acked 4324 Read 2 Done New Done false
14764 3326 Acked 4325 Read 6 Done New Done false
14765 3327 Acked 4326 Read 6 Done New Done false
14766 3328 Acked 4327 Read 2 Done New Done false
14767 3329 Acked 4328 Read 6 Done New Done false
14768 3330 Acked 4329 Read 3 Done New Done false
14769 3331 Acked 4330 Write 4 Done New Done false
14770 3332 Acked 4331 Read 8 Done New Done false
14771 3333 Acked 4332 Write 7 Done New Done false
14772 3334 Acked 4333 Read 3 Done New Done false
14773 3335 Acked 4334 Write 5 Done New Done false
14774 3336 Acked 4335 Write 7 Done New Done false
14775 3337 Acked 4336 Write 4 Done New Done false
14776 3338 Acked 4337 Read 8 Done New Done false
14777 3339 Acked 4338 Write 9 Done New Done false
14778 3340 Acked 4339 Read 9 Done New Done false
14779 3341 Acked 4340 Write 1 Done New Done false
14780 3342 Acked 4341 Read 9 Done New Done false
14781 3343 Acked 4342 Write 5 Done New Done false
14782 3344 Acked 4343 Read 9 Done New Done false
14783 3345 Acked 4344 Read 8 Done New Done false
14784 3346 Acked 4345 Read 7 Done New Done false
14785 3347 Acked 4346 Write 8 Done New Done false
14786 3348 Acked 4347 Write 1 Done New Done false
14787 3349 Acked 4348 Read 10 Done New Done false
14788 3350 Acked 4349 Flush 0 Done New Done false
14789 3351 Acked 4350 Read 1 Done New Done false
14790 3352 Acked 4351 Flush 0 Done New Done false
14791 3353 Acked 4352 Write 2 Done New Done false
14792 3354 Acked 4353 Read 2 Done New Done false
14793 3355 Acked 4354 Write 8 Done New Done false
14794 3356 Acked 4355 Write 10 Done New Done false
14795 3357 Acked 4356 Read 1 Done New Done false
14796 3358 Acked 4357 Read 6 Done New Done false
14797 3359 Acked 4358 Read 3 Done New Done false
14798 3360 Acked 4359 Read 5 Done New Done false
14799 3361 Acked 4360 Read 1 Done New Done false
14800 3362 Acked 4361 Write 3 Done New Done false
14801 3363 Acked 4362 Write 2 Done New Done false
14802 3364 Acked 4363 Read 1 Done New Done false
14803 3365 Acked 4364 Read 5 Done New Done false
14804 3366 Acked 4365 Read 3 Done New Done false
14805 3367 Acked 4366 Write 5 Done New Done false
14806 3368 Acked 4367 Flush 0 Done New Done false
14807 3369 Acked 4368 Read 8 Done New Done false
14808 3370 Acked 4369 Read 3 Done New Done false
14809 3371 Acked 4370 Write 5 Done New Done false
14810 3372 Acked 4371 Flush 0 Done New Done false
14811 3373 Acked 4372 Read 6 Done New Done false
14812 3374 Acked 4373 Write 2 Done New Done false
14813 3375 Acked 4374 Flush 0 Done New Done false
14814 3376 Acked 4375 Read 4 Done New Done false
14815 3377 Acked 4376 Write 6 Done New Done false
14816 3378 Acked 4377 Read 9 Done New Done false
14817 3379 Acked 4378 Write 10 Done New Done false
14818 3380 Acked 4379 Flush 0 Done New Done false
14819 3381 Acked 4380 Read 6 Done New Done false
14820 3382 Acked 4381 Write 2 Done New Done false
14821 3383 Acked 4382 Read 9 Done New Done false
14822 3384 Acked 4383 Write 7 Done New Done false
14823 3385 Acked 4384 Write 2 Done New Done false
14824 3386 Acked 4385 Write 10 Done New Done false
14825 3387 Acked 4386 Flush 0 Done New Done false
14826 3388 Acked 4387 Read 4 Done New Done false
14827 3389 Acked 4388 Read 7 Done New Done false
14828 3390 Acked 4389 Write 9 Done New Done false
14829 3391 Acked 4390 Write 5 Done New Done false
14830 3392 Acked 4391 Write 3 Done New Done false
14831 3393 Acked 4392 Read 4 Done New Done false
14832 3394 Acked 4393 Read 9 Done New Done false
14833 3395 Acked 4394 Write 6 Done New Done false
14834 3396 Acked 4395 Read 8 Done New Done false
14835 3397 Acked 4396 Write 3 Done New Done false
14836 3398 Acked 4397 Write 4 Done New Done false
14837 3399 Acked 4398 Write 10 Done New Done false
14838 3400 Acked 4399 Write 3 Done New Done false
14839 3401 Acked 4400 Flush 0 Done New Done false
14840 3402 Acked 4401 Flush 0 Done New Done false
14841 3403 Acked 4402 Write 6 Done New Done false
14842 3404 Acked 4403 Write 6 Done New Done false
14843 3405 Acked 4404 Read 7 Done New Done false
14844 3406 Acked 4405 Read 4 Done New Done false
14845 3407 Acked 4406 Read 8 Done New Done false
14846 3408 Acked 4407 Read 8 Done New Done false
14847 3409 Acked 4408 Flush 0 Done New Done false
14848 3410 Acked 4409 Flush 0 Done New Done false
14849 3411 Acked 4410 Write 2 Done New Done false
14850 3412 Acked 4411 Write 6 Done New Done false
14851 3413 Acked 4412 Read 10 Done New Done false
14852 3414 Acked 4413 Read 7 Done New Done false
14853 3415 Acked 4414 Write 6 Done New Done false
14854 3416 Acked 4415 Read 7 Done New Done false
14855 3417 Acked 4416 Read 10 Done New Done false
14856 3418 Acked 4417 Write 2 Done New Done false
14857 3419 Acked 4418 Read 8 Done New Done false
14858 3420 Acked 4419 Write 2 Done New Done false
14859 3421 Acked 4420 Write 5 Done New Done false
14860 3422 Acked 4421 Write 9 Done New Done false
14861 3423 Acked 4422 Read 4 Done New Done false
14862 3424 Acked 4423 Read 7 Done New Done false
14863 3425 Acked 4424 Read 5 Done New Done false
14864 3426 Acked 4425 Write 7 Done New Done false
14865 3427 Acked 4426 Write 4 Done New Done false
14866 3428 Acked 4427 Write 1 Done New Done false
14867 3429 Acked 4428 Read 3 Done New Done false
14868 3430 Acked 4429 Write 1 Done New Done false
14869 3431 Acked 4430 Read 2 Done New Done false
14870 3432 Acked 4431 Read 10 Done New Done false
14871 3433 Acked 4432 Flush 0 Done New Done false
14872 3434 Acked 4433 Write 9 Done New Done false
14873 3435 Acked 4434 Write 1 Done New Done false
14874 3436 Acked 4435 Read 1 Done New Done false
14875 3437 Acked 4436 Write 6 Done New Done false
14876 3438 Acked 4437 Flush 0 Done New Done false
14877 3439 Acked 4438 Read 4 Done New Done false
14878 3440 Acked 4439 Write 7 Done New Done false
14879 3441 Acked 4440 Write 6 Done New Done false
14880 3442 Acked 4441 Read 7 Done New Done false
14881 3443 Acked 4442 Read 9 Done New Done false
14882 3444 Acked 4443 Read 4 Done New Done false
14883 3445 Acked 4444 Write 3 Done New Done false
14884 3446 Acked 4445 Write 7 Done New Done false
14885 3447 Acked 4446 Write 3 Done New Done false
14886 3448 Acked 4447 Write 6 Done New Done false
14887 3449 Acked 4448 Read 7 Done New Done false
14888 3450 Acked 4449 Write 7 Done New Done false
14889 3451 Acked 4450 Read 1 Done New Done false
14890 3452 Acked 4451 Read 1 Done New Done false
14891 3453 Acked 4452 Flush 0 Done New Done false
14892 3454 Acked 4453 Read 4 Done New Done false
14893 3455 Acked 4454 Read 5 Done New Done false
14894 3456 Acked 4455 Read 2 Done New Done false
14895 3457 Acked 4456 Write 2 Done New Done false
14896 3458 Acked 4457 Write 2 Done New Done false
14897 3459 Acked 4458 Read 9 Done New Done false
14898 3460 Acked 4459 Flush 0 Done New Done false
14899 3461 Acked 4460 Read 1 Done New Done false
14900 3462 Acked 4461 Read 1 Done New Done false
14901 3463 Acked 4462 Write 9 Done New Done false
14902 3464 Acked 4463 Read 10 Done New Done false
14903 3465 Acked 4464 Read 1 Done New Done false
14904 3466 Acked 4465 Read 2 Done New Done false
14905 3467 Acked 4466 Read 4 Done New Done false
14906 3468 Acked 4467 Read 8 Done New Done false
14907 3469 Acked 4468 Write 3 Done New Done false
14908 3470 Acked 4469 Flush 0 Done New Done false
14909 3471 Acked 4470 Read 1 Done New Done false
14910 3472 Acked 4471 Write 1 Done New Done false
14911 3473 Acked 4472 Read 4 Done New Done false
14912 3474 Acked 4473 Read 10 Done New Done false
14913 3475 Acked 4474 Write 6 Done New Done false
14914 3476 Acked 4475 Read 7 Done New Done false
14915 3477 Acked 4476 Read 6 Done New Done false
14916 3478 Acked 4477 Write 7 Done New Done false
14917 3479 Acked 4478 Read 3 Done New Done false
14918 3480 Acked 4479 Write 3 Done New Done false
14919 3481 Acked 4480 Write 6 Done New Done false
14920 3482 Acked 4481 Read 6 Done New Done false
14921 3483 Acked 4482 Read 6 Done New Done false
14922 3484 Acked 4483 Read 5 Done New Done false
14923 3485 Acked 4484 Write 9 Done New Done false
14924 3486 Acked 4485 Read 8 Done New Done false
14925 3487 Acked 4486 Write 1 Done New Done false
14926 3488 Acked 4487 Read 9 Done New Done false
14927 3489 Acked 4488 Read 3 Done New Done false
14928 3490 Acked 4489 Read 2 Done New Done false
14929 3491 Acked 4490 Read 3 Done New Done false
14930 3492 Acked 4491 Read 5 Done New Done false
14931 3493 Acked 4492 Read 5 Done New Done false
14932 3494 Acked 4493 Write 7 Done New Done false
14933 3495 Acked 4494 Read 4 Done New Done false
14934 3496 Acked 4495 Write 10 Done New Done false
14935 3497 Acked 4496 Read 5 Done New Done false
14936 3498 Acked 4497 Write 5 Done New Done false
14937 3499 Acked 4498 Write 3 Done New Done false
14938 3500 Acked 4499 Read 5 Done New Done false
14939 3501 Acked 4500 Write 8 Done New Done false
14940 3502 Acked 4501 Write 3 Done New Done false
14941 3503 Acked 4502 Write 5 Done New Done false
14942 3504 Acked 4503 Read 4 Done New Done false
14943 3505 Acked 4504 Flush 0 Done New Done false
14944 3506 Acked 4505 Read 9 Done New Done false
14945 3507 Acked 4506 Write 8 Done New Done false
14946 3508 Acked 4507 Read 6 Done New Done false
14947 3509 Acked 4508 Read 9 Done New Done false
14948 3510 Acked 4509 Read 1 Done New Done false
14949 3511 Acked 4510 Flush 0 Done New Done false
14950 3512 Acked 4511 Write 2 Done New Done false
14951 3513 Acked 4512 Read 6 Done New Done false
14952 3514 Acked 4513 Write 4 Done New Done false
14953 3515 Acked 4514 Read 7 Done New Done false
14954 3516 Acked 4515 Read 8 Done New Done false
14955 3517 Acked 4516 Write 2 Done New Done false
14956 3518 Acked 4517 Write 5 Done New Done false
14957 3519 Acked 4518 Read 4 Done New Done false
14958 3520 Acked 4519 Read 10 Done New Done false
14959 3521 Acked 4520 Read 2 Done New Done false
14960 3522 Acked 4521 Write 9 Done New Done false
14961 3523 Acked 4522 Read 3 Done New Done false
14962 3524 Acked 4523 Read 9 Done New Done false
14963 3525 Acked 4524 Read 1 Done New Done false
14964 3526 Acked 4525 Read 1 Done New Done false
14965 3527 Acked 4526 Write 1 Done New Done false
14966 3528 Acked 4527 Read 2 Done New Done false
14967 3529 Acked 4528 Write 4 Done New Done false
14968 3530 Acked 4529 Flush 0 Done New Done false
14969 3531 Acked 4530 Read 6 Done New Done false
14970 3532 Acked 4531 Write 10 Done New Done false
14971 3533 Acked 4532 Write 5 Done New Done false
14972 3534 Acked 4533 Read 1 Done New Done false
14973 3535 Acked 4534 Read 5 Done New Done false
14974 3536 Acked 4535 Write 9 Done New Done false
14975 3537 Acked 4536 Read 5 Done New Done false
14976 3538 Acked 4537 Write 10 Done New Done false
14977 3539 Acked 4538 Write 10 Done New Done false
14978 3540 Acked 4539 Read 10 Done New Done false
14979 3541 Acked 4540 Read 5 Done New Done false
14980 3542 Acked 4541 Flush 0 Done New Done false
14981 3543 Acked 4542 Read 2 Done New Done false
14982 3544 Acked 4543 Read 5 Done New Done false
14983 3545 Acked 4544 Read 6 Done New Done false
14984 3546 Acked 4545 Read 2 Done New Done false
14985 3547 Acked 4546 Read 3 Done New Done false
14986 3548 Acked 4547 Read 10 Done New Done false
14987 3549 Acked 4548 Write 8 Done New Done false
14988 3550 Acked 4549 Read 5 Done New Done false
14989 3551 Acked 4550 Write 3 Done New Done false
14990 3552 Acked 4551 Write 1 Done New Done false
14991 3553 Acked 4552 Read 10 Done New Done false
14992 3554 Acked 4553 Read 5 Done New Done false
14993 3555 Acked 4554 Read 7 Done New Done false
14994 3556 Acked 4555 Read 2 Done New Done false
14995 3557 Acked 4556 Read 2 Done New Done false
14996 3558 Acked 4557 Read 8 Done New Done false
14997 3559 Acked 4558 Flush 0 Done New Done false
14998 3560 Acked 4559 Read 7 Done New Done false
14999 3561 Acked 4560 Flush 0 Done New Done false
15000 3562 Acked 4561 Read 10 Done New Done false
15001 3563 Acked 4562 Write 3 Done New Done false
15002 3564 Acked 4563 Write 2 Done New Done false
15003 3565 Acked 4564 Read 7 Done New Done false
15004 3566 Acked 4565 Write 5 Done New Done false
15005 3567 Acked 4566 Read 5 Done New Done false
15006 3568 Acked 4567 Read 9 Done New Done false
15007 3569 Acked 4568 Read 8 Done New Done false
15008 3570 Acked 4569 Read 8 Done New Done false
15009 3571 Acked 4570 Read 10 Done New Done false
15010 3572 Acked 4571 Flush 0 Done New Done false
15011 3573 Acked 4572 Write 2 Done New Done false
15012 3574 Acked 4573 Write 1 Done New Done false
15013 3575 Acked 4574 Flush 0 Done New Done false
15014 3576 Acked 4575 Write 7 Done New Done false
15015 3577 Acked 4576 Write 3 Done New Done false
15016 3578 Acked 4577 Read 7 Done New Done false
15017 3579 Acked 4578 Write 10 Done New Done false
15018 3580 Acked 4579 Write 10 Done New Done false
15019 3581 Acked 4580 Write 3 Done New Done false
15020 3582 Acked 4581 Read 4 Done New Done false
15021 3583 Acked 4582 Write 3 Done New Done false
15022 3584 Acked 4583 Read 10 Done New Done false
15023 3585 Acked 4584 Write 4 Done New Done false
15024 3586 Acked 4585 Flush 0 Done New Done false
15025 3587 Acked 4586 Flush 0 Done New Done false
15026 3588 Acked 4587 Write 6 Done New Done false
15027 3589 Acked 4588 Read 7 Done New Done false
15028 3590 Acked 4589 Read 6 Done New Done false
15029 3591 Acked 4590 Write 1 Done New Done false
15030 3592 Acked 4591 Read 3 Done New Done false
15031 3593 Acked 4592 Read 5 Done New Done false
15032 3594 Acked 4593 Read 1 Done New Done false
15033 3595 Acked 4594 Read 6 Done New Done false
15034 3596 Acked 4595 Write 8 Done New Done false
15035 3597 Acked 4596 Write 9 Done New Done false
15036 3598 Acked 4597 Write 4 Done New Done false
15037 3599 Acked 4598 Read 10 Done New Done false
15038 3600 Acked 4599 Write 4 Done New Done false
15039 3601 Acked 4600 Write 7 Done New Done false
15040 3602 Acked 4601 Read 1 Done New Done false
15041 3603 Acked 4602 Read 8 Done New Done false
15042 3604 Acked 4603 Write 6 Done New Done false
15043 3605 Acked 4604 Read 4 Done New Done false
15044 3606 Acked 4605 Read 7 Done New Done false
15045 3607 Acked 4606 Read 8 Done New Done false
15046 3608 Acked 4607 Write 2 Done New Done false
15047 3609 Acked 4608 Read 7 Done New Done false
15048 3610 Acked 4609 Read 4 Done New Done false
15049 3611 Acked 4610 Read 9 Done New Done false
15050 3612 Acked 4611 Read 3 Done New Done false
15051 3613 Acked 4612 Read 5 Done New Done false
15052 3614 Acked 4613 Write 8 Done New Done false
15053 3615 Acked 4614 Read 4 Done New Done false
15054 3616 Acked 4615 Read 2 Done New Done false
15055 3617 Acked 4616 Flush 0 Done New Done false
15056 3618 Acked 4617 Read 9 Done New Done false
15057 3619 Acked 4618 Flush 0 Done New Done false
15058 STATES DS:0 DS:1 DS:2 TOTAL
15059 New 0 302 0 302
15060 Sent 0 0 0 0
15061 Done 302 0 302 604
15062 Skipped 0 0 0 0
15063 Error 0 0 0 0
15064 Last Flush: 4618 4316 4618
15065 Downstairs last five completed: 4316 4315 4314 4313 4312
15066 Upstairs last five completed: 3619 3618 3617 3616 3615
15067 CLIENT: Up:0 ds:302 act:2
150682024-04-20T01:08:13.593ZINFOcrucible: connecting to 127.0.0.1:8820 = io task client = 1 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
150692024-04-20T01:08:13.594ZINFOcrucible: ds_connection connected from Ok(127.0.0.1:34638) = io task client = 1 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
150702024-04-20T01:08:13.595ZINFOcrucible: downstairs client at Some(127.0.0.1:8820) has region UUID 12345678-0000-0000-0000-000000008820 = downstairs client = 1 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
150712024-04-20T01:08:13.595ZINFOcrucible: Returning UUID:12345678-0000-0000-0000-000000008820 matches = downstairs client = 1 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
150722024-04-20T01:08:13.595ZINFOcrucible: send last flush ID to this DS: 4316 = downstairs client = 1 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
150732024-04-20T01:08:13.596ZINFOcrucible: Replied this last flush ID: 4316 = downstairs client = 1 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
150742024-04-20T01:08:13.596ZINFOcrucible: ds_transition from Offline to Replay = downstairs client = 1 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
150752024-04-20T01:08:13.596ZINFOcrucible: [1] Transition from Offline to Replay = downstairs client = 1 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
150762024-04-20T01:08:13.596ZINFOcrucible: ds_transition from Replay to Active = downstairs client = 1 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
150772024-04-20T01:08:13.596ZINFOcrucible: [1] Transition from Replay to Active = downstairs client = 1 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
15078 ----------------------------------------------------------------
15079 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:0
15080 Downstairs last five completed: 4618 4617 4616 4615 4614
15081 Upstairs last five completed: 3619 3618 3617 3616 3615
15082 CLIENT: Up:0 ds:0 act:3
15083 Replay: All jobs finished, all DS active.
15084 Main task has work to do, go find it
15085 got dsc Stop(1)
15086 stop 1
15087 Apr 20 01:08:15.898 INFO[8820] Got stop action so:false kr:false
15088 request completed, latency_us: 319, response_code: 204, uri: /stop/cid/1, method: POST, req_id: 55e21e1f-b163-4fff-9ec8-4c1d2b115524, remote_addr: 127.0.0.1:60352, local_addr: 127.0.0.1:9998
150892024-04-20T01:08:15.899ZWARNcrucible: downstairs disconnected = io task client = 1 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
15090 Apr 20 01:08:15.899 {"msg":"client task is sending Done(Finished)","v":0,"name":"crucible","level":40,"time":"2024-04-20T01:08:15.899344975Z","hostname":"w-01HVWGBJP7HK0H9TQ26T6N3X8M","pid":1196,"":"io task","client":"1","":"downstairs","session_id":"132b460a-26a0-4532-b1ab-4f8c07d4c6c7"}
15091 INFO request completed, latency_us: 112, response_code: 200, uri{"msg":"downstairs task for 1 stopped due to Finished","v":0,"name":"crucible","level":40,"time":"2024-04-20T01:08:15.899397303Z","hostname":"w-01HVWGBJP7HK0H9TQ26T6N3X8M","pid":1196,"session_id":"132b460a-26a0-4532-b1ab-4f8c07d4c6c7"}
15092 : /state/cid/1, method: GET, req_id: 6565ec04-6dd1-4184-9712-f123fcae8e7d, remote_addr: 127.0.0.1:{"msg":"Gone missing, transition from Active to Offline","v":0,"name":"crucible","level":30,"time":"2024-04-20T01:08:15.899423683Z","hostname":"w-01HVWGBJP7HK0H9TQ26T6N3X8M","pid":1196,"client":"1","":"downstairs","session_id":"132b460a-26a0-4532-b1ab-4f8c07d4c6c7"}
15093 60352, local_addr: 127.0.0.1:9998
150942024-04-20T01:08:15.899ZINFOcrucible: [1] client re-new 0 jobs since flush 4618 = downstairs session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
150952024-04-20T01:08:15.899ZINFOcrucible: [1] Marked 0 jobs for replay since flush: 4618 = downstairs session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
150962024-04-20T01:08:15.899ZINFOcrucible: client task is exiting = io task client = 1 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
15097 [8820] Exited with: ExitStatus(unix_wait_status(9))
15098 [8820][1] reports Exit
15099 Apr 20 01:08:19.901 INFO request completed, latency_us: 178, response_code: 200, uri: /state/cid/1, method: GET, req_id: 9d05eeb6-4a86-4ddc-b840-392e08b28f14, remote_addr: 127.0.0.1:60352, local_addr: 127.0.0.1:9998
15100 001/300 Read block 280 len 16384
15101 002/300 Read block 2136 len 20480
15102 003/300 Write block 440 len 28672 data: 3 3 4 5 5 5 6
15103 004/300 Read block 2775 len 40960
15104 005/300 Read block 1903 len 32768
15105 006/300 Write block 2333 len 16384 data: 4 5 4 4
15106 007/300 Read block 3670 len 32768
15107 008/300 Read block 1697 len 32768
15108 009/300 Read block 3341 len 12288
15109 010/300 Read block 4777 len 16384
15110 011/300 Read block 2123 len 12288
15111 012/300 Write block 2882 len 12288 data: 3 2 3
15112 013/300 Write block 2652 len 4096 data: 2
15113 014/300 Read block 856 len 28672
15114 015/300 Read block 3704 len 32768
15115 016/300 Flush
15116 017/300 Write block 1712 len 8192 data: 4 4
15117 018/300 Write block 112 len 28672 data: 5 6 5 5 5 4 3
15118 019/300 Flush
15119 020/300 Write block 326 len 20480 data: 6 6 5 5 3
15120 021/300 Write block 1744 len 24576 data: 4 3 3 3 3 4
15121 022/300 Write block 3045 len 24576 data: 2 3 3 3 3 3
15122 023/300 Write block 3017 len 32768 data: 3 3 3 4 5 5 6 7
15123 024/300 Read block 2630 len 28672
15124 025/300 Write block 1187 len 32768 data: 3 3 3 3 4 4 3 2
15125 026/300 Flush
15126 027/300 Write block 1244 len 28672 data: 5 3 3 2 2 2 2
15127 028/300 Write block 4443 len 24576 data: 3 5 5 6 5 5
15128 029/300 Read block 1460 len 20480
15129 030/300 Write block 2980 len 16384 data: 5 5 6 6
15130 031/300 Read block 965 len 36864
15131 032/300 Write block 2846 len 12288 data: 4 4 3
15132 033/300 Write block 140 len 20480 data: 2 2 2 2 2
15133 034/300 Read block 3959 len 28672
15134 035/300 Flush
15135 036/300 Read block 1187 len 20480
15136 037/300 Write block 1682 len 24576 data: 4 3 3 3 4 3
15137 038/300 Write block 1987 len 16384 data: 4 4 4 4
15138 039/300 Read block 1245 len 20480
15139 040/300 Read block 4344 len 32768
15140 041/300 Read block 4444 len 36864
15141 042/300 Read block 2145 len 32768
15142 043/300 Read block 1852 len 24576
15143 044/300 Read block 2861 len 4096
15144 045/300 Read block 1631 len 4096
15145 046/300 Read block 1987 len 36864
15146 047/300 Read block 1313 len 16384
15147 048/300 Write block 3014 len 24576 data: 3 4 4 4 4 4
15148 049/300 Read block 4904 len 8192
15149 050/300 Read block 2907 len 36864
15150 051/300 Write block 3043 len 32768 data: 2 2 3 4 4 4 4 4
15151 052/300 Write block 2510 len 28672 data: 5 5 5 2 2 3 3
15152 053/300 Read block 688 len 28672
15153 054/300 Write block 2536 len 12288 data: 3 3 3
15154 055/300 Write block 761 len 40960 data: 3 4 4 4 4 3 4 4 5 6
15155 056/300 Flush
15156 057/300 Write block 2293 len 8192 data: 3 3
15157 058/300 Write block 991 len 36864 data: 3 4 4 5 4 4 4 4 4
15158 059/300 Read block 1242 len 32768
15159 060/300 Write block 2510 len 36864 data: 6 6 6 3 3 4 4 4 4
15160 061/300 Read block 3801 len 12288
15161 062/300 Write block 2183 len 12288 data: 3 3 3
15162 063/300 Write block 1968 len 8192 data: 2 2
15163 064/300 Read block 4899 len 24576
15164 065/300 Read block 2864 len 8192
15165 066/300 Read block 4391 len 20480
15166 067/300 Write block 3284 len 4096 data: 6
15167 068/300 Read block 4409 len 36864
15168 069/300 Read block 3286 len 4096
15169 070/300 Write block 2562 len 36864 data: 4 4 4 4 3 2 2 2 2
15170 071/300 Read block 1067 len 8192
15171 072/300 Write block 833 len 24576 data: 2 2 2 3 3 3
15172 073/300 Read block 4036 len 8192
15173 074/300 Write block 4542 len 40960 data: 2 2 4 4 4 3 2 2 2 2
15174 075/300 Write block 4381 len 32768 data: 4 3 2 2 3 3 2 2
15175 076/300 Write block 699 len 16384 data: 4 4 3 3
15176 077/300 Write block 203 len 28672 data: 3 3 3 3 3 3 3
15177 078/300 Write block 1612 len 16384 data: 2 3 4 4
15178 079/300 Read block 1497 len 36864
15179 080/300 Read block 2357 len 24576
15180 081/300 Write block 4429 len 16384 data: 4 4 4 4
15181 082/300 Read block 3657 len 40960
15182 083/300 Write block 4304 len 36864 data: 3 3 3 5 5 5 4 4 4
15183 084/300 Write block 3771 len 28672 data: 3 3 3 3 3 3 2
15184 085/300 Read block 140 len 12288
15185 086/300 Read block 994 len 20480
15186 087/300 Flush
15187 088/300 Read block 2543 len 32768
15188 089/300 Flush
15189 090/300 Write block 887 len 12288 data: 2 3 3
15190 091/300 Write block 1033 len 32768 data: 5 4 3 3 2 3 3 3
15191 092/300 Flush
15192 093/300 Read block 135 len 16384
15193 094/300 Write block 3980 len 8192 data: 2 2
15194 095/300 Write block 3006 len 36864 data: 5 5 5 7 7 6 4 2 4
15195 096/300 Write block 516 len 36864 data: 5 4 5 5 5 6 5 6 6
15196 097/300 Read block 1065 len 32768
15197 098/300 Write block 574 len 4096 data: 5
15198 099/300 Read block 2894 len 28672
15199 100/300 Read block 4587 len 20480
15200 101/300 Read block 2938 len 40960
15201 102/300 Flush
15202 103/300 Write block 3614 len 8192 data: 4 2
15203 104/300 Read block 776 len 12288
15204 105/300 Write block 4662 len 16384 data: 4 4 3 3
15205 106/300 Read block 4184 len 8192
15206 107/300 Write block 3944 len 24576 data: 2 2 2 2 2 2
15207 108/300 Read block 4206 len 8192
15208 109/300 Read block 601 len 4096
15209 110/300 Write block 4005 len 12288 data: 7 6 4
15210 111/300 Read block 372 len 36864
15211 112/300 Write block 4690 len 36864 data: 3 3 3 3 3 3 2 2 2
15212 113/300 Read block 1431 len 12288
15213 114/300 Write block 4067 len 40960 data: 2 2 2 2 2 3 4 5 5 6
15214 115/300 Read block 486 len 36864
15215 116/300 Read block 3280 len 40960
15216 117/300 Write block 2666 len 32768 data: 6 5 5 5 5 4 4 4
15217 118/300 Write block 4238 len 36864 data: 3 3 4 4 4 4 4 5 6
15218 119/300 Read block 1737 len 40960
15219 120/300 Write block 4928 len 32768 data: 2 2 2 3 3 3 3 3
15220 121/300 Write block 2829 len 8192 data: 4 4
15221 122/300 Read block 762 len 36864
15222 123/300 Write block 4215 len 8192 data: 2 2
15223 124/300 Write block 2797 len 32768 data: 4 4 6 3 4 4 4 5
15224 125/300 Write block 834 len 8192 data: 3 3
15225 126/300 Read block 3537 len 8192
15226 127/300 Write block 3845 len 24576 data: 2 2 2 2 2 2
15227 128/300 Write block 1561 len 8192 data: 4 3
15228 129/300 Read block 1869 len 4096
15229 130/300 Read block 1744 len 16384
15230 131/300 Write block 3642 len 12288 data: 2 3 3
15231 132/300 Write block 3155 len 24576 data: 2 2 2 2 2 3
15232 133/300 Read block 3700 len 4096
15233 134/300 Write block 1946 len 16384 data: 2 2 2 2
15234 135/300 Read block 259 len 4096
15235 136/300 Flush
15236 137/300 Flush
15237 138/300 Write block 2637 len 32768 data: 2 2 2 2 4 5 5 6
15238 139/300 Write block 4260 len 16384 data: 4 4 3 3
15239 140/300 Read block 3731 len 4096
15240 141/300 Read block 1259 len 28672
15241 142/300 Read block 1914 len 36864
15242 143/300 Write block 4816 len 8192 data: 2 2
15243 144/300 Read block 803 len 40960
15244 145/300 Write block 4568 len 36864 data: 5 5 6 6 6 4 5 5 4
15245 146/300 Flush
15246 147/300 Read block 1843 len 40960
15247 148/300 Read block 3512 len 12288
15248 149/300 Write block 4574 len 12288 data: 6 6 5
15249 150/300 Write block 3978 len 32768 data: 2 2 3 3 2 3 3 3
15250 151/300 Read block 4559 len 40960
15251 152/300 Write block 3248 len 4096 data: 3
15252 153/300 Write block 4245 len 12288 data: 6 7 4
15253 154/300 Read block 2730 len 32768
15254 155/300 Read block 155 len 4096
15255 156/300 Read block 915 len 12288
15256 157/300 Write block 2536 len 24576 data: 4 4 4 3 3 3
15257 158/300 Read block 3197 len 40960
15258 159/300 Read block 4202 len 4096
15259 160/300 Flush
15260 161/300 Write block 4407 len 36864 data: 3 3 3 3 4 4 5 4 4
15261 162/300 Read block 4093 len 16384
15262 163/300 Read block 349 len 36864
15263 164/300 Write block 1111 len 16384 data: 3 2 2 2
15264 165/300 Write block 1343 len 8192 data: 3 3
15265 166/300 Flush
15266 167/300 Read block 3568 len 40960
15267 168/300 Read block 2579 len 40960
15268 169/300 Write block 268 len 40960 data: 5 6 7 6 4 3 4 4 4 5
15269 170/300 Flush
15270 171/300 Write block 4915 len 32768 data: 5 5 7 7 6 6 6 5
15271 172/300 Read block 2622 len 24576
15272 173/300 Write block 2316 len 20480 data: 3 2 3 3 3
15273 174/300 Write block 1124 len 20480 data: 6 6 6 8 7
15274 175/300 Read block 3768 len 20480
15275 176/300 Write block 3216 len 8192 data: 2 2
15276 177/300 Read block 1283 len 24576
15277 178/300 Read block 3720 len 4096
15278 179/300 Read block 2361 len 4096
15279 180/300 Write block 3613 len 36864 data: 3 5 3 2 2 2 2 2 2
15280 181/300 Write block 4194 len 20480 data: 2 2 2 3 4
15281 182/300 Write block 4202 len 20480 data: 5 4 3 2 2
15282 183/300 Write block 165 len 4096 data: 2
15283 184/300 Read block 1260 len 16384
15284 185/300 Write block 4266 len 32768 data: 2 3 3 4 4 4 4 5
15285 186/300 Read block 3395 len 4096
15286 187/300 Write block 3929 len 24576 data: 2 2 2 2 3 2
15287 188/300 Flush
15288 189/300 Read block 3107 len 12288
15289 190/300 Write block 1416 len 28672 data: 5 5 5 4 4 3 3
15290 191/300 Write block 1082 len 40960 data: 5 6 5 5 4 4 4 4 5 5
15291 192/300 Read block 286 len 36864
15292 193/300 Read block 248 len 24576
15293 194/300 Write block 3108 len 36864 data: 2 2 3 3 3 3 3 3 5
15294 195/300 Read block 430 len 36864
15295 196/300 Write block 360 len 20480 data: 5 6 5 5 5
15296 197/300 Read block 2594 len 40960
15297 198/300 Flush
15298 199/300 Read block 1292 len 12288
15299 200/300 Write block 3549 len 36864 data: 3 3 3 3 3 3 2 2 2
15300 201/300 Read block 1497 len 32768
15301 202/300 Write block 321 len 4096 data: 5
15302 203/300 Read block 677 len 16384
15303 204/300 Write block 1798 len 8192 data: 4 4
15304 205/300 Write block 796 len 36864 data: 2 3 4 4 5 5 5 5 4
15305 206/300 Write block 3941 len 4096 data: 2
15306 207/300 Read block 3565 len 28672
15307 208/300 Flush
15308 209/300 Read block 4571 len 12288
15309 210/300 Flush
15310 211/300 Write block 4125 len 20480 data: 5 6 6 5 5
15311 212/300 Write block 2910 len 32768 data: 4 4 5 3 3 2 2 2
15312 213/300 Read block 1330 len 24576
15313 214/300 Read block 3313 len 40960
15314 215/300 Read block 42 len 8192
15315 216/300 Write block 3786 len 36864 data: 4 4 4 5 4 4 3 3 3
15316 217/300 Write block 4078 len 36864 data: 6 6 7 6 5 5 4 3 3
15317 218/300 Write block 2685 len 16384 data: 3 3 3 3
15318 219/300 Read block 499 len 28672
15319 220/300 Read block 4595 len 40960
15320 221/300 Read block 844 len 24576
15321 222/300 Write block 3195 len 40960 data: 4 4 3 4 4 5 5 6 3 3
15322 223/300 Write block 4119 len 40960 data: 4 3 4 3 5 5 6 7 7 6
15323 224/300 Read block 1136 len 20480
15324 225/300 Flush
15325 226/300 Read block 3721 len 36864
15326 227/300 Flush
15327 228/300 Read block 491 len 28672
15328 229/300 Read block 3586 len 16384
15329 230/300 Read block 2182 len 32768
15330 231/300 Write block 1206 len 16384 data: 5 5 4 4
15331 232/300 Write block 3384 len 24576 data: 3 3 3 3 3 3
15332 233/300 Read block 2948 len 4096
15333 234/300 Read block 1396 len 20480
15334 235/300 Write block 1518 len 8192 data: 6 6
15335 236/300 Write block 2207 len 20480 data: 4 3 3 3 3
15336 237/300 Write block 4615 len 24576 data: 2 2 2 2 2 2
15337 238/300 Write block 4087 len 20480 data: 2 2 2 3 3
15338 239/300 Read block 427 len 4096
15339 240/300 Read block 305 len 32768
15340 241/300 Read block 2637 len 40960
15341 242/300 Write block 1132 len 12288 data: 5 4 4
15342 243/300 Write block 3858 len 12288 data: 4 5 4
15343 244/300 Write block 2167 len 24576 data: 6 5 5 5 5 5
15344 245/300 Read block 3070 len 28672
15345 246/300 Write block 2392 len 20480 data: 7 7 5 5 5
15346 247/300 Write block 4709 len 36864 data: 5 4 5 4 3 4 2 2 2
15347 248/300 Flush
15348 249/300 Read block 849 len 24576
15349 250/300 Write block 4371 len 24576 data: 2 2 2 3 3 3
15350 251/300 Read block 3340 len 12288
15351 252/300 Write block 3866 len 28672 data: 5 4 3 3 4 4 3
15352 253/300 Write block 157 len 40960 data: 2 3 3 3 3 3 2 2 3 2
15353 254/300 Flush
15354 255/300 Read block 2036 len 20480
15355 256/300 Read block 300 len 32768
15356 257/300 Read block 2045 len 12288
15357 258/300 Read block 4765 len 28672
15358 259/300 Write block 3348 len 20480 data: 3 2 2 2 2
15359 260/300 Flush
15360 261/300 Write block 1013 len 4096 data: 2
15361 262/300 Write block 3324 len 28672 data: 3 3 3 4 4 4 2
15362 263/300 Read block 1610 len 4096
15363 264/300 Write block 2766 len 40960 data: 5 5 5 4 3 4 4 4 4 3
15364 265/300 Write block 1796 len 8192 data: 5 4
15365 266/300 Read block 1976 len 32768
15366 267/300 Write block 2517 len 36864 data: 5 5 4 4 4 4 4 3 4
15367 268/300 Flush
15368 269/300 Read block 2741 len 4096
15369 270/300 Write block 2941 len 28672 data: 3 3 3 4 3 3 2
15370 271/300 Write block 479 len 4096 data: 4
15371 272/300 Flush
15372 273/300 Read block 1620 len 36864
15373 274/300 Read block 3700 len 40960
15374 275/300 Write block 4555 len 28672 data: 2 2 2 2 3 3 3
15375 276/300 Flush
15376 277/300 Write block 1548 len 36864 data: 4 4 4 4 4 4 2 2 3
15377 278/300 Write block 2069 len 16384 data: 6 4 5 5
15378 279/300 Read block 4086 len 16384
15379 280/300 Read block 1699 len 20480
15380 281/300 Read block 3626 len 20480
15381 282/300 Read block 4735 len 8192
15382 283/300 Read block 2231 len 12288
15383 284/300 Write block 2112 len 40960 data: 2 2 2 2 2 2 2 2 2 2
15384 285/300 Read block 4731 len 16384
15385 286/300 Write block 2620 len 24576 data: 6 5 5 4 4 4
15386 287/300 Read block 3635 len 24576
15387 288/300 Read block 3049 len 28672
15388 289/300 Flush
15389 290/300 Read block 2951 len 28672
15390 291/300 Write block 1464 len 40960 data: 2 3 3 2 3 3 4 4 4 4
15391 292/300 Flush
15392 293/300 Write block 352 len 36864 data: 2 2 2 2 2 2 4 5 6
15393 294/300 Write block 2533 len 36864 data: 2 2 2 5 5 5 4 4 4
15394 295/300 Read block 1345 len 8192
15395 296/300 Read block 4918 len 16384
15396 297/300 Write block 2707 len 20480 data: 2 2 2 2 3
15397 298/300 Write block 4158 len 24576 data: 3 3 3 3 2 2
15398 299/300 Read block 1652 len 16384
15399 300/300 Write block 1594 len 20480 data: 3 3 2 2 2
15400 Main task has work to do, go find it
15401 got dsc Start(1)
15402 start 1
15403 Apr 20 01:08:20.221 INFO request completed, latency_us: 207, response_code: 204, uri: /start/cid/1, method: POST, req_id: 7f4de428-db1b-4a3b-bada-2491390abb10, remote_addr: 127.0.0.1:60352, local_addr: 127.0.0.1:9998
15404 Replay: started 1, returned:Ok(())
15405 ----------------------------------------------------------------
15406 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:300
15407 States: Active Offline Active
15408 GW_ID ACK DSID TYPE BLOCKS DS:0 DS:1 DS:2 REPLAY
15409 3620 Acked 4619 Read 4 Done New Done false
15410 3621 Acked 4620 Read 5 Done New Done false
15411 3622 Acked 4621 Write 7 Done New Done false
15412 3623 Acked 4622 Read 10 Done New Done false
15413 3624 Acked 4623 Read 8 Done New Done false
15414 3625 Acked 4624 Write 4 Done New Done false
15415 3626 Acked 4625 Read 8 Done New Done false
15416 3627 Acked 4626 Read 8 Done New Done false
15417 3628 Acked 4627 Read 3 Done New Done false
15418 3629 Acked 4628 Read 4 Done New Done false
15419 3630 Acked 4629 Read 3 Done New Done false
15420 3631 Acked 4630 Write 3 Done New Done false
15421 3632 Acked 4631 Write 1 Done New Done false
15422 3633 Acked 4632 Read 7 Done New Done false
15423 3634 Acked 4633 Read 8 Done New Done false
15424 3635 Acked 4634 Flush 0 Done New Done false
15425 3636 Acked 4635 Write 2 Done New Done false
15426 3637 Acked 4636 Write 7 Done New Done false
15427 3638 Acked 4637 Flush 0 Done New Done false
15428 3639 Acked 4638 Write 5 Done New Done false
15429 3640 Acked 4639 Write 6 Done New Done false
15430 3641 Acked 4640 Write 6 Done New Done false
15431 3642 Acked 4641 Write 8 Done New Done false
15432 3643 Acked 4642 Read 7 Done New Done false
15433 3644 Acked 4643 Write 8 Done New Done false
15434 3645 Acked 4644 Flush 0 Done New Done false
15435 3646 Acked 4645 Write 7 Done New Done false
15436 3647 Acked 4646 Write 6 Done New Done false
15437 3648 Acked 4647 Read 5 Done New Done false
15438 3649 Acked 4648 Write 4 Done New Done false
15439 3650 Acked 4649 Read 9 Done New Done false
15440 3651 Acked 4650 Write 3 Done New Done false
15441 3652 Acked 4651 Write 5 Done New Done false
15442 3653 Acked 4652 Read 7 Done New Done false
15443 3654 Acked 4653 Flush 0 Done New Done false
15444 3655 Acked 4654 Read 5 Done New Done false
15445 3656 Acked 4655 Write 6 Done New Done false
15446 3657 Acked 4656 Write 4 Done New Done false
15447 3658 Acked 4657 Read 5 Done New Done false
15448 3659 Acked 4658 Read 8 Done New Done false
15449 3660 Acked 4659 Read 9 Done New Done false
15450 3661 Acked 4660 Read 8 Done New Done false
15451 3662 Acked 4661 Read 6 Done New Done false
15452 3663 Acked 4662 Read 1 Done New Done false
15453 3664 Acked 4663 Read 1 Done New Done false
15454 3665 Acked 4664 Read 9 Done New Done false
15455 3666 Acked 4665 Read 4 Done New Done false
15456 3667 Acked 4666 Write 6 Done New Done false
15457 3668 Acked 4667 Read 2 Done New Done false
15458 3669 Acked 4668 Read 9 Done New Done false
15459 3670 Acked 4669 Write 8 Done New Done false
15460 3671 Acked 4670 Write 7 Done New Done false
15461 3672 Acked 4671 Read 7 Done New Done false
15462 3673 Acked 4672 Write 3 Done New Done false
15463 3674 Acked 4673 Write 10 Done New Done false
15464 3675 Acked 4674 Flush 0 Done New Done false
15465 3676 Acked 4675 Write 2 Done New Done false
15466 3677 Acked 4676 Write 9 Done New Done false
15467 3678 Acked 4677 Read 8 Done New Done false
15468 3679 Acked 4678 Write 9 Done New Done false
15469 3680 Acked 4679 Read 3 Done New Done false
15470 3681 Acked 4680 Write 3 Done New Done false
15471 3682 Acked 4681 Write 2 Done New Done false
15472 3683 Acked 4682 Read 6 Done New Done false
15473 3684 Acked 4683 Read 2 Done New Done false
15474 3685 Acked 4684 Read 5 Done New Done false
15475 3686 Acked 4685 Write 1 Done New Done false
15476 3687 Acked 4686 Read 9 Done New Done false
15477 3688 Acked 4687 Read 1 Done New Done false
15478 3689 Acked 4688 Write 9 Done New Done false
15479 3690 Acked 4689 Read 2 Done New Done false
15480 3691 Acked 4690 Write 6 Done New Done false
15481 3692 Acked 4691 Read 2 Done New Done false
15482 3693 Acked 4692 Write 10 Done New Done false
15483 3694 Acked 4693 Write 8 Done New Done false
15484 3695 Acked 4694 Write 4 Done New Done false
15485 3696 Acked 4695 Write 7 Done New Done false
15486 3697 Acked 4696 Write 4 Done New Done false
15487 3698 Acked 4697 Read 9 Done New Done false
15488 3699 Acked 4698 Read 6 Done New Done false
15489 3700 Acked 4699 Write 4 Done New Done false
15490 3701 Acked 4700 Read 10 Done New Done false
15491 3702 Acked 4701 Write 9 Done New Done false
15492 3703 Acked 4702 Write 7 Done New Done false
15493 3704 Acked 4703 Read 3 Done New Done false
15494 3705 Acked 4704 Read 5 Done New Done false
15495 3706 Acked 4705 Flush 0 Done New Done false
15496 3707 Acked 4706 Read 8 Done New Done false
15497 3708 Acked 4707 Flush 0 Done New Done false
15498 3709 Acked 4708 Write 3 Done New Done false
15499 3710 Acked 4709 Write 8 Done New Done false
15500 3711 Acked 4710 Flush 0 Done New Done false
15501 3712 Acked 4711 Read 4 Done New Done false
15502 3713 Acked 4712 Write 2 Done New Done false
15503 3714 Acked 4713 Write 9 Done New Done false
15504 3715 Acked 4714 Write 9 Done New Done false
15505 3716 Acked 4715 Read 8 Done New Done false
15506 3717 Acked 4716 Write 1 Done New Done false
15507 3718 Acked 4717 Read 7 Done New Done false
15508 3719 Acked 4718 Read 5 Done New Done false
15509 3720 Acked 4719 Read 10 Done New Done false
15510 3721 Acked 4720 Flush 0 Done New Done false
15511 3722 Acked 4721 Write 2 Done New Done false
15512 3723 Acked 4722 Read 3 Done New Done false
15513 3724 Acked 4723 Write 4 Done New Done false
15514 3725 Acked 4724 Read 2 Done New Done false
15515 3726 Acked 4725 Write 6 Done New Done false
15516 3727 Acked 4726 Read 2 Done New Done false
15517 3728 Acked 4727 Read 1 Done New Done false
15518 3729 Acked 4728 Write 3 Done New Done false
15519 3730 Acked 4729 Read 9 Done New Done false
15520 3731 Acked 4730 Write 9 Done New Done false
15521 3732 Acked 4731 Read 3 Done New Done false
15522 3733 Acked 4732 Write 10 Done New Done false
15523 3734 Acked 4733 Read 9 Done New Done false
15524 3735 Acked 4734 Read 10 Done New Done false
15525 3736 Acked 4735 Write 8 Done New Done false
15526 3737 Acked 4736 Write 9 Done New Done false
15527 3738 Acked 4737 Read 10 Done New Done false
15528 3739 Acked 4738 Write 8 Done New Done false
15529 3740 Acked 4739 Write 2 Done New Done false
15530 3741 Acked 4740 Read 9 Done New Done false
15531 3742 Acked 4741 Write 2 Done New Done false
15532 3743 Acked 4742 Write 8 Done New Done false
15533 3744 Acked 4743 Write 2 Done New Done false
15534 3745 Acked 4744 Read 2 Done New Done false
15535 3746 Acked 4745 Write 6 Done New Done false
15536 3747 Acked 4746 Write 2 Done New Done false
15537 3748 Acked 4747 Read 1 Done New Done false
15538 3749 Acked 4748 Read 4 Done New Done false
15539 3750 Acked 4749 Write 3 Done New Done false
15540 3751 Acked 4750 Write 6 Done New Done false
15541 3752 Acked 4751 Read 1 Done New Done false
15542 3753 Acked 4752 Write 4 Done New Done false
15543 3754 Acked 4753 Read 1 Done New Done false
15544 3755 Acked 4754 Flush 0 Done New Done false
15545 3756 Acked 4755 Flush 0 Done New Done false
15546 3757 Acked 4756 Write 8 Done New Done false
15547 3758 Acked 4757 Write 4 Done New Done false
15548 3759 Acked 4758 Read 1 Done New Done false
15549 3760 Acked 4759 Read 7 Done New Done false
15550 3761 Acked 4760 Read 9 Done New Done false
15551 3762 Acked 4761 Write 2 Done New Done false
15552 3763 Acked 4762 Read 10 Done New Done false
15553 3764 Acked 4763 Write 9 Done New Done false
15554 3765 Acked 4764 Flush 0 Done New Done false
15555 3766 Acked 4765 Read 10 Done New Done false
15556 3767 Acked 4766 Read 3 Done New Done false
15557 3768 Acked 4767 Write 3 Done New Done false
15558 3769 Acked 4768 Write 8 Done New Done false
15559 3770 Acked 4769 Read 10 Done New Done false
15560 3771 Acked 4770 Write 1 Done New Done false
15561 3772 Acked 4771 Write 3 Done New Done false
15562 3773 Acked 4772 Read 8 Done New Done false
15563 3774 Acked 4773 Read 1 Done New Done false
15564 3775 Acked 4774 Read 3 Done New Done false
15565 3776 Acked 4775 Write 6 Done New Done false
15566 3777 Acked 4776 Read 10 Done New Done false
15567 3778 Acked 4777 Read 1 Done New Done false
15568 3779 Acked 4778 Flush 0 Done New Done false
15569 3780 Acked 4779 Write 9 Done New Done false
15570 3781 Acked 4780 Read 4 Done New Done false
15571 3782 Acked 4781 Read 9 Done New Done false
15572 3783 Acked 4782 Write 4 Done New Done false
15573 3784 Acked 4783 Write 2 Done New Done false
15574 3785 Acked 4784 Flush 0 Done New Done false
15575 3786 Acked 4785 Read 10 Done New Done false
15576 3787 Acked 4786 Read 10 Done New Done false
15577 3788 Acked 4787 Write 10 Done New Done false
15578 3789 Acked 4788 Flush 0 Done New Done false
15579 3790 Acked 4789 Write 8 Done New Done false
15580 3791 Acked 4790 Read 6 Done New Done false
15581 3792 Acked 4791 Write 5 Done New Done false
15582 3793 Acked 4792 Write 5 Done New Done false
15583 3794 Acked 4793 Read 5 Done New Done false
15584 3795 Acked 4794 Write 2 Done New Done false
15585 3796 Acked 4795 Read 6 Done New Done false
15586 3797 Acked 4796 Read 1 Done New Done false
15587 3798 Acked 4797 Read 1 Done New Done false
15588 3799 Acked 4798 Write 9 Done New Done false
15589 3800 Acked 4799 Write 5 Done New Done false
15590 3801 Acked 4800 Write 5 Done New Done false
15591 3802 Acked 4801 Write 1 Done New Done false
15592 3803 Acked 4802 Read 4 Done New Done false
15593 3804 Acked 4803 Write 8 Done New Done false
15594 3805 Acked 4804 Read 1 Done New Done false
15595 3806 Acked 4805 Write 6 Done New Done false
15596 3807 Acked 4806 Flush 0 Done New Done false
15597 3808 Acked 4807 Read 3 Done New Done false
15598 3809 Acked 4808 Write 7 Done New Done false
15599 3810 Acked 4809 Write 10 Done New Done false
15600 3811 Acked 4810 Read 9 Done New Done false
15601 3812 Acked 4811 Read 6 Done New Done false
15602 3813 Acked 4812 Write 9 Done New Done false
15603 3814 Acked 4813 Read 9 Done New Done false
15604 3815 Acked 4814 Write 5 Done New Done false
15605 3816 Acked 4815 Read 10 Done New Done false
15606 3817 Acked 4816 Flush 0 Done New Done false
15607 3818 Acked 4817 Read 3 Done New Done false
15608 3819 Acked 4818 Write 9 Done New Done false
15609 3820 Acked 4819 Read 8 Done New Done false
15610 3821 Acked 4820 Write 1 Done New Done false
15611 3822 Acked 4821 Read 4 Done New Done false
15612 3823 Acked 4822 Write 2 Done New Done false
15613 3824 Acked 4823 Write 9 Done New Done false
15614 3825 Acked 4824 Write 1 Done New Done false
15615 3826 Acked 4825 Read 7 Done New Done false
15616 3827 Acked 4826 Flush 0 Done New Done false
15617 3828 Acked 4827 Read 3 Done New Done false
15618 3829 Acked 4828 Flush 0 Done New Done false
15619 3830 Acked 4829 Write 5 Done New Done false
15620 3831 Acked 4830 Write 8 Done New Done false
15621 3832 Acked 4831 Read 6 Done New Done false
15622 3833 Acked 4832 Read 10 Done New Done false
15623 3834 Acked 4833 Read 2 Done New Done false
15624 3835 Acked 4834 Write 9 Done New Done false
15625 3836 Acked 4835 Write 9 Done New Done false
15626 3837 Acked 4836 Write 4 Done New Done false
15627 3838 Acked 4837 Read 7 Done New Done false
15628 3839 Acked 4838 Read 10 Done New Done false
15629 3840 Acked 4839 Read 6 Done New Done false
15630 3841 Acked 4840 Write 10 Done New Done false
15631 3842 Acked 4841 Write 10 Done New Done false
15632 3843 Acked 4842 Read 5 Done New Done false
15633 3844 Acked 4843 Flush 0 Done New Done false
15634 3845 Acked 4844 Read 9 Done New Done false
15635 3846 Acked 4845 Flush 0 Done New Done false
15636 3847 Acked 4846 Read 7 Done New Done false
15637 3848 Acked 4847 Read 4 Done New Done false
15638 3849 Acked 4848 Read 8 Done New Done false
15639 3850 Acked 4849 Write 4 Done New Done false
15640 3851 Acked 4850 Write 6 Done New Done false
15641 3852 Acked 4851 Read 1 Done New Done false
15642 3853 Acked 4852 Read 5 Done New Done false
15643 3854 Acked 4853 Write 2 Done New Done false
15644 3855 Acked 4854 Write 5 Done New Done false
15645 3856 Acked 4855 Write 6 Done New Done false
15646 3857 Acked 4856 Write 5 Done New Done false
15647 3858 Acked 4857 Read 1 Done New Done false
15648 3859 Acked 4858 Read 8 Done New Done false
15649 3860 Acked 4859 Read 10 Done New Done false
15650 3861 Acked 4860 Write 3 Done New Done false
15651 3862 Acked 4861 Write 3 Done New Done false
15652 3863 Acked 4862 Write 6 Done New Done false
15653 3864 Acked 4863 Read 7 Done New Done false
15654 3865 Acked 4864 Write 5 Done New Done false
15655 3866 Acked 4865 Write 9 Done New Done false
15656 3867 Acked 4866 Flush 0 Done New Done false
15657 3868 Acked 4867 Read 6 Done New Done false
15658 3869 Acked 4868 Write 6 Done New Done false
15659 3870 Acked 4869 Read 3 Done New Done false
15660 3871 Acked 4870 Write 7 Done New Done false
15661 3872 Acked 4871 Write 10 Done New Done false
15662 3873 Acked 4872 Flush 0 Done New Done false
15663 3874 Acked 4873 Read 5 Done New Done false
15664 3875 Acked 4874 Read 8 Done New Done false
15665 3876 Acked 4875 Read 3 Done New Done false
15666 3877 Acked 4876 Read 7 Done New Done false
15667 3878 Acked 4877 Write 5 Done New Done false
15668 3879 Acked 4878 Flush 0 Done New Done false
15669 3880 Acked 4879 Write 1 Done New Done false
15670 3881 Acked 4880 Write 7 Done New Done false
15671 3882 Acked 4881 Read 1 Done New Done false
15672 3883 Acked 4882 Write 10 Done New Done false
15673 3884 Acked 4883 Write 2 Done New Done false
15674 3885 Acked 4884 Read 8 Done New Done false
15675 3886 Acked 4885 Write 9 Done New Done false
15676 3887 Acked 4886 Flush 0 Done New Done false
15677 3888 Acked 4887 Read 1 Done New Done false
15678 3889 Acked 4888 Write 7 Done New Done false
15679 3890 Acked 4889 Write 1 Done New Done false
15680 3891 Acked 4890 Flush 0 Done New Done false
15681 3892 Acked 4891 Read 9 Done New Done false
15682 3893 Acked 4892 Read 10 Done New Done false
15683 3894 Acked 4893 Write 7 Done New Done false
15684 3895 Acked 4894 Flush 0 Done New Done false
15685 3896 Acked 4895 Write 9 Done New Done false
15686 3897 Acked 4896 Write 4 Done New Done false
15687 3898 Acked 4897 Read 4 Done New Done false
15688 3899 Acked 4898 Read 5 Done New Done false
15689 3900 Acked 4899 Read 5 Done New Done false
15690 3901 Acked 4900 Read 2 Done New Done false
15691 3902 Acked 4901 Read 3 Done New Done false
15692 3903 Acked 4902 Write 10 Done New Done false
15693 3904 Acked 4903 Read 4 Done New Done false
15694 3905 Acked 4904 Write 6 Done New Done false
15695 3906 Acked 4905 Read 6 Done New Done false
15696 3907 Acked 4906 Read 7 Done New Done false
15697 3908 Acked 4907 Flush 0 Done New Done false
15698 3909 Acked 4908 Read 7 Done New Done false
15699 3910 Acked 4909 Write 10 Done New Done false
15700 3911 Acked 4910 Flush 0 Done New Done false
15701 3912 Acked 4911 Write 9 Done New Done false
15702 3913 Acked 4912 Write 9 Done New Done false
15703 3914 Acked 4913 Read 2 Done New Done false
15704 3915 Acked 4914 Read 4 Done New Done false
15705 3916 Acked 4915 Write 5 Done New Done false
15706 3917 Acked 4916 Write 6 Done New Done false
15707 3918 Acked 4917 Read 4 Done New Done false
15708 3919 Acked 4918 Write 5 Done New Done false
15709 STATES DS:0 DS:1 DS:2 TOTAL
15710 New 0 300 0 300
15711 Sent 0 0 0 0
15712 Done 300 0 300 600
15713 Skipped 0 0 0 0
15714 Error 0 0 0 0
15715 Last Flush: 4910 4618 4910
15716 Downstairs last five completed: 4618 4617 4616 4615 4614
15717 Upstairs last five completed: 3919 3918 3917 3916 3915
15718 CLIENT: Up:0 ds:300 act:2
15719 ----------------------------------------------------------------
15720 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:301
15721 States: Active Offline Active
15722 GW_ID ACK DSID TYPE BLOCKS DS:0 DS:1 DS:2 REPLAY
15723 3620 Acked 4619 Read 4 Done New Done false
15724 3621 Acked 4620 Read 5 Done New Done false
15725 3622 Acked 4621 Write 7 Done New Done false
15726 3623 Acked 4622 Read 10 Done New Done false
15727 3624 Acked 4623 Read 8 Done New Done false
15728 3625 Acked 4624 Write 4 Done New Done false
15729 3626 Acked 4625 Read 8 Done New Done false
15730 3627 Acked 4626 Read 8 Done New Done false
15731 3628 Acked 4627 Read 3 Done New Done false
15732 3629 Acked 4628 Read 4 Done New Done false
15733 3630 Acked 4629 Read 3 Done New Done false
15734 3631 Acked 4630 Write 3 Done New Done false
15735 3632 Acked 4631 Write 1 Done New Done false
15736 3633 Acked 4632 Read 7 Done New Done false
15737 3634 Acked 4633 Read 8 Done New Done false
15738 3635 Acked 4634 Flush 0 Done New Done false
15739 3636 Acked 4635 Write 2 Done New Done false
15740 3637 Acked 4636 Write 7 Done New Done false
15741 3638 Acked 4637 Flush 0 Done New Done false
15742 3639 Acked 4638 Write 5 Done New Done false
15743 3640 Acked 4639 Write 6 Done New Done false
15744 3641 Acked 4640 Write 6 Done New Done false
15745 3642 Acked 4641 Write 8 Done New Done false
15746 3643 Acked 4642 Read 7 Done New Done false
15747 3644 Acked 4643 Write 8 Done New Done false
15748 3645 Acked 4644 Flush 0 Done New Done false
15749 3646 Acked 4645 Write 7 Done New Done false
15750 3647 Acked 4646 Write 6 Done New Done false
15751 3648 Acked 4647 Read 5 Done New Done false
15752 3649 Acked 4648 Write 4 Done New Done false
15753 3650 Acked 4649 Read 9 Done New Done false
15754 3651 Acked 4650 Write 3 Done New Done false
15755 3652 Acked 4651 Write 5 Done New Done false
15756 3653 Acked 4652 Read 7 Done New Done false
15757 3654 Acked 4653 Flush 0 Done New Done false
15758 3655 Acked 4654 Read 5 Done New Done false
15759 3656 Acked 4655 Write 6 Done New Done false
15760 3657 Acked 4656 Write 4 Done New Done false
15761 3658 Acked 4657 Read 5 Done New Done false
15762 3659 Acked 4658 Read 8 Done New Done false
15763 3660 Acked 4659 Read 9 Done New Done false
15764 3661 Acked 4660 Read 8 Done New Done false
15765 3662 Acked 4661 Read 6 Done New Done false
15766 3663 Acked 4662 Read 1 Done New Done false
15767 3664 Acked 4663 Read 1 Done New Done false
15768 3665 Acked 4664 Read 9 Done New Done false
15769 3666 Acked 4665 Read 4 Done New Done false
15770 3667 Acked 4666 Write 6 Done New Done false
15771 3668 Acked 4667 Read 2 Done New Done false
15772 3669 Acked 4668 Read 9 Done New Done false
15773 3670 Acked 4669 Write 8 Done New Done false
15774 3671 Acked 4670 Write 7 Done New Done false
15775 3672 Acked 4671 Read 7 Done New Done false
15776 3673 Acked 4672 Write 3 Done New Done false
15777 3674 Acked 4673 Write 10 Done New Done false
15778 3675 Acked 4674 Flush 0 Done New Done false
15779 3676 Acked 4675 Write 2 Done New Done false
15780 3677 Acked 4676 Write 9 Done New Done false
15781 3678 Acked 4677 Read 8 Done New Done false
15782 3679 Acked 4678 Write 9 Done New Done false
15783 3680 Acked 4679 Read 3 Done New Done false
15784 3681 Acked 4680 Write 3 Done New Done false
15785 3682 Acked 4681 Write 2 Done New Done false
15786 3683 Acked 4682 Read 6 Done New Done false
15787 3684 Acked 4683 Read 2 Done New Done false
15788 3685 Acked 4684 Read 5 Done New Done false
15789 3686 Acked 4685 Write 1 Done New Done false
15790 3687 Acked 4686 Read 9 Done New Done false
15791 3688 Acked 4687 Read 1 Done New Done false
15792 3689 Acked 4688 Write 9 Done New Done false
15793 3690 Acked 4689 Read 2 Done New Done false
15794 3691 Acked 4690 Write 6 Done New Done false
15795 3692 Acked 4691 Read 2 Done New Done false
15796 3693 Acked 4692 Write 10 Done New Done false
15797 3694 Acked 4693 Write 8 Done New Done false
15798 3695 Acked 4694 Write 4 Done New Done false
15799 3696 Acked 4695 Write 7 Done New Done false
15800 3697 Acked 4696 Write 4 Done New Done false
15801 3698 Acked 4697 Read 9 Done New Done false
15802 3699 Acked 4698 Read 6 Done New Done false
15803 3700 Acked 4699 Write 4 Done New Done false
15804 3701 Acked 4700 Read 10 Done New Done false
15805 3702 Acked 4701 Write 9 Done New Done false
15806 3703 Acked 4702 Write 7 Done New Done false
15807 3704 Acked 4703 Read 3 Done New Done false
15808 3705 Acked 4704 Read 5 Done New Done false
15809 3706 Acked 4705 Flush 0 Done New Done false
15810 3707 Acked 4706 Read 8 Done New Done false
15811 3708 Acked 4707 Flush 0 Done New Done false
15812 3709 Acked 4708 Write 3 Done New Done false
15813 3710 Acked 4709 Write 8 Done New Done false
15814 3711 Acked 4710 Flush 0 Done New Done false
15815 3712 Acked 4711 Read 4 Done New Done false
15816 3713 Acked 4712 Write 2 Done New Done false
15817 3714 Acked 4713 Write 9 Done New Done false
15818 3715 Acked 4714 Write 9 Done New Done false
15819 3716 Acked 4715 Read 8 Done New Done false
15820 3717 Acked 4716 Write 1 Done New Done false
15821 3718 Acked 4717 Read 7 Done New Done false
15822 3719 Acked 4718 Read 5 Done New Done false
15823 3720 Acked 4719 Read 10 Done New Done false
15824 3721 Acked 4720 Flush 0 Done New Done false
15825 3722 Acked 4721 Write 2 Done New Done false
15826 3723 Acked 4722 Read 3 Done New Done false
15827 3724 Acked 4723 Write 4 Done New Done false
15828 3725 Acked 4724 Read 2 Done New Done false
15829 3726 Acked 4725 Write 6 Done New Done false
15830 3727 Acked 4726 Read 2 Done New Done false
15831 3728 Acked 4727 Read 1 Done New Done false
15832 3729 Acked 4728 Write 3 Done New Done false
15833 3730 Acked 4729 Read 9 Done New Done false
15834 3731 Acked 4730 Write 9 Done New Done false
15835 3732 Acked 4731 Read 3 Done New Done false
15836 3733 Acked 4732 Write 10 Done New Done false
15837 3734 Acked 4733 Read 9 Done New Done false
15838 3735 Acked 4734 Read 10 Done New Done false
15839 3736 Acked 4735 Write 8 Done New Done false
15840 3737 Acked 4736 Write 9 Done New Done false
15841 3738 Acked 4737 Read 10 Done New Done false
15842 3739 Acked 4738 Write 8 Done New Done false
15843 3740 Acked 4739 Write 2 Done New Done false
15844 3741 Acked 4740 Read 9 Done New Done false
15845 3742 Acked 4741 Write 2 Done New Done false
15846 3743 Acked 4742 Write 8 Done New Done false
15847 3744 Acked 4743 Write 2 Done New Done false
15848 3745 Acked 4744 Read 2 Done New Done false
15849 3746 Acked 4745 Write 6 Done New Done false
15850 3747 Acked 4746 Write 2 Done New Done false
15851 3748 Acked 4747 Read 1 Done New Done false
15852 3749 Acked 4748 Read 4 Done New Done false
15853 3750 Acked 4749 Write 3 Done New Done false
15854 3751 Acked 4750 Write 6 Done New Done false
15855 3752 Acked 4751 Read 1 Done New Done false
15856 3753 Acked 4752 Write 4 Done New Done false
15857 3754 Acked 4753 Read 1 Done New Done false
15858 3755 Acked 4754 Flush 0 Done New Done false
15859 3756 Acked 4755 Flush 0 Done New Done false
15860 3757 Acked 4756 Write 8 Done New Done false
15861 3758 Acked 4757 Write 4 Done New Done false
15862 3759 Acked 4758 Read 1 Done New Done false
15863 3760 Acked 4759 Read 7 Done New Done false
15864 3761 Acked 4760 Read 9 Done New Done false
15865 3762 Acked 4761 Write 2 Done New Done false
15866 3763 Acked 4762 Read 10 Done New Done false
15867 3764 Acked 4763 Write 9 Done New Done false
15868 3765 Acked 4764 Flush 0 Done New Done false
15869 3766 Acked 4765 Read 10 Done New Done false
15870 3767 Acked 4766 Read 3 Done New Done false
15871 3768 Acked 4767 Write 3 Done New Done false
15872 3769 Acked 4768 Write 8 Done New Done false
15873 3770 Acked 4769 Read 10 Done New Done false
15874 3771 Acked 4770 Write 1 Done New Done false
15875 3772 Acked 4771 Write 3 Done New Done false
15876 3773 Acked 4772 Read 8 Done New Done false
15877 3774 Acked 4773 Read 1 Done New Done false
15878 3775 Acked 4774 Read 3 Done New Done false
15879 3776 Acked 4775 Write 6 Done New Done false
15880 3777 Acked 4776 Read 10 Done New Done false
15881 3778 Acked 4777 Read 1 Done New Done false
15882 3779 Acked 4778 Flush 0 Done New Done false
15883 3780 Acked 4779 Write 9 Done New Done false
15884 3781 Acked 4780 Read 4 Done New Done false
15885 3782 Acked 4781 Read 9 Done New Done false
15886 3783 Acked 4782 Write 4 Done New Done false
15887 3784 Acked 4783 Write 2 Done New Done false
15888 3785 Acked 4784 Flush 0 Done New Done false
15889 3786 Acked 4785 Read 10 Done New Done false
15890 3787 Acked 4786 Read 10 Done New Done false
15891 3788 Acked 4787 Write 10 Done New Done false
15892 3789 Acked 4788 Flush 0 Done New Done false
15893 3790 Acked 4789 Write 8 Done New Done false
15894 3791 Acked 4790 Read 6 Done New Done false
15895 3792 Acked 4791 Write 5 Done New Done false
15896 3793 Acked 4792 Write 5 Done New Done false
15897 3794 Acked 4793 Read 5 Done New Done false
15898 3795 Acked 4794 Write 2 Done New Done false
15899 3796 Acked 4795 Read 6 Done New Done false
15900 3797 Acked 4796 Read 1 Done New Done false
15901 3798 Acked 4797 Read 1 Done New Done false
15902 3799 Acked 4798 Write 9 Done New Done false
15903 3800 Acked 4799 Write 5 Done New Done false
15904 3801 Acked 4800 Write 5 Done New Done false
15905 3802 Acked 4801 Write 1 Done New Done false
15906 3803 Acked 4802 Read 4 Done New Done false
15907 3804 Acked 4803 Write 8 Done New Done false
15908 3805 Acked 4804 Read 1 Done New Done false
15909 3806 Acked 4805 Write 6 Done New Done false
15910 3807 Acked 4806 Flush 0 Done New Done false
15911 3808 Acked 4807 Read 3 Done New Done false
15912 3809 Acked 4808 Write 7 Done New Done false
15913 3810 Acked 4809 Write 10 Done New Done false
15914 3811 Acked 4810 Read 9 Done New Done false
15915 3812 Acked 4811 Read 6 Done New Done false
15916 3813 Acked 4812 Write 9 Done New Done false
15917 3814 Acked 4813 Read 9 Done New Done false
15918 3815 Acked 4814 Write 5 Done New Done false
15919 3816 Acked 4815 Read 10 Done New Done false
15920 3817 Acked 4816 Flush 0 Done New Done false
15921 3818 Acked 4817 Read 3 Done New Done false
15922 3819 Acked 4818 Write 9 Done New Done false
15923 3820 Acked 4819 Read 8 Done New Done false
15924 3821 Acked 4820 Write 1 Done New Done false
15925 3822 Acked 4821 Read 4 Done New Done false
15926 3823 Acked 4822 Write 2 Done New Done false
15927 3824 Acked 4823 Write 9 Done New Done false
15928 3825 Acked 4824 Write 1 Done New Done false
15929 3826 Acked 4825 Read 7 Done New Done false
15930 3827 Acked 4826 Flush 0 Done New Done false
15931 3828 Acked 4827 Read 3 Done New Done false
15932 3829 Acked 4828 Flush 0 Done New Done false
15933 3830 Acked 4829 Write 5 Done New Done false
15934 3831 Acked 4830 Write 8 Done New Done false
15935 3832 Acked 4831 Read 6 Done New Done false
15936 3833 Acked 4832 Read 10 Done New Done false
15937 3834 Acked 4833 Read 2 Done New Done false
15938 3835 Acked 4834 Write 9 Done New Done false
15939 3836 Acked 4835 Write 9 Done New Done false
15940 3837 Acked 4836 Write 4 Done New Done false
15941 3838 Acked 4837 Read 7 Done New Done false
15942 3839 Acked 4838 Read 10 Done New Done false
15943 3840 Acked 4839 Read 6 Done New Done false
15944 3841 Acked 4840 Write 10 Done New Done false
15945 3842 Acked 4841 Write 10 Done New Done false
15946 3843 Acked 4842 Read 5 Done New Done false
15947 3844 Acked 4843 Flush 0 Done New Done false
15948 3845 Acked 4844 Read 9 Done New Done false
15949 3846 Acked 4845 Flush 0 Done New Done false
15950 3847 Acked 4846 Read 7 Done New Done false
15951 3848 Acked 4847 Read 4 Done New Done false
15952 3849 Acked 4848 Read 8 Done New Done false
15953 3850 Acked 4849 Write 4 Done New Done false
15954 3851 Acked 4850 Write 6 Done New Done false
15955 3852 Acked 4851 Read 1 Done New Done false
15956 3853 Acked 4852 Read 5 Done New Done false
15957 3854 Acked 4853 Write 2 Done New Done false
15958 3855 Acked 4854 Write 5 Done New Done false
15959 3856 Acked 4855 Write 6 Done New Done false
15960 3857 Acked 4856 Write 5 Done New Done false
15961 3858 Acked 4857 Read 1 Done New Done false
15962 3859 Acked 4858 Read 8 Done New Done false
15963 3860 Acked 4859 Read 10 Done New Done false
15964 3861 Acked 4860 Write 3 Done New Done false
15965 3862 Acked 4861 Write 3 Done New Done false
15966 3863 Acked 4862 Write 6 Done New Done false
15967 3864 Acked 4863 Read 7 Done New Done false
15968 3865 Acked 4864 Write 5 Done New Done false
15969 3866 Acked 4865 Write 9 Done New Done false
15970 3867 Acked 4866 Flush 0 Done New Done false
15971 3868 Acked 4867 Read 6 Done New Done false
15972 3869 Acked 4868 Write 6 Done New Done false
15973 3870 Acked 4869 Read 3 Done New Done false
15974 3871 Acked 4870 Write 7 Done New Done false
15975 3872 Acked 4871 Write 10 Done New Done false
15976 3873 Acked 4872 Flush 0 Done New Done false
15977 3874 Acked 4873 Read 5 Done New Done false
15978 3875 Acked 4874 Read 8 Done New Done false
15979 3876 Acked 4875 Read 3 Done New Done false
15980 3877 Acked 4876 Read 7 Done New Done false
15981 3878 Acked 4877 Write 5 Done New Done false
15982 3879 Acked 4878 Flush 0 Done New Done false
15983 3880 Acked 4879 Write 1 Done New Done false
15984 3881 Acked 4880 Write 7 Done New Done false
15985 3882 Acked 4881 Read 1 Done New Done false
15986 3883 Acked 4882 Write 10 Done New Done false
15987 3884 Acked 4883 Write 2 Done New Done false
15988 3885 Acked 4884 Read 8 Done New Done false
15989 3886 Acked 4885 Write 9 Done New Done false
15990 3887 Acked 4886 Flush 0 Done New Done false
15991 3888 Acked 4887 Read 1 Done New Done false
15992 3889 Acked 4888 Write 7 Done New Done false
15993 3890 Acked 4889 Write 1 Done New Done false
15994 3891 Acked 4890 Flush 0 Done New Done false
15995 3892 Acked 4891 Read 9 Done New Done false
15996 3893 Acked 4892 Read 10 Done New Done false
15997 3894 Acked 4893 Write 7 Done New Done false
15998 3895 Acked 4894 Flush 0 Done New Done false
15999 3896 Acked 4895 Write 9 Done New Done false
16000 3897 Acked 4896 Write 4 Done New Done false
16001 3898 Acked 4897 Read 4 Done New Done false
16002 3899 Acked 4898 Read 5 Done New Done false
16003 3900 Acked 4899 Read 5 Done New Done false
16004 3901 Acked 4900 Read 2 Done New Done false
16005 3902 Acked 4901 Read 3 Done New Done false
16006 3903 Acked 4902 Write 10 Done New Done false
16007 3904 Acked 4903 Read 4 Done New Done false
16008 3905 Acked 4904 Write 6 Done New Done false
16009 3906 Acked 4905 Read 6 Done New Done false
16010 3907 Acked 4906 Read 7 Done New Done false
16011 3908 Acked 4907 Flush 0 Done New Done false
16012 3909 Acked 4908 Read 7 Done New Done false
16013 3910 Acked 4909 Write 10 Done New Done false
16014 3911 Acked 4910 Flush 0 Done New Done false
16015 3912 Acked 4911 Write 9 Done New Done false
16016 3913 Acked 4912 Write 9 Done New Done false
16017 3914 Acked 4913 Read 2 Done New Done false
16018 3915 Acked 4914 Read 4 Done New Done false
16019 3916 Acked 4915 Write 5 Done New Done false
16020 3917 Acked 4916 Write 6 Done New Done false
16021 3918 Acked 4917 Read 4 Done New Done false
16022 3919 Acked 4918 Write 5 Done New Done false
16023 3920 Acked 4919 Flush 0 Done New Done false
16024 STATES DS:0 DS:1 DS:2 TOTAL
16025 New 0 301 0 301
16026 Sent 0 0 0 0
16027 Done 301 0 301 602
16028 Skipped 0 0 0 0
16029 Error 0 0 0 0
16030 Last Flush: 4919 4618 4919
16031 Downstairs last five completed: 4618 4617 4616 4615 4614
16032 Upstairs last five completed: 3920 3919 3918 3917 3916
16033 CLIENT: Up:0 ds:301 act:2
160342024-04-20T01:08:25.900ZINFOcrucible: connecting to 127.0.0.1:8820 = io task client = 1 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
160352024-04-20T01:08:25.900ZWARNcrucible: ds_connection connect to 127.0.0.1:8820 failure: Os { code: 146, kind: ConnectionRefused, message: "Connection refused" } = io task client = 1 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
160362024-04-20T01:08:25.900ZWARNcrucible: client task is sending Done(ConnectionFailed(Os { code: 146, kind: ConnectionRefused, message: "Connection refused" })) = io task client = 1 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
160372024-04-20T01:08:25.900ZWARNcrucible: downstairs task for 1 stopped due to ConnectionFailed(Os { code: 146, kind: ConnectionRefused, message: "Connection refused" }) session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
160382024-04-20T01:08:25.900ZINFOcrucible: [1] client re-new 301 jobs since flush 4618 = downstairs session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
160392024-04-20T01:08:25.900ZINFOcrucible: [1] Marked 0 jobs for replay since flush: 4618 = downstairs session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
160402024-04-20T01:08:25.900ZINFOcrucible: client task is exiting = io task client = 1 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
16041 [8820] got start action
16042 [8820] I am going to restart
16043 Starting downstairs at port 8820
16044 Make output file at "/tmp/dsc/downstairs-8820.txt"
16045 [8820][1] reports Starting
16046 Downstairs /var/tmp/dsc/region/8820 port 8820 PID:Some(1209)
16047 [8820][1] reports Running
16048 ----------------------------------------------------------------
16049 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:301
16050 States: Active Offline Active
16051 GW_ID ACK DSID TYPE BLOCKS DS:0 DS:1 DS:2 REPLAY
16052 3620 Acked 4619 Read 4 Done New Done true
16053 3621 Acked 4620 Read 5 Done New Done true
16054 3622 Acked 4621 Write 7 Done New Done true
16055 3623 Acked 4622 Read 10 Done New Done true
16056 3624 Acked 4623 Read 8 Done New Done true
16057 3625 Acked 4624 Write 4 Done New Done true
16058 3626 Acked 4625 Read 8 Done New Done true
16059 3627 Acked 4626 Read 8 Done New Done true
16060 3628 Acked 4627 Read 3 Done New Done true
16061 3629 Acked 4628 Read 4 Done New Done true
16062 3630 Acked 4629 Read 3 Done New Done true
16063 3631 Acked 4630 Write 3 Done New Done true
16064 3632 Acked 4631 Write 1 Done New Done true
16065 3633 Acked 4632 Read 7 Done New Done true
16066 3634 Acked 4633 Read 8 Done New Done true
16067 3635 Acked 4634 Flush 0 Done New Done true
16068 3636 Acked 4635 Write 2 Done New Done true
16069 3637 Acked 4636 Write 7 Done New Done true
16070 3638 Acked 4637 Flush 0 Done New Done true
16071 3639 Acked 4638 Write 5 Done New Done true
16072 3640 Acked 4639 Write 6 Done New Done true
16073 3641 Acked 4640 Write 6 Done New Done true
16074 3642 Acked 4641 Write 8 Done New Done true
16075 3643 Acked 4642 Read 7 Done New Done true
16076 3644 Acked 4643 Write 8 Done New Done true
16077 3645 Acked 4644 Flush 0 Done New Done true
16078 3646 Acked 4645 Write 7 Done New Done true
16079 3647 Acked 4646 Write 6 Done New Done true
16080 3648 Acked 4647 Read 5 Done New Done true
16081 3649 Acked 4648 Write 4 Done New Done true
16082 3650 Acked 4649 Read 9 Done New Done true
16083 3651 Acked 4650 Write 3 Done New Done true
16084 3652 Acked 4651 Write 5 Done New Done true
16085 3653 Acked 4652 Read 7 Done New Done true
16086 3654 Acked 4653 Flush 0 Done New Done true
16087 3655 Acked 4654 Read 5 Done New Done true
16088 3656 Acked 4655 Write 6 Done New Done true
16089 3657 Acked 4656 Write 4 Done New Done true
16090 3658 Acked 4657 Read 5 Done New Done true
16091 3659 Acked 4658 Read 8 Done New Done true
16092 3660 Acked 4659 Read 9 Done New Done true
16093 3661 Acked 4660 Read 8 Done New Done true
16094 3662 Acked 4661 Read 6 Done New Done true
16095 3663 Acked 4662 Read 1 Done New Done true
16096 3664 Acked 4663 Read 1 Done New Done true
16097 3665 Acked 4664 Read 9 Done New Done true
16098 3666 Acked 4665 Read 4 Done New Done true
16099 3667 Acked 4666 Write 6 Done New Done true
16100 3668 Acked 4667 Read 2 Done New Done true
16101 3669 Acked 4668 Read 9 Done New Done true
16102 3670 Acked 4669 Write 8 Done New Done true
16103 3671 Acked 4670 Write 7 Done New Done true
16104 3672 Acked 4671 Read 7 Done New Done true
16105 3673 Acked 4672 Write 3 Done New Done true
16106 3674 Acked 4673 Write 10 Done New Done true
16107 3675 Acked 4674 Flush 0 Done New Done true
16108 3676 Acked 4675 Write 2 Done New Done true
16109 3677 Acked 4676 Write 9 Done New Done true
16110 3678 Acked 4677 Read 8 Done New Done true
16111 3679 Acked 4678 Write 9 Done New Done true
16112 3680 Acked 4679 Read 3 Done New Done true
16113 3681 Acked 4680 Write 3 Done New Done true
16114 3682 Acked 4681 Write 2 Done New Done true
16115 3683 Acked 4682 Read 6 Done New Done true
16116 3684 Acked 4683 Read 2 Done New Done true
16117 3685 Acked 4684 Read 5 Done New Done true
16118 3686 Acked 4685 Write 1 Done New Done true
16119 3687 Acked 4686 Read 9 Done New Done true
16120 3688 Acked 4687 Read 1 Done New Done true
16121 3689 Acked 4688 Write 9 Done New Done true
16122 3690 Acked 4689 Read 2 Done New Done true
16123 3691 Acked 4690 Write 6 Done New Done true
16124 3692 Acked 4691 Read 2 Done New Done true
16125 3693 Acked 4692 Write 10 Done New Done true
16126 3694 Acked 4693 Write 8 Done New Done true
16127 3695 Acked 4694 Write 4 Done New Done true
16128 3696 Acked 4695 Write 7 Done New Done true
16129 3697 Acked 4696 Write 4 Done New Done true
16130 3698 Acked 4697 Read 9 Done New Done true
16131 3699 Acked 4698 Read 6 Done New Done true
16132 3700 Acked 4699 Write 4 Done New Done true
16133 3701 Acked 4700 Read 10 Done New Done true
16134 3702 Acked 4701 Write 9 Done New Done true
16135 3703 Acked 4702 Write 7 Done New Done true
16136 3704 Acked 4703 Read 3 Done New Done true
16137 3705 Acked 4704 Read 5 Done New Done true
16138 3706 Acked 4705 Flush 0 Done New Done true
16139 3707 Acked 4706 Read 8 Done New Done true
16140 3708 Acked 4707 Flush 0 Done New Done true
16141 3709 Acked 4708 Write 3 Done New Done true
16142 3710 Acked 4709 Write 8 Done New Done true
16143 3711 Acked 4710 Flush 0 Done New Done true
16144 3712 Acked 4711 Read 4 Done New Done true
16145 3713 Acked 4712 Write 2 Done New Done true
16146 3714 Acked 4713 Write 9 Done New Done true
16147 3715 Acked 4714 Write 9 Done New Done true
16148 3716 Acked 4715 Read 8 Done New Done true
16149 3717 Acked 4716 Write 1 Done New Done true
16150 3718 Acked 4717 Read 7 Done New Done true
16151 3719 Acked 4718 Read 5 Done New Done true
16152 3720 Acked 4719 Read 10 Done New Done true
16153 3721 Acked 4720 Flush 0 Done New Done true
16154 3722 Acked 4721 Write 2 Done New Done true
16155 3723 Acked 4722 Read 3 Done New Done true
16156 3724 Acked 4723 Write 4 Done New Done true
16157 3725 Acked 4724 Read 2 Done New Done true
16158 3726 Acked 4725 Write 6 Done New Done true
16159 3727 Acked 4726 Read 2 Done New Done true
16160 3728 Acked 4727 Read 1 Done New Done true
16161 3729 Acked 4728 Write 3 Done New Done true
16162 3730 Acked 4729 Read 9 Done New Done true
16163 3731 Acked 4730 Write 9 Done New Done true
16164 3732 Acked 4731 Read 3 Done New Done true
16165 3733 Acked 4732 Write 10 Done New Done true
16166 3734 Acked 4733 Read 9 Done New Done true
16167 3735 Acked 4734 Read 10 Done New Done true
16168 3736 Acked 4735 Write 8 Done New Done true
16169 3737 Acked 4736 Write 9 Done New Done true
16170 3738 Acked 4737 Read 10 Done New Done true
16171 3739 Acked 4738 Write 8 Done New Done true
16172 3740 Acked 4739 Write 2 Done New Done true
16173 3741 Acked 4740 Read 9 Done New Done true
16174 3742 Acked 4741 Write 2 Done New Done true
16175 3743 Acked 4742 Write 8 Done New Done true
16176 3744 Acked 4743 Write 2 Done New Done true
16177 3745 Acked 4744 Read 2 Done New Done true
16178 3746 Acked 4745 Write 6 Done New Done true
16179 3747 Acked 4746 Write 2 Done New Done true
16180 3748 Acked 4747 Read 1 Done New Done true
16181 3749 Acked 4748 Read 4 Done New Done true
16182 3750 Acked 4749 Write 3 Done New Done true
16183 3751 Acked 4750 Write 6 Done New Done true
16184 3752 Acked 4751 Read 1 Done New Done true
16185 3753 Acked 4752 Write 4 Done New Done true
16186 3754 Acked 4753 Read 1 Done New Done true
16187 3755 Acked 4754 Flush 0 Done New Done true
16188 3756 Acked 4755 Flush 0 Done New Done true
16189 3757 Acked 4756 Write 8 Done New Done true
16190 3758 Acked 4757 Write 4 Done New Done true
16191 3759 Acked 4758 Read 1 Done New Done true
16192 3760 Acked 4759 Read 7 Done New Done true
16193 3761 Acked 4760 Read 9 Done New Done true
16194 3762 Acked 4761 Write 2 Done New Done true
16195 3763 Acked 4762 Read 10 Done New Done true
16196 3764 Acked 4763 Write 9 Done New Done true
16197 3765 Acked 4764 Flush 0 Done New Done true
16198 3766 Acked 4765 Read 10 Done New Done true
16199 3767 Acked 4766 Read 3 Done New Done true
16200 3768 Acked 4767 Write 3 Done New Done true
16201 3769 Acked 4768 Write 8 Done New Done true
16202 3770 Acked 4769 Read 10 Done New Done true
16203 3771 Acked 4770 Write 1 Done New Done true
16204 3772 Acked 4771 Write 3 Done New Done true
16205 3773 Acked 4772 Read 8 Done New Done true
16206 3774 Acked 4773 Read 1 Done New Done true
16207 3775 Acked 4774 Read 3 Done New Done true
16208 3776 Acked 4775 Write 6 Done New Done true
16209 3777 Acked 4776 Read 10 Done New Done true
16210 3778 Acked 4777 Read 1 Done New Done true
16211 3779 Acked 4778 Flush 0 Done New Done true
16212 3780 Acked 4779 Write 9 Done New Done true
16213 3781 Acked 4780 Read 4 Done New Done true
16214 3782 Acked 4781 Read 9 Done New Done true
16215 3783 Acked 4782 Write 4 Done New Done true
16216 3784 Acked 4783 Write 2 Done New Done true
16217 3785 Acked 4784 Flush 0 Done New Done true
16218 3786 Acked 4785 Read 10 Done New Done true
16219 3787 Acked 4786 Read 10 Done New Done true
16220 3788 Acked 4787 Write 10 Done New Done true
16221 3789 Acked 4788 Flush 0 Done New Done true
16222 3790 Acked 4789 Write 8 Done New Done true
16223 3791 Acked 4790 Read 6 Done New Done true
16224 3792 Acked 4791 Write 5 Done New Done true
16225 3793 Acked 4792 Write 5 Done New Done true
16226 3794 Acked 4793 Read 5 Done New Done true
16227 3795 Acked 4794 Write 2 Done New Done true
16228 3796 Acked 4795 Read 6 Done New Done true
16229 3797 Acked 4796 Read 1 Done New Done true
16230 3798 Acked 4797 Read 1 Done New Done true
16231 3799 Acked 4798 Write 9 Done New Done true
16232 3800 Acked 4799 Write 5 Done New Done true
16233 3801 Acked 4800 Write 5 Done New Done true
16234 3802 Acked 4801 Write 1 Done New Done true
16235 3803 Acked 4802 Read 4 Done New Done true
16236 3804 Acked 4803 Write 8 Done New Done true
16237 3805 Acked 4804 Read 1 Done New Done true
16238 3806 Acked 4805 Write 6 Done New Done true
16239 3807 Acked 4806 Flush 0 Done New Done true
16240 3808 Acked 4807 Read 3 Done New Done true
16241 3809 Acked 4808 Write 7 Done New Done true
16242 3810 Acked 4809 Write 10 Done New Done true
16243 3811 Acked 4810 Read 9 Done New Done true
16244 3812 Acked 4811 Read 6 Done New Done true
16245 3813 Acked 4812 Write 9 Done New Done true
16246 3814 Acked 4813 Read 9 Done New Done true
16247 3815 Acked 4814 Write 5 Done New Done true
16248 3816 Acked 4815 Read 10 Done New Done true
16249 3817 Acked 4816 Flush 0 Done New Done true
16250 3818 Acked 4817 Read 3 Done New Done true
16251 3819 Acked 4818 Write 9 Done New Done true
16252 3820 Acked 4819 Read 8 Done New Done true
16253 3821 Acked 4820 Write 1 Done New Done true
16254 3822 Acked 4821 Read 4 Done New Done true
16255 3823 Acked 4822 Write 2 Done New Done true
16256 3824 Acked 4823 Write 9 Done New Done true
16257 3825 Acked 4824 Write 1 Done New Done true
16258 3826 Acked 4825 Read 7 Done New Done true
16259 3827 Acked 4826 Flush 0 Done New Done true
16260 3828 Acked 4827 Read 3 Done New Done true
16261 3829 Acked 4828 Flush 0 Done New Done true
16262 3830 Acked 4829 Write 5 Done New Done true
16263 3831 Acked 4830 Write 8 Done New Done true
16264 3832 Acked 4831 Read 6 Done New Done true
16265 3833 Acked 4832 Read 10 Done New Done true
16266 3834 Acked 4833 Read 2 Done New Done true
16267 3835 Acked 4834 Write 9 Done New Done true
16268 3836 Acked 4835 Write 9 Done New Done true
16269 3837 Acked 4836 Write 4 Done New Done true
16270 3838 Acked 4837 Read 7 Done New Done true
16271 3839 Acked 4838 Read 10 Done New Done true
16272 3840 Acked 4839 Read 6 Done New Done true
16273 3841 Acked 4840 Write 10 Done New Done true
16274 3842 Acked 4841 Write 10 Done New Done true
16275 3843 Acked 4842 Read 5 Done New Done true
16276 3844 Acked 4843 Flush 0 Done New Done true
16277 3845 Acked 4844 Read 9 Done New Done true
16278 3846 Acked 4845 Flush 0 Done New Done true
16279 3847 Acked 4846 Read 7 Done New Done true
16280 3848 Acked 4847 Read 4 Done New Done true
16281 3849 Acked 4848 Read 8 Done New Done true
16282 3850 Acked 4849 Write 4 Done New Done true
16283 3851 Acked 4850 Write 6 Done New Done true
16284 3852 Acked 4851 Read 1 Done New Done true
16285 3853 Acked 4852 Read 5 Done New Done true
16286 3854 Acked 4853 Write 2 Done New Done true
16287 3855 Acked 4854 Write 5 Done New Done true
16288 3856 Acked 4855 Write 6 Done New Done true
16289 3857 Acked 4856 Write 5 Done New Done true
16290 3858 Acked 4857 Read 1 Done New Done true
16291 3859 Acked 4858 Read 8 Done New Done true
16292 3860 Acked 4859 Read 10 Done New Done true
16293 3861 Acked 4860 Write 3 Done New Done true
16294 3862 Acked 4861 Write 3 Done New Done true
16295 3863 Acked 4862 Write 6 Done New Done true
16296 3864 Acked 4863 Read 7 Done New Done true
16297 3865 Acked 4864 Write 5 Done New Done true
16298 3866 Acked 4865 Write 9 Done New Done true
16299 3867 Acked 4866 Flush 0 Done New Done true
16300 3868 Acked 4867 Read 6 Done New Done true
16301 3869 Acked 4868 Write 6 Done New Done true
16302 3870 Acked 4869 Read 3 Done New Done true
16303 3871 Acked 4870 Write 7 Done New Done true
16304 3872 Acked 4871 Write 10 Done New Done true
16305 3873 Acked 4872 Flush 0 Done New Done true
16306 3874 Acked 4873 Read 5 Done New Done true
16307 3875 Acked 4874 Read 8 Done New Done true
16308 3876 Acked 4875 Read 3 Done New Done true
16309 3877 Acked 4876 Read 7 Done New Done true
16310 3878 Acked 4877 Write 5 Done New Done true
16311 3879 Acked 4878 Flush 0 Done New Done true
16312 3880 Acked 4879 Write 1 Done New Done true
16313 3881 Acked 4880 Write 7 Done New Done true
16314 3882 Acked 4881 Read 1 Done New Done true
16315 3883 Acked 4882 Write 10 Done New Done true
16316 3884 Acked 4883 Write 2 Done New Done true
16317 3885 Acked 4884 Read 8 Done New Done true
16318 3886 Acked 4885 Write 9 Done New Done true
16319 3887 Acked 4886 Flush 0 Done New Done true
16320 3888 Acked 4887 Read 1 Done New Done true
16321 3889 Acked 4888 Write 7 Done New Done true
16322 3890 Acked 4889 Write 1 Done New Done true
16323 3891 Acked 4890 Flush 0 Done New Done true
16324 3892 Acked 4891 Read 9 Done New Done true
16325 3893 Acked 4892 Read 10 Done New Done true
16326 3894 Acked 4893 Write 7 Done New Done true
16327 3895 Acked 4894 Flush 0 Done New Done true
16328 3896 Acked 4895 Write 9 Done New Done true
16329 3897 Acked 4896 Write 4 Done New Done true
16330 3898 Acked 4897 Read 4 Done New Done true
16331 3899 Acked 4898 Read 5 Done New Done true
16332 3900 Acked 4899 Read 5 Done New Done true
16333 3901 Acked 4900 Read 2 Done New Done true
16334 3902 Acked 4901 Read 3 Done New Done true
16335 3903 Acked 4902 Write 10 Done New Done true
16336 3904 Acked 4903 Read 4 Done New Done true
16337 3905 Acked 4904 Write 6 Done New Done true
16338 3906 Acked 4905 Read 6 Done New Done true
16339 3907 Acked 4906 Read 7 Done New Done true
16340 3908 Acked 4907 Flush 0 Done New Done true
16341 3909 Acked 4908 Read 7 Done New Done true
16342 3910 Acked 4909 Write 10 Done New Done true
16343 3911 Acked 4910 Flush 0 Done New Done true
16344 3912 Acked 4911 Write 9 Done New Done true
16345 3913 Acked 4912 Write 9 Done New Done true
16346 3914 Acked 4913 Read 2 Done New Done true
16347 3915 Acked 4914 Read 4 Done New Done true
16348 3916 Acked 4915 Write 5 Done New Done true
16349 3917 Acked 4916 Write 6 Done New Done true
16350 3918 Acked 4917 Read 4 Done New Done true
16351 3919 Acked 4918 Write 5 Done New Done true
16352 3920 Acked 4919 Flush 0 Done New Done true
16353 STATES DS:0 DS:1 DS:2 TOTAL
16354 New 0 301 0 301
16355 Sent 0 0 0 0
16356 Done 301 0 301 602
16357 Skipped 0 0 0 0
16358 Error 0 0 0 0
16359 Last Flush: 4919 4618 4919
16360 Downstairs last five completed: 4618 4617 4616 4615 4614
16361 Upstairs last five completed: 3920 3919 3918 3917 3916
16362 CLIENT: Up:0 ds:301 act:2
16363 ----------------------------------------------------------------
16364 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:301
16365 States: Active Offline Active
16366 GW_ID ACK DSID TYPE BLOCKS DS:0 DS:1 DS:2 REPLAY
16367 3620 Acked 4619 Read 4 Done New Done true
16368 3621 Acked 4620 Read 5 Done New Done true
16369 3622 Acked 4621 Write 7 Done New Done true
16370 3623 Acked 4622 Read 10 Done New Done true
16371 3624 Acked 4623 Read 8 Done New Done true
16372 3625 Acked 4624 Write 4 Done New Done true
16373 3626 Acked 4625 Read 8 Done New Done true
16374 3627 Acked 4626 Read 8 Done New Done true
16375 3628 Acked 4627 Read 3 Done New Done true
16376 3629 Acked 4628 Read 4 Done New Done true
16377 3630 Acked 4629 Read 3 Done New Done true
16378 3631 Acked 4630 Write 3 Done New Done true
16379 3632 Acked 4631 Write 1 Done New Done true
16380 3633 Acked 4632 Read 7 Done New Done true
16381 3634 Acked 4633 Read 8 Done New Done true
16382 3635 Acked 4634 Flush 0 Done New Done true
16383 3636 Acked 4635 Write 2 Done New Done true
16384 3637 Acked 4636 Write 7 Done New Done true
16385 3638 Acked 4637 Flush 0 Done New Done true
16386 3639 Acked 4638 Write 5 Done New Done true
16387 3640 Acked 4639 Write 6 Done New Done true
16388 3641 Acked 4640 Write 6 Done New Done true
16389 3642 Acked 4641 Write 8 Done New Done true
16390 3643 Acked 4642 Read 7 Done New Done true
16391 3644 Acked 4643 Write 8 Done New Done true
16392 3645 Acked 4644 Flush 0 Done New Done true
16393 3646 Acked 4645 Write 7 Done New Done true
16394 3647 Acked 4646 Write 6 Done New Done true
16395 3648 Acked 4647 Read 5 Done New Done true
16396 3649 Acked 4648 Write 4 Done New Done true
16397 3650 Acked 4649 Read 9 Done New Done true
16398 3651 Acked 4650 Write 3 Done New Done true
16399 3652 Acked 4651 Write 5 Done New Done true
16400 3653 Acked 4652 Read 7 Done New Done true
16401 3654 Acked 4653 Flush 0 Done New Done true
16402 3655 Acked 4654 Read 5 Done New Done true
16403 3656 Acked 4655 Write 6 Done New Done true
16404 3657 Acked 4656 Write 4 Done New Done true
16405 3658 Acked 4657 Read 5 Done New Done true
16406 3659 Acked 4658 Read 8 Done New Done true
16407 3660 Acked 4659 Read 9 Done New Done true
16408 3661 Acked 4660 Read 8 Done New Done true
16409 3662 Acked 4661 Read 6 Done New Done true
16410 3663 Acked 4662 Read 1 Done New Done true
16411 3664 Acked 4663 Read 1 Done New Done true
16412 3665 Acked 4664 Read 9 Done New Done true
16413 3666 Acked 4665 Read 4 Done New Done true
16414 3667 Acked 4666 Write 6 Done New Done true
16415 3668 Acked 4667 Read 2 Done New Done true
16416 3669 Acked 4668 Read 9 Done New Done true
16417 3670 Acked 4669 Write 8 Done New Done true
16418 3671 Acked 4670 Write 7 Done New Done true
16419 3672 Acked 4671 Read 7 Done New Done true
16420 3673 Acked 4672 Write 3 Done New Done true
16421 3674 Acked 4673 Write 10 Done New Done true
16422 3675 Acked 4674 Flush 0 Done New Done true
16423 3676 Acked 4675 Write 2 Done New Done true
16424 3677 Acked 4676 Write 9 Done New Done true
16425 3678 Acked 4677 Read 8 Done New Done true
16426 3679 Acked 4678 Write 9 Done New Done true
16427 3680 Acked 4679 Read 3 Done New Done true
16428 3681 Acked 4680 Write 3 Done New Done true
16429 3682 Acked 4681 Write 2 Done New Done true
16430 3683 Acked 4682 Read 6 Done New Done true
16431 3684 Acked 4683 Read 2 Done New Done true
16432 3685 Acked 4684 Read 5 Done New Done true
16433 3686 Acked 4685 Write 1 Done New Done true
16434 3687 Acked 4686 Read 9 Done New Done true
16435 3688 Acked 4687 Read 1 Done New Done true
16436 3689 Acked 4688 Write 9 Done New Done true
16437 3690 Acked 4689 Read 2 Done New Done true
16438 3691 Acked 4690 Write 6 Done New Done true
16439 3692 Acked 4691 Read 2 Done New Done true
16440 3693 Acked 4692 Write 10 Done New Done true
16441 3694 Acked 4693 Write 8 Done New Done true
16442 3695 Acked 4694 Write 4 Done New Done true
16443 3696 Acked 4695 Write 7 Done New Done true
16444 3697 Acked 4696 Write 4 Done New Done true
16445 3698 Acked 4697 Read 9 Done New Done true
16446 3699 Acked 4698 Read 6 Done New Done true
16447 3700 Acked 4699 Write 4 Done New Done true
16448 3701 Acked 4700 Read 10 Done New Done true
16449 3702 Acked 4701 Write 9 Done New Done true
16450 3703 Acked 4702 Write 7 Done New Done true
16451 3704 Acked 4703 Read 3 Done New Done true
16452 3705 Acked 4704 Read 5 Done New Done true
16453 3706 Acked 4705 Flush 0 Done New Done true
16454 3707 Acked 4706 Read 8 Done New Done true
16455 3708 Acked 4707 Flush 0 Done New Done true
16456 3709 Acked 4708 Write 3 Done New Done true
16457 3710 Acked 4709 Write 8 Done New Done true
16458 3711 Acked 4710 Flush 0 Done New Done true
16459 3712 Acked 4711 Read 4 Done New Done true
16460 3713 Acked 4712 Write 2 Done New Done true
16461 3714 Acked 4713 Write 9 Done New Done true
16462 3715 Acked 4714 Write 9 Done New Done true
16463 3716 Acked 4715 Read 8 Done New Done true
16464 3717 Acked 4716 Write 1 Done New Done true
16465 3718 Acked 4717 Read 7 Done New Done true
16466 3719 Acked 4718 Read 5 Done New Done true
16467 3720 Acked 4719 Read 10 Done New Done true
16468 3721 Acked 4720 Flush 0 Done New Done true
16469 3722 Acked 4721 Write 2 Done New Done true
16470 3723 Acked 4722 Read 3 Done New Done true
16471 3724 Acked 4723 Write 4 Done New Done true
16472 3725 Acked 4724 Read 2 Done New Done true
16473 3726 Acked 4725 Write 6 Done New Done true
16474 3727 Acked 4726 Read 2 Done New Done true
16475 3728 Acked 4727 Read 1 Done New Done true
16476 3729 Acked 4728 Write 3 Done New Done true
16477 3730 Acked 4729 Read 9 Done New Done true
16478 3731 Acked 4730 Write 9 Done New Done true
16479 3732 Acked 4731 Read 3 Done New Done true
16480 3733 Acked 4732 Write 10 Done New Done true
16481 3734 Acked 4733 Read 9 Done New Done true
16482 3735 Acked 4734 Read 10 Done New Done true
16483 3736 Acked 4735 Write 8 Done New Done true
16484 3737 Acked 4736 Write 9 Done New Done true
16485 3738 Acked 4737 Read 10 Done New Done true
16486 3739 Acked 4738 Write 8 Done New Done true
16487 3740 Acked 4739 Write 2 Done New Done true
16488 3741 Acked 4740 Read 9 Done New Done true
16489 3742 Acked 4741 Write 2 Done New Done true
16490 3743 Acked 4742 Write 8 Done New Done true
16491 3744 Acked 4743 Write 2 Done New Done true
16492 3745 Acked 4744 Read 2 Done New Done true
16493 3746 Acked 4745 Write 6 Done New Done true
16494 3747 Acked 4746 Write 2 Done New Done true
16495 3748 Acked 4747 Read 1 Done New Done true
16496 3749 Acked 4748 Read 4 Done New Done true
16497 3750 Acked 4749 Write 3 Done New Done true
16498 3751 Acked 4750 Write 6 Done New Done true
16499 3752 Acked 4751 Read 1 Done New Done true
16500 3753 Acked 4752 Write 4 Done New Done true
16501 3754 Acked 4753 Read 1 Done New Done true
16502 3755 Acked 4754 Flush 0 Done New Done true
16503 3756 Acked 4755 Flush 0 Done New Done true
16504 3757 Acked 4756 Write 8 Done New Done true
16505 3758 Acked 4757 Write 4 Done New Done true
16506 3759 Acked 4758 Read 1 Done New Done true
16507 3760 Acked 4759 Read 7 Done New Done true
16508 3761 Acked 4760 Read 9 Done New Done true
16509 3762 Acked 4761 Write 2 Done New Done true
16510 3763 Acked 4762 Read 10 Done New Done true
16511 3764 Acked 4763 Write 9 Done New Done true
16512 3765 Acked 4764 Flush 0 Done New Done true
16513 3766 Acked 4765 Read 10 Done New Done true
16514 3767 Acked 4766 Read 3 Done New Done true
16515 3768 Acked 4767 Write 3 Done New Done true
16516 3769 Acked 4768 Write 8 Done New Done true
16517 3770 Acked 4769 Read 10 Done New Done true
16518 3771 Acked 4770 Write 1 Done New Done true
16519 3772 Acked 4771 Write 3 Done New Done true
16520 3773 Acked 4772 Read 8 Done New Done true
16521 3774 Acked 4773 Read 1 Done New Done true
16522 3775 Acked 4774 Read 3 Done New Done true
16523 3776 Acked 4775 Write 6 Done New Done true
16524 3777 Acked 4776 Read 10 Done New Done true
16525 3778 Acked 4777 Read 1 Done New Done true
16526 3779 Acked 4778 Flush 0 Done New Done true
16527 3780 Acked 4779 Write 9 Done New Done true
16528 3781 Acked 4780 Read 4 Done New Done true
16529 3782 Acked 4781 Read 9 Done New Done true
16530 3783 Acked 4782 Write 4 Done New Done true
16531 3784 Acked 4783 Write 2 Done New Done true
16532 3785 Acked 4784 Flush 0 Done New Done true
16533 3786 Acked 4785 Read 10 Done New Done true
16534 3787 Acked 4786 Read 10 Done New Done true
16535 3788 Acked 4787 Write 10 Done New Done true
16536 3789 Acked 4788 Flush 0 Done New Done true
16537 3790 Acked 4789 Write 8 Done New Done true
16538 3791 Acked 4790 Read 6 Done New Done true
16539 3792 Acked 4791 Write 5 Done New Done true
16540 3793 Acked 4792 Write 5 Done New Done true
16541 3794 Acked 4793 Read 5 Done New Done true
16542 3795 Acked 4794 Write 2 Done New Done true
16543 3796 Acked 4795 Read 6 Done New Done true
16544 3797 Acked 4796 Read 1 Done New Done true
16545 3798 Acked 4797 Read 1 Done New Done true
16546 3799 Acked 4798 Write 9 Done New Done true
16547 3800 Acked 4799 Write 5 Done New Done true
16548 3801 Acked 4800 Write 5 Done New Done true
16549 3802 Acked 4801 Write 1 Done New Done true
16550 3803 Acked 4802 Read 4 Done New Done true
16551 3804 Acked 4803 Write 8 Done New Done true
16552 3805 Acked 4804 Read 1 Done New Done true
16553 3806 Acked 4805 Write 6 Done New Done true
16554 3807 Acked 4806 Flush 0 Done New Done true
16555 3808 Acked 4807 Read 3 Done New Done true
16556 3809 Acked 4808 Write 7 Done New Done true
16557 3810 Acked 4809 Write 10 Done New Done true
16558 3811 Acked 4810 Read 9 Done New Done true
16559 3812 Acked 4811 Read 6 Done New Done true
16560 3813 Acked 4812 Write 9 Done New Done true
16561 3814 Acked 4813 Read 9 Done New Done true
16562 3815 Acked 4814 Write 5 Done New Done true
16563 3816 Acked 4815 Read 10 Done New Done true
16564 3817 Acked 4816 Flush 0 Done New Done true
16565 3818 Acked 4817 Read 3 Done New Done true
16566 3819 Acked 4818 Write 9 Done New Done true
16567 3820 Acked 4819 Read 8 Done New Done true
16568 3821 Acked 4820 Write 1 Done New Done true
16569 3822 Acked 4821 Read 4 Done New Done true
16570 3823 Acked 4822 Write 2 Done New Done true
16571 3824 Acked 4823 Write 9 Done New Done true
16572 3825 Acked 4824 Write 1 Done New Done true
16573 3826 Acked 4825 Read 7 Done New Done true
16574 3827 Acked 4826 Flush 0 Done New Done true
16575 3828 Acked 4827 Read 3 Done New Done true
16576 3829 Acked 4828 Flush 0 Done New Done true
16577 3830 Acked 4829 Write 5 Done New Done true
16578 3831 Acked 4830 Write 8 Done New Done true
16579 3832 Acked 4831 Read 6 Done New Done true
16580 3833 Acked 4832 Read 10 Done New Done true
16581 3834 Acked 4833 Read 2 Done New Done true
16582 3835 Acked 4834 Write 9 Done New Done true
16583 3836 Acked 4835 Write 9 Done New Done true
16584 3837 Acked 4836 Write 4 Done New Done true
16585 3838 Acked 4837 Read 7 Done New Done true
16586 3839 Acked 4838 Read 10 Done New Done true
16587 3840 Acked 4839 Read 6 Done New Done true
16588 3841 Acked 4840 Write 10 Done New Done true
16589 3842 Acked 4841 Write 10 Done New Done true
16590 3843 Acked 4842 Read 5 Done New Done true
16591 3844 Acked 4843 Flush 0 Done New Done true
16592 3845 Acked 4844 Read 9 Done New Done true
16593 3846 Acked 4845 Flush 0 Done New Done true
16594 3847 Acked 4846 Read 7 Done New Done true
16595 3848 Acked 4847 Read 4 Done New Done true
16596 3849 Acked 4848 Read 8 Done New Done true
16597 3850 Acked 4849 Write 4 Done New Done true
16598 3851 Acked 4850 Write 6 Done New Done true
16599 3852 Acked 4851 Read 1 Done New Done true
16600 3853 Acked 4852 Read 5 Done New Done true
16601 3854 Acked 4853 Write 2 Done New Done true
16602 3855 Acked 4854 Write 5 Done New Done true
16603 3856 Acked 4855 Write 6 Done New Done true
16604 3857 Acked 4856 Write 5 Done New Done true
16605 3858 Acked 4857 Read 1 Done New Done true
16606 3859 Acked 4858 Read 8 Done New Done true
16607 3860 Acked 4859 Read 10 Done New Done true
16608 3861 Acked 4860 Write 3 Done New Done true
16609 3862 Acked 4861 Write 3 Done New Done true
16610 3863 Acked 4862 Write 6 Done New Done true
16611 3864 Acked 4863 Read 7 Done New Done true
16612 3865 Acked 4864 Write 5 Done New Done true
16613 3866 Acked 4865 Write 9 Done New Done true
16614 3867 Acked 4866 Flush 0 Done New Done true
16615 3868 Acked 4867 Read 6 Done New Done true
16616 3869 Acked 4868 Write 6 Done New Done true
16617 3870 Acked 4869 Read 3 Done New Done true
16618 3871 Acked 4870 Write 7 Done New Done true
16619 3872 Acked 4871 Write 10 Done New Done true
16620 3873 Acked 4872 Flush 0 Done New Done true
16621 3874 Acked 4873 Read 5 Done New Done true
16622 3875 Acked 4874 Read 8 Done New Done true
16623 3876 Acked 4875 Read 3 Done New Done true
16624 3877 Acked 4876 Read 7 Done New Done true
16625 3878 Acked 4877 Write 5 Done New Done true
16626 3879 Acked 4878 Flush 0 Done New Done true
16627 3880 Acked 4879 Write 1 Done New Done true
16628 3881 Acked 4880 Write 7 Done New Done true
16629 3882 Acked 4881 Read 1 Done New Done true
16630 3883 Acked 4882 Write 10 Done New Done true
16631 3884 Acked 4883 Write 2 Done New Done true
16632 3885 Acked 4884 Read 8 Done New Done true
16633 3886 Acked 4885 Write 9 Done New Done true
16634 3887 Acked 4886 Flush 0 Done New Done true
16635 3888 Acked 4887 Read 1 Done New Done true
16636 3889 Acked 4888 Write 7 Done New Done true
16637 3890 Acked 4889 Write 1 Done New Done true
16638 3891 Acked 4890 Flush 0 Done New Done true
16639 3892 Acked 4891 Read 9 Done New Done true
16640 3893 Acked 4892 Read 10 Done New Done true
16641 3894 Acked 4893 Write 7 Done New Done true
16642 3895 Acked 4894 Flush 0 Done New Done true
16643 3896 Acked 4895 Write 9 Done New Done true
16644 3897 Acked 4896 Write 4 Done New Done true
16645 3898 Acked 4897 Read 4 Done New Done true
16646 3899 Acked 4898 Read 5 Done New Done true
16647 3900 Acked 4899 Read 5 Done New Done true
16648 3901 Acked 4900 Read 2 Done New Done true
16649 3902 Acked 4901 Read 3 Done New Done true
16650 3903 Acked 4902 Write 10 Done New Done true
16651 3904 Acked 4903 Read 4 Done New Done true
16652 3905 Acked 4904 Write 6 Done New Done true
16653 3906 Acked 4905 Read 6 Done New Done true
16654 3907 Acked 4906 Read 7 Done New Done true
16655 3908 Acked 4907 Flush 0 Done New Done true
16656 3909 Acked 4908 Read 7 Done New Done true
16657 3910 Acked 4909 Write 10 Done New Done true
16658 3911 Acked 4910 Flush 0 Done New Done true
16659 3912 Acked 4911 Write 9 Done New Done true
16660 3913 Acked 4912 Write 9 Done New Done true
16661 3914 Acked 4913 Read 2 Done New Done true
16662 3915 Acked 4914 Read 4 Done New Done true
16663 3916 Acked 4915 Write 5 Done New Done true
16664 3917 Acked 4916 Write 6 Done New Done true
16665 3918 Acked 4917 Read 4 Done New Done true
16666 3919 Acked 4918 Write 5 Done New Done true
16667 3920 Acked 4919 Flush 0 Done New Done true
16668 STATES DS:0 DS:1 DS:2 TOTAL
16669 New 0 301 0 301
16670 Sent 0 0 0 0
16671 Done 301 0 301 602
16672 Skipped 0 0 0 0
16673 Error 0 0 0 0
16674 Last Flush: 4919 4618 4919
16675 Downstairs last five completed: 4618 4617 4616 4615 4614
16676 Upstairs last five completed: 3920 3919 3918 3917 3916
16677 CLIENT: Up:0 ds:301 act:2
166782024-04-20T01:08:35.901ZINFOcrucible: connecting to 127.0.0.1:8820 = io task client = 1 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
166792024-04-20T01:08:35.902ZINFOcrucible: ds_connection connected from Ok(127.0.0.1:38506) = io task client = 1 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
166802024-04-20T01:08:35.903ZINFOcrucible: downstairs client at Some(127.0.0.1:8820) has region UUID 12345678-0000-0000-0000-000000008820 = downstairs client = 1 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
166812024-04-20T01:08:35.903ZINFOcrucible: Returning UUID:12345678-0000-0000-0000-000000008820 matches = downstairs client = 1 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
166822024-04-20T01:08:35.903ZINFOcrucible: send last flush ID to this DS: 4618 = downstairs client = 1 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
166832024-04-20T01:08:35.903ZINFOcrucible: Replied this last flush ID: 4618 = downstairs client = 1 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
166842024-04-20T01:08:35.903ZINFOcrucible: ds_transition from Offline to Replay = downstairs client = 1 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
166852024-04-20T01:08:35.903ZINFOcrucible: [1] Transition from Offline to Replay = downstairs client = 1 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
166862024-04-20T01:08:35.903ZINFOcrucible: ds_transition from Replay to Active = downstairs client = 1 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
166872024-04-20T01:08:35.903ZINFOcrucible: [1] Transition from Replay to Active = downstairs client = 1 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
16688 ----------------------------------------------------------------
16689 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:0
16690 Downstairs last five completed: 4919 4918 4917 4916 4915
16691 Upstairs last five completed: 3920 3919 3918 3917 3916
16692 CLIENT: Up:0 ds:0 act:3
16693 Replay: All jobs finished, all DS active.
16694 Main task has work to do, go find it
16695 got dsc Stop(1)
16696 stop 1
16697 Apr 20 01:08:36.231 INFO request completed, latency_us: 309, response_code:[8820] Got stop action so:false kr:false
16698 204, uri: /stop/cid/1, method: POST, req_id: 30bf9229-7f1e-48af-be30-d85acffe087d, remote_addr: 127.0.0.1:60352, local_addr: 127.0.0.1:9998
166992024-04-20T01:08:36.232ZWARNcrucible: downstairs disconnected = io task client = 1 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
167002024-04-20T01:08:36.232ZWARNcrucible: client task is sending Done(Finished) = io task client = 1 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
167012024-04-20T01:08:36.232ZWARNcrucible: downstairs task for 1 stopped due to Finished session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
167022024-04-20T01:08:36.232ZINFOcrucible: Gone missing, transition from Active to Offline = downstairs client = 1 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
167032024-04-20T01:08:36.232ZINFOcrucible: [1] client re-new 0 jobs since flush 4919 = downstairs session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
167042024-04-20T01:08:36.232ZINFOcrucible: [1] Marked 0 jobs for replay since flush: 4919 = downstairs session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
167052024-04-20T01:08:36.232ZINFOcrucible: client task is exiting = io task client = 1 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
16706 Apr 20 01:08:36.232 INFO request completed, latency_us: 159, response_code: 200, uri: /state/cid/1, method: GET, req_id: 176be754-1959-4fdd-b795-6b500c31d6f0, remote_addr: 127.0.0.1:60352, local_addr: 127.0.0.1:9998
16707 [8820] Exited with: ExitStatus(unix_wait_status(9))
16708 [8820][1] reports Exit
16709 Apr 20 01:08:40.234 INFO request completed, latency_us: 193, response_code: 200, uri: /state/cid/1, method: GET, req_id: dce8a133-2ef5-4880-8216-2616896253a7, remote_addr: 127.0.0.1:60352, local_addr: 127.0.0.1:9998
16710 001/300 Read block 725 len 24576
16711 002/300 Write block 296 len 20480 data: 4 3 3 3 4
16712 003/300 Read block 985 len 32768
16713 004/300 Read block 2114 len 36864
16714 005/300 Write block 1804 len 24576 data: 3 2 2 2 2 2
16715 006/300 Read block 417 len 24576
16716 007/300 Read block 1513 len 28672
16717 008/300 Flush
16718 009/300 Read block 964 len 32768
16719 010/300 Read block 139 len 12288
16720 011/300 Read block 2660 len 8192
16721 012/300 Write block 400 len 8192 data: 5 6
16722 013/300 Write block 2101 len 16384 data: 3 3 3 3
16723 014/300 Read block 1152 len 4096
16724 015/300 Write block 349 len 16384 data: 2 2 2 3
16725 016/300 Read block 1841 len 8192
16726 017/300 Read block 2778 len 16384
16727 018/300 Flush
16728 019/300 Read block 2164 len 32768
16729 020/300 Read block 2328 len 16384
16730 021/300 Read block 3026 len 40960
16731 022/300 Flush
16732 023/300 Read block 2068 len 24576
16733 024/300 Write block 3083 len 28672 data: 3 4 4 3 3 3 3
16734 025/300 Flush
16735 026/300 Flush
16736 027/300 Read block 1189 len 28672
16737 028/300 Read block 4714 len 32768
16738 029/300 Write block 3476 len 40960 data: 3 4 4 4 4 4 3 3 4 4
16739 030/300 Write block 1307 len 8192 data: 6 6
16740 031/300 Read block 1193 len 28672
16741 032/300 Write block 4516 len 28672 data: 3 4 5 5 6 7 7
16742 033/300 Read block 1091 len 40960
16743 034/300 Write block 1270 len 28672 data: 5 4 3 4 4 4 4
16744 035/300 Read block 884 len 36864
16745 036/300 Write block 2021 len 28672 data: 5 7 8 7 6 6 4
16746 037/300 Write block 1739 len 40960 data: 4 3 3 3 4 5 4 4 4 4
16747 038/300 Write block 2937 len 20480 data: 3 5 4 4 4
16748 039/300 Write block 2726 len 16384 data: 6 7 7 7
16749 040/300 Write block 1259 len 40960 data: 3 3 4 3 3 5 4 3 4 4
16750 041/300 Read block 3963 len 24576
16751 042/300 Flush
16752 043/300 Write block 942 len 40960 data: 2 2 2 2 2 3 3 3 3 4
16753 044/300 Read block 2897 len 12288
16754 045/300 Read block 3013 len 12288
16755 046/300 Read block 2400 len 24576
16756 047/300 Read block 143 len 12288
16757 048/300 Read block 4200 len 40960
16758 049/300 Read block 2337 len 20480
16759 050/300 Write block 4721 len 12288 data: 2 3 4
16760 051/300 Write block 4838 len 32768 data: 2 2 2 3 3 3 3 3
16761 052/300 Read block 4146 len 40960
16762 053/300 Write block 4753 len 32768 data: 3 3 4 4 4 3 3 3
16763 054/300 Flush
16764 055/300 Write block 3065 len 4096 data: 3
16765 056/300 Read block 1410 len 36864
16766 057/300 Write block 36 len 20480 data: 2 3 3 3 3
16767 058/300 Read block 4859 len 24576
16768 059/300 Write block 4407 len 28672 data: 4 4 4 4 5 5 6
16769 060/300 Write block 666 len 16384 data: 4 5 6 6
16770 061/300 Read block 3102 len 16384
16771 062/300 Write block 3799 len 16384 data: 3 3 3 3
16772 063/300 Read block 1942 len 36864
16773 064/300 Read block 599 len 24576
16774 065/300 Write block 2768 len 40960 data: 6 5 4 5 5 5 5 4 3 3
16775 066/300 Read block 215 len 32768
16776 067/300 Flush
16777 068/300 Write block 573 len 12288 data: 5 6 5
16778 069/300 Read block 3368 len 12288
16779 070/300 Read block 4969 len 32768
16780 071/300 Read block 1162 len 20480
16781 072/300 Read block 2855 len 12288
16782 073/300 Read block 2977 len 24576
16783 074/300 Read block 1032 len 16384
16784 075/300 Read block 3048 len 40960
16785 076/300 Read block 4841 len 8192
16786 077/300 Write block 1649 len 12288 data: 2 2 2
16787 078/300 Write block 244 len 20480 data: 5 8 6 5 5
16788 079/300 Read block 1004 len 8192
16789 080/300 Read block 4937 len 8192
16790 081/300 Read block 2967 len 36864
16791 082/300 Read block 2737 len 12288
16792 083/300 Write block 3077 len 4096 data: 3
16793 084/300 Read block 1072 len 36864
16794 085/300 Read block 499 len 32768
16795 086/300 Read block 4294 len 36864
16796 087/300 Read block 1102 len 24576
16797 088/300 Read block 3807 len 16384
16798 089/300 Read block 3907 len 32768
16799 090/300 Flush
16800 091/300 Write block 3428 len 20480 data: 4 5 5 6 8
16801 092/300 Flush
16802 093/300 Read block 4734 len 12288
16803 094/300 Read block 50 len 4096
16804 095/300 Read block 3199 len 8192
16805 096/300 Write block 3980 len 24576 data: 4 4 3 4 4 4
16806 097/300 Read block 3890 len 40960
16807 098/300 Write block 2225 len 32768 data: 3 4 4 4 5 4 3 3
16808 099/300 Write block 1198 len 24576 data: 3 5 4 3 3 3
16809 100/300 Read block 4251 len 40960
16810 101/300 Read block 2231 len 16384
16811 102/300 Write block 4969 len 4096 data: 3
16812 103/300 Flush
16813 104/300 Write block 771 len 8192 data: 6 6
16814 105/300 Read block 1072 len 24576
16815 106/300 Read block 790 len 8192
16816 107/300 Write block 1069 len 12288 data: 2 2 2
16817 108/300 Write block 1471 len 24576 data: 5 5 5 3 3 3
16818 109/300 Write block 4743 len 20480 data: 5 5 5 3 3
16819 110/300 Read block 3551 len 12288
16820 111/300 Write block 2439 len 20480 data: 4 3 3 2 2
16821 112/300 Write block 4768 len 8192 data: 3 4
16822 113/300 Read block 3922 len 8192
16823 114/300 Write block 4264 len 40960 data: 3 3 3 4 4 5 5 5 5 6
16824 115/300 Write block 290 len 40960 data: 2 2 2 2 2 4 5 4 4 4
16825 116/300 Write block 4212 len 20480 data: 2 2 2 3 3
16826 117/300 Read block 1062 len 24576
16827 118/300 Read block 2920 len 32768
16828 119/300 Write block 4371 len 20480 data: 3 3 3 4 4
16829 120/300 Read block 4003 len 16384
16830 121/300 Read block 180 len 28672
16831 122/300 Write block 793 len 20480 data: 2 2 2 3 4
16832 123/300 Write block 4430 len 32768 data: 5 5 5 3 2 2 2 2
16833 124/300 Write block 633 len 16384 data: 2 2 2 3
16834 125/300 Write block 2824 len 24576 data: 3 2 2 2 2 5
16835 126/300 Write block 3891 len 28672 data: 3 2 2 2 2 2 2
16836 127/300 Write block 1926 len 24576 data: 3 2 3 3 3 3
16837 128/300 Read block 3195 len 8192
16838 129/300 Read block 3039 len 20480
16839 130/300 Write block 4048 len 32768 data: 2 2 2 2 3 4 4 4
16840 131/300 Read block 1010 len 40960
16841 132/300 Read block 2360 len 24576
16842 133/300 Write block 669 len 40960 data: 7 5 5 4 6 6 5 4 4 3
16843 134/300 Write block 4651 len 12288 data: 2 2 2
16844 135/300 Read block 4634 len 28672
16845 136/300 Read block 4024 len 8192
16846 137/300 Read block 4343 len 24576
16847 138/300 Read block 4123 len 12288
16848 139/300 Write block 851 len 12288 data: 3 3 3
16849 140/300 Read block 256 len 24576
16850 141/300 Read block 424 len 12288
16851 142/300 Read block 3030 len 40960
16852 143/300 Read block 3617 len 12288
16853 144/300 Read block 3568 len 16384
16854 145/300 Read block 1085 len 24576
16855 146/300 Read block 4733 len 4096
16856 147/300 Write block 820 len 32768 data: 3 3 3 4 4 4 3 3
16857 148/300 Write block 1356 len 28672 data: 3 3 4 6 4 4 4
16858 149/300 Flush
16859 150/300 Write block 2509 len 36864 data: 4 7 7 7 4 4 5 5 6
16860 151/300 Read block 433 len 40960
16861 152/300 Write block 4387 len 28672 data: 3 3 2 2 2 2 2
16862 153/300 Read block 1366 len 4096
16863 154/300 Read block 2179 len 32768
16864 155/300 Read block 940 len 20480
16865 156/300 Read block 2801 len 40960
16866 157/300 Write block 1077 len 24576 data: 3 3 4 4 5 6
16867 158/300 Read block 3190 len 12288
16868 159/300 Read block 3810 len 32768
16869 160/300 Read block 34 len 28672
16870 161/300 Read block 3319 len 16384
16871 162/300 Read block 1750 len 36864
16872 163/300 Write block 1696 len 16384 data: 4 3 4 4
16873 164/300 Write block 1542 len 12288 data: 5 5 6
16874 165/300 Flush
16875 166/300 Write block 4129 len 12288 data: 6 3 3
16876 167/300 Write block 3195 len 40960 data: 5 5 4 5 5 6 6 7 4 4
16877 168/300 Write block 736 len 40960 data: 5 4 4 3 3 3 2 3 3 4
16878 169/300 Read block 1633 len 28672
16879 170/300 Flush
16880 171/300 Read block 4068 len 16384
16881 172/300 Read block 3758 len 40960
16882 173/300 Read block 1443 len 20480
16883 174/300 Write block 1832 len 36864 data: 5 5 4 5 4 3 3 3 3
16884 175/300 Flush
16885 176/300 Flush
16886 177/300 Write block 1465 len 20480 data: 4 4 3 4 4
16887 178/300 Write block 2952 len 4096 data: 2
16888 179/300 Write block 2636 len 24576 data: 2 3 3 3 3 5
16889 180/300 Write block 618 len 4096 data: 4
16890 181/300 Read block 2585 len 32768
16891 182/300 Read block 1812 len 12288
16892 183/300 Write block 1574 len 20480 data: 4 3 3 3 4
16893 184/300 Read block 1606 len 20480
16894 185/300 Read block 2744 len 8192
16895 186/300 Read block 3082 len 20480
16896 187/300 Write block 4520 len 8192 data: 7 8
16897 188/300 Write block 1938 len 20480 data: 2 2 3 3 2
16898 189/300 Read block 874 len 40960
16899 190/300 Read block 1745 len 4096
16900 191/300 Write block 3156 len 28672 data: 3 3 3 3 4 4 4
16901 192/300 Write block 1298 len 4096 data: 2
16902 193/300 Write block 2660 len 40960 data: 2 2 2 3 6 6 7 6 6 6
16903 194/300 Write block 2189 len 28672 data: 3 3 3 3 4 4 4
16904 195/300 Write block 628 len 4096 data: 3
16905 196/300 Write block 4180 len 40960 data: 3 3 4 3 2 2 2 2 2 2
16906 197/300 Read block 4922 len 36864
16907 198/300 Write block 4958 len 16384 data: 2 2 3 3
16908 199/300 Read block 633 len 32768
16909 200/300 Write block 887 len 12288 data: 3 4 4
16910 201/300 Read block 4569 len 4096
16911 202/300 Write block 4812 len 36864 data: 2 3 3 2 3 3 4 5 5
16912 203/300 Flush
16913 204/300 Read block 3428 len 12288
16914 205/300 Write block 1484 len 4096 data: 2
16915 206/300 Read block 1185 len 40960
16916 207/300 Read block 2494 len 16384
16917 208/300 Write block 4074 len 28672 data: 6 6 7 6 7 7 8
16918 209/300 Read block 2904 len 32768
16919 210/300 Write block 4182 len 4096 data: 5
16920 211/300 Write block 1324 len 40960 data: 2 2 2 2 2 2 2 2 2 3
16921 212/300 Read block 1355 len 40960
16922 213/300 Read block 2230 len 16384
16923 214/300 Read block 1510 len 12288
16924 215/300 Write block 3538 len 4096 data: 4
16925 216/300 Write block 3607 len 16384 data: 4 4 4 4
16926 217/300 Write block 981 len 4096 data: 3
16927 218/300 Write block 4107 len 40960 data: 3 3 3 3 3 4 5 5 5 5
16928 219/300 Write block 4381 len 24576 data: 5 4 3 3 4 4
16929 220/300 Write block 1519 len 12288 data: 7 6 5
16930 221/300 Read block 1667 len 32768
16931 222/300 Write block 1565 len 32768 data: 2 2 2 2 2 3 3 4
16932 223/300 Read block 3044 len 16384
16933 224/300 Write block 4442 len 40960 data: 2 4 6 6 7 6 6 4 5 4
16934 225/300 Flush
16935 226/300 Read block 3793 len 20480
16936 227/300 Write block 3787 len 16384 data: 5 5 6 5
16937 228/300 Write block 1527 len 20480 data: 3 3 4 5 5
16938 229/300 Write block 503 len 24576 data: 4 5 4 5 5 5
16939 230/300 Flush
16940 231/300 Read block 3594 len 36864
16941 232/300 Write block 4803 len 36864 data: 5 5 4 5 3 4 4 3 3
16942 233/300 Flush
16943 234/300 Read block 3919 len 12288
16944 235/300 Read block 2463 len 12288
16945 236/300 Read block 3281 len 40960
16946 237/300 Write block 211 len 8192 data: 3 2
16947 238/300 Flush
16948 239/300 Write block 4280 len 40960 data: 3 3 2 2 2 2 2 2 2 2
16949 240/300 Read block 4794 len 40960
16950 241/300 Read block 288 len 8192
16951 242/300 Read block 2179 len 32768
16952 243/300 Read block 544 len 8192
16953 244/300 Write block 2579 len 28672 data: 4 3 3 3 2 2 2
16954 245/300 Flush
16955 246/300 Read block 4955 len 16384
16956 247/300 Write block 1181 len 4096 data: 3
16957 248/300 Read block 1941 len 28672
16958 249/300 Read block 308 len 40960
16959 250/300 Read block 3387 len 4096
16960 251/300 Write block 2225 len 8192 data: 4 5
16961 252/300 Read block 367 len 4096
16962 253/300 Read block 464 len 36864
16963 254/300 Read block 4733 len 40960
16964 255/300 Write block 4633 len 28672 data: 3 3 3 3 3 2 2
16965 256/300 Read block 3341 len 28672
16966 257/300 Write block 1371 len 12288 data: 2 3 2
16967 258/300 Write block 729 len 36864 data: 7 6 5 4 5 5 5 6 5
16968 259/300 Read block 2239 len 24576
16969 260/300 Write block 1346 len 20480 data: 3 3 3 2 2
16970 261/300 Write block 2144 len 20480 data: 5 4 3 2 2
16971 262/300 Read block 184 len 28672
16972 263/300 Read block 3798 len 32768
16973 264/300 Read block 3888 len 4096
16974 265/300 Read block 2689 len 20480
16975 266/300 Write block 1009 len 20480 data: 2 2 3 2 3
16976 267/300 Read block 1233 len 8192
16977 268/300 Read block 2069 len 36864
16978 269/300 Read block 944 len 32768
16979 270/300 Write block 2007 len 8192 data: 6 6
16980 271/300 Read block 4822 len 24576
16981 272/300 Write block 1296 len 20480 data: 2 2 3 3 3
16982 273/300 Write block 515 len 8192 data: 4 6
16983 274/300 Flush
16984 275/300 Write block 1858 len 4096 data: 2
16985 276/300 Read block 840 len 8192
16986 277/300 Read block 4815 len 20480
16987 278/300 Read block 1345 len 12288
16988 279/300 Write block 1083 len 16384 data: 7 6 6 5
16989 280/300 Read block 2639 len 20480
16990 281/300 Flush
16991 282/300 Write block 4843 len 8192 data: 4 4
16992 283/300 Write block 1376 len 40960 data: 2 2 4 3 4 4 4 3 4 5
16993 284/300 Read block 29 len 8192
16994 285/300 Read block 4140 len 40960
16995 286/300 Read block 2761 len 16384
16996 287/300 Write block 1812 len 36864 data: 2 2 3 3 2 2 2 2 2
16997 288/300 Write block 4148 len 4096 data: 2
16998 289/300 Read block 496 len 40960
16999 290/300 Write block 644 len 24576 data: 4 5 4 5 3 3
17000 291/300 Read block 2293 len 20480
17001 292/300 Write block 3234 len 36864 data: 4 4 5 5 3 3 3 2 2
17002 293/300 Read block 1481 len 24576
17003 294/300 Read block 3429 len 40960
17004 295/300 Read block 3386 len 40960
17005 296/300 Read block 4873 len 20480
17006 297/300 Read block 2373 len 36864
17007 298/300 Flush
17008 299/300 Write block 2123 len 32768 data: 2 3 3 4 4 4 4 4
17009 300/300 Read block 2269 len 20480
17010 Main task has work to do, go find it
17011 got dsc Start(1)
17012 start 1
17013 Apr 20 01:08:40.546 INFO request completed, latency_us: 231, response_code: 204, uri: /start/cid/1, method: POST, req_id: 02e77a6e-ac10-4017-b2f6-dffa580077c6, remote_addr: 127.0.0.1:60352, local_addr: 127.0.0.1:9998
17014 Replay: started 1, returned:Ok(())
17015 ----------------------------------------------------------------
17016 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:301
17017 States: Active Offline Active
17018 GW_ID ACK DSID TYPE BLOCKS DS:0 DS:1 DS:2 REPLAY
17019 3921 Acked 4920 Read 6 Done New Done false
17020 3922 Acked 4921 Write 5 Done New Done false
17021 3923 Acked 4922 Read 8 Done New Done false
17022 3924 Acked 4923 Read 9 Done New Done false
17023 3925 Acked 4924 Write 6 Done New Done false
17024 3926 Acked 4925 Read 6 Done New Done false
17025 3927 Acked 4926 Read 7 Done New Done false
17026 3928 Acked 4927 Flush 0 Done New Done false
17027 3929 Acked 4928 Read 8 Done New Done false
17028 3930 Acked 4929 Read 3 Done New Done false
17029 3931 Acked 4930 Read 2 Done New Done false
17030 3932 Acked 4931 Write 2 Done New Done false
17031 3933 Acked 4932 Write 4 Done New Done false
17032 3934 Acked 4933 Read 1 Done New Done false
17033 3935 Acked 4934 Write 4 Done New Done false
17034 3936 Acked 4935 Read 2 Done New Done false
17035 3937 Acked 4936 Read 4 Done New Done false
17036 3938 Acked 4937 Flush 0 Done New Done false
17037 3939 Acked 4938 Read 8 Done New Done false
17038 3940 Acked 4939 Read 4 Done New Done false
17039 3941 Acked 4940 Read 10 Done New Done false
17040 3942 Acked 4941 Flush 0 Done New Done false
17041 3943 Acked 4942 Read 6 Done New Done false
17042 3944 Acked 4943 Write 7 Done New Done false
17043 3945 Acked 4944 Flush 0 Done New Done false
17044 3946 Acked 4945 Flush 0 Done New Done false
17045 3947 Acked 4946 Read 7 Done New Done false
17046 3948 Acked 4947 Read 8 Done New Done false
17047 3949 Acked 4948 Write 10 Done New Done false
17048 3950 Acked 4949 Write 2 Done New Done false
17049 3951 Acked 4950 Read 7 Done New Done false
17050 3952 Acked 4951 Write 7 Done New Done false
17051 3953 Acked 4952 Read 10 Done New Done false
17052 3954 Acked 4953 Write 7 Done New Done false
17053 3955 Acked 4954 Read 9 Done New Done false
17054 3956 Acked 4955 Write 7 Done New Done false
17055 3957 Acked 4956 Write 10 Done New Done false
17056 3958 Acked 4957 Write 5 Done New Done false
17057 3959 Acked 4958 Write 4 Done New Done false
17058 3960 Acked 4959 Write 10 Done New Done false
17059 3961 Acked 4960 Read 6 Done New Done false
17060 3962 Acked 4961 Flush 0 Done New Done false
17061 3963 Acked 4962 Write 10 Done New Done false
17062 3964 Acked 4963 Read 3 Done New Done false
17063 3965 Acked 4964 Read 3 Done New Done false
17064 3966 Acked 4965 Read 6 Done New Done false
17065 3967 Acked 4966 Read 3 Done New Done false
17066 3968 Acked 4967 Read 10 Done New Done false
17067 3969 Acked 4968 Read 5 Done New Done false
17068 3970 Acked 4969 Write 3 Done New Done false
17069 3971 Acked 4970 Write 8 Done New Done false
17070 3972 Acked 4971 Read 10 Done New Done false
17071 3973 Acked 4972 Write 8 Done New Done false
17072 3974 Acked 4973 Flush 0 Done New Done false
17073 3975 Acked 4974 Write 1 Done New Done false
17074 3976 Acked 4975 Read 9 Done New Done false
17075 3977 Acked 4976 Write 5 Done New Done false
17076 3978 Acked 4977 Read 6 Done New Done false
17077 3979 Acked 4978 Write 7 Done New Done false
17078 3980 Acked 4979 Write 4 Done New Done false
17079 3981 Acked 4980 Read 4 Done New Done false
17080 3982 Acked 4981 Write 4 Done New Done false
17081 3983 Acked 4982 Read 9 Done New Done false
17082 3984 Acked 4983 Read 6 Done New Done false
17083 3985 Acked 4984 Write 10 Done New Done false
17084 3986 Acked 4985 Read 8 Done New Done false
17085 3987 Acked 4986 Flush 0 Done New Done false
17086 3988 Acked 4987 Write 3 Done New Done false
17087 3989 Acked 4988 Read 3 Done New Done false
17088 3990 Acked 4989 Read 8 Done New Done false
17089 3991 Acked 4990 Read 5 Done New Done false
17090 3992 Acked 4991 Read 3 Done New Done false
17091 3993 Acked 4992 Read 6 Done New Done false
17092 3994 Acked 4993 Read 4 Done New Done false
17093 3995 Acked 4994 Read 10 Done New Done false
17094 3996 Acked 4995 Read 2 Done New Done false
17095 3997 Acked 4996 Write 3 Done New Done false
17096 3998 Acked 4997 Write 5 Done New Done false
17097 3999 Acked 4998 Read 2 Done New Done false
17098 4000 Acked 4999 Read 2 Done New Done false
17099 4001 Acked 5000 Read 9 Done New Done false
17100 4002 Acked 5001 Read 3 Done New Done false
17101 4003 Acked 5002 Write 1 Done New Done false
17102 4004 Acked 5003 Read 9 Done New Done false
17103 4005 Acked 5004 Read 8 Done New Done false
17104 4006 Acked 5005 Read 9 Done New Done false
17105 4007 Acked 5006 Read 6 Done New Done false
17106 4008 Acked 5007 Read 4 Done New Done false
17107 4009 Acked 5008 Read 8 Done New Done false
17108 4010 Acked 5009 Flush 0 Done New Done false
17109 4011 Acked 5010 Write 5 Done New Done false
17110 4012 Acked 5011 Flush 0 Done New Done false
17111 4013 Acked 5012 Read 3 Done New Done false
17112 4014 Acked 5013 Read 1 Done New Done false
17113 4015 Acked 5014 Read 2 Done New Done false
17114 4016 Acked 5015 Write 6 Done New Done false
17115 4017 Acked 5016 Read 10 Done New Done false
17116 4018 Acked 5017 Write 8 Done New Done false
17117 4019 Acked 5018 Write 6 Done New Done false
17118 4020 Acked 5019 Read 10 Done New Done false
17119 4021 Acked 5020 Read 4 Done New Done false
17120 4022 Acked 5021 Write 1 Done New Done false
17121 4023 Acked 5022 Flush 0 Done New Done false
17122 4024 Acked 5023 Write 2 Done New Done false
17123 4025 Acked 5024 Read 6 Done New Done false
17124 4026 Acked 5025 Read 2 Done New Done false
17125 4027 Acked 5026 Write 3 Done New Done false
17126 4028 Acked 5027 Write 6 Done New Done false
17127 4029 Acked 5028 Write 5 Done New Done false
17128 4030 Acked 5029 Read 3 Done New Done false
17129 4031 Acked 5030 Write 5 Done New Done false
17130 4032 Acked 5031 Write 2 Done New Done false
17131 4033 Acked 5032 Read 2 Done New Done false
17132 4034 Acked 5033 Write 10 Done New Done false
17133 4035 Acked 5034 Write 10 Done New Done false
17134 4036 Acked 5035 Write 5 Done New Done false
17135 4037 Acked 5036 Read 6 Done New Done false
17136 4038 Acked 5037 Read 8 Done New Done false
17137 4039 Acked 5038 Write 5 Done New Done false
17138 4040 Acked 5039 Read 4 Done New Done false
17139 4041 Acked 5040 Read 7 Done New Done false
17140 4042 Acked 5041 Write 5 Done New Done false
17141 4043 Acked 5042 Write 8 Done New Done false
17142 4044 Acked 5043 Write 4 Done New Done false
17143 4045 Acked 5044 Write 6 Done New Done false
17144 4046 Acked 5045 Write 7 Done New Done false
17145 4047 Acked 5046 Write 6 Done New Done false
17146 4048 Acked 5047 Read 2 Done New Done false
17147 4049 Acked 5048 Read 5 Done New Done false
17148 4050 Acked 5049 Write 8 Done New Done false
17149 4051 Acked 5050 Read 10 Done New Done false
17150 4052 Acked 5051 Read 6 Done New Done false
17151 4053 Acked 5052 Write 10 Done New Done false
17152 4054 Acked 5053 Write 3 Done New Done false
17153 4055 Acked 5054 Read 7 Done New Done false
17154 4056 Acked 5055 Read 2 Done New Done false
17155 4057 Acked 5056 Read 6 Done New Done false
17156 4058 Acked 5057 Read 3 Done New Done false
17157 4059 Acked 5058 Write 3 Done New Done false
17158 4060 Acked 5059 Read 6 Done New Done false
17159 4061 Acked 5060 Read 3 Done New Done false
17160 4062 Acked 5061 Read 10 Done New Done false
17161 4063 Acked 5062 Read 3 Done New Done false
17162 4064 Acked 5063 Read 4 Done New Done false
17163 4065 Acked 5064 Read 6 Done New Done false
17164 4066 Acked 5065 Read 1 Done New Done false
17165 4067 Acked 5066 Write 8 Done New Done false
17166 4068 Acked 5067 Write 7 Done New Done false
17167 4069 Acked 5068 Flush 0 Done New Done false
17168 4070 Acked 5069 Write 9 Done New Done false
17169 4071 Acked 5070 Read 10 Done New Done false
17170 4072 Acked 5071 Write 7 Done New Done false
17171 4073 Acked 5072 Read 1 Done New Done false
17172 4074 Acked 5073 Read 8 Done New Done false
17173 4075 Acked 5074 Read 5 Done New Done false
17174 4076 Acked 5075 Read 10 Done New Done false
17175 4077 Acked 5076 Write 6 Done New Done false
17176 4078 Acked 5077 Read 3 Done New Done false
17177 4079 Acked 5078 Read 8 Done New Done false
17178 4080 Acked 5079 Read 7 Done New Done false
17179 4081 Acked 5080 Read 4 Done New Done false
17180 4082 Acked 5081 Read 9 Done New Done false
17181 4083 Acked 5082 Write 4 Done New Done false
17182 4084 Acked 5083 Write 3 Done New Done false
17183 4085 Acked 5084 Flush 0 Done New Done false
17184 4086 Acked 5085 Write 3 Done New Done false
17185 4087 Acked 5086 Write 10 Done New Done false
17186 4088 Acked 5087 Write 10 Done New Done false
17187 4089 Acked 5088 Read 7 Done New Done false
17188 4090 Acked 5089 Flush 0 Done New Done false
17189 4091 Acked 5090 Read 4 Done New Done false
17190 4092 Acked 5091 Read 10 Done New Done false
17191 4093 Acked 5092 Read 5 Done New Done false
17192 4094 Acked 5093 Write 9 Done New Done false
17193 4095 Acked 5094 Flush 0 Done New Done false
17194 4096 Acked 5095 Flush 0 Done New Done false
17195 4097 Acked 5096 Write 5 Done New Done false
17196 4098 Acked 5097 Write 1 Done New Done false
17197 4099 Acked 5098 Write 6 Done New Done false
17198 4100 Acked 5099 Write 1 Done New Done false
17199 4101 Acked 5100 Read 8 Done New Done false
17200 4102 Acked 5101 Read 3 Done New Done false
17201 4103 Acked 5102 Write 5 Done New Done false
17202 4104 Acked 5103 Read 5 Done New Done false
17203 4105 Acked 5104 Flush 0 Done New Done false
17204 4106 Acked 5105 Read 2 Done New Done false
17205 4107 Acked 5106 Read 5 Done New Done false
17206 4108 Acked 5107 Write 2 Done New Done false
17207 4109 Acked 5108 Write 5 Done New Done false
17208 4110 Acked 5109 Read 10 Done New Done false
17209 4111 Acked 5110 Read 1 Done New Done false
17210 4112 Acked 5111 Write 7 Done New Done false
17211 4113 Acked 5112 Write 1 Done New Done false
17212 4114 Acked 5113 Write 10 Done New Done false
17213 4115 Acked 5114 Write 7 Done New Done false
17214 4116 Acked 5115 Write 1 Done New Done false
17215 4117 Acked 5116 Write 10 Done New Done false
17216 4118 Acked 5117 Read 9 Done New Done false
17217 4119 Acked 5118 Write 4 Done New Done false
17218 4120 Acked 5119 Read 8 Done New Done false
17219 4121 Acked 5120 Write 3 Done New Done false
17220 4122 Acked 5121 Read 1 Done New Done false
17221 4123 Acked 5122 Write 9 Done New Done false
17222 4124 Acked 5123 Flush 0 Done New Done false
17223 4125 Acked 5124 Read 3 Done New Done false
17224 4126 Acked 5125 Write 1 Done New Done false
17225 4127 Acked 5126 Read 10 Done New Done false
17226 4128 Acked 5127 Read 4 Done New Done false
17227 4129 Acked 5128 Write 7 Done New Done false
17228 4130 Acked 5129 Read 8 Done New Done false
17229 4131 Acked 5130 Write 1 Done New Done false
17230 4132 Acked 5131 Write 10 Done New Done false
17231 4133 Acked 5132 Read 10 Done New Done false
17232 4134 Acked 5133 Read 4 Done New Done false
17233 4135 Acked 5134 Read 3 Done New Done false
17234 4136 Acked 5135 Write 1 Done New Done false
17235 4137 Acked 5136 Write 4 Done New Done false
17236 4138 Acked 5137 Write 1 Done New Done false
17237 4139 Acked 5138 Write 10 Done New Done false
17238 4140 Acked 5139 Write 6 Done New Done false
17239 4141 Acked 5140 Write 3 Done New Done false
17240 4142 Acked 5141 Read 8 Done New Done false
17241 4143 Acked 5142 Write 8 Done New Done false
17242 4144 Acked 5143 Read 4 Done New Done false
17243 4145 Acked 5144 Write 10 Done New Done false
17244 4146 Acked 5145 Flush 0 Done New Done false
17245 4147 Acked 5146 Read 5 Done New Done false
17246 4148 Acked 5147 Write 4 Done New Done false
17247 4149 Acked 5148 Write 5 Done New Done false
17248 4150 Acked 5149 Write 6 Done New Done false
17249 4151 Acked 5150 Flush 0 Done New Done false
17250 4152 Acked 5151 Read 9 Done New Done false
17251 4153 Acked 5152 Write 9 Done New Done false
17252 4154 Acked 5153 Flush 0 Done New Done false
17253 4155 Acked 5154 Read 3 Done New Done false
17254 4156 Acked 5155 Read 3 Done New Done false
17255 4157 Acked 5156 Read 10 Done New Done false
17256 4158 Acked 5157 Write 2 Done New Done false
17257 4159 Acked 5158 Flush 0 Done New Done false
17258 4160 Acked 5159 Write 10 Done New Done false
17259 4161 Acked 5160 Read 10 Done New Done false
17260 4162 Acked 5161 Read 2 Done New Done false
17261 4163 Acked 5162 Read 8 Done New Done false
17262 4164 Acked 5163 Read 2 Done New Done false
17263 4165 Acked 5164 Write 7 Done New Done false
17264 4166 Acked 5165 Flush 0 Done New Done false
17265 4167 Acked 5166 Read 4 Done New Done false
17266 4168 Acked 5167 Write 1 Done New Done false
17267 4169 Acked 5168 Read 7 Done New Done false
17268 4170 Acked 5169 Read 10 Done New Done false
17269 4171 Acked 5170 Read 1 Done New Done false
17270 4172 Acked 5171 Write 2 Done New Done false
17271 4173 Acked 5172 Read 1 Done New Done false
17272 4174 Acked 5173 Read 9 Done New Done false
17273 4175 Acked 5174 Read 10 Done New Done false
17274 4176 Acked 5175 Write 7 Done New Done false
17275 4177 Acked 5176 Read 7 Done New Done false
17276 4178 Acked 5177 Write 3 Done New Done false
17277 4179 Acked 5178 Write 9 Done New Done false
17278 4180 Acked 5179 Read 6 Done New Done false
17279 4181 Acked 5180 Write 5 Done New Done false
17280 4182 Acked 5181 Write 5 Done New Done false
17281 4183 Acked 5182 Read 7 Done New Done false
17282 4184 Acked 5183 Read 8 Done New Done false
17283 4185 Acked 5184 Read 1 Done New Done false
17284 4186 Acked 5185 Read 5 Done New Done false
17285 4187 Acked 5186 Write 5 Done New Done false
17286 4188 Acked 5187 Read 2 Done New Done false
17287 4189 Acked 5188 Read 9 Done New Done false
17288 4190 Acked 5189 Read 8 Done New Done false
17289 4191 Acked 5190 Write 2 Done New Done false
17290 4192 Acked 5191 Read 6 Done New Done false
17291 4193 Acked 5192 Write 5 Done New Done false
17292 4194 Acked 5193 Write 2 Done New Done false
17293 4195 Acked 5194 Flush 0 Done New Done false
17294 4196 Acked 5195 Write 1 Done New Done false
17295 4197 Acked 5196 Read 2 Done New Done false
17296 4198 Acked 5197 Read 5 Done New Done false
17297 4199 Acked 5198 Read 3 Done New Done false
17298 4200 Acked 5199 Write 4 Done New Done false
17299 4201 Acked 5200 Read 5 Done New Done false
17300 4202 Acked 5201 Flush 0 Done New Done false
17301 4203 Acked 5202 Write 2 Done New Done false
17302 4204 Acked 5203 Write 10 Done New Done false
17303 4205 Acked 5204 Read 2 Done New Done false
17304 4206 Acked 5205 Read 10 Done New Done false
17305 4207 Acked 5206 Read 4 Done New Done false
17306 4208 Acked 5207 Write 9 Done New Done false
17307 4209 Acked 5208 Write 1 Done New Done false
17308 4210 Acked 5209 Read 10 Done New Done false
17309 4211 Acked 5210 Write 6 Done New Done false
17310 4212 Acked 5211 Read 5 Done New Done false
17311 4213 Acked 5212 Write 9 Done New Done false
17312 4214 Acked 5213 Read 6 Done New Done false
17313 4215 Acked 5214 Read 10 Done New Done false
17314 4216 Acked 5215 Read 10 Done New Done false
17315 4217 Acked 5216 Read 5 Done New Done false
17316 4218 Acked 5217 Read 9 Done New Done false
17317 4219 Acked 5218 Flush 0 Done New Done false
17318 4220 Acked 5219 Write 8 Done New Done false
17319 4221 Acked 5220 Read 5 Done New Done false
17320 STATES DS:0 DS:1 DS:2 TOTAL
17321 New 0 301 0 301
17322 Sent 0 0 0 0
17323 Done 301 0 301 602
17324 Skipped 0 0 0 0
17325 Error 0 0 0 0
17326 Last Flush: 5218 4919 5218
17327 Downstairs last five completed: 4919 4918 4917 4916 4915
17328 Upstairs last five completed: 4221 4220 4219 4218 4217
17329 CLIENT: Up:0 ds:301 act:2
17330 ----------------------------------------------------------------
17331 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:302
17332 States: Active Offline Active
17333 GW_ID ACK DSID TYPE BLOCKS DS:0 DS:1 DS:2 REPLAY
17334 3921 Acked 4920 Read 6 Done New Done false
17335 3922 Acked 4921 Write 5 Done New Done false
17336 3923 Acked 4922 Read 8 Done New Done false
17337 3924 Acked 4923 Read 9 Done New Done false
17338 3925 Acked 4924 Write 6 Done New Done false
17339 3926 Acked 4925 Read 6 Done New Done false
17340 3927 Acked 4926 Read 7 Done New Done false
17341 3928 Acked 4927 Flush 0 Done New Done false
17342 3929 Acked 4928 Read 8 Done New Done false
17343 3930 Acked 4929 Read 3 Done New Done false
17344 3931 Acked 4930 Read 2 Done New Done false
17345 3932 Acked 4931 Write 2 Done New Done false
17346 3933 Acked 4932 Write 4 Done New Done false
17347 3934 Acked 4933 Read 1 Done New Done false
17348 3935 Acked 4934 Write 4 Done New Done false
17349 3936 Acked 4935 Read 2 Done New Done false
17350 3937 Acked 4936 Read 4 Done New Done false
17351 3938 Acked 4937 Flush 0 Done New Done false
17352 3939 Acked 4938 Read 8 Done New Done false
17353 3940 Acked 4939 Read 4 Done New Done false
17354 3941 Acked 4940 Read 10 Done New Done false
17355 3942 Acked 4941 Flush 0 Done New Done false
17356 3943 Acked 4942 Read 6 Done New Done false
17357 3944 Acked 4943 Write 7 Done New Done false
17358 3945 Acked 4944 Flush 0 Done New Done false
17359 3946 Acked 4945 Flush 0 Done New Done false
17360 3947 Acked 4946 Read 7 Done New Done false
17361 3948 Acked 4947 Read 8 Done New Done false
17362 3949 Acked 4948 Write 10 Done New Done false
17363 3950 Acked 4949 Write 2 Done New Done false
17364 3951 Acked 4950 Read 7 Done New Done false
17365 3952 Acked 4951 Write 7 Done New Done false
17366 3953 Acked 4952 Read 10 Done New Done false
17367 3954 Acked 4953 Write 7 Done New Done false
17368 3955 Acked 4954 Read 9 Done New Done false
17369 3956 Acked 4955 Write 7 Done New Done false
17370 3957 Acked 4956 Write 10 Done New Done false
17371 3958 Acked 4957 Write 5 Done New Done false
17372 3959 Acked 4958 Write 4 Done New Done false
17373 3960 Acked 4959 Write 10 Done New Done false
17374 3961 Acked 4960 Read 6 Done New Done false
17375 3962 Acked 4961 Flush 0 Done New Done false
17376 3963 Acked 4962 Write 10 Done New Done false
17377 3964 Acked 4963 Read 3 Done New Done false
17378 3965 Acked 4964 Read 3 Done New Done false
17379 3966 Acked 4965 Read 6 Done New Done false
17380 3967 Acked 4966 Read 3 Done New Done false
17381 3968 Acked 4967 Read 10 Done New Done false
17382 3969 Acked 4968 Read 5 Done New Done false
17383 3970 Acked 4969 Write 3 Done New Done false
17384 3971 Acked 4970 Write 8 Done New Done false
17385 3972 Acked 4971 Read 10 Done New Done false
17386 3973 Acked 4972 Write 8 Done New Done false
17387 3974 Acked 4973 Flush 0 Done New Done false
17388 3975 Acked 4974 Write 1 Done New Done false
17389 3976 Acked 4975 Read 9 Done New Done false
17390 3977 Acked 4976 Write 5 Done New Done false
17391 3978 Acked 4977 Read 6 Done New Done false
17392 3979 Acked 4978 Write 7 Done New Done false
17393 3980 Acked 4979 Write 4 Done New Done false
17394 3981 Acked 4980 Read 4 Done New Done false
17395 3982 Acked 4981 Write 4 Done New Done false
17396 3983 Acked 4982 Read 9 Done New Done false
17397 3984 Acked 4983 Read 6 Done New Done false
17398 3985 Acked 4984 Write 10 Done New Done false
17399 3986 Acked 4985 Read 8 Done New Done false
17400 3987 Acked 4986 Flush 0 Done New Done false
17401 3988 Acked 4987 Write 3 Done New Done false
17402 3989 Acked 4988 Read 3 Done New Done false
17403 3990 Acked 4989 Read 8 Done New Done false
17404 3991 Acked 4990 Read 5 Done New Done false
17405 3992 Acked 4991 Read 3 Done New Done false
17406 3993 Acked 4992 Read 6 Done New Done false
17407 3994 Acked 4993 Read 4 Done New Done false
17408 3995 Acked 4994 Read 10 Done New Done false
17409 3996 Acked 4995 Read 2 Done New Done false
17410 3997 Acked 4996 Write 3 Done New Done false
17411 3998 Acked 4997 Write 5 Done New Done false
17412 3999 Acked 4998 Read 2 Done New Done false
17413 4000 Acked 4999 Read 2 Done New Done false
17414 4001 Acked 5000 Read 9 Done New Done false
17415 4002 Acked 5001 Read 3 Done New Done false
17416 4003 Acked 5002 Write 1 Done New Done false
17417 4004 Acked 5003 Read 9 Done New Done false
17418 4005 Acked 5004 Read 8 Done New Done false
17419 4006 Acked 5005 Read 9 Done New Done false
17420 4007 Acked 5006 Read 6 Done New Done false
17421 4008 Acked 5007 Read 4 Done New Done false
17422 4009 Acked 5008 Read 8 Done New Done false
17423 4010 Acked 5009 Flush 0 Done New Done false
17424 4011 Acked 5010 Write 5 Done New Done false
17425 4012 Acked 5011 Flush 0 Done New Done false
17426 4013 Acked 5012 Read 3 Done New Done false
17427 4014 Acked 5013 Read 1 Done New Done false
17428 4015 Acked 5014 Read 2 Done New Done false
17429 4016 Acked 5015 Write 6 Done New Done false
17430 4017 Acked 5016 Read 10 Done New Done false
17431 4018 Acked 5017 Write 8 Done New Done false
17432 4019 Acked 5018 Write 6 Done New Done false
17433 4020 Acked 5019 Read 10 Done New Done false
17434 4021 Acked 5020 Read 4 Done New Done false
17435 4022 Acked 5021 Write 1 Done New Done false
17436 4023 Acked 5022 Flush 0 Done New Done false
17437 4024 Acked 5023 Write 2 Done New Done false
17438 4025 Acked 5024 Read 6 Done New Done false
17439 4026 Acked 5025 Read 2 Done New Done false
17440 4027 Acked 5026 Write 3 Done New Done false
17441 4028 Acked 5027 Write 6 Done New Done false
17442 4029 Acked 5028 Write 5 Done New Done false
17443 4030 Acked 5029 Read 3 Done New Done false
17444 4031 Acked 5030 Write 5 Done New Done false
17445 4032 Acked 5031 Write 2 Done New Done false
17446 4033 Acked 5032 Read 2 Done New Done false
17447 4034 Acked 5033 Write 10 Done New Done false
17448 4035 Acked 5034 Write 10 Done New Done false
17449 4036 Acked 5035 Write 5 Done New Done false
17450 4037 Acked 5036 Read 6 Done New Done false
17451 4038 Acked 5037 Read 8 Done New Done false
17452 4039 Acked 5038 Write 5 Done New Done false
17453 4040 Acked 5039 Read 4 Done New Done false
17454 4041 Acked 5040 Read 7 Done New Done false
17455 4042 Acked 5041 Write 5 Done New Done false
17456 4043 Acked 5042 Write 8 Done New Done false
17457 4044 Acked 5043 Write 4 Done New Done false
17458 4045 Acked 5044 Write 6 Done New Done false
17459 4046 Acked 5045 Write 7 Done New Done false
17460 4047 Acked 5046 Write 6 Done New Done false
17461 4048 Acked 5047 Read 2 Done New Done false
17462 4049 Acked 5048 Read 5 Done New Done false
17463 4050 Acked 5049 Write 8 Done New Done false
17464 4051 Acked 5050 Read 10 Done New Done false
17465 4052 Acked 5051 Read 6 Done New Done false
17466 4053 Acked 5052 Write 10 Done New Done false
17467 4054 Acked 5053 Write 3 Done New Done false
17468 4055 Acked 5054 Read 7 Done New Done false
17469 4056 Acked 5055 Read 2 Done New Done false
17470 4057 Acked 5056 Read 6 Done New Done false
17471 4058 Acked 5057 Read 3 Done New Done false
17472 4059 Acked 5058 Write 3 Done New Done false
17473 4060 Acked 5059 Read 6 Done New Done false
17474 4061 Acked 5060 Read 3 Done New Done false
17475 4062 Acked 5061 Read 10 Done New Done false
17476 4063 Acked 5062 Read 3 Done New Done false
17477 4064 Acked 5063 Read 4 Done New Done false
17478 4065 Acked 5064 Read 6 Done New Done false
17479 4066 Acked 5065 Read 1 Done New Done false
17480 4067 Acked 5066 Write 8 Done New Done false
17481 4068 Acked 5067 Write 7 Done New Done false
17482 4069 Acked 5068 Flush 0 Done New Done false
17483 4070 Acked 5069 Write 9 Done New Done false
17484 4071 Acked 5070 Read 10 Done New Done false
17485 4072 Acked 5071 Write 7 Done New Done false
17486 4073 Acked 5072 Read 1 Done New Done false
17487 4074 Acked 5073 Read 8 Done New Done false
17488 4075 Acked 5074 Read 5 Done New Done false
17489 4076 Acked 5075 Read 10 Done New Done false
17490 4077 Acked 5076 Write 6 Done New Done false
17491 4078 Acked 5077 Read 3 Done New Done false
17492 4079 Acked 5078 Read 8 Done New Done false
17493 4080 Acked 5079 Read 7 Done New Done false
17494 4081 Acked 5080 Read 4 Done New Done false
17495 4082 Acked 5081 Read 9 Done New Done false
17496 4083 Acked 5082 Write 4 Done New Done false
17497 4084 Acked 5083 Write 3 Done New Done false
17498 4085 Acked 5084 Flush 0 Done New Done false
17499 4086 Acked 5085 Write 3 Done New Done false
17500 4087 Acked 5086 Write 10 Done New Done false
17501 4088 Acked 5087 Write 10 Done New Done false
17502 4089 Acked 5088 Read 7 Done New Done false
17503 4090 Acked 5089 Flush 0 Done New Done false
17504 4091 Acked 5090 Read 4 Done New Done false
17505 4092 Acked 5091 Read 10 Done New Done false
17506 4093 Acked 5092 Read 5 Done New Done false
17507 4094 Acked 5093 Write 9 Done New Done false
17508 4095 Acked 5094 Flush 0 Done New Done false
17509 4096 Acked 5095 Flush 0 Done New Done false
17510 4097 Acked 5096 Write 5 Done New Done false
17511 4098 Acked 5097 Write 1 Done New Done false
17512 4099 Acked 5098 Write 6 Done New Done false
17513 4100 Acked 5099 Write 1 Done New Done false
17514 4101 Acked 5100 Read 8 Done New Done false
17515 4102 Acked 5101 Read 3 Done New Done false
17516 4103 Acked 5102 Write 5 Done New Done false
17517 4104 Acked 5103 Read 5 Done New Done false
17518 4105 Acked 5104 Flush 0 Done New Done false
17519 4106 Acked 5105 Read 2 Done New Done false
17520 4107 Acked 5106 Read 5 Done New Done false
17521 4108 Acked 5107 Write 2 Done New Done false
17522 4109 Acked 5108 Write 5 Done New Done false
17523 4110 Acked 5109 Read 10 Done New Done false
17524 4111 Acked 5110 Read 1 Done New Done false
17525 4112 Acked 5111 Write 7 Done New Done false
17526 4113 Acked 5112 Write 1 Done New Done false
17527 4114 Acked 5113 Write 10 Done New Done false
17528 4115 Acked 5114 Write 7 Done New Done false
17529 4116 Acked 5115 Write 1 Done New Done false
17530 4117 Acked 5116 Write 10 Done New Done false
17531 4118 Acked 5117 Read 9 Done New Done false
17532 4119 Acked 5118 Write 4 Done New Done false
17533 4120 Acked 5119 Read 8 Done New Done false
17534 4121 Acked 5120 Write 3 Done New Done false
17535 4122 Acked 5121 Read 1 Done New Done false
17536 4123 Acked 5122 Write 9 Done New Done false
17537 4124 Acked 5123 Flush 0 Done New Done false
17538 4125 Acked 5124 Read 3 Done New Done false
17539 4126 Acked 5125 Write 1 Done New Done false
17540 4127 Acked 5126 Read 10 Done New Done false
17541 4128 Acked 5127 Read 4 Done New Done false
17542 4129 Acked 5128 Write 7 Done New Done false
17543 4130 Acked 5129 Read 8 Done New Done false
17544 4131 Acked 5130 Write 1 Done New Done false
17545 4132 Acked 5131 Write 10 Done New Done false
17546 4133 Acked 5132 Read 10 Done New Done false
17547 4134 Acked 5133 Read 4 Done New Done false
17548 4135 Acked 5134 Read 3 Done New Done false
17549 4136 Acked 5135 Write 1 Done New Done false
17550 4137 Acked 5136 Write 4 Done New Done false
17551 4138 Acked 5137 Write 1 Done New Done false
17552 4139 Acked 5138 Write 10 Done New Done false
17553 4140 Acked 5139 Write 6 Done New Done false
17554 4141 Acked 5140 Write 3 Done New Done false
17555 4142 Acked 5141 Read 8 Done New Done false
17556 4143 Acked 5142 Write 8 Done New Done false
17557 4144 Acked 5143 Read 4 Done New Done false
17558 4145 Acked 5144 Write 10 Done New Done false
17559 4146 Acked 5145 Flush 0 Done New Done false
17560 4147 Acked 5146 Read 5 Done New Done false
17561 4148 Acked 5147 Write 4 Done New Done false
17562 4149 Acked 5148 Write 5 Done New Done false
17563 4150 Acked 5149 Write 6 Done New Done false
17564 4151 Acked 5150 Flush 0 Done New Done false
17565 4152 Acked 5151 Read 9 Done New Done false
17566 4153 Acked 5152 Write 9 Done New Done false
17567 4154 Acked 5153 Flush 0 Done New Done false
17568 4155 Acked 5154 Read 3 Done New Done false
17569 4156 Acked 5155 Read 3 Done New Done false
17570 4157 Acked 5156 Read 10 Done New Done false
17571 4158 Acked 5157 Write 2 Done New Done false
17572 4159 Acked 5158 Flush 0 Done New Done false
17573 4160 Acked 5159 Write 10 Done New Done false
17574 4161 Acked 5160 Read 10 Done New Done false
17575 4162 Acked 5161 Read 2 Done New Done false
17576 4163 Acked 5162 Read 8 Done New Done false
17577 4164 Acked 5163 Read 2 Done New Done false
17578 4165 Acked 5164 Write 7 Done New Done false
17579 4166 Acked 5165 Flush 0 Done New Done false
17580 4167 Acked 5166 Read 4 Done New Done false
17581 4168 Acked 5167 Write 1 Done New Done false
17582 4169 Acked 5168 Read 7 Done New Done false
17583 4170 Acked 5169 Read 10 Done New Done false
17584 4171 Acked 5170 Read 1 Done New Done false
17585 4172 Acked 5171 Write 2 Done New Done false
17586 4173 Acked 5172 Read 1 Done New Done false
17587 4174 Acked 5173 Read 9 Done New Done false
17588 4175 Acked 5174 Read 10 Done New Done false
17589 4176 Acked 5175 Write 7 Done New Done false
17590 4177 Acked 5176 Read 7 Done New Done false
17591 4178 Acked 5177 Write 3 Done New Done false
17592 4179 Acked 5178 Write 9 Done New Done false
17593 4180 Acked 5179 Read 6 Done New Done false
17594 4181 Acked 5180 Write 5 Done New Done false
17595 4182 Acked 5181 Write 5 Done New Done false
17596 4183 Acked 5182 Read 7 Done New Done false
17597 4184 Acked 5183 Read 8 Done New Done false
17598 4185 Acked 5184 Read 1 Done New Done false
17599 4186 Acked 5185 Read 5 Done New Done false
17600 4187 Acked 5186 Write 5 Done New Done false
17601 4188 Acked 5187 Read 2 Done New Done false
17602 4189 Acked 5188 Read 9 Done New Done false
17603 4190 Acked 5189 Read 8 Done New Done false
17604 4191 Acked 5190 Write 2 Done New Done false
17605 4192 Acked 5191 Read 6 Done New Done false
17606 4193 Acked 5192 Write 5 Done New Done false
17607 4194 Acked 5193 Write 2 Done New Done false
17608 4195 Acked 5194 Flush 0 Done New Done false
17609 4196 Acked 5195 Write 1 Done New Done false
17610 4197 Acked 5196 Read 2 Done New Done false
17611 4198 Acked 5197 Read 5 Done New Done false
17612 4199 Acked 5198 Read 3 Done New Done false
17613 4200 Acked 5199 Write 4 Done New Done false
17614 4201 Acked 5200 Read 5 Done New Done false
17615 4202 Acked 5201 Flush 0 Done New Done false
17616 4203 Acked 5202 Write 2 Done New Done false
17617 4204 Acked 5203 Write 10 Done New Done false
17618 4205 Acked 5204 Read 2 Done New Done false
17619 4206 Acked 5205 Read 10 Done New Done false
17620 4207 Acked 5206 Read 4 Done New Done false
17621 4208 Acked 5207 Write 9 Done New Done false
17622 4209 Acked 5208 Write 1 Done New Done false
17623 4210 Acked 5209 Read 10 Done New Done false
17624 4211 Acked 5210 Write 6 Done New Done false
17625 4212 Acked 5211 Read 5 Done New Done false
17626 4213 Acked 5212 Write 9 Done New Done false
17627 4214 Acked 5213 Read 6 Done New Done false
17628 4215 Acked 5214 Read 10 Done New Done false
17629 4216 Acked 5215 Read 10 Done New Done false
17630 4217 Acked 5216 Read 5 Done New Done false
17631 4218 Acked 5217 Read 9 Done New Done false
17632 4219 Acked 5218 Flush 0 Done New Done false
17633 4220 Acked 5219 Write 8 Done New Done false
17634 4221 Acked 5220 Read 5 Done New Done false
17635 4222 Acked 5221 Flush 0 Done New Done false
17636 STATES DS:0 DS:1 DS:2 TOTAL
17637 New 0 302 0 302
17638 Sent 0 0 0 0
17639 Done 302 0 302 604
17640 Skipped 0 0 0 0
17641 Error 0 0 0 0
17642 Last Flush: 5221 4919 5221
17643 Downstairs last five completed: 4919 4918 4917 4916 4915
17644 Upstairs last five completed: 4222 4221 4220 4219 4218
17645 CLIENT: Up:0 ds:302 act:2
176462024-04-20T01:08:46.233ZINFOcrucible: connecting to 127.0.0.1:8820 = io task client = 1 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
176472024-04-20T01:08:46.233ZWARNcrucible: ds_connection connect to 127.0.0.1:8820 failure: Os { code: 146, kind: ConnectionRefused, message: "Connection refused" } = io task client = 1 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
176482024-04-20T01:08:46.233ZWARNcrucible: client task is sending Done(ConnectionFailed(Os { code: 146, kind: ConnectionRefused, message: "Connection refused" })) = io task client = 1 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
176492024-04-20T01:08:46.233ZWARNcrucible: downstairs task for 1 stopped due to ConnectionFailed(Os { code: 146, kind: ConnectionRefused, message: "Connection refused" }) session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
176502024-04-20T01:08:46.233ZINFOcrucible: [1] client re-new 302 jobs since flush 4919 = downstairs session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
176512024-04-20T01:08:46.233ZINFOcrucible: [1] Marked 0 jobs for replay since flush: 4919 = downstairs session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
176522024-04-20T01:08:46.233ZINFOcrucible: client task is exiting = io task client = 1 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
17653 [8820] got start action
17654 [8820] I am going to restart
17655 Starting downstairs at port 8820
17656 Make output file at "/tmp/dsc/downstairs-8820.txt"
17657 [8820][1] reports Starting
17658 Downstairs /var/tmp/dsc/region/8820 port 8820 PID:Some(1210)
17659 [8820][1] reports Running
17660 ----------------------------------------------------------------
17661 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:302
17662 States: Active Offline Active
17663 GW_ID ACK DSID TYPE BLOCKS DS:0 DS:1 DS:2 REPLAY
17664 3921 Acked 4920 Read 6 Done New Done true
17665 3922 Acked 4921 Write 5 Done New Done true
17666 3923 Acked 4922 Read 8 Done New Done true
17667 3924 Acked 4923 Read 9 Done New Done true
17668 3925 Acked 4924 Write 6 Done New Done true
17669 3926 Acked 4925 Read 6 Done New Done true
17670 3927 Acked 4926 Read 7 Done New Done true
17671 3928 Acked 4927 Flush 0 Done New Done true
17672 3929 Acked 4928 Read 8 Done New Done true
17673 3930 Acked 4929 Read 3 Done New Done true
17674 3931 Acked 4930 Read 2 Done New Done true
17675 3932 Acked 4931 Write 2 Done New Done true
17676 3933 Acked 4932 Write 4 Done New Done true
17677 3934 Acked 4933 Read 1 Done New Done true
17678 3935 Acked 4934 Write 4 Done New Done true
17679 3936 Acked 4935 Read 2 Done New Done true
17680 3937 Acked 4936 Read 4 Done New Done true
17681 3938 Acked 4937 Flush 0 Done New Done true
17682 3939 Acked 4938 Read 8 Done New Done true
17683 3940 Acked 4939 Read 4 Done New Done true
17684 3941 Acked 4940 Read 10 Done New Done true
17685 3942 Acked 4941 Flush 0 Done New Done true
17686 3943 Acked 4942 Read 6 Done New Done true
17687 3944 Acked 4943 Write 7 Done New Done true
17688 3945 Acked 4944 Flush 0 Done New Done true
17689 3946 Acked 4945 Flush 0 Done New Done true
17690 3947 Acked 4946 Read 7 Done New Done true
17691 3948 Acked 4947 Read 8 Done New Done true
17692 3949 Acked 4948 Write 10 Done New Done true
17693 3950 Acked 4949 Write 2 Done New Done true
17694 3951 Acked 4950 Read 7 Done New Done true
17695 3952 Acked 4951 Write 7 Done New Done true
17696 3953 Acked 4952 Read 10 Done New Done true
17697 3954 Acked 4953 Write 7 Done New Done true
17698 3955 Acked 4954 Read 9 Done New Done true
17699 3956 Acked 4955 Write 7 Done New Done true
17700 3957 Acked 4956 Write 10 Done New Done true
17701 3958 Acked 4957 Write 5 Done New Done true
17702 3959 Acked 4958 Write 4 Done New Done true
17703 3960 Acked 4959 Write 10 Done New Done true
17704 3961 Acked 4960 Read 6 Done New Done true
17705 3962 Acked 4961 Flush 0 Done New Done true
17706 3963 Acked 4962 Write 10 Done New Done true
17707 3964 Acked 4963 Read 3 Done New Done true
17708 3965 Acked 4964 Read 3 Done New Done true
17709 3966 Acked 4965 Read 6 Done New Done true
17710 3967 Acked 4966 Read 3 Done New Done true
17711 3968 Acked 4967 Read 10 Done New Done true
17712 3969 Acked 4968 Read 5 Done New Done true
17713 3970 Acked 4969 Write 3 Done New Done true
17714 3971 Acked 4970 Write 8 Done New Done true
17715 3972 Acked 4971 Read 10 Done New Done true
17716 3973 Acked 4972 Write 8 Done New Done true
17717 3974 Acked 4973 Flush 0 Done New Done true
17718 3975 Acked 4974 Write 1 Done New Done true
17719 3976 Acked 4975 Read 9 Done New Done true
17720 3977 Acked 4976 Write 5 Done New Done true
17721 3978 Acked 4977 Read 6 Done New Done true
17722 3979 Acked 4978 Write 7 Done New Done true
17723 3980 Acked 4979 Write 4 Done New Done true
17724 3981 Acked 4980 Read 4 Done New Done true
17725 3982 Acked 4981 Write 4 Done New Done true
17726 3983 Acked 4982 Read 9 Done New Done true
17727 3984 Acked 4983 Read 6 Done New Done true
17728 3985 Acked 4984 Write 10 Done New Done true
17729 3986 Acked 4985 Read 8 Done New Done true
17730 3987 Acked 4986 Flush 0 Done New Done true
17731 3988 Acked 4987 Write 3 Done New Done true
17732 3989 Acked 4988 Read 3 Done New Done true
17733 3990 Acked 4989 Read 8 Done New Done true
17734 3991 Acked 4990 Read 5 Done New Done true
17735 3992 Acked 4991 Read 3 Done New Done true
17736 3993 Acked 4992 Read 6 Done New Done true
17737 3994 Acked 4993 Read 4 Done New Done true
17738 3995 Acked 4994 Read 10 Done New Done true
17739 3996 Acked 4995 Read 2 Done New Done true
17740 3997 Acked 4996 Write 3 Done New Done true
17741 3998 Acked 4997 Write 5 Done New Done true
17742 3999 Acked 4998 Read 2 Done New Done true
17743 4000 Acked 4999 Read 2 Done New Done true
17744 4001 Acked 5000 Read 9 Done New Done true
17745 4002 Acked 5001 Read 3 Done New Done true
17746 4003 Acked 5002 Write 1 Done New Done true
17747 4004 Acked 5003 Read 9 Done New Done true
17748 4005 Acked 5004 Read 8 Done New Done true
17749 4006 Acked 5005 Read 9 Done New Done true
17750 4007 Acked 5006 Read 6 Done New Done true
17751 4008 Acked 5007 Read 4 Done New Done true
17752 4009 Acked 5008 Read 8 Done New Done true
17753 4010 Acked 5009 Flush 0 Done New Done true
17754 4011 Acked 5010 Write 5 Done New Done true
17755 4012 Acked 5011 Flush 0 Done New Done true
17756 4013 Acked 5012 Read 3 Done New Done true
17757 4014 Acked 5013 Read 1 Done New Done true
17758 4015 Acked 5014 Read 2 Done New Done true
17759 4016 Acked 5015 Write 6 Done New Done true
17760 4017 Acked 5016 Read 10 Done New Done true
17761 4018 Acked 5017 Write 8 Done New Done true
17762 4019 Acked 5018 Write 6 Done New Done true
17763 4020 Acked 5019 Read 10 Done New Done true
17764 4021 Acked 5020 Read 4 Done New Done true
17765 4022 Acked 5021 Write 1 Done New Done true
17766 4023 Acked 5022 Flush 0 Done New Done true
17767 4024 Acked 5023 Write 2 Done New Done true
17768 4025 Acked 5024 Read 6 Done New Done true
17769 4026 Acked 5025 Read 2 Done New Done true
17770 4027 Acked 5026 Write 3 Done New Done true
17771 4028 Acked 5027 Write 6 Done New Done true
17772 4029 Acked 5028 Write 5 Done New Done true
17773 4030 Acked 5029 Read 3 Done New Done true
17774 4031 Acked 5030 Write 5 Done New Done true
17775 4032 Acked 5031 Write 2 Done New Done true
17776 4033 Acked 5032 Read 2 Done New Done true
17777 4034 Acked 5033 Write 10 Done New Done true
17778 4035 Acked 5034 Write 10 Done New Done true
17779 4036 Acked 5035 Write 5 Done New Done true
17780 4037 Acked 5036 Read 6 Done New Done true
17781 4038 Acked 5037 Read 8 Done New Done true
17782 4039 Acked 5038 Write 5 Done New Done true
17783 4040 Acked 5039 Read 4 Done New Done true
17784 4041 Acked 5040 Read 7 Done New Done true
17785 4042 Acked 5041 Write 5 Done New Done true
17786 4043 Acked 5042 Write 8 Done New Done true
17787 4044 Acked 5043 Write 4 Done New Done true
17788 4045 Acked 5044 Write 6 Done New Done true
17789 4046 Acked 5045 Write 7 Done New Done true
17790 4047 Acked 5046 Write 6 Done New Done true
17791 4048 Acked 5047 Read 2 Done New Done true
17792 4049 Acked 5048 Read 5 Done New Done true
17793 4050 Acked 5049 Write 8 Done New Done true
17794 4051 Acked 5050 Read 10 Done New Done true
17795 4052 Acked 5051 Read 6 Done New Done true
17796 4053 Acked 5052 Write 10 Done New Done true
17797 4054 Acked 5053 Write 3 Done New Done true
17798 4055 Acked 5054 Read 7 Done New Done true
17799 4056 Acked 5055 Read 2 Done New Done true
17800 4057 Acked 5056 Read 6 Done New Done true
17801 4058 Acked 5057 Read 3 Done New Done true
17802 4059 Acked 5058 Write 3 Done New Done true
17803 4060 Acked 5059 Read 6 Done New Done true
17804 4061 Acked 5060 Read 3 Done New Done true
17805 4062 Acked 5061 Read 10 Done New Done true
17806 4063 Acked 5062 Read 3 Done New Done true
17807 4064 Acked 5063 Read 4 Done New Done true
17808 4065 Acked 5064 Read 6 Done New Done true
17809 4066 Acked 5065 Read 1 Done New Done true
17810 4067 Acked 5066 Write 8 Done New Done true
17811 4068 Acked 5067 Write 7 Done New Done true
17812 4069 Acked 5068 Flush 0 Done New Done true
17813 4070 Acked 5069 Write 9 Done New Done true
17814 4071 Acked 5070 Read 10 Done New Done true
17815 4072 Acked 5071 Write 7 Done New Done true
17816 4073 Acked 5072 Read 1 Done New Done true
17817 4074 Acked 5073 Read 8 Done New Done true
17818 4075 Acked 5074 Read 5 Done New Done true
17819 4076 Acked 5075 Read 10 Done New Done true
17820 4077 Acked 5076 Write 6 Done New Done true
17821 4078 Acked 5077 Read 3 Done New Done true
17822 4079 Acked 5078 Read 8 Done New Done true
17823 4080 Acked 5079 Read 7 Done New Done true
17824 4081 Acked 5080 Read 4 Done New Done true
17825 4082 Acked 5081 Read 9 Done New Done true
17826 4083 Acked 5082 Write 4 Done New Done true
17827 4084 Acked 5083 Write 3 Done New Done true
17828 4085 Acked 5084 Flush 0 Done New Done true
17829 4086 Acked 5085 Write 3 Done New Done true
17830 4087 Acked 5086 Write 10 Done New Done true
17831 4088 Acked 5087 Write 10 Done New Done true
17832 4089 Acked 5088 Read 7 Done New Done true
17833 4090 Acked 5089 Flush 0 Done New Done true
17834 4091 Acked 5090 Read 4 Done New Done true
17835 4092 Acked 5091 Read 10 Done New Done true
17836 4093 Acked 5092 Read 5 Done New Done true
17837 4094 Acked 5093 Write 9 Done New Done true
17838 4095 Acked 5094 Flush 0 Done New Done true
17839 4096 Acked 5095 Flush 0 Done New Done true
17840 4097 Acked 5096 Write 5 Done New Done true
17841 4098 Acked 5097 Write 1 Done New Done true
17842 4099 Acked 5098 Write 6 Done New Done true
17843 4100 Acked 5099 Write 1 Done New Done true
17844 4101 Acked 5100 Read 8 Done New Done true
17845 4102 Acked 5101 Read 3 Done New Done true
17846 4103 Acked 5102 Write 5 Done New Done true
17847 4104 Acked 5103 Read 5 Done New Done true
17848 4105 Acked 5104 Flush 0 Done New Done true
17849 4106 Acked 5105 Read 2 Done New Done true
17850 4107 Acked 5106 Read 5 Done New Done true
17851 4108 Acked 5107 Write 2 Done New Done true
17852 4109 Acked 5108 Write 5 Done New Done true
17853 4110 Acked 5109 Read 10 Done New Done true
17854 4111 Acked 5110 Read 1 Done New Done true
17855 4112 Acked 5111 Write 7 Done New Done true
17856 4113 Acked 5112 Write 1 Done New Done true
17857 4114 Acked 5113 Write 10 Done New Done true
17858 4115 Acked 5114 Write 7 Done New Done true
17859 4116 Acked 5115 Write 1 Done New Done true
17860 4117 Acked 5116 Write 10 Done New Done true
17861 4118 Acked 5117 Read 9 Done New Done true
17862 4119 Acked 5118 Write 4 Done New Done true
17863 4120 Acked 5119 Read 8 Done New Done true
17864 4121 Acked 5120 Write 3 Done New Done true
17865 4122 Acked 5121 Read 1 Done New Done true
17866 4123 Acked 5122 Write 9 Done New Done true
17867 4124 Acked 5123 Flush 0 Done New Done true
17868 4125 Acked 5124 Read 3 Done New Done true
17869 4126 Acked 5125 Write 1 Done New Done true
17870 4127 Acked 5126 Read 10 Done New Done true
17871 4128 Acked 5127 Read 4 Done New Done true
17872 4129 Acked 5128 Write 7 Done New Done true
17873 4130 Acked 5129 Read 8 Done New Done true
17874 4131 Acked 5130 Write 1 Done New Done true
17875 4132 Acked 5131 Write 10 Done New Done true
17876 4133 Acked 5132 Read 10 Done New Done true
17877 4134 Acked 5133 Read 4 Done New Done true
17878 4135 Acked 5134 Read 3 Done New Done true
17879 4136 Acked 5135 Write 1 Done New Done true
17880 4137 Acked 5136 Write 4 Done New Done true
17881 4138 Acked 5137 Write 1 Done New Done true
17882 4139 Acked 5138 Write 10 Done New Done true
17883 4140 Acked 5139 Write 6 Done New Done true
17884 4141 Acked 5140 Write 3 Done New Done true
17885 4142 Acked 5141 Read 8 Done New Done true
17886 4143 Acked 5142 Write 8 Done New Done true
17887 4144 Acked 5143 Read 4 Done New Done true
17888 4145 Acked 5144 Write 10 Done New Done true
17889 4146 Acked 5145 Flush 0 Done New Done true
17890 4147 Acked 5146 Read 5 Done New Done true
17891 4148 Acked 5147 Write 4 Done New Done true
17892 4149 Acked 5148 Write 5 Done New Done true
17893 4150 Acked 5149 Write 6 Done New Done true
17894 4151 Acked 5150 Flush 0 Done New Done true
17895 4152 Acked 5151 Read 9 Done New Done true
17896 4153 Acked 5152 Write 9 Done New Done true
17897 4154 Acked 5153 Flush 0 Done New Done true
17898 4155 Acked 5154 Read 3 Done New Done true
17899 4156 Acked 5155 Read 3 Done New Done true
17900 4157 Acked 5156 Read 10 Done New Done true
17901 4158 Acked 5157 Write 2 Done New Done true
17902 4159 Acked 5158 Flush 0 Done New Done true
17903 4160 Acked 5159 Write 10 Done New Done true
17904 4161 Acked 5160 Read 10 Done New Done true
17905 4162 Acked 5161 Read 2 Done New Done true
17906 4163 Acked 5162 Read 8 Done New Done true
17907 4164 Acked 5163 Read 2 Done New Done true
17908 4165 Acked 5164 Write 7 Done New Done true
17909 4166 Acked 5165 Flush 0 Done New Done true
17910 4167 Acked 5166 Read 4 Done New Done true
17911 4168 Acked 5167 Write 1 Done New Done true
17912 4169 Acked 5168 Read 7 Done New Done true
17913 4170 Acked 5169 Read 10 Done New Done true
17914 4171 Acked 5170 Read 1 Done New Done true
17915 4172 Acked 5171 Write 2 Done New Done true
17916 4173 Acked 5172 Read 1 Done New Done true
17917 4174 Acked 5173 Read 9 Done New Done true
17918 4175 Acked 5174 Read 10 Done New Done true
17919 4176 Acked 5175 Write 7 Done New Done true
17920 4177 Acked 5176 Read 7 Done New Done true
17921 4178 Acked 5177 Write 3 Done New Done true
17922 4179 Acked 5178 Write 9 Done New Done true
17923 4180 Acked 5179 Read 6 Done New Done true
17924 4181 Acked 5180 Write 5 Done New Done true
17925 4182 Acked 5181 Write 5 Done New Done true
17926 4183 Acked 5182 Read 7 Done New Done true
17927 4184 Acked 5183 Read 8 Done New Done true
17928 4185 Acked 5184 Read 1 Done New Done true
17929 4186 Acked 5185 Read 5 Done New Done true
17930 4187 Acked 5186 Write 5 Done New Done true
17931 4188 Acked 5187 Read 2 Done New Done true
17932 4189 Acked 5188 Read 9 Done New Done true
17933 4190 Acked 5189 Read 8 Done New Done true
17934 4191 Acked 5190 Write 2 Done New Done true
17935 4192 Acked 5191 Read 6 Done New Done true
17936 4193 Acked 5192 Write 5 Done New Done true
17937 4194 Acked 5193 Write 2 Done New Done true
17938 4195 Acked 5194 Flush 0 Done New Done true
17939 4196 Acked 5195 Write 1 Done New Done true
17940 4197 Acked 5196 Read 2 Done New Done true
17941 4198 Acked 5197 Read 5 Done New Done true
17942 4199 Acked 5198 Read 3 Done New Done true
17943 4200 Acked 5199 Write 4 Done New Done true
17944 4201 Acked 5200 Read 5 Done New Done true
17945 4202 Acked 5201 Flush 0 Done New Done true
17946 4203 Acked 5202 Write 2 Done New Done true
17947 4204 Acked 5203 Write 10 Done New Done true
17948 4205 Acked 5204 Read 2 Done New Done true
17949 4206 Acked 5205 Read 10 Done New Done true
17950 4207 Acked 5206 Read 4 Done New Done true
17951 4208 Acked 5207 Write 9 Done New Done true
17952 4209 Acked 5208 Write 1 Done New Done true
17953 4210 Acked 5209 Read 10 Done New Done true
17954 4211 Acked 5210 Write 6 Done New Done true
17955 4212 Acked 5211 Read 5 Done New Done true
17956 4213 Acked 5212 Write 9 Done New Done true
17957 4214 Acked 5213 Read 6 Done New Done true
17958 4215 Acked 5214 Read 10 Done New Done true
17959 4216 Acked 5215 Read 10 Done New Done true
17960 4217 Acked 5216 Read 5 Done New Done true
17961 4218 Acked 5217 Read 9 Done New Done true
17962 4219 Acked 5218 Flush 0 Done New Done true
17963 4220 Acked 5219 Write 8 Done New Done true
17964 4221 Acked 5220 Read 5 Done New Done true
17965 4222 Acked 5221 Flush 0 Done New Done true
17966 STATES DS:0 DS:1 DS:2 TOTAL
17967 New 0 302 0 302
17968 Sent 0 0 0 0
17969 Done 302 0 302 604
17970 Skipped 0 0 0 0
17971 Error 0 0 0 0
17972 Last Flush: 5221 4919 5221
17973 Downstairs last five completed: 4919 4918 4917 4916 4915
17974 Upstairs last five completed: 4222 4221 4220 4219 4218
17975 CLIENT: Up:0 ds:302 act:2
17976 ----------------------------------------------------------------
17977 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:302
17978 States: Active Offline Active
17979 GW_ID ACK DSID TYPE BLOCKS DS:0 DS:1 DS:2 REPLAY
17980 3921 Acked 4920 Read 6 Done New Done true
17981 3922 Acked 4921 Write 5 Done New Done true
17982 3923 Acked 4922 Read 8 Done New Done true
17983 3924 Acked 4923 Read 9 Done New Done true
17984 3925 Acked 4924 Write 6 Done New Done true
17985 3926 Acked 4925 Read 6 Done New Done true
17986 3927 Acked 4926 Read 7 Done New Done true
17987 3928 Acked 4927 Flush 0 Done New Done true
17988 3929 Acked 4928 Read 8 Done New Done true
17989 3930 Acked 4929 Read 3 Done New Done true
17990 3931 Acked 4930 Read 2 Done New Done true
17991 3932 Acked 4931 Write 2 Done New Done true
17992 3933 Acked 4932 Write 4 Done New Done true
17993 3934 Acked 4933 Read 1 Done New Done true
17994 3935 Acked 4934 Write 4 Done New Done true
17995 3936 Acked 4935 Read 2 Done New Done true
17996 3937 Acked 4936 Read 4 Done New Done true
17997 3938 Acked 4937 Flush 0 Done New Done true
17998 3939 Acked 4938 Read 8 Done New Done true
17999 3940 Acked 4939 Read 4 Done New Done true
18000 3941 Acked 4940 Read 10 Done New Done true
18001 3942 Acked 4941 Flush 0 Done New Done true
18002 3943 Acked 4942 Read 6 Done New Done true
18003 3944 Acked 4943 Write 7 Done New Done true
18004 3945 Acked 4944 Flush 0 Done New Done true
18005 3946 Acked 4945 Flush 0 Done New Done true
18006 3947 Acked 4946 Read 7 Done New Done true
18007 3948 Acked 4947 Read 8 Done New Done true
18008 3949 Acked 4948 Write 10 Done New Done true
18009 3950 Acked 4949 Write 2 Done New Done true
18010 3951 Acked 4950 Read 7 Done New Done true
18011 3952 Acked 4951 Write 7 Done New Done true
18012 3953 Acked 4952 Read 10 Done New Done true
18013 3954 Acked 4953 Write 7 Done New Done true
18014 3955 Acked 4954 Read 9 Done New Done true
18015 3956 Acked 4955 Write 7 Done New Done true
18016 3957 Acked 4956 Write 10 Done New Done true
18017 3958 Acked 4957 Write 5 Done New Done true
18018 3959 Acked 4958 Write 4 Done New Done true
18019 3960 Acked 4959 Write 10 Done New Done true
18020 3961 Acked 4960 Read 6 Done New Done true
18021 3962 Acked 4961 Flush 0 Done New Done true
18022 3963 Acked 4962 Write 10 Done New Done true
18023 3964 Acked 4963 Read 3 Done New Done true
18024 3965 Acked 4964 Read 3 Done New Done true
18025 3966 Acked 4965 Read 6 Done New Done true
18026 3967 Acked 4966 Read 3 Done New Done true
18027 3968 Acked 4967 Read 10 Done New Done true
18028 3969 Acked 4968 Read 5 Done New Done true
18029 3970 Acked 4969 Write 3 Done New Done true
18030 3971 Acked 4970 Write 8 Done New Done true
18031 3972 Acked 4971 Read 10 Done New Done true
18032 3973 Acked 4972 Write 8 Done New Done true
18033 3974 Acked 4973 Flush 0 Done New Done true
18034 3975 Acked 4974 Write 1 Done New Done true
18035 3976 Acked 4975 Read 9 Done New Done true
18036 3977 Acked 4976 Write 5 Done New Done true
18037 3978 Acked 4977 Read 6 Done New Done true
18038 3979 Acked 4978 Write 7 Done New Done true
18039 3980 Acked 4979 Write 4 Done New Done true
18040 3981 Acked 4980 Read 4 Done New Done true
18041 3982 Acked 4981 Write 4 Done New Done true
18042 3983 Acked 4982 Read 9 Done New Done true
18043 3984 Acked 4983 Read 6 Done New Done true
18044 3985 Acked 4984 Write 10 Done New Done true
18045 3986 Acked 4985 Read 8 Done New Done true
18046 3987 Acked 4986 Flush 0 Done New Done true
18047 3988 Acked 4987 Write 3 Done New Done true
18048 3989 Acked 4988 Read 3 Done New Done true
18049 3990 Acked 4989 Read 8 Done New Done true
18050 3991 Acked 4990 Read 5 Done New Done true
18051 3992 Acked 4991 Read 3 Done New Done true
18052 3993 Acked 4992 Read 6 Done New Done true
18053 3994 Acked 4993 Read 4 Done New Done true
18054 3995 Acked 4994 Read 10 Done New Done true
18055 3996 Acked 4995 Read 2 Done New Done true
18056 3997 Acked 4996 Write 3 Done New Done true
18057 3998 Acked 4997 Write 5 Done New Done true
18058 3999 Acked 4998 Read 2 Done New Done true
18059 4000 Acked 4999 Read 2 Done New Done true
18060 4001 Acked 5000 Read 9 Done New Done true
18061 4002 Acked 5001 Read 3 Done New Done true
18062 4003 Acked 5002 Write 1 Done New Done true
18063 4004 Acked 5003 Read 9 Done New Done true
18064 4005 Acked 5004 Read 8 Done New Done true
18065 4006 Acked 5005 Read 9 Done New Done true
18066 4007 Acked 5006 Read 6 Done New Done true
18067 4008 Acked 5007 Read 4 Done New Done true
18068 4009 Acked 5008 Read 8 Done New Done true
18069 4010 Acked 5009 Flush 0 Done New Done true
18070 4011 Acked 5010 Write 5 Done New Done true
18071 4012 Acked 5011 Flush 0 Done New Done true
18072 4013 Acked 5012 Read 3 Done New Done true
18073 4014 Acked 5013 Read 1 Done New Done true
18074 4015 Acked 5014 Read 2 Done New Done true
18075 4016 Acked 5015 Write 6 Done New Done true
18076 4017 Acked 5016 Read 10 Done New Done true
18077 4018 Acked 5017 Write 8 Done New Done true
18078 4019 Acked 5018 Write 6 Done New Done true
18079 4020 Acked 5019 Read 10 Done New Done true
18080 4021 Acked 5020 Read 4 Done New Done true
18081 4022 Acked 5021 Write 1 Done New Done true
18082 4023 Acked 5022 Flush 0 Done New Done true
18083 4024 Acked 5023 Write 2 Done New Done true
18084 4025 Acked 5024 Read 6 Done New Done true
18085 4026 Acked 5025 Read 2 Done New Done true
18086 4027 Acked 5026 Write 3 Done New Done true
18087 4028 Acked 5027 Write 6 Done New Done true
18088 4029 Acked 5028 Write 5 Done New Done true
18089 4030 Acked 5029 Read 3 Done New Done true
18090 4031 Acked 5030 Write 5 Done New Done true
18091 4032 Acked 5031 Write 2 Done New Done true
18092 4033 Acked 5032 Read 2 Done New Done true
18093 4034 Acked 5033 Write 10 Done New Done true
18094 4035 Acked 5034 Write 10 Done New Done true
18095 4036 Acked 5035 Write 5 Done New Done true
18096 4037 Acked 5036 Read 6 Done New Done true
18097 4038 Acked 5037 Read 8 Done New Done true
18098 4039 Acked 5038 Write 5 Done New Done true
18099 4040 Acked 5039 Read 4 Done New Done true
18100 4041 Acked 5040 Read 7 Done New Done true
18101 4042 Acked 5041 Write 5 Done New Done true
18102 4043 Acked 5042 Write 8 Done New Done true
18103 4044 Acked 5043 Write 4 Done New Done true
18104 4045 Acked 5044 Write 6 Done New Done true
18105 4046 Acked 5045 Write 7 Done New Done true
18106 4047 Acked 5046 Write 6 Done New Done true
18107 4048 Acked 5047 Read 2 Done New Done true
18108 4049 Acked 5048 Read 5 Done New Done true
18109 4050 Acked 5049 Write 8 Done New Done true
18110 4051 Acked 5050 Read 10 Done New Done true
18111 4052 Acked 5051 Read 6 Done New Done true
18112 4053 Acked 5052 Write 10 Done New Done true
18113 4054 Acked 5053 Write 3 Done New Done true
18114 4055 Acked 5054 Read 7 Done New Done true
18115 4056 Acked 5055 Read 2 Done New Done true
18116 4057 Acked 5056 Read 6 Done New Done true
18117 4058 Acked 5057 Read 3 Done New Done true
18118 4059 Acked 5058 Write 3 Done New Done true
18119 4060 Acked 5059 Read 6 Done New Done true
18120 4061 Acked 5060 Read 3 Done New Done true
18121 4062 Acked 5061 Read 10 Done New Done true
18122 4063 Acked 5062 Read 3 Done New Done true
18123 4064 Acked 5063 Read 4 Done New Done true
18124 4065 Acked 5064 Read 6 Done New Done true
18125 4066 Acked 5065 Read 1 Done New Done true
18126 4067 Acked 5066 Write 8 Done New Done true
18127 4068 Acked 5067 Write 7 Done New Done true
18128 4069 Acked 5068 Flush 0 Done New Done true
18129 4070 Acked 5069 Write 9 Done New Done true
18130 4071 Acked 5070 Read 10 Done New Done true
18131 4072 Acked 5071 Write 7 Done New Done true
18132 4073 Acked 5072 Read 1 Done New Done true
18133 4074 Acked 5073 Read 8 Done New Done true
18134 4075 Acked 5074 Read 5 Done New Done true
18135 4076 Acked 5075 Read 10 Done New Done true
18136 4077 Acked 5076 Write 6 Done New Done true
18137 4078 Acked 5077 Read 3 Done New Done true
18138 4079 Acked 5078 Read 8 Done New Done true
18139 4080 Acked 5079 Read 7 Done New Done true
18140 4081 Acked 5080 Read 4 Done New Done true
18141 4082 Acked 5081 Read 9 Done New Done true
18142 4083 Acked 5082 Write 4 Done New Done true
18143 4084 Acked 5083 Write 3 Done New Done true
18144 4085 Acked 5084 Flush 0 Done New Done true
18145 4086 Acked 5085 Write 3 Done New Done true
18146 4087 Acked 5086 Write 10 Done New Done true
18147 4088 Acked 5087 Write 10 Done New Done true
18148 4089 Acked 5088 Read 7 Done New Done true
18149 4090 Acked 5089 Flush 0 Done New Done true
18150 4091 Acked 5090 Read 4 Done New Done true
18151 4092 Acked 5091 Read 10 Done New Done true
18152 4093 Acked 5092 Read 5 Done New Done true
18153 4094 Acked 5093 Write 9 Done New Done true
18154 4095 Acked 5094 Flush 0 Done New Done true
18155 4096 Acked 5095 Flush 0 Done New Done true
18156 4097 Acked 5096 Write 5 Done New Done true
18157 4098 Acked 5097 Write 1 Done New Done true
18158 4099 Acked 5098 Write 6 Done New Done true
18159 4100 Acked 5099 Write 1 Done New Done true
18160 4101 Acked 5100 Read 8 Done New Done true
18161 4102 Acked 5101 Read 3 Done New Done true
18162 4103 Acked 5102 Write 5 Done New Done true
18163 4104 Acked 5103 Read 5 Done New Done true
18164 4105 Acked 5104 Flush 0 Done New Done true
18165 4106 Acked 5105 Read 2 Done New Done true
18166 4107 Acked 5106 Read 5 Done New Done true
18167 4108 Acked 5107 Write 2 Done New Done true
18168 4109 Acked 5108 Write 5 Done New Done true
18169 4110 Acked 5109 Read 10 Done New Done true
18170 4111 Acked 5110 Read 1 Done New Done true
18171 4112 Acked 5111 Write 7 Done New Done true
18172 4113 Acked 5112 Write 1 Done New Done true
18173 4114 Acked 5113 Write 10 Done New Done true
18174 4115 Acked 5114 Write 7 Done New Done true
18175 4116 Acked 5115 Write 1 Done New Done true
18176 4117 Acked 5116 Write 10 Done New Done true
18177 4118 Acked 5117 Read 9 Done New Done true
18178 4119 Acked 5118 Write 4 Done New Done true
18179 4120 Acked 5119 Read 8 Done New Done true
18180 4121 Acked 5120 Write 3 Done New Done true
18181 4122 Acked 5121 Read 1 Done New Done true
18182 4123 Acked 5122 Write 9 Done New Done true
18183 4124 Acked 5123 Flush 0 Done New Done true
18184 4125 Acked 5124 Read 3 Done New Done true
18185 4126 Acked 5125 Write 1 Done New Done true
18186 4127 Acked 5126 Read 10 Done New Done true
18187 4128 Acked 5127 Read 4 Done New Done true
18188 4129 Acked 5128 Write 7 Done New Done true
18189 4130 Acked 5129 Read 8 Done New Done true
18190 4131 Acked 5130 Write 1 Done New Done true
18191 4132 Acked 5131 Write 10 Done New Done true
18192 4133 Acked 5132 Read 10 Done New Done true
18193 4134 Acked 5133 Read 4 Done New Done true
18194 4135 Acked 5134 Read 3 Done New Done true
18195 4136 Acked 5135 Write 1 Done New Done true
18196 4137 Acked 5136 Write 4 Done New Done true
18197 4138 Acked 5137 Write 1 Done New Done true
18198 4139 Acked 5138 Write 10 Done New Done true
18199 4140 Acked 5139 Write 6 Done New Done true
18200 4141 Acked 5140 Write 3 Done New Done true
18201 4142 Acked 5141 Read 8 Done New Done true
18202 4143 Acked 5142 Write 8 Done New Done true
18203 4144 Acked 5143 Read 4 Done New Done true
18204 4145 Acked 5144 Write 10 Done New Done true
18205 4146 Acked 5145 Flush 0 Done New Done true
18206 4147 Acked 5146 Read 5 Done New Done true
18207 4148 Acked 5147 Write 4 Done New Done true
18208 4149 Acked 5148 Write 5 Done New Done true
18209 4150 Acked 5149 Write 6 Done New Done true
18210 4151 Acked 5150 Flush 0 Done New Done true
18211 4152 Acked 5151 Read 9 Done New Done true
18212 4153 Acked 5152 Write 9 Done New Done true
18213 4154 Acked 5153 Flush 0 Done New Done true
18214 4155 Acked 5154 Read 3 Done New Done true
18215 4156 Acked 5155 Read 3 Done New Done true
18216 4157 Acked 5156 Read 10 Done New Done true
18217 4158 Acked 5157 Write 2 Done New Done true
18218 4159 Acked 5158 Flush 0 Done New Done true
18219 4160 Acked 5159 Write 10 Done New Done true
18220 4161 Acked 5160 Read 10 Done New Done true
18221 4162 Acked 5161 Read 2 Done New Done true
18222 4163 Acked 5162 Read 8 Done New Done true
18223 4164 Acked 5163 Read 2 Done New Done true
18224 4165 Acked 5164 Write 7 Done New Done true
18225 4166 Acked 5165 Flush 0 Done New Done true
18226 4167 Acked 5166 Read 4 Done New Done true
18227 4168 Acked 5167 Write 1 Done New Done true
18228 4169 Acked 5168 Read 7 Done New Done true
18229 4170 Acked 5169 Read 10 Done New Done true
18230 4171 Acked 5170 Read 1 Done New Done true
18231 4172 Acked 5171 Write 2 Done New Done true
18232 4173 Acked 5172 Read 1 Done New Done true
18233 4174 Acked 5173 Read 9 Done New Done true
18234 4175 Acked 5174 Read 10 Done New Done true
18235 4176 Acked 5175 Write 7 Done New Done true
18236 4177 Acked 5176 Read 7 Done New Done true
18237 4178 Acked 5177 Write 3 Done New Done true
18238 4179 Acked 5178 Write 9 Done New Done true
18239 4180 Acked 5179 Read 6 Done New Done true
18240 4181 Acked 5180 Write 5 Done New Done true
18241 4182 Acked 5181 Write 5 Done New Done true
18242 4183 Acked 5182 Read 7 Done New Done true
18243 4184 Acked 5183 Read 8 Done New Done true
18244 4185 Acked 5184 Read 1 Done New Done true
18245 4186 Acked 5185 Read 5 Done New Done true
18246 4187 Acked 5186 Write 5 Done New Done true
18247 4188 Acked 5187 Read 2 Done New Done true
18248 4189 Acked 5188 Read 9 Done New Done true
18249 4190 Acked 5189 Read 8 Done New Done true
18250 4191 Acked 5190 Write 2 Done New Done true
18251 4192 Acked 5191 Read 6 Done New Done true
18252 4193 Acked 5192 Write 5 Done New Done true
18253 4194 Acked 5193 Write 2 Done New Done true
18254 4195 Acked 5194 Flush 0 Done New Done true
18255 4196 Acked 5195 Write 1 Done New Done true
18256 4197 Acked 5196 Read 2 Done New Done true
18257 4198 Acked 5197 Read 5 Done New Done true
18258 4199 Acked 5198 Read 3 Done New Done true
18259 4200 Acked 5199 Write 4 Done New Done true
18260 4201 Acked 5200 Read 5 Done New Done true
18261 4202 Acked 5201 Flush 0 Done New Done true
18262 4203 Acked 5202 Write 2 Done New Done true
18263 4204 Acked 5203 Write 10 Done New Done true
18264 4205 Acked 5204 Read 2 Done New Done true
18265 4206 Acked 5205 Read 10 Done New Done true
18266 4207 Acked 5206 Read 4 Done New Done true
18267 4208 Acked 5207 Write 9 Done New Done true
18268 4209 Acked 5208 Write 1 Done New Done true
18269 4210 Acked 5209 Read 10 Done New Done true
18270 4211 Acked 5210 Write 6 Done New Done true
18271 4212 Acked 5211 Read 5 Done New Done true
18272 4213 Acked 5212 Write 9 Done New Done true
18273 4214 Acked 5213 Read 6 Done New Done true
18274 4215 Acked 5214 Read 10 Done New Done true
18275 4216 Acked 5215 Read 10 Done New Done true
18276 4217 Acked 5216 Read 5 Done New Done true
18277 4218 Acked 5217 Read 9 Done New Done true
18278 4219 Acked 5218 Flush 0 Done New Done true
18279 4220 Acked 5219 Write 8 Done New Done true
18280 4221 Acked 5220 Read 5 Done New Done true
18281 4222 Acked 5221 Flush 0 Done New Done true
18282 STATES DS:0 DS:1 DS:2 TOTAL
18283 New 0 302 0 302
18284 Sent 0 0 0 0
18285 Done 302 0 302 604
18286 Skipped 0 0 0 0
18287 Error 0 0 0 0
18288 Last Flush: 5221 4919 5221
18289 Downstairs last five completed: 4919 4918 4917 4916 4915
18290 Upstairs last five completed: 4222 4221 4220 4219 4218
18291 CLIENT: Up:0 ds:302 act:2
182922024-04-20T01:08:56.233ZINFOcrucible: connecting to 127.0.0.1:8820 = io task client = 1 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
182932024-04-20T01:08:56.233ZINFOcrucible: ds_connection connected from Ok(127.0.0.1:65512) = io task client = 1 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
182942024-04-20T01:08:56.235ZINFOcrucible: downstairs client at Some(127.0.0.1:8820) has region UUID 12345678-0000-0000-0000-000000008820 = downstairs client = 1 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
182952024-04-20T01:08:56.235ZINFOcrucible: Returning UUID:12345678-0000-0000-0000-000000008820 matches = downstairs client = 1 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
182962024-04-20T01:08:56.235ZINFOcrucible: send last flush ID to this DS: 4919 = downstairs client = 1 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
182972024-04-20T01:08:56.235ZINFOcrucible: Replied this last flush ID: 4919 = downstairs client = 1 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
182982024-04-20T01:08:56.235ZINFOcrucible: ds_transition from Offline to Replay = downstairs client = 1 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
182992024-04-20T01:08:56.235ZINFOcrucible: [1] Transition from Offline to Replay = downstairs client = 1 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
183002024-04-20T01:08:56.235ZINFOcrucible: ds_transition from Replay to Active = downstairs client = 1 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
183012024-04-20T01:08:56.235ZINFOcrucible: [1] Transition from Replay to Active = downstairs client = 1 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
18302 ----------------------------------------------------------------
18303 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:0
18304 Downstairs last five completed: 5221 5220 5219 5218 5217
18305 Upstairs last five completed: 4222 4221 4220 4219 4218
18306 CLIENT: Up:0 ds:0 act:3
18307 Replay: All jobs finished, all DS active.
18308 Main task has work to do, go find it
18309 got dsc Stop(1)
18310 stop 1
18311 Apr 20 01:08:56.555 INFO request completed, latency_us: 315[8820] Got stop action so:false kr:false
18312 , response_code: 204, uri: /stop/cid/1, method: POST, req_id: d7ffe746-43a0-4ab6-88f1-6b2d037a0311, remote_addr: 127.0.0.1:60352, local_addr: 127.0.0.1:9998
183132024-04-20T01:08:56.555ZWARNcrucible: downstairs disconnected = io task client = 1 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
183142024-04-20T01:08:56.555ZWARNcrucible: client task is sending Done(Finished) = io task client = 1 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
183152024-04-20T01:08:56.555ZWARNcrucible: downstairs task for 1 stopped due to Finished session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
183162024-04-20T01:08:56.555ZINFOcrucible: Gone missing, transition from Active to Offline = downstairs client = 1 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
183172024-04-20T01:08:56.556ZINFOcrucible: [1] client re-new 0 jobs since flush 5221 = downstairs session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
183182024-04-20T01:08:56.556ZINFOcrucible: [1] Marked 0 jobs for replay since flush: 5221 = downstairs session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
18319 Apr 20 01:08:56.556 INFO request completed, latency_us: 184, response_code: 200{"msg":"client task is exiting","v":0,"name":"crucible","level":30,"time":"2024-04-20T01:08:56.556172559Z","hostname":"w-01HVWGBJP7HK0H9TQ26T6N3X8M","pid":1196,"":"io task","client":"1","":"downstairs","session_id":"132b460a-26a0-4532-b1ab-4f8c07d4c6c7"}
18320 , uri: /state/cid/1, method: GET, req_id: 31cc3fe0-75f0-4496-9e13-2fc70615c611, remote_addr: 127.0.0.1:60352, local_addr: 127.0.0.1:9998
18321 [8820] Exited with: ExitStatus(unix_wait_status(9))
18322 [8820][1] reports Exit
18323 Apr 20 01:09:00.557 INFO request completed, latency_us: 178, response_code: 200, uri: /state/cid/1, method: GET, req_id: 23929337-50ae-4482-8d8b-52dd074b1ddb, remote_addr: 127.0.0.1:60352, local_addr: 127.0.0.1:9998
18324 001/300 Write block 3107 len 20480 data: 5 3 3 4 4
18325 002/300 Read block 2549 len 20480
18326 003/300 Write block 3795 len 8192 data: 3 4
18327 004/300 Read block 1966 len 28672
18328 005/300 Write block 2584 len 36864 data: 3 3 2 2 2 2 2 2 3
18329 006/300 Write block 3583 len 32768 data: 4 3 3 2 2 2 2 2
18330 007/300 Write block 3465 len 40960 data: 4 4 4 4 4 2 2 2 2 2
18331 008/300 Write block 857 len 24576 data: 3 3 3 4 4 4
18332 009/300 Read block 1014 len 28672
18333 010/300 Write block 118 len 12288 data: 4 3 3
18334 011/300 Write block 4077 len 20480 data: 7 8 8 9 7
18335 012/300 Write block 512 len 4096 data: 4
18336 013/300 Read block 2496 len 20480
18337 014/300 Read block 4489 len 32768
18338 015/300 Read block 4202 len 28672
18339 016/300 Read block 3215 len 36864
18340 017/300 Write block 540 len 32768 data: 4 4 4 5 5 3 3 3
18341 018/300 Flush
18342 019/300 Write block 2059 len 36864 data: 5 4 4 4 3 3 4 4 4
18343 020/300 Read block 2385 len 16384
18344 021/300 Read block 1046 len 12288
18345 022/300 Read block 3374 len 8192
18346 023/300 Write block 4791 len 16384 data: 2 2 2 2
18347 024/300 Read block 823 len 16384
18348 025/300 Write block 2952 len 24576 data: 3 2 2 2 2 2
18349 026/300 Write block 1034 len 4096 data: 5
18350 027/300 Write block 4181 len 24576 data: 4 6 4 3 3 3
18351 028/300 Write block 3615 len 32768 data: 4 3 3 3 3 3 3 2
18352 029/300 Read block 264 len 16384
18353 030/300 Read block 2792 len 20480
18354 031/300 Write block 473 len 24576 data: 3 2 3 3 3 4
18355 032/300 Read block 1744 len 32768
18356 033/300 Read block 1234 len 20480
18357 034/300 Write block 3230 len 28672 data: 3 3 2 3 5 5 6
18358 035/300 Write block 837 len 36864 data: 4 4 3 3 3 3 3 3 2
18359 036/300 Flush
18360 037/300 Write block 312 len 32768 data: 3 3 3 5 5 4 5 5
18361 038/300 Read block 1771 len 8192
18362 039/300 Read block 1489 len 36864
18363 040/300 Write block 2458 len 4096 data: 4
18364 041/300 Write block 4701 len 24576 data: 5 5 5 4 4 5
18365 042/300 Write block 1271 len 4096 data: 5
18366 043/300 Write block 3876 len 8192 data: 3 3
18367 044/300 Flush
18368 045/300 Read block 2047 len 40960
18369 046/300 Write block 1059 len 16384 data: 5 4 4 4
18370 047/300 Read block 684 len 36864
18371 048/300 Read block 1701 len 16384
18372 049/300 Read block 3316 len 8192
18373 050/300 Flush
18374 051/300 Flush
18375 052/300 Read block 4716 len 40960
18376 053/300 Read block 274 len 32768
18377 054/300 Write block 1310 len 36864 data: 4 4 4 3 2 2 3 2 2
18378 055/300 Read block 131 len 32768
18379 056/300 Read block 2546 len 32768
18380 057/300 Flush
18381 058/300 Read block 51 len 28672
18382 059/300 Flush
18383 060/300 Write block 3295 len 32768 data: 2 2 2 2 2 2 2 2
18384 061/300 Write block 2584 len 12288 data: 4 4 3
18385 062/300 Read block 85 len 4096
18386 063/300 Read block 3915 len 8192
18387 064/300 Write block 2274 len 28672 data: 2 3 2 2 2 2 2
18388 065/300 Write block 4807 len 8192 data: 4 5
18389 066/300 Read block 2536 len 40960
18390 067/300 Write block 1565 len 24576 data: 3 3 3 3 3 4
18391 068/300 Write block 2036 len 4096 data: 2
18392 069/300 Read block 4638 len 24576
18393 070/300 Write block 4218 len 16384 data: 3 3 3 3
18394 071/300 Read block 4222 len 40960
18395 072/300 Write block 1137 len 32768 data: 4 3 4 4 4 3 2 2
18396 073/300 Read block 3319 len 12288
18397 074/300 Write block 2813 len 4096 data: 7
18398 075/300 Read block 1950 len 12288
18399 076/300 Read block 2868 len 20480
18400 077/300 Write block 4769 len 16384 data: 5 3 3 3
18401 078/300 Write block 2285 len 24576 data: 2 2 3 4 4 4
18402 079/300 Write block 1487 len 32768 data: 3 2 2 3 3 2 3 3
18403 080/300 Read block 805 len 40960
18404 081/300 Write block 3964 len 4096 data: 3
18405 082/300 Read block 2970 len 36864
18406 083/300 Write block 3405 len 8192 data: 4 5
18407 084/300 Flush
18408 085/300 Read block 4775 len 4096
18409 086/300 Write block 2605 len 28672 data: 5 5 3 3 3 3 3
18410 087/300 Read block 2890 len 4096
18411 088/300 Write block 4298 len 8192 data: 3 3
18412 089/300 Read block 1610 len 36864
18413 090/300 Write block 2026 len 12288 data: 7 5 3
18414 091/300 Read block 4706 len 16384
18415 092/300 Write block 4649 len 36864 data: 2 2 3 3 3 2 3 5 5
18416 093/300 Read block 1795 len 32768
18417 094/300 Flush
18418 095/300 Read block 1194 len 4096
18419 096/300 Read block 3927 len 24576
18420 097/300 Write block 1352 len 24576 data: 2 2 2 2 4 4
18421 098/300 Write block 1695 len 28672 data: 4 5 4 5 5 4 4
18422 099/300 Read block 909 len 12288
18423 100/300 Read block 1362 len 8192
18424 101/300 Read block 520 len 8192
18425 102/300 Read block 1590 len 8192
18426 103/300 Read block 1762 len 24576
18427 104/300 Read block 3707 len 12288
18428 105/300 Read block 2465 len 40960
18429 106/300 Write block 2756 len 16384 data: 5 4 4 4
18430 107/300 Write block 2847 len 8192 data: 5 4
18431 108/300 Write block 4860 len 16384 data: 4 6 5 3
18432 109/300 Write block 2102 len 8192 data: 4 4
18433 110/300 Read block 387 len 28672
18434 111/300 Write block 3878 len 36864 data: 3 3 2 2 3 3 4 4 3
18435 112/300 Write block 3735 len 8192 data: 3 3
18436 113/300 Read block 4531 len 4096
18437 114/300 Read block 3527 len 32768
18438 115/300 Write block 2061 len 4096 data: 5
18439 116/300 Write block 583 len 20480 data: 3 3 3 3 3
18440 117/300 Write block 2394 len 32768 data: 6 6 6 4 4 4 4 4
18441 118/300 Write block 2971 len 16384 data: 4 4 4 4
18442 119/300 Write block 2304 len 40960 data: 4 4 3 2 2 2 2 2 3 3
18443 120/300 Flush
18444 121/300 Write block 3325 len 16384 data: 4 4 5 5
18445 122/300 Write block 4137 len 4096 data: 4
18446 123/300 Read block 1716 len 4096
18447 124/300 Write block 2183 len 24576 data: 4 4 4 3 4 3
18448 125/300 Read block 3163 len 24576
18449 126/300 Read block 449 len 4096
18450 127/300 Write block 1233 len 28672 data: 2 2 2 2 2 2 2
18451 128/300 Read block 2273 len 24576
18452 129/300 Write block 2558 len 16384 data: 2 4 4 4
18453 130/300 Flush
18454 131/300 Write block 1960 len 4096 data: 4
18455 132/300 Read block 4001 len 28672
18456 133/300 Write block 1813 len 4096 data: 3
18457 134/300 Read block 1120 len 40960
18458 135/300 Write block 3187 len 28672 data: 5 5 5 4 4 4 3
18459 136/300 Read block 2038 len 20480
18460 137/300 Read block 3182 len 16384
18461 138/300 Write block 4556 len 24576 data: 3 3 3 4 4 4
18462 139/300 Write block 2054 len 4096 data: 6
18463 140/300 Read block 3155 len 28672
18464 141/300 Read block 4606 len 32768
18465 142/300 Write block 1018 len 20480 data: 2 3 3 2 2
18466 143/300 Read block 1998 len 8192
18467 144/300 Read block 1699 len 24576
18468 145/300 Read block 4186 len 20480
18469 146/300 Write block 913 len 20480 data: 4 4 3 3 2
18470 147/300 Write block 1441 len 8192 data: 6 7
18471 148/300 Write block 1042 len 36864 data: 4 5 5 5 5 6 5 4 4
18472 149/300 Write block 2723 len 28672 data: 3 5 5 7 8 8 8
18473 150/300 Write block 4251 len 40960 data: 4 5 5 6 6 5 4 4 4 5
18474 151/300 Write block 4050 len 24576 data: 3 3 4 5 5 5
18475 152/300 Write block 4219 len 36864 data: 4 4 4 3 3 4 5 4 5
18476 153/300 Read block 2421 len 40960
18477 154/300 Read block 4037 len 16384
18478 155/300 Read block 2261 len 24576
18479 156/300 Flush
18480 157/300 Write block 693 len 16384 data: 4 4 2 4
18481 158/300 Flush
18482 159/300 Read block 384 len 16384
18483 160/300 Write block 4303 len 16384 data: 4 4 4 4
18484 161/300 Write block 1333 len 16384 data: 4 3 3 3
18485 162/300 Read block 4810 len 32768
18486 163/300 Read block 4329 len 36864
18487 164/300 Read block 2601 len 32768
18488 165/300 Read block 3128 len 36864
18489 166/300 Flush
18490 167/300 Flush
18491 168/300 Read block 726 len 28672
18492 169/300 Flush
18493 170/300 Read block 3363 len 8192
18494 171/300 Write block 4297 len 8192 data: 4 4
18495 172/300 Write block 3224 len 24576 data: 3 3 3 3 2 2
18496 173/300 Read block 4929 len 16384
18497 174/300 Flush
18498 175/300 Write block 2350 len 40960 data: 7 6 6 5 4 5 6 4 6 5
18499 176/300 Write block 1801 len 16384 data: 3 3 3 4
18500 177/300 Write block 2409 len 12288 data: 2 2 2
18501 178/300 Read block 1226 len 24576
18502 179/300 Read block 2083 len 4096
18503 180/300 Read block 196 len 20480
18504 181/300 Read block 4539 len 8192
18505 182/300 Write block 794 len 8192 data: 3 3
18506 183/300 Read block 2877 len 32768
18507 184/300 Read block 645 len 20480
18508 185/300 Write block 3485 len 32768 data: 5 4 4 5 5 6 5 5
18509 186/300 Write block 513 len 16384 data: 6 4 5 7
18510 187/300 Write block 4774 len 40960 data: 3 2 3 4 4 3 4 3 4 4
18511 188/300 Read block 3809 len 24576
18512 189/300 Read block 4366 len 24576
18513 190/300 Read block 2406 len 20480
18514 191/300 Flush
18515 192/300 Write block 3507 len 32768 data: 2 2 2 2 2 2 3 4
18516 193/300 Read block 4171 len 36864
18517 194/300 Read block 3035 len 36864
18518 195/300 Write block 1693 len 8192 data: 2 3
18519 196/300 Flush
18520 197/300 Read block 4151 len 12288
18521 198/300 Read block 1874 len 12288
18522 199/300 Write block 2843 len 24576 data: 6 4 5 5 6 5
18523 200/300 Write block 4481 len 4096 data: 4
18524 201/300 Read block 1953 len 8192
18525 202/300 Read block 2745 len 8192
18526 203/300 Write block 3169 len 28672 data: 3 3 3 2 2 2 2
18527 204/300 Read block 4969 len 40960
18528 205/300 Read block 1320 len 36864
18529 206/300 Read block 4717 len 4096
18530 207/300 Write block 165 len 40960 data: 4 3 2 2 2 2 2 2 3 2
18531 208/300 Read block 3084 len 28672
18532 209/300 Read block 2999 len 28672
18533 210/300 Read block 176 len 4096
18534 211/300 Read block 1532 len 16384
18535 212/300 Read block 3417 len 28672
18536 213/300 Read block 1877 len 32768
18537 214/300 Read block 808 len 36864
18538 215/300 Write block 2152 len 20480 data: 2 3 3 4 4
18539 216/300 Write block 1482 len 8192 data: 2 2
18540 217/300 Write block 3722 len 20480 data: 5 5 5 5 5
18541 218/300 Read block 4059 len 32768
18542 219/300 Write block 4495 len 32768 data: 4 4 2 2 2 2 2 2
18543 220/300 Write block 4366 len 20480 data: 3 3 3 3 3
18544 221/300 Read block 3133 len 36864
18545 222/300 Write block 3248 len 32768 data: 4 3 3 3 3 2 2 2
18546 223/300 Read block 3081 len 28672
18547 224/300 Write block 93 len 24576 data: 4 4 3 3 3 3
18548 225/300 Flush
18549 226/300 Read block 3577 len 32768
18550 227/300 Write block 467 len 20480 data: 5 4 4 4 3
18551 228/300 Read block 3209 len 4096
18552 229/300 Write block 4538 len 16384 data: 2 2 2 2
18553 230/300 Read block 3036 len 16384
18554 231/300 Write block 3859 len 16384 data: 6 5 5 5
18555 232/300 Write block 1801 len 16384 data: 4 4 4 5
18556 233/300 Flush
18557 234/300 Read block 2677 len 32768
18558 235/300 Read block 2549 len 24576
18559 236/300 Write block 2976 len 8192 data: 3 3
18560 237/300 Write block 298 len 8192 data: 5 5
18561 238/300 Write block 2486 len 32768 data: 2 2 2 2 2 2 2 2
18562 239/300 Read block 4793 len 16384
18563 240/300 Write block 428 len 24576 data: 3 3 4 3 3 2
18564 241/300 Read block 1090 len 12288
18565 242/300 Write block 4455 len 28672 data: 2 3 3 2 2 3 3
18566 243/300 Read block 4828 len 16384
18567 244/300 Read block 984 len 20480
18568 245/300 Read block 3679 len 36864
18569 246/300 Read block 4452 len 4096
18570 247/300 Read block 4379 len 20480
18571 248/300 Write block 3782 len 32768 data: 2 2 3 4 5 6 6 7
18572 249/300 Write block 3955 len 8192 data: 6 8
18573 250/300 Read block 4370 len 16384
18574 251/300 Flush
18575 252/300 Write block 275 len 8192 data: 5 5
18576 253/300 Write block 3528 len 36864 data: 2 2 4 3 3 3 3 3 4
18577 254/300 Read block 2465 len 8192
18578 255/300 Read block 1843 len 28672
18579 256/300 Read block 4391 len 16384
18580 257/300 Read block 53 len 8192
18581 258/300 Write block 4485 len 28672 data: 4 3 3 3 3 3 3
18582 259/300 Read block 2 len 28672
18583 260/300 Read block 2431 len 24576
18584 261/300 Read block 4041 len 8192
18585 262/300 Write block 4398 len 40960 data: 3 3 2 2 3 3 2 2 2 5
18586 263/300 Read block 3244 len 32768
18587 264/300 Write block 4041 len 20480 data: 3 5 4 5 5
18588 265/300 Read block 3040 len 16384
18589 266/300 Read block 2624 len 12288
18590 267/300 Read block 4082 len 24576
18591 268/300 Read block 2076 len 12288
18592 269/300 Read block 2780 len 28672
18593 270/300 Write block 3798 len 24576 data: 5 4 4 4 4 3
18594 271/300 Read block 3016 len 16384
18595 272/300 Read block 2565 len 40960
18596 273/300 Read block 3328 len 20480
18597 274/300 Flush
18598 275/300 Write block 2105 len 12288 data: 3 3 3
18599 276/300 Write block 828 len 40960 data: 3 3 2 2 2 3 4 4 4 5
18600 277/300 Write block 1593 len 24576 data: 3 4 4 3 3 3
18601 278/300 Read block 1747 len 12288
18602 279/300 Write block 4480 len 8192 data: 2 5
18603 280/300 Read block 1364 len 12288
18604 281/300 Read block 2271 len 20480
18605 282/300 Write block 3201 len 12288 data: 7 8 5
18606 283/300 Read block 2308 len 4096
18607 284/300 Read block 4429 len 24576
18608 285/300 Flush
18609 286/300 Read block 3150 len 20480
18610 287/300 Write block 577 len 20480 data: 4 4 4 5 5
18611 288/300 Write block 1861 len 8192 data: 2 3
18612 289/300 Write block 2505 len 40960 data: 6 4 3 4 5 8 8 8 5 5
18613 290/300 Write block 2989 len 36864 data: 5 5 5 6 8 9 9 8 8
18614 291/300 Read block 2875 len 16384
18615 292/300 Flush
18616 293/300 Read block 4640 len 4096
18617 294/300 Read block 3036 len 8192
18618 295/300 Read block 4763 len 8192
18619 296/300 Flush
18620 297/300 Read block 1801 len 24576
18621 298/300 Write block 1898 len 24576 data: 5 6 4 3 5 6
18622 299/300 Read block 103 len 32768
18623 300/300 Flush
18624 Main task has work to do, go find it
18625 got dsc Start(1)
18626 start 1
18627 Apr 20 01:09:00.866 INFO request completed, latency_us: 204, response_code: 204, uri: /start/cid/1, method: POST, req_id: f94ebf3a-579a-4d79-a7ee-32c005cc779e, remote_addr: 127.0.0.1:60352, local_addr: 127.0.0.1:9998
18628 Replay: started 1, returned:Ok(())
18629 ----------------------------------------------------------------
18630 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:300
18631 States: Active Offline Active
18632 GW_ID ACK DSID TYPE BLOCKS DS:0 DS:1 DS:2 REPLAY
18633 4223 Acked 5222 Write 5 Done New Done false
18634 4224 Acked 5223 Read 5 Done New Done false
18635 4225 Acked 5224 Write 2 Done New Done false
18636 4226 Acked 5225 Read 7 Done New Done false
18637 4227 Acked 5226 Write 9 Done New Done false
18638 4228 Acked 5227 Write 8 Done New Done false
18639 4229 Acked 5228 Write 10 Done New Done false
18640 4230 Acked 5229 Write 6 Done New Done false
18641 4231 Acked 5230 Read 7 Done New Done false
18642 4232 Acked 5231 Write 3 Done New Done false
18643 4233 Acked 5232 Write 5 Done New Done false
18644 4234 Acked 5233 Write 1 Done New Done false
18645 4235 Acked 5234 Read 5 Done New Done false
18646 4236 Acked 5235 Read 8 Done New Done false
18647 4237 Acked 5236 Read 7 Done New Done false
18648 4238 Acked 5237 Read 9 Done New Done false
18649 4239 Acked 5238 Write 8 Done New Done false
18650 4240 Acked 5239 Flush 0 Done New Done false
18651 4241 Acked 5240 Write 9 Done New Done false
18652 4242 Acked 5241 Read 4 Done New Done false
18653 4243 Acked 5242 Read 3 Done New Done false
18654 4244 Acked 5243 Read 2 Done New Done false
18655 4245 Acked 5244 Write 4 Done New Done false
18656 4246 Acked 5245 Read 4 Done New Done false
18657 4247 Acked 5246 Write 6 Done New Done false
18658 4248 Acked 5247 Write 1 Done New Done false
18659 4249 Acked 5248 Write 6 Done New Done false
18660 4250 Acked 5249 Write 8 Done New Done false
18661 4251 Acked 5250 Read 4 Done New Done false
18662 4252 Acked 5251 Read 5 Done New Done false
18663 4253 Acked 5252 Write 6 Done New Done false
18664 4254 Acked 5253 Read 8 Done New Done false
18665 4255 Acked 5254 Read 5 Done New Done false
18666 4256 Acked 5255 Write 7 Done New Done false
18667 4257 Acked 5256 Write 9 Done New Done false
18668 4258 Acked 5257 Flush 0 Done New Done false
18669 4259 Acked 5258 Write 8 Done New Done false
18670 4260 Acked 5259 Read 2 Done New Done false
18671 4261 Acked 5260 Read 9 Done New Done false
18672 4262 Acked 5261 Write 1 Done New Done false
18673 4263 Acked 5262 Write 6 Done New Done false
18674 4264 Acked 5263 Write 1 Done New Done false
18675 4265 Acked 5264 Write 2 Done New Done false
18676 4266 Acked 5265 Flush 0 Done New Done false
18677 4267 Acked 5266 Read 10 Done New Done false
18678 4268 Acked 5267 Write 4 Done New Done false
18679 4269 Acked 5268 Read 9 Done New Done false
18680 4270 Acked 5269 Read 4 Done New Done false
18681 4271 Acked 5270 Read 2 Done New Done false
18682 4272 Acked 5271 Flush 0 Done New Done false
18683 4273 Acked 5272 Flush 0 Done New Done false
18684 4274 Acked 5273 Read 10 Done New Done false
18685 4275 Acked 5274 Read 8 Done New Done false
18686 4276 Acked 5275 Write 9 Done New Done false
18687 4277 Acked 5276 Read 8 Done New Done false
18688 4278 Acked 5277 Read 8 Done New Done false
18689 4279 Acked 5278 Flush 0 Done New Done false
18690 4280 Acked 5279 Read 7 Done New Done false
18691 4281 Acked 5280 Flush 0 Done New Done false
18692 4282 Acked 5281 Write 8 Done New Done false
18693 4283 Acked 5282 Write 3 Done New Done false
18694 4284 Acked 5283 Read 1 Done New Done false
18695 4285 Acked 5284 Read 2 Done New Done false
18696 4286 Acked 5285 Write 7 Done New Done false
18697 4287 Acked 5286 Write 2 Done New Done false
18698 4288 Acked 5287 Read 10 Done New Done false
18699 4289 Acked 5288 Write 6 Done New Done false
18700 4290 Acked 5289 Write 1 Done New Done false
18701 4291 Acked 5290 Read 6 Done New Done false
18702 4292 Acked 5291 Write 4 Done New Done false
18703 4293 Acked 5292 Read 10 Done New Done false
18704 4294 Acked 5293 Write 8 Done New Done false
18705 4295 Acked 5294 Read 3 Done New Done false
18706 4296 Acked 5295 Write 1 Done New Done false
18707 4297 Acked 5296 Read 3 Done New Done false
18708 4298 Acked 5297 Read 5 Done New Done false
18709 4299 Acked 5298 Write 4 Done New Done false
18710 4300 Acked 5299 Write 6 Done New Done false
18711 4301 Acked 5300 Write 8 Done New Done false
18712 4302 Acked 5301 Read 10 Done New Done false
18713 4303 Acked 5302 Write 1 Done New Done false
18714 4304 Acked 5303 Read 9 Done New Done false
18715 4305 Acked 5304 Write 2 Done New Done false
18716 4306 Acked 5305 Flush 0 Done New Done false
18717 4307 Acked 5306 Read 1 Done New Done false
18718 4308 Acked 5307 Write 7 Done New Done false
18719 4309 Acked 5308 Read 1 Done New Done false
18720 4310 Acked 5309 Write 2 Done New Done false
18721 4311 Acked 5310 Read 9 Done New Done false
18722 4312 Acked 5311 Write 3 Done New Done false
18723 4313 Acked 5312 Read 4 Done New Done false
18724 4314 Acked 5313 Write 9 Done New Done false
18725 4315 Acked 5314 Read 8 Done New Done false
18726 4316 Acked 5315 Flush 0 Done New Done false
18727 4317 Acked 5316 Read 1 Done New Done false
18728 4318 Acked 5317 Read 6 Done New Done false
18729 4319 Acked 5318 Write 6 Done New Done false
18730 4320 Acked 5319 Write 7 Done New Done false
18731 4321 Acked 5320 Read 3 Done New Done false
18732 4322 Acked 5321 Read 2 Done New Done false
18733 4323 Acked 5322 Read 2 Done New Done false
18734 4324 Acked 5323 Read 2 Done New Done false
18735 4325 Acked 5324 Read 6 Done New Done false
18736 4326 Acked 5325 Read 3 Done New Done false
18737 4327 Acked 5326 Read 10 Done New Done false
18738 4328 Acked 5327 Write 4 Done New Done false
18739 4329 Acked 5328 Write 2 Done New Done false
18740 4330 Acked 5329 Write 4 Done New Done false
18741 4331 Acked 5330 Write 2 Done New Done false
18742 4332 Acked 5331 Read 7 Done New Done false
18743 4333 Acked 5332 Write 9 Done New Done false
18744 4334 Acked 5333 Write 2 Done New Done false
18745 4335 Acked 5334 Read 1 Done New Done false
18746 4336 Acked 5335 Read 8 Done New Done false
18747 4337 Acked 5336 Write 1 Done New Done false
18748 4338 Acked 5337 Write 5 Done New Done false
18749 4339 Acked 5338 Write 8 Done New Done false
18750 4340 Acked 5339 Write 4 Done New Done false
18751 4341 Acked 5340 Write 10 Done New Done false
18752 4342 Acked 5341 Flush 0 Done New Done false
18753 4343 Acked 5342 Write 4 Done New Done false
18754 4344 Acked 5343 Write 1 Done New Done false
18755 4345 Acked 5344 Read 1 Done New Done false
18756 4346 Acked 5345 Write 6 Done New Done false
18757 4347 Acked 5346 Read 6 Done New Done false
18758 4348 Acked 5347 Read 1 Done New Done false
18759 4349 Acked 5348 Write 7 Done New Done false
18760 4350 Acked 5349 Read 6 Done New Done false
18761 4351 Acked 5350 Write 4 Done New Done false
18762 4352 Acked 5351 Flush 0 Done New Done false
18763 4353 Acked 5352 Write 1 Done New Done false
18764 4354 Acked 5353 Read 7 Done New Done false
18765 4355 Acked 5354 Write 1 Done New Done false
18766 4356 Acked 5355 Read 10 Done New Done false
18767 4357 Acked 5356 Write 7 Done New Done false
18768 4358 Acked 5357 Read 5 Done New Done false
18769 4359 Acked 5358 Read 4 Done New Done false
18770 4360 Acked 5359 Write 6 Done New Done false
18771 4361 Acked 5360 Write 1 Done New Done false
18772 4362 Acked 5361 Read 7 Done New Done false
18773 4363 Acked 5362 Read 8 Done New Done false
18774 4364 Acked 5363 Write 5 Done New Done false
18775 4365 Acked 5364 Read 2 Done New Done false
18776 4366 Acked 5365 Read 6 Done New Done false
18777 4367 Acked 5366 Read 5 Done New Done false
18778 4368 Acked 5367 Write 5 Done New Done false
18779 4369 Acked 5368 Write 2 Done New Done false
18780 4370 Acked 5369 Write 9 Done New Done false
18781 4371 Acked 5370 Write 7 Done New Done false
18782 4372 Acked 5371 Write 10 Done New Done false
18783 4373 Acked 5372 Write 6 Done New Done false
18784 4374 Acked 5373 Write 9 Done New Done false
18785 4375 Acked 5374 Read 10 Done New Done false
18786 4376 Acked 5375 Read 4 Done New Done false
18787 4377 Acked 5376 Read 6 Done New Done false
18788 4378 Acked 5377 Flush 0 Done New Done false
18789 4379 Acked 5378 Write 4 Done New Done false
18790 4380 Acked 5379 Flush 0 Done New Done false
18791 4381 Acked 5380 Read 4 Done New Done false
18792 4382 Acked 5381 Write 4 Done New Done false
18793 4383 Acked 5382 Write 4 Done New Done false
18794 4384 Acked 5383 Read 8 Done New Done false
18795 4385 Acked 5384 Read 9 Done New Done false
18796 4386 Acked 5385 Read 8 Done New Done false
18797 4387 Acked 5386 Read 9 Done New Done false
18798 4388 Acked 5387 Flush 0 Done New Done false
18799 4389 Acked 5388 Flush 0 Done New Done false
18800 4390 Acked 5389 Read 7 Done New Done false
18801 4391 Acked 5390 Flush 0 Done New Done false
18802 4392 Acked 5391 Read 2 Done New Done false
18803 4393 Acked 5392 Write 2 Done New Done false
18804 4394 Acked 5393 Write 6 Done New Done false
18805 4395 Acked 5394 Read 4 Done New Done false
18806 4396 Acked 5395 Flush 0 Done New Done false
18807 4397 Acked 5396 Write 10 Done New Done false
18808 4398 Acked 5397 Write 4 Done New Done false
18809 4399 Acked 5398 Write 3 Done New Done false
18810 4400 Acked 5399 Read 6 Done New Done false
18811 4401 Acked 5400 Read 1 Done New Done false
18812 4402 Acked 5401 Read 5 Done New Done false
18813 4403 Acked 5402 Read 2 Done New Done false
18814 4404 Acked 5403 Write 2 Done New Done false
18815 4405 Acked 5404 Read 8 Done New Done false
18816 4406 Acked 5405 Read 5 Done New Done false
18817 4407 Acked 5406 Write 8 Done New Done false
18818 4408 Acked 5407 Write 4 Done New Done false
18819 4409 Acked 5408 Write 10 Done New Done false
18820 4410 Acked 5409 Read 6 Done New Done false
18821 4411 Acked 5410 Read 6 Done New Done false
18822 4412 Acked 5411 Read 5 Done New Done false
18823 4413 Acked 5412 Flush 0 Done New Done false
18824 4414 Acked 5413 Write 8 Done New Done false
18825 4415 Acked 5414 Read 9 Done New Done false
18826 4416 Acked 5415 Read 9 Done New Done false
18827 4417 Acked 5416 Write 2 Done New Done false
18828 4418 Acked 5417 Flush 0 Done New Done false
18829 4419 Acked 5418 Read 3 Done New Done false
18830 4420 Acked 5419 Read 3 Done New Done false
18831 4421 Acked 5420 Write 6 Done New Done false
18832 4422 Acked 5421 Write 1 Done New Done false
18833 4423 Acked 5422 Read 2 Done New Done false
18834 4424 Acked 5423 Read 2 Done New Done false
18835 4425 Acked 5424 Write 7 Done New Done false
18836 4426 Acked 5425 Read 10 Done New Done false
18837 4427 Acked 5426 Read 9 Done New Done false
18838 4428 Acked 5427 Read 1 Done New Done false
18839 4429 Acked 5428 Write 10 Done New Done false
18840 4430 Acked 5429 Read 7 Done New Done false
18841 4431 Acked 5430 Read 7 Done New Done false
18842 4432 Acked 5431 Read 1 Done New Done false
18843 4433 Acked 5432 Read 4 Done New Done false
18844 4434 Acked 5433 Read 7 Done New Done false
18845 4435 Acked 5434 Read 8 Done New Done false
18846 4436 Acked 5435 Read 9 Done New Done false
18847 4437 Acked 5436 Write 5 Done New Done false
18848 4438 Acked 5437 Write 2 Done New Done false
18849 4439 Acked 5438 Write 5 Done New Done false
18850 4440 Acked 5439 Read 8 Done New Done false
18851 4441 Acked 5440 Write 8 Done New Done false
18852 4442 Acked 5441 Write 5 Done New Done false
18853 4443 Acked 5442 Read 9 Done New Done false
18854 4444 Acked 5443 Write 8 Done New Done false
18855 4445 Acked 5444 Read 7 Done New Done false
18856 4446 Acked 5445 Write 6 Done New Done false
18857 4447 Acked 5446 Flush 0 Done New Done false
18858 4448 Acked 5447 Read 8 Done New Done false
18859 4449 Acked 5448 Write 5 Done New Done false
18860 4450 Acked 5449 Read 1 Done New Done false
18861 4451 Acked 5450 Write 4 Done New Done false
18862 4452 Acked 5451 Read 4 Done New Done false
18863 4453 Acked 5452 Write 4 Done New Done false
18864 4454 Acked 5453 Write 4 Done New Done false
18865 4455 Acked 5454 Flush 0 Done New Done false
18866 4456 Acked 5455 Read 8 Done New Done false
18867 4457 Acked 5456 Read 6 Done New Done false
18868 4458 Acked 5457 Write 2 Done New Done false
18869 4459 Acked 5458 Write 2 Done New Done false
18870 4460 Acked 5459 Write 8 Done New Done false
18871 4461 Acked 5460 Read 4 Done New Done false
18872 4462 Acked 5461 Write 6 Done New Done false
18873 4463 Acked 5462 Read 3 Done New Done false
18874 4464 Acked 5463 Write 7 Done New Done false
18875 4465 Acked 5464 Read 4 Done New Done false
18876 4466 Acked 5465 Read 5 Done New Done false
18877 4467 Acked 5466 Read 9 Done New Done false
18878 4468 Acked 5467 Read 1 Done New Done false
18879 4469 Acked 5468 Read 5 Done New Done false
18880 4470 Acked 5469 Write 8 Done New Done false
18881 4471 Acked 5470 Write 2 Done New Done false
18882 4472 Acked 5471 Read 4 Done New Done false
18883 4473 Acked 5472 Flush 0 Done New Done false
18884 4474 Acked 5473 Write 2 Done New Done false
18885 4475 Acked 5474 Write 9 Done New Done false
18886 4476 Acked 5475 Read 2 Done New Done false
18887 4477 Acked 5476 Read 7 Done New Done false
18888 4478 Acked 5477 Read 4 Done New Done false
18889 4479 Acked 5478 Read 2 Done New Done false
18890 4480 Acked 5479 Write 7 Done New Done false
18891 4481 Acked 5480 Read 7 Done New Done false
18892 4482 Acked 5481 Read 6 Done New Done false
18893 4483 Acked 5482 Read 2 Done New Done false
18894 4484 Acked 5483 Write 10 Done New Done false
18895 4485 Acked 5484 Read 8 Done New Done false
18896 4486 Acked 5485 Write 5 Done New Done false
18897 4487 Acked 5486 Read 4 Done New Done false
18898 4488 Acked 5487 Read 3 Done New Done false
18899 4489 Acked 5488 Read 6 Done New Done false
18900 4490 Acked 5489 Read 3 Done New Done false
18901 4491 Acked 5490 Read 7 Done New Done false
18902 4492 Acked 5491 Write 6 Done New Done false
18903 4493 Acked 5492 Read 4 Done New Done false
18904 4494 Acked 5493 Read 10 Done New Done false
18905 4495 Acked 5494 Read 5 Done New Done false
18906 4496 Acked 5495 Flush 0 Done New Done false
18907 4497 Acked 5496 Write 3 Done New Done false
18908 4498 Acked 5497 Write 10 Done New Done false
18909 4499 Acked 5498 Write 6 Done New Done false
18910 4500 Acked 5499 Read 3 Done New Done false
18911 4501 Acked 5500 Write 2 Done New Done false
18912 4502 Acked 5501 Read 3 Done New Done false
18913 4503 Acked 5502 Read 5 Done New Done false
18914 4504 Acked 5503 Write 3 Done New Done false
18915 4505 Acked 5504 Read 1 Done New Done false
18916 4506 Acked 5505 Read 6 Done New Done false
18917 4507 Acked 5506 Flush 0 Done New Done false
18918 4508 Acked 5507 Read 5 Done New Done false
18919 4509 Acked 5508 Write 5 Done New Done false
18920 4510 Acked 5509 Write 2 Done New Done false
18921 4511 Acked 5510 Write 10 Done New Done false
18922 4512 Acked 5511 Write 9 Done New Done false
18923 4513 Acked 5512 Read 4 Done New Done false
18924 4514 Acked 5513 Flush 0 Done New Done false
18925 4515 Acked 5514 Read 1 Done New Done false
18926 4516 Acked 5515 Read 2 Done New Done false
18927 4517 Acked 5516 Read 2 Done New Done false
18928 4518 Acked 5517 Flush 0 Done New Done false
18929 4519 Acked 5518 Read 6 Done New Done false
18930 4520 Acked 5519 Write 6 Done New Done false
18931 4521 Acked 5520 Read 8 Done New Done false
18932 4522 Acked 5521 Flush 0 Done New Done false
18933 STATES DS:0 DS:1 DS:2 TOTAL
18934 New 0 300 0 300
18935 Sent 0 0 0 0
18936 Done 300 0 300 600
18937 Skipped 0 0 0 0
18938 Error 0 0 0 0
18939 Last Flush: 5521 5221 5521
18940 Downstairs last five completed: 5221 5220 5219 5218 5217
18941 Upstairs last five completed: 4522 4521 4520 4519 4518
18942 CLIENT: Up:0 ds:300 act:2
18943 [8820] got start action
18944 [8820] I am going to restart
18945 Starting downstairs at port 8820
18946 Make output file at "/tmp/dsc/downstairs-8820.txt"
18947 [8820][1] reports Starting
18948 Downstairs /var/tmp/dsc/region/8820 port 8820 PID:Some(1211)
18949 [8820][1] reports Running
18950 ----------------------------------------------------------------
18951 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:300
18952 States: Active Offline Active
18953 GW_ID ACK DSID TYPE BLOCKS DS:0 DS:1 DS:2 REPLAY
18954 4223 Acked 5222 Write 5 Done New Done false
18955 4224 Acked 5223 Read 5 Done New Done false
18956 4225 Acked 5224 Write 2 Done New Done false
18957 4226 Acked 5225 Read 7 Done New Done false
18958 4227 Acked 5226 Write 9 Done New Done false
18959 4228 Acked 5227 Write 8 Done New Done false
18960 4229 Acked 5228 Write 10 Done New Done false
18961 4230 Acked 5229 Write 6 Done New Done false
18962 4231 Acked 5230 Read 7 Done New Done false
18963 4232 Acked 5231 Write 3 Done New Done false
18964 4233 Acked 5232 Write 5 Done New Done false
18965 4234 Acked 5233 Write 1 Done New Done false
18966 4235 Acked 5234 Read 5 Done New Done false
18967 4236 Acked 5235 Read 8 Done New Done false
18968 4237 Acked 5236 Read 7 Done New Done false
18969 4238 Acked 5237 Read 9 Done New Done false
18970 4239 Acked 5238 Write 8 Done New Done false
18971 4240 Acked 5239 Flush 0 Done New Done false
18972 4241 Acked 5240 Write 9 Done New Done false
18973 4242 Acked 5241 Read 4 Done New Done false
18974 4243 Acked 5242 Read 3 Done New Done false
18975 4244 Acked 5243 Read 2 Done New Done false
18976 4245 Acked 5244 Write 4 Done New Done false
18977 4246 Acked 5245 Read 4 Done New Done false
18978 4247 Acked 5246 Write 6 Done New Done false
18979 4248 Acked 5247 Write 1 Done New Done false
18980 4249 Acked 5248 Write 6 Done New Done false
18981 4250 Acked 5249 Write 8 Done New Done false
18982 4251 Acked 5250 Read 4 Done New Done false
18983 4252 Acked 5251 Read 5 Done New Done false
18984 4253 Acked 5252 Write 6 Done New Done false
18985 4254 Acked 5253 Read 8 Done New Done false
18986 4255 Acked 5254 Read 5 Done New Done false
18987 4256 Acked 5255 Write 7 Done New Done false
18988 4257 Acked 5256 Write 9 Done New Done false
18989 4258 Acked 5257 Flush 0 Done New Done false
18990 4259 Acked 5258 Write 8 Done New Done false
18991 4260 Acked 5259 Read 2 Done New Done false
18992 4261 Acked 5260 Read 9 Done New Done false
18993 4262 Acked 5261 Write 1 Done New Done false
18994 4263 Acked 5262 Write 6 Done New Done false
18995 4264 Acked 5263 Write 1 Done New Done false
18996 4265 Acked 5264 Write 2 Done New Done false
18997 4266 Acked 5265 Flush 0 Done New Done false
18998 4267 Acked 5266 Read 10 Done New Done false
18999 4268 Acked 5267 Write 4 Done New Done false
19000 4269 Acked 5268 Read 9 Done New Done false
19001 4270 Acked 5269 Read 4 Done New Done false
19002 4271 Acked 5270 Read 2 Done New Done false
19003 4272 Acked 5271 Flush 0 Done New Done false
19004 4273 Acked 5272 Flush 0 Done New Done false
19005 4274 Acked 5273 Read 10 Done New Done false
19006 4275 Acked 5274 Read 8 Done New Done false
19007 4276 Acked 5275 Write 9 Done New Done false
19008 4277 Acked 5276 Read 8 Done New Done false
19009 4278 Acked 5277 Read 8 Done New Done false
19010 4279 Acked 5278 Flush 0 Done New Done false
19011 4280 Acked 5279 Read 7 Done New Done false
19012 4281 Acked 5280 Flush 0 Done New Done false
19013 4282 Acked 5281 Write 8 Done New Done false
19014 4283 Acked 5282 Write 3 Done New Done false
19015 4284 Acked 5283 Read 1 Done New Done false
19016 4285 Acked 5284 Read 2 Done New Done false
19017 4286 Acked 5285 Write 7 Done New Done false
19018 4287 Acked 5286 Write 2 Done New Done false
19019 4288 Acked 5287 Read 10 Done New Done false
19020 4289 Acked 5288 Write 6 Done New Done false
19021 4290 Acked 5289 Write 1 Done New Done false
19022 4291 Acked 5290 Read 6 Done New Done false
19023 4292 Acked 5291 Write 4 Done New Done false
19024 4293 Acked 5292 Read 10 Done New Done false
19025 4294 Acked 5293 Write 8 Done New Done false
19026 4295 Acked 5294 Read 3 Done New Done false
19027 4296 Acked 5295 Write 1 Done New Done false
19028 4297 Acked 5296 Read 3 Done New Done false
19029 4298 Acked 5297 Read 5 Done New Done false
19030 4299 Acked 5298 Write 4 Done New Done false
19031 4300 Acked 5299 Write 6 Done New Done false
19032 4301 Acked 5300 Write 8 Done New Done false
19033 4302 Acked 5301 Read 10 Done New Done false
19034 4303 Acked 5302 Write 1 Done New Done false
19035 4304 Acked 5303 Read 9 Done New Done false
19036 4305 Acked 5304 Write 2 Done New Done false
19037 4306 Acked 5305 Flush 0 Done New Done false
19038 4307 Acked 5306 Read 1 Done New Done false
19039 4308 Acked 5307 Write 7 Done New Done false
19040 4309 Acked 5308 Read 1 Done New Done false
19041 4310 Acked 5309 Write 2 Done New Done false
19042 4311 Acked 5310 Read 9 Done New Done false
19043 4312 Acked 5311 Write 3 Done New Done false
19044 4313 Acked 5312 Read 4 Done New Done false
19045 4314 Acked 5313 Write 9 Done New Done false
19046 4315 Acked 5314 Read 8 Done New Done false
19047 4316 Acked 5315 Flush 0 Done New Done false
19048 4317 Acked 5316 Read 1 Done New Done false
19049 4318 Acked 5317 Read 6 Done New Done false
19050 4319 Acked 5318 Write 6 Done New Done false
19051 4320 Acked 5319 Write 7 Done New Done false
19052 4321 Acked 5320 Read 3 Done New Done false
19053 4322 Acked 5321 Read 2 Done New Done false
19054 4323 Acked 5322 Read 2 Done New Done false
19055 4324 Acked 5323 Read 2 Done New Done false
19056 4325 Acked 5324 Read 6 Done New Done false
19057 4326 Acked 5325 Read 3 Done New Done false
19058 4327 Acked 5326 Read 10 Done New Done false
19059 4328 Acked 5327 Write 4 Done New Done false
19060 4329 Acked 5328 Write 2 Done New Done false
19061 4330 Acked 5329 Write 4 Done New Done false
19062 4331 Acked 5330 Write 2 Done New Done false
19063 4332 Acked 5331 Read 7 Done New Done false
19064 4333 Acked 5332 Write 9 Done New Done false
19065 4334 Acked 5333 Write 2 Done New Done false
19066 4335 Acked 5334 Read 1 Done New Done false
19067 4336 Acked 5335 Read 8 Done New Done false
19068 4337 Acked 5336 Write 1 Done New Done false
19069 4338 Acked 5337 Write 5 Done New Done false
19070 4339 Acked 5338 Write 8 Done New Done false
19071 4340 Acked 5339 Write 4 Done New Done false
19072 4341 Acked 5340 Write 10 Done New Done false
19073 4342 Acked 5341 Flush 0 Done New Done false
19074 4343 Acked 5342 Write 4 Done New Done false
19075 4344 Acked 5343 Write 1 Done New Done false
19076 4345 Acked 5344 Read 1 Done New Done false
19077 4346 Acked 5345 Write 6 Done New Done false
19078 4347 Acked 5346 Read 6 Done New Done false
19079 4348 Acked 5347 Read 1 Done New Done false
19080 4349 Acked 5348 Write 7 Done New Done false
19081 4350 Acked 5349 Read 6 Done New Done false
19082 4351 Acked 5350 Write 4 Done New Done false
19083 4352 Acked 5351 Flush 0 Done New Done false
19084 4353 Acked 5352 Write 1 Done New Done false
19085 4354 Acked 5353 Read 7 Done New Done false
19086 4355 Acked 5354 Write 1 Done New Done false
19087 4356 Acked 5355 Read 10 Done New Done false
19088 4357 Acked 5356 Write 7 Done New Done false
19089 4358 Acked 5357 Read 5 Done New Done false
19090 4359 Acked 5358 Read 4 Done New Done false
19091 4360 Acked 5359 Write 6 Done New Done false
19092 4361 Acked 5360 Write 1 Done New Done false
19093 4362 Acked 5361 Read 7 Done New Done false
19094 4363 Acked 5362 Read 8 Done New Done false
19095 4364 Acked 5363 Write 5 Done New Done false
19096 4365 Acked 5364 Read 2 Done New Done false
19097 4366 Acked 5365 Read 6 Done New Done false
19098 4367 Acked 5366 Read 5 Done New Done false
19099 4368 Acked 5367 Write 5 Done New Done false
19100 4369 Acked 5368 Write 2 Done New Done false
19101 4370 Acked 5369 Write 9 Done New Done false
19102 4371 Acked 5370 Write 7 Done New Done false
19103 4372 Acked 5371 Write 10 Done New Done false
19104 4373 Acked 5372 Write 6 Done New Done false
19105 4374 Acked 5373 Write 9 Done New Done false
19106 4375 Acked 5374 Read 10 Done New Done false
19107 4376 Acked 5375 Read 4 Done New Done false
19108 4377 Acked 5376 Read 6 Done New Done false
19109 4378 Acked 5377 Flush 0 Done New Done false
19110 4379 Acked 5378 Write 4 Done New Done false
19111 4380 Acked 5379 Flush 0 Done New Done false
19112 4381 Acked 5380 Read 4 Done New Done false
19113 4382 Acked 5381 Write 4 Done New Done false
19114 4383 Acked 5382 Write 4 Done New Done false
19115 4384 Acked 5383 Read 8 Done New Done false
19116 4385 Acked 5384 Read 9 Done New Done false
19117 4386 Acked 5385 Read 8 Done New Done false
19118 4387 Acked 5386 Read 9 Done New Done false
19119 4388 Acked 5387 Flush 0 Done New Done false
19120 4389 Acked 5388 Flush 0 Done New Done false
19121 4390 Acked 5389 Read 7 Done New Done false
19122 4391 Acked 5390 Flush 0 Done New Done false
19123 4392 Acked 5391 Read 2 Done New Done false
19124 4393 Acked 5392 Write 2 Done New Done false
19125 4394 Acked 5393 Write 6 Done New Done false
19126 4395 Acked 5394 Read 4 Done New Done false
19127 4396 Acked 5395 Flush 0 Done New Done false
19128 4397 Acked 5396 Write 10 Done New Done false
19129 4398 Acked 5397 Write 4 Done New Done false
19130 4399 Acked 5398 Write 3 Done New Done false
19131 4400 Acked 5399 Read 6 Done New Done false
19132 4401 Acked 5400 Read 1 Done New Done false
19133 4402 Acked 5401 Read 5 Done New Done false
19134 4403 Acked 5402 Read 2 Done New Done false
19135 4404 Acked 5403 Write 2 Done New Done false
19136 4405 Acked 5404 Read 8 Done New Done false
19137 4406 Acked 5405 Read 5 Done New Done false
19138 4407 Acked 5406 Write 8 Done New Done false
19139 4408 Acked 5407 Write 4 Done New Done false
19140 4409 Acked 5408 Write 10 Done New Done false
19141 4410 Acked 5409 Read 6 Done New Done false
19142 4411 Acked 5410 Read 6 Done New Done false
19143 4412 Acked 5411 Read 5 Done New Done false
19144 4413 Acked 5412 Flush 0 Done New Done false
19145 4414 Acked 5413 Write 8 Done New Done false
19146 4415 Acked 5414 Read 9 Done New Done false
19147 4416 Acked 5415 Read 9 Done New Done false
19148 4417 Acked 5416 Write 2 Done New Done false
19149 4418 Acked 5417 Flush 0 Done New Done false
19150 4419 Acked 5418 Read 3 Done New Done false
19151 4420 Acked 5419 Read 3 Done New Done false
19152 4421 Acked 5420 Write 6 Done New Done false
19153 4422 Acked 5421 Write 1 Done New Done false
19154 4423 Acked 5422 Read 2 Done New Done false
19155 4424 Acked 5423 Read 2 Done New Done false
19156 4425 Acked 5424 Write 7 Done New Done false
19157 4426 Acked 5425 Read 10 Done New Done false
19158 4427 Acked 5426 Read 9 Done New Done false
19159 4428 Acked 5427 Read 1 Done New Done false
19160 4429 Acked 5428 Write 10 Done New Done false
19161 4430 Acked 5429 Read 7 Done New Done false
19162 4431 Acked 5430 Read 7 Done New Done false
19163 4432 Acked 5431 Read 1 Done New Done false
19164 4433 Acked 5432 Read 4 Done New Done false
19165 4434 Acked 5433 Read 7 Done New Done false
19166 4435 Acked 5434 Read 8 Done New Done false
19167 4436 Acked 5435 Read 9 Done New Done false
19168 4437 Acked 5436 Write 5 Done New Done false
19169 4438 Acked 5437 Write 2 Done New Done false
19170 4439 Acked 5438 Write 5 Done New Done false
19171 4440 Acked 5439 Read 8 Done New Done false
19172 4441 Acked 5440 Write 8 Done New Done false
19173 4442 Acked 5441 Write 5 Done New Done false
19174 4443 Acked 5442 Read 9 Done New Done false
19175 4444 Acked 5443 Write 8 Done New Done false
19176 4445 Acked 5444 Read 7 Done New Done false
19177 4446 Acked 5445 Write 6 Done New Done false
19178 4447 Acked 5446 Flush 0 Done New Done false
19179 4448 Acked 5447 Read 8 Done New Done false
19180 4449 Acked 5448 Write 5 Done New Done false
19181 4450 Acked 5449 Read 1 Done New Done false
19182 4451 Acked 5450 Write 4 Done New Done false
19183 4452 Acked 5451 Read 4 Done New Done false
19184 4453 Acked 5452 Write 4 Done New Done false
19185 4454 Acked 5453 Write 4 Done New Done false
19186 4455 Acked 5454 Flush 0 Done New Done false
19187 4456 Acked 5455 Read 8 Done New Done false
19188 4457 Acked 5456 Read 6 Done New Done false
19189 4458 Acked 5457 Write 2 Done New Done false
19190 4459 Acked 5458 Write 2 Done New Done false
19191 4460 Acked 5459 Write 8 Done New Done false
19192 4461 Acked 5460 Read 4 Done New Done false
19193 4462 Acked 5461 Write 6 Done New Done false
19194 4463 Acked 5462 Read 3 Done New Done false
19195 4464 Acked 5463 Write 7 Done New Done false
19196 4465 Acked 5464 Read 4 Done New Done false
19197 4466 Acked 5465 Read 5 Done New Done false
19198 4467 Acked 5466 Read 9 Done New Done false
19199 4468 Acked 5467 Read 1 Done New Done false
19200 4469 Acked 5468 Read 5 Done New Done false
19201 4470 Acked 5469 Write 8 Done New Done false
19202 4471 Acked 5470 Write 2 Done New Done false
19203 4472 Acked 5471 Read 4 Done New Done false
19204 4473 Acked 5472 Flush 0 Done New Done false
19205 4474 Acked 5473 Write 2 Done New Done false
19206 4475 Acked 5474 Write 9 Done New Done false
19207 4476 Acked 5475 Read 2 Done New Done false
19208 4477 Acked 5476 Read 7 Done New Done false
19209 4478 Acked 5477 Read 4 Done New Done false
19210 4479 Acked 5478 Read 2 Done New Done false
19211 4480 Acked 5479 Write 7 Done New Done false
19212 4481 Acked 5480 Read 7 Done New Done false
19213 4482 Acked 5481 Read 6 Done New Done false
19214 4483 Acked 5482 Read 2 Done New Done false
19215 4484 Acked 5483 Write 10 Done New Done false
19216 4485 Acked 5484 Read 8 Done New Done false
19217 4486 Acked 5485 Write 5 Done New Done false
19218 4487 Acked 5486 Read 4 Done New Done false
19219 4488 Acked 5487 Read 3 Done New Done false
19220 4489 Acked 5488 Read 6 Done New Done false
19221 4490 Acked 5489 Read 3 Done New Done false
19222 4491 Acked 5490 Read 7 Done New Done false
19223 4492 Acked 5491 Write 6 Done New Done false
19224 4493 Acked 5492 Read 4 Done New Done false
19225 4494 Acked 5493 Read 10 Done New Done false
19226 4495 Acked 5494 Read 5 Done New Done false
19227 4496 Acked 5495 Flush 0 Done New Done false
19228 4497 Acked 5496 Write 3 Done New Done false
19229 4498 Acked 5497 Write 10 Done New Done false
19230 4499 Acked 5498 Write 6 Done New Done false
19231 4500 Acked 5499 Read 3 Done New Done false
19232 4501 Acked 5500 Write 2 Done New Done false
19233 4502 Acked 5501 Read 3 Done New Done false
19234 4503 Acked 5502 Read 5 Done New Done false
19235 4504 Acked 5503 Write 3 Done New Done false
19236 4505 Acked 5504 Read 1 Done New Done false
19237 4506 Acked 5505 Read 6 Done New Done false
19238 4507 Acked 5506 Flush 0 Done New Done false
19239 4508 Acked 5507 Read 5 Done New Done false
19240 4509 Acked 5508 Write 5 Done New Done false
19241 4510 Acked 5509 Write 2 Done New Done false
19242 4511 Acked 5510 Write 10 Done New Done false
19243 4512 Acked 5511 Write 9 Done New Done false
19244 4513 Acked 5512 Read 4 Done New Done false
19245 4514 Acked 5513 Flush 0 Done New Done false
19246 4515 Acked 5514 Read 1 Done New Done false
19247 4516 Acked 5515 Read 2 Done New Done false
19248 4517 Acked 5516 Read 2 Done New Done false
19249 4518 Acked 5517 Flush 0 Done New Done false
19250 4519 Acked 5518 Read 6 Done New Done false
19251 4520 Acked 5519 Write 6 Done New Done false
19252 4521 Acked 5520 Read 8 Done New Done false
19253 4522 Acked 5521 Flush 0 Done New Done false
19254 STATES DS:0 DS:1 DS:2 TOTAL
19255 New 0 300 0 300
19256 Sent 0 0 0 0
19257 Done 300 0 300 600
19258 Skipped 0 0 0 0
19259 Error 0 0 0 0
19260 Last Flush: 5521 5221 5521
19261 Downstairs last five completed: 5221 5220 5219 5218 5217
19262 Upstairs last five completed: 4522 4521 4520 4519 4518
19263 CLIENT: Up:0 ds:300 act:2
192642024-04-20T01:09:06.556ZINFOcrucible: connecting to 127.0.0.1:8820 = io task client = 1 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
192652024-04-20T01:09:06.556ZINFOcrucible: ds_connection connected from Ok(127.0.0.1:54864) = io task client = 1 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
192662024-04-20T01:09:06.558ZINFOcrucible: downstairs client at Some(127.0.0.1:8820) has region UUID 12345678-0000-0000-0000-000000008820 = downstairs client = 1 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
192672024-04-20T01:09:06.558ZINFOcrucible: Returning UUID:12345678-0000-0000-0000-000000008820 matches = downstairs client = 1 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
192682024-04-20T01:09:06.558ZINFOcrucible: send last flush ID to this DS: 5221 = downstairs client = 1 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
192692024-04-20T01:09:06.558ZINFOcrucible: Replied this last flush ID: 5221 = downstairs client = 1 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
192702024-04-20T01:09:06.558ZINFOcrucible: ds_transition from Offline to Replay = downstairs client = 1 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
192712024-04-20T01:09:06.558ZINFOcrucible: [1] Transition from Offline to Replay = downstairs client = 1 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
192722024-04-20T01:09:06.558ZINFOcrucible: ds_transition from Replay to Active = downstairs client = 1 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
192732024-04-20T01:09:06.558ZINFOcrucible: [1] Transition from Replay to Active = downstairs client = 1 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
19274 ----------------------------------------------------------------
19275 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:0
19276 Downstairs last five completed: 5521 5520 5519 5518 5517
19277 Upstairs last five completed: 4522 4521 4520 4519 4518
19278 CLIENT: Up:0 ds:0 act:3
19279 Replay: All jobs finished, all DS active.
19280 Main task has work to do, go find it
19281 got dsc Stop(2)
19282 stop 2
19283 Apr 20 01:09:08.871 INFO request completed[8830] Got stop action so:false kr:false
19284 , latency_us: 326, response_code: 204, uri: /stop/cid/2, method: POST, req_id: c255d1b8-8cc5-4e13-91d5-ba6e7d708e54, remote_addr: 127.0.0.1:60352, local_addr: 127.0.0.1:9998
192852024-04-20T01:09:08.872ZWARNcrucible: downstairs disconnected = io task client = 2 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
192862024-04-20T01:09:08.872ZWARNcrucible: client task is sending Done(Finished) = io task client = 2 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
192872024-04-20T01:09:08.872ZWARNcrucible: downstairs task for 2 stopped due to Finished session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
19288 Apr 20 01:09:08.872 INFO request completed, latency_us: 113{"msg":"Gone missing, transition from Active to Offline","v":0,"name":"crucible","level":30,"time":"2024-04-20T01:09:08.872202433Z","hostname":"w-01HVWGBJP7HK0H9TQ26T6N3X8M","pid":1196,"client":"2","":"downstairs","session_id":"132b460a-26a0-4532-b1ab-4f8c07d4c6c7"}
19289 , response_code: 200, uri: /state/cid/2, method: GET, req_id: 1ae0df9e-0ffc-4318-8c92-ee262068b728, remote_addr: {"msg":"[2] client re-new 0 jobs since flush 5521","v":0,"name":"crucible","level":30,"time":"2024-04-20T01:09:08.872279811Z","hostname":"w-01HVWGBJP7HK0H9TQ26T6N3X8M","pid":1196,"":"downstairs","":"downstairs","session_id":"132b460a-26a0-4532-b1ab-4f8c07d4c6c7"}
19290 127.0.0.1:60352, local_addr: 127.0.0.1:9998
192912024-04-20T01:09:08.872ZINFOcrucible: [2] Marked 0 jobs for replay since flush: 5521 = downstairs session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
192922024-04-20T01:09:08.872ZINFOcrucible: client task is exiting = io task client = 2 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
19293 [8830] Exited with: ExitStatus(unix_wait_status(9))
19294 [8830][2] reports Exit
19295 Apr 20 01:09:12.873 INFO request completed, latency_us: 201, response_code: 200, uri: /state/cid/2, method: GET, req_id: a93f5418-3de5-4ace-955b-84f71000ef86, remote_addr: 127.0.0.1:60352, local_addr: 127.0.0.1:9998
19296 001/300 Write block 3046 len 8192 data: 5 5
19297 002/300 Write block 951 len 16384 data: 5 4 5 3
19298 003/300 Flush
19299 004/300 Read block 269 len 20480
19300 005/300 Read block 3521 len 32768
19301 006/300 Write block 2309 len 24576 data: 3 3 3 4 4 3
19302 007/300 Write block 1387 len 16384 data: 5 5 4 4
19303 008/300 Flush
19304 009/300 Read block 1231 len 4096
19305 010/300 Write block 1903 len 36864 data: 7 5 5 3 2 2 2 2 3
19306 011/300 Read block 811 len 12288
19307 012/300 Flush
19308 013/300 Read block 4858 len 36864
19309 014/300 Read block 1638 len 24576
19310 015/300 Read block 792 len 32768
19311 016/300 Read block 3651 len 4096
19312 017/300 Write block 2630 len 36864 data: 3 2 2 2 2 2 3 4 4
19313 018/300 Read block 4514 len 4096
19314 019/300 Write block 949 len 16384 data: 4 4 6 5
19315 020/300 Read block 289 len 28672
19316 021/300 Flush
19317 022/300 Read block 2835 len 4096
19318 023/300 Read block 939 len 8192
19319 024/300 Read block 195 len 8192
19320 025/300 Write block 4714 len 16384 data: 5 3 3 3
19321 026/300 Read block 1404 len 16384
19322 027/300 Read block 2700 len 4096
19323 028/300 Write block 3000 len 4096 data: 4
19324 029/300 Read block 786 len 28672
19325 030/300 Read block 3403 len 32768
19326 031/300 Read block 3733 len 28672
19327 032/300 Write block 4800 len 20480 data: 5 5 4 6 6
19328 033/300 Write block 3148 len 16384 data: 2 2 2 2
19329 034/300 Write block 4946 len 40960 data: 4 4 5 4 5 5 6 5 5 4
19330 035/300 Write block 2679 len 40960 data: 3 3 3 4 4 4 4 4 4 4
19331 036/300 Write block 1758 len 8192 data: 3 3
19332 037/300 Write block 3742 len 28672 data: 3 3 3 3 5 5 4
19333 038/300 Read block 2085 len 4096
19334 039/300 Read block 3482 len 16384
19335 040/300 Read block 344 len 36864
19336 041/300 Flush
19337 042/300 Flush
19338 043/300 Write block 594 len 8192 data: 4 5
19339 044/300 Write block 971 len 40960 data: 3 3 3 3 2 2 2 3 3 3
19340 045/300 Read block 1973 len 16384
19341 046/300 Read block 1273 len 20480
19342 047/300 Write block 4621 len 24576 data: 3 3 3 3 3 4
19343 048/300 Write block 4236 len 24576 data: 2 3 4 4 5 5
19344 049/300 Write block 4865 len 16384 data: 2 2 4 5
19345 050/300 Read block 3101 len 20480
19346 051/300 Read block 4537 len 32768
19347 052/300 Read block 4670 len 32768
19348 053/300 Write block 4548 len 20480 data: 3 3 3 3 2
19349 054/300 Write block 827 len 20480 data: 4 4 4 3 3
19350 055/300 Read block 4059 len 24576
19351 056/300 Write block 1303 len 20480 data: 4 6 7 7 7
19352 057/300 Read block 4984 len 8192
19353 058/300 Write block 2121 len 32768 data: 3 2 3 4 4 5 5 5
19354 059/300 Write block 916 len 20480 data: 4 3 2 2 2
19355 060/300 Write block 4779 len 28672 data: 4 5 4 5 5 4 6
19356 061/300 Write block 4820 len 36864 data: 6 7 7 6 5 6 6 6 5
19357 062/300 Read block 784 len 16384
19358 063/300 Read block 1604 len 20480
19359 064/300 Read block 2226 len 20480
19360 065/300 Write block 810 len 24576 data: 3 3 3 3 3 4
19361 066/300 Write block 1619 len 20480 data: 3 3 3 3 3
19362 067/300 Write block 2846 len 20480 data: 6 7 6 3 4
19363 068/300 Write block 2063 len 24576 data: 4 4 5 5 5 6
19364 069/300 Read block 4615 len 28672
19365 070/300 Read block 381 len 24576
19366 071/300 Write block 1221 len 40960 data: 3 2 2 3 4 4 3 3 3 3
19367 072/300 Read block 2039 len 16384
19368 073/300 Write block 3117 len 32768 data: 5 5 4 4 3 3 3 3
19369 074/300 Write block 4676 len 16384 data: 5 5 5 5
19370 075/300 Read block 4712 len 8192
19371 076/300 Read block 784 len 24576
19372 077/300 Read block 449 len 16384
19373 078/300 Write block 3704 len 28672 data: 5 4 4 4 4 4 3
19374 079/300 Write block 776 len 32768 data: 5 4 3 2 2 3 3 4
19375 080/300 Write block 1100 len 12288 data: 5 5 5
19376 081/300 Read block 1814 len 24576
19377 082/300 Write block 2008 len 12288 data: 7 5 5
19378 083/300 Write block 232 len 16384 data: 4 3 3 2
19379 084/300 Flush
19380 085/300 Flush
19381 086/300 Read block 1719 len 12288
19382 087/300 Read block 4704 len 20480
19383 088/300 Write block 770 len 20480 data: 7 7 7 7 7
19384 089/300 Write block 1635 len 16384 data: 2 2 3 3
19385 090/300 Read block 1767 len 12288
19386 091/300 Write block 4431 len 20480 data: 6 6 4 3 3
19387 092/300 Flush
19388 093/300 Read block 3693 len 4096
19389 094/300 Flush
19390 095/300 Flush
19391 096/300 Write block 2745 len 32768 data: 3 4 3 3 4 4 3 4
19392 097/300 Read block 1433 len 32768
19393 098/300 Read block 1603 len 20480
19394 099/300 Read block 371 len 8192
19395 100/300 Write block 4751 len 40960 data: 3 3 4 4 5 5 5 4 4 4
19396 101/300 Write block 2173 len 8192 data: 3 3
19397 102/300 Write block 841 len 12288 data: 4 4 4
19398 103/300 Flush
19399 104/300 Write block 3751 len 28672 data: 5 4 3 3 4 4 4
19400 105/300 Read block 1060 len 20480
19401 106/300 Write block 2586 len 24576 data: 4 3 3 3 3 3
19402 107/300 Write block 712 len 4096 data: 2
19403 108/300 Read block 2323 len 20480
19404 109/300 Read block 1853 len 32768
19405 110/300 Write block 2813 len 36864 data: 8 6 6 5 4 4 4 4 3
19406 111/300 Read block 3512 len 32768
19407 112/300 Read block 2210 len 40960
19408 113/300 Read block 1142 len 20480
19409 114/300 Write block 3231 len 36864 data: 4 3 4 6 6 7 6 4 4
19410 115/300 Read block 3344 len 4096
19411 116/300 Write block 3527 len 40960 data: 2 3 3 5 4 4 4 4 4 5
19412 117/300 Write block 2468 len 16384 data: 4 6 6 5
19413 118/300 Write block 1645 len 28672 data: 2 2 2 2 3 3 3
19414 119/300 Read block 2152 len 16384
19415 120/300 Read block 2304 len 40960
19416 121/300 Read block 4063 len 16384
19417 122/300 Read block 2690 len 12288
19418 123/300 Read block 4689 len 24576
19419 124/300 Write block 2631 len 16384 data: 3 3 3 3
19420 125/300 Read block 3826 len 32768
19421 126/300 Read block 3155 len 40960
19422 127/300 Flush
19423 128/300 Read block 372 len 16384
19424 129/300 Read block 3908 len 40960
19425 130/300 Flush
19426 131/300 Read block 1509 len 40960
19427 132/300 Write block 3462 len 12288 data: 3 3 3
19428 133/300 Read block 2008 len 16384
19429 134/300 Write block 2768 len 40960 data: 7 6 5 6 6 6 6 5 4 4
19430 135/300 Write block 3036 len 36864 data: 3 4 4 3 3 3 2 3 3
19431 136/300 Write block 3269 len 24576 data: 3 2 3 3 3 3
19432 137/300 Write block 341 len 16384 data: 2 3 4 3
19433 138/300 Flush
19434 139/300 Write block 2336 len 16384 data: 5 3 2 2
19435 140/300 Read block 4014 len 28672
19436 141/300 Read block 4513 len 40960
19437 142/300 Write block 1399 len 32768 data: 4 4 3 3 3 3 3 4
19438 143/300 Flush
19439 144/300 Write block 193 len 40960 data: 4 3 3 3 2 2 2 3 3 3
19440 145/300 Read block 1234 len 4096
19441 146/300 Write block 4190 len 32768 data: 2 2 2 2 3 3 3 4
19442 147/300 Write block 498 len 24576 data: 2 4 4 5 4 5
19443 148/300 Write block 2735 len 16384 data: 3 3 2 2
19444 149/300 Read block 509 len 24576
19445 150/300 Read block 4591 len 20480
19446 151/300 Read block 1738 len 20480
19447 152/300 Read block 4199 len 16384
19448 153/300 Write block 557 len 28672 data: 4 5 5 5 5 4 4
19449 154/300 Write block 2309 len 36864 data: 4 4 4 5 5 4 4 4 3
19450 155/300 Flush
19451 156/300 Flush
19452 157/300 Flush
19453 158/300 Read block 4162 len 4096
19454 159/300 Write block 3553 len 24576 data: 4 4 3 3 3 4
19455 160/300 Read block 2899 len 28672
19456 161/300 Write block 585 len 36864 data: 4 4 4 3 4 4 4 4 4
19457 162/300 Read block 94 len 28672
19458 163/300 Write block 2110 len 40960 data: 3 3 3 3 3 3 3 3 3 3
19459 164/300 Write block 4943 len 4096 data: 5
19460 165/300 Read block 2758 len 28672
19461 166/300 Flush
19462 167/300 Write block 4215 len 8192 data: 4 4
19463 168/300 Read block 3035 len 8192
19464 169/300 Write block 1857 len 8192 data: 3 3
19465 170/300 Write block 1374 len 8192 data: 2 2
19466 171/300 Write block 4882 len 32768 data: 3 2 2 3 4 5 5 6
19467 172/300 Read block 3518 len 8192
19468 173/300 Read block 4749 len 20480
19469 174/300 Read block 775 len 32768
19470 175/300 Flush
19471 176/300 Flush
19472 177/300 Read block 2890 len 4096
19473 178/300 Read block 3096 len 20480
19474 179/300 Write block 2875 len 24576 data: 3 3 3 3 3 3
19475 180/300 Read block 814 len 36864
19476 181/300 Write block 1708 len 28672 data: 7 6 6 6 5 5 4
19477 182/300 Write block 4816 len 8192 data: 4 4
19478 183/300 Read block 879 len 32768
19479 184/300 Read block 4118 len 8192
19480 185/300 Flush
19481 186/300 Read block 3519 len 40960
19482 187/300 Write block 1804 len 20480 data: 6 3 3 3 3
19483 188/300 Write block 1363 len 8192 data: 4 3
19484 189/300 Write block 1195 len 16384 data: 2 3 3 4
19485 190/300 Write block 4670 len 28672 data: 4 4 2 3 3 5 6
19486 191/300 Write block 2674 len 20480 data: 3 3 3 3 2
19487 192/300 Flush
19488 193/300 Write block 1023 len 16384 data: 2 2 2 2
19489 194/300 Read block 3356 len 4096
19490 195/300 Flush
19491 196/300 Write block 3641 len 28672 data: 2 3 4 4 4 4 3
19492 197/300 Read block 3904 len 4096
19493 198/300 Write block 2658 len 32768 data: 3 2 3 3 3 4 7 7
19494 199/300 Write block 3367 len 12288 data: 4 4 5
19495 200/300 Read block 1233 len 12288
19496 201/300 Write block 4834 len 28672 data: 4 4 4 4 3 3 3
19497 202/300 Read block 3110 len 40960
19498 203/300 Write block 3951 len 36864 data: 2 2 3 5 7 9 8 8 8
19499 204/300 Write block 614 len 16384 data: 5 5 3 3
19500 205/300 Write block 3540 len 32768 data: 3 3 2 2 2 3 4 4
19501 206/300 Read block 1271 len 28672
19502 207/300 Read block 3024 len 32768
19503 208/300 Read block 1363 len 36864
19504 209/300 Flush
19505 210/300 Flush
19506 211/300 Read block 2623 len 40960
19507 212/300 Read block 960 len 4096
19508 213/300 Read block 3617 len 28672
19509 214/300 Read block 3187 len 8192
19510 215/300 Write block 772 len 4096 data: 8
19511 216/300 Write block 4796 len 20480 data: 2 4 4 4 6
19512 217/300 Flush
19513 218/300 Read block 1642 len 32768
19514 219/300 Read block 611 len 4096
19515 220/300 Write block 4754 len 40960 data: 5 6 6 6 5 5 5 3 3 4
19516 221/300 Read block 3873 len 20480
19517 222/300 Read block 3826 len 20480
19518 223/300 Write block 4197 len 36864 data: 5 5 6 6 6 6 5 4 3
19519 224/300 Write block 2633 len 16384 data: 4 4 3 4
19520 225/300 Read block 1825 len 28672
19521 226/300 Read block 2602 len 28672
19522 227/300 Write block 1850 len 24576 data: 3 3 3 3 3 3
19523 228/300 Write block 919 len 24576 data: 3 3 2 2 2 3
19524 229/300 Flush
19525 230/300 Write block 1680 len 12288 data: 4 4 5
19526 231/300 Write block 4979 len 20480 data: 2 2 3 4 4
19527 232/300 Read block 1550 len 40960
19528 233/300 Flush
19529 234/300 Read block 1269 len 28672
19530 235/300 Read block 3464 len 36864
19531 236/300 Flush
19532 237/300 Write block 737 len 40960 data: 6 5 4 4 4 3 4 4 5 5
19533 238/300 Read block 4140 len 28672
19534 239/300 Flush
19535 240/300 Write block 95 len 32768 data: 4 4 4 4 3 4 4 4
19536 241/300 Write block 785 len 8192 data: 4 4
19537 242/300 Read block 1184 len 20480
19538 243/300 Write block 1427 len 24576 data: 3 3 3 3 3 3
19539 244/300 Read block 1958 len 24576
19540 245/300 Write block 2101 len 24576 data: 4 5 5 4 4 4
19541 246/300 Flush
19542 247/300 Read block 663 len 32768
19543 248/300 Read block 3703 len 24576
19544 249/300 Read block 3719 len 24576
19545 250/300 Read block 963 len 32768
19546 251/300 Read block 602 len 40960
19547 252/300 Read block 2594 len 32768
19548 253/300 Write block 4332 len 4096 data: 2
19549 254/300 Read block 2911 len 32768
19550 255/300 Write block 4040 len 20480 data: 2 4 6 5 6
19551 256/300 Write block 4068 len 24576 data: 3 3 3 3 4 5
19552 257/300 Write block 1667 len 16384 data: 7 6 4 4
19553 258/300 Read block 3170 len 24576
19554 259/300 Read block 1046 len 4096
19555 260/300 Read block 2730 len 20480
19556 261/300 Read block 1475 len 36864
19557 262/300 Flush
19558 263/300 Read block 2198 len 40960
19559 264/300 Flush
19560 265/300 Read block 555 len 8192
19561 266/300 Write block 2540 len 4096 data: 5
19562 267/300 Write block 3946 len 12288 data: 3 3 3
19563 268/300 Read block 3355 len 4096
19564 269/300 Read block 3543 len 32768
19565 270/300 Flush
19566 271/300 Flush
19567 272/300 Flush
19568 273/300 Read block 1728 len 36864
19569 274/300 Read block 2992 len 12288
19570 275/300 Read block 4198 len 20480
19571 276/300 Read block 113 len 28672
19572 277/300 Write block 410 len 24576 data: 2 3 3 3 4 4
19573 278/300 Read block 4325 len 28672
19574 279/300 Write block 3800 len 20480 data: 5 5 5 4 3
19575 280/300 Read block 2215 len 16384
19576 281/300 Read block 1624 len 40960
19577 282/300 Write block 3246 len 16384 data: 3 3 5 4
19578 283/300 Read block 898 len 28672
19579 284/300 Read block 3225 len 12288
19580 285/300 Write block 4471 len 8192 data: 4 4
19581 286/300 Read block 4054 len 28672
19582 287/300 Read block 4616 len 16384
19583 288/300 Read block 3207 len 20480
19584 289/300 Write block 2975 len 4096 data: 4
19585 290/300 Write block 1240 len 28672 data: 2 2 4 5 6 4 4
19586 291/300 Flush
19587 292/300 Read block 4968 len 28672
19588 293/300 Write block 1735 len 8192 data: 2 2
19589 294/300 Write block 1298 len 8192 data: 4 4
19590 295/300 Write block 3598 len 28672 data: 5 4 4 4 4 3 3
19591 296/300 Write block 4287 len 4096 data: 3
19592 297/300 Read block 2098 len 40960
19593 298/300 Write block 2325 len 24576 data: 4 4 4 4 3 3
19594 299/300 Write block 1454 len 12288 data: 2 2 2
19595 300/300 Flush
19596 Main task has work to do, go find it
19597 got dsc Start(2)
19598 start 2
19599 Apr 20 01:09:13.185 INFO request completed, latency_us: 226, response_code: 204, uri: /start/cid/2, method: POST, req_id: d7519a48-f34c-4bd4-ba31-11f9a196c5bc, remote_addr: 127.0.0.1:60352, local_addr: 127.0.0.1:9998
19600 Replay: started 2, returned:Ok(())
19601 ----------------------------------------------------------------
19602 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:301
19603 States: Active Active Offline
19604 GW_ID ACK DSID TYPE BLOCKS DS:0 DS:1 DS:2 REPLAY
19605 4523 Acked 5522 Write 2 Done Done New false
19606 4524 Acked 5523 Write 4 Done Done New false
19607 4525 Acked 5524 Flush 0 Done Done New false
19608 4526 Acked 5525 Read 5 Done Done New false
19609 4527 Acked 5526 Read 8 Done Done New false
19610 4528 Acked 5527 Write 6 Done Done New false
19611 4529 Acked 5528 Write 4 Done Done New false
19612 4530 Acked 5529 Flush 0 Done Done New false
19613 4531 Acked 5530 Read 1 Done Done New false
19614 4532 Acked 5531 Write 9 Done Done New false
19615 4533 Acked 5532 Read 3 Done Done New false
19616 4534 Acked 5533 Flush 0 Done Done New false
19617 4535 Acked 5534 Read 9 Done Done New false
19618 4536 Acked 5535 Read 6 Done Done New false
19619 4537 Acked 5536 Read 8 Done Done New false
19620 4538 Acked 5537 Read 1 Done Done New false
19621 4539 Acked 5538 Write 9 Done Done New false
19622 4540 Acked 5539 Read 1 Done Done New false
19623 4541 Acked 5540 Write 4 Done Done New false
19624 4542 Acked 5541 Read 7 Done Done New false
19625 4543 Acked 5542 Flush 0 Done Done New false
19626 4544 Acked 5543 Read 1 Done Done New false
19627 4545 Acked 5544 Read 2 Done Done New false
19628 4546 Acked 5545 Read 2 Done Done New false
19629 4547 Acked 5546 Write 4 Done Done New false
19630 4548 Acked 5547 Read 4 Done Done New false
19631 4549 Acked 5548 Read 1 Done Done New false
19632 4550 Acked 5549 Write 1 Done Done New false
19633 4551 Acked 5550 Read 7 Done Done New false
19634 4552 Acked 5551 Read 8 Done Done New false
19635 4553 Acked 5552 Read 7 Done Done New false
19636 4554 Acked 5553 Write 5 Done Done New false
19637 4555 Acked 5554 Write 4 Done Done New false
19638 4556 Acked 5555 Write 10 Done Done New false
19639 4557 Acked 5556 Write 10 Done Done New false
19640 4558 Acked 5557 Write 2 Done Done New false
19641 4559 Acked 5558 Write 7 Done Done New false
19642 4560 Acked 5559 Read 1 Done Done New false
19643 4561 Acked 5560 Read 4 Done Done New false
19644 4562 Acked 5561 Read 9 Done Done New false
19645 4563 Acked 5562 Flush 0 Done Done New false
19646 4564 Acked 5563 Flush 0 Done Done New false
19647 4565 Acked 5564 Write 2 Done Done New false
19648 4566 Acked 5565 Write 10 Done Done New false
19649 4567 Acked 5566 Read 4 Done Done New false
19650 4568 Acked 5567 Read 5 Done Done New false
19651 4569 Acked 5568 Write 6 Done Done New false
19652 4570 Acked 5569 Write 6 Done Done New false
19653 4571 Acked 5570 Write 4 Done Done New false
19654 4572 Acked 5571 Read 5 Done Done New false
19655 4573 Acked 5572 Read 8 Done Done New false
19656 4574 Acked 5573 Read 8 Done Done New false
19657 4575 Acked 5574 Write 5 Done Done New false
19658 4576 Acked 5575 Write 5 Done Done New false
19659 4577 Acked 5576 Read 6 Done Done New false
19660 4578 Acked 5577 Write 5 Done Done New false
19661 4579 Acked 5578 Read 2 Done Done New false
19662 4580 Acked 5579 Write 8 Done Done New false
19663 4581 Acked 5580 Write 5 Done Done New false
19664 4582 Acked 5581 Write 7 Done Done New false
19665 4583 Acked 5582 Write 9 Done Done New false
19666 4584 Acked 5583 Read 4 Done Done New false
19667 4585 Acked 5584 Read 5 Done Done New false
19668 4586 Acked 5585 Read 5 Done Done New false
19669 4587 Acked 5586 Write 6 Done Done New false
19670 4588 Acked 5587 Write 5 Done Done New false
19671 4589 Acked 5588 Write 5 Done Done New false
19672 4590 Acked 5589 Write 6 Done Done New false
19673 4591 Acked 5590 Read 7 Done Done New false
19674 4592 Acked 5591 Read 6 Done Done New false
19675 4593 Acked 5592 Write 10 Done Done New false
19676 4594 Acked 5593 Read 4 Done Done New false
19677 4595 Acked 5594 Write 8 Done Done New false
19678 4596 Acked 5595 Write 4 Done Done New false
19679 4597 Acked 5596 Read 2 Done Done New false
19680 4598 Acked 5597 Read 6 Done Done New false
19681 4599 Acked 5598 Read 4 Done Done New false
19682 4600 Acked 5599 Write 7 Done Done New false
19683 4601 Acked 5600 Write 8 Done Done New false
19684 4602 Acked 5601 Write 3 Done Done New false
19685 4603 Acked 5602 Read 6 Done Done New false
19686 4604 Acked 5603 Write 3 Done Done New false
19687 4605 Acked 5604 Write 4 Done Done New false
19688 4606 Acked 5605 Flush 0 Done Done New false
19689 4607 Acked 5606 Flush 0 Done Done New false
19690 4608 Acked 5607 Read 3 Done Done New false
19691 4609 Acked 5608 Read 5 Done Done New false
19692 4610 Acked 5609 Write 5 Done Done New false
19693 4611 Acked 5610 Write 4 Done Done New false
19694 4612 Acked 5611 Read 3 Done Done New false
19695 4613 Acked 5612 Write 5 Done Done New false
19696 4614 Acked 5613 Flush 0 Done Done New false
19697 4615 Acked 5614 Read 1 Done Done New false
19698 4616 Acked 5615 Flush 0 Done Done New false
19699 4617 Acked 5616 Flush 0 Done Done New false
19700 4618 Acked 5617 Write 8 Done Done New false
19701 4619 Acked 5618 Read 8 Done Done New false
19702 4620 Acked 5619 Read 5 Done Done New false
19703 4621 Acked 5620 Read 2 Done Done New false
19704 4622 Acked 5621 Write 10 Done Done New false
19705 4623 Acked 5622 Write 2 Done Done New false
19706 4624 Acked 5623 Write 3 Done Done New false
19707 4625 Acked 5624 Flush 0 Done Done New false
19708 4626 Acked 5625 Write 7 Done Done New false
19709 4627 Acked 5626 Read 5 Done Done New false
19710 4628 Acked 5627 Write 6 Done Done New false
19711 4629 Acked 5628 Write 1 Done Done New false
19712 4630 Acked 5629 Read 5 Done Done New false
19713 4631 Acked 5630 Read 8 Done Done New false
19714 4632 Acked 5631 Write 9 Done Done New false
19715 4633 Acked 5632 Read 8 Done Done New false
19716 4634 Acked 5633 Read 10 Done Done New false
19717 4635 Acked 5634 Read 5 Done Done New false
19718 4636 Acked 5635 Write 9 Done Done New false
19719 4637 Acked 5636 Read 1 Done Done New false
19720 4638 Acked 5637 Write 10 Done Done New false
19721 4639 Acked 5638 Write 4 Done Done New false
19722 4640 Acked 5639 Flush 0 Done Done New false
19723 4641 Acked 5640 Write 7 Done Done New false
19724 4642 Acked 5641 Read 4 Done Done New false
19725 4643 Acked 5642 Read 10 Done Done New false
19726 4644 Acked 5643 Read 4 Done Done New false
19727 4645 Acked 5644 Read 3 Done Done New false
19728 4646 Acked 5645 Read 6 Done Done New false
19729 4647 Acked 5646 Write 4 Done Done New false
19730 4648 Acked 5647 Read 8 Done Done New false
19731 4649 Acked 5648 Read 10 Done Done New false
19732 4650 Acked 5649 Flush 0 Done Done New false
19733 4651 Acked 5650 Read 4 Done Done New false
19734 4652 Acked 5651 Read 10 Done Done New false
19735 4653 Acked 5652 Flush 0 Done Done New false
19736 4654 Acked 5653 Read 10 Done Done New false
19737 4655 Acked 5654 Write 3 Done Done New false
19738 4656 Acked 5655 Read 4 Done Done New false
19739 4657 Acked 5656 Write 10 Done Done New false
19740 4658 Acked 5657 Write 9 Done Done New false
19741 4659 Acked 5658 Write 6 Done Done New false
19742 4660 Acked 5659 Write 4 Done Done New false
19743 4661 Acked 5660 Flush 0 Done Done New false
19744 4662 Acked 5661 Write 4 Done Done New false
19745 4663 Acked 5662 Read 7 Done Done New false
19746 4664 Acked 5663 Read 10 Done Done New false
19747 4665 Acked 5664 Write 8 Done Done New false
19748 4666 Acked 5665 Flush 0 Done Done New false
19749 4667 Acked 5666 Write 10 Done Done New false
19750 4668 Acked 5667 Read 1 Done Done New false
19751 4669 Acked 5668 Write 8 Done Done New false
19752 4670 Acked 5669 Write 6 Done Done New false
19753 4671 Acked 5670 Write 4 Done Done New false
19754 4672 Acked 5671 Read 6 Done Done New false
19755 4673 Acked 5672 Read 5 Done Done New false
19756 4674 Acked 5673 Read 5 Done Done New false
19757 4675 Acked 5674 Read 4 Done Done New false
19758 4676 Acked 5675 Write 7 Done Done New false
19759 4677 Acked 5676 Write 9 Done Done New false
19760 4678 Acked 5677 Flush 0 Done Done New false
19761 4679 Acked 5678 Flush 0 Done Done New false
19762 4680 Acked 5679 Flush 0 Done Done New false
19763 4681 Acked 5680 Read 1 Done Done New false
19764 4682 Acked 5681 Write 6 Done Done New false
19765 4683 Acked 5682 Read 7 Done Done New false
19766 4684 Acked 5683 Write 9 Done Done New false
19767 4685 Acked 5684 Read 7 Done Done New false
19768 4686 Acked 5685 Write 10 Done Done New false
19769 4687 Acked 5686 Write 1 Done Done New false
19770 4688 Acked 5687 Read 7 Done Done New false
19771 4689 Acked 5688 Flush 0 Done Done New false
19772 4690 Acked 5689 Write 2 Done Done New false
19773 4691 Acked 5690 Read 2 Done Done New false
19774 4692 Acked 5691 Write 2 Done Done New false
19775 4693 Acked 5692 Write 2 Done Done New false
19776 4694 Acked 5693 Write 8 Done Done New false
19777 4695 Acked 5694 Read 2 Done Done New false
19778 4696 Acked 5695 Read 5 Done Done New false
19779 4697 Acked 5696 Read 8 Done Done New false
19780 4698 Acked 5697 Flush 0 Done Done New false
19781 4699 Acked 5698 Flush 0 Done Done New false
19782 4700 Acked 5699 Read 1 Done Done New false
19783 4701 Acked 5700 Read 5 Done Done New false
19784 4702 Acked 5701 Write 6 Done Done New false
19785 4703 Acked 5702 Read 9 Done Done New false
19786 4704 Acked 5703 Write 7 Done Done New false
19787 4705 Acked 5704 Write 2 Done Done New false
19788 4706 Acked 5705 Read 8 Done Done New false
19789 4707 Acked 5706 Read 2 Done Done New false
19790 4708 Acked 5707 Flush 0 Done Done New false
19791 4709 Acked 5708 Read 10 Done Done New false
19792 4710 Acked 5709 Write 5 Done Done New false
19793 4711 Acked 5710 Write 2 Done Done New false
19794 4712 Acked 5711 Write 4 Done Done New false
19795 4713 Acked 5712 Write 7 Done Done New false
19796 4714 Acked 5713 Write 5 Done Done New false
19797 4715 Acked 5714 Flush 0 Done Done New false
19798 4716 Acked 5715 Write 4 Done Done New false
19799 4717 Acked 5716 Read 1 Done Done New false
19800 4718 Acked 5717 Flush 0 Done Done New false
19801 4719 Acked 5718 Write 7 Done Done New false
19802 4720 Acked 5719 Read 1 Done Done New false
19803 4721 Acked 5720 Write 8 Done Done New false
19804 4722 Acked 5721 Write 3 Done Done New false
19805 4723 Acked 5722 Read 3 Done Done New false
19806 4724 Acked 5723 Write 7 Done Done New false
19807 4725 Acked 5724 Read 10 Done Done New false
19808 4726 Acked 5725 Write 9 Done Done New false
19809 4727 Acked 5726 Write 4 Done Done New false
19810 4728 Acked 5727 Write 8 Done Done New false
19811 4729 Acked 5728 Read 7 Done Done New false
19812 4730 Acked 5729 Read 8 Done Done New false
19813 4731 Acked 5730 Read 9 Done Done New false
19814 4732 Acked 5731 Flush 0 Done Done New false
19815 4733 Acked 5732 Flush 0 Done Done New false
19816 4734 Acked 5733 Read 10 Done Done New false
19817 4735 Acked 5734 Read 1 Done Done New false
19818 4736 Acked 5735 Read 7 Done Done New false
19819 4737 Acked 5736 Read 2 Done Done New false
19820 4738 Acked 5737 Write 1 Done Done New false
19821 4739 Acked 5738 Write 5 Done Done New false
19822 4740 Acked 5739 Flush 0 Done Done New false
19823 4741 Acked 5740 Read 8 Done Done New false
19824 4742 Acked 5741 Read 1 Done Done New false
19825 4743 Acked 5742 Write 10 Done Done New false
19826 4744 Acked 5743 Read 5 Done Done New false
19827 4745 Acked 5744 Read 5 Done Done New false
19828 4746 Acked 5745 Write 9 Done Done New false
19829 4747 Acked 5746 Write 4 Done Done New false
19830 4748 Acked 5747 Read 7 Done Done New false
19831 4749 Acked 5748 Read 7 Done Done New false
19832 4750 Acked 5749 Write 6 Done Done New false
19833 4751 Acked 5750 Write 6 Done Done New false
19834 4752 Acked 5751 Flush 0 Done Done New false
19835 4753 Acked 5752 Write 3 Done Done New false
19836 4754 Acked 5753 Write 5 Done Done New false
19837 4755 Acked 5754 Read 10 Done Done New false
19838 4756 Acked 5755 Flush 0 Done Done New false
19839 4757 Acked 5756 Read 7 Done Done New false
19840 4758 Acked 5757 Read 9 Done Done New false
19841 4759 Acked 5758 Flush 0 Done Done New false
19842 4760 Acked 5759 Write 10 Done Done New false
19843 4761 Acked 5760 Read 7 Done Done New false
19844 4762 Acked 5761 Flush 0 Done Done New false
19845 4763 Acked 5762 Write 8 Done Done New false
19846 4764 Acked 5763 Write 2 Done Done New false
19847 4765 Acked 5764 Read 5 Done Done New false
19848 4766 Acked 5765 Write 6 Done Done New false
19849 4767 Acked 5766 Read 6 Done Done New false
19850 4768 Acked 5767 Write 6 Done Done New false
19851 4769 Acked 5768 Flush 0 Done Done New false
19852 4770 Acked 5769 Read 8 Done Done New false
19853 4771 Acked 5770 Read 6 Done Done New false
19854 4772 Acked 5771 Read 6 Done Done New false
19855 4773 Acked 5772 Read 8 Done Done New false
19856 4774 Acked 5773 Read 10 Done Done New false
19857 4775 Acked 5774 Read 8 Done Done New false
19858 4776 Acked 5775 Write 1 Done Done New false
19859 4777 Acked 5776 Read 8 Done Done New false
19860 4778 Acked 5777 Write 5 Done Done New false
19861 4779 Acked 5778 Write 6 Done Done New false
19862 4780 Acked 5779 Write 4 Done Done New false
19863 4781 Acked 5780 Read 6 Done Done New false
19864 4782 Acked 5781 Read 1 Done Done New false
19865 4783 Acked 5782 Read 5 Done Done New false
19866 4784 Acked 5783 Read 9 Done Done New false
19867 4785 Acked 5784 Flush 0 Done Done New false
19868 4786 Acked 5785 Read 10 Done Done New false
19869 4787 Acked 5786 Flush 0 Done Done New false
19870 4788 Acked 5787 Read 2 Done Done New false
19871 4789 Acked 5788 Write 1 Done Done New false
19872 4790 Acked 5789 Write 3 Done Done New false
19873 4791 Acked 5790 Read 1 Done Done New false
19874 4792 Acked 5791 Read 8 Done Done New false
19875 4793 Acked 5792 Flush 0 Done Done New false
19876 4794 Acked 5793 Flush 0 Done Done New false
19877 4795 Acked 5794 Flush 0 Done Done New false
19878 4796 Acked 5795 Read 9 Done Done New false
19879 4797 Acked 5796 Read 3 Done Done New false
19880 4798 Acked 5797 Read 5 Done Done New false
19881 4799 Acked 5798 Read 7 Done Done New false
19882 4800 Acked 5799 Write 6 Done Done New false
19883 4801 Acked 5800 Read 7 Done Done New false
19884 4802 Acked 5801 Write 5 Done Done New false
19885 4803 Acked 5802 Read 4 Done Done New false
19886 4804 Acked 5803 Read 10 Done Done New false
19887 4805 Acked 5804 Write 4 Done Done New false
19888 4806 Acked 5805 Read 7 Done Done New false
19889 4807 Acked 5806 Read 3 Done Done New false
19890 4808 Acked 5807 Write 2 Done Done New false
19891 4809 Acked 5808 Read 7 Done Done New false
19892 4810 Acked 5809 Read 4 Done Done New false
19893 4811 Acked 5810 Read 5 Done Done New false
19894 4812 Acked 5811 Write 1 Done Done New false
19895 4813 Acked 5812 Write 7 Done Done New false
19896 4814 Acked 5813 Flush 0 Done Done New false
19897 4815 Acked 5814 Read 7 Done Done New false
19898 4816 Acked 5815 Write 2 Done Done New false
19899 4817 Acked 5816 Write 2 Done Done New false
19900 4818 Acked 5817 Write 7 Done Done New false
19901 4819 Acked 5818 Write 1 Done Done New false
19902 4820 Acked 5819 Read 10 Done Done New false
19903 4821 Acked 5820 Write 6 Done Done New false
19904 4822 Acked 5821 Write 3 Done Done New false
19905 4823 Acked 5822 Flush 0 Done Done New false
19906 STATES DS:0 DS:1 DS:2 TOTAL
19907 New 0 0 301 301
19908 Sent 0 0 0 0
19909 Done 301 301 0 602
19910 Skipped 0 0 0 0
19911 Error 0 0 0 0
19912 Last Flush: 5822 5822 5521
19913 Downstairs last five completed: 5521 5520 5519 5518 5517
19914 Upstairs last five completed: 4823 4822 4821 4820 4819
19915 CLIENT: Up:0 ds:301 act:2
19916 [8830] got start action
19917 [8830] I am going to restart
19918 Starting downstairs at port 8830
19919 Make output file at "/tmp/dsc/downstairs-8830.txt"
19920 [8830][2] reports Starting
19921 Downstairs /var/tmp/dsc/region/8830 port 8830 PID:Some(1212)
19922 [8830][2] reports Running
19923 ----------------------------------------------------------------
19924 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:301
19925 States: Active Active Offline
19926 GW_ID ACK DSID TYPE BLOCKS DS:0 DS:1 DS:2 REPLAY
19927 4523 Acked 5522 Write 2 Done Done New false
19928 4524 Acked 5523 Write 4 Done Done New false
19929 4525 Acked 5524 Flush 0 Done Done New false
19930 4526 Acked 5525 Read 5 Done Done New false
19931 4527 Acked 5526 Read 8 Done Done New false
19932 4528 Acked 5527 Write 6 Done Done New false
19933 4529 Acked 5528 Write 4 Done Done New false
19934 4530 Acked 5529 Flush 0 Done Done New false
19935 4531 Acked 5530 Read 1 Done Done New false
19936 4532 Acked 5531 Write 9 Done Done New false
19937 4533 Acked 5532 Read 3 Done Done New false
19938 4534 Acked 5533 Flush 0 Done Done New false
19939 4535 Acked 5534 Read 9 Done Done New false
19940 4536 Acked 5535 Read 6 Done Done New false
19941 4537 Acked 5536 Read 8 Done Done New false
19942 4538 Acked 5537 Read 1 Done Done New false
19943 4539 Acked 5538 Write 9 Done Done New false
19944 4540 Acked 5539 Read 1 Done Done New false
19945 4541 Acked 5540 Write 4 Done Done New false
19946 4542 Acked 5541 Read 7 Done Done New false
19947 4543 Acked 5542 Flush 0 Done Done New false
19948 4544 Acked 5543 Read 1 Done Done New false
19949 4545 Acked 5544 Read 2 Done Done New false
19950 4546 Acked 5545 Read 2 Done Done New false
19951 4547 Acked 5546 Write 4 Done Done New false
19952 4548 Acked 5547 Read 4 Done Done New false
19953 4549 Acked 5548 Read 1 Done Done New false
19954 4550 Acked 5549 Write 1 Done Done New false
19955 4551 Acked 5550 Read 7 Done Done New false
19956 4552 Acked 5551 Read 8 Done Done New false
19957 4553 Acked 5552 Read 7 Done Done New false
19958 4554 Acked 5553 Write 5 Done Done New false
19959 4555 Acked 5554 Write 4 Done Done New false
19960 4556 Acked 5555 Write 10 Done Done New false
19961 4557 Acked 5556 Write 10 Done Done New false
19962 4558 Acked 5557 Write 2 Done Done New false
19963 4559 Acked 5558 Write 7 Done Done New false
19964 4560 Acked 5559 Read 1 Done Done New false
19965 4561 Acked 5560 Read 4 Done Done New false
19966 4562 Acked 5561 Read 9 Done Done New false
19967 4563 Acked 5562 Flush 0 Done Done New false
19968 4564 Acked 5563 Flush 0 Done Done New false
19969 4565 Acked 5564 Write 2 Done Done New false
19970 4566 Acked 5565 Write 10 Done Done New false
19971 4567 Acked 5566 Read 4 Done Done New false
19972 4568 Acked 5567 Read 5 Done Done New false
19973 4569 Acked 5568 Write 6 Done Done New false
19974 4570 Acked 5569 Write 6 Done Done New false
19975 4571 Acked 5570 Write 4 Done Done New false
19976 4572 Acked 5571 Read 5 Done Done New false
19977 4573 Acked 5572 Read 8 Done Done New false
19978 4574 Acked 5573 Read 8 Done Done New false
19979 4575 Acked 5574 Write 5 Done Done New false
19980 4576 Acked 5575 Write 5 Done Done New false
19981 4577 Acked 5576 Read 6 Done Done New false
19982 4578 Acked 5577 Write 5 Done Done New false
19983 4579 Acked 5578 Read 2 Done Done New false
19984 4580 Acked 5579 Write 8 Done Done New false
19985 4581 Acked 5580 Write 5 Done Done New false
19986 4582 Acked 5581 Write 7 Done Done New false
19987 4583 Acked 5582 Write 9 Done Done New false
19988 4584 Acked 5583 Read 4 Done Done New false
19989 4585 Acked 5584 Read 5 Done Done New false
19990 4586 Acked 5585 Read 5 Done Done New false
19991 4587 Acked 5586 Write 6 Done Done New false
19992 4588 Acked 5587 Write 5 Done Done New false
19993 4589 Acked 5588 Write 5 Done Done New false
19994 4590 Acked 5589 Write 6 Done Done New false
19995 4591 Acked 5590 Read 7 Done Done New false
19996 4592 Acked 5591 Read 6 Done Done New false
19997 4593 Acked 5592 Write 10 Done Done New false
19998 4594 Acked 5593 Read 4 Done Done New false
19999 4595 Acked 5594 Write 8 Done Done New false
20000 4596 Acked 5595 Write 4 Done Done New false
20001 4597 Acked 5596 Read 2 Done Done New false
20002 4598 Acked 5597 Read 6 Done Done New false
20003 4599 Acked 5598 Read 4 Done Done New false
20004 4600 Acked 5599 Write 7 Done Done New false
20005 4601 Acked 5600 Write 8 Done Done New false
20006 4602 Acked 5601 Write 3 Done Done New false
20007 4603 Acked 5602 Read 6 Done Done New false
20008 4604 Acked 5603 Write 3 Done Done New false
20009 4605 Acked 5604 Write 4 Done Done New false
20010 4606 Acked 5605 Flush 0 Done Done New false
20011 4607 Acked 5606 Flush 0 Done Done New false
20012 4608 Acked 5607 Read 3 Done Done New false
20013 4609 Acked 5608 Read 5 Done Done New false
20014 4610 Acked 5609 Write 5 Done Done New false
20015 4611 Acked 5610 Write 4 Done Done New false
20016 4612 Acked 5611 Read 3 Done Done New false
20017 4613 Acked 5612 Write 5 Done Done New false
20018 4614 Acked 5613 Flush 0 Done Done New false
20019 4615 Acked 5614 Read 1 Done Done New false
20020 4616 Acked 5615 Flush 0 Done Done New false
20021 4617 Acked 5616 Flush 0 Done Done New false
20022 4618 Acked 5617 Write 8 Done Done New false
20023 4619 Acked 5618 Read 8 Done Done New false
20024 4620 Acked 5619 Read 5 Done Done New false
20025 4621 Acked 5620 Read 2 Done Done New false
20026 4622 Acked 5621 Write 10 Done Done New false
20027 4623 Acked 5622 Write 2 Done Done New false
20028 4624 Acked 5623 Write 3 Done Done New false
20029 4625 Acked 5624 Flush 0 Done Done New false
20030 4626 Acked 5625 Write 7 Done Done New false
20031 4627 Acked 5626 Read 5 Done Done New false
20032 4628 Acked 5627 Write 6 Done Done New false
20033 4629 Acked 5628 Write 1 Done Done New false
20034 4630 Acked 5629 Read 5 Done Done New false
20035 4631 Acked 5630 Read 8 Done Done New false
20036 4632 Acked 5631 Write 9 Done Done New false
20037 4633 Acked 5632 Read 8 Done Done New false
20038 4634 Acked 5633 Read 10 Done Done New false
20039 4635 Acked 5634 Read 5 Done Done New false
20040 4636 Acked 5635 Write 9 Done Done New false
20041 4637 Acked 5636 Read 1 Done Done New false
20042 4638 Acked 5637 Write 10 Done Done New false
20043 4639 Acked 5638 Write 4 Done Done New false
20044 4640 Acked 5639 Flush 0 Done Done New false
20045 4641 Acked 5640 Write 7 Done Done New false
20046 4642 Acked 5641 Read 4 Done Done New false
20047 4643 Acked 5642 Read 10 Done Done New false
20048 4644 Acked 5643 Read 4 Done Done New false
20049 4645 Acked 5644 Read 3 Done Done New false
20050 4646 Acked 5645 Read 6 Done Done New false
20051 4647 Acked 5646 Write 4 Done Done New false
20052 4648 Acked 5647 Read 8 Done Done New false
20053 4649 Acked 5648 Read 10 Done Done New false
20054 4650 Acked 5649 Flush 0 Done Done New false
20055 4651 Acked 5650 Read 4 Done Done New false
20056 4652 Acked 5651 Read 10 Done Done New false
20057 4653 Acked 5652 Flush 0 Done Done New false
20058 4654 Acked 5653 Read 10 Done Done New false
20059 4655 Acked 5654 Write 3 Done Done New false
20060 4656 Acked 5655 Read 4 Done Done New false
20061 4657 Acked 5656 Write 10 Done Done New false
20062 4658 Acked 5657 Write 9 Done Done New false
20063 4659 Acked 5658 Write 6 Done Done New false
20064 4660 Acked 5659 Write 4 Done Done New false
20065 4661 Acked 5660 Flush 0 Done Done New false
20066 4662 Acked 5661 Write 4 Done Done New false
20067 4663 Acked 5662 Read 7 Done Done New false
20068 4664 Acked 5663 Read 10 Done Done New false
20069 4665 Acked 5664 Write 8 Done Done New false
20070 4666 Acked 5665 Flush 0 Done Done New false
20071 4667 Acked 5666 Write 10 Done Done New false
20072 4668 Acked 5667 Read 1 Done Done New false
20073 4669 Acked 5668 Write 8 Done Done New false
20074 4670 Acked 5669 Write 6 Done Done New false
20075 4671 Acked 5670 Write 4 Done Done New false
20076 4672 Acked 5671 Read 6 Done Done New false
20077 4673 Acked 5672 Read 5 Done Done New false
20078 4674 Acked 5673 Read 5 Done Done New false
20079 4675 Acked 5674 Read 4 Done Done New false
20080 4676 Acked 5675 Write 7 Done Done New false
20081 4677 Acked 5676 Write 9 Done Done New false
20082 4678 Acked 5677 Flush 0 Done Done New false
20083 4679 Acked 5678 Flush 0 Done Done New false
20084 4680 Acked 5679 Flush 0 Done Done New false
20085 4681 Acked 5680 Read 1 Done Done New false
20086 4682 Acked 5681 Write 6 Done Done New false
20087 4683 Acked 5682 Read 7 Done Done New false
20088 4684 Acked 5683 Write 9 Done Done New false
20089 4685 Acked 5684 Read 7 Done Done New false
20090 4686 Acked 5685 Write 10 Done Done New false
20091 4687 Acked 5686 Write 1 Done Done New false
20092 4688 Acked 5687 Read 7 Done Done New false
20093 4689 Acked 5688 Flush 0 Done Done New false
20094 4690 Acked 5689 Write 2 Done Done New false
20095 4691 Acked 5690 Read 2 Done Done New false
20096 4692 Acked 5691 Write 2 Done Done New false
20097 4693 Acked 5692 Write 2 Done Done New false
20098 4694 Acked 5693 Write 8 Done Done New false
20099 4695 Acked 5694 Read 2 Done Done New false
20100 4696 Acked 5695 Read 5 Done Done New false
20101 4697 Acked 5696 Read 8 Done Done New false
20102 4698 Acked 5697 Flush 0 Done Done New false
20103 4699 Acked 5698 Flush 0 Done Done New false
20104 4700 Acked 5699 Read 1 Done Done New false
20105 4701 Acked 5700 Read 5 Done Done New false
20106 4702 Acked 5701 Write 6 Done Done New false
20107 4703 Acked 5702 Read 9 Done Done New false
20108 4704 Acked 5703 Write 7 Done Done New false
20109 4705 Acked 5704 Write 2 Done Done New false
20110 4706 Acked 5705 Read 8 Done Done New false
20111 4707 Acked 5706 Read 2 Done Done New false
20112 4708 Acked 5707 Flush 0 Done Done New false
20113 4709 Acked 5708 Read 10 Done Done New false
20114 4710 Acked 5709 Write 5 Done Done New false
20115 4711 Acked 5710 Write 2 Done Done New false
20116 4712 Acked 5711 Write 4 Done Done New false
20117 4713 Acked 5712 Write 7 Done Done New false
20118 4714 Acked 5713 Write 5 Done Done New false
20119 4715 Acked 5714 Flush 0 Done Done New false
20120 4716 Acked 5715 Write 4 Done Done New false
20121 4717 Acked 5716 Read 1 Done Done New false
20122 4718 Acked 5717 Flush 0 Done Done New false
20123 4719 Acked 5718 Write 7 Done Done New false
20124 4720 Acked 5719 Read 1 Done Done New false
20125 4721 Acked 5720 Write 8 Done Done New false
20126 4722 Acked 5721 Write 3 Done Done New false
20127 4723 Acked 5722 Read 3 Done Done New false
20128 4724 Acked 5723 Write 7 Done Done New false
20129 4725 Acked 5724 Read 10 Done Done New false
20130 4726 Acked 5725 Write 9 Done Done New false
20131 4727 Acked 5726 Write 4 Done Done New false
20132 4728 Acked 5727 Write 8 Done Done New false
20133 4729 Acked 5728 Read 7 Done Done New false
20134 4730 Acked 5729 Read 8 Done Done New false
20135 4731 Acked 5730 Read 9 Done Done New false
20136 4732 Acked 5731 Flush 0 Done Done New false
20137 4733 Acked 5732 Flush 0 Done Done New false
20138 4734 Acked 5733 Read 10 Done Done New false
20139 4735 Acked 5734 Read 1 Done Done New false
20140 4736 Acked 5735 Read 7 Done Done New false
20141 4737 Acked 5736 Read 2 Done Done New false
20142 4738 Acked 5737 Write 1 Done Done New false
20143 4739 Acked 5738 Write 5 Done Done New false
20144 4740 Acked 5739 Flush 0 Done Done New false
20145 4741 Acked 5740 Read 8 Done Done New false
20146 4742 Acked 5741 Read 1 Done Done New false
20147 4743 Acked 5742 Write 10 Done Done New false
20148 4744 Acked 5743 Read 5 Done Done New false
20149 4745 Acked 5744 Read 5 Done Done New false
20150 4746 Acked 5745 Write 9 Done Done New false
20151 4747 Acked 5746 Write 4 Done Done New false
20152 4748 Acked 5747 Read 7 Done Done New false
20153 4749 Acked 5748 Read 7 Done Done New false
20154 4750 Acked 5749 Write 6 Done Done New false
20155 4751 Acked 5750 Write 6 Done Done New false
20156 4752 Acked 5751 Flush 0 Done Done New false
20157 4753 Acked 5752 Write 3 Done Done New false
20158 4754 Acked 5753 Write 5 Done Done New false
20159 4755 Acked 5754 Read 10 Done Done New false
20160 4756 Acked 5755 Flush 0 Done Done New false
20161 4757 Acked 5756 Read 7 Done Done New false
20162 4758 Acked 5757 Read 9 Done Done New false
20163 4759 Acked 5758 Flush 0 Done Done New false
20164 4760 Acked 5759 Write 10 Done Done New false
20165 4761 Acked 5760 Read 7 Done Done New false
20166 4762 Acked 5761 Flush 0 Done Done New false
20167 4763 Acked 5762 Write 8 Done Done New false
20168 4764 Acked 5763 Write 2 Done Done New false
20169 4765 Acked 5764 Read 5 Done Done New false
20170 4766 Acked 5765 Write 6 Done Done New false
20171 4767 Acked 5766 Read 6 Done Done New false
20172 4768 Acked 5767 Write 6 Done Done New false
20173 4769 Acked 5768 Flush 0 Done Done New false
20174 4770 Acked 5769 Read 8 Done Done New false
20175 4771 Acked 5770 Read 6 Done Done New false
20176 4772 Acked 5771 Read 6 Done Done New false
20177 4773 Acked 5772 Read 8 Done Done New false
20178 4774 Acked 5773 Read 10 Done Done New false
20179 4775 Acked 5774 Read 8 Done Done New false
20180 4776 Acked 5775 Write 1 Done Done New false
20181 4777 Acked 5776 Read 8 Done Done New false
20182 4778 Acked 5777 Write 5 Done Done New false
20183 4779 Acked 5778 Write 6 Done Done New false
20184 4780 Acked 5779 Write 4 Done Done New false
20185 4781 Acked 5780 Read 6 Done Done New false
20186 4782 Acked 5781 Read 1 Done Done New false
20187 4783 Acked 5782 Read 5 Done Done New false
20188 4784 Acked 5783 Read 9 Done Done New false
20189 4785 Acked 5784 Flush 0 Done Done New false
20190 4786 Acked 5785 Read 10 Done Done New false
20191 4787 Acked 5786 Flush 0 Done Done New false
20192 4788 Acked 5787 Read 2 Done Done New false
20193 4789 Acked 5788 Write 1 Done Done New false
20194 4790 Acked 5789 Write 3 Done Done New false
20195 4791 Acked 5790 Read 1 Done Done New false
20196 4792 Acked 5791 Read 8 Done Done New false
20197 4793 Acked 5792 Flush 0 Done Done New false
20198 4794 Acked 5793 Flush 0 Done Done New false
20199 4795 Acked 5794 Flush 0 Done Done New false
20200 4796 Acked 5795 Read 9 Done Done New false
20201 4797 Acked 5796 Read 3 Done Done New false
20202 4798 Acked 5797 Read 5 Done Done New false
20203 4799 Acked 5798 Read 7 Done Done New false
20204 4800 Acked 5799 Write 6 Done Done New false
20205 4801 Acked 5800 Read 7 Done Done New false
20206 4802 Acked 5801 Write 5 Done Done New false
20207 4803 Acked 5802 Read 4 Done Done New false
20208 4804 Acked 5803 Read 10 Done Done New false
20209 4805 Acked 5804 Write 4 Done Done New false
20210 4806 Acked 5805 Read 7 Done Done New false
20211 4807 Acked 5806 Read 3 Done Done New false
20212 4808 Acked 5807 Write 2 Done Done New false
20213 4809 Acked 5808 Read 7 Done Done New false
20214 4810 Acked 5809 Read 4 Done Done New false
20215 4811 Acked 5810 Read 5 Done Done New false
20216 4812 Acked 5811 Write 1 Done Done New false
20217 4813 Acked 5812 Write 7 Done Done New false
20218 4814 Acked 5813 Flush 0 Done Done New false
20219 4815 Acked 5814 Read 7 Done Done New false
20220 4816 Acked 5815 Write 2 Done Done New false
20221 4817 Acked 5816 Write 2 Done Done New false
20222 4818 Acked 5817 Write 7 Done Done New false
20223 4819 Acked 5818 Write 1 Done Done New false
20224 4820 Acked 5819 Read 10 Done Done New false
20225 4821 Acked 5820 Write 6 Done Done New false
20226 4822 Acked 5821 Write 3 Done Done New false
20227 4823 Acked 5822 Flush 0 Done Done New false
20228 STATES DS:0 DS:1 DS:2 TOTAL
20229 New 0 0 301 301
20230 Sent 0 0 0 0
20231 Done 301 301 0 602
20232 Skipped 0 0 0 0
20233 Error 0 0 0 0
20234 Last Flush: 5822 5822 5521
20235 Downstairs last five completed: 5521 5520 5519 5518 5517
20236 Upstairs last five completed: 4823 4822 4821 4820 4819
20237 CLIENT: Up:0 ds:301 act:2
202382024-04-20T01:09:18.873ZINFOcrucible: connecting to 127.0.0.1:8830 = io task client = 2 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
202392024-04-20T01:09:18.873ZINFOcrucible: ds_connection connected from Ok(127.0.0.1:47644) = io task client = 2 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
202402024-04-20T01:09:18.874ZINFOcrucible: downstairs client at Some(127.0.0.1:8830) has region UUID 12345678-0000-0000-0000-000000008830 = downstairs client = 2 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
202412024-04-20T01:09:18.874ZINFOcrucible: Returning UUID:12345678-0000-0000-0000-000000008830 matches = downstairs client = 2 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
202422024-04-20T01:09:18.874ZINFOcrucible: send last flush ID to this DS: 5521 = downstairs client = 2 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
202432024-04-20T01:09:18.874ZINFOcrucible: Replied this last flush ID: 5521 = downstairs client = 2 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
202442024-04-20T01:09:18.874ZINFOcrucible: ds_transition from Offline to Replay = downstairs client = 2 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
202452024-04-20T01:09:18.874ZINFOcrucible: [2] Transition from Offline to Replay = downstairs client = 2 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
202462024-04-20T01:09:18.874ZINFOcrucible: ds_transition from Replay to Active = downstairs client = 2 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
202472024-04-20T01:09:18.875ZINFOcrucible: [2] Transition from Replay to Active = downstairs client = 2 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
20248 ----------------------------------------------------------------
20249 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:0
20250 Downstairs last five completed: 5822 5821 5820 5819 5818
20251 Upstairs last five completed: 4823 4822 4821 4820 4819
20252 CLIENT: Up:0 ds:0 act:3
20253 Replay: All jobs finished, all DS active.
20254 Main task has work to do, go find it
20255 got dsc Stop(2)
20256 stop 2
20257 Apr 20 01:09:21.190 INFO request completed, latency_us: 309, response_code: 204, uri: /stop/cid/2, method: POST, req_id: [8830] Got stop action so:false kr:false
20258 be6ccf63-8220-4415-82c4-478667d49b55, remote_addr: 127.0.0.1:60352, local_addr: 127.0.0.1:9998
202592024-04-20T01:09:21.190ZWARNcrucible: downstairs disconnected = io task client = 2 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
202602024-04-20T01:09:21.190ZWARNcrucible: client task is sending Done(Finished) = io task client = 2 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
202612024-04-20T01:09:21.190ZWARNcrucible: downstairs task for 2 stopped due to Finished session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
202622024-04-20T01:09:21.190ZINFOcrucible: Gone missing, transition from Active to Offline = downstairs client = 2 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
20263 Apr 20 01:09:21.190 INFO request completed, latency_us: 195, response_code: 200, uri: /state/cid/2, method: GET, req_id: d8ae3aa1-4541-4503-8c42-f08c938651a3, remote_addr: 127.0.0.1:60352, local_addr: 127{"msg":"[2] client re-new 0 jobs since flush 5822","v":0,"name":"crucible","level":30,"time":"2024-04-20T01:09:21.191032089Z","hostname":"w-01HVWGBJP7HK0H9TQ26T6N3X8M","pid":1196,"":"downstairs","":"downstairs","session_id":"132b460a-26a0-4532-b1ab-4f8c07d4c6c7"}
20264 .0.0.1:9998{"msg":"[2] Marked 0 jobs for replay since flush: 5822","v":0,"name":"crucible","level":30,"time":"2024-04-20T01:09:21.191081727Z","hostname":"w-01HVWGBJP7HK0H9TQ26T6N3X8M","pid":1196,"":"downstairs","":"downstairs","session_id":"132b460a-26a0-4532-b1ab-4f8c07d4c6c7"}
20265 
202662024-04-20T01:09:21.191ZINFOcrucible: client task is exiting = io task client = 2 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
20267 [8830] Exited with: ExitStatus(unix_wait_status(9))
20268 [8830][2] reports Exit
20269 Apr 20 01:09:25.192 INFO request completed, latency_us: 187, response_code: 200, uri: /state/cid/2, method: GET, req_id: d000a7ac-000a-4915-8237-217f2d21e09f, remote_addr: 127.0.0.1:60352, local_addr: 127.0.0.1:9998
20270 001/300 Read block 3391 len 12288
20271 002/300 Write block 2166 len 4096 data: 6
20272 003/300 Read block 367 len 16384
20273 004/300 Write block 2841 len 40960 data: 5 5 7 5 6 7 8 7 4 5
20274 005/300 Write block 1298 len 28672 data: 5 5 4 3 4 5 7
20275 006/300 Write block 4764 len 4096 data: 4
20276 007/300 Write block 3416 len 32768 data: 3 4 4 5 5 4 4 4
20277 008/300 Flush
20278 009/300 Write block 2460 len 32768 data: 4 4 3 4 5 5 4 4
20279 010/300 Read block 2109 len 36864
20280 011/300 Read block 1957 len 8192
20281 012/300 Flush
20282 013/300 Write block 1606 len 12288 data: 5 5 5
20283 014/300 Write block 2722 len 28672 data: 3 4 6 6 8 9 9
20284 015/300 Read block 930 len 24576
20285 016/300 Read block 809 len 16384
20286 017/300 Flush
20287 018/300 Write block 249 len 32768 data: 5 6 6 6 4 5 3 3
20288 019/300 Read block 3783 len 16384
20289 020/300 Read block 2063 len 16384
20290 021/300 Read block 22 len 4096
20291 022/300 Read block 1456 len 28672
20292 023/300 Write block 469 len 4096 data: 5
20293 024/300 Read block 3692 len 36864
20294 025/300 Write block 4752 len 4096 data: 4
20295 026/300 Flush
20296 027/300 Read block 1031 len 40960
20297 028/300 Read block 4615 len 20480
20298 029/300 Write block 2085 len 12288 data: 5 7 5
20299 030/300 Read block 3241 len 40960
20300 031/300 Read block 3303 len 16384
20301 032/300 Read block 2981 len 36864
20302 033/300 Write block 2766 len 8192 data: 6 6
20303 034/300 Write block 3259 len 4096 data: 2
20304 035/300 Write block 2900 len 8192 data: 4 3
20305 036/300 Read block 2203 len 4096
20306 037/300 Read block 4489 len 32768
20307 038/300 Write block 3209 len 32768 data: 3 3 3 4 4 2 2 3
20308 039/300 Write block 3835 len 8192 data: 3 4
20309 040/300 Read block 3420 len 28672
20310 041/300 Write block 2855 len 24576 data: 3 3 2 3 3 3
20311 042/300 Write block 2301 len 28672 data: 3 4 4 5 5 4 3
20312 043/300 Write block 4876 len 12288 data: 8 8 6
20313 044/300 Write block 401 len 24576 data: 7 6 6 5 4 4
20314 045/300 Read block 2780 len 24576
20315 046/300 Write block 1601 len 20480 data: 2 3 3 3 3
20316 047/300 Read block 4266 len 28672
20317 048/300 Read block 4390 len 16384
20318 049/300 Write block 2239 len 32768 data: 4 4 3 3 3 4 4 4
20319 050/300 Write block 4067 len 20480 data: 3 4 4 4 4
20320 051/300 Read block 4643 len 20480
20321 052/300 Write block 1898 len 8192 data: 6 7
20322 053/300 Read block 4449 len 28672
20323 054/300 Read block 2770 len 36864
20324 055/300 Write block 81 len 40960 data: 3 3 4 4 5 6 7 6 6 4
20325 056/300 Write block 4343 len 40960 data: 3 3 3 4 4 6 6 6 7 6
20326 057/300 Read block 4680 len 4096
20327 058/300 Write block 3006 len 12288 data: 6 6 6
20328 059/300 Read block 3414 len 24576
20329 060/300 Write block 2479 len 4096 data: 2
20330 061/300 Write block 4261 len 36864 data: 5 4 4 4 4 4 5 5 6
20331 062/300 Flush
20332 063/300 Write block 411 len 28672 data: 4 4 4 5 5 4 4
20333 064/300 Read block 884 len 24576
20334 065/300 Flush
20335 066/300 Read block 760 len 28672
20336 067/300 Read block 3724 len 32768
20337 068/300 Write block 1638 len 32768 data: 4 2 2 2 2 2 2 3
20338 069/300 Write block 1111 len 12288 data: 4 3 3
20339 070/300 Write block 1533 len 16384 data: 5 5 5 5
20340 071/300 Read block 4142 len 16384
20341 072/300 Read block 3678 len 8192
20342 073/300 Write block 2739 len 40960 data: 2 2 3 4 4 4 4 5 4 4
20343 074/300 Write block 2340 len 36864 data: 3 3 3 4 4 4 4 4 9
20344 075/300 Flush
20345 076/300 Write block 4164 len 24576 data: 2 2 2 2 3 5
20346 077/300 Read block 4406 len 8192
20347 078/300 Write block 1199 len 24576 data: 6 5 4 4 4 3
20348 079/300 Write block 3633 len 20480 data: 3 3 3 4 4
20349 080/300 Write block 3679 len 12288 data: 3 5 5
20350 081/300 Read block 4174 len 16384
20351 082/300 Read block 948 len 12288
20352 083/300 Read block 3226 len 36864
20353 084/300 Flush
20354 085/300 Read block 2415 len 40960
20355 086/300 Read block 2148 len 40960
20356 087/300 Read block 1197 len 8192
20357 088/300 Read block 723 len 36864
20358 089/300 Write block 2890 len 12288 data: 5 5 5
20359 090/300 Read block 4181 len 20480
20360 091/300 Write block 1729 len 28672 data: 2 2 2 2 2 2 3
20361 092/300 Read block 3683 len 16384
20362 093/300 Write block 493 len 28672 data: 2 2 2 2 2 3 5
20363 094/300 Read block 4602 len 16384
20364 095/300 Write block 2505 len 4096 data: 7
20365 096/300 Write block 2138 len 40960 data: 4 3 3 5 5 5 6 5 4 3
20366 097/300 Read block 1047 len 4096
20367 098/300 Flush
20368 099/300 Read block 4062 len 12288
20369 100/300 Write block 3356 len 16384 data: 3 3 3 2
20370 101/300 Flush
20371 102/300 Write block 1090 len 28672 data: 6 6 4 4 3 3 3
20372 103/300 Read block 2413 len 4096
20373 104/300 Read block 4769 len 40960
20374 105/300 Read block 4756 len 24576
20375 106/300 Read block 1748 len 36864
20376 107/300 Write block 713 len 28672 data: 2 2 2 2 4 4 4
20377 108/300 Flush
20378 109/300 Write block 3731 len 40960 data: 3 3 4 3 4 4 3 4 4 4
20379 110/300 Read block 1963 len 36864
20380 111/300 Read block 3977 len 8192
20381 112/300 Write block 4293 len 40960 data: 6 6 6 4 5 5 4 3 4 4
20382 113/300 Write block 3687 len 12288 data: 5 5 3
20383 114/300 Write block 3836 len 28672 data: 5 4 5 5 5 3 3
20384 115/300 Read block 4103 len 40960
20385 116/300 Write block 4739 len 36864 data: 5 5 4 4 6 6 6 4 4
20386 117/300 Read block 119 len 16384
20387 118/300 Read block 3225 len 16384
20388 119/300 Flush
20389 120/300 Write block 1139 len 20480 data: 5 5 5 4 3
20390 121/300 Write block 3828 len 20480 data: 2 2 2 2 2
20391 122/300 Flush
20392 123/300 Read block 3387 len 12288
20393 124/300 Read block 1153 len 40960
20394 125/300 Read block 3115 len 24576
20395 126/300 Flush
20396 127/300 Write block 147 len 40960 data: 3 3 3 3 2 2 2 2 2 2
20397 128/300 Read block 924 len 36864
20398 129/300 Write block 2505 len 12288 data: 8 5 4
20399 130/300 Read block 4653 len 40960
20400 131/300 Write block 4991 len 24576 data: 5 5 4 4 4 5
20401 132/300 Read block 565 len 28672
20402 133/300 Write block 1031 len 28672 data: 7 7 6 6 4 4 3
20403 134/300 Write block 1121 len 16384 data: 3 4 5 7
20404 135/300 Read block 4348 len 40960
20405 136/300 Read block 2474 len 32768
20406 137/300 Read block 3401 len 40960
20407 138/300 Read block 3946 len 8192
20408 139/300 Write block 422 len 32768 data: 5 5 3 3 4 4 4 4
20409 140/300 Read block 2309 len 24576
20410 141/300 Write block 2508 len 20480 data: 5 6 9 9 9
20411 142/300 Write block 3778 len 16384 data: 2 2 2 3
20412 143/300 Read block 1597 len 36864
20413 144/300 Read block 3313 len 24576
20414 145/300 Write block 2818 len 36864 data: 5 5 5 4 3 3 4 3 3
20415 146/300 Write block 2219 len 24576 data: 3 3 4 4 3 3
20416 147/300 Read block 224 len 8192
20417 148/300 Flush
20418 149/300 Write block 3602 len 40960 data: 5 4 4 4 4 5 5 5 5 3
20419 150/300 Read block 2750 len 36864
20420 151/300 Write block 1984 len 28672 data: 2 3 4 5 5 5 5
20421 152/300 Read block 1106 len 40960
20422 153/300 Read block 3919 len 36864
20423 154/300 Read block 1393 len 16384
20424 155/300 Write block 2597 len 36864 data: 3 3 4 5 5 4 5 5 6
20425 156/300 Write block 3125 len 24576 data: 3 3 3 4 5 5
20426 157/300 Read block 1002 len 8192
20427 158/300 Write block 2497 len 16384 data: 3 4 4 4
20428 159/300 Read block 894 len 36864
20429 160/300 Read block 2974 len 8192
20430 161/300 Write block 1348 len 20480 data: 4 3 3 2 3
20431 162/300 Write block 2458 len 4096 data: 5
20432 163/300 Read block 4035 len 32768
20433 164/300 Write block 2005 len 8192 data: 5 5
20434 165/300 Read block 1796 len 32768
20435 166/300 Write block 2786 len 36864 data: 4 4 4 3 3 2 2 3 3
20436 167/300 Read block 2658 len 24576
20437 168/300 Write block 4877 len 28672 data: 9 7 6 5 4 4 3
20438 169/300 Read block 2950 len 20480
20439 170/300 Write block 2594 len 8192 data: 2 2
20440 171/300 Read block 562 len 4096
20441 172/300 Read block 2272 len 28672
20442 173/300 Write block 827 len 36864 data: 5 5 5 4 4 3 4 5 5
20443 174/300 Read block 4571 len 20480
20444 175/300 Read block 4695 len 12288
20445 176/300 Read block 1370 len 28672
20446 177/300 Read block 2070 len 32768
20447 178/300 Write block 4541 len 32768 data: 3 3 3 5 5 5 4 4
20448 179/300 Read block 4098 len 8192
20449 180/300 Flush
20450 181/300 Read block 508 len 20480
20451 182/300 Write block 3565 len 40960 data: 2 3 3 2 2 3 3 3 3 3
20452 183/300 Read block 3210 len 8192
20453 184/300 Write block 2723 len 28672 data: 5 7 7 9 10 10 9
20454 185/300 Read block 564 len 24576
20455 186/300 Write block 1098 len 12288 data: 5 4 6
20456 187/300 Write block 2150 len 32768 data: 2 2 3 4 4 5 5 5
20457 188/300 Flush
20458 189/300 Write block 2739 len 12288 data: 3 3 4
20459 190/300 Write block 2697 len 8192 data: 3 4
20460 191/300 Write block 2450 len 24576 data: 3 3 3 3 3 3
20461 192/300 Read block 623 len 36864
20462 193/300 Read block 2885 len 8192
20463 194/300 Write block 4947 len 36864 data: 5 6 5 6 6 7 6 6 5
20464 195/300 Write block 264 len 12288 data: 4 3 3
20465 196/300 Read block 346 len 8192
20466 197/300 Write block 3683 len 12288 data: 5 5 5
20467 198/300 Write block 4158 len 40960 data: 4 4 4 4 3 3 3 3 3 3
20468 199/300 Read block 1914 len 4096
20469 200/300 Read block 4170 len 24576
20470 201/300 Read block 3301 len 40960
20471 202/300 Write block 3525 len 24576 data: 2 2 3 4 4 6
20472 203/300 Write block 1713 len 8192 data: 6 5
20473 204/300 Read block 3578 len 32768
20474 205/300 Read block 1032 len 12288
20475 206/300 Read block 956 len 20480
20476 207/300 Read block 2715 len 4096
20477 208/300 Flush
20478 209/300 Write block 3295 len 36864 data: 3 3 3 3 3 3 3 3 3
20479 210/300 Read block 1126 len 4096
20480 211/300 Write block 360 len 36864 data: 7 7 6 6 6 5 5 4 4
20481 212/300 Write block 3837 len 4096 data: 5
20482 213/300 Read block 3309 len 4096
20483 214/300 Write block 2901 len 28672 data: 4 3 4 4 3 5 4
20484 215/300 Write block 1963 len 36864 data: 4 3 2 2 2 3 3 2 2
20485 216/300 Read block 4355 len 28672
20486 217/300 Flush
20487 218/300 Read block 525 len 24576
20488 219/300 Flush
20489 220/300 Flush
20490 221/300 Read block 1027 len 20480
20491 222/300 Write block 2719 len 16384 data: 5 2 2 4
20492 223/300 Write block 2318 len 4096 data: 4
20493 224/300 Read block 2378 len 8192
20494 225/300 Read block 1121 len 8192
20495 226/300 Write block 1093 len 32768 data: 5 4 4 4 5 6 5 7
20496 227/300 Read block 4269 len 32768
20497 228/300 Read block 4408 len 32768
20498 229/300 Read block 483 len 20480
20499 230/300 Read block 4814 len 24576
20500 231/300 Write block 1512 len 32768 data: 3 3 2 2 3 5 7 8
20501 232/300 Write block 2265 len 4096 data: 4
20502 233/300 Read block 1531 len 24576
20503 234/300 Write block 121 len 32768 data: 4 4 4 3 3 4 4 4
20504 235/300 Write block 4552 len 16384 data: 3 2 2 3
20505 236/300 Read block 3825 len 24576
20506 237/300 Write block 2126 len 24576 data: 6 6 6 5 5 4
20507 238/300 Write block 4808 len 20480 data: 6 5 4 4 3
20508 239/300 Write block 1063 len 12288 data: 3 3 3
20509 240/300 Read block 1868 len 28672
20510 241/300 Write block 3897 len 16384 data: 3 2 4 6
20511 242/300 Flush
20512 243/300 Write block 1728 len 24576 data: 3 3 3 3 3 3
20513 244/300 Read block 1002 len 8192
20514 245/300 Read block 419 len 36864
20515 246/300 Read block 2736 len 4096
20516 247/300 Write block 317 len 8192 data: 5 6
20517 248/300 Read block 2721 len 24576
20518 249/300 Write block 3268 len 4096 data: 2
20519 250/300 Read block 1657 len 40960
20520 251/300 Write block 4140 len 36864 data: 4 4 6 6 4 3 3 3 3
20521 252/300 Read block 1786 len 40960
20522 253/300 Read block 2799 len 12288
20523 254/300 Flush
20524 255/300 Write block 1298 len 40960 data: 6 6 5 4 5 6 8 8 8 8
20525 256/300 Read block 3116 len 28672
20526 257/300 Read block 4309 len 32768
20527 258/300 Write block 2262 len 8192 data: 3 3
20528 259/300 Read block 417 len 28672
20529 260/300 Write block 3618 len 16384 data: 4 4 4 4
20530 261/300 Write block 3639 len 12288 data: 3 3 3
20531 262/300 Read block 4326 len 32768
20532 263/300 Write block 1759 len 8192 data: 4 4
20533 264/300 Write block 3380 len 40960 data: 3 3 3 3 4 4 4 4 4 4
20534 265/300 Write block 657 len 24576 data: 4 3 4 4 5 5
20535 266/300 Read block 3209 len 16384
20536 267/300 Flush
20537 268/300 Read block 2117 len 16384
20538 269/300 Write block 298 len 32768 data: 6 6 5 4 4 4 3 2
20539 270/300 Write block 2203 len 8192 data: 3 3
20540 271/300 Write block 916 len 4096 data: 5
20541 272/300 Read block 4088 len 36864
20542 273/300 Write block 993 len 8192 data: 5 6
20543 274/300 Read block 3470 len 36864
20544 275/300 Write block 1168 len 28672 data: 3 4 4 4 5 5 5
20545 276/300 Read block 4345 len 16384
20546 277/300 Write block 4413 len 12288 data: 7 5 5
20547 278/300 Read block 355 len 12288
20548 279/300 Read block 1488 len 4096
20549 280/300 Flush
20550 281/300 Write block 3857 len 8192 data: 3 5
20551 282/300 Write block 2582 len 36864 data: 4 3 5 5 5 4 4 4 4
20552 283/300 Flush
20553 284/300 Read block 4317 len 20480
20554 285/300 Write block 1455 len 32768 data: 3 3 2 2 2 2 2 2
20555 286/300 Write block 1782 len 40960 data: 4 4 5 3 3 2 3 3 3 3
20556 287/300 Write block 2355 len 4096 data: 6
20557 288/300 Read block 1654 len 28672
20558 289/300 Read block 1572 len 40960
20559 290/300 Write block 2728 len 8192 data: 11 10
20560 291/300 Flush
20561 292/300 Read block 23 len 24576
20562 293/300 Read block 4674 len 4096
20563 294/300 Read block 2340 len 4096
20564 295/300 Read block 2050 len 36864
20565 296/300 Write block 1808 len 8192 data: 4 3
20566 297/300 Read block 328 len 32768
20567 298/300 Write block 4851 len 8192 data: 5 5
20568 299/300 Flush
20569 300/300 Read block 645 len 20480
20570 Main task has work to do, go find it
20571 got dsc Start(2)
20572 start 2
20573 Apr 20 01:09:25.505 INFO request completed, latency_us: 218, response_code: 204, uri: /start/cid/2, method: POST, req_id: e8cad39a-595f-46a3-ab2c-796b1ca1e2f3, remote_addr: 127.0.0.1:60352, local_addr: 127.0.0.1:9998
20574 Replay: started 2, returned:Ok(())
20575 ----------------------------------------------------------------
20576 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:300
20577 States: Active Active Offline
20578 GW_ID ACK DSID TYPE BLOCKS DS:0 DS:1 DS:2 REPLAY
20579 4824 Acked 5823 Read 3 Done Done New false
20580 4825 Acked 5824 Write 1 Done Done New false
20581 4826 Acked 5825 Read 4 Done Done New false
20582 4827 Acked 5826 Write 10 Done Done New false
20583 4828 Acked 5827 Write 7 Done Done New false
20584 4829 Acked 5828 Write 1 Done Done New false
20585 4830 Acked 5829 Write 8 Done Done New false
20586 4831 Acked 5830 Flush 0 Done Done New false
20587 4832 Acked 5831 Write 8 Done Done New false
20588 4833 Acked 5832 Read 9 Done Done New false
20589 4834 Acked 5833 Read 2 Done Done New false
20590 4835 Acked 5834 Flush 0 Done Done New false
20591 4836 Acked 5835 Write 3 Done Done New false
20592 4837 Acked 5836 Write 7 Done Done New false
20593 4838 Acked 5837 Read 6 Done Done New false
20594 4839 Acked 5838 Read 4 Done Done New false
20595 4840 Acked 5839 Flush 0 Done Done New false
20596 4841 Acked 5840 Write 8 Done Done New false
20597 4842 Acked 5841 Read 4 Done Done New false
20598 4843 Acked 5842 Read 4 Done Done New false
20599 4844 Acked 5843 Read 1 Done Done New false
20600 4845 Acked 5844 Read 7 Done Done New false
20601 4846 Acked 5845 Write 1 Done Done New false
20602 4847 Acked 5846 Read 9 Done Done New false
20603 4848 Acked 5847 Write 1 Done Done New false
20604 4849 Acked 5848 Flush 0 Done Done New false
20605 4850 Acked 5849 Read 10 Done Done New false
20606 4851 Acked 5850 Read 5 Done Done New false
20607 4852 Acked 5851 Write 3 Done Done New false
20608 4853 Acked 5852 Read 10 Done Done New false
20609 4854 Acked 5853 Read 4 Done Done New false
20610 4855 Acked 5854 Read 9 Done Done New false
20611 4856 Acked 5855 Write 2 Done Done New false
20612 4857 Acked 5856 Write 1 Done Done New false
20613 4858 Acked 5857 Write 2 Done Done New false
20614 4859 Acked 5858 Read 1 Done Done New false
20615 4860 Acked 5859 Read 8 Done Done New false
20616 4861 Acked 5860 Write 8 Done Done New false
20617 4862 Acked 5861 Write 2 Done Done New false
20618 4863 Acked 5862 Read 7 Done Done New false
20619 4864 Acked 5863 Write 6 Done Done New false
20620 4865 Acked 5864 Write 7 Done Done New false
20621 4866 Acked 5865 Write 3 Done Done New false
20622 4867 Acked 5866 Write 6 Done Done New false
20623 4868 Acked 5867 Read 6 Done Done New false
20624 4869 Acked 5868 Write 5 Done Done New false
20625 4870 Acked 5869 Read 7 Done Done New false
20626 4871 Acked 5870 Read 4 Done Done New false
20627 4872 Acked 5871 Write 8 Done Done New false
20628 4873 Acked 5872 Write 5 Done Done New false
20629 4874 Acked 5873 Read 5 Done Done New false
20630 4875 Acked 5874 Write 2 Done Done New false
20631 4876 Acked 5875 Read 7 Done Done New false
20632 4877 Acked 5876 Read 9 Done Done New false
20633 4878 Acked 5877 Write 10 Done Done New false
20634 4879 Acked 5878 Write 10 Done Done New false
20635 4880 Acked 5879 Read 1 Done Done New false
20636 4881 Acked 5880 Write 3 Done Done New false
20637 4882 Acked 5881 Read 6 Done Done New false
20638 4883 Acked 5882 Write 1 Done Done New false
20639 4884 Acked 5883 Write 9 Done Done New false
20640 4885 Acked 5884 Flush 0 Done Done New false
20641 4886 Acked 5885 Write 7 Done Done New false
20642 4887 Acked 5886 Read 6 Done Done New false
20643 4888 Acked 5887 Flush 0 Done Done New false
20644 4889 Acked 5888 Read 7 Done Done New false
20645 4890 Acked 5889 Read 8 Done Done New false
20646 4891 Acked 5890 Write 8 Done Done New false
20647 4892 Acked 5891 Write 3 Done Done New false
20648 4893 Acked 5892 Write 4 Done Done New false
20649 4894 Acked 5893 Read 4 Done Done New false
20650 4895 Acked 5894 Read 2 Done Done New false
20651 4896 Acked 5895 Write 10 Done Done New false
20652 4897 Acked 5896 Write 9 Done Done New false
20653 4898 Acked 5897 Flush 0 Done Done New false
20654 4899 Acked 5898 Write 6 Done Done New false
20655 4900 Acked 5899 Read 2 Done Done New false
20656 4901 Acked 5900 Write 6 Done Done New false
20657 4902 Acked 5901 Write 5 Done Done New false
20658 4903 Acked 5902 Write 3 Done Done New false
20659 4904 Acked 5903 Read 4 Done Done New false
20660 4905 Acked 5904 Read 3 Done Done New false
20661 4906 Acked 5905 Read 9 Done Done New false
20662 4907 Acked 5906 Flush 0 Done Done New false
20663 4908 Acked 5907 Read 10 Done Done New false
20664 4909 Acked 5908 Read 10 Done Done New false
20665 4910 Acked 5909 Read 2 Done Done New false
20666 4911 Acked 5910 Read 9 Done Done New false
20667 4912 Acked 5911 Write 3 Done Done New false
20668 4913 Acked 5912 Read 5 Done Done New false
20669 4914 Acked 5913 Write 7 Done Done New false
20670 4915 Acked 5914 Read 4 Done Done New false
20671 4916 Acked 5915 Write 7 Done Done New false
20672 4917 Acked 5916 Read 4 Done Done New false
20673 4918 Acked 5917 Write 1 Done Done New false
20674 4919 Acked 5918 Write 10 Done Done New false
20675 4920 Acked 5919 Read 1 Done Done New false
20676 4921 Acked 5920 Flush 0 Done Done New false
20677 4922 Acked 5921 Read 3 Done Done New false
20678 4923 Acked 5922 Write 4 Done Done New false
20679 4924 Acked 5923 Flush 0 Done Done New false
20680 4925 Acked 5924 Write 7 Done Done New false
20681 4926 Acked 5925 Read 1 Done Done New false
20682 4927 Acked 5926 Read 10 Done Done New false
20683 4928 Acked 5927 Read 6 Done Done New false
20684 4929 Acked 5928 Read 9 Done Done New false
20685 4930 Acked 5929 Write 7 Done Done New false
20686 4931 Acked 5930 Flush 0 Done Done New false
20687 4932 Acked 5931 Write 10 Done Done New false
20688 4933 Acked 5932 Read 9 Done Done New false
20689 4934 Acked 5933 Read 2 Done Done New false
20690 4935 Acked 5934 Write 10 Done Done New false
20691 4936 Acked 5935 Write 3 Done Done New false
20692 4937 Acked 5936 Write 7 Done Done New false
20693 4938 Acked 5937 Read 10 Done Done New false
20694 4939 Acked 5938 Write 9 Done Done New false
20695 4940 Acked 5939 Read 4 Done Done New false
20696 4941 Acked 5940 Read 4 Done Done New false
20697 4942 Acked 5941 Flush 0 Done Done New false
20698 4943 Acked 5942 Write 5 Done Done New false
20699 4944 Acked 5943 Write 5 Done Done New false
20700 4945 Acked 5944 Flush 0 Done Done New false
20701 4946 Acked 5945 Read 3 Done Done New false
20702 4947 Acked 5946 Read 10 Done Done New false
20703 4948 Acked 5947 Read 6 Done Done New false
20704 4949 Acked 5948 Flush 0 Done Done New false
20705 4950 Acked 5949 Write 10 Done Done New false
20706 4951 Acked 5950 Read 9 Done Done New false
20707 4952 Acked 5951 Write 3 Done Done New false
20708 4953 Acked 5952 Read 10 Done Done New false
20709 4954 Acked 5953 Write 6 Done Done New false
20710 4955 Acked 5954 Read 7 Done Done New false
20711 4956 Acked 5955 Write 7 Done Done New false
20712 4957 Acked 5956 Write 4 Done Done New false
20713 4958 Acked 5957 Read 10 Done Done New false
20714 4959 Acked 5958 Read 8 Done Done New false
20715 4960 Acked 5959 Read 10 Done Done New false
20716 4961 Acked 5960 Read 2 Done Done New false
20717 4962 Acked 5961 Write 8 Done Done New false
20718 4963 Acked 5962 Read 6 Done Done New false
20719 4964 Acked 5963 Write 5 Done Done New false
20720 4965 Acked 5964 Write 4 Done Done New false
20721 4966 Acked 5965 Read 9 Done Done New false
20722 4967 Acked 5966 Read 6 Done Done New false
20723 4968 Acked 5967 Write 9 Done Done New false
20724 4969 Acked 5968 Write 6 Done Done New false
20725 4970 Acked 5969 Read 2 Done Done New false
20726 4971 Acked 5970 Flush 0 Done Done New false
20727 4972 Acked 5971 Write 10 Done Done New false
20728 4973 Acked 5972 Read 9 Done Done New false
20729 4974 Acked 5973 Write 7 Done Done New false
20730 4975 Acked 5974 Read 10 Done Done New false
20731 4976 Acked 5975 Read 9 Done Done New false
20732 4977 Acked 5976 Read 4 Done Done New false
20733 4978 Acked 5977 Write 9 Done Done New false
20734 4979 Acked 5978 Write 6 Done Done New false
20735 4980 Acked 5979 Read 2 Done Done New false
20736 4981 Acked 5980 Write 4 Done Done New false
20737 4982 Acked 5981 Read 9 Done Done New false
20738 4983 Acked 5982 Read 2 Done Done New false
20739 4984 Acked 5983 Write 5 Done Done New false
20740 4985 Acked 5984 Write 1 Done Done New false
20741 4986 Acked 5985 Read 8 Done Done New false
20742 4987 Acked 5986 Write 2 Done Done New false
20743 4988 Acked 5987 Read 8 Done Done New false
20744 4989 Acked 5988 Write 9 Done Done New false
20745 4990 Acked 5989 Read 6 Done Done New false
20746 4991 Acked 5990 Write 7 Done Done New false
20747 4992 Acked 5991 Read 5 Done Done New false
20748 4993 Acked 5992 Write 2 Done Done New false
20749 4994 Acked 5993 Read 1 Done Done New false
20750 4995 Acked 5994 Read 7 Done Done New false
20751 4996 Acked 5995 Write 9 Done Done New false
20752 4997 Acked 5996 Read 5 Done Done New false
20753 4998 Acked 5997 Read 3 Done Done New false
20754 4999 Acked 5998 Read 7 Done Done New false
20755 5000 Acked 5999 Read 8 Done Done New false
20756 5001 Acked 6000 Write 8 Done Done New false
20757 5002 Acked 6001 Read 2 Done Done New false
20758 5003 Acked 6002 Flush 0 Done Done New false
20759 5004 Acked 6003 Read 5 Done Done New false
20760 5005 Acked 6004 Write 10 Done Done New false
20761 5006 Acked 6005 Read 2 Done Done New false
20762 5007 Acked 6006 Write 7 Done Done New false
20763 5008 Acked 6007 Read 6 Done Done New false
20764 5009 Acked 6008 Write 3 Done Done New false
20765 5010 Acked 6009 Write 8 Done Done New false
20766 5011 Acked 6010 Flush 0 Done Done New false
20767 5012 Acked 6011 Write 3 Done Done New false
20768 5013 Acked 6012 Write 2 Done Done New false
20769 5014 Acked 6013 Write 6 Done Done New false
20770 5015 Acked 6014 Read 9 Done Done New false
20771 5016 Acked 6015 Read 2 Done Done New false
20772 5017 Acked 6016 Write 9 Done Done New false
20773 5018 Acked 6017 Write 3 Done Done New false
20774 5019 Acked 6018 Read 2 Done Done New false
20775 5020 Acked 6019 Write 3 Done Done New false
20776 5021 Acked 6020 Write 10 Done Done New false
20777 5022 Acked 6021 Read 1 Done Done New false
20778 5023 Acked 6022 Read 6 Done Done New false
20779 5024 Acked 6023 Read 10 Done Done New false
20780 5025 Acked 6024 Write 6 Done Done New false
20781 5026 Acked 6025 Write 2 Done Done New false
20782 5027 Acked 6026 Read 8 Done Done New false
20783 5028 Acked 6027 Read 3 Done Done New false
20784 5029 Acked 6028 Read 5 Done Done New false
20785 5030 Acked 6029 Read 1 Done Done New false
20786 5031 Acked 6030 Flush 0 Done Done New false
20787 5032 Acked 6031 Write 9 Done Done New false
20788 5033 Acked 6032 Read 1 Done Done New false
20789 5034 Acked 6033 Write 9 Done Done New false
20790 5035 Acked 6034 Write 1 Done Done New false
20791 5036 Acked 6035 Read 1 Done Done New false
20792 5037 Acked 6036 Write 7 Done Done New false
20793 5038 Acked 6037 Write 9 Done Done New false
20794 5039 Acked 6038 Read 7 Done Done New false
20795 5040 Acked 6039 Flush 0 Done Done New false
20796 5041 Acked 6040 Read 6 Done Done New false
20797 5042 Acked 6041 Flush 0 Done Done New false
20798 5043 Acked 6042 Flush 0 Done Done New false
20799 5044 Acked 6043 Read 5 Done Done New false
20800 5045 Acked 6044 Write 4 Done Done New false
20801 5046 Acked 6045 Write 1 Done Done New false
20802 5047 Acked 6046 Read 2 Done Done New false
20803 5048 Acked 6047 Read 2 Done Done New false
20804 5049 Acked 6048 Write 8 Done Done New false
20805 5050 Acked 6049 Read 8 Done Done New false
20806 5051 Acked 6050 Read 8 Done Done New false
20807 5052 Acked 6051 Read 5 Done Done New false
20808 5053 Acked 6052 Read 6 Done Done New false
20809 5054 Acked 6053 Write 8 Done Done New false
20810 5055 Acked 6054 Write 1 Done Done New false
20811 5056 Acked 6055 Read 6 Done Done New false
20812 5057 Acked 6056 Write 8 Done Done New false
20813 5058 Acked 6057 Write 4 Done Done New false
20814 5059 Acked 6058 Read 6 Done Done New false
20815 5060 Acked 6059 Write 6 Done Done New false
20816 5061 Acked 6060 Write 5 Done Done New false
20817 5062 Acked 6061 Write 3 Done Done New false
20818 5063 Acked 6062 Read 7 Done Done New false
20819 5064 Acked 6063 Write 4 Done Done New false
20820 5065 Acked 6064 Flush 0 Done Done New false
20821 5066 Acked 6065 Write 6 Done Done New false
20822 5067 Acked 6066 Read 2 Done Done New false
20823 5068 Acked 6067 Read 9 Done Done New false
20824 5069 Acked 6068 Read 1 Done Done New false
20825 5070 Acked 6069 Write 2 Done Done New false
20826 5071 Acked 6070 Read 6 Done Done New false
20827 5072 Acked 6071 Write 1 Done Done New false
20828 5073 Acked 6072 Read 10 Done Done New false
20829 5074 Acked 6073 Write 9 Done Done New false
20830 5075 Acked 6074 Read 10 Done Done New false
20831 5076 Acked 6075 Read 3 Done Done New false
20832 5077 Acked 6076 Flush 0 Done Done New false
20833 5078 Acked 6077 Write 10 Done Done New false
20834 5079 Acked 6078 Read 7 Done Done New false
20835 5080 Acked 6079 Read 8 Done Done New false
20836 5081 Acked 6080 Write 2 Done Done New false
20837 5082 Acked 6081 Read 7 Done Done New false
20838 5083 Acked 6082 Write 4 Done Done New false
20839 5084 Acked 6083 Write 3 Done Done New false
20840 5085 Acked 6084 Read 8 Done Done New false
20841 5086 Acked 6085 Write 2 Done Done New false
20842 5087 Acked 6086 Write 10 Done Done New false
20843 5088 Acked 6087 Write 6 Done Done New false
20844 5089 Acked 6088 Read 4 Done Done New false
20845 5090 Acked 6089 Flush 0 Done Done New false
20846 5091 Acked 6090 Read 4 Done Done New false
20847 5092 Acked 6091 Write 8 Done Done New false
20848 5093 Acked 6092 Write 2 Done Done New false
20849 5094 Acked 6093 Write 1 Done Done New false
20850 5095 Acked 6094 Read 9 Done Done New false
20851 5096 Acked 6095 Write 2 Done Done New false
20852 5097 Acked 6096 Read 9 Done Done New false
20853 5098 Acked 6097 Write 7 Done Done New false
20854 5099 Acked 6098 Read 4 Done Done New false
20855 5100 Acked 6099 Write 3 Done Done New false
20856 5101 Acked 6100 Read 3 Done Done New false
20857 5102 Acked 6101 Read 1 Done Done New false
20858 5103 Acked 6102 Flush 0 Done Done New false
20859 5104 Acked 6103 Write 2 Done Done New false
20860 5105 Acked 6104 Write 9 Done Done New false
20861 5106 Acked 6105 Flush 0 Done Done New false
20862 5107 Acked 6106 Read 5 Done Done New false
20863 5108 Acked 6107 Write 8 Done Done New false
20864 5109 Acked 6108 Write 10 Done Done New false
20865 5110 Acked 6109 Write 1 Done Done New false
20866 5111 Acked 6110 Read 7 Done Done New false
20867 5112 Acked 6111 Read 10 Done Done New false
20868 5113 Acked 6112 Write 2 Done Done New false
20869 5114 Acked 6113 Flush 0 Done Done New false
20870 5115 Acked 6114 Read 6 Done Done New false
20871 5116 Acked 6115 Read 1 Done Done New false
20872 5117 Acked 6116 Read 1 Done Done New false
20873 5118 Acked 6117 Read 9 Done Done New false
20874 5119 Acked 6118 Write 2 Done Done New false
20875 5120 Acked 6119 Read 8 Done Done New false
20876 5121 Acked 6120 Write 2 Done Done New false
20877 5122 Acked 6121 Flush 0 Done Done New false
20878 5123 Acked 6122 Read 5 Done Done New false
20879 STATES DS:0 DS:1 DS:2 TOTAL
20880 New 0 0 300 300
20881 Sent 0 0 0 0
20882 Done 300 300 0 600
20883 Skipped 0 0 0 0
20884 Error 0 0 0 0
20885 Last Flush: 6121 6121 5822
20886 Downstairs last five completed: 5822 5821 5820 5819 5818
20887 Upstairs last five completed: 5123 5122 5121 5120 5119
20888 CLIENT: Up:0 ds:300 act:2
20889 [8830] got start action
20890 [8830] I am going to restart
20891 Starting downstairs at port 8830
20892 Make output file at "/tmp/dsc/downstairs-8830.txt"
20893 [8830][2] reports Starting
20894 Downstairs /var/tmp/dsc/region/8830 port 8830 PID:Some(1213)
20895 [8830][2] reports Running
20896 ----------------------------------------------------------------
20897 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:301
20898 States: Active Active Offline
20899 GW_ID ACK DSID TYPE BLOCKS DS:0 DS:1 DS:2 REPLAY
20900 4824 Acked 5823 Read 3 Done Done New false
20901 4825 Acked 5824 Write 1 Done Done New false
20902 4826 Acked 5825 Read 4 Done Done New false
20903 4827 Acked 5826 Write 10 Done Done New false
20904 4828 Acked 5827 Write 7 Done Done New false
20905 4829 Acked 5828 Write 1 Done Done New false
20906 4830 Acked 5829 Write 8 Done Done New false
20907 4831 Acked 5830 Flush 0 Done Done New false
20908 4832 Acked 5831 Write 8 Done Done New false
20909 4833 Acked 5832 Read 9 Done Done New false
20910 4834 Acked 5833 Read 2 Done Done New false
20911 4835 Acked 5834 Flush 0 Done Done New false
20912 4836 Acked 5835 Write 3 Done Done New false
20913 4837 Acked 5836 Write 7 Done Done New false
20914 4838 Acked 5837 Read 6 Done Done New false
20915 4839 Acked 5838 Read 4 Done Done New false
20916 4840 Acked 5839 Flush 0 Done Done New false
20917 4841 Acked 5840 Write 8 Done Done New false
20918 4842 Acked 5841 Read 4 Done Done New false
20919 4843 Acked 5842 Read 4 Done Done New false
20920 4844 Acked 5843 Read 1 Done Done New false
20921 4845 Acked 5844 Read 7 Done Done New false
20922 4846 Acked 5845 Write 1 Done Done New false
20923 4847 Acked 5846 Read 9 Done Done New false
20924 4848 Acked 5847 Write 1 Done Done New false
20925 4849 Acked 5848 Flush 0 Done Done New false
20926 4850 Acked 5849 Read 10 Done Done New false
20927 4851 Acked 5850 Read 5 Done Done New false
20928 4852 Acked 5851 Write 3 Done Done New false
20929 4853 Acked 5852 Read 10 Done Done New false
20930 4854 Acked 5853 Read 4 Done Done New false
20931 4855 Acked 5854 Read 9 Done Done New false
20932 4856 Acked 5855 Write 2 Done Done New false
20933 4857 Acked 5856 Write 1 Done Done New false
20934 4858 Acked 5857 Write 2 Done Done New false
20935 4859 Acked 5858 Read 1 Done Done New false
20936 4860 Acked 5859 Read 8 Done Done New false
20937 4861 Acked 5860 Write 8 Done Done New false
20938 4862 Acked 5861 Write 2 Done Done New false
20939 4863 Acked 5862 Read 7 Done Done New false
20940 4864 Acked 5863 Write 6 Done Done New false
20941 4865 Acked 5864 Write 7 Done Done New false
20942 4866 Acked 5865 Write 3 Done Done New false
20943 4867 Acked 5866 Write 6 Done Done New false
20944 4868 Acked 5867 Read 6 Done Done New false
20945 4869 Acked 5868 Write 5 Done Done New false
20946 4870 Acked 5869 Read 7 Done Done New false
20947 4871 Acked 5870 Read 4 Done Done New false
20948 4872 Acked 5871 Write 8 Done Done New false
20949 4873 Acked 5872 Write 5 Done Done New false
20950 4874 Acked 5873 Read 5 Done Done New false
20951 4875 Acked 5874 Write 2 Done Done New false
20952 4876 Acked 5875 Read 7 Done Done New false
20953 4877 Acked 5876 Read 9 Done Done New false
20954 4878 Acked 5877 Write 10 Done Done New false
20955 4879 Acked 5878 Write 10 Done Done New false
20956 4880 Acked 5879 Read 1 Done Done New false
20957 4881 Acked 5880 Write 3 Done Done New false
20958 4882 Acked 5881 Read 6 Done Done New false
20959 4883 Acked 5882 Write 1 Done Done New false
20960 4884 Acked 5883 Write 9 Done Done New false
20961 4885 Acked 5884 Flush 0 Done Done New false
20962 4886 Acked 5885 Write 7 Done Done New false
20963 4887 Acked 5886 Read 6 Done Done New false
20964 4888 Acked 5887 Flush 0 Done Done New false
20965 4889 Acked 5888 Read 7 Done Done New false
20966 4890 Acked 5889 Read 8 Done Done New false
20967 4891 Acked 5890 Write 8 Done Done New false
20968 4892 Acked 5891 Write 3 Done Done New false
20969 4893 Acked 5892 Write 4 Done Done New false
20970 4894 Acked 5893 Read 4 Done Done New false
20971 4895 Acked 5894 Read 2 Done Done New false
20972 4896 Acked 5895 Write 10 Done Done New false
20973 4897 Acked 5896 Write 9 Done Done New false
20974 4898 Acked 5897 Flush 0 Done Done New false
20975 4899 Acked 5898 Write 6 Done Done New false
20976 4900 Acked 5899 Read 2 Done Done New false
20977 4901 Acked 5900 Write 6 Done Done New false
20978 4902 Acked 5901 Write 5 Done Done New false
20979 4903 Acked 5902 Write 3 Done Done New false
20980 4904 Acked 5903 Read 4 Done Done New false
20981 4905 Acked 5904 Read 3 Done Done New false
20982 4906 Acked 5905 Read 9 Done Done New false
20983 4907 Acked 5906 Flush 0 Done Done New false
20984 4908 Acked 5907 Read 10 Done Done New false
20985 4909 Acked 5908 Read 10 Done Done New false
20986 4910 Acked 5909 Read 2 Done Done New false
20987 4911 Acked 5910 Read 9 Done Done New false
20988 4912 Acked 5911 Write 3 Done Done New false
20989 4913 Acked 5912 Read 5 Done Done New false
20990 4914 Acked 5913 Write 7 Done Done New false
20991 4915 Acked 5914 Read 4 Done Done New false
20992 4916 Acked 5915 Write 7 Done Done New false
20993 4917 Acked 5916 Read 4 Done Done New false
20994 4918 Acked 5917 Write 1 Done Done New false
20995 4919 Acked 5918 Write 10 Done Done New false
20996 4920 Acked 5919 Read 1 Done Done New false
20997 4921 Acked 5920 Flush 0 Done Done New false
20998 4922 Acked 5921 Read 3 Done Done New false
20999 4923 Acked 5922 Write 4 Done Done New false
21000 4924 Acked 5923 Flush 0 Done Done New false
21001 4925 Acked 5924 Write 7 Done Done New false
21002 4926 Acked 5925 Read 1 Done Done New false
21003 4927 Acked 5926 Read 10 Done Done New false
21004 4928 Acked 5927 Read 6 Done Done New false
21005 4929 Acked 5928 Read 9 Done Done New false
21006 4930 Acked 5929 Write 7 Done Done New false
21007 4931 Acked 5930 Flush 0 Done Done New false
21008 4932 Acked 5931 Write 10 Done Done New false
21009 4933 Acked 5932 Read 9 Done Done New false
21010 4934 Acked 5933 Read 2 Done Done New false
21011 4935 Acked 5934 Write 10 Done Done New false
21012 4936 Acked 5935 Write 3 Done Done New false
21013 4937 Acked 5936 Write 7 Done Done New false
21014 4938 Acked 5937 Read 10 Done Done New false
21015 4939 Acked 5938 Write 9 Done Done New false
21016 4940 Acked 5939 Read 4 Done Done New false
21017 4941 Acked 5940 Read 4 Done Done New false
21018 4942 Acked 5941 Flush 0 Done Done New false
21019 4943 Acked 5942 Write 5 Done Done New false
21020 4944 Acked 5943 Write 5 Done Done New false
21021 4945 Acked 5944 Flush 0 Done Done New false
21022 4946 Acked 5945 Read 3 Done Done New false
21023 4947 Acked 5946 Read 10 Done Done New false
21024 4948 Acked 5947 Read 6 Done Done New false
21025 4949 Acked 5948 Flush 0 Done Done New false
21026 4950 Acked 5949 Write 10 Done Done New false
21027 4951 Acked 5950 Read 9 Done Done New false
21028 4952 Acked 5951 Write 3 Done Done New false
21029 4953 Acked 5952 Read 10 Done Done New false
21030 4954 Acked 5953 Write 6 Done Done New false
21031 4955 Acked 5954 Read 7 Done Done New false
21032 4956 Acked 5955 Write 7 Done Done New false
21033 4957 Acked 5956 Write 4 Done Done New false
21034 4958 Acked 5957 Read 10 Done Done New false
21035 4959 Acked 5958 Read 8 Done Done New false
21036 4960 Acked 5959 Read 10 Done Done New false
21037 4961 Acked 5960 Read 2 Done Done New false
21038 4962 Acked 5961 Write 8 Done Done New false
21039 4963 Acked 5962 Read 6 Done Done New false
21040 4964 Acked 5963 Write 5 Done Done New false
21041 4965 Acked 5964 Write 4 Done Done New false
21042 4966 Acked 5965 Read 9 Done Done New false
21043 4967 Acked 5966 Read 6 Done Done New false
21044 4968 Acked 5967 Write 9 Done Done New false
21045 4969 Acked 5968 Write 6 Done Done New false
21046 4970 Acked 5969 Read 2 Done Done New false
21047 4971 Acked 5970 Flush 0 Done Done New false
21048 4972 Acked 5971 Write 10 Done Done New false
21049 4973 Acked 5972 Read 9 Done Done New false
21050 4974 Acked 5973 Write 7 Done Done New false
21051 4975 Acked 5974 Read 10 Done Done New false
21052 4976 Acked 5975 Read 9 Done Done New false
21053 4977 Acked 5976 Read 4 Done Done New false
21054 4978 Acked 5977 Write 9 Done Done New false
21055 4979 Acked 5978 Write 6 Done Done New false
21056 4980 Acked 5979 Read 2 Done Done New false
21057 4981 Acked 5980 Write 4 Done Done New false
21058 4982 Acked 5981 Read 9 Done Done New false
21059 4983 Acked 5982 Read 2 Done Done New false
21060 4984 Acked 5983 Write 5 Done Done New false
21061 4985 Acked 5984 Write 1 Done Done New false
21062 4986 Acked 5985 Read 8 Done Done New false
21063 4987 Acked 5986 Write 2 Done Done New false
21064 4988 Acked 5987 Read 8 Done Done New false
21065 4989 Acked 5988 Write 9 Done Done New false
21066 4990 Acked 5989 Read 6 Done Done New false
21067 4991 Acked 5990 Write 7 Done Done New false
21068 4992 Acked 5991 Read 5 Done Done New false
21069 4993 Acked 5992 Write 2 Done Done New false
21070 4994 Acked 5993 Read 1 Done Done New false
21071 4995 Acked 5994 Read 7 Done Done New false
21072 4996 Acked 5995 Write 9 Done Done New false
21073 4997 Acked 5996 Read 5 Done Done New false
21074 4998 Acked 5997 Read 3 Done Done New false
21075 4999 Acked 5998 Read 7 Done Done New false
21076 5000 Acked 5999 Read 8 Done Done New false
21077 5001 Acked 6000 Write 8 Done Done New false
21078 5002 Acked 6001 Read 2 Done Done New false
21079 5003 Acked 6002 Flush 0 Done Done New false
21080 5004 Acked 6003 Read 5 Done Done New false
21081 5005 Acked 6004 Write 10 Done Done New false
21082 5006 Acked 6005 Read 2 Done Done New false
21083 5007 Acked 6006 Write 7 Done Done New false
21084 5008 Acked 6007 Read 6 Done Done New false
21085 5009 Acked 6008 Write 3 Done Done New false
21086 5010 Acked 6009 Write 8 Done Done New false
21087 5011 Acked 6010 Flush 0 Done Done New false
21088 5012 Acked 6011 Write 3 Done Done New false
21089 5013 Acked 6012 Write 2 Done Done New false
21090 5014 Acked 6013 Write 6 Done Done New false
21091 5015 Acked 6014 Read 9 Done Done New false
21092 5016 Acked 6015 Read 2 Done Done New false
21093 5017 Acked 6016 Write 9 Done Done New false
21094 5018 Acked 6017 Write 3 Done Done New false
21095 5019 Acked 6018 Read 2 Done Done New false
21096 5020 Acked 6019 Write 3 Done Done New false
21097 5021 Acked 6020 Write 10 Done Done New false
21098 5022 Acked 6021 Read 1 Done Done New false
21099 5023 Acked 6022 Read 6 Done Done New false
21100 5024 Acked 6023 Read 10 Done Done New false
21101 5025 Acked 6024 Write 6 Done Done New false
21102 5026 Acked 6025 Write 2 Done Done New false
21103 5027 Acked 6026 Read 8 Done Done New false
21104 5028 Acked 6027 Read 3 Done Done New false
21105 5029 Acked 6028 Read 5 Done Done New false
21106 5030 Acked 6029 Read 1 Done Done New false
21107 5031 Acked 6030 Flush 0 Done Done New false
21108 5032 Acked 6031 Write 9 Done Done New false
21109 5033 Acked 6032 Read 1 Done Done New false
21110 5034 Acked 6033 Write 9 Done Done New false
21111 5035 Acked 6034 Write 1 Done Done New false
21112 5036 Acked 6035 Read 1 Done Done New false
21113 5037 Acked 6036 Write 7 Done Done New false
21114 5038 Acked 6037 Write 9 Done Done New false
21115 5039 Acked 6038 Read 7 Done Done New false
21116 5040 Acked 6039 Flush 0 Done Done New false
21117 5041 Acked 6040 Read 6 Done Done New false
21118 5042 Acked 6041 Flush 0 Done Done New false
21119 5043 Acked 6042 Flush 0 Done Done New false
21120 5044 Acked 6043 Read 5 Done Done New false
21121 5045 Acked 6044 Write 4 Done Done New false
21122 5046 Acked 6045 Write 1 Done Done New false
21123 5047 Acked 6046 Read 2 Done Done New false
21124 5048 Acked 6047 Read 2 Done Done New false
21125 5049 Acked 6048 Write 8 Done Done New false
21126 5050 Acked 6049 Read 8 Done Done New false
21127 5051 Acked 6050 Read 8 Done Done New false
21128 5052 Acked 6051 Read 5 Done Done New false
21129 5053 Acked 6052 Read 6 Done Done New false
21130 5054 Acked 6053 Write 8 Done Done New false
21131 5055 Acked 6054 Write 1 Done Done New false
21132 5056 Acked 6055 Read 6 Done Done New false
21133 5057 Acked 6056 Write 8 Done Done New false
21134 5058 Acked 6057 Write 4 Done Done New false
21135 5059 Acked 6058 Read 6 Done Done New false
21136 5060 Acked 6059 Write 6 Done Done New false
21137 5061 Acked 6060 Write 5 Done Done New false
21138 5062 Acked 6061 Write 3 Done Done New false
21139 5063 Acked 6062 Read 7 Done Done New false
21140 5064 Acked 6063 Write 4 Done Done New false
21141 5065 Acked 6064 Flush 0 Done Done New false
21142 5066 Acked 6065 Write 6 Done Done New false
21143 5067 Acked 6066 Read 2 Done Done New false
21144 5068 Acked 6067 Read 9 Done Done New false
21145 5069 Acked 6068 Read 1 Done Done New false
21146 5070 Acked 6069 Write 2 Done Done New false
21147 5071 Acked 6070 Read 6 Done Done New false
21148 5072 Acked 6071 Write 1 Done Done New false
21149 5073 Acked 6072 Read 10 Done Done New false
21150 5074 Acked 6073 Write 9 Done Done New false
21151 5075 Acked 6074 Read 10 Done Done New false
21152 5076 Acked 6075 Read 3 Done Done New false
21153 5077 Acked 6076 Flush 0 Done Done New false
21154 5078 Acked 6077 Write 10 Done Done New false
21155 5079 Acked 6078 Read 7 Done Done New false
21156 5080 Acked 6079 Read 8 Done Done New false
21157 5081 Acked 6080 Write 2 Done Done New false
21158 5082 Acked 6081 Read 7 Done Done New false
21159 5083 Acked 6082 Write 4 Done Done New false
21160 5084 Acked 6083 Write 3 Done Done New false
21161 5085 Acked 6084 Read 8 Done Done New false
21162 5086 Acked 6085 Write 2 Done Done New false
21163 5087 Acked 6086 Write 10 Done Done New false
21164 5088 Acked 6087 Write 6 Done Done New false
21165 5089 Acked 6088 Read 4 Done Done New false
21166 5090 Acked 6089 Flush 0 Done Done New false
21167 5091 Acked 6090 Read 4 Done Done New false
21168 5092 Acked 6091 Write 8 Done Done New false
21169 5093 Acked 6092 Write 2 Done Done New false
21170 5094 Acked 6093 Write 1 Done Done New false
21171 5095 Acked 6094 Read 9 Done Done New false
21172 5096 Acked 6095 Write 2 Done Done New false
21173 5097 Acked 6096 Read 9 Done Done New false
21174 5098 Acked 6097 Write 7 Done Done New false
21175 5099 Acked 6098 Read 4 Done Done New false
21176 5100 Acked 6099 Write 3 Done Done New false
21177 5101 Acked 6100 Read 3 Done Done New false
21178 5102 Acked 6101 Read 1 Done Done New false
21179 5103 Acked 6102 Flush 0 Done Done New false
21180 5104 Acked 6103 Write 2 Done Done New false
21181 5105 Acked 6104 Write 9 Done Done New false
21182 5106 Acked 6105 Flush 0 Done Done New false
21183 5107 Acked 6106 Read 5 Done Done New false
21184 5108 Acked 6107 Write 8 Done Done New false
21185 5109 Acked 6108 Write 10 Done Done New false
21186 5110 Acked 6109 Write 1 Done Done New false
21187 5111 Acked 6110 Read 7 Done Done New false
21188 5112 Acked 6111 Read 10 Done Done New false
21189 5113 Acked 6112 Write 2 Done Done New false
21190 5114 Acked 6113 Flush 0 Done Done New false
21191 5115 Acked 6114 Read 6 Done Done New false
21192 5116 Acked 6115 Read 1 Done Done New false
21193 5117 Acked 6116 Read 1 Done Done New false
21194 5118 Acked 6117 Read 9 Done Done New false
21195 5119 Acked 6118 Write 2 Done Done New false
21196 5120 Acked 6119 Read 8 Done Done New false
21197 5121 Acked 6120 Write 2 Done Done New false
21198 5122 Acked 6121 Flush 0 Done Done New false
21199 5123 Acked 6122 Read 5 Done Done New false
21200 5124 Acked 6123 Flush 0 Done Done New false
21201 STATES DS:0 DS:1 DS:2 TOTAL
21202 New 0 0 301 301
21203 Sent 0 0 0 0
21204 Done 301 301 0 602
21205 Skipped 0 0 0 0
21206 Error 0 0 0 0
21207 Last Flush: 6123 6123 5822
21208 Downstairs last five completed: 5822 5821 5820 5819 5818
21209 Upstairs last five completed: 5124 5123 5122 5121 5120
21210 CLIENT: Up:0 ds:301 act:2
212112024-04-20T01:09:31.192ZINFOcrucible: connecting to 127.0.0.1:8830 = io task client = 2 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
212122024-04-20T01:09:31.192ZINFOcrucible: ds_connection connected from Ok(127.0.0.1:63094) = io task client = 2 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
212132024-04-20T01:09:31.193ZINFOcrucible: downstairs client at Some(127.0.0.1:8830) has region UUID 12345678-0000-0000-0000-000000008830 = downstairs client = 2 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
212142024-04-20T01:09:31.193ZINFOcrucible: Returning UUID:12345678-0000-0000-0000-000000008830 matches = downstairs client = 2 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
212152024-04-20T01:09:31.193ZINFOcrucible: send last flush ID to this DS: 5822 = downstairs client = 2 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
212162024-04-20T01:09:31.194ZINFOcrucible: Replied this last flush ID: 5822 = downstairs client = 2 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
212172024-04-20T01:09:31.194ZINFOcrucible: ds_transition from Offline to Replay = downstairs client = 2 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
212182024-04-20T01:09:31.194ZINFOcrucible: [2] Transition from Offline to Replay = downstairs client = 2 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
212192024-04-20T01:09:31.194ZINFOcrucible: ds_transition from Replay to Active = downstairs client = 2 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
212202024-04-20T01:09:31.194ZINFOcrucible: [2] Transition from Replay to Active = downstairs client = 2 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
21221 ----------------------------------------------------------------
21222 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:0
21223 Downstairs last five completed: 6123 6122 6121 6120 6119
21224 Upstairs last five completed: 5124 5123 5122 5121 5120
21225 CLIENT: Up:0 ds:0 act:3
21226 Replay: All jobs finished, all DS active.
21227 Main task has work to do, go find it
21228 got dsc Stop(1)
21229 stop 1
21230 Apr 20 01:09:33.510 INFO request completed, latency_us: 304, response_code: 204, uri: /stop/cid/1, method:[8820] Got stop action so:false kr:false
21231 POST, req_id: d08c464d-a529-4082-ac07-a04a74d08d61, remote_addr: 127.0.0.1:60352, local_addr: 127.0.0.1:9998
212322024-04-20T01:09:33.510ZWARNcrucible: downstairs disconnected = io task client = 1 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
212332024-04-20T01:09:33.511ZWARNcrucible: client task is sending Done(Finished) = io task client = 1 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
212342024-04-20T01:09:33.511ZWARNcrucible: downstairs task for 1 stopped due to Finished session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
21235 Apr 20 01:09:33.511{"msg":"Gone missing, transition from Active to Offline","v":0,"name":"crucible","level":30,"time":"2024-04-20T01:09:33.511095701Z","hostname":"w-01HVWGBJP7HK0H9TQ26T6N3X8M","pid":1196,"client":"1","":"downstairs","session_id":"132b460a-26a0-4532-b1ab-4f8c07d4c6c7"}
21236 INFO request completed, latency_us: 132, response_code: 200, uri:{"msg":"[1] client re-new 0 jobs since flush 6123","v":0,"name":"crucible","level":30,"time":"2024-04-20T01:09:33.51114291Z","hostname":"w-01HVWGBJP7HK0H9TQ26T6N3X8M","pid":1196,"":"downstairs","":"downstairs","session_id":"132b460a-26a0-4532-b1ab-4f8c07d4c6c7"}
21237 /state/cid/1, method: GET, req_id: 62fca42f-7333-4803-91dc-de66df7d0e97, remote_addr: 127.0.{"msg":"[1] Marked 0 jobs for replay since flush: 6123","v":0,"name":"crucible","level":30,"time":"2024-04-20T01:09:33.511194689Z","hostname":"w-01HVWGBJP7HK0H9TQ26T6N3X8M","pid":1196,"":"downstairs","":"downstairs","session_id":"132b460a-26a0-4532-b1ab-4f8c07d4c6c7"}
21238 0.1:60352, local_addr: 127.0.0.1:9998
212392024-04-20T01:09:33.511ZINFOcrucible: client task is exiting = io task client = 1 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
21240 [8820] Exited with: ExitStatus(unix_wait_status(9))
21241 [8820][1] reports Exit
21242 Apr 20 01:09:37.512 INFO request completed, latency_us: 207, response_code: 200, uri: /state/cid/1, method: GET, req_id: c331f037-5abf-48d8-bb7d-3c7db329b6c1, remote_addr: 127.0.0.1:60352, local_addr: 127.0.0.1:9998
21243 001/300 Read block 2173 len 32768
21244 002/300 Write block 3438 len 36864 data: 4 4 5 5 5 2 2 2 2
21245 003/300 Read block 485 len 8192
21246 004/300 Write block 1591 len 24576 data: 5 5 4 5 5 4
21247 005/300 Read block 4990 len 24576
21248 006/300 Read block 30 len 16384
21249 007/300 Read block 1013 len 24576
21250 008/300 Flush
21251 009/300 Write block 1938 len 36864 data: 3 3 4 4 3 2 2 2 3
21252 010/300 Write block 1440 len 32768 data: 6 7 8 5 6 7 5 5
21253 011/300 Read block 2364 len 4096
21254 012/300 Write block 4534 len 4096 data: 3
21255 013/300 Read block 3934 len 20480
21256 014/300 Read block 334 len 32768
21257 015/300 Flush
21258 016/300 Read block 76 len 12288
21259 017/300 Read block 4675 len 36864
21260 018/300 Write block 4168 len 16384 data: 4 6 8 7
21261 019/300 Read block 3768 len 36864
21262 020/300 Read block 437 len 16384
21263 021/300 Read block 1507 len 20480
21264 022/300 Flush
21265 023/300 Write block 807 len 8192 data: 2 2
21266 024/300 Read block 3061 len 12288
21267 025/300 Write block 3444 len 20480 data: 3 3 3 2 3
21268 026/300 Read block 3903 len 12288
21269 027/300 Read block 3620 len 36864
21270 028/300 Read block 1967 len 12288
21271 029/300 Flush
21272 030/300 Write block 2753 len 36864 data: 5 5 5 6 5 5 5 3 2
21273 031/300 Write block 4186 len 32768 data: 4 3 3 3 3 3 3 3
21274 032/300 Read block 208 len 36864
21275 033/300 Read block 172 len 16384
21276 034/300 Read block 2690 len 28672
21277 035/300 Read block 4254 len 24576
21278 036/300 Read block 2688 len 4096
21279 037/300 Write block 2426 len 16384 data: 6 5 4 4
21280 038/300 Read block 489 len 4096
21281 039/300 Read block 1218 len 36864
21282 040/300 Write block 3874 len 32768 data: 3 3 4 4 4 4 3 3
21283 041/300 Read block 739 len 4096
21284 042/300 Write block 4432 len 28672 data: 7 5 4 4 3 3 2
21285 043/300 Flush
21286 044/300 Flush
21287 045/300 Write block 1566 len 8192 data: 4 4
21288 046/300 Write block 1162 len 36864 data: 3 3 3 3 2 2 4 5 5
21289 047/300 Read block 2834 len 24576
21290 048/300 Read block 3396 len 40960
21291 049/300 Write block 4412 len 36864 data: 6 8 6 6 4 4 4 3 3
21292 050/300 Write block 2749 len 36864 data: 5 5 4 5 6 6 6 7 6
21293 051/300 Write block 2895 len 36864 data: 4 4 4 4 4 5 5 4 5
21294 052/300 Flush
21295 053/300 Flush
21296 054/300 Read block 360 len 20480
21297 055/300 Read block 3844 len 8192
21298 056/300 Flush
21299 057/300 Write block 1188 len 40960 data: 4 4 4 5 5 4 3 3 4 4
21300 058/300 Read block 4332 len 16384
21301 059/300 Read block 1932 len 20480
21302 060/300 Read block 2588 len 32768
21303 061/300 Read block 1880 len 36864
21304 062/300 Read block 2695 len 32768
21305 063/300 Read block 2967 len 28672
21306 064/300 Write block 689 len 40960 data: 4 4 4 4 5 5 3 5 4 4
21307 065/300 Read block 4411 len 36864
21308 066/300 Read block 1940 len 12288
21309 067/300 Read block 4908 len 12288
21310 068/300 Write block 3687 len 20480 data: 6 6 4 3 3
21311 069/300 Read block 4351 len 24576
21312 070/300 Read block 3034 len 4096
21313 071/300 Read block 2092 len 24576
21314 072/300 Read block 3098 len 28672
21315 073/300 Write block 159 len 8192 data: 4 4
21316 074/300 Write block 542 len 20480 data: 5 6 6 4 4
21317 075/300 Flush
21318 076/300 Read block 4203 len 12288
21319 077/300 Read block 2363 len 4096
21320 078/300 Write block 1164 len 16384 data: 4 4 3 3
21321 079/300 Read block 2602 len 32768
21322 080/300 Read block 1936 len 20480
21323 081/300 Write block 2399 len 36864 data: 5 5 5 3 3 3 2 2 2
21324 082/300 Write block 2010 len 28672 data: 6 3 3 3 3 4 3
21325 083/300 Write block 1317 len 40960 data: 3 3 2 2 2 2 2 3 3 3
21326 084/300 Read block 1495 len 40960
21327 085/300 Write block 3971 len 16384 data: 2 3 3 3
21328 086/300 Read block 4935 len 12288
21329 087/300 Write block 4501 len 32768 data: 3 3 2 2 2 2 2 2
21330 088/300 Read block 3297 len 32768
21331 089/300 Read block 2270 len 4096
21332 090/300 Read block 4697 len 16384
21333 091/300 Write block 3786 len 12288 data: 6 7 7
21334 092/300 Read block 1316 len 16384
21335 093/300 Write block 4951 len 28672 data: 7 8 7 7 6 3 2
21336 094/300 Write block 3448 len 8192 data: 4 4
21337 095/300 Write block 1319 len 12288 data: 3 3 3
21338 096/300 Write block 2763 len 8192 data: 3 3
21339 097/300 Read block 325 len 8192
21340 098/300 Read block 1386 len 40960
21341 099/300 Write block 3505 len 24576 data: 3 2 3 3 3 3
21342 100/300 Read block 1187 len 8192
21343 101/300 Flush
21344 102/300 Write block 4587 len 32768 data: 2 3 3 2 2 2 2 3
21345 103/300 Read block 1430 len 24576
21346 104/300 Read block 875 len 20480
21347 105/300 Write block 4358 len 40960 data: 4 4 4 4 4 3 3 3 4 4
21348 106/300 Read block 3022 len 20480
21349 107/300 Read block 1167 len 40960
21350 108/300 Write block 969 len 16384 data: 4 2 4 4
21351 109/300 Read block 3204 len 36864
21352 110/300 Read block 422 len 28672
21353 111/300 Read block 1862 len 24576
21354 112/300 Write block 1488 len 24576 data: 3 3 4 4 3 4
21355 113/300 Read block 951 len 12288
21356 114/300 Read block 512 len 8192
21357 115/300 Read block 3515 len 32768
21358 116/300 Write block 1322 len 28672 data: 3 3 4 4 4 3 3
21359 117/300 Write block 1853 len 4096 data: 4
21360 118/300 Read block 4200 len 12288
21361 119/300 Read block 3433 len 20480
21362 120/300 Write block 1402 len 36864 data: 4 4 4 4 5 4 4 3 3
21363 121/300 Flush
21364 122/300 Write block 3905 len 40960 data: 4 4 4 6 6 5 5 6 6 4
21365 123/300 Write block 1228 len 36864 data: 4 4 4 3 3 3 3 3 3
21366 124/300 Read block 4954 len 8192
21367 125/300 Write block 62 len 32768 data: 4 4 5 5 5 4 4 4
21368 126/300 Write block 1790 len 32768 data: 4 4 3 3 4 5 6 5
21369 127/300 Write block 1778 len 4096 data: 7
21370 128/300 Read block 4428 len 24576
21371 129/300 Write block 2057 len 40960 data: 7 6 6 5 6 5 5 5 6 6
21372 130/300 Read block 1936 len 4096
21373 131/300 Write block 4118 len 28672 data: 4 5 4 5 4 6 6
21374 132/300 Flush
21375 133/300 Write block 4528 len 16384 data: 3 6 5 5
21376 134/300 Write block 88 len 16384 data: 7 7 5 5
21377 135/300 Write block 1678 len 12288 data: 4 3 5
21378 136/300 Read block 1546 len 4096
21379 137/300 Write block 4319 len 8192 data: 5 4
21380 138/300 Flush
21381 139/300 Read block 1057 len 16384
21382 140/300 Read block 3178 len 8192
21383 141/300 Read block 1165 len 4096
21384 142/300 Read block 1072 len 8192
21385 143/300 Flush
21386 144/300 Flush
21387 145/300 Write block 1189 len 12288 data: 5 5 6
21388 146/300 Flush
21389 147/300 Write block 2748 len 24576 data: 5 6 6 5 6 7
21390 148/300 Write block 1543 len 32768 data: 6 7 6 6 6 5 5 5
21391 149/300 Write block 127 len 20480 data: 5 5 2 3 3
21392 150/300 Write block 2767 len 20480 data: 7 8 7 6 7
21393 151/300 Read block 4782 len 24576
21394 152/300 Read block 3994 len 20480
21395 153/300 Write block 3409 len 20480 data: 3 3 4 4 3
21396 154/300 Write block 4406 len 16384 data: 3 6 5 5
21397 155/300 Write block 3260 len 4096 data: 2
21398 156/300 Read block 3016 len 12288
21399 157/300 Read block 4080 len 16384
21400 158/300 Read block 3748 len 40960
21401 159/300 Read block 4410 len 12288
21402 160/300 Read block 406 len 16384
21403 161/300 Read block 231 len 36864
21404 162/300 Read block 1074 len 12288
21405 163/300 Read block 4076 len 12288
21406 164/300 Write block 1864 len 36864 data: 2 2 2 3 3 3 3 3 3
21407 165/300 Read block 632 len 36864
21408 166/300 Read block 1146 len 8192
21409 167/300 Write block 4408 len 8192 data: 6 6
21410 168/300 Flush
21411 169/300 Write block 536 len 12288 data: 3 3 3
21412 170/300 Flush
21413 171/300 Read block 1290 len 32768
21414 172/300 Write block 2345 len 12288 data: 5 5 5
21415 173/300 Write block 243 len 40960 data: 4 6 9 7 6 6 6 7 7 7
21416 174/300 Read block 4407 len 12288
21417 175/300 Read block 1065 len 8192
21418 176/300 Read block 3203 len 40960
21419 177/300 Read block 4399 len 36864
21420 178/300 Read block 1893 len 32768
21421 179/300 Write block 3919 len 32768 data: 6 6 5 5 4 3 3 3
21422 180/300 Write block 4714 len 8192 data: 6 4
21423 181/300 Write block 3914 len 8192 data: 5 4
21424 182/300 Write block 4054 len 4096 data: 6
21425 183/300 Read block 2299 len 32768
21426 184/300 Read block 2857 len 28672
21427 185/300 Read block 3923 len 40960
21428 186/300 Read block 4681 len 40960
21429 187/300 Read block 4684 len 4096
21430 188/300 Read block 4176 len 12288
21431 189/300 Read block 2396 len 4096
21432 190/300 Read block 4893 len 16384
21433 191/300 Read block 3699 len 4096
21434 192/300 Read block 2869 len 12288
21435 193/300 Write block 974 len 24576 data: 4 3 3 3 4 4
21436 194/300 Write block 1255 len 32768 data: 5 5 4 4 4 4 5 4
21437 195/300 Write block 3862 len 36864 data: 6 5 5 5 6 5 4 4 5
21438 196/300 Write block 4782 len 12288 data: 6 6 5
21439 197/300 Write block 1767 len 16384 data: 4 5 4 6
21440 198/300 Write block 4747 len 24576 data: 5 4 4 3 4 5
21441 199/300 Read block 4990 len 40960
21442 200/300 Read block 2735 len 24576
21443 201/300 Write block 4764 len 12288 data: 5 4 3
21444 202/300 Write block 2853 len 28672 data: 3 3 4 4 3 4 4
21445 203/300 Write block 4088 len 32768 data: 3 3 4 4 3 3 3 3
21446 204/300 Write block 1212 len 32768 data: 4 4 4 3 3 4 3 3
21447 205/300 Read block 2330 len 24576
21448 206/300 Write block 1758 len 16384 data: 4 5 5 4
21449 207/300 Read block 2157 len 8192
21450 208/300 Read block 1625 len 32768
21451 209/300 Write block 1608 len 28672 data: 6 5 3 2 3 4 5
21452 210/300 Write block 4298 len 24576 data: 6 5 4 5 5 5
21453 211/300 Flush
21454 212/300 Write block 39 len 20480 data: 4 4 3 3 4
21455 213/300 Read block 3021 len 32768
21456 214/300 Read block 4005 len 40960
21457 215/300 Write block 4562 len 12288 data: 3 3 4
21458 216/300 Flush
21459 217/300 Read block 2035 len 4096
21460 218/300 Read block 3877 len 8192
21461 219/300 Write block 1815 len 20480 data: 4 3 3 3 3
21462 220/300 Read block 3162 len 16384
21463 221/300 Write block 163 len 8192 data: 3 3
21464 222/300 Write block 3195 len 32768 data: 6 6 5 6 6 7 8 9
21465 223/300 Read block 4256 len 12288
21466 224/300 Read block 705 len 24576
21467 225/300 Read block 4080 len 20480
21468 226/300 Read block 3242 len 32768
21469 227/300 Read block 204 len 8192
21470 228/300 Read block 701 len 40960
21471 229/300 Read block 4248 len 20480
21472 230/300 Write block 3441 len 40960 data: 6 6 3 4 4 4 3 5 5 3
21473 231/300 Read block 4263 len 36864
21474 232/300 Read block 2431 len 24576
21475 233/300 Write block 2312 len 36864 data: 6 6 5 5 5 4 5 4 4
21476 234/300 Write block 2514 len 28672 data: 6 6 6 7 6 5 5
21477 235/300 Read block 427 len 36864
21478 236/300 Read block 3260 len 4096
21479 237/300 Write block 497 len 8192 data: 3 4
21480 238/300 Read block 226 len 4096
21481 239/300 Write block 176 len 32768 data: 3 4 4 3 3 3 2 2
21482 240/300 Read block 2790 len 24576
21483 241/300 Read block 1798 len 36864
21484 242/300 Read block 1536 len 24576
21485 243/300 Flush
21486 244/300 Read block 585 len 8192
21487 245/300 Read block 4075 len 24576
21488 246/300 Read block 4676 len 20480
21489 247/300 Read block 70 len 32768
21490 248/300 Read block 4837 len 24576
21491 249/300 Read block 4449 len 12288
21492 250/300 Write block 4186 len 20480 data: 5 4 4 4 4
21493 251/300 Read block 1480 len 24576
21494 252/300 Read block 3627 len 12288
21495 253/300 Flush
21496 254/300 Write block 2327 len 32768 data: 5 5 4 4 4 4 5 6
21497 255/300 Read block 2622 len 20480
21498 256/300 Write block 4079 len 40960 data: 9 10 8 6 6 5 4 4 3 4
21499 257/300 Write block 277 len 12288 data: 6 5 5
21500 258/300 Write block 4873 len 16384 data: 7 7 8 9
21501 259/300 Write block 1111 len 4096 data: 5
21502 260/300 Read block 1329 len 8192
21503 261/300 Write block 421 len 16384 data: 4 6 6 4
21504 262/300 Read block 3045 len 20480
21505 263/300 Read block 3219 len 32768
21506 264/300 Read block 813 len 16384
21507 265/300 Write block 3847 len 20480 data: 3 3 3 3 2
21508 266/300 Write block 1817 len 32768 data: 4 4 4 3 3 3 4 4
21509 267/300 Read block 4656 len 28672
21510 268/300 Read block 1060 len 28672
21511 269/300 Read block 512 len 36864
21512 270/300 Read block 2593 len 4096
21513 271/300 Flush
21514 272/300 Read block 3958 len 16384
21515 273/300 Write block 1356 len 20480 data: 5 5 5 7 5
21516 274/300 Flush
21517 275/300 Write block 688 len 4096 data: 4
21518 276/300 Flush
21519 277/300 Write block 506 len 12288 data: 6 6 6
21520 278/300 Write block 3785 len 24576 data: 5 7 8 8 8 6
21521 279/300 Read block 3180 len 4096
21522 280/300 Read block 178 len 28672
21523 281/300 Read block 107 len 16384
21524 282/300 Flush
21525 283/300 Write block 3037 len 8192 data: 5 5
21526 284/300 Read block 2532 len 28672
21527 285/300 Read block 4544 len 20480
21528 286/300 Read block 4697 len 16384
21529 287/300 Flush
21530 288/300 Read block 2870 len 8192
21531 289/300 Write block 2255 len 8192 data: 3 3
21532 290/300 Read block 3675 len 40960
21533 291/300 Flush
21534 292/300 Read block 58 len 12288
21535 293/300 Write block 651 len 32768 data: 3 3 4 3 2 2 5 4
21536 294/300 Write block 1228 len 36864 data: 5 5 5 4 4 4 4 4 4
21537 295/300 Write block 2438 len 24576 data: 3 5 4 4 3 3
21538 296/300 Write block 1818 len 20480 data: 5 5 4 4 4
21539 297/300 Write block 2691 len 16384 data: 3 2 2 2
21540 298/300 Read block 2095 len 12288
21541 299/300 Write block 3783 len 4096 data: 3
21542 300/300 Write block 297 len 16384 data: 5 7 7 6
21543 Main task has work to do, go find it
21544 got dsc Start(1)
21545 start 1
21546 Apr 20 01:09:37.813 INFO request completed, latency_us: 214, response_code: 204, uri: /start/cid/1, method: POST, req_id: 1ac7d1f0-3bd2-47f4-a8b5-495a4285e858, remote_addr: 127.0.0.1:60352, local_addr: 127.0.0.1:9998
21547 Replay: started 1, returned:Ok(())
21548 ----------------------------------------------------------------
21549 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:301
21550 States: Active Offline Active
21551 GW_ID ACK DSID TYPE BLOCKS DS:0 DS:1 DS:2 REPLAY
21552 5125 Acked 6124 Read 8 Done New Done false
21553 5126 Acked 6125 Write 9 Done New Done false
21554 5127 Acked 6126 Read 2 Done New Done false
21555 5128 Acked 6127 Write 6 Done New Done false
21556 5129 Acked 6128 Read 6 Done New Done false
21557 5130 Acked 6129 Read 4 Done New Done false
21558 5131 Acked 6130 Read 6 Done New Done false
21559 5132 Acked 6131 Flush 0 Done New Done false
21560 5133 Acked 6132 Write 9 Done New Done false
21561 5134 Acked 6133 Write 8 Done New Done false
21562 5135 Acked 6134 Read 1 Done New Done false
21563 5136 Acked 6135 Write 1 Done New Done false
21564 5137 Acked 6136 Read 5 Done New Done false
21565 5138 Acked 6137 Read 8 Done New Done false
21566 5139 Acked 6138 Flush 0 Done New Done false
21567 5140 Acked 6139 Read 3 Done New Done false
21568 5141 Acked 6140 Read 9 Done New Done false
21569 5142 Acked 6141 Write 4 Done New Done false
21570 5143 Acked 6142 Read 9 Done New Done false
21571 5144 Acked 6143 Read 4 Done New Done false
21572 5145 Acked 6144 Read 5 Done New Done false
21573 5146 Acked 6145 Flush 0 Done New Done false
21574 5147 Acked 6146 Write 2 Done New Done false
21575 5148 Acked 6147 Read 3 Done New Done false
21576 5149 Acked 6148 Write 5 Done New Done false
21577 5150 Acked 6149 Read 3 Done New Done false
21578 5151 Acked 6150 Read 9 Done New Done false
21579 5152 Acked 6151 Read 3 Done New Done false
21580 5153 Acked 6152 Flush 0 Done New Done false
21581 5154 Acked 6153 Write 9 Done New Done false
21582 5155 Acked 6154 Write 8 Done New Done false
21583 5156 Acked 6155 Read 9 Done New Done false
21584 5157 Acked 6156 Read 4 Done New Done false
21585 5158 Acked 6157 Read 7 Done New Done false
21586 5159 Acked 6158 Read 6 Done New Done false
21587 5160 Acked 6159 Flush 0 Done New Done false
21588 5161 Acked 6160 Read 1 Done New Done false
21589 5162 Acked 6161 Write 4 Done New Done false
21590 5163 Acked 6162 Read 1 Done New Done false
21591 5164 Acked 6163 Read 9 Done New Done false
21592 5165 Acked 6164 Write 8 Done New Done false
21593 5166 Acked 6165 Read 1 Done New Done false
21594 5167 Acked 6166 Write 7 Done New Done false
21595 5168 Acked 6167 Flush 0 Done New Done false
21596 5169 Acked 6168 Flush 0 Done New Done false
21597 5170 Acked 6169 Write 2 Done New Done false
21598 5171 Acked 6170 Write 9 Done New Done false
21599 5172 Acked 6171 Read 6 Done New Done false
21600 5173 Acked 6172 Read 10 Done New Done false
21601 5174 Acked 6173 Write 9 Done New Done false
21602 5175 Acked 6174 Write 9 Done New Done false
21603 5176 Acked 6175 Write 9 Done New Done false
21604 5177 Acked 6176 Flush 0 Done New Done false
21605 5178 Acked 6177 Flush 0 Done New Done false
21606 5179 Acked 6178 Read 5 Done New Done false
21607 5180 Acked 6179 Read 2 Done New Done false
21608 5181 Acked 6180 Flush 0 Done New Done false
21609 5182 Acked 6181 Write 10 Done New Done false
21610 5183 Acked 6182 Read 4 Done New Done false
21611 5184 Acked 6183 Read 5 Done New Done false
21612 5185 Acked 6184 Read 8 Done New Done false
21613 5186 Acked 6185 Read 9 Done New Done false
21614 5187 Acked 6186 Read 8 Done New Done false
21615 5188 Acked 6187 Read 7 Done New Done false
21616 5189 Acked 6188 Write 10 Done New Done false
21617 5190 Acked 6189 Read 9 Done New Done false
21618 5191 Acked 6190 Read 3 Done New Done false
21619 5192 Acked 6191 Read 3 Done New Done false
21620 5193 Acked 6192 Write 5 Done New Done false
21621 5194 Acked 6193 Read 6 Done New Done false
21622 5195 Acked 6194 Read 1 Done New Done false
21623 5196 Acked 6195 Read 6 Done New Done false
21624 5197 Acked 6196 Read 7 Done New Done false
21625 5198 Acked 6197 Write 2 Done New Done false
21626 5199 Acked 6198 Write 5 Done New Done false
21627 5200 Acked 6199 Flush 0 Done New Done false
21628 5201 Acked 6200 Read 3 Done New Done false
21629 5202 Acked 6201 Read 1 Done New Done false
21630 5203 Acked 6202 Write 4 Done New Done false
21631 5204 Acked 6203 Read 8 Done New Done false
21632 5205 Acked 6204 Read 5 Done New Done false
21633 5206 Acked 6205 Write 9 Done New Done false
21634 5207 Acked 6206 Write 7 Done New Done false
21635 5208 Acked 6207 Write 10 Done New Done false
21636 5209 Acked 6208 Read 10 Done New Done false
21637 5210 Acked 6209 Write 4 Done New Done false
21638 5211 Acked 6210 Read 3 Done New Done false
21639 5212 Acked 6211 Write 8 Done New Done false
21640 5213 Acked 6212 Read 8 Done New Done false
21641 5214 Acked 6213 Read 1 Done New Done false
21642 5215 Acked 6214 Read 4 Done New Done false
21643 5216 Acked 6215 Write 3 Done New Done false
21644 5217 Acked 6216 Read 4 Done New Done false
21645 5218 Acked 6217 Write 7 Done New Done false
21646 5219 Acked 6218 Write 2 Done New Done false
21647 5220 Acked 6219 Write 3 Done New Done false
21648 5221 Acked 6220 Write 2 Done New Done false
21649 5222 Acked 6221 Read 2 Done New Done false
21650 5223 Acked 6222 Read 10 Done New Done false
21651 5224 Acked 6223 Write 6 Done New Done false
21652 5225 Acked 6224 Read 2 Done New Done false
21653 5226 Acked 6225 Flush 0 Done New Done false
21654 5227 Acked 6226 Write 8 Done New Done false
21655 5228 Acked 6227 Read 6 Done New Done false
21656 5229 Acked 6228 Read 5 Done New Done false
21657 5230 Acked 6229 Write 10 Done New Done false
21658 5231 Acked 6230 Read 5 Done New Done false
21659 5232 Acked 6231 Read 10 Done New Done false
21660 5233 Acked 6232 Write 4 Done New Done false
21661 5234 Acked 6233 Read 9 Done New Done false
21662 5235 Acked 6234 Read 7 Done New Done false
21663 5236 Acked 6235 Read 6 Done New Done false
21664 5237 Acked 6236 Write 6 Done New Done false
21665 5238 Acked 6237 Read 3 Done New Done false
21666 5239 Acked 6238 Read 2 Done New Done false
21667 5240 Acked 6239 Read 8 Done New Done false
21668 5241 Acked 6240 Write 7 Done New Done false
21669 5242 Acked 6241 Write 1 Done New Done false
21670 5243 Acked 6242 Read 3 Done New Done false
21671 5244 Acked 6243 Read 5 Done New Done false
21672 5245 Acked 6244 Write 9 Done New Done false
21673 5246 Acked 6245 Flush 0 Done New Done false
21674 5247 Acked 6246 Write 10 Done New Done false
21675 5248 Acked 6247 Write 9 Done New Done false
21676 5249 Acked 6248 Read 2 Done New Done false
21677 5250 Acked 6249 Write 8 Done New Done false
21678 5251 Acked 6250 Write 8 Done New Done false
21679 5252 Acked 6251 Write 1 Done New Done false
21680 5253 Acked 6252 Read 6 Done New Done false
21681 5254 Acked 6253 Write 10 Done New Done false
21682 5255 Acked 6254 Read 1 Done New Done false
21683 5256 Acked 6255 Write 7 Done New Done false
21684 5257 Acked 6256 Flush 0 Done New Done false
21685 5258 Acked 6257 Write 4 Done New Done false
21686 5259 Acked 6258 Write 4 Done New Done false
21687 5260 Acked 6259 Write 3 Done New Done false
21688 5261 Acked 6260 Read 1 Done New Done false
21689 5262 Acked 6261 Write 2 Done New Done false
21690 5263 Acked 6262 Flush 0 Done New Done false
21691 5264 Acked 6263 Read 4 Done New Done false
21692 5265 Acked 6264 Read 2 Done New Done false
21693 5266 Acked 6265 Read 1 Done New Done false
21694 5267 Acked 6266 Read 2 Done New Done false
21695 5268 Acked 6267 Flush 0 Done New Done false
21696 5269 Acked 6268 Flush 0 Done New Done false
21697 5270 Acked 6269 Write 3 Done New Done false
21698 5271 Acked 6270 Flush 0 Done New Done false
21699 5272 Acked 6271 Write 6 Done New Done false
21700 5273 Acked 6272 Write 8 Done New Done false
21701 5274 Acked 6273 Write 5 Done New Done false
21702 5275 Acked 6274 Write 5 Done New Done false
21703 5276 Acked 6275 Read 6 Done New Done false
21704 5277 Acked 6276 Read 5 Done New Done false
21705 5278 Acked 6277 Write 5 Done New Done false
21706 5279 Acked 6278 Write 4 Done New Done false
21707 5280 Acked 6279 Write 1 Done New Done false
21708 5281 Acked 6280 Read 3 Done New Done false
21709 5282 Acked 6281 Read 4 Done New Done false
21710 5283 Acked 6282 Read 10 Done New Done false
21711 5284 Acked 6283 Read 3 Done New Done false
21712 5285 Acked 6284 Read 4 Done New Done false
21713 5286 Acked 6285 Read 9 Done New Done false
21714 5287 Acked 6286 Read 3 Done New Done false
21715 5288 Acked 6287 Read 3 Done New Done false
21716 5289 Acked 6288 Write 9 Done New Done false
21717 5290 Acked 6289 Read 9 Done New Done false
21718 5291 Acked 6290 Read 2 Done New Done false
21719 5292 Acked 6291 Write 2 Done New Done false
21720 5293 Acked 6292 Flush 0 Done New Done false
21721 5294 Acked 6293 Write 3 Done New Done false
21722 5295 Acked 6294 Flush 0 Done New Done false
21723 5296 Acked 6295 Read 8 Done New Done false
21724 5297 Acked 6296 Write 3 Done New Done false
21725 5298 Acked 6297 Write 10 Done New Done false
21726 5299 Acked 6298 Read 3 Done New Done false
21727 5300 Acked 6299 Read 2 Done New Done false
21728 5301 Acked 6300 Read 10 Done New Done false
21729 5302 Acked 6301 Read 9 Done New Done false
21730 5303 Acked 6302 Read 8 Done New Done false
21731 5304 Acked 6303 Write 8 Done New Done false
21732 5305 Acked 6304 Write 2 Done New Done false
21733 5306 Acked 6305 Write 2 Done New Done false
21734 5307 Acked 6306 Write 1 Done New Done false
21735 5308 Acked 6307 Read 8 Done New Done false
21736 5309 Acked 6308 Read 7 Done New Done false
21737 5310 Acked 6309 Read 10 Done New Done false
21738 5311 Acked 6310 Read 10 Done New Done false
21739 5312 Acked 6311 Read 1 Done New Done false
21740 5313 Acked 6312 Read 3 Done New Done false
21741 5314 Acked 6313 Read 1 Done New Done false
21742 5315 Acked 6314 Read 4 Done New Done false
21743 5316 Acked 6315 Read 1 Done New Done false
21744 5317 Acked 6316 Read 3 Done New Done false
21745 5318 Acked 6317 Write 6 Done New Done false
21746 5319 Acked 6318 Write 8 Done New Done false
21747 5320 Acked 6319 Write 9 Done New Done false
21748 5321 Acked 6320 Write 3 Done New Done false
21749 5322 Acked 6321 Write 4 Done New Done false
21750 5323 Acked 6322 Write 6 Done New Done false
21751 5324 Acked 6323 Read 10 Done New Done false
21752 5325 Acked 6324 Read 6 Done New Done false
21753 5326 Acked 6325 Write 3 Done New Done false
21754 5327 Acked 6326 Write 7 Done New Done false
21755 5328 Acked 6327 Write 8 Done New Done false
21756 5329 Acked 6328 Write 8 Done New Done false
21757 5330 Acked 6329 Read 6 Done New Done false
21758 5331 Acked 6330 Write 4 Done New Done false
21759 5332 Acked 6331 Read 2 Done New Done false
21760 5333 Acked 6332 Read 8 Done New Done false
21761 5334 Acked 6333 Write 7 Done New Done false
21762 5335 Acked 6334 Write 6 Done New Done false
21763 5336 Acked 6335 Flush 0 Done New Done false
21764 5337 Acked 6336 Write 5 Done New Done false
21765 5338 Acked 6337 Read 8 Done New Done false
21766 5339 Acked 6338 Read 10 Done New Done false
21767 5340 Acked 6339 Write 3 Done New Done false
21768 5341 Acked 6340 Flush 0 Done New Done false
21769 5342 Acked 6341 Read 1 Done New Done false
21770 5343 Acked 6342 Read 2 Done New Done false
21771 5344 Acked 6343 Write 5 Done New Done false
21772 5345 Acked 6344 Read 4 Done New Done false
21773 5346 Acked 6345 Write 2 Done New Done false
21774 5347 Acked 6346 Write 8 Done New Done false
21775 5348 Acked 6347 Read 3 Done New Done false
21776 5349 Acked 6348 Read 6 Done New Done false
21777 5350 Acked 6349 Read 5 Done New Done false
21778 5351 Acked 6350 Read 8 Done New Done false
21779 5352 Acked 6351 Read 2 Done New Done false
21780 5353 Acked 6352 Read 10 Done New Done false
21781 5354 Acked 6353 Read 5 Done New Done false
21782 5355 Acked 6354 Write 10 Done New Done false
21783 5356 Acked 6355 Read 9 Done New Done false
21784 5357 Acked 6356 Read 6 Done New Done false
21785 5358 Acked 6357 Write 9 Done New Done false
21786 5359 Acked 6358 Write 7 Done New Done false
21787 5360 Acked 6359 Read 9 Done New Done false
21788 5361 Acked 6360 Read 1 Done New Done false
21789 5362 Acked 6361 Write 2 Done New Done false
21790 5363 Acked 6362 Read 1 Done New Done false
21791 5364 Acked 6363 Write 8 Done New Done false
21792 5365 Acked 6364 Read 6 Done New Done false
21793 5366 Acked 6365 Read 9 Done New Done false
21794 5367 Acked 6366 Read 6 Done New Done false
21795 5368 Acked 6367 Flush 0 Done New Done false
21796 5369 Acked 6368 Read 2 Done New Done false
21797 5370 Acked 6369 Read 6 Done New Done false
21798 5371 Acked 6370 Read 5 Done New Done false
21799 5372 Acked 6371 Read 8 Done New Done false
21800 5373 Acked 6372 Read 6 Done New Done false
21801 5374 Acked 6373 Read 3 Done New Done false
21802 5375 Acked 6374 Write 5 Done New Done false
21803 5376 Acked 6375 Read 6 Done New Done false
21804 5377 Acked 6376 Read 3 Done New Done false
21805 5378 Acked 6377 Flush 0 Done New Done false
21806 5379 Acked 6378 Write 8 Done New Done false
21807 5380 Acked 6379 Read 5 Done New Done false
21808 5381 Acked 6380 Write 10 Done New Done false
21809 5382 Acked 6381 Write 3 Done New Done false
21810 5383 Acked 6382 Write 4 Done New Done false
21811 5384 Acked 6383 Write 1 Done New Done false
21812 5385 Acked 6384 Read 2 Done New Done false
21813 5386 Acked 6385 Write 4 Done New Done false
21814 5387 Acked 6386 Read 5 Done New Done false
21815 5388 Acked 6387 Read 8 Done New Done false
21816 5389 Acked 6388 Read 4 Done New Done false
21817 5390 Acked 6389 Write 5 Done New Done false
21818 5391 Acked 6390 Write 8 Done New Done false
21819 5392 Acked 6391 Read 7 Done New Done false
21820 5393 Acked 6392 Read 7 Done New Done false
21821 5394 Acked 6393 Read 9 Done New Done false
21822 5395 Acked 6394 Read 1 Done New Done false
21823 5396 Acked 6395 Flush 0 Done New Done false
21824 5397 Acked 6396 Read 4 Done New Done false
21825 5398 Acked 6397 Write 5 Done New Done false
21826 5399 Acked 6398 Flush 0 Done New Done false
21827 5400 Acked 6399 Write 1 Done New Done false
21828 5401 Acked 6400 Flush 0 Done New Done false
21829 5402 Acked 6401 Write 3 Done New Done false
21830 5403 Acked 6402 Write 6 Done New Done false
21831 5404 Acked 6403 Read 1 Done New Done false
21832 5405 Acked 6404 Read 7 Done New Done false
21833 5406 Acked 6405 Read 4 Done New Done false
21834 5407 Acked 6406 Flush 0 Done New Done false
21835 5408 Acked 6407 Write 2 Done New Done false
21836 5409 Acked 6408 Read 7 Done New Done false
21837 5410 Acked 6409 Read 5 Done New Done false
21838 5411 Acked 6410 Read 4 Done New Done false
21839 5412 Acked 6411 Flush 0 Done New Done false
21840 5413 Acked 6412 Read 2 Done New Done false
21841 5414 Acked 6413 Write 2 Done New Done false
21842 5415 Acked 6414 Read 10 Done New Done false
21843 5416 Acked 6415 Flush 0 Done New Done false
21844 5417 Acked 6416 Read 3 Done New Done false
21845 5418 Acked 6417 Write 8 Done New Done false
21846 5419 Acked 6418 Write 9 Done New Done false
21847 5420 Acked 6419 Write 6 Done New Done false
21848 5421 Acked 6420 Write 5 Done New Done false
21849 5422 Acked 6421 Write 4 Done New Done false
21850 5423 Acked 6422 Read 3 Done New Done false
21851 5424 Acked 6423 Write 1 Done New Done false
21852 5425 Acked 6424 Write 4 Done New Done false
21853 STATES DS:0 DS:1 DS:2 TOTAL
21854 New 0 301 0 301
21855 Sent 0 0 0 0
21856 Done 301 0 301 602
21857 Skipped 0 0 0 0
21858 Error 0 0 0 0
21859 Last Flush: 6415 6123 6415
21860 Downstairs last five completed: 6123 6122 6121 6120 6119
21861 Upstairs last five completed: 5425 5424 5423 5422 5421
21862 CLIENT: Up:0 ds:301 act:2
21863 [8820] got start action
21864 [8820] I am going to restart
21865 Starting downstairs at port 8820
21866 Make output file at "/tmp/dsc/downstairs-8820.txt"
21867 [8820][1] reports Starting
21868 Downstairs /var/tmp/dsc/region/8820 port 8820 PID:Some(1214)
21869 [8820][1] reports Running
21870 ----------------------------------------------------------------
21871 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:302
21872 States: Active Offline Active
21873 GW_ID ACK DSID TYPE BLOCKS DS:0 DS:1 DS:2 REPLAY
21874 5125 Acked 6124 Read 8 Done New Done false
21875 5126 Acked 6125 Write 9 Done New Done false
21876 5127 Acked 6126 Read 2 Done New Done false
21877 5128 Acked 6127 Write 6 Done New Done false
21878 5129 Acked 6128 Read 6 Done New Done false
21879 5130 Acked 6129 Read 4 Done New Done false
21880 5131 Acked 6130 Read 6 Done New Done false
21881 5132 Acked 6131 Flush 0 Done New Done false
21882 5133 Acked 6132 Write 9 Done New Done false
21883 5134 Acked 6133 Write 8 Done New Done false
21884 5135 Acked 6134 Read 1 Done New Done false
21885 5136 Acked 6135 Write 1 Done New Done false
21886 5137 Acked 6136 Read 5 Done New Done false
21887 5138 Acked 6137 Read 8 Done New Done false
21888 5139 Acked 6138 Flush 0 Done New Done false
21889 5140 Acked 6139 Read 3 Done New Done false
21890 5141 Acked 6140 Read 9 Done New Done false
21891 5142 Acked 6141 Write 4 Done New Done false
21892 5143 Acked 6142 Read 9 Done New Done false
21893 5144 Acked 6143 Read 4 Done New Done false
21894 5145 Acked 6144 Read 5 Done New Done false
21895 5146 Acked 6145 Flush 0 Done New Done false
21896 5147 Acked 6146 Write 2 Done New Done false
21897 5148 Acked 6147 Read 3 Done New Done false
21898 5149 Acked 6148 Write 5 Done New Done false
21899 5150 Acked 6149 Read 3 Done New Done false
21900 5151 Acked 6150 Read 9 Done New Done false
21901 5152 Acked 6151 Read 3 Done New Done false
21902 5153 Acked 6152 Flush 0 Done New Done false
21903 5154 Acked 6153 Write 9 Done New Done false
21904 5155 Acked 6154 Write 8 Done New Done false
21905 5156 Acked 6155 Read 9 Done New Done false
21906 5157 Acked 6156 Read 4 Done New Done false
21907 5158 Acked 6157 Read 7 Done New Done false
21908 5159 Acked 6158 Read 6 Done New Done false
21909 5160 Acked 6159 Flush 0 Done New Done false
21910 5161 Acked 6160 Read 1 Done New Done false
21911 5162 Acked 6161 Write 4 Done New Done false
21912 5163 Acked 6162 Read 1 Done New Done false
21913 5164 Acked 6163 Read 9 Done New Done false
21914 5165 Acked 6164 Write 8 Done New Done false
21915 5166 Acked 6165 Read 1 Done New Done false
21916 5167 Acked 6166 Write 7 Done New Done false
21917 5168 Acked 6167 Flush 0 Done New Done false
21918 5169 Acked 6168 Flush 0 Done New Done false
21919 5170 Acked 6169 Write 2 Done New Done false
21920 5171 Acked 6170 Write 9 Done New Done false
21921 5172 Acked 6171 Read 6 Done New Done false
21922 5173 Acked 6172 Read 10 Done New Done false
21923 5174 Acked 6173 Write 9 Done New Done false
21924 5175 Acked 6174 Write 9 Done New Done false
21925 5176 Acked 6175 Write 9 Done New Done false
21926 5177 Acked 6176 Flush 0 Done New Done false
21927 5178 Acked 6177 Flush 0 Done New Done false
21928 5179 Acked 6178 Read 5 Done New Done false
21929 5180 Acked 6179 Read 2 Done New Done false
21930 5181 Acked 6180 Flush 0 Done New Done false
21931 5182 Acked 6181 Write 10 Done New Done false
21932 5183 Acked 6182 Read 4 Done New Done false
21933 5184 Acked 6183 Read 5 Done New Done false
21934 5185 Acked 6184 Read 8 Done New Done false
21935 5186 Acked 6185 Read 9 Done New Done false
21936 5187 Acked 6186 Read 8 Done New Done false
21937 5188 Acked 6187 Read 7 Done New Done false
21938 5189 Acked 6188 Write 10 Done New Done false
21939 5190 Acked 6189 Read 9 Done New Done false
21940 5191 Acked 6190 Read 3 Done New Done false
21941 5192 Acked 6191 Read 3 Done New Done false
21942 5193 Acked 6192 Write 5 Done New Done false
21943 5194 Acked 6193 Read 6 Done New Done false
21944 5195 Acked 6194 Read 1 Done New Done false
21945 5196 Acked 6195 Read 6 Done New Done false
21946 5197 Acked 6196 Read 7 Done New Done false
21947 5198 Acked 6197 Write 2 Done New Done false
21948 5199 Acked 6198 Write 5 Done New Done false
21949 5200 Acked 6199 Flush 0 Done New Done false
21950 5201 Acked 6200 Read 3 Done New Done false
21951 5202 Acked 6201 Read 1 Done New Done false
21952 5203 Acked 6202 Write 4 Done New Done false
21953 5204 Acked 6203 Read 8 Done New Done false
21954 5205 Acked 6204 Read 5 Done New Done false
21955 5206 Acked 6205 Write 9 Done New Done false
21956 5207 Acked 6206 Write 7 Done New Done false
21957 5208 Acked 6207 Write 10 Done New Done false
21958 5209 Acked 6208 Read 10 Done New Done false
21959 5210 Acked 6209 Write 4 Done New Done false
21960 5211 Acked 6210 Read 3 Done New Done false
21961 5212 Acked 6211 Write 8 Done New Done false
21962 5213 Acked 6212 Read 8 Done New Done false
21963 5214 Acked 6213 Read 1 Done New Done false
21964 5215 Acked 6214 Read 4 Done New Done false
21965 5216 Acked 6215 Write 3 Done New Done false
21966 5217 Acked 6216 Read 4 Done New Done false
21967 5218 Acked 6217 Write 7 Done New Done false
21968 5219 Acked 6218 Write 2 Done New Done false
21969 5220 Acked 6219 Write 3 Done New Done false
21970 5221 Acked 6220 Write 2 Done New Done false
21971 5222 Acked 6221 Read 2 Done New Done false
21972 5223 Acked 6222 Read 10 Done New Done false
21973 5224 Acked 6223 Write 6 Done New Done false
21974 5225 Acked 6224 Read 2 Done New Done false
21975 5226 Acked 6225 Flush 0 Done New Done false
21976 5227 Acked 6226 Write 8 Done New Done false
21977 5228 Acked 6227 Read 6 Done New Done false
21978 5229 Acked 6228 Read 5 Done New Done false
21979 5230 Acked 6229 Write 10 Done New Done false
21980 5231 Acked 6230 Read 5 Done New Done false
21981 5232 Acked 6231 Read 10 Done New Done false
21982 5233 Acked 6232 Write 4 Done New Done false
21983 5234 Acked 6233 Read 9 Done New Done false
21984 5235 Acked 6234 Read 7 Done New Done false
21985 5236 Acked 6235 Read 6 Done New Done false
21986 5237 Acked 6236 Write 6 Done New Done false
21987 5238 Acked 6237 Read 3 Done New Done false
21988 5239 Acked 6238 Read 2 Done New Done false
21989 5240 Acked 6239 Read 8 Done New Done false
21990 5241 Acked 6240 Write 7 Done New Done false
21991 5242 Acked 6241 Write 1 Done New Done false
21992 5243 Acked 6242 Read 3 Done New Done false
21993 5244 Acked 6243 Read 5 Done New Done false
21994 5245 Acked 6244 Write 9 Done New Done false
21995 5246 Acked 6245 Flush 0 Done New Done false
21996 5247 Acked 6246 Write 10 Done New Done false
21997 5248 Acked 6247 Write 9 Done New Done false
21998 5249 Acked 6248 Read 2 Done New Done false
21999 5250 Acked 6249 Write 8 Done New Done false
22000 5251 Acked 6250 Write 8 Done New Done false
22001 5252 Acked 6251 Write 1 Done New Done false
22002 5253 Acked 6252 Read 6 Done New Done false
22003 5254 Acked 6253 Write 10 Done New Done false
22004 5255 Acked 6254 Read 1 Done New Done false
22005 5256 Acked 6255 Write 7 Done New Done false
22006 5257 Acked 6256 Flush 0 Done New Done false
22007 5258 Acked 6257 Write 4 Done New Done false
22008 5259 Acked 6258 Write 4 Done New Done false
22009 5260 Acked 6259 Write 3 Done New Done false
22010 5261 Acked 6260 Read 1 Done New Done false
22011 5262 Acked 6261 Write 2 Done New Done false
22012 5263 Acked 6262 Flush 0 Done New Done false
22013 5264 Acked 6263 Read 4 Done New Done false
22014 5265 Acked 6264 Read 2 Done New Done false
22015 5266 Acked 6265 Read 1 Done New Done false
22016 5267 Acked 6266 Read 2 Done New Done false
22017 5268 Acked 6267 Flush 0 Done New Done false
22018 5269 Acked 6268 Flush 0 Done New Done false
22019 5270 Acked 6269 Write 3 Done New Done false
22020 5271 Acked 6270 Flush 0 Done New Done false
22021 5272 Acked 6271 Write 6 Done New Done false
22022 5273 Acked 6272 Write 8 Done New Done false
22023 5274 Acked 6273 Write 5 Done New Done false
22024 5275 Acked 6274 Write 5 Done New Done false
22025 5276 Acked 6275 Read 6 Done New Done false
22026 5277 Acked 6276 Read 5 Done New Done false
22027 5278 Acked 6277 Write 5 Done New Done false
22028 5279 Acked 6278 Write 4 Done New Done false
22029 5280 Acked 6279 Write 1 Done New Done false
22030 5281 Acked 6280 Read 3 Done New Done false
22031 5282 Acked 6281 Read 4 Done New Done false
22032 5283 Acked 6282 Read 10 Done New Done false
22033 5284 Acked 6283 Read 3 Done New Done false
22034 5285 Acked 6284 Read 4 Done New Done false
22035 5286 Acked 6285 Read 9 Done New Done false
22036 5287 Acked 6286 Read 3 Done New Done false
22037 5288 Acked 6287 Read 3 Done New Done false
22038 5289 Acked 6288 Write 9 Done New Done false
22039 5290 Acked 6289 Read 9 Done New Done false
22040 5291 Acked 6290 Read 2 Done New Done false
22041 5292 Acked 6291 Write 2 Done New Done false
22042 5293 Acked 6292 Flush 0 Done New Done false
22043 5294 Acked 6293 Write 3 Done New Done false
22044 5295 Acked 6294 Flush 0 Done New Done false
22045 5296 Acked 6295 Read 8 Done New Done false
22046 5297 Acked 6296 Write 3 Done New Done false
22047 5298 Acked 6297 Write 10 Done New Done false
22048 5299 Acked 6298 Read 3 Done New Done false
22049 5300 Acked 6299 Read 2 Done New Done false
22050 5301 Acked 6300 Read 10 Done New Done false
22051 5302 Acked 6301 Read 9 Done New Done false
22052 5303 Acked 6302 Read 8 Done New Done false
22053 5304 Acked 6303 Write 8 Done New Done false
22054 5305 Acked 6304 Write 2 Done New Done false
22055 5306 Acked 6305 Write 2 Done New Done false
22056 5307 Acked 6306 Write 1 Done New Done false
22057 5308 Acked 6307 Read 8 Done New Done false
22058 5309 Acked 6308 Read 7 Done New Done false
22059 5310 Acked 6309 Read 10 Done New Done false
22060 5311 Acked 6310 Read 10 Done New Done false
22061 5312 Acked 6311 Read 1 Done New Done false
22062 5313 Acked 6312 Read 3 Done New Done false
22063 5314 Acked 6313 Read 1 Done New Done false
22064 5315 Acked 6314 Read 4 Done New Done false
22065 5316 Acked 6315 Read 1 Done New Done false
22066 5317 Acked 6316 Read 3 Done New Done false
22067 5318 Acked 6317 Write 6 Done New Done false
22068 5319 Acked 6318 Write 8 Done New Done false
22069 5320 Acked 6319 Write 9 Done New Done false
22070 5321 Acked 6320 Write 3 Done New Done false
22071 5322 Acked 6321 Write 4 Done New Done false
22072 5323 Acked 6322 Write 6 Done New Done false
22073 5324 Acked 6323 Read 10 Done New Done false
22074 5325 Acked 6324 Read 6 Done New Done false
22075 5326 Acked 6325 Write 3 Done New Done false
22076 5327 Acked 6326 Write 7 Done New Done false
22077 5328 Acked 6327 Write 8 Done New Done false
22078 5329 Acked 6328 Write 8 Done New Done false
22079 5330 Acked 6329 Read 6 Done New Done false
22080 5331 Acked 6330 Write 4 Done New Done false
22081 5332 Acked 6331 Read 2 Done New Done false
22082 5333 Acked 6332 Read 8 Done New Done false
22083 5334 Acked 6333 Write 7 Done New Done false
22084 5335 Acked 6334 Write 6 Done New Done false
22085 5336 Acked 6335 Flush 0 Done New Done false
22086 5337 Acked 6336 Write 5 Done New Done false
22087 5338 Acked 6337 Read 8 Done New Done false
22088 5339 Acked 6338 Read 10 Done New Done false
22089 5340 Acked 6339 Write 3 Done New Done false
22090 5341 Acked 6340 Flush 0 Done New Done false
22091 5342 Acked 6341 Read 1 Done New Done false
22092 5343 Acked 6342 Read 2 Done New Done false
22093 5344 Acked 6343 Write 5 Done New Done false
22094 5345 Acked 6344 Read 4 Done New Done false
22095 5346 Acked 6345 Write 2 Done New Done false
22096 5347 Acked 6346 Write 8 Done New Done false
22097 5348 Acked 6347 Read 3 Done New Done false
22098 5349 Acked 6348 Read 6 Done New Done false
22099 5350 Acked 6349 Read 5 Done New Done false
22100 5351 Acked 6350 Read 8 Done New Done false
22101 5352 Acked 6351 Read 2 Done New Done false
22102 5353 Acked 6352 Read 10 Done New Done false
22103 5354 Acked 6353 Read 5 Done New Done false
22104 5355 Acked 6354 Write 10 Done New Done false
22105 5356 Acked 6355 Read 9 Done New Done false
22106 5357 Acked 6356 Read 6 Done New Done false
22107 5358 Acked 6357 Write 9 Done New Done false
22108 5359 Acked 6358 Write 7 Done New Done false
22109 5360 Acked 6359 Read 9 Done New Done false
22110 5361 Acked 6360 Read 1 Done New Done false
22111 5362 Acked 6361 Write 2 Done New Done false
22112 5363 Acked 6362 Read 1 Done New Done false
22113 5364 Acked 6363 Write 8 Done New Done false
22114 5365 Acked 6364 Read 6 Done New Done false
22115 5366 Acked 6365 Read 9 Done New Done false
22116 5367 Acked 6366 Read 6 Done New Done false
22117 5368 Acked 6367 Flush 0 Done New Done false
22118 5369 Acked 6368 Read 2 Done New Done false
22119 5370 Acked 6369 Read 6 Done New Done false
22120 5371 Acked 6370 Read 5 Done New Done false
22121 5372 Acked 6371 Read 8 Done New Done false
22122 5373 Acked 6372 Read 6 Done New Done false
22123 5374 Acked 6373 Read 3 Done New Done false
22124 5375 Acked 6374 Write 5 Done New Done false
22125 5376 Acked 6375 Read 6 Done New Done false
22126 5377 Acked 6376 Read 3 Done New Done false
22127 5378 Acked 6377 Flush 0 Done New Done false
22128 5379 Acked 6378 Write 8 Done New Done false
22129 5380 Acked 6379 Read 5 Done New Done false
22130 5381 Acked 6380 Write 10 Done New Done false
22131 5382 Acked 6381 Write 3 Done New Done false
22132 5383 Acked 6382 Write 4 Done New Done false
22133 5384 Acked 6383 Write 1 Done New Done false
22134 5385 Acked 6384 Read 2 Done New Done false
22135 5386 Acked 6385 Write 4 Done New Done false
22136 5387 Acked 6386 Read 5 Done New Done false
22137 5388 Acked 6387 Read 8 Done New Done false
22138 5389 Acked 6388 Read 4 Done New Done false
22139 5390 Acked 6389 Write 5 Done New Done false
22140 5391 Acked 6390 Write 8 Done New Done false
22141 5392 Acked 6391 Read 7 Done New Done false
22142 5393 Acked 6392 Read 7 Done New Done false
22143 5394 Acked 6393 Read 9 Done New Done false
22144 5395 Acked 6394 Read 1 Done New Done false
22145 5396 Acked 6395 Flush 0 Done New Done false
22146 5397 Acked 6396 Read 4 Done New Done false
22147 5398 Acked 6397 Write 5 Done New Done false
22148 5399 Acked 6398 Flush 0 Done New Done false
22149 5400 Acked 6399 Write 1 Done New Done false
22150 5401 Acked 6400 Flush 0 Done New Done false
22151 5402 Acked 6401 Write 3 Done New Done false
22152 5403 Acked 6402 Write 6 Done New Done false
22153 5404 Acked 6403 Read 1 Done New Done false
22154 5405 Acked 6404 Read 7 Done New Done false
22155 5406 Acked 6405 Read 4 Done New Done false
22156 5407 Acked 6406 Flush 0 Done New Done false
22157 5408 Acked 6407 Write 2 Done New Done false
22158 5409 Acked 6408 Read 7 Done New Done false
22159 5410 Acked 6409 Read 5 Done New Done false
22160 5411 Acked 6410 Read 4 Done New Done false
22161 5412 Acked 6411 Flush 0 Done New Done false
22162 5413 Acked 6412 Read 2 Done New Done false
22163 5414 Acked 6413 Write 2 Done New Done false
22164 5415 Acked 6414 Read 10 Done New Done false
22165 5416 Acked 6415 Flush 0 Done New Done false
22166 5417 Acked 6416 Read 3 Done New Done false
22167 5418 Acked 6417 Write 8 Done New Done false
22168 5419 Acked 6418 Write 9 Done New Done false
22169 5420 Acked 6419 Write 6 Done New Done false
22170 5421 Acked 6420 Write 5 Done New Done false
22171 5422 Acked 6421 Write 4 Done New Done false
22172 5423 Acked 6422 Read 3 Done New Done false
22173 5424 Acked 6423 Write 1 Done New Done false
22174 5425 Acked 6424 Write 4 Done New Done false
22175 5426 Acked 6425 Flush 0 Done New Done false
22176 STATES DS:0 DS:1 DS:2 TOTAL
22177 New 0 302 0 302
22178 Sent 0 0 0 0
22179 Done 302 0 302 604
22180 Skipped 0 0 0 0
22181 Error 0 0 0 0
22182 Last Flush: 6425 6123 6425
22183 Downstairs last five completed: 6123 6122 6121 6120 6119
22184 Upstairs last five completed: 5426 5425 5424 5423 5422
22185 CLIENT: Up:0 ds:302 act:2
221862024-04-20T01:09:43.511ZINFOcrucible: connecting to 127.0.0.1:8820 = io task client = 1 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
221872024-04-20T01:09:43.511ZINFOcrucible: ds_connection connected from Ok(127.0.0.1:35806) = io task client = 1 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
221882024-04-20T01:09:43.513ZINFOcrucible: downstairs client at Some(127.0.0.1:8820) has region UUID 12345678-0000-0000-0000-000000008820 = downstairs client = 1 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
221892024-04-20T01:09:43.513ZINFOcrucible: Returning UUID:12345678-0000-0000-0000-000000008820 matches = downstairs client = 1 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
221902024-04-20T01:09:43.513ZINFOcrucible: send last flush ID to this DS: 6123 = downstairs client = 1 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
221912024-04-20T01:09:43.513ZINFOcrucible: Replied this last flush ID: 6123 = downstairs client = 1 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
221922024-04-20T01:09:43.513ZINFOcrucible: ds_transition from Offline to Replay = downstairs client = 1 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
221932024-04-20T01:09:43.513ZINFOcrucible: [1] Transition from Offline to Replay = downstairs client = 1 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
221942024-04-20T01:09:43.513ZINFOcrucible: ds_transition from Replay to Active = downstairs client = 1 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
221952024-04-20T01:09:43.513ZINFOcrucible: [1] Transition from Replay to Active = downstairs client = 1 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
22196 ----------------------------------------------------------------
22197 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:0
22198 Downstairs last five completed: 6425 6424 6423 6422 6421
22199 Upstairs last five completed: 5426 5425 5424 5423 5422
22200 CLIENT: Up:0 ds:0 act:3
22201 Replay: All jobs finished, all DS active.
22202 Main task has work to do, go find it
22203 got dsc Stop(0)
22204 stop 0
22205 Apr 20 01:09:45.818 INFO request completed, latency_us: 352, [8810] Got stop action so:false kr:false
22206 response_code: 204, uri: /stop/cid/0, method: POST, req_id: d0b90461-abcc-41d3-88f5-15b5e9727393, remote_addr: 127.0.0.1:60352, local_addr: 127.0.0.1:9998
222072024-04-20T01:09:45.818ZWARNcrucible: downstairs disconnected = io task client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
222082024-04-20T01:09:45.818ZWARNcrucible: client task is sending Done(Finished) = io task client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
22209 Apr 20 01:09:45.818 INFO request completed, latency_us: 159, response_code: 200, uri: /state/cid/0, method: GET, req_id{"msg":"downstairs task for 0 stopped due to Finished","v":0,"name":"crucible","level":40,"time":"2024-04-20T01:09:45.819021657Z","hostname":"w-01HVWGBJP7HK0H9TQ26T6N3X8M","pid":1196,"session_id":"132b460a-26a0-4532-b1ab-4f8c07d4c6c7"}
22210 : 96ac01ae-7b3d-43a2-ad18-38cebcb4dff0, remote_addr: 127.0.0.1:60352, local_addr: 127.0.0.{"msg":"Gone missing, transition from Active to Offline","v":0,"name":"crucible","level":30,"time":"2024-04-20T01:09:45.819067896Z","hostname":"w-01HVWGBJP7HK0H9TQ26T6N3X8M","pid":1196,"client":"0","":"downstairs","session_id":"132b460a-26a0-4532-b1ab-4f8c07d4c6c7"}
22211 1:9998{"msg":"[0] client re-new 0 jobs since flush 6425","v":0,"name":"crucible","level":30,"time":"2024-04-20T01:09:45.819099635Z","hostname":"w-01HVWGBJP7HK0H9TQ26T6N3X8M","pid":1196,"":"downstairs","":"downstairs","session_id":"132b460a-26a0-4532-b1ab-4f8c07d4c6c7"}
22212 
222132024-04-20T01:09:45.819ZINFOcrucible: [0] Marked 0 jobs for replay since flush: 6425 = downstairs session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
222142024-04-20T01:09:45.819ZINFOcrucible: client task is exiting = io task client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
22215 [8810] Exited with: ExitStatus(unix_wait_status(9))
22216 [8810][0] reports Exit
22217 Apr 20 01:09:49.820 INFO request completed, latency_us: 203, response_code: 200, uri: /state/cid/0, method: GET, req_id: 7bfa98f1-a442-43e5-a137-b93a4cefea68, remote_addr: 127.0.0.1:60352, local_addr: 127.0.0.1:9998
22218 001/300 Read block 1590 len 4096
22219 002/300 Write block 2339 len 4096 data: 3
22220 003/300 Read block 431 len 8192
22221 004/300 Write block 4039 len 36864 data: 2 3 5 7 6 7 6 5 4
22222 005/300 Write block 1631 len 40960 data: 3 2 2 2 3 3 4 5 3 3
22223 006/300 Read block 316 len 24576
22224 007/300 Read block 4059 len 36864
22225 008/300 Write block 837 len 20480 data: 6 5 4 4 5
22226 009/300 Read block 564 len 4096
22227 010/300 Write block 2023 len 36864 data: 9 8 7 8 6 4 3 2 2
22228 011/300 Read block 2899 len 16384
22229 012/300 Read block 353 len 20480
22230 013/300 Read block 3639 len 32768
22231 014/300 Write block 3352 len 40960 data: 3 2 3 3 4 4 4 3 2 2
22232 015/300 Read block 1749 len 16384
22233 016/300 Write block 1552 len 40960 data: 5 5 3 3 4 4 4 4 4 5
22234 017/300 Flush
22235 018/300 Write block 4226 len 4096 data: 5
22236 019/300 Read block 4802 len 8192
22237 020/300 Read block 4678 len 24576
22238 021/300 Write block 3198 len 28672 data: 7 7 8 9 10 6 5
22239 022/300 Write block 4009 len 36864 data: 3 3 2 2 3 3 3 3 3
22240 023/300 Write block 4473 len 40960 data: 4 4 4 4 4 4 2 3 6 6
22241 024/300 Read block 1613 len 28672
22242 025/300 Read block 3346 len 24576
22243 026/300 Write block 3491 len 28672 data: 6 6 5 6 4 4 4
22244 027/300 Write block 1685 len 20480 data: 4 5 4 3 3
22245 028/300 Write block 1475 len 24576 data: 4 4 3 2 2 2
22246 029/300 Read block 4370 len 16384
22247 030/300 Write block 4016 len 32768 data: 4 4 3 2 2 2 3 3
22248 031/300 Read block 2621 len 12288
22249 032/300 Read block 4313 len 20480
22250 033/300 Write block 684 len 8192 data: 5 5
22251 034/300 Read block 3538 len 24576
22252 035/300 Read block 2641 len 20480
22253 036/300 Read block 1206 len 32768
22254 037/300 Write block 1547 len 16384 data: 7 6 6 6
22255 038/300 Read block 1337 len 32768
22256 039/300 Read block 4563 len 12288
22257 040/300 Write block 3881 len 32768 data: 4 4 4 5 5 4 3 3
22258 041/300 Write block 276 len 16384 data: 6 7 6 6
22259 042/300 Write block 4479 len 28672 data: 3 4 7 7 6 6 5
22260 043/300 Write block 388 len 40960 data: 4 4 5 5 6 7 7 7 8 6
22261 044/300 Write block 247 len 4096 data: 7
22262 045/300 Write block 3922 len 36864 data: 6 5 4 4 4 4 4 3 3
22263 046/300 Write block 1767 len 12288 data: 5 6 5
22264 047/300 Flush
22265 048/300 Write block 4080 len 12288 data: 11 9 7
22266 049/300 Flush
22267 050/300 Read block 1846 len 28672
22268 051/300 Flush
22269 052/300 Read block 4728 len 40960
22270 053/300 Write block 3750 len 40960 data: 5 6 5 4 4 5 5 5 4 3
22271 054/300 Read block 1794 len 28672
22272 055/300 Write block 3816 len 12288 data: 5 5 5
22273 056/300 Write block 4767 len 28672 data: 3 4 6 4 4 4 3
22274 057/300 Write block 596 len 28672 data: 4 4 4 3 2 2 4
22275 058/300 Read block 3266 len 16384
22276 059/300 Flush
22277 060/300 Write block 3389 len 36864 data: 5 3 4 3 4 4 3 3 3
22278 061/300 Flush
22279 062/300 Read block 1863 len 12288
22280 063/300 Write block 3884 len 20480 data: 6 6 5 4 4
22281 064/300 Read block 182 len 24576
22282 065/300 Read block 2444 len 20480
22283 066/300 Read block 4423 len 20480
22284 067/300 Write block 2138 len 32768 data: 5 4 4 6 6 6 7 6
22285 068/300 Read block 1086 len 12288
22286 069/300 Read block 1242 len 20480
22287 070/300 Write block 3182 len 4096 data: 4
22288 071/300 Write block 4429 len 28672 data: 5 6 7 8 6 5 5
22289 072/300 Read block 2342 len 4096
22290 073/300 Read block 2307 len 20480
22291 074/300 Read block 1124 len 36864
22292 075/300 Flush
22293 076/300 Read block 4630 len 4096
22294 077/300 Flush
22295 078/300 Write block 365 len 4096 data: 6
22296 079/300 Flush
22297 080/300 Write block 4062 len 20480 data: 2 2 3 3 2
22298 081/300 Read block 1941 len 4096
22299 082/300 Read block 3454 len 12288
22300 083/300 Read block 4303 len 24576
22301 084/300 Read block 3006 len 32768
22302 085/300 Write block 1230 len 36864 data: 6 5 5 5 5 5 5 3 3
22303 086/300 Read block 2829 len 36864
22304 087/300 Write block 4463 len 28672 data: 4 4 3 3 3 3 3
22305 088/300 Flush
22306 089/300 Write block 2765 len 32768 data: 4 7 8 9 8 7 8 7
22307 090/300 Read block 2606 len 4096
22308 091/300 Read block 1977 len 12288
22309 092/300 Flush
22310 093/300 Write block 1779 len 8192 data: 5 3
22311 094/300 Write block 2537 len 28672 data: 6 6 5 6 5 4 3
22312 095/300 Read block 1541 len 12288
22313 096/300 Read block 2799 len 40960
22314 097/300 Write block 1253 len 16384 data: 4 4 6 6
22315 098/300 Write block 2845 len 40960 data: 7 8 9 8 5 6 2 2 4 4
22316 099/300 Read block 3042 len 24576
22317 100/300 Write block 1396 len 24576 data: 4 4 3 5 5 4
22318 101/300 Read block 2859 len 40960
22319 102/300 Read block 790 len 24576
22320 103/300 Flush
22321 104/300 Read block 3612 len 12288
22322 105/300 Read block 1117 len 4096
22323 106/300 Write block 874 len 16384 data: 6 6 5 5
22324 107/300 Flush
22325 108/300 Read block 4414 len 8192
22326 109/300 Read block 1230 len 32768
22327 110/300 Read block 4293 len 20480
22328 111/300 Read block 3834 len 40960
22329 112/300 Read block 3320 len 36864
22330 113/300 Read block 4420 len 12288
22331 114/300 Flush
22332 115/300 Read block 1077 len 28672
22333 116/300 Read block 579 len 28672
22334 117/300 Read block 1804 len 16384
22335 118/300 Flush
22336 119/300 Read block 3494 len 4096
22337 120/300 Read block 745 len 4096
22338 121/300 Write block 68 len 4096 data: 5
22339 122/300 Read block 3031 len 12288
22340 123/300 Read block 643 len 8192
22341 124/300 Read block 4410 len 24576
22342 125/300 Read block 4169 len 20480
22343 126/300 Read block 1036 len 36864
22344 127/300 Read block 1137 len 16384
22345 128/300 Read block 2342 len 32768
22346 129/300 Read block 2429 len 4096
22347 130/300 Read block 3297 len 28672
22348 131/300 Read block 3401 len 4096
22349 132/300 Read block 4401 len 40960
22350 133/300 Read block 3414 len 28672
22351 134/300 Read block 2402 len 8192
22352 135/300 Read block 2355 len 32768
22353 136/300 Flush
22354 137/300 Write block 523 len 24576 data: 7 7 6 6 5 3
22355 138/300 Write block 3939 len 4096 data: 2
22356 139/300 Read block 251 len 32768
22357 140/300 Flush
22358 141/300 Read block 652 len 36864
22359 142/300 Write block 2994 len 24576 data: 10 10 9 9 7 6
22360 143/300 Read block 1688 len 4096
22361 144/300 Write block 3006 len 28672 data: 7 7 7 8 8 7 5
22362 145/300 Read block 17 len 20480
22363 146/300 Write block 2074 len 8192 data: 4 3
22364 147/300 Write block 4578 len 28672 data: 3 4 3 3 3 4 4
22365 148/300 Read block 199 len 40960
22366 149/300 Read block 576 len 32768
22367 150/300 Read block 2882 len 40960
22368 151/300 Write block 664 len 24576 data: 5 3 5 6 7 8
22369 152/300 Read block 4262 len 20480
22370 153/300 Read block 2549 len 8192
22371 154/300 Read block 1341 len 24576
22372 155/300 Write block 2413 len 28672 data: 3 3 3 3 3 3 3
22373 156/300 Write block 1189 len 4096 data: 6
22374 157/300 Write block 905 len 28672 data: 4 4 4 4 4 3 3
22375 158/300 Write block 571 len 16384 data: 4 4 6 7
22376 159/300 Write block 3710 len 32768 data: 4 4 4 4 4 5 5 4
22377 160/300 Write block 710 len 12288 data: 2 2 3
22378 161/300 Write block 2673 len 24576 data: 5 4 4 4 4 3
22379 162/300 Write block 3172 len 12288 data: 3 3 3
22380 163/300 Read block 2492 len 40960
22381 164/300 Write block 1809 len 28672 data: 4 2 2 3 4 4 5
22382 165/300 Write block 2721 len 28672 data: 3 5 6 8 8 10 11
22383 166/300 Read block 4209 len 40960
22384 167/300 Flush
22385 168/300 Write block 2713 len 36864 data: 3 3 3 3 4 4 6 3 4
22386 169/300 Read block 183 len 4096
22387 170/300 Read block 4218 len 32768
22388 171/300 Write block 2026 len 8192 data: 9 7
22389 172/300 Read block 1719 len 8192
22390 173/300 Read block 1935 len 40960
22391 174/300 Read block 3037 len 32768
22392 175/300 Write block 2697 len 32768 data: 4 5 4 4 4 3 3 3
22393 176/300 Read block 4453 len 16384
22394 177/300 Write block 4841 len 32768 data: 4 4 5 5 4 5 4 4
22395 178/300 Write block 2786 len 20480 data: 5 5 5 4 4
22396 179/300 Read block 1607 len 12288
22397 180/300 Read block 933 len 28672
22398 181/300 Read block 47 len 36864
22399 182/300 Read block 88 len 20480
22400 183/300 Read block 3688 len 4096
22401 184/300 Write block 2268 len 4096 data: 2
22402 185/300 Write block 2562 len 20480 data: 5 5 5 5 4
22403 186/300 Write block 690 len 24576 data: 5 5 5 6 6 4
22404 187/300 Write block 2471 len 12288 data: 6 4 4
22405 188/300 Flush
22406 189/300 Read block 3568 len 28672
22407 190/300 Read block 799 len 24576
22408 191/300 Read block 2309 len 20480
22409 192/300 Write block 1570 len 24576 data: 5 4 5 4 5 4
22410 193/300 Flush
22411 194/300 Read block 4327 len 28672
22412 195/300 Write block 2995 len 40960 data: 11 10 10 8 7 5 4 4 4 3
22413 196/300 Read block 590 len 28672
22414 197/300 Write block 3342 len 24576 data: 4 4 3 3 3 3
22415 198/300 Write block 678 len 32768 data: 4 3 2 3 4 4 6 6
22416 199/300 Read block 888 len 8192
22417 200/300 Read block 1759 len 28672
22418 201/300 Write block 2337 len 16384 data: 4 3 4 4
22419 202/300 Write block 4035 len 4096 data: 3
22420 203/300 Read block 2991 len 24576
22421 204/300 Write block 4021 len 24576 data: 3 4 4 4 4 4
22422 205/300 Write block 1366 len 24576 data: 4 3 3 2 2 3
22423 206/300 Read block 2394 len 4096
22424 207/300 Write block 1584 len 24576 data: 4 3 4 4 3 5
22425 208/300 Write block 2378 len 4096 data: 3
22426 209/300 Read block 3125 len 36864
22427 210/300 Read block 2022 len 28672
22428 211/300 Read block 3848 len 4096
22429 212/300 Write block 3148 len 40960 data: 3 3 3 3 2 2 2 3 4 4
22430 213/300 Write block 1850 len 40960 data: 4 4 4 5 4 4 3 4 4 3
22431 214/300 Write block 616 len 32768 data: 4 4 5 3 3 4 5 5
22432 215/300 Read block 3892 len 40960
22433 216/300 Read block 457 len 12288
22434 217/300 Write block 339 len 40960 data: 2 2 3 4 5 4 3 4 2 3
22435 218/300 Write block 4123 len 12288 data: 7 7 7
22436 219/300 Read block 2162 len 24576
22437 220/300 Read block 3443 len 8192
22438 221/300 Flush
22439 222/300 Flush
22440 223/300 Read block 3529 len 12288
22441 224/300 Read block 800 len 12288
22442 225/300 Flush
22443 226/300 Read block 2739 len 28672
22444 227/300 Write block 1819 len 20480 data: 6 5 5 5 5
22445 228/300 Read block 3483 len 4096
22446 229/300 Read block 2256 len 40960
22447 230/300 Write block 2003 len 4096 data: 4
22448 231/300 Read block 778 len 16384
22449 232/300 Write block 4309 len 32768 data: 6 5 5 5 4 4 5 5
22450 233/300 Read block 4690 len 40960
22451 234/300 Write block 3477 len 24576 data: 5 5 5 5 5 4
22452 235/300 Read block 2214 len 8192
22453 236/300 Read block 1323 len 20480
22454 237/300 Write block 3735 len 20480 data: 5 5 4 5 5
22455 238/300 Write block 3374 len 40960 data: 4 4 3 3 3 3 4 4 4 4
22456 239/300 Read block 90 len 36864
22457 240/300 Read block 2751 len 36864
22458 241/300 Write block 2158 len 24576 data: 5 5 6 4 4 6
22459 242/300 Read block 606 len 4096
22460 243/300 Read block 736 len 24576
22461 244/300 Write block 2046 len 24576 data: 4 4 4 3 3 5
22462 245/300 Read block 2202 len 8192
22463 246/300 Write block 1536 len 4096 data: 6
22464 247/300 Read block 2245 len 8192
22465 248/300 Write block 1013 len 16384 data: 4 2 2 2
22466 249/300 Flush
22467 250/300 Read block 2797 len 40960
22468 251/300 Write block 3307 len 40960 data: 3 3 2 2 3 3 3 3 3 2
22469 252/300 Write block 2302 len 4096 data: 5
22470 253/300 Read block 3021 len 28672
22471 254/300 Read block 2421 len 28672
22472 255/300 Write block 167 len 28672 data: 3 3 3 3 3 3 4
22473 256/300 Read block 2970 len 4096
22474 257/300 Read block 1208 len 28672
22475 258/300 Write block 2848 len 40960 data: 9 6 7 3 3 5 5 5 5 4
22476 259/300 Read block 4295 len 8192
22477 260/300 Write block 3302 len 40960 data: 4 4 2 3 2 4 4 3 3 4
22478 261/300 Read block 517 len 40960
22479 262/300 Read block 2978 len 40960
22480 263/300 Read block 3546 len 16384
22481 264/300 Write block 2426 len 4096 data: 7
22482 265/300 Read block 3007 len 36864
22483 266/300 Read block 4111 len 12288
22484 267/300 Read block 43 len 4096
22485 268/300 Read block 4479 len 12288
22486 269/300 Write block 1100 len 16384 data: 8 6 6 5
22487 270/300 Write block 4205 len 20480 data: 4 3 2 3 3
22488 271/300 Read block 1698 len 16384
22489 272/300 Read block 4911 len 4096
22490 273/300 Read block 4416 len 40960
22491 274/300 Write block 3907 len 12288 data: 5 7 7
22492 275/300 Read block 3099 len 36864
22493 276/300 Write block 4937 len 24576 data: 3 4 4 4 3 4
22494 277/300 Write block 2258 len 8192 data: 2 2
22495 278/300 Write block 1132 len 32768 data: 6 5 5 6 5 5 4 6
22496 279/300 Write block 2058 len 28672 data: 7 7 6 7 6 6 6
22497 280/300 Flush
22498 281/300 Write block 1720 len 40960 data: 3 3 3 3 3 3 3 3 4 4
22499 282/300 Write block 506 len 40960 data: 7 7 7 5 5 4 5 7 5 6
22500 283/300 Read block 2064 len 28672
22501 284/300 Read block 4625 len 32768
22502 285/300 Read block 4680 len 24576
22503 286/300 Read block 3907 len 4096
22504 287/300 Read block 4381 len 16384
22505 288/300 Read block 480 len 36864
22506 289/300 Read block 4366 len 8192
22507 290/300 Write block 1438 len 24576 data: 4 5 7 8 9 6
22508 291/300 Read block 4818 len 24576
22509 292/300 Write block 2462 len 36864 data: 4 5 6 6 5 5 5 7 7
22510 293/300 Write block 1178 len 40960 data: 3 3 3 4 3 3 3 3 2 4
22511 294/300 Write block 1537 len 36864 data: 3 3 4 4 4 6 7 8 7
22512 295/300 Flush
22513 296/300 Read block 4100 len 28672
22514 297/300 Read block 722 len 20480
22515 298/300 Read block 2905 len 12288
22516 299/300 Read block 0 len 36864
22517 300/300 Read block 4335 len 32768
22518 Main task has work to do, go find it
22519 got dsc Start(0)
22520 start 0
22521 Apr 20 01:09:50.127 INFO request completed, latency_us: 202, response_code: 204, uri: /start/cid/0, method: POST, req_id: 6a141df8-99a5-4f04-91dc-975714368531, remote_addr: 127.0.0.1:60352, local_addr: 127.0.0.1:9998
22522 Replay: started 0, returned:Ok(())
22523 ----------------------------------------------------------------
22524 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:301
22525 States: Offline Active Active
22526 GW_ID ACK DSID TYPE BLOCKS DS:0 DS:1 DS:2 REPLAY
22527 5427 Acked 6426 Read 1 New Done Done false
22528 5428 Acked 6427 Write 1 New Done Done false
22529 5429 Acked 6428 Read 2 New Done Done false
22530 5430 Acked 6429 Write 9 New Done Done false
22531 5431 Acked 6430 Write 10 New Done Done false
22532 5432 Acked 6431 Read 6 New Done Done false
22533 5433 Acked 6432 Read 9 New Done Done false
22534 5434 Acked 6433 Write 5 New Done Done false
22535 5435 Acked 6434 Read 1 New Done Done false
22536 5436 Acked 6435 Write 9 New Done Done false
22537 5437 Acked 6436 Read 4 New Done Done false
22538 5438 Acked 6437 Read 5 New Done Done false
22539 5439 Acked 6438 Read 8 New Done Done false
22540 5440 Acked 6439 Write 10 New Done Done false
22541 5441 Acked 6440 Read 4 New Done Done false
22542 5442 Acked 6441 Write 10 New Done Done false
22543 5443 Acked 6442 Flush 0 New Done Done false
22544 5444 Acked 6443 Write 1 New Done Done false
22545 5445 Acked 6444 Read 2 New Done Done false
22546 5446 Acked 6445 Read 6 New Done Done false
22547 5447 Acked 6446 Write 7 New Done Done false
22548 5448 Acked 6447 Write 9 New Done Done false
22549 5449 Acked 6448 Write 10 New Done Done false
22550 5450 Acked 6449 Read 7 New Done Done false
22551 5451 Acked 6450 Read 6 New Done Done false
22552 5452 Acked 6451 Write 7 New Done Done false
22553 5453 Acked 6452 Write 5 New Done Done false
22554 5454 Acked 6453 Write 6 New Done Done false
22555 5455 Acked 6454 Read 4 New Done Done false
22556 5456 Acked 6455 Write 8 New Done Done false
22557 5457 Acked 6456 Read 3 New Done Done false
22558 5458 Acked 6457 Read 5 New Done Done false
22559 5459 Acked 6458 Write 2 New Done Done false
22560 5460 Acked 6459 Read 6 New Done Done false
22561 5461 Acked 6460 Read 5 New Done Done false
22562 5462 Acked 6461 Read 8 New Done Done false
22563 5463 Acked 6462 Write 4 New Done Done false
22564 5464 Acked 6463 Read 8 New Done Done false
22565 5465 Acked 6464 Read 3 New Done Done false
22566 5466 Acked 6465 Write 8 New Done Done false
22567 5467 Acked 6466 Write 4 New Done Done false
22568 5468 Acked 6467 Write 7 New Done Done false
22569 5469 Acked 6468 Write 10 New Done Done false
22570 5470 Acked 6469 Write 1 New Done Done false
22571 5471 Acked 6470 Write 9 New Done Done false
22572 5472 Acked 6471 Write 3 New Done Done false
22573 5473 Acked 6472 Flush 0 New Done Done false
22574 5474 Acked 6473 Write 3 New Done Done false
22575 5475 Acked 6474 Flush 0 New Done Done false
22576 5476 Acked 6475 Read 7 New Done Done false
22577 5477 Acked 6476 Flush 0 New Done Done false
22578 5478 Acked 6477 Read 10 New Done Done false
22579 5479 Acked 6478 Write 10 New Done Done false
22580 5480 Acked 6479 Read 7 New Done Done false
22581 5481 Acked 6480 Write 3 New Done Done false
22582 5482 Acked 6481 Write 7 New Done Done false
22583 5483 Acked 6482 Write 7 New Done Done false
22584 5484 Acked 6483 Read 4 New Done Done false
22585 5485 Acked 6484 Flush 0 New Done Done false
22586 5486 Acked 6485 Write 9 New Done Done false
22587 5487 Acked 6486 Flush 0 New Done Done false
22588 5488 Acked 6487 Read 3 New Done Done false
22589 5489 Acked 6488 Write 5 New Done Done false
22590 5490 Acked 6489 Read 6 New Done Done false
22591 5491 Acked 6490 Read 5 New Done Done false
22592 5492 Acked 6491 Read 5 New Done Done false
22593 5493 Acked 6492 Write 8 New Done Done false
22594 5494 Acked 6493 Read 3 New Done Done false
22595 5495 Acked 6494 Read 5 New Done Done false
22596 5496 Acked 6495 Write 1 New Done Done false
22597 5497 Acked 6496 Write 7 New Done Done false
22598 5498 Acked 6497 Read 1 New Done Done false
22599 5499 Acked 6498 Read 5 New Done Done false
22600 5500 Acked 6499 Read 9 New Done Done false
22601 5501 Acked 6500 Flush 0 New Done Done false
22602 5502 Acked 6501 Read 1 New Done Done false
22603 5503 Acked 6502 Flush 0 New Done Done false
22604 5504 Acked 6503 Write 1 New Done Done false
22605 5505 Acked 6504 Flush 0 New Done Done false
22606 5506 Acked 6505 Write 5 New Done Done false
22607 5507 Acked 6506 Read 1 New Done Done false
22608 5508 Acked 6507 Read 3 New Done Done false
22609 5509 Acked 6508 Read 6 New Done Done false
22610 5510 Acked 6509 Read 8 New Done Done false
22611 5511 Acked 6510 Write 9 New Done Done false
22612 5512 Acked 6511 Read 9 New Done Done false
22613 5513 Acked 6512 Write 7 New Done Done false
22614 5514 Acked 6513 Flush 0 New Done Done false
22615 5515 Acked 6514 Write 8 New Done Done false
22616 5516 Acked 6515 Read 1 New Done Done false
22617 5517 Acked 6516 Read 3 New Done Done false
22618 5518 Acked 6517 Flush 0 New Done Done false
22619 5519 Acked 6518 Write 2 New Done Done false
22620 5520 Acked 6519 Write 7 New Done Done false
22621 5521 Acked 6520 Read 3 New Done Done false
22622 5522 Acked 6521 Read 10 New Done Done false
22623 5523 Acked 6522 Write 4 New Done Done false
22624 5524 Acked 6523 Write 10 New Done Done false
22625 5525 Acked 6524 Read 6 New Done Done false
22626 5526 Acked 6525 Write 6 New Done Done false
22627 5527 Acked 6526 Read 10 New Done Done false
22628 5528 Acked 6527 Read 6 New Done Done false
22629 5529 Acked 6528 Flush 0 New Done Done false
22630 5530 Acked 6529 Read 3 New Done Done false
22631 5531 Acked 6530 Read 1 New Done Done false
22632 5532 Acked 6531 Write 4 New Done Done false
22633 5533 Acked 6532 Flush 0 New Done Done false
22634 5534 Acked 6533 Read 2 New Done Done false
22635 5535 Acked 6534 Read 8 New Done Done false
22636 5536 Acked 6535 Read 5 New Done Done false
22637 5537 Acked 6536 Read 10 New Done Done false
22638 5538 Acked 6537 Read 9 New Done Done false
22639 5539 Acked 6538 Read 3 New Done Done false
22640 5540 Acked 6539 Flush 0 New Done Done false
22641 5541 Acked 6540 Read 7 New Done Done false
22642 5542 Acked 6541 Read 7 New Done Done false
22643 5543 Acked 6542 Read 4 New Done Done false
22644 5544 Acked 6543 Flush 0 New Done Done false
22645 5545 Acked 6544 Read 1 New Done Done false
22646 5546 Acked 6545 Read 1 New Done Done false
22647 5547 Acked 6546 Write 1 New Done Done false
22648 5548 Acked 6547 Read 3 New Done Done false
22649 5549 Acked 6548 Read 2 New Done Done false
22650 5550 Acked 6549 Read 6 New Done Done false
22651 5551 Acked 6550 Read 5 New Done Done false
22652 5552 Acked 6551 Read 9 New Done Done false
22653 5553 Acked 6552 Read 4 New Done Done false
22654 5554 Acked 6553 Read 8 New Done Done false
22655 5555 Acked 6554 Read 1 New Done Done false
22656 5556 Acked 6555 Read 7 New Done Done false
22657 5557 Acked 6556 Read 1 New Done Done false
22658 5558 Acked 6557 Read 10 New Done Done false
22659 5559 Acked 6558 Read 7 New Done Done false
22660 5560 Acked 6559 Read 2 New Done Done false
22661 5561 Acked 6560 Read 8 New Done Done false
22662 5562 Acked 6561 Flush 0 New Done Done false
22663 5563 Acked 6562 Write 6 New Done Done false
22664 5564 Acked 6563 Write 1 New Done Done false
22665 5565 Acked 6564 Read 8 New Done Done false
22666 5566 Acked 6565 Flush 0 New Done Done false
22667 5567 Acked 6566 Read 9 New Done Done false
22668 5568 Acked 6567 Write 6 New Done Done false
22669 5569 Acked 6568 Read 1 New Done Done false
22670 5570 Acked 6569 Write 7 New Done Done false
22671 5571 Acked 6570 Read 5 New Done Done false
22672 5572 Acked 6571 Write 2 New Done Done false
22673 5573 Acked 6572 Write 7 New Done Done false
22674 5574 Acked 6573 Read 10 New Done Done false
22675 5575 Acked 6574 Read 8 New Done Done false
22676 5576 Acked 6575 Read 10 New Done Done false
22677 5577 Acked 6576 Write 6 New Done Done false
22678 5578 Acked 6577 Read 5 New Done Done false
22679 5579 Acked 6578 Read 2 New Done Done false
22680 5580 Acked 6579 Read 6 New Done Done false
22681 5581 Acked 6580 Write 7 New Done Done false
22682 5582 Acked 6581 Write 1 New Done Done false
22683 5583 Acked 6582 Write 7 New Done Done false
22684 5584 Acked 6583 Write 4 New Done Done false
22685 5585 Acked 6584 Write 8 New Done Done false
22686 5586 Acked 6585 Write 3 New Done Done false
22687 5587 Acked 6586 Write 6 New Done Done false
22688 5588 Acked 6587 Write 3 New Done Done false
22689 5589 Acked 6588 Read 10 New Done Done false
22690 5590 Acked 6589 Write 7 New Done Done false
22691 5591 Acked 6590 Write 7 New Done Done false
22692 5592 Acked 6591 Read 10 New Done Done false
22693 5593 Acked 6592 Flush 0 New Done Done false
22694 5594 Acked 6593 Write 9 New Done Done false
22695 5595 Acked 6594 Read 1 New Done Done false
22696 5596 Acked 6595 Read 8 New Done Done false
22697 5597 Acked 6596 Write 2 New Done Done false
22698 5598 Acked 6597 Read 2 New Done Done false
22699 5599 Acked 6598 Read 10 New Done Done false
22700 5600 Acked 6599 Read 8 New Done Done false
22701 5601 Acked 6600 Write 8 New Done Done false
22702 5602 Acked 6601 Read 4 New Done Done false
22703 5603 Acked 6602 Write 8 New Done Done false
22704 5604 Acked 6603 Write 5 New Done Done false
22705 5605 Acked 6604 Read 3 New Done Done false
22706 5606 Acked 6605 Read 7 New Done Done false
22707 5607 Acked 6606 Read 9 New Done Done false
22708 5608 Acked 6607 Read 5 New Done Done false
22709 5609 Acked 6608 Read 1 New Done Done false
22710 5610 Acked 6609 Write 1 New Done Done false
22711 5611 Acked 6610 Write 5 New Done Done false
22712 5612 Acked 6611 Write 6 New Done Done false
22713 5613 Acked 6612 Write 3 New Done Done false
22714 5614 Acked 6613 Flush 0 New Done Done false
22715 5615 Acked 6614 Read 7 New Done Done false
22716 5616 Acked 6615 Read 6 New Done Done false
22717 5617 Acked 6616 Read 5 New Done Done false
22718 5618 Acked 6617 Write 6 New Done Done false
22719 5619 Acked 6618 Flush 0 New Done Done false
22720 5620 Acked 6619 Read 7 New Done Done false
22721 5621 Acked 6620 Write 10 New Done Done false
22722 5622 Acked 6621 Read 7 New Done Done false
22723 5623 Acked 6622 Write 6 New Done Done false
22724 5624 Acked 6623 Write 8 New Done Done false
22725 5625 Acked 6624 Read 2 New Done Done false
22726 5626 Acked 6625 Read 7 New Done Done false
22727 5627 Acked 6626 Write 4 New Done Done false
22728 5628 Acked 6627 Write 1 New Done Done false
22729 5629 Acked 6628 Read 6 New Done Done false
22730 5630 Acked 6629 Write 6 New Done Done false
22731 5631 Acked 6630 Write 6 New Done Done false
22732 5632 Acked 6631 Read 1 New Done Done false
22733 5633 Acked 6632 Write 6 New Done Done false
22734 5634 Acked 6633 Write 1 New Done Done false
22735 5635 Acked 6634 Read 9 New Done Done false
22736 5636 Acked 6635 Read 7 New Done Done false
22737 5637 Acked 6636 Read 1 New Done Done false
22738 5638 Acked 6637 Write 10 New Done Done false
22739 5639 Acked 6638 Write 10 New Done Done false
22740 5640 Acked 6639 Write 8 New Done Done false
22741 5641 Acked 6640 Read 10 New Done Done false
22742 5642 Acked 6641 Read 3 New Done Done false
22743 5643 Acked 6642 Write 10 New Done Done false
22744 5644 Acked 6643 Write 3 New Done Done false
22745 5645 Acked 6644 Read 6 New Done Done false
22746 5646 Acked 6645 Read 2 New Done Done false
22747 5647 Acked 6646 Flush 0 New Done Done false
22748 5648 Acked 6647 Flush 0 New Done Done false
22749 5649 Acked 6648 Read 3 New Done Done false
22750 5650 Acked 6649 Read 3 New Done Done false
22751 5651 Acked 6650 Flush 0 New Done Done false
22752 5652 Acked 6651 Read 7 New Done Done false
22753 5653 Acked 6652 Write 5 New Done Done false
22754 5654 Acked 6653 Read 1 New Done Done false
22755 5655 Acked 6654 Read 10 New Done Done false
22756 5656 Acked 6655 Write 1 New Done Done false
22757 5657 Acked 6656 Read 4 New Done Done false
22758 5658 Acked 6657 Write 8 New Done Done false
22759 5659 Acked 6658 Read 10 New Done Done false
22760 5660 Acked 6659 Write 6 New Done Done false
22761 5661 Acked 6660 Read 2 New Done Done false
22762 5662 Acked 6661 Read 5 New Done Done false
22763 5663 Acked 6662 Write 5 New Done Done false
22764 5664 Acked 6663 Write 10 New Done Done false
22765 5665 Acked 6664 Read 9 New Done Done false
22766 5666 Acked 6665 Read 9 New Done Done false
22767 5667 Acked 6666 Write 6 New Done Done false
22768 5668 Acked 6667 Read 1 New Done Done false
22769 5669 Acked 6668 Read 6 New Done Done false
22770 5670 Acked 6669 Write 6 New Done Done false
22771 5671 Acked 6670 Read 2 New Done Done false
22772 5672 Acked 6671 Write 1 New Done Done false
22773 5673 Acked 6672 Read 2 New Done Done false
22774 5674 Acked 6673 Write 4 New Done Done false
22775 5675 Acked 6674 Flush 0 New Done Done false
22776 5676 Acked 6675 Read 10 New Done Done false
22777 5677 Acked 6676 Flush 0 New Done Done false
22778 5678 Acked 6677 Write 10 New Done Done false
22779 5679 Acked 6678 Write 1 New Done Done false
22780 5680 Acked 6679 Read 7 New Done Done false
22781 5681 Acked 6680 Read 7 New Done Done false
22782 5682 Acked 6681 Write 7 New Done Done false
22783 5683 Acked 6682 Read 1 New Done Done false
22784 5684 Acked 6683 Read 7 New Done Done false
22785 5685 Acked 6684 Write 10 New Done Done false
22786 5686 Acked 6685 Read 2 New Done Done false
22787 5687 Acked 6686 Write 10 New Done Done false
22788 5688 Acked 6687 Read 10 New Done Done false
22789 5689 Acked 6688 Read 10 New Done Done false
22790 5690 Acked 6689 Read 4 New Done Done false
22791 5691 Acked 6690 Write 1 New Done Done false
22792 5692 Acked 6691 Read 9 New Done Done false
22793 5693 Acked 6692 Read 3 New Done Done false
22794 5694 Acked 6693 Read 1 New Done Done false
22795 5695 Acked 6694 Read 3 New Done Done false
22796 5696 Acked 6695 Write 4 New Done Done false
22797 5697 Acked 6696 Write 5 New Done Done false
22798 5698 Acked 6697 Read 4 New Done Done false
22799 5699 Acked 6698 Read 1 New Done Done false
22800 5700 Acked 6699 Read 10 New Done Done false
22801 5701 Acked 6700 Write 3 New Done Done false
22802 5702 Acked 6701 Read 9 New Done Done false
22803 5703 Acked 6702 Write 6 New Done Done false
22804 5704 Acked 6703 Write 2 New Done Done false
22805 5705 Acked 6704 Write 8 New Done Done false
22806 5706 Acked 6705 Write 7 New Done Done false
22807 5707 Acked 6706 Flush 0 New Done Done false
22808 5708 Acked 6707 Write 10 New Done Done false
22809 5709 Acked 6708 Write 10 New Done Done false
22810 5710 Acked 6709 Read 7 New Done Done false
22811 5711 Acked 6710 Read 8 New Done Done false
22812 5712 Acked 6711 Read 6 New Done Done false
22813 5713 Acked 6712 Read 1 New Done Done false
22814 5714 Acked 6713 Read 4 New Done Done false
22815 5715 Acked 6714 Read 9 New Done Done false
22816 5716 Acked 6715 Read 2 New Done Done false
22817 5717 Acked 6716 Write 6 New Done Done false
22818 5718 Acked 6717 Read 6 New Done Done false
22819 5719 Acked 6718 Write 9 New Done Done false
22820 5720 Acked 6719 Write 10 New Done Done false
22821 5721 Acked 6720 Write 9 New Done Done false
22822 5722 Acked 6721 Flush 0 New Done Done false
22823 5723 Acked 6722 Read 7 New Done Done false
22824 5724 Acked 6723 Read 5 New Done Done false
22825 5725 Acked 6724 Read 3 New Done Done false
22826 5726 Acked 6725 Read 9 New Done Done false
22827 5727 Acked 6726 Read 8 New Done Done false
22828 STATES DS:0 DS:1 DS:2 TOTAL
22829 New 301 0 0 301
22830 Sent 0 0 0 0
22831 Done 0 301 301 602
22832 Skipped 0 0 0 0
22833 Error 0 0 0 0
22834 Last Flush: 6425 6721 6721
22835 Downstairs last five completed: 6425 6424 6423 6422 6421
22836 Upstairs last five completed: 5727 5726 5725 5724 5723
22837 CLIENT: Up:0 ds:301 act:2
22838 ----------------------------------------------------------------
22839 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:302
22840 States: Offline Active Active
22841 GW_ID ACK DSID TYPE BLOCKS DS:0 DS:1 DS:2 REPLAY
22842 5427 Acked 6426 Read 1 New Done Done false
22843 5428 Acked 6427 Write 1 New Done Done false
22844 5429 Acked 6428 Read 2 New Done Done false
22845 5430 Acked 6429 Write 9 New Done Done false
22846 5431 Acked 6430 Write 10 New Done Done false
22847 5432 Acked 6431 Read 6 New Done Done false
22848 5433 Acked 6432 Read 9 New Done Done false
22849 5434 Acked 6433 Write 5 New Done Done false
22850 5435 Acked 6434 Read 1 New Done Done false
22851 5436 Acked 6435 Write 9 New Done Done false
22852 5437 Acked 6436 Read 4 New Done Done false
22853 5438 Acked 6437 Read 5 New Done Done false
22854 5439 Acked 6438 Read 8 New Done Done false
22855 5440 Acked 6439 Write 10 New Done Done false
22856 5441 Acked 6440 Read 4 New Done Done false
22857 5442 Acked 6441 Write 10 New Done Done false
22858 5443 Acked 6442 Flush 0 New Done Done false
22859 5444 Acked 6443 Write 1 New Done Done false
22860 5445 Acked 6444 Read 2 New Done Done false
22861 5446 Acked 6445 Read 6 New Done Done false
22862 5447 Acked 6446 Write 7 New Done Done false
22863 5448 Acked 6447 Write 9 New Done Done false
22864 5449 Acked 6448 Write 10 New Done Done false
22865 5450 Acked 6449 Read 7 New Done Done false
22866 5451 Acked 6450 Read 6 New Done Done false
22867 5452 Acked 6451 Write 7 New Done Done false
22868 5453 Acked 6452 Write 5 New Done Done false
22869 5454 Acked 6453 Write 6 New Done Done false
22870 5455 Acked 6454 Read 4 New Done Done false
22871 5456 Acked 6455 Write 8 New Done Done false
22872 5457 Acked 6456 Read 3 New Done Done false
22873 5458 Acked 6457 Read 5 New Done Done false
22874 5459 Acked 6458 Write 2 New Done Done false
22875 5460 Acked 6459 Read 6 New Done Done false
22876 5461 Acked 6460 Read 5 New Done Done false
22877 5462 Acked 6461 Read 8 New Done Done false
22878 5463 Acked 6462 Write 4 New Done Done false
22879 5464 Acked 6463 Read 8 New Done Done false
22880 5465 Acked 6464 Read 3 New Done Done false
22881 5466 Acked 6465 Write 8 New Done Done false
22882 5467 Acked 6466 Write 4 New Done Done false
22883 5468 Acked 6467 Write 7 New Done Done false
22884 5469 Acked 6468 Write 10 New Done Done false
22885 5470 Acked 6469 Write 1 New Done Done false
22886 5471 Acked 6470 Write 9 New Done Done false
22887 5472 Acked 6471 Write 3 New Done Done false
22888 5473 Acked 6472 Flush 0 New Done Done false
22889 5474 Acked 6473 Write 3 New Done Done false
22890 5475 Acked 6474 Flush 0 New Done Done false
22891 5476 Acked 6475 Read 7 New Done Done false
22892 5477 Acked 6476 Flush 0 New Done Done false
22893 5478 Acked 6477 Read 10 New Done Done false
22894 5479 Acked 6478 Write 10 New Done Done false
22895 5480 Acked 6479 Read 7 New Done Done false
22896 5481 Acked 6480 Write 3 New Done Done false
22897 5482 Acked 6481 Write 7 New Done Done false
22898 5483 Acked 6482 Write 7 New Done Done false
22899 5484 Acked 6483 Read 4 New Done Done false
22900 5485 Acked 6484 Flush 0 New Done Done false
22901 5486 Acked 6485 Write 9 New Done Done false
22902 5487 Acked 6486 Flush 0 New Done Done false
22903 5488 Acked 6487 Read 3 New Done Done false
22904 5489 Acked 6488 Write 5 New Done Done false
22905 5490 Acked 6489 Read 6 New Done Done false
22906 5491 Acked 6490 Read 5 New Done Done false
22907 5492 Acked 6491 Read 5 New Done Done false
22908 5493 Acked 6492 Write 8 New Done Done false
22909 5494 Acked 6493 Read 3 New Done Done false
22910 5495 Acked 6494 Read 5 New Done Done false
22911 5496 Acked 6495 Write 1 New Done Done false
22912 5497 Acked 6496 Write 7 New Done Done false
22913 5498 Acked 6497 Read 1 New Done Done false
22914 5499 Acked 6498 Read 5 New Done Done false
22915 5500 Acked 6499 Read 9 New Done Done false
22916 5501 Acked 6500 Flush 0 New Done Done false
22917 5502 Acked 6501 Read 1 New Done Done false
22918 5503 Acked 6502 Flush 0 New Done Done false
22919 5504 Acked 6503 Write 1 New Done Done false
22920 5505 Acked 6504 Flush 0 New Done Done false
22921 5506 Acked 6505 Write 5 New Done Done false
22922 5507 Acked 6506 Read 1 New Done Done false
22923 5508 Acked 6507 Read 3 New Done Done false
22924 5509 Acked 6508 Read 6 New Done Done false
22925 5510 Acked 6509 Read 8 New Done Done false
22926 5511 Acked 6510 Write 9 New Done Done false
22927 5512 Acked 6511 Read 9 New Done Done false
22928 5513 Acked 6512 Write 7 New Done Done false
22929 5514 Acked 6513 Flush 0 New Done Done false
22930 5515 Acked 6514 Write 8 New Done Done false
22931 5516 Acked 6515 Read 1 New Done Done false
22932 5517 Acked 6516 Read 3 New Done Done false
22933 5518 Acked 6517 Flush 0 New Done Done false
22934 5519 Acked 6518 Write 2 New Done Done false
22935 5520 Acked 6519 Write 7 New Done Done false
22936 5521 Acked 6520 Read 3 New Done Done false
22937 5522 Acked 6521 Read 10 New Done Done false
22938 5523 Acked 6522 Write 4 New Done Done false
22939 5524 Acked 6523 Write 10 New Done Done false
22940 5525 Acked 6524 Read 6 New Done Done false
22941 5526 Acked 6525 Write 6 New Done Done false
22942 5527 Acked 6526 Read 10 New Done Done false
22943 5528 Acked 6527 Read 6 New Done Done false
22944 5529 Acked 6528 Flush 0 New Done Done false
22945 5530 Acked 6529 Read 3 New Done Done false
22946 5531 Acked 6530 Read 1 New Done Done false
22947 5532 Acked 6531 Write 4 New Done Done false
22948 5533 Acked 6532 Flush 0 New Done Done false
22949 5534 Acked 6533 Read 2 New Done Done false
22950 5535 Acked 6534 Read 8 New Done Done false
22951 5536 Acked 6535 Read 5 New Done Done false
22952 5537 Acked 6536 Read 10 New Done Done false
22953 5538 Acked 6537 Read 9 New Done Done false
22954 5539 Acked 6538 Read 3 New Done Done false
22955 5540 Acked 6539 Flush 0 New Done Done false
22956 5541 Acked 6540 Read 7 New Done Done false
22957 5542 Acked 6541 Read 7 New Done Done false
22958 5543 Acked 6542 Read 4 New Done Done false
22959 5544 Acked 6543 Flush 0 New Done Done false
22960 5545 Acked 6544 Read 1 New Done Done false
22961 5546 Acked 6545 Read 1 New Done Done false
22962 5547 Acked 6546 Write 1 New Done Done false
22963 5548 Acked 6547 Read 3 New Done Done false
22964 5549 Acked 6548 Read 2 New Done Done false
22965 5550 Acked 6549 Read 6 New Done Done false
22966 5551 Acked 6550 Read 5 New Done Done false
22967 5552 Acked 6551 Read 9 New Done Done false
22968 5553 Acked 6552 Read 4 New Done Done false
22969 5554 Acked 6553 Read 8 New Done Done false
22970 5555 Acked 6554 Read 1 New Done Done false
22971 5556 Acked 6555 Read 7 New Done Done false
22972 5557 Acked 6556 Read 1 New Done Done false
22973 5558 Acked 6557 Read 10 New Done Done false
22974 5559 Acked 6558 Read 7 New Done Done false
22975 5560 Acked 6559 Read 2 New Done Done false
22976 5561 Acked 6560 Read 8 New Done Done false
22977 5562 Acked 6561 Flush 0 New Done Done false
22978 5563 Acked 6562 Write 6 New Done Done false
22979 5564 Acked 6563 Write 1 New Done Done false
22980 5565 Acked 6564 Read 8 New Done Done false
22981 5566 Acked 6565 Flush 0 New Done Done false
22982 5567 Acked 6566 Read 9 New Done Done false
22983 5568 Acked 6567 Write 6 New Done Done false
22984 5569 Acked 6568 Read 1 New Done Done false
22985 5570 Acked 6569 Write 7 New Done Done false
22986 5571 Acked 6570 Read 5 New Done Done false
22987 5572 Acked 6571 Write 2 New Done Done false
22988 5573 Acked 6572 Write 7 New Done Done false
22989 5574 Acked 6573 Read 10 New Done Done false
22990 5575 Acked 6574 Read 8 New Done Done false
22991 5576 Acked 6575 Read 10 New Done Done false
22992 5577 Acked 6576 Write 6 New Done Done false
22993 5578 Acked 6577 Read 5 New Done Done false
22994 5579 Acked 6578 Read 2 New Done Done false
22995 5580 Acked 6579 Read 6 New Done Done false
22996 5581 Acked 6580 Write 7 New Done Done false
22997 5582 Acked 6581 Write 1 New Done Done false
22998 5583 Acked 6582 Write 7 New Done Done false
22999 5584 Acked 6583 Write 4 New Done Done false
23000 5585 Acked 6584 Write 8 New Done Done false
23001 5586 Acked 6585 Write 3 New Done Done false
23002 5587 Acked 6586 Write 6 New Done Done false
23003 5588 Acked 6587 Write 3 New Done Done false
23004 5589 Acked 6588 Read 10 New Done Done false
23005 5590 Acked 6589 Write 7 New Done Done false
23006 5591 Acked 6590 Write 7 New Done Done false
23007 5592 Acked 6591 Read 10 New Done Done false
23008 5593 Acked 6592 Flush 0 New Done Done false
23009 5594 Acked 6593 Write 9 New Done Done false
23010 5595 Acked 6594 Read 1 New Done Done false
23011 5596 Acked 6595 Read 8 New Done Done false
23012 5597 Acked 6596 Write 2 New Done Done false
23013 5598 Acked 6597 Read 2 New Done Done false
23014 5599 Acked 6598 Read 10 New Done Done false
23015 5600 Acked 6599 Read 8 New Done Done false
23016 5601 Acked 6600 Write 8 New Done Done false
23017 5602 Acked 6601 Read 4 New Done Done false
23018 5603 Acked 6602 Write 8 New Done Done false
23019 5604 Acked 6603 Write 5 New Done Done false
23020 5605 Acked 6604 Read 3 New Done Done false
23021 5606 Acked 6605 Read 7 New Done Done false
23022 5607 Acked 6606 Read 9 New Done Done false
23023 5608 Acked 6607 Read 5 New Done Done false
23024 5609 Acked 6608 Read 1 New Done Done false
23025 5610 Acked 6609 Write 1 New Done Done false
23026 5611 Acked 6610 Write 5 New Done Done false
23027 5612 Acked 6611 Write 6 New Done Done false
23028 5613 Acked 6612 Write 3 New Done Done false
23029 5614 Acked 6613 Flush 0 New Done Done false
23030 5615 Acked 6614 Read 7 New Done Done false
23031 5616 Acked 6615 Read 6 New Done Done false
23032 5617 Acked 6616 Read 5 New Done Done false
23033 5618 Acked 6617 Write 6 New Done Done false
23034 5619 Acked 6618 Flush 0 New Done Done false
23035 5620 Acked 6619 Read 7 New Done Done false
23036 5621 Acked 6620 Write 10 New Done Done false
23037 5622 Acked 6621 Read 7 New Done Done false
23038 5623 Acked 6622 Write 6 New Done Done false
23039 5624 Acked 6623 Write 8 New Done Done false
23040 5625 Acked 6624 Read 2 New Done Done false
23041 5626 Acked 6625 Read 7 New Done Done false
23042 5627 Acked 6626 Write 4 New Done Done false
23043 5628 Acked 6627 Write 1 New Done Done false
23044 5629 Acked 6628 Read 6 New Done Done false
23045 5630 Acked 6629 Write 6 New Done Done false
23046 5631 Acked 6630 Write 6 New Done Done false
23047 5632 Acked 6631 Read 1 New Done Done false
23048 5633 Acked 6632 Write 6 New Done Done false
23049 5634 Acked 6633 Write 1 New Done Done false
23050 5635 Acked 6634 Read 9 New Done Done false
23051 5636 Acked 6635 Read 7 New Done Done false
23052 5637 Acked 6636 Read 1 New Done Done false
23053 5638 Acked 6637 Write 10 New Done Done false
23054 5639 Acked 6638 Write 10 New Done Done false
23055 5640 Acked 6639 Write 8 New Done Done false
23056 5641 Acked 6640 Read 10 New Done Done false
23057 5642 Acked 6641 Read 3 New Done Done false
23058 5643 Acked 6642 Write 10 New Done Done false
23059 5644 Acked 6643 Write 3 New Done Done false
23060 5645 Acked 6644 Read 6 New Done Done false
23061 5646 Acked 6645 Read 2 New Done Done false
23062 5647 Acked 6646 Flush 0 New Done Done false
23063 5648 Acked 6647 Flush 0 New Done Done false
23064 5649 Acked 6648 Read 3 New Done Done false
23065 5650 Acked 6649 Read 3 New Done Done false
23066 5651 Acked 6650 Flush 0 New Done Done false
23067 5652 Acked 6651 Read 7 New Done Done false
23068 5653 Acked 6652 Write 5 New Done Done false
23069 5654 Acked 6653 Read 1 New Done Done false
23070 5655 Acked 6654 Read 10 New Done Done false
23071 5656 Acked 6655 Write 1 New Done Done false
23072 5657 Acked 6656 Read 4 New Done Done false
23073 5658 Acked 6657 Write 8 New Done Done false
23074 5659 Acked 6658 Read 10 New Done Done false
23075 5660 Acked 6659 Write 6 New Done Done false
23076 5661 Acked 6660 Read 2 New Done Done false
23077 5662 Acked 6661 Read 5 New Done Done false
23078 5663 Acked 6662 Write 5 New Done Done false
23079 5664 Acked 6663 Write 10 New Done Done false
23080 5665 Acked 6664 Read 9 New Done Done false
23081 5666 Acked 6665 Read 9 New Done Done false
23082 5667 Acked 6666 Write 6 New Done Done false
23083 5668 Acked 6667 Read 1 New Done Done false
23084 5669 Acked 6668 Read 6 New Done Done false
23085 5670 Acked 6669 Write 6 New Done Done false
23086 5671 Acked 6670 Read 2 New Done Done false
23087 5672 Acked 6671 Write 1 New Done Done false
23088 5673 Acked 6672 Read 2 New Done Done false
23089 5674 Acked 6673 Write 4 New Done Done false
23090 5675 Acked 6674 Flush 0 New Done Done false
23091 5676 Acked 6675 Read 10 New Done Done false
23092 5677 Acked 6676 Flush 0 New Done Done false
23093 5678 Acked 6677 Write 10 New Done Done false
23094 5679 Acked 6678 Write 1 New Done Done false
23095 5680 Acked 6679 Read 7 New Done Done false
23096 5681 Acked 6680 Read 7 New Done Done false
23097 5682 Acked 6681 Write 7 New Done Done false
23098 5683 Acked 6682 Read 1 New Done Done false
23099 5684 Acked 6683 Read 7 New Done Done false
23100 5685 Acked 6684 Write 10 New Done Done false
23101 5686 Acked 6685 Read 2 New Done Done false
23102 5687 Acked 6686 Write 10 New Done Done false
23103 5688 Acked 6687 Read 10 New Done Done false
23104 5689 Acked 6688 Read 10 New Done Done false
23105 5690 Acked 6689 Read 4 New Done Done false
23106 5691 Acked 6690 Write 1 New Done Done false
23107 5692 Acked 6691 Read 9 New Done Done false
23108 5693 Acked 6692 Read 3 New Done Done false
23109 5694 Acked 6693 Read 1 New Done Done false
23110 5695 Acked 6694 Read 3 New Done Done false
23111 5696 Acked 6695 Write 4 New Done Done false
23112 5697 Acked 6696 Write 5 New Done Done false
23113 5698 Acked 6697 Read 4 New Done Done false
23114 5699 Acked 6698 Read 1 New Done Done false
23115 5700 Acked 6699 Read 10 New Done Done false
23116 5701 Acked 6700 Write 3 New Done Done false
23117 5702 Acked 6701 Read 9 New Done Done false
23118 5703 Acked 6702 Write 6 New Done Done false
23119 5704 Acked 6703 Write 2 New Done Done false
23120 5705 Acked 6704 Write 8 New Done Done false
23121 5706 Acked 6705 Write 7 New Done Done false
23122 5707 Acked 6706 Flush 0 New Done Done false
23123 5708 Acked 6707 Write 10 New Done Done false
23124 5709 Acked 6708 Write 10 New Done Done false
23125 5710 Acked 6709 Read 7 New Done Done false
23126 5711 Acked 6710 Read 8 New Done Done false
23127 5712 Acked 6711 Read 6 New Done Done false
23128 5713 Acked 6712 Read 1 New Done Done false
23129 5714 Acked 6713 Read 4 New Done Done false
23130 5715 Acked 6714 Read 9 New Done Done false
23131 5716 Acked 6715 Read 2 New Done Done false
23132 5717 Acked 6716 Write 6 New Done Done false
23133 5718 Acked 6717 Read 6 New Done Done false
23134 5719 Acked 6718 Write 9 New Done Done false
23135 5720 Acked 6719 Write 10 New Done Done false
23136 5721 Acked 6720 Write 9 New Done Done false
23137 5722 Acked 6721 Flush 0 New Done Done false
23138 5723 Acked 6722 Read 7 New Done Done false
23139 5724 Acked 6723 Read 5 New Done Done false
23140 5725 Acked 6724 Read 3 New Done Done false
23141 5726 Acked 6725 Read 9 New Done Done false
23142 5727 Acked 6726 Read 8 New Done Done false
23143 5728 Acked 6727 Flush 0 New Done Done false
23144 STATES DS:0 DS:1 DS:2 TOTAL
23145 New 302 0 0 302
23146 Sent 0 0 0 0
23147 Done 0 302 302 604
23148 Skipped 0 0 0 0
23149 Error 0 0 0 0
23150 Last Flush: 6425 6727 6727
23151 Downstairs last five completed: 6425 6424 6423 6422 6421
23152 Upstairs last five completed: 5728 5727 5726 5725 5724
23153 CLIENT: Up:0 ds:302 act:2
231542024-04-20T01:09:55.819ZINFOcrucible: connecting to 127.0.0.1:8810 = io task client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
231552024-04-20T01:09:55.820ZWARNcrucible: ds_connection connect to 127.0.0.1:8810 failure: Os { code: 146, kind: ConnectionRefused, message: "Connection refused" } = io task client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
231562024-04-20T01:09:55.820ZWARNcrucible: client task is sending Done(ConnectionFailed(Os { code: 146, kind: ConnectionRefused, message: "Connection refused" })) = io task client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
231572024-04-20T01:09:55.820ZWARNcrucible: downstairs task for 0 stopped due to ConnectionFailed(Os { code: 146, kind: ConnectionRefused, message: "Connection refused" }) session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
231582024-04-20T01:09:55.820ZINFOcrucible: [0] client re-new 302 jobs since flush 6425 = downstairs session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
231592024-04-20T01:09:55.820ZINFOcrucible: [0] Marked 0 jobs for replay since flush: 6425 = downstairs session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
231602024-04-20T01:09:55.820ZINFOcrucible: client task is exiting = io task client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
23161 [8810] got start action
23162 [8810] I am going to restart
23163 Starting downstairs at port 8810
23164 Make output file at "/tmp/dsc/downstairs-8810.txt"
23165 [8810][0] reports Starting
23166 Downstairs /var/tmp/dsc/region/8810 port 8810 PID:Some(1215)
23167 [8810][0] reports Running
23168 ----------------------------------------------------------------
23169 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:302
23170 States: Offline Active Active
23171 GW_ID ACK DSID TYPE BLOCKS DS:0 DS:1 DS:2 REPLAY
23172 5427 Acked 6426 Read 1 New Done Done true
23173 5428 Acked 6427 Write 1 New Done Done true
23174 5429 Acked 6428 Read 2 New Done Done true
23175 5430 Acked 6429 Write 9 New Done Done true
23176 5431 Acked 6430 Write 10 New Done Done true
23177 5432 Acked 6431 Read 6 New Done Done true
23178 5433 Acked 6432 Read 9 New Done Done true
23179 5434 Acked 6433 Write 5 New Done Done true
23180 5435 Acked 6434 Read 1 New Done Done true
23181 5436 Acked 6435 Write 9 New Done Done true
23182 5437 Acked 6436 Read 4 New Done Done true
23183 5438 Acked 6437 Read 5 New Done Done true
23184 5439 Acked 6438 Read 8 New Done Done true
23185 5440 Acked 6439 Write 10 New Done Done true
23186 5441 Acked 6440 Read 4 New Done Done true
23187 5442 Acked 6441 Write 10 New Done Done true
23188 5443 Acked 6442 Flush 0 New Done Done true
23189 5444 Acked 6443 Write 1 New Done Done true
23190 5445 Acked 6444 Read 2 New Done Done true
23191 5446 Acked 6445 Read 6 New Done Done true
23192 5447 Acked 6446 Write 7 New Done Done true
23193 5448 Acked 6447 Write 9 New Done Done true
23194 5449 Acked 6448 Write 10 New Done Done true
23195 5450 Acked 6449 Read 7 New Done Done true
23196 5451 Acked 6450 Read 6 New Done Done true
23197 5452 Acked 6451 Write 7 New Done Done true
23198 5453 Acked 6452 Write 5 New Done Done true
23199 5454 Acked 6453 Write 6 New Done Done true
23200 5455 Acked 6454 Read 4 New Done Done true
23201 5456 Acked 6455 Write 8 New Done Done true
23202 5457 Acked 6456 Read 3 New Done Done true
23203 5458 Acked 6457 Read 5 New Done Done true
23204 5459 Acked 6458 Write 2 New Done Done true
23205 5460 Acked 6459 Read 6 New Done Done true
23206 5461 Acked 6460 Read 5 New Done Done true
23207 5462 Acked 6461 Read 8 New Done Done true
23208 5463 Acked 6462 Write 4 New Done Done true
23209 5464 Acked 6463 Read 8 New Done Done true
23210 5465 Acked 6464 Read 3 New Done Done true
23211 5466 Acked 6465 Write 8 New Done Done true
23212 5467 Acked 6466 Write 4 New Done Done true
23213 5468 Acked 6467 Write 7 New Done Done true
23214 5469 Acked 6468 Write 10 New Done Done true
23215 5470 Acked 6469 Write 1 New Done Done true
23216 5471 Acked 6470 Write 9 New Done Done true
23217 5472 Acked 6471 Write 3 New Done Done true
23218 5473 Acked 6472 Flush 0 New Done Done true
23219 5474 Acked 6473 Write 3 New Done Done true
23220 5475 Acked 6474 Flush 0 New Done Done true
23221 5476 Acked 6475 Read 7 New Done Done true
23222 5477 Acked 6476 Flush 0 New Done Done true
23223 5478 Acked 6477 Read 10 New Done Done true
23224 5479 Acked 6478 Write 10 New Done Done true
23225 5480 Acked 6479 Read 7 New Done Done true
23226 5481 Acked 6480 Write 3 New Done Done true
23227 5482 Acked 6481 Write 7 New Done Done true
23228 5483 Acked 6482 Write 7 New Done Done true
23229 5484 Acked 6483 Read 4 New Done Done true
23230 5485 Acked 6484 Flush 0 New Done Done true
23231 5486 Acked 6485 Write 9 New Done Done true
23232 5487 Acked 6486 Flush 0 New Done Done true
23233 5488 Acked 6487 Read 3 New Done Done true
23234 5489 Acked 6488 Write 5 New Done Done true
23235 5490 Acked 6489 Read 6 New Done Done true
23236 5491 Acked 6490 Read 5 New Done Done true
23237 5492 Acked 6491 Read 5 New Done Done true
23238 5493 Acked 6492 Write 8 New Done Done true
23239 5494 Acked 6493 Read 3 New Done Done true
23240 5495 Acked 6494 Read 5 New Done Done true
23241 5496 Acked 6495 Write 1 New Done Done true
23242 5497 Acked 6496 Write 7 New Done Done true
23243 5498 Acked 6497 Read 1 New Done Done true
23244 5499 Acked 6498 Read 5 New Done Done true
23245 5500 Acked 6499 Read 9 New Done Done true
23246 5501 Acked 6500 Flush 0 New Done Done true
23247 5502 Acked 6501 Read 1 New Done Done true
23248 5503 Acked 6502 Flush 0 New Done Done true
23249 5504 Acked 6503 Write 1 New Done Done true
23250 5505 Acked 6504 Flush 0 New Done Done true
23251 5506 Acked 6505 Write 5 New Done Done true
23252 5507 Acked 6506 Read 1 New Done Done true
23253 5508 Acked 6507 Read 3 New Done Done true
23254 5509 Acked 6508 Read 6 New Done Done true
23255 5510 Acked 6509 Read 8 New Done Done true
23256 5511 Acked 6510 Write 9 New Done Done true
23257 5512 Acked 6511 Read 9 New Done Done true
23258 5513 Acked 6512 Write 7 New Done Done true
23259 5514 Acked 6513 Flush 0 New Done Done true
23260 5515 Acked 6514 Write 8 New Done Done true
23261 5516 Acked 6515 Read 1 New Done Done true
23262 5517 Acked 6516 Read 3 New Done Done true
23263 5518 Acked 6517 Flush 0 New Done Done true
23264 5519 Acked 6518 Write 2 New Done Done true
23265 5520 Acked 6519 Write 7 New Done Done true
23266 5521 Acked 6520 Read 3 New Done Done true
23267 5522 Acked 6521 Read 10 New Done Done true
23268 5523 Acked 6522 Write 4 New Done Done true
23269 5524 Acked 6523 Write 10 New Done Done true
23270 5525 Acked 6524 Read 6 New Done Done true
23271 5526 Acked 6525 Write 6 New Done Done true
23272 5527 Acked 6526 Read 10 New Done Done true
23273 5528 Acked 6527 Read 6 New Done Done true
23274 5529 Acked 6528 Flush 0 New Done Done true
23275 5530 Acked 6529 Read 3 New Done Done true
23276 5531 Acked 6530 Read 1 New Done Done true
23277 5532 Acked 6531 Write 4 New Done Done true
23278 5533 Acked 6532 Flush 0 New Done Done true
23279 5534 Acked 6533 Read 2 New Done Done true
23280 5535 Acked 6534 Read 8 New Done Done true
23281 5536 Acked 6535 Read 5 New Done Done true
23282 5537 Acked 6536 Read 10 New Done Done true
23283 5538 Acked 6537 Read 9 New Done Done true
23284 5539 Acked 6538 Read 3 New Done Done true
23285 5540 Acked 6539 Flush 0 New Done Done true
23286 5541 Acked 6540 Read 7 New Done Done true
23287 5542 Acked 6541 Read 7 New Done Done true
23288 5543 Acked 6542 Read 4 New Done Done true
23289 5544 Acked 6543 Flush 0 New Done Done true
23290 5545 Acked 6544 Read 1 New Done Done true
23291 5546 Acked 6545 Read 1 New Done Done true
23292 5547 Acked 6546 Write 1 New Done Done true
23293 5548 Acked 6547 Read 3 New Done Done true
23294 5549 Acked 6548 Read 2 New Done Done true
23295 5550 Acked 6549 Read 6 New Done Done true
23296 5551 Acked 6550 Read 5 New Done Done true
23297 5552 Acked 6551 Read 9 New Done Done true
23298 5553 Acked 6552 Read 4 New Done Done true
23299 5554 Acked 6553 Read 8 New Done Done true
23300 5555 Acked 6554 Read 1 New Done Done true
23301 5556 Acked 6555 Read 7 New Done Done true
23302 5557 Acked 6556 Read 1 New Done Done true
23303 5558 Acked 6557 Read 10 New Done Done true
23304 5559 Acked 6558 Read 7 New Done Done true
23305 5560 Acked 6559 Read 2 New Done Done true
23306 5561 Acked 6560 Read 8 New Done Done true
23307 5562 Acked 6561 Flush 0 New Done Done true
23308 5563 Acked 6562 Write 6 New Done Done true
23309 5564 Acked 6563 Write 1 New Done Done true
23310 5565 Acked 6564 Read 8 New Done Done true
23311 5566 Acked 6565 Flush 0 New Done Done true
23312 5567 Acked 6566 Read 9 New Done Done true
23313 5568 Acked 6567 Write 6 New Done Done true
23314 5569 Acked 6568 Read 1 New Done Done true
23315 5570 Acked 6569 Write 7 New Done Done true
23316 5571 Acked 6570 Read 5 New Done Done true
23317 5572 Acked 6571 Write 2 New Done Done true
23318 5573 Acked 6572 Write 7 New Done Done true
23319 5574 Acked 6573 Read 10 New Done Done true
23320 5575 Acked 6574 Read 8 New Done Done true
23321 5576 Acked 6575 Read 10 New Done Done true
23322 5577 Acked 6576 Write 6 New Done Done true
23323 5578 Acked 6577 Read 5 New Done Done true
23324 5579 Acked 6578 Read 2 New Done Done true
23325 5580 Acked 6579 Read 6 New Done Done true
23326 5581 Acked 6580 Write 7 New Done Done true
23327 5582 Acked 6581 Write 1 New Done Done true
23328 5583 Acked 6582 Write 7 New Done Done true
23329 5584 Acked 6583 Write 4 New Done Done true
23330 5585 Acked 6584 Write 8 New Done Done true
23331 5586 Acked 6585 Write 3 New Done Done true
23332 5587 Acked 6586 Write 6 New Done Done true
23333 5588 Acked 6587 Write 3 New Done Done true
23334 5589 Acked 6588 Read 10 New Done Done true
23335 5590 Acked 6589 Write 7 New Done Done true
23336 5591 Acked 6590 Write 7 New Done Done true
23337 5592 Acked 6591 Read 10 New Done Done true
23338 5593 Acked 6592 Flush 0 New Done Done true
23339 5594 Acked 6593 Write 9 New Done Done true
23340 5595 Acked 6594 Read 1 New Done Done true
23341 5596 Acked 6595 Read 8 New Done Done true
23342 5597 Acked 6596 Write 2 New Done Done true
23343 5598 Acked 6597 Read 2 New Done Done true
23344 5599 Acked 6598 Read 10 New Done Done true
23345 5600 Acked 6599 Read 8 New Done Done true
23346 5601 Acked 6600 Write 8 New Done Done true
23347 5602 Acked 6601 Read 4 New Done Done true
23348 5603 Acked 6602 Write 8 New Done Done true
23349 5604 Acked 6603 Write 5 New Done Done true
23350 5605 Acked 6604 Read 3 New Done Done true
23351 5606 Acked 6605 Read 7 New Done Done true
23352 5607 Acked 6606 Read 9 New Done Done true
23353 5608 Acked 6607 Read 5 New Done Done true
23354 5609 Acked 6608 Read 1 New Done Done true
23355 5610 Acked 6609 Write 1 New Done Done true
23356 5611 Acked 6610 Write 5 New Done Done true
23357 5612 Acked 6611 Write 6 New Done Done true
23358 5613 Acked 6612 Write 3 New Done Done true
23359 5614 Acked 6613 Flush 0 New Done Done true
23360 5615 Acked 6614 Read 7 New Done Done true
23361 5616 Acked 6615 Read 6 New Done Done true
23362 5617 Acked 6616 Read 5 New Done Done true
23363 5618 Acked 6617 Write 6 New Done Done true
23364 5619 Acked 6618 Flush 0 New Done Done true
23365 5620 Acked 6619 Read 7 New Done Done true
23366 5621 Acked 6620 Write 10 New Done Done true
23367 5622 Acked 6621 Read 7 New Done Done true
23368 5623 Acked 6622 Write 6 New Done Done true
23369 5624 Acked 6623 Write 8 New Done Done true
23370 5625 Acked 6624 Read 2 New Done Done true
23371 5626 Acked 6625 Read 7 New Done Done true
23372 5627 Acked 6626 Write 4 New Done Done true
23373 5628 Acked 6627 Write 1 New Done Done true
23374 5629 Acked 6628 Read 6 New Done Done true
23375 5630 Acked 6629 Write 6 New Done Done true
23376 5631 Acked 6630 Write 6 New Done Done true
23377 5632 Acked 6631 Read 1 New Done Done true
23378 5633 Acked 6632 Write 6 New Done Done true
23379 5634 Acked 6633 Write 1 New Done Done true
23380 5635 Acked 6634 Read 9 New Done Done true
23381 5636 Acked 6635 Read 7 New Done Done true
23382 5637 Acked 6636 Read 1 New Done Done true
23383 5638 Acked 6637 Write 10 New Done Done true
23384 5639 Acked 6638 Write 10 New Done Done true
23385 5640 Acked 6639 Write 8 New Done Done true
23386 5641 Acked 6640 Read 10 New Done Done true
23387 5642 Acked 6641 Read 3 New Done Done true
23388 5643 Acked 6642 Write 10 New Done Done true
23389 5644 Acked 6643 Write 3 New Done Done true
23390 5645 Acked 6644 Read 6 New Done Done true
23391 5646 Acked 6645 Read 2 New Done Done true
23392 5647 Acked 6646 Flush 0 New Done Done true
23393 5648 Acked 6647 Flush 0 New Done Done true
23394 5649 Acked 6648 Read 3 New Done Done true
23395 5650 Acked 6649 Read 3 New Done Done true
23396 5651 Acked 6650 Flush 0 New Done Done true
23397 5652 Acked 6651 Read 7 New Done Done true
23398 5653 Acked 6652 Write 5 New Done Done true
23399 5654 Acked 6653 Read 1 New Done Done true
23400 5655 Acked 6654 Read 10 New Done Done true
23401 5656 Acked 6655 Write 1 New Done Done true
23402 5657 Acked 6656 Read 4 New Done Done true
23403 5658 Acked 6657 Write 8 New Done Done true
23404 5659 Acked 6658 Read 10 New Done Done true
23405 5660 Acked 6659 Write 6 New Done Done true
23406 5661 Acked 6660 Read 2 New Done Done true
23407 5662 Acked 6661 Read 5 New Done Done true
23408 5663 Acked 6662 Write 5 New Done Done true
23409 5664 Acked 6663 Write 10 New Done Done true
23410 5665 Acked 6664 Read 9 New Done Done true
23411 5666 Acked 6665 Read 9 New Done Done true
23412 5667 Acked 6666 Write 6 New Done Done true
23413 5668 Acked 6667 Read 1 New Done Done true
23414 5669 Acked 6668 Read 6 New Done Done true
23415 5670 Acked 6669 Write 6 New Done Done true
23416 5671 Acked 6670 Read 2 New Done Done true
23417 5672 Acked 6671 Write 1 New Done Done true
23418 5673 Acked 6672 Read 2 New Done Done true
23419 5674 Acked 6673 Write 4 New Done Done true
23420 5675 Acked 6674 Flush 0 New Done Done true
23421 5676 Acked 6675 Read 10 New Done Done true
23422 5677 Acked 6676 Flush 0 New Done Done true
23423 5678 Acked 6677 Write 10 New Done Done true
23424 5679 Acked 6678 Write 1 New Done Done true
23425 5680 Acked 6679 Read 7 New Done Done true
23426 5681 Acked 6680 Read 7 New Done Done true
23427 5682 Acked 6681 Write 7 New Done Done true
23428 5683 Acked 6682 Read 1 New Done Done true
23429 5684 Acked 6683 Read 7 New Done Done true
23430 5685 Acked 6684 Write 10 New Done Done true
23431 5686 Acked 6685 Read 2 New Done Done true
23432 5687 Acked 6686 Write 10 New Done Done true
23433 5688 Acked 6687 Read 10 New Done Done true
23434 5689 Acked 6688 Read 10 New Done Done true
23435 5690 Acked 6689 Read 4 New Done Done true
23436 5691 Acked 6690 Write 1 New Done Done true
23437 5692 Acked 6691 Read 9 New Done Done true
23438 5693 Acked 6692 Read 3 New Done Done true
23439 5694 Acked 6693 Read 1 New Done Done true
23440 5695 Acked 6694 Read 3 New Done Done true
23441 5696 Acked 6695 Write 4 New Done Done true
23442 5697 Acked 6696 Write 5 New Done Done true
23443 5698 Acked 6697 Read 4 New Done Done true
23444 5699 Acked 6698 Read 1 New Done Done true
23445 5700 Acked 6699 Read 10 New Done Done true
23446 5701 Acked 6700 Write 3 New Done Done true
23447 5702 Acked 6701 Read 9 New Done Done true
23448 5703 Acked 6702 Write 6 New Done Done true
23449 5704 Acked 6703 Write 2 New Done Done true
23450 5705 Acked 6704 Write 8 New Done Done true
23451 5706 Acked 6705 Write 7 New Done Done true
23452 5707 Acked 6706 Flush 0 New Done Done true
23453 5708 Acked 6707 Write 10 New Done Done true
23454 5709 Acked 6708 Write 10 New Done Done true
23455 5710 Acked 6709 Read 7 New Done Done true
23456 5711 Acked 6710 Read 8 New Done Done true
23457 5712 Acked 6711 Read 6 New Done Done true
23458 5713 Acked 6712 Read 1 New Done Done true
23459 5714 Acked 6713 Read 4 New Done Done true
23460 5715 Acked 6714 Read 9 New Done Done true
23461 5716 Acked 6715 Read 2 New Done Done true
23462 5717 Acked 6716 Write 6 New Done Done true
23463 5718 Acked 6717 Read 6 New Done Done true
23464 5719 Acked 6718 Write 9 New Done Done true
23465 5720 Acked 6719 Write 10 New Done Done true
23466 5721 Acked 6720 Write 9 New Done Done true
23467 5722 Acked 6721 Flush 0 New Done Done true
23468 5723 Acked 6722 Read 7 New Done Done true
23469 5724 Acked 6723 Read 5 New Done Done true
23470 5725 Acked 6724 Read 3 New Done Done true
23471 5726 Acked 6725 Read 9 New Done Done true
23472 5727 Acked 6726 Read 8 New Done Done true
23473 5728 Acked 6727 Flush 0 New Done Done true
23474 STATES DS:0 DS:1 DS:2 TOTAL
23475 New 302 0 0 302
23476 Sent 0 0 0 0
23477 Done 0 302 302 604
23478 Skipped 0 0 0 0
23479 Error 0 0 0 0
23480 Last Flush: 6425 6727 6727
23481 Downstairs last five completed: 6425 6424 6423 6422 6421
23482 Upstairs last five completed: 5728 5727 5726 5725 5724
23483 CLIENT: Up:0 ds:302 act:2
23484 ----------------------------------------------------------------
23485 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:302
23486 States: Offline Active Active
23487 GW_ID ACK DSID TYPE BLOCKS DS:0 DS:1 DS:2 REPLAY
23488 5427 Acked 6426 Read 1 New Done Done true
23489 5428 Acked 6427 Write 1 New Done Done true
23490 5429 Acked 6428 Read 2 New Done Done true
23491 5430 Acked 6429 Write 9 New Done Done true
23492 5431 Acked 6430 Write 10 New Done Done true
23493 5432 Acked 6431 Read 6 New Done Done true
23494 5433 Acked 6432 Read 9 New Done Done true
23495 5434 Acked 6433 Write 5 New Done Done true
23496 5435 Acked 6434 Read 1 New Done Done true
23497 5436 Acked 6435 Write 9 New Done Done true
23498 5437 Acked 6436 Read 4 New Done Done true
23499 5438 Acked 6437 Read 5 New Done Done true
23500 5439 Acked 6438 Read 8 New Done Done true
23501 5440 Acked 6439 Write 10 New Done Done true
23502 5441 Acked 6440 Read 4 New Done Done true
23503 5442 Acked 6441 Write 10 New Done Done true
23504 5443 Acked 6442 Flush 0 New Done Done true
23505 5444 Acked 6443 Write 1 New Done Done true
23506 5445 Acked 6444 Read 2 New Done Done true
23507 5446 Acked 6445 Read 6 New Done Done true
23508 5447 Acked 6446 Write 7 New Done Done true
23509 5448 Acked 6447 Write 9 New Done Done true
23510 5449 Acked 6448 Write 10 New Done Done true
23511 5450 Acked 6449 Read 7 New Done Done true
23512 5451 Acked 6450 Read 6 New Done Done true
23513 5452 Acked 6451 Write 7 New Done Done true
23514 5453 Acked 6452 Write 5 New Done Done true
23515 5454 Acked 6453 Write 6 New Done Done true
23516 5455 Acked 6454 Read 4 New Done Done true
23517 5456 Acked 6455 Write 8 New Done Done true
23518 5457 Acked 6456 Read 3 New Done Done true
23519 5458 Acked 6457 Read 5 New Done Done true
23520 5459 Acked 6458 Write 2 New Done Done true
23521 5460 Acked 6459 Read 6 New Done Done true
23522 5461 Acked 6460 Read 5 New Done Done true
23523 5462 Acked 6461 Read 8 New Done Done true
23524 5463 Acked 6462 Write 4 New Done Done true
23525 5464 Acked 6463 Read 8 New Done Done true
23526 5465 Acked 6464 Read 3 New Done Done true
23527 5466 Acked 6465 Write 8 New Done Done true
23528 5467 Acked 6466 Write 4 New Done Done true
23529 5468 Acked 6467 Write 7 New Done Done true
23530 5469 Acked 6468 Write 10 New Done Done true
23531 5470 Acked 6469 Write 1 New Done Done true
23532 5471 Acked 6470 Write 9 New Done Done true
23533 5472 Acked 6471 Write 3 New Done Done true
23534 5473 Acked 6472 Flush 0 New Done Done true
23535 5474 Acked 6473 Write 3 New Done Done true
23536 5475 Acked 6474 Flush 0 New Done Done true
23537 5476 Acked 6475 Read 7 New Done Done true
23538 5477 Acked 6476 Flush 0 New Done Done true
23539 5478 Acked 6477 Read 10 New Done Done true
23540 5479 Acked 6478 Write 10 New Done Done true
23541 5480 Acked 6479 Read 7 New Done Done true
23542 5481 Acked 6480 Write 3 New Done Done true
23543 5482 Acked 6481 Write 7 New Done Done true
23544 5483 Acked 6482 Write 7 New Done Done true
23545 5484 Acked 6483 Read 4 New Done Done true
23546 5485 Acked 6484 Flush 0 New Done Done true
23547 5486 Acked 6485 Write 9 New Done Done true
23548 5487 Acked 6486 Flush 0 New Done Done true
23549 5488 Acked 6487 Read 3 New Done Done true
23550 5489 Acked 6488 Write 5 New Done Done true
23551 5490 Acked 6489 Read 6 New Done Done true
23552 5491 Acked 6490 Read 5 New Done Done true
23553 5492 Acked 6491 Read 5 New Done Done true
23554 5493 Acked 6492 Write 8 New Done Done true
23555 5494 Acked 6493 Read 3 New Done Done true
23556 5495 Acked 6494 Read 5 New Done Done true
23557 5496 Acked 6495 Write 1 New Done Done true
23558 5497 Acked 6496 Write 7 New Done Done true
23559 5498 Acked 6497 Read 1 New Done Done true
23560 5499 Acked 6498 Read 5 New Done Done true
23561 5500 Acked 6499 Read 9 New Done Done true
23562 5501 Acked 6500 Flush 0 New Done Done true
23563 5502 Acked 6501 Read 1 New Done Done true
23564 5503 Acked 6502 Flush 0 New Done Done true
23565 5504 Acked 6503 Write 1 New Done Done true
23566 5505 Acked 6504 Flush 0 New Done Done true
23567 5506 Acked 6505 Write 5 New Done Done true
23568 5507 Acked 6506 Read 1 New Done Done true
23569 5508 Acked 6507 Read 3 New Done Done true
23570 5509 Acked 6508 Read 6 New Done Done true
23571 5510 Acked 6509 Read 8 New Done Done true
23572 5511 Acked 6510 Write 9 New Done Done true
23573 5512 Acked 6511 Read 9 New Done Done true
23574 5513 Acked 6512 Write 7 New Done Done true
23575 5514 Acked 6513 Flush 0 New Done Done true
23576 5515 Acked 6514 Write 8 New Done Done true
23577 5516 Acked 6515 Read 1 New Done Done true
23578 5517 Acked 6516 Read 3 New Done Done true
23579 5518 Acked 6517 Flush 0 New Done Done true
23580 5519 Acked 6518 Write 2 New Done Done true
23581 5520 Acked 6519 Write 7 New Done Done true
23582 5521 Acked 6520 Read 3 New Done Done true
23583 5522 Acked 6521 Read 10 New Done Done true
23584 5523 Acked 6522 Write 4 New Done Done true
23585 5524 Acked 6523 Write 10 New Done Done true
23586 5525 Acked 6524 Read 6 New Done Done true
23587 5526 Acked 6525 Write 6 New Done Done true
23588 5527 Acked 6526 Read 10 New Done Done true
23589 5528 Acked 6527 Read 6 New Done Done true
23590 5529 Acked 6528 Flush 0 New Done Done true
23591 5530 Acked 6529 Read 3 New Done Done true
23592 5531 Acked 6530 Read 1 New Done Done true
23593 5532 Acked 6531 Write 4 New Done Done true
23594 5533 Acked 6532 Flush 0 New Done Done true
23595 5534 Acked 6533 Read 2 New Done Done true
23596 5535 Acked 6534 Read 8 New Done Done true
23597 5536 Acked 6535 Read 5 New Done Done true
23598 5537 Acked 6536 Read 10 New Done Done true
23599 5538 Acked 6537 Read 9 New Done Done true
23600 5539 Acked 6538 Read 3 New Done Done true
23601 5540 Acked 6539 Flush 0 New Done Done true
23602 5541 Acked 6540 Read 7 New Done Done true
23603 5542 Acked 6541 Read 7 New Done Done true
23604 5543 Acked 6542 Read 4 New Done Done true
23605 5544 Acked 6543 Flush 0 New Done Done true
23606 5545 Acked 6544 Read 1 New Done Done true
23607 5546 Acked 6545 Read 1 New Done Done true
23608 5547 Acked 6546 Write 1 New Done Done true
23609 5548 Acked 6547 Read 3 New Done Done true
23610 5549 Acked 6548 Read 2 New Done Done true
23611 5550 Acked 6549 Read 6 New Done Done true
23612 5551 Acked 6550 Read 5 New Done Done true
23613 5552 Acked 6551 Read 9 New Done Done true
23614 5553 Acked 6552 Read 4 New Done Done true
23615 5554 Acked 6553 Read 8 New Done Done true
23616 5555 Acked 6554 Read 1 New Done Done true
23617 5556 Acked 6555 Read 7 New Done Done true
23618 5557 Acked 6556 Read 1 New Done Done true
23619 5558 Acked 6557 Read 10 New Done Done true
23620 5559 Acked 6558 Read 7 New Done Done true
23621 5560 Acked 6559 Read 2 New Done Done true
23622 5561 Acked 6560 Read 8 New Done Done true
23623 5562 Acked 6561 Flush 0 New Done Done true
23624 5563 Acked 6562 Write 6 New Done Done true
23625 5564 Acked 6563 Write 1 New Done Done true
23626 5565 Acked 6564 Read 8 New Done Done true
23627 5566 Acked 6565 Flush 0 New Done Done true
23628 5567 Acked 6566 Read 9 New Done Done true
23629 5568 Acked 6567 Write 6 New Done Done true
23630 5569 Acked 6568 Read 1 New Done Done true
23631 5570 Acked 6569 Write 7 New Done Done true
23632 5571 Acked 6570 Read 5 New Done Done true
23633 5572 Acked 6571 Write 2 New Done Done true
23634 5573 Acked 6572 Write 7 New Done Done true
23635 5574 Acked 6573 Read 10 New Done Done true
23636 5575 Acked 6574 Read 8 New Done Done true
23637 5576 Acked 6575 Read 10 New Done Done true
23638 5577 Acked 6576 Write 6 New Done Done true
23639 5578 Acked 6577 Read 5 New Done Done true
23640 5579 Acked 6578 Read 2 New Done Done true
23641 5580 Acked 6579 Read 6 New Done Done true
23642 5581 Acked 6580 Write 7 New Done Done true
23643 5582 Acked 6581 Write 1 New Done Done true
23644 5583 Acked 6582 Write 7 New Done Done true
23645 5584 Acked 6583 Write 4 New Done Done true
23646 5585 Acked 6584 Write 8 New Done Done true
23647 5586 Acked 6585 Write 3 New Done Done true
23648 5587 Acked 6586 Write 6 New Done Done true
23649 5588 Acked 6587 Write 3 New Done Done true
23650 5589 Acked 6588 Read 10 New Done Done true
23651 5590 Acked 6589 Write 7 New Done Done true
23652 5591 Acked 6590 Write 7 New Done Done true
23653 5592 Acked 6591 Read 10 New Done Done true
23654 5593 Acked 6592 Flush 0 New Done Done true
23655 5594 Acked 6593 Write 9 New Done Done true
23656 5595 Acked 6594 Read 1 New Done Done true
23657 5596 Acked 6595 Read 8 New Done Done true
23658 5597 Acked 6596 Write 2 New Done Done true
23659 5598 Acked 6597 Read 2 New Done Done true
23660 5599 Acked 6598 Read 10 New Done Done true
23661 5600 Acked 6599 Read 8 New Done Done true
23662 5601 Acked 6600 Write 8 New Done Done true
23663 5602 Acked 6601 Read 4 New Done Done true
23664 5603 Acked 6602 Write 8 New Done Done true
23665 5604 Acked 6603 Write 5 New Done Done true
23666 5605 Acked 6604 Read 3 New Done Done true
23667 5606 Acked 6605 Read 7 New Done Done true
23668 5607 Acked 6606 Read 9 New Done Done true
23669 5608 Acked 6607 Read 5 New Done Done true
23670 5609 Acked 6608 Read 1 New Done Done true
23671 5610 Acked 6609 Write 1 New Done Done true
23672 5611 Acked 6610 Write 5 New Done Done true
23673 5612 Acked 6611 Write 6 New Done Done true
23674 5613 Acked 6612 Write 3 New Done Done true
23675 5614 Acked 6613 Flush 0 New Done Done true
23676 5615 Acked 6614 Read 7 New Done Done true
23677 5616 Acked 6615 Read 6 New Done Done true
23678 5617 Acked 6616 Read 5 New Done Done true
23679 5618 Acked 6617 Write 6 New Done Done true
23680 5619 Acked 6618 Flush 0 New Done Done true
23681 5620 Acked 6619 Read 7 New Done Done true
23682 5621 Acked 6620 Write 10 New Done Done true
23683 5622 Acked 6621 Read 7 New Done Done true
23684 5623 Acked 6622 Write 6 New Done Done true
23685 5624 Acked 6623 Write 8 New Done Done true
23686 5625 Acked 6624 Read 2 New Done Done true
23687 5626 Acked 6625 Read 7 New Done Done true
23688 5627 Acked 6626 Write 4 New Done Done true
23689 5628 Acked 6627 Write 1 New Done Done true
23690 5629 Acked 6628 Read 6 New Done Done true
23691 5630 Acked 6629 Write 6 New Done Done true
23692 5631 Acked 6630 Write 6 New Done Done true
23693 5632 Acked 6631 Read 1 New Done Done true
23694 5633 Acked 6632 Write 6 New Done Done true
23695 5634 Acked 6633 Write 1 New Done Done true
23696 5635 Acked 6634 Read 9 New Done Done true
23697 5636 Acked 6635 Read 7 New Done Done true
23698 5637 Acked 6636 Read 1 New Done Done true
23699 5638 Acked 6637 Write 10 New Done Done true
23700 5639 Acked 6638 Write 10 New Done Done true
23701 5640 Acked 6639 Write 8 New Done Done true
23702 5641 Acked 6640 Read 10 New Done Done true
23703 5642 Acked 6641 Read 3 New Done Done true
23704 5643 Acked 6642 Write 10 New Done Done true
23705 5644 Acked 6643 Write 3 New Done Done true
23706 5645 Acked 6644 Read 6 New Done Done true
23707 5646 Acked 6645 Read 2 New Done Done true
23708 5647 Acked 6646 Flush 0 New Done Done true
23709 5648 Acked 6647 Flush 0 New Done Done true
23710 5649 Acked 6648 Read 3 New Done Done true
23711 5650 Acked 6649 Read 3 New Done Done true
23712 5651 Acked 6650 Flush 0 New Done Done true
23713 5652 Acked 6651 Read 7 New Done Done true
23714 5653 Acked 6652 Write 5 New Done Done true
23715 5654 Acked 6653 Read 1 New Done Done true
23716 5655 Acked 6654 Read 10 New Done Done true
23717 5656 Acked 6655 Write 1 New Done Done true
23718 5657 Acked 6656 Read 4 New Done Done true
23719 5658 Acked 6657 Write 8 New Done Done true
23720 5659 Acked 6658 Read 10 New Done Done true
23721 5660 Acked 6659 Write 6 New Done Done true
23722 5661 Acked 6660 Read 2 New Done Done true
23723 5662 Acked 6661 Read 5 New Done Done true
23724 5663 Acked 6662 Write 5 New Done Done true
23725 5664 Acked 6663 Write 10 New Done Done true
23726 5665 Acked 6664 Read 9 New Done Done true
23727 5666 Acked 6665 Read 9 New Done Done true
23728 5667 Acked 6666 Write 6 New Done Done true
23729 5668 Acked 6667 Read 1 New Done Done true
23730 5669 Acked 6668 Read 6 New Done Done true
23731 5670 Acked 6669 Write 6 New Done Done true
23732 5671 Acked 6670 Read 2 New Done Done true
23733 5672 Acked 6671 Write 1 New Done Done true
23734 5673 Acked 6672 Read 2 New Done Done true
23735 5674 Acked 6673 Write 4 New Done Done true
23736 5675 Acked 6674 Flush 0 New Done Done true
23737 5676 Acked 6675 Read 10 New Done Done true
23738 5677 Acked 6676 Flush 0 New Done Done true
23739 5678 Acked 6677 Write 10 New Done Done true
23740 5679 Acked 6678 Write 1 New Done Done true
23741 5680 Acked 6679 Read 7 New Done Done true
23742 5681 Acked 6680 Read 7 New Done Done true
23743 5682 Acked 6681 Write 7 New Done Done true
23744 5683 Acked 6682 Read 1 New Done Done true
23745 5684 Acked 6683 Read 7 New Done Done true
23746 5685 Acked 6684 Write 10 New Done Done true
23747 5686 Acked 6685 Read 2 New Done Done true
23748 5687 Acked 6686 Write 10 New Done Done true
23749 5688 Acked 6687 Read 10 New Done Done true
23750 5689 Acked 6688 Read 10 New Done Done true
23751 5690 Acked 6689 Read 4 New Done Done true
23752 5691 Acked 6690 Write 1 New Done Done true
23753 5692 Acked 6691 Read 9 New Done Done true
23754 5693 Acked 6692 Read 3 New Done Done true
23755 5694 Acked 6693 Read 1 New Done Done true
23756 5695 Acked 6694 Read 3 New Done Done true
23757 5696 Acked 6695 Write 4 New Done Done true
23758 5697 Acked 6696 Write 5 New Done Done true
23759 5698 Acked 6697 Read 4 New Done Done true
23760 5699 Acked 6698 Read 1 New Done Done true
23761 5700 Acked 6699 Read 10 New Done Done true
23762 5701 Acked 6700 Write 3 New Done Done true
23763 5702 Acked 6701 Read 9 New Done Done true
23764 5703 Acked 6702 Write 6 New Done Done true
23765 5704 Acked 6703 Write 2 New Done Done true
23766 5705 Acked 6704 Write 8 New Done Done true
23767 5706 Acked 6705 Write 7 New Done Done true
23768 5707 Acked 6706 Flush 0 New Done Done true
23769 5708 Acked 6707 Write 10 New Done Done true
23770 5709 Acked 6708 Write 10 New Done Done true
23771 5710 Acked 6709 Read 7 New Done Done true
23772 5711 Acked 6710 Read 8 New Done Done true
23773 5712 Acked 6711 Read 6 New Done Done true
23774 5713 Acked 6712 Read 1 New Done Done true
23775 5714 Acked 6713 Read 4 New Done Done true
23776 5715 Acked 6714 Read 9 New Done Done true
23777 5716 Acked 6715 Read 2 New Done Done true
23778 5717 Acked 6716 Write 6 New Done Done true
23779 5718 Acked 6717 Read 6 New Done Done true
23780 5719 Acked 6718 Write 9 New Done Done true
23781 5720 Acked 6719 Write 10 New Done Done true
23782 5721 Acked 6720 Write 9 New Done Done true
23783 5722 Acked 6721 Flush 0 New Done Done true
23784 5723 Acked 6722 Read 7 New Done Done true
23785 5724 Acked 6723 Read 5 New Done Done true
23786 5725 Acked 6724 Read 3 New Done Done true
23787 5726 Acked 6725 Read 9 New Done Done true
23788 5727 Acked 6726 Read 8 New Done Done true
23789 5728 Acked 6727 Flush 0 New Done Done true
23790 STATES DS:0 DS:1 DS:2 TOTAL
23791 New 302 0 0 302
23792 Sent 0 0 0 0
23793 Done 0 302 302 604
23794 Skipped 0 0 0 0
23795 Error 0 0 0 0
23796 Last Flush: 6425 6727 6727
23797 Downstairs last five completed: 6425 6424 6423 6422 6421
23798 Upstairs last five completed: 5728 5727 5726 5725 5724
23799 CLIENT: Up:0 ds:302 act:2
238002024-04-20T01:10:05.821ZINFOcrucible: connecting to 127.0.0.1:8810 = io task client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
238012024-04-20T01:10:05.821ZINFOcrucible: ds_connection connected from Ok(127.0.0.1:37400) = io task client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
238022024-04-20T01:10:05.822ZINFOcrucible: downstairs client at Some(127.0.0.1:8810) has region UUID 12345678-0000-0000-0000-000000008810 = downstairs client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
238032024-04-20T01:10:05.822ZINFOcrucible: Returning UUID:12345678-0000-0000-0000-000000008810 matches = downstairs client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
238042024-04-20T01:10:05.822ZINFOcrucible: send last flush ID to this DS: 6425 = downstairs client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
238052024-04-20T01:10:05.822ZINFOcrucible: Replied this last flush ID: 6425 = downstairs client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
238062024-04-20T01:10:05.823ZINFOcrucible: ds_transition from Offline to Replay = downstairs client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
238072024-04-20T01:10:05.823ZINFOcrucible: [0] Transition from Offline to Replay = downstairs client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
238082024-04-20T01:10:05.823ZINFOcrucible: ds_transition from Replay to Active = downstairs client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
238092024-04-20T01:10:05.823ZINFOcrucible: [0] Transition from Replay to Active = downstairs client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
23810 ----------------------------------------------------------------
23811 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:0
23812 Downstairs last five completed: 6727 6726 6725 6724 6723
23813 Upstairs last five completed: 5728 5727 5726 5725 5724
23814 CLIENT: Up:0 ds:0 act:3
23815 Replay: All jobs finished, all DS active.
23816 Main task has work to do, go find it
23817 got dsc Stop(0)
23818 stop 0
23819 Apr 20 01:10:06.137 INFO request completed[8810] Got stop action so:false kr:false
23820 , latency_us: 341, response_code: 204, uri: /stop/cid/0, method: POST, req_id: 988a3b64-5f37-427b-97b9-6d18779e6cb1, remote_addr: 127.0.0.1:60352, local_addr: 127.0.0.1:9998
238212024-04-20T01:10:06.137ZWARNcrucible: downstairs disconnected = io task client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
238222024-04-20T01:10:06.137ZWARNcrucible: client task is sending Done(Finished) = io task client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
238232024-04-20T01:10:06.137ZWARNcrucible: downstairs task for 0 stopped due to Finished session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
238242024-04-20T01:10:06.138ZINFOcrucible: Gone missing, transition from Active to Offline = downstairs client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
23825 Apr 20 01:10:06.138 INFO request completed, latency_us: 133, response_code: 200, uri: /state/cid/0, method: GET, req_id: b46b4ba0-31dd-4166-8c39-07f513e32b44, remote_addr: 127.0.0.1:60352, local_addr: 127.0.0.1:9998
238262024-04-20T01:10:06.138ZINFOcrucible: [0] client re-new 0 jobs since flush 6727 = downstairs session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
238272024-04-20T01:10:06.138ZINFOcrucible: [0] Marked 0 jobs for replay since flush: 6727 = downstairs session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
238282024-04-20T01:10:06.138ZINFOcrucible: client task is exiting = io task client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
23829 [8810] Exited with: ExitStatus(unix_wait_status(9))
23830 [8810][0] reports Exit
23831 Apr 20 01:10:10.139 INFO request completed, latency_us: 182, response_code: 200, uri: /state/cid/0, method: GET, req_id: 691bbcfa-b54e-4b16-af0f-1d9788acd8f6, remote_addr: 127.0.0.1:60352, local_addr: 127.0.0.1:9998
23832 001/300 Read block 183 len 24576
23833 002/300 Read block 1520 len 28672
23834 003/300 Write block 463 len 32768 data: 3 3 3 5 6 5 6 5
23835 004/300 Read block 3886 len 24576
23836 005/300 Flush
23837 006/300 Write block 309 len 24576 data: 3 4 4 4 4 4
23838 007/300 Write block 3015 len 36864 data: 5 5 5 5 5 5 6 6 7
23839 008/300 Read block 4319 len 24576
23840 009/300 Read block 665 len 24576
23841 010/300 Read block 4578 len 20480
23842 011/300 Read block 952 len 24576
23843 012/300 Read block 4519 len 20480
23844 013/300 Read block 4383 len 36864
23845 014/300 Read block 2108 len 40960
23846 015/300 Read block 871 len 40960
23847 016/300 Write block 2890 len 16384 data: 6 6 6 4
23848 017/300 Read block 24 len 36864
23849 018/300 Write block 4824 len 12288 data: 6 7 7
23850 019/300 Write block 4309 len 8192 data: 7 6
23851 020/300 Write block 197 len 40960 data: 3 3 3 4 4 4 4 4 4 4
23852 021/300 Read block 2504 len 40960
23853 022/300 Write block 1959 len 8192 data: 5 5
23854 023/300 Write block 3117 len 8192 data: 6 6
23855 024/300 Read block 715 len 28672
23856 025/300 Write block 3789 len 8192 data: 9 7
23857 026/300 Flush
23858 027/300 Read block 1362 len 4096
23859 028/300 Write block 3493 len 40960 data: 6 7 5 5 5 5 5 5 5 4
23860 029/300 Read block 2154 len 16384
23861 030/300 Read block 2462 len 28672
23862 031/300 Read block 200 len 40960
23863 032/300 Write block 1936 len 28672 data: 3 2 4 4 5 5 4
23864 033/300 Flush
23865 034/300 Read block 4019 len 8192
23866 035/300 Read block 459 len 32768
23867 036/300 Flush
23868 037/300 Write block 3868 len 16384 data: 5 5 6 5
23869 038/300 Write block 686 len 40960 data: 6 4 5 5 6 6 6 7 7 5
23870 039/300 Read block 2338 len 16384
23871 040/300 Read block 4459 len 28672
23872 041/300 Read block 2608 len 4096
23873 042/300 Read block 447 len 4096
23874 043/300 Write block 4389 len 12288 data: 3 3 3
23875 044/300 Write block 3338 len 32768 data: 2 4 4 4 5 5 4 4
23876 045/300 Read block 650 len 4096
23877 046/300 Read block 4248 len 24576
23878 047/300 Write block 4073 len 40960 data: 6 7 7 8 8 9 10 12 10 8
23879 048/300 Read block 3784 len 36864
23880 049/300 Write block 3798 len 32768 data: 6 5 6 6 6 5 4 3
23881 050/300 Write block 2636 len 28672 data: 5 5 5 4 4 6 6
23882 051/300 Flush
23883 052/300 Read block 1606 len 16384
23884 053/300 Write block 4566 len 32768 data: 4 4 6 6 7 7 7 5
23885 054/300 Read block 1517 len 4096
23886 055/300 Read block 889 len 4096
23887 056/300 Write block 4863 len 16384 data: 4 3 3 3
23888 057/300 Flush
23889 058/300 Read block 97 len 28672
23890 059/300 Write block 880 len 12288 data: 4 3 2
23891 060/300 Read block 1762 len 20480
23892 061/300 Read block 3252 len 4096
23893 062/300 Read block 844 len 32768
23894 063/300 Write block 4606 len 40960 data: 3 4 3 2 2 2 2 2 2 3
23895 064/300 Flush
23896 065/300 Read block 598 len 4096
23897 066/300 Read block 4695 len 4096
23898 067/300 Read block 1460 len 36864
23899 068/300 Read block 3716 len 28672
23900 069/300 Write block 3892 len 24576 data: 3 3 3 3 3 4
23901 070/300 Read block 3526 len 40960
23902 071/300 Read block 4706 len 4096
23903 072/300 Write block 2611 len 36864 data: 4 3 3 3 3 5 5 5 6
23904 073/300 Read block 4376 len 4096
23905 074/300 Read block 819 len 32768
23906 075/300 Write block 4653 len 36864 data: 4 3 4 6 6 4 4 3 3
23907 076/300 Write block 853 len 12288 data: 4 3 3
23908 077/300 Write block 4860 len 32768 data: 5 7 6 5 4 4 4 5
23909 078/300 Write block 929 len 36864 data: 2 2 2 2 2 3 4 4 4
23910 079/300 Flush
23911 080/300 Read block 3224 len 40960
23912 081/300 Flush
23913 082/300 Write block 4556 len 16384 data: 4 4 4 5
23914 083/300 Flush
23915 084/300 Write block 1431 len 24576 data: 4 4 4 4 5 5
23916 085/300 Read block 4500 len 40960
23917 086/300 Read block 1013 len 20480
23918 087/300 Write block 1850 len 32768 data: 5 5 5 6 5 5 4 5
23919 088/300 Read block 3648 len 28672
23920 089/300 Read block 546 len 12288
23921 090/300 Read block 363 len 28672
23922 091/300 Read block 481 len 24576
23923 092/300 Read block 2241 len 28672
23924 093/300 Read block 1800 len 4096
23925 094/300 Read block 4461 len 24576
23926 095/300 Read block 1392 len 4096
23927 096/300 Write block 1907 len 4096 data: 3
23928 097/300 Read block 1941 len 36864
23929 098/300 Read block 4313 len 32768
23930 099/300 Write block 1720 len 32768 data: 4 4 4 4 4 4 4 4
23931 100/300 Write block 1155 len 32768 data: 6 5 5 3 2 3 3 4
23932 101/300 Write block 3774 len 36864 data: 4 4 4 3 3 3 3 4 3
23933 102/300 Read block 3091 len 40960
23934 103/300 Flush
23935 104/300 Read block 4713 len 24576
23936 105/300 Read block 4429 len 16384
23937 106/300 Write block 412 len 36864 data: 5 5 6 6 5 5 5 4 4
23938 107/300 Write block 1798 len 36864 data: 5 5 4 5 5 5 7 4 4
23939 108/300 Read block 867 len 8192
23940 109/300 Write block 3697 len 32768 data: 3 4 3 3 5 5 5 6
23941 110/300 Write block 1213 len 40960 data: 5 5 4 4 5 4 4 3 4 3
23942 111/300 Read block 2171 len 12288
23943 112/300 Read block 1224 len 12288
23944 113/300 Write block 92 len 12288 data: 5 5 5
23945 114/300 Read block 94 len 24576
23946 115/300 Read block 2783 len 4096
23947 116/300 Read block 936 len 8192
23948 117/300 Flush
23949 118/300 Read block 503 len 28672
23950 119/300 Read block 4978 len 28672
23951 120/300 Read block 1082 len 36864
23952 121/300 Write block 2904 len 40960 data: 5 4 6 5 4 4 5 5 6 4
23953 122/300 Write block 1988 len 24576 data: 6 6 6 4 3 3
23954 123/300 Read block 1918 len 8192
23955 124/300 Read block 1761 len 4096
23956 125/300 Read block 993 len 40960
23957 126/300 Read block 221 len 20480
23958 127/300 Write block 1056 len 36864 data: 6 6 5 6 5 5 5 4 4
23959 128/300 Read block 130 len 16384
23960 129/300 Write block 91 len 36864 data: 6 6 6 6 5 5 5 5 4
23961 130/300 Read block 1021 len 36864
23962 131/300 Read block 4993 len 24576
23963 132/300 Write block 3378 len 20480 data: 4 4 5 5 5
23964 133/300 Read block 1883 len 20480
23965 134/300 Write block 3113 len 28672 data: 4 4 4 6 7 7 5
23966 135/300 Read block 2336 len 16384
23967 136/300 Flush
23968 137/300 Write block 2311 len 40960 data: 5 7 7 6 6 6 5 6 5 5
23969 138/300 Read block 1719 len 4096
23970 139/300 Read block 3259 len 8192
23971 140/300 Read block 1103 len 36864
23972 141/300 Read block 1038 len 40960
23973 142/300 Write block 3737 len 4096 data: 5
23974 143/300 Read block 4606 len 24576
23975 144/300 Read block 3987 len 40960
23976 145/300 Read block 1869 len 32768
23977 146/300 Read block 4527 len 40960
23978 147/300 Read block 3140 len 4096
23979 148/300 Write block 236 len 28672 data: 3 3 3 4 4 3 3
23980 149/300 Write block 4677 len 24576 data: 6 6 6 3 4 5
23981 150/300 Read block 4044 len 8192
23982 151/300 Read block 2411 len 4096
23983 152/300 Flush
23984 153/300 Flush
23985 154/300 Write block 4892 len 24576 data: 4 4 4 3 4 3
23986 155/300 Read block 2662 len 4096
23987 156/300 Read block 4748 len 40960
23988 157/300 Write block 3127 len 20480 data: 4 5 6 6 4
23989 158/300 Write block 2002 len 36864 data: 4 5 5 6 6 7 8 6 7
23990 159/300 Read block 1250 len 12288
23991 160/300 Read block 1316 len 28672
23992 161/300 Read block 2385 len 40960
23993 162/300 Write block 737 len 24576 data: 7 6 5 5 5 4
23994 163/300 Write block 721 len 8192 data: 4 5
23995 164/300 Write block 4840 len 36864 data: 4 5 5 6 6 5 6 5 5
23996 165/300 Write block 1441 len 4096 data: 9
23997 166/300 Read block 496 len 32768
23998 167/300 Read block 2224 len 4096
23999 168/300 Write block 4483 len 4096 data: 7
24000 169/300 Write block 2218 len 32768 data: 3 4 4 5 5 4 4 5
24001 170/300 Flush
24002 171/300 Read block 2992 len 28672
24003 172/300 Read block 3256 len 36864
24004 173/300 Read block 494 len 8192
24005 174/300 Read block 20 len 12288
24006 175/300 Read block 1829 len 24576
24007 176/300 Read block 2734 len 4096
24008 177/300 Write block 2119 len 24576 data: 4 3 4 3 4 5
24009 178/300 Write block 4636 len 24576 data: 4 4 3 3 2 2
24010 179/300 Read block 4375 len 36864
24011 180/300 Flush
24012 181/300 Read block 535 len 8192
24013 182/300 Flush
24014 183/300 Write block 4941 len 8192 data: 4 5
24015 184/300 Write block 4568 len 24576 data: 7 7 8 8 8 6
24016 185/300 Read block 1139 len 36864
24017 186/300 Read block 1084 len 40960
24018 187/300 Read block 4743 len 36864
24019 188/300 Write block 3335 len 36864 data: 3 2 2 3 5 5 5 6 6
24020 189/300 Read block 4664 len 12288
24021 190/300 Write block 4869 len 28672 data: 6 5 6 6 8 8 9
24022 191/300 Read block 2061 len 28672
24023 192/300 Write block 918 len 28672 data: 3 4 4 3 3 3 4
24024 193/300 Read block 1413 len 40960
24025 194/300 Read block 246 len 32768
24026 195/300 Read block 3977 len 12288
24027 196/300 Write block 367 len 16384 data: 5 5 3 3
24028 197/300 Read block 1195 len 24576
24029 198/300 Read block 2046 len 24576
24030 199/300 Read block 677 len 16384
24031 200/300 Read block 1181 len 28672
24032 201/300 Write block 2874 len 28672 data: 4 4 4 4 4 4 4
24033 202/300 Write block 2528 len 24576 data: 4 4 4 4 4 3
24034 203/300 Flush
24035 204/300 Flush
24036 205/300 Read block 3476 len 20480
24037 206/300 Read block 931 len 8192
24038 207/300 Flush
24039 208/300 Read block 3202 len 24576
24040 209/300 Write block 703 len 8192 data: 3 3
24041 210/300 Write block 657 len 8192 data: 6 5
24042 211/300 Write block 1015 len 16384 data: 3 3 2 3
24043 212/300 Read block 2139 len 16384
24044 213/300 Write block 324 len 12288 data: 6 8 7
24045 214/300 Flush
24046 215/300 Flush
24047 216/300 Read block 4267 len 28672
24048 217/300 Read block 910 len 8192
24049 218/300 Read block 1510 len 8192
24050 219/300 Read block 2376 len 24576
24051 220/300 Read block 4784 len 12288
24052 221/300 Read block 2876 len 12288
24053 222/300 Read block 2655 len 4096
24054 223/300 Read block 3449 len 20480
24055 224/300 Write block 3009 len 20480 data: 9 9 8 6 3
24056 225/300 Write block 4945 len 28672 data: 4 5 6 7 6 7 8
24057 226/300 Read block 1852 len 20480
24058 227/300 Read block 234 len 4096
24059 228/300 Write block 959 len 32768 data: 3 3 3 3 4 6 6 5
24060 229/300 Read block 3942 len 4096
24061 230/300 Read block 2106 len 28672
24062 231/300 Read block 3070 len 28672
24063 232/300 Read block 4710 len 36864
24064 233/300 Read block 2001 len 28672
24065 234/300 Write block 3624 len 4096 data: 2
24066 235/300 Read block 645 len 8192
24067 236/300 Read block 4664 len 40960
24068 237/300 Write block 3453 len 28672 data: 3 3 4 5 5 6 5
24069 238/300 Read block 1433 len 24576
24070 239/300 Read block 1611 len 16384
24071 240/300 Flush
24072 241/300 Read block 3732 len 24576
24073 242/300 Read block 1170 len 36864
24074 243/300 Read block 4098 len 36864
24075 244/300 Read block 157 len 16384
24076 245/300 Write block 174 len 12288 data: 3 4 4
24077 246/300 Flush
24078 247/300 Read block 2446 len 12288
24079 248/300 Read block 1072 len 12288
24080 249/300 Read block 484 len 8192
24081 250/300 Read block 749 len 40960
24082 251/300 Read block 1936 len 12288
24083 252/300 Read block 4007 len 40960
24084 253/300 Write block 202 len 8192 data: 5 5
24085 254/300 Write block 3866 len 40960 data: 7 6 6 6 7 6 4 3 4 4
24086 255/300 Write block 3892 len 4096 data: 4
24087 256/300 Read block 4441 len 4096
24088 257/300 Write block 752 len 8192 data: 5 4
24089 258/300 Write block 4059 len 32768 data: 2 2 2 3 3 4 4 3
24090 259/300 Write block 3176 len 28672 data: 2 3 4 4 4 4 5
24091 260/300 Write block 2263 len 16384 data: 4 5 5 3
24092 261/300 Read block 2539 len 28672
24093 262/300 Write block 153 len 8192 data: 3 3
24094 263/300 Read block 1428 len 28672
24095 264/300 Read block 2153 len 28672
24096 265/300 Read block 4256 len 32768
24097 266/300 Write block 8 len 32768 data: 3 4 4 3 5 6 6 6
24098 267/300 Read block 2356 len 32768
24099 268/300 Read block 2406 len 36864
24100 269/300 Write block 1872 len 12288 data: 4 2 4
24101 270/300 Write block 4242 len 20480 data: 5 5 5 7 8
24102 271/300 Write block 573 len 4096 data: 7
24103 272/300 Write block 189 len 24576 data: 4 4 4 5 5 4
24104 273/300 Read block 1370 len 32768
24105 274/300 Write block 1101 len 40960 data: 7 7 6 5 4 5 4 4 2 3
24106 275/300 Flush
24107 276/300 Write block 38 len 40960 data: 4 5 5 4 4 5 4 4 4 2
24108 277/300 Write block 3886 len 36864 data: 6 5 5 3 3 4 5 4 4
24109 278/300 Read block 34 len 16384
24110 279/300 Read block 4487 len 12288
24111 280/300 Write block 4788 len 24576 data: 4 4 3 3 3 3
24112 281/300 Write block 2068 len 8192 data: 7 7
24113 282/300 Write block 3673 len 8192 data: 3 4
24114 283/300 Write block 1780 len 32768 data: 4 4 5 5 6 4 4 3
24115 284/300 Write block 1835 len 20480 data: 6 5 4 4 4
24116 285/300 Write block 1412 len 8192 data: 4 4
24117 286/300 Read block 3054 len 36864
24118 287/300 Write block 1213 len 20480 data: 6 6 5 5 6
24119 288/300 Read block 2013 len 4096
24120 289/300 Flush
24121 290/300 Read block 1276 len 28672
24122 291/300 Write block 466 len 4096 data: 6
24123 292/300 Read block 3471 len 16384
24124 293/300 Read block 3712 len 4096
24125 294/300 Read block 2183 len 28672
24126 295/300 Write block 1552 len 4096 data: 6
24127 296/300 Read block 86 len 20480
24128 297/300 Read block 2544 len 24576
24129 298/300 Read block 3693 len 40960
24130 299/300 Write block 877 len 16384 data: 6 5 4 5
24131 300/300 Read block 4224 len 8192
24132 Main task has work to do, go find it
24133 got dsc Start(0)
24134 start 0
24135 Apr 20 01:10:10.439 INFO request completed, latency_us: 199, response_code: 204, uri: /start/cid/0, method: POST, req_id: e2f482ab-5543-4306-8e39-f00bd9f6ad2d, remote_addr: 127.0.0.1:60352, local_addr: 127.0.0.1:9998
24136 Replay: started 0, returned:Ok(())
24137 ----------------------------------------------------------------
24138 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:300
24139 States: Offline Active Active
24140 GW_ID ACK DSID TYPE BLOCKS DS:0 DS:1 DS:2 REPLAY
24141 5729 Acked 6728 Read 6 New Done Done false
24142 5730 Acked 6729 Read 7 New Done Done false
24143 5731 Acked 6730 Write 8 New Done Done false
24144 5732 Acked 6731 Read 6 New Done Done false
24145 5733 Acked 6732 Flush 0 New Done Done false
24146 5734 Acked 6733 Write 6 New Done Done false
24147 5735 Acked 6734 Write 9 New Done Done false
24148 5736 Acked 6735 Read 6 New Done Done false
24149 5737 Acked 6736 Read 6 New Done Done false
24150 5738 Acked 6737 Read 5 New Done Done false
24151 5739 Acked 6738 Read 6 New Done Done false
24152 5740 Acked 6739 Read 5 New Done Done false
24153 5741 Acked 6740 Read 9 New Done Done false
24154 5742 Acked 6741 Read 10 New Done Done false
24155 5743 Acked 6742 Read 10 New Done Done false
24156 5744 Acked 6743 Write 4 New Done Done false
24157 5745 Acked 6744 Read 9 New Done Done false
24158 5746 Acked 6745 Write 3 New Done Done false
24159 5747 Acked 6746 Write 2 New Done Done false
24160 5748 Acked 6747 Write 10 New Done Done false
24161 5749 Acked 6748 Read 10 New Done Done false
24162 5750 Acked 6749 Write 2 New Done Done false
24163 5751 Acked 6750 Write 2 New Done Done false
24164 5752 Acked 6751 Read 7 New Done Done false
24165 5753 Acked 6752 Write 2 New Done Done false
24166 5754 Acked 6753 Flush 0 New Done Done false
24167 5755 Acked 6754 Read 1 New Done Done false
24168 5756 Acked 6755 Write 10 New Done Done false
24169 5757 Acked 6756 Read 4 New Done Done false
24170 5758 Acked 6757 Read 7 New Done Done false
24171 5759 Acked 6758 Read 10 New Done Done false
24172 5760 Acked 6759 Write 7 New Done Done false
24173 5761 Acked 6760 Flush 0 New Done Done false
24174 5762 Acked 6761 Read 2 New Done Done false
24175 5763 Acked 6762 Read 8 New Done Done false
24176 5764 Acked 6763 Flush 0 New Done Done false
24177 5765 Acked 6764 Write 4 New Done Done false
24178 5766 Acked 6765 Write 10 New Done Done false
24179 5767 Acked 6766 Read 4 New Done Done false
24180 5768 Acked 6767 Read 7 New Done Done false
24181 5769 Acked 6768 Read 1 New Done Done false
24182 5770 Acked 6769 Read 1 New Done Done false
24183 5771 Acked 6770 Write 3 New Done Done false
24184 5772 Acked 6771 Write 8 New Done Done false
24185 5773 Acked 6772 Read 1 New Done Done false
24186 5774 Acked 6773 Read 6 New Done Done false
24187 5775 Acked 6774 Write 10 New Done Done false
24188 5776 Acked 6775 Read 9 New Done Done false
24189 5777 Acked 6776 Write 8 New Done Done false
24190 5778 Acked 6777 Write 7 New Done Done false
24191 5779 Acked 6778 Flush 0 New Done Done false
24192 5780 Acked 6779 Read 4 New Done Done false
24193 5781 Acked 6780 Write 8 New Done Done false
24194 5782 Acked 6781 Read 1 New Done Done false
24195 5783 Acked 6782 Read 1 New Done Done false
24196 5784 Acked 6783 Write 4 New Done Done false
24197 5785 Acked 6784 Flush 0 New Done Done false
24198 5786 Acked 6785 Read 7 New Done Done false
24199 5787 Acked 6786 Write 3 New Done Done false
24200 5788 Acked 6787 Read 5 New Done Done false
24201 5789 Acked 6788 Read 1 New Done Done false
24202 5790 Acked 6789 Read 8 New Done Done false
24203 5791 Acked 6790 Write 10 New Done Done false
24204 5792 Acked 6791 Flush 0 New Done Done false
24205 5793 Acked 6792 Read 1 New Done Done false
24206 5794 Acked 6793 Read 1 New Done Done false
24207 5795 Acked 6794 Read 9 New Done Done false
24208 5796 Acked 6795 Read 7 New Done Done false
24209 5797 Acked 6796 Write 6 New Done Done false
24210 5798 Acked 6797 Read 10 New Done Done false
24211 5799 Acked 6798 Read 1 New Done Done false
24212 5800 Acked 6799 Write 9 New Done Done false
24213 5801 Acked 6800 Read 1 New Done Done false
24214 5802 Acked 6801 Read 8 New Done Done false
24215 5803 Acked 6802 Write 9 New Done Done false
24216 5804 Acked 6803 Write 3 New Done Done false
24217 5805 Acked 6804 Write 8 New Done Done false
24218 5806 Acked 6805 Write 9 New Done Done false
24219 5807 Acked 6806 Flush 0 New Done Done false
24220 5808 Acked 6807 Read 10 New Done Done false
24221 5809 Acked 6808 Flush 0 New Done Done false
24222 5810 Acked 6809 Write 4 New Done Done false
24223 5811 Acked 6810 Flush 0 New Done Done false
24224 5812 Acked 6811 Write 6 New Done Done false
24225 5813 Acked 6812 Read 10 New Done Done false
24226 5814 Acked 6813 Read 5 New Done Done false
24227 5815 Acked 6814 Write 8 New Done Done false
24228 5816 Acked 6815 Read 7 New Done Done false
24229 5817 Acked 6816 Read 3 New Done Done false
24230 5818 Acked 6817 Read 7 New Done Done false
24231 5819 Acked 6818 Read 6 New Done Done false
24232 5820 Acked 6819 Read 7 New Done Done false
24233 5821 Acked 6820 Read 1 New Done Done false
24234 5822 Acked 6821 Read 6 New Done Done false
24235 5823 Acked 6822 Read 1 New Done Done false
24236 5824 Acked 6823 Write 1 New Done Done false
24237 5825 Acked 6824 Read 9 New Done Done false
24238 5826 Acked 6825 Read 8 New Done Done false
24239 5827 Acked 6826 Write 8 New Done Done false
24240 5828 Acked 6827 Write 8 New Done Done false
24241 5829 Acked 6828 Write 9 New Done Done false
24242 5830 Acked 6829 Read 10 New Done Done false
24243 5831 Acked 6830 Flush 0 New Done Done false
24244 5832 Acked 6831 Read 6 New Done Done false
24245 5833 Acked 6832 Read 4 New Done Done false
24246 5834 Acked 6833 Write 9 New Done Done false
24247 5835 Acked 6834 Write 9 New Done Done false
24248 5836 Acked 6835 Read 2 New Done Done false
24249 5837 Acked 6836 Write 8 New Done Done false
24250 5838 Acked 6837 Write 10 New Done Done false
24251 5839 Acked 6838 Read 3 New Done Done false
24252 5840 Acked 6839 Read 3 New Done Done false
24253 5841 Acked 6840 Write 3 New Done Done false
24254 5842 Acked 6841 Read 6 New Done Done false
24255 5843 Acked 6842 Read 1 New Done Done false
24256 5844 Acked 6843 Read 2 New Done Done false
24257 5845 Acked 6844 Flush 0 New Done Done false
24258 5846 Acked 6845 Read 7 New Done Done false
24259 5847 Acked 6846 Read 7 New Done Done false
24260 5848 Acked 6847 Read 9 New Done Done false
24261 5849 Acked 6848 Write 10 New Done Done false
24262 5850 Acked 6849 Write 6 New Done Done false
24263 5851 Acked 6850 Read 2 New Done Done false
24264 5852 Acked 6851 Read 1 New Done Done false
24265 5853 Acked 6852 Read 10 New Done Done false
24266 5854 Acked 6853 Read 5 New Done Done false
24267 5855 Acked 6854 Write 9 New Done Done false
24268 5856 Acked 6855 Read 4 New Done Done false
24269 5857 Acked 6856 Write 9 New Done Done false
24270 5858 Acked 6857 Read 9 New Done Done false
24271 5859 Acked 6858 Read 6 New Done Done false
24272 5860 Acked 6859 Write 5 New Done Done false
24273 5861 Acked 6860 Read 5 New Done Done false
24274 5862 Acked 6861 Write 7 New Done Done false
24275 5863 Acked 6862 Read 4 New Done Done false
24276 5864 Acked 6863 Flush 0 New Done Done false
24277 5865 Acked 6864 Write 10 New Done Done false
24278 5866 Acked 6865 Read 1 New Done Done false
24279 5867 Acked 6866 Read 2 New Done Done false
24280 5868 Acked 6867 Read 9 New Done Done false
24281 5869 Acked 6868 Read 10 New Done Done false
24282 5870 Acked 6869 Write 1 New Done Done false
24283 5871 Acked 6870 Read 6 New Done Done false
24284 5872 Acked 6871 Read 10 New Done Done false
24285 5873 Acked 6872 Read 8 New Done Done false
24286 5874 Acked 6873 Read 10 New Done Done false
24287 5875 Acked 6874 Read 1 New Done Done false
24288 5876 Acked 6875 Write 7 New Done Done false
24289 5877 Acked 6876 Write 6 New Done Done false
24290 5878 Acked 6877 Read 2 New Done Done false
24291 5879 Acked 6878 Read 1 New Done Done false
24292 5880 Acked 6879 Flush 0 New Done Done false
24293 5881 Acked 6880 Flush 0 New Done Done false
24294 5882 Acked 6881 Write 6 New Done Done false
24295 5883 Acked 6882 Read 1 New Done Done false
24296 5884 Acked 6883 Read 10 New Done Done false
24297 5885 Acked 6884 Write 5 New Done Done false
24298 5886 Acked 6885 Write 9 New Done Done false
24299 5887 Acked 6886 Read 3 New Done Done false
24300 5888 Acked 6887 Read 7 New Done Done false
24301 5889 Acked 6888 Read 10 New Done Done false
24302 5890 Acked 6889 Write 6 New Done Done false
24303 5891 Acked 6890 Write 2 New Done Done false
24304 5892 Acked 6891 Write 9 New Done Done false
24305 5893 Acked 6892 Write 1 New Done Done false
24306 5894 Acked 6893 Read 8 New Done Done false
24307 5895 Acked 6894 Read 1 New Done Done false
24308 5896 Acked 6895 Write 1 New Done Done false
24309 5897 Acked 6896 Write 8 New Done Done false
24310 5898 Acked 6897 Flush 0 New Done Done false
24311 5899 Acked 6898 Read 7 New Done Done false
24312 5900 Acked 6899 Read 9 New Done Done false
24313 5901 Acked 6900 Read 2 New Done Done false
24314 5902 Acked 6901 Read 3 New Done Done false
24315 5903 Acked 6902 Read 6 New Done Done false
24316 5904 Acked 6903 Read 1 New Done Done false
24317 5905 Acked 6904 Write 6 New Done Done false
24318 5906 Acked 6905 Write 6 New Done Done false
24319 5907 Acked 6906 Read 9 New Done Done false
24320 5908 Acked 6907 Flush 0 New Done Done false
24321 5909 Acked 6908 Read 2 New Done Done false
24322 5910 Acked 6909 Flush 0 New Done Done false
24323 5911 Acked 6910 Write 2 New Done Done false
24324 5912 Acked 6911 Write 6 New Done Done false
24325 5913 Acked 6912 Read 9 New Done Done false
24326 5914 Acked 6913 Read 10 New Done Done false
24327 5915 Acked 6914 Read 9 New Done Done false
24328 5916 Acked 6915 Write 9 New Done Done false
24329 5917 Acked 6916 Read 3 New Done Done false
24330 5918 Acked 6917 Write 7 New Done Done false
24331 5919 Acked 6918 Read 7 New Done Done false
24332 5920 Acked 6919 Write 7 New Done Done false
24333 5921 Acked 6920 Read 10 New Done Done false
24334 5922 Acked 6921 Read 8 New Done Done false
24335 5923 Acked 6922 Read 3 New Done Done false
24336 5924 Acked 6923 Write 4 New Done Done false
24337 5925 Acked 6924 Read 6 New Done Done false
24338 5926 Acked 6925 Read 6 New Done Done false
24339 5927 Acked 6926 Read 4 New Done Done false
24340 5928 Acked 6927 Read 7 New Done Done false
24341 5929 Acked 6928 Write 7 New Done Done false
24342 5930 Acked 6929 Write 6 New Done Done false
24343 5931 Acked 6930 Flush 0 New Done Done false
24344 5932 Acked 6931 Flush 0 New Done Done false
24345 5933 Acked 6932 Read 5 New Done Done false
24346 5934 Acked 6933 Read 2 New Done Done false
24347 5935 Acked 6934 Flush 0 New Done Done false
24348 5936 Acked 6935 Read 6 New Done Done false
24349 5937 Acked 6936 Write 2 New Done Done false
24350 5938 Acked 6937 Write 2 New Done Done false
24351 5939 Acked 6938 Write 4 New Done Done false
24352 5940 Acked 6939 Read 4 New Done Done false
24353 5941 Acked 6940 Write 3 New Done Done false
24354 5942 Acked 6941 Flush 0 New Done Done false
24355 5943 Acked 6942 Flush 0 New Done Done false
24356 5944 Acked 6943 Read 7 New Done Done false
24357 5945 Acked 6944 Read 2 New Done Done false
24358 5946 Acked 6945 Read 2 New Done Done false
24359 5947 Acked 6946 Read 6 New Done Done false
24360 5948 Acked 6947 Read 3 New Done Done false
24361 5949 Acked 6948 Read 3 New Done Done false
24362 5950 Acked 6949 Read 1 New Done Done false
24363 5951 Acked 6950 Read 5 New Done Done false
24364 5952 Acked 6951 Write 5 New Done Done false
24365 5953 Acked 6952 Write 7 New Done Done false
24366 5954 Acked 6953 Read 5 New Done Done false
24367 5955 Acked 6954 Read 1 New Done Done false
24368 5956 Acked 6955 Write 8 New Done Done false
24369 5957 Acked 6956 Read 1 New Done Done false
24370 5958 Acked 6957 Read 7 New Done Done false
24371 5959 Acked 6958 Read 7 New Done Done false
24372 5960 Acked 6959 Read 9 New Done Done false
24373 5961 Acked 6960 Read 7 New Done Done false
24374 5962 Acked 6961 Write 1 New Done Done false
24375 5963 Acked 6962 Read 2 New Done Done false
24376 5964 Acked 6963 Read 10 New Done Done false
24377 5965 Acked 6964 Write 7 New Done Done false
24378 5966 Acked 6965 Read 6 New Done Done false
24379 5967 Acked 6966 Read 4 New Done Done false
24380 5968 Acked 6967 Flush 0 New Done Done false
24381 5969 Acked 6968 Read 6 New Done Done false
24382 5970 Acked 6969 Read 9 New Done Done false
24383 5971 Acked 6970 Read 9 New Done Done false
24384 5972 Acked 6971 Read 4 New Done Done false
24385 5973 Acked 6972 Write 3 New Done Done false
24386 5974 Acked 6973 Flush 0 New Done Done false
24387 5975 Acked 6974 Read 3 New Done Done false
24388 5976 Acked 6975 Read 3 New Done Done false
24389 5977 Acked 6976 Read 2 New Done Done false
24390 5978 Acked 6977 Read 10 New Done Done false
24391 5979 Acked 6978 Read 3 New Done Done false
24392 5980 Acked 6979 Read 10 New Done Done false
24393 5981 Acked 6980 Write 2 New Done Done false
24394 5982 Acked 6981 Write 10 New Done Done false
24395 5983 Acked 6982 Write 1 New Done Done false
24396 5984 Acked 6983 Read 1 New Done Done false
24397 5985 Acked 6984 Write 2 New Done Done false
24398 5986 Acked 6985 Write 8 New Done Done false
24399 5987 Acked 6986 Write 7 New Done Done false
24400 5988 Acked 6987 Write 4 New Done Done false
24401 5989 Acked 6988 Read 7 New Done Done false
24402 5990 Acked 6989 Write 2 New Done Done false
24403 5991 Acked 6990 Read 7 New Done Done false
24404 5992 Acked 6991 Read 7 New Done Done false
24405 5993 Acked 6992 Read 8 New Done Done false
24406 5994 Acked 6993 Write 8 New Done Done false
24407 5995 Acked 6994 Read 8 New Done Done false
24408 5996 Acked 6995 Read 9 New Done Done false
24409 5997 Acked 6996 Write 3 New Done Done false
24410 5998 Acked 6997 Write 5 New Done Done false
24411 5999 Acked 6998 Write 1 New Done Done false
24412 6000 Acked 6999 Write 6 New Done Done false
24413 6001 Acked 7000 Read 8 New Done Done false
24414 6002 Acked 7001 Write 10 New Done Done false
24415 6003 Acked 7002 Flush 0 New Done Done false
24416 6004 Acked 7003 Write 10 New Done Done false
24417 6005 Acked 7004 Write 9 New Done Done false
24418 6006 Acked 7005 Read 4 New Done Done false
24419 6007 Acked 7006 Read 3 New Done Done false
24420 6008 Acked 7007 Write 6 New Done Done false
24421 6009 Acked 7008 Write 2 New Done Done false
24422 6010 Acked 7009 Write 2 New Done Done false
24423 6011 Acked 7010 Write 8 New Done Done false
24424 6012 Acked 7011 Write 5 New Done Done false
24425 6013 Acked 7012 Write 2 New Done Done false
24426 6014 Acked 7013 Read 9 New Done Done false
24427 6015 Acked 7014 Write 5 New Done Done false
24428 6016 Acked 7015 Read 1 New Done Done false
24429 6017 Acked 7016 Flush 0 New Done Done false
24430 6018 Acked 7017 Read 7 New Done Done false
24431 6019 Acked 7018 Write 1 New Done Done false
24432 6020 Acked 7019 Read 4 New Done Done false
24433 6021 Acked 7020 Read 1 New Done Done false
24434 6022 Acked 7021 Read 7 New Done Done false
24435 6023 Acked 7022 Write 1 New Done Done false
24436 6024 Acked 7023 Read 5 New Done Done false
24437 6025 Acked 7024 Read 6 New Done Done false
24438 6026 Acked 7025 Read 10 New Done Done false
24439 6027 Acked 7026 Write 4 New Done Done false
24440 6028 Acked 7027 Read 2 New Done Done false
24441 STATES DS:0 DS:1 DS:2 TOTAL
24442 New 300 0 0 300
24443 Sent 0 0 0 0
24444 Done 0 300 300 600
24445 Skipped 0 0 0 0
24446 Error 0 0 0 0
24447 Last Flush: 6727 7016 7016
24448 Downstairs last five completed: 6727 6726 6725 6724 6723
24449 Upstairs last five completed: 6028 6027 6026 6025 6024
24450 CLIENT: Up:0 ds:300 act:2
24451 ----------------------------------------------------------------
24452 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:301
24453 States: Offline Active Active
24454 GW_ID ACK DSID TYPE BLOCKS DS:0 DS:1 DS:2 REPLAY
24455 5729 Acked 6728 Read 6 New Done Done false
24456 5730 Acked 6729 Read 7 New Done Done false
24457 5731 Acked 6730 Write 8 New Done Done false
24458 5732 Acked 6731 Read 6 New Done Done false
24459 5733 Acked 6732 Flush 0 New Done Done false
24460 5734 Acked 6733 Write 6 New Done Done false
24461 5735 Acked 6734 Write 9 New Done Done false
24462 5736 Acked 6735 Read 6 New Done Done false
24463 5737 Acked 6736 Read 6 New Done Done false
24464 5738 Acked 6737 Read 5 New Done Done false
24465 5739 Acked 6738 Read 6 New Done Done false
24466 5740 Acked 6739 Read 5 New Done Done false
24467 5741 Acked 6740 Read 9 New Done Done false
24468 5742 Acked 6741 Read 10 New Done Done false
24469 5743 Acked 6742 Read 10 New Done Done false
24470 5744 Acked 6743 Write 4 New Done Done false
24471 5745 Acked 6744 Read 9 New Done Done false
24472 5746 Acked 6745 Write 3 New Done Done false
24473 5747 Acked 6746 Write 2 New Done Done false
24474 5748 Acked 6747 Write 10 New Done Done false
24475 5749 Acked 6748 Read 10 New Done Done false
24476 5750 Acked 6749 Write 2 New Done Done false
24477 5751 Acked 6750 Write 2 New Done Done false
24478 5752 Acked 6751 Read 7 New Done Done false
24479 5753 Acked 6752 Write 2 New Done Done false
24480 5754 Acked 6753 Flush 0 New Done Done false
24481 5755 Acked 6754 Read 1 New Done Done false
24482 5756 Acked 6755 Write 10 New Done Done false
24483 5757 Acked 6756 Read 4 New Done Done false
24484 5758 Acked 6757 Read 7 New Done Done false
24485 5759 Acked 6758 Read 10 New Done Done false
24486 5760 Acked 6759 Write 7 New Done Done false
24487 5761 Acked 6760 Flush 0 New Done Done false
24488 5762 Acked 6761 Read 2 New Done Done false
24489 5763 Acked 6762 Read 8 New Done Done false
24490 5764 Acked 6763 Flush 0 New Done Done false
24491 5765 Acked 6764 Write 4 New Done Done false
24492 5766 Acked 6765 Write 10 New Done Done false
24493 5767 Acked 6766 Read 4 New Done Done false
24494 5768 Acked 6767 Read 7 New Done Done false
24495 5769 Acked 6768 Read 1 New Done Done false
24496 5770 Acked 6769 Read 1 New Done Done false
24497 5771 Acked 6770 Write 3 New Done Done false
24498 5772 Acked 6771 Write 8 New Done Done false
24499 5773 Acked 6772 Read 1 New Done Done false
24500 5774 Acked 6773 Read 6 New Done Done false
24501 5775 Acked 6774 Write 10 New Done Done false
24502 5776 Acked 6775 Read 9 New Done Done false
24503 5777 Acked 6776 Write 8 New Done Done false
24504 5778 Acked 6777 Write 7 New Done Done false
24505 5779 Acked 6778 Flush 0 New Done Done false
24506 5780 Acked 6779 Read 4 New Done Done false
24507 5781 Acked 6780 Write 8 New Done Done false
24508 5782 Acked 6781 Read 1 New Done Done false
24509 5783 Acked 6782 Read 1 New Done Done false
24510 5784 Acked 6783 Write 4 New Done Done false
24511 5785 Acked 6784 Flush 0 New Done Done false
24512 5786 Acked 6785 Read 7 New Done Done false
24513 5787 Acked 6786 Write 3 New Done Done false
24514 5788 Acked 6787 Read 5 New Done Done false
24515 5789 Acked 6788 Read 1 New Done Done false
24516 5790 Acked 6789 Read 8 New Done Done false
24517 5791 Acked 6790 Write 10 New Done Done false
24518 5792 Acked 6791 Flush 0 New Done Done false
24519 5793 Acked 6792 Read 1 New Done Done false
24520 5794 Acked 6793 Read 1 New Done Done false
24521 5795 Acked 6794 Read 9 New Done Done false
24522 5796 Acked 6795 Read 7 New Done Done false
24523 5797 Acked 6796 Write 6 New Done Done false
24524 5798 Acked 6797 Read 10 New Done Done false
24525 5799 Acked 6798 Read 1 New Done Done false
24526 5800 Acked 6799 Write 9 New Done Done false
24527 5801 Acked 6800 Read 1 New Done Done false
24528 5802 Acked 6801 Read 8 New Done Done false
24529 5803 Acked 6802 Write 9 New Done Done false
24530 5804 Acked 6803 Write 3 New Done Done false
24531 5805 Acked 6804 Write 8 New Done Done false
24532 5806 Acked 6805 Write 9 New Done Done false
24533 5807 Acked 6806 Flush 0 New Done Done false
24534 5808 Acked 6807 Read 10 New Done Done false
24535 5809 Acked 6808 Flush 0 New Done Done false
24536 5810 Acked 6809 Write 4 New Done Done false
24537 5811 Acked 6810 Flush 0 New Done Done false
24538 5812 Acked 6811 Write 6 New Done Done false
24539 5813 Acked 6812 Read 10 New Done Done false
24540 5814 Acked 6813 Read 5 New Done Done false
24541 5815 Acked 6814 Write 8 New Done Done false
24542 5816 Acked 6815 Read 7 New Done Done false
24543 5817 Acked 6816 Read 3 New Done Done false
24544 5818 Acked 6817 Read 7 New Done Done false
24545 5819 Acked 6818 Read 6 New Done Done false
24546 5820 Acked 6819 Read 7 New Done Done false
24547 5821 Acked 6820 Read 1 New Done Done false
24548 5822 Acked 6821 Read 6 New Done Done false
24549 5823 Acked 6822 Read 1 New Done Done false
24550 5824 Acked 6823 Write 1 New Done Done false
24551 5825 Acked 6824 Read 9 New Done Done false
24552 5826 Acked 6825 Read 8 New Done Done false
24553 5827 Acked 6826 Write 8 New Done Done false
24554 5828 Acked 6827 Write 8 New Done Done false
24555 5829 Acked 6828 Write 9 New Done Done false
24556 5830 Acked 6829 Read 10 New Done Done false
24557 5831 Acked 6830 Flush 0 New Done Done false
24558 5832 Acked 6831 Read 6 New Done Done false
24559 5833 Acked 6832 Read 4 New Done Done false
24560 5834 Acked 6833 Write 9 New Done Done false
24561 5835 Acked 6834 Write 9 New Done Done false
24562 5836 Acked 6835 Read 2 New Done Done false
24563 5837 Acked 6836 Write 8 New Done Done false
24564 5838 Acked 6837 Write 10 New Done Done false
24565 5839 Acked 6838 Read 3 New Done Done false
24566 5840 Acked 6839 Read 3 New Done Done false
24567 5841 Acked 6840 Write 3 New Done Done false
24568 5842 Acked 6841 Read 6 New Done Done false
24569 5843 Acked 6842 Read 1 New Done Done false
24570 5844 Acked 6843 Read 2 New Done Done false
24571 5845 Acked 6844 Flush 0 New Done Done false
24572 5846 Acked 6845 Read 7 New Done Done false
24573 5847 Acked 6846 Read 7 New Done Done false
24574 5848 Acked 6847 Read 9 New Done Done false
24575 5849 Acked 6848 Write 10 New Done Done false
24576 5850 Acked 6849 Write 6 New Done Done false
24577 5851 Acked 6850 Read 2 New Done Done false
24578 5852 Acked 6851 Read 1 New Done Done false
24579 5853 Acked 6852 Read 10 New Done Done false
24580 5854 Acked 6853 Read 5 New Done Done false
24581 5855 Acked 6854 Write 9 New Done Done false
24582 5856 Acked 6855 Read 4 New Done Done false
24583 5857 Acked 6856 Write 9 New Done Done false
24584 5858 Acked 6857 Read 9 New Done Done false
24585 5859 Acked 6858 Read 6 New Done Done false
24586 5860 Acked 6859 Write 5 New Done Done false
24587 5861 Acked 6860 Read 5 New Done Done false
24588 5862 Acked 6861 Write 7 New Done Done false
24589 5863 Acked 6862 Read 4 New Done Done false
24590 5864 Acked 6863 Flush 0 New Done Done false
24591 5865 Acked 6864 Write 10 New Done Done false
24592 5866 Acked 6865 Read 1 New Done Done false
24593 5867 Acked 6866 Read 2 New Done Done false
24594 5868 Acked 6867 Read 9 New Done Done false
24595 5869 Acked 6868 Read 10 New Done Done false
24596 5870 Acked 6869 Write 1 New Done Done false
24597 5871 Acked 6870 Read 6 New Done Done false
24598 5872 Acked 6871 Read 10 New Done Done false
24599 5873 Acked 6872 Read 8 New Done Done false
24600 5874 Acked 6873 Read 10 New Done Done false
24601 5875 Acked 6874 Read 1 New Done Done false
24602 5876 Acked 6875 Write 7 New Done Done false
24603 5877 Acked 6876 Write 6 New Done Done false
24604 5878 Acked 6877 Read 2 New Done Done false
24605 5879 Acked 6878 Read 1 New Done Done false
24606 5880 Acked 6879 Flush 0 New Done Done false
24607 5881 Acked 6880 Flush 0 New Done Done false
24608 5882 Acked 6881 Write 6 New Done Done false
24609 5883 Acked 6882 Read 1 New Done Done false
24610 5884 Acked 6883 Read 10 New Done Done false
24611 5885 Acked 6884 Write 5 New Done Done false
24612 5886 Acked 6885 Write 9 New Done Done false
24613 5887 Acked 6886 Read 3 New Done Done false
24614 5888 Acked 6887 Read 7 New Done Done false
24615 5889 Acked 6888 Read 10 New Done Done false
24616 5890 Acked 6889 Write 6 New Done Done false
24617 5891 Acked 6890 Write 2 New Done Done false
24618 5892 Acked 6891 Write 9 New Done Done false
24619 5893 Acked 6892 Write 1 New Done Done false
24620 5894 Acked 6893 Read 8 New Done Done false
24621 5895 Acked 6894 Read 1 New Done Done false
24622 5896 Acked 6895 Write 1 New Done Done false
24623 5897 Acked 6896 Write 8 New Done Done false
24624 5898 Acked 6897 Flush 0 New Done Done false
24625 5899 Acked 6898 Read 7 New Done Done false
24626 5900 Acked 6899 Read 9 New Done Done false
24627 5901 Acked 6900 Read 2 New Done Done false
24628 5902 Acked 6901 Read 3 New Done Done false
24629 5903 Acked 6902 Read 6 New Done Done false
24630 5904 Acked 6903 Read 1 New Done Done false
24631 5905 Acked 6904 Write 6 New Done Done false
24632 5906 Acked 6905 Write 6 New Done Done false
24633 5907 Acked 6906 Read 9 New Done Done false
24634 5908 Acked 6907 Flush 0 New Done Done false
24635 5909 Acked 6908 Read 2 New Done Done false
24636 5910 Acked 6909 Flush 0 New Done Done false
24637 5911 Acked 6910 Write 2 New Done Done false
24638 5912 Acked 6911 Write 6 New Done Done false
24639 5913 Acked 6912 Read 9 New Done Done false
24640 5914 Acked 6913 Read 10 New Done Done false
24641 5915 Acked 6914 Read 9 New Done Done false
24642 5916 Acked 6915 Write 9 New Done Done false
24643 5917 Acked 6916 Read 3 New Done Done false
24644 5918 Acked 6917 Write 7 New Done Done false
24645 5919 Acked 6918 Read 7 New Done Done false
24646 5920 Acked 6919 Write 7 New Done Done false
24647 5921 Acked 6920 Read 10 New Done Done false
24648 5922 Acked 6921 Read 8 New Done Done false
24649 5923 Acked 6922 Read 3 New Done Done false
24650 5924 Acked 6923 Write 4 New Done Done false
24651 5925 Acked 6924 Read 6 New Done Done false
24652 5926 Acked 6925 Read 6 New Done Done false
24653 5927 Acked 6926 Read 4 New Done Done false
24654 5928 Acked 6927 Read 7 New Done Done false
24655 5929 Acked 6928 Write 7 New Done Done false
24656 5930 Acked 6929 Write 6 New Done Done false
24657 5931 Acked 6930 Flush 0 New Done Done false
24658 5932 Acked 6931 Flush 0 New Done Done false
24659 5933 Acked 6932 Read 5 New Done Done false
24660 5934 Acked 6933 Read 2 New Done Done false
24661 5935 Acked 6934 Flush 0 New Done Done false
24662 5936 Acked 6935 Read 6 New Done Done false
24663 5937 Acked 6936 Write 2 New Done Done false
24664 5938 Acked 6937 Write 2 New Done Done false
24665 5939 Acked 6938 Write 4 New Done Done false
24666 5940 Acked 6939 Read 4 New Done Done false
24667 5941 Acked 6940 Write 3 New Done Done false
24668 5942 Acked 6941 Flush 0 New Done Done false
24669 5943 Acked 6942 Flush 0 New Done Done false
24670 5944 Acked 6943 Read 7 New Done Done false
24671 5945 Acked 6944 Read 2 New Done Done false
24672 5946 Acked 6945 Read 2 New Done Done false
24673 5947 Acked 6946 Read 6 New Done Done false
24674 5948 Acked 6947 Read 3 New Done Done false
24675 5949 Acked 6948 Read 3 New Done Done false
24676 5950 Acked 6949 Read 1 New Done Done false
24677 5951 Acked 6950 Read 5 New Done Done false
24678 5952 Acked 6951 Write 5 New Done Done false
24679 5953 Acked 6952 Write 7 New Done Done false
24680 5954 Acked 6953 Read 5 New Done Done false
24681 5955 Acked 6954 Read 1 New Done Done false
24682 5956 Acked 6955 Write 8 New Done Done false
24683 5957 Acked 6956 Read 1 New Done Done false
24684 5958 Acked 6957 Read 7 New Done Done false
24685 5959 Acked 6958 Read 7 New Done Done false
24686 5960 Acked 6959 Read 9 New Done Done false
24687 5961 Acked 6960 Read 7 New Done Done false
24688 5962 Acked 6961 Write 1 New Done Done false
24689 5963 Acked 6962 Read 2 New Done Done false
24690 5964 Acked 6963 Read 10 New Done Done false
24691 5965 Acked 6964 Write 7 New Done Done false
24692 5966 Acked 6965 Read 6 New Done Done false
24693 5967 Acked 6966 Read 4 New Done Done false
24694 5968 Acked 6967 Flush 0 New Done Done false
24695 5969 Acked 6968 Read 6 New Done Done false
24696 5970 Acked 6969 Read 9 New Done Done false
24697 5971 Acked 6970 Read 9 New Done Done false
24698 5972 Acked 6971 Read 4 New Done Done false
24699 5973 Acked 6972 Write 3 New Done Done false
24700 5974 Acked 6973 Flush 0 New Done Done false
24701 5975 Acked 6974 Read 3 New Done Done false
24702 5976 Acked 6975 Read 3 New Done Done false
24703 5977 Acked 6976 Read 2 New Done Done false
24704 5978 Acked 6977 Read 10 New Done Done false
24705 5979 Acked 6978 Read 3 New Done Done false
24706 5980 Acked 6979 Read 10 New Done Done false
24707 5981 Acked 6980 Write 2 New Done Done false
24708 5982 Acked 6981 Write 10 New Done Done false
24709 5983 Acked 6982 Write 1 New Done Done false
24710 5984 Acked 6983 Read 1 New Done Done false
24711 5985 Acked 6984 Write 2 New Done Done false
24712 5986 Acked 6985 Write 8 New Done Done false
24713 5987 Acked 6986 Write 7 New Done Done false
24714 5988 Acked 6987 Write 4 New Done Done false
24715 5989 Acked 6988 Read 7 New Done Done false
24716 5990 Acked 6989 Write 2 New Done Done false
24717 5991 Acked 6990 Read 7 New Done Done false
24718 5992 Acked 6991 Read 7 New Done Done false
24719 5993 Acked 6992 Read 8 New Done Done false
24720 5994 Acked 6993 Write 8 New Done Done false
24721 5995 Acked 6994 Read 8 New Done Done false
24722 5996 Acked 6995 Read 9 New Done Done false
24723 5997 Acked 6996 Write 3 New Done Done false
24724 5998 Acked 6997 Write 5 New Done Done false
24725 5999 Acked 6998 Write 1 New Done Done false
24726 6000 Acked 6999 Write 6 New Done Done false
24727 6001 Acked 7000 Read 8 New Done Done false
24728 6002 Acked 7001 Write 10 New Done Done false
24729 6003 Acked 7002 Flush 0 New Done Done false
24730 6004 Acked 7003 Write 10 New Done Done false
24731 6005 Acked 7004 Write 9 New Done Done false
24732 6006 Acked 7005 Read 4 New Done Done false
24733 6007 Acked 7006 Read 3 New Done Done false
24734 6008 Acked 7007 Write 6 New Done Done false
24735 6009 Acked 7008 Write 2 New Done Done false
24736 6010 Acked 7009 Write 2 New Done Done false
24737 6011 Acked 7010 Write 8 New Done Done false
24738 6012 Acked 7011 Write 5 New Done Done false
24739 6013 Acked 7012 Write 2 New Done Done false
24740 6014 Acked 7013 Read 9 New Done Done false
24741 6015 Acked 7014 Write 5 New Done Done false
24742 6016 Acked 7015 Read 1 New Done Done false
24743 6017 Acked 7016 Flush 0 New Done Done false
24744 6018 Acked 7017 Read 7 New Done Done false
24745 6019 Acked 7018 Write 1 New Done Done false
24746 6020 Acked 7019 Read 4 New Done Done false
24747 6021 Acked 7020 Read 1 New Done Done false
24748 6022 Acked 7021 Read 7 New Done Done false
24749 6023 Acked 7022 Write 1 New Done Done false
24750 6024 Acked 7023 Read 5 New Done Done false
24751 6025 Acked 7024 Read 6 New Done Done false
24752 6026 Acked 7025 Read 10 New Done Done false
24753 6027 Acked 7026 Write 4 New Done Done false
24754 6028 Acked 7027 Read 2 New Done Done false
24755 6029 Acked 7028 Flush 0 New Done Done false
24756 STATES DS:0 DS:1 DS:2 TOTAL
24757 New 301 0 0 301
24758 Sent 0 0 0 0
24759 Done 0 301 301 602
24760 Skipped 0 0 0 0
24761 Error 0 0 0 0
24762 Last Flush: 6727 7028 7028
24763 Downstairs last five completed: 6727 6726 6725 6724 6723
24764 Upstairs last five completed: 6029 6028 6027 6026 6025
24765 CLIENT: Up:0 ds:301 act:2
247662024-04-20T01:10:16.138ZINFOcrucible: connecting to 127.0.0.1:8810 = io task client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
247672024-04-20T01:10:16.138ZWARNcrucible: ds_connection connect to 127.0.0.1:8810 failure: Os { code: 146, kind: ConnectionRefused, message: "Connection refused" } = io task client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
247682024-04-20T01:10:16.138ZWARNcrucible: client task is sending Done(ConnectionFailed(Os { code: 146, kind: ConnectionRefused, message: "Connection refused" })) = io task client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
247692024-04-20T01:10:16.138ZWARNcrucible: downstairs task for 0 stopped due to ConnectionFailed(Os { code: 146, kind: ConnectionRefused, message: "Connection refused" }) session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
247702024-04-20T01:10:16.138ZINFOcrucible: [0] client re-new 301 jobs since flush 6727 = downstairs session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
247712024-04-20T01:10:16.139ZINFOcrucible: [0] Marked 0 jobs for replay since flush: 6727 = downstairs session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
247722024-04-20T01:10:16.139ZINFOcrucible: client task is exiting = io task client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
24773 [8810] got start action
24774 [8810] I am going to restart
24775 Starting downstairs at port 8810
24776 Make output file at "/tmp/dsc/downstairs-8810.txt"
24777 [8810][0] reports Starting
24778 Downstairs /var/tmp/dsc/region/8810 port 8810 PID:Some(1216)
24779 [8810][0] reports Running
24780 ----------------------------------------------------------------
24781 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:301
24782 States: Offline Active Active
24783 GW_ID ACK DSID TYPE BLOCKS DS:0 DS:1 DS:2 REPLAY
24784 5729 Acked 6728 Read 6 New Done Done true
24785 5730 Acked 6729 Read 7 New Done Done true
24786 5731 Acked 6730 Write 8 New Done Done true
24787 5732 Acked 6731 Read 6 New Done Done true
24788 5733 Acked 6732 Flush 0 New Done Done true
24789 5734 Acked 6733 Write 6 New Done Done true
24790 5735 Acked 6734 Write 9 New Done Done true
24791 5736 Acked 6735 Read 6 New Done Done true
24792 5737 Acked 6736 Read 6 New Done Done true
24793 5738 Acked 6737 Read 5 New Done Done true
24794 5739 Acked 6738 Read 6 New Done Done true
24795 5740 Acked 6739 Read 5 New Done Done true
24796 5741 Acked 6740 Read 9 New Done Done true
24797 5742 Acked 6741 Read 10 New Done Done true
24798 5743 Acked 6742 Read 10 New Done Done true
24799 5744 Acked 6743 Write 4 New Done Done true
24800 5745 Acked 6744 Read 9 New Done Done true
24801 5746 Acked 6745 Write 3 New Done Done true
24802 5747 Acked 6746 Write 2 New Done Done true
24803 5748 Acked 6747 Write 10 New Done Done true
24804 5749 Acked 6748 Read 10 New Done Done true
24805 5750 Acked 6749 Write 2 New Done Done true
24806 5751 Acked 6750 Write 2 New Done Done true
24807 5752 Acked 6751 Read 7 New Done Done true
24808 5753 Acked 6752 Write 2 New Done Done true
24809 5754 Acked 6753 Flush 0 New Done Done true
24810 5755 Acked 6754 Read 1 New Done Done true
24811 5756 Acked 6755 Write 10 New Done Done true
24812 5757 Acked 6756 Read 4 New Done Done true
24813 5758 Acked 6757 Read 7 New Done Done true
24814 5759 Acked 6758 Read 10 New Done Done true
24815 5760 Acked 6759 Write 7 New Done Done true
24816 5761 Acked 6760 Flush 0 New Done Done true
24817 5762 Acked 6761 Read 2 New Done Done true
24818 5763 Acked 6762 Read 8 New Done Done true
24819 5764 Acked 6763 Flush 0 New Done Done true
24820 5765 Acked 6764 Write 4 New Done Done true
24821 5766 Acked 6765 Write 10 New Done Done true
24822 5767 Acked 6766 Read 4 New Done Done true
24823 5768 Acked 6767 Read 7 New Done Done true
24824 5769 Acked 6768 Read 1 New Done Done true
24825 5770 Acked 6769 Read 1 New Done Done true
24826 5771 Acked 6770 Write 3 New Done Done true
24827 5772 Acked 6771 Write 8 New Done Done true
24828 5773 Acked 6772 Read 1 New Done Done true
24829 5774 Acked 6773 Read 6 New Done Done true
24830 5775 Acked 6774 Write 10 New Done Done true
24831 5776 Acked 6775 Read 9 New Done Done true
24832 5777 Acked 6776 Write 8 New Done Done true
24833 5778 Acked 6777 Write 7 New Done Done true
24834 5779 Acked 6778 Flush 0 New Done Done true
24835 5780 Acked 6779 Read 4 New Done Done true
24836 5781 Acked 6780 Write 8 New Done Done true
24837 5782 Acked 6781 Read 1 New Done Done true
24838 5783 Acked 6782 Read 1 New Done Done true
24839 5784 Acked 6783 Write 4 New Done Done true
24840 5785 Acked 6784 Flush 0 New Done Done true
24841 5786 Acked 6785 Read 7 New Done Done true
24842 5787 Acked 6786 Write 3 New Done Done true
24843 5788 Acked 6787 Read 5 New Done Done true
24844 5789 Acked 6788 Read 1 New Done Done true
24845 5790 Acked 6789 Read 8 New Done Done true
24846 5791 Acked 6790 Write 10 New Done Done true
24847 5792 Acked 6791 Flush 0 New Done Done true
24848 5793 Acked 6792 Read 1 New Done Done true
24849 5794 Acked 6793 Read 1 New Done Done true
24850 5795 Acked 6794 Read 9 New Done Done true
24851 5796 Acked 6795 Read 7 New Done Done true
24852 5797 Acked 6796 Write 6 New Done Done true
24853 5798 Acked 6797 Read 10 New Done Done true
24854 5799 Acked 6798 Read 1 New Done Done true
24855 5800 Acked 6799 Write 9 New Done Done true
24856 5801 Acked 6800 Read 1 New Done Done true
24857 5802 Acked 6801 Read 8 New Done Done true
24858 5803 Acked 6802 Write 9 New Done Done true
24859 5804 Acked 6803 Write 3 New Done Done true
24860 5805 Acked 6804 Write 8 New Done Done true
24861 5806 Acked 6805 Write 9 New Done Done true
24862 5807 Acked 6806 Flush 0 New Done Done true
24863 5808 Acked 6807 Read 10 New Done Done true
24864 5809 Acked 6808 Flush 0 New Done Done true
24865 5810 Acked 6809 Write 4 New Done Done true
24866 5811 Acked 6810 Flush 0 New Done Done true
24867 5812 Acked 6811 Write 6 New Done Done true
24868 5813 Acked 6812 Read 10 New Done Done true
24869 5814 Acked 6813 Read 5 New Done Done true
24870 5815 Acked 6814 Write 8 New Done Done true
24871 5816 Acked 6815 Read 7 New Done Done true
24872 5817 Acked 6816 Read 3 New Done Done true
24873 5818 Acked 6817 Read 7 New Done Done true
24874 5819 Acked 6818 Read 6 New Done Done true
24875 5820 Acked 6819 Read 7 New Done Done true
24876 5821 Acked 6820 Read 1 New Done Done true
24877 5822 Acked 6821 Read 6 New Done Done true
24878 5823 Acked 6822 Read 1 New Done Done true
24879 5824 Acked 6823 Write 1 New Done Done true
24880 5825 Acked 6824 Read 9 New Done Done true
24881 5826 Acked 6825 Read 8 New Done Done true
24882 5827 Acked 6826 Write 8 New Done Done true
24883 5828 Acked 6827 Write 8 New Done Done true
24884 5829 Acked 6828 Write 9 New Done Done true
24885 5830 Acked 6829 Read 10 New Done Done true
24886 5831 Acked 6830 Flush 0 New Done Done true
24887 5832 Acked 6831 Read 6 New Done Done true
24888 5833 Acked 6832 Read 4 New Done Done true
24889 5834 Acked 6833 Write 9 New Done Done true
24890 5835 Acked 6834 Write 9 New Done Done true
24891 5836 Acked 6835 Read 2 New Done Done true
24892 5837 Acked 6836 Write 8 New Done Done true
24893 5838 Acked 6837 Write 10 New Done Done true
24894 5839 Acked 6838 Read 3 New Done Done true
24895 5840 Acked 6839 Read 3 New Done Done true
24896 5841 Acked 6840 Write 3 New Done Done true
24897 5842 Acked 6841 Read 6 New Done Done true
24898 5843 Acked 6842 Read 1 New Done Done true
24899 5844 Acked 6843 Read 2 New Done Done true
24900 5845 Acked 6844 Flush 0 New Done Done true
24901 5846 Acked 6845 Read 7 New Done Done true
24902 5847 Acked 6846 Read 7 New Done Done true
24903 5848 Acked 6847 Read 9 New Done Done true
24904 5849 Acked 6848 Write 10 New Done Done true
24905 5850 Acked 6849 Write 6 New Done Done true
24906 5851 Acked 6850 Read 2 New Done Done true
24907 5852 Acked 6851 Read 1 New Done Done true
24908 5853 Acked 6852 Read 10 New Done Done true
24909 5854 Acked 6853 Read 5 New Done Done true
24910 5855 Acked 6854 Write 9 New Done Done true
24911 5856 Acked 6855 Read 4 New Done Done true
24912 5857 Acked 6856 Write 9 New Done Done true
24913 5858 Acked 6857 Read 9 New Done Done true
24914 5859 Acked 6858 Read 6 New Done Done true
24915 5860 Acked 6859 Write 5 New Done Done true
24916 5861 Acked 6860 Read 5 New Done Done true
24917 5862 Acked 6861 Write 7 New Done Done true
24918 5863 Acked 6862 Read 4 New Done Done true
24919 5864 Acked 6863 Flush 0 New Done Done true
24920 5865 Acked 6864 Write 10 New Done Done true
24921 5866 Acked 6865 Read 1 New Done Done true
24922 5867 Acked 6866 Read 2 New Done Done true
24923 5868 Acked 6867 Read 9 New Done Done true
24924 5869 Acked 6868 Read 10 New Done Done true
24925 5870 Acked 6869 Write 1 New Done Done true
24926 5871 Acked 6870 Read 6 New Done Done true
24927 5872 Acked 6871 Read 10 New Done Done true
24928 5873 Acked 6872 Read 8 New Done Done true
24929 5874 Acked 6873 Read 10 New Done Done true
24930 5875 Acked 6874 Read 1 New Done Done true
24931 5876 Acked 6875 Write 7 New Done Done true
24932 5877 Acked 6876 Write 6 New Done Done true
24933 5878 Acked 6877 Read 2 New Done Done true
24934 5879 Acked 6878 Read 1 New Done Done true
24935 5880 Acked 6879 Flush 0 New Done Done true
24936 5881 Acked 6880 Flush 0 New Done Done true
24937 5882 Acked 6881 Write 6 New Done Done true
24938 5883 Acked 6882 Read 1 New Done Done true
24939 5884 Acked 6883 Read 10 New Done Done true
24940 5885 Acked 6884 Write 5 New Done Done true
24941 5886 Acked 6885 Write 9 New Done Done true
24942 5887 Acked 6886 Read 3 New Done Done true
24943 5888 Acked 6887 Read 7 New Done Done true
24944 5889 Acked 6888 Read 10 New Done Done true
24945 5890 Acked 6889 Write 6 New Done Done true
24946 5891 Acked 6890 Write 2 New Done Done true
24947 5892 Acked 6891 Write 9 New Done Done true
24948 5893 Acked 6892 Write 1 New Done Done true
24949 5894 Acked 6893 Read 8 New Done Done true
24950 5895 Acked 6894 Read 1 New Done Done true
24951 5896 Acked 6895 Write 1 New Done Done true
24952 5897 Acked 6896 Write 8 New Done Done true
24953 5898 Acked 6897 Flush 0 New Done Done true
24954 5899 Acked 6898 Read 7 New Done Done true
24955 5900 Acked 6899 Read 9 New Done Done true
24956 5901 Acked 6900 Read 2 New Done Done true
24957 5902 Acked 6901 Read 3 New Done Done true
24958 5903 Acked 6902 Read 6 New Done Done true
24959 5904 Acked 6903 Read 1 New Done Done true
24960 5905 Acked 6904 Write 6 New Done Done true
24961 5906 Acked 6905 Write 6 New Done Done true
24962 5907 Acked 6906 Read 9 New Done Done true
24963 5908 Acked 6907 Flush 0 New Done Done true
24964 5909 Acked 6908 Read 2 New Done Done true
24965 5910 Acked 6909 Flush 0 New Done Done true
24966 5911 Acked 6910 Write 2 New Done Done true
24967 5912 Acked 6911 Write 6 New Done Done true
24968 5913 Acked 6912 Read 9 New Done Done true
24969 5914 Acked 6913 Read 10 New Done Done true
24970 5915 Acked 6914 Read 9 New Done Done true
24971 5916 Acked 6915 Write 9 New Done Done true
24972 5917 Acked 6916 Read 3 New Done Done true
24973 5918 Acked 6917 Write 7 New Done Done true
24974 5919 Acked 6918 Read 7 New Done Done true
24975 5920 Acked 6919 Write 7 New Done Done true
24976 5921 Acked 6920 Read 10 New Done Done true
24977 5922 Acked 6921 Read 8 New Done Done true
24978 5923 Acked 6922 Read 3 New Done Done true
24979 5924 Acked 6923 Write 4 New Done Done true
24980 5925 Acked 6924 Read 6 New Done Done true
24981 5926 Acked 6925 Read 6 New Done Done true
24982 5927 Acked 6926 Read 4 New Done Done true
24983 5928 Acked 6927 Read 7 New Done Done true
24984 5929 Acked 6928 Write 7 New Done Done true
24985 5930 Acked 6929 Write 6 New Done Done true
24986 5931 Acked 6930 Flush 0 New Done Done true
24987 5932 Acked 6931 Flush 0 New Done Done true
24988 5933 Acked 6932 Read 5 New Done Done true
24989 5934 Acked 6933 Read 2 New Done Done true
24990 5935 Acked 6934 Flush 0 New Done Done true
24991 5936 Acked 6935 Read 6 New Done Done true
24992 5937 Acked 6936 Write 2 New Done Done true
24993 5938 Acked 6937 Write 2 New Done Done true
24994 5939 Acked 6938 Write 4 New Done Done true
24995 5940 Acked 6939 Read 4 New Done Done true
24996 5941 Acked 6940 Write 3 New Done Done true
24997 5942 Acked 6941 Flush 0 New Done Done true
24998 5943 Acked 6942 Flush 0 New Done Done true
24999 5944 Acked 6943 Read 7 New Done Done true
25000 5945 Acked 6944 Read 2 New Done Done true
25001 5946 Acked 6945 Read 2 New Done Done true
25002 5947 Acked 6946 Read 6 New Done Done true
25003 5948 Acked 6947 Read 3 New Done Done true
25004 5949 Acked 6948 Read 3 New Done Done true
25005 5950 Acked 6949 Read 1 New Done Done true
25006 5951 Acked 6950 Read 5 New Done Done true
25007 5952 Acked 6951 Write 5 New Done Done true
25008 5953 Acked 6952 Write 7 New Done Done true
25009 5954 Acked 6953 Read 5 New Done Done true
25010 5955 Acked 6954 Read 1 New Done Done true
25011 5956 Acked 6955 Write 8 New Done Done true
25012 5957 Acked 6956 Read 1 New Done Done true
25013 5958 Acked 6957 Read 7 New Done Done true
25014 5959 Acked 6958 Read 7 New Done Done true
25015 5960 Acked 6959 Read 9 New Done Done true
25016 5961 Acked 6960 Read 7 New Done Done true
25017 5962 Acked 6961 Write 1 New Done Done true
25018 5963 Acked 6962 Read 2 New Done Done true
25019 5964 Acked 6963 Read 10 New Done Done true
25020 5965 Acked 6964 Write 7 New Done Done true
25021 5966 Acked 6965 Read 6 New Done Done true
25022 5967 Acked 6966 Read 4 New Done Done true
25023 5968 Acked 6967 Flush 0 New Done Done true
25024 5969 Acked 6968 Read 6 New Done Done true
25025 5970 Acked 6969 Read 9 New Done Done true
25026 5971 Acked 6970 Read 9 New Done Done true
25027 5972 Acked 6971 Read 4 New Done Done true
25028 5973 Acked 6972 Write 3 New Done Done true
25029 5974 Acked 6973 Flush 0 New Done Done true
25030 5975 Acked 6974 Read 3 New Done Done true
25031 5976 Acked 6975 Read 3 New Done Done true
25032 5977 Acked 6976 Read 2 New Done Done true
25033 5978 Acked 6977 Read 10 New Done Done true
25034 5979 Acked 6978 Read 3 New Done Done true
25035 5980 Acked 6979 Read 10 New Done Done true
25036 5981 Acked 6980 Write 2 New Done Done true
25037 5982 Acked 6981 Write 10 New Done Done true
25038 5983 Acked 6982 Write 1 New Done Done true
25039 5984 Acked 6983 Read 1 New Done Done true
25040 5985 Acked 6984 Write 2 New Done Done true
25041 5986 Acked 6985 Write 8 New Done Done true
25042 5987 Acked 6986 Write 7 New Done Done true
25043 5988 Acked 6987 Write 4 New Done Done true
25044 5989 Acked 6988 Read 7 New Done Done true
25045 5990 Acked 6989 Write 2 New Done Done true
25046 5991 Acked 6990 Read 7 New Done Done true
25047 5992 Acked 6991 Read 7 New Done Done true
25048 5993 Acked 6992 Read 8 New Done Done true
25049 5994 Acked 6993 Write 8 New Done Done true
25050 5995 Acked 6994 Read 8 New Done Done true
25051 5996 Acked 6995 Read 9 New Done Done true
25052 5997 Acked 6996 Write 3 New Done Done true
25053 5998 Acked 6997 Write 5 New Done Done true
25054 5999 Acked 6998 Write 1 New Done Done true
25055 6000 Acked 6999 Write 6 New Done Done true
25056 6001 Acked 7000 Read 8 New Done Done true
25057 6002 Acked 7001 Write 10 New Done Done true
25058 6003 Acked 7002 Flush 0 New Done Done true
25059 6004 Acked 7003 Write 10 New Done Done true
25060 6005 Acked 7004 Write 9 New Done Done true
25061 6006 Acked 7005 Read 4 New Done Done true
25062 6007 Acked 7006 Read 3 New Done Done true
25063 6008 Acked 7007 Write 6 New Done Done true
25064 6009 Acked 7008 Write 2 New Done Done true
25065 6010 Acked 7009 Write 2 New Done Done true
25066 6011 Acked 7010 Write 8 New Done Done true
25067 6012 Acked 7011 Write 5 New Done Done true
25068 6013 Acked 7012 Write 2 New Done Done true
25069 6014 Acked 7013 Read 9 New Done Done true
25070 6015 Acked 7014 Write 5 New Done Done true
25071 6016 Acked 7015 Read 1 New Done Done true
25072 6017 Acked 7016 Flush 0 New Done Done true
25073 6018 Acked 7017 Read 7 New Done Done true
25074 6019 Acked 7018 Write 1 New Done Done true
25075 6020 Acked 7019 Read 4 New Done Done true
25076 6021 Acked 7020 Read 1 New Done Done true
25077 6022 Acked 7021 Read 7 New Done Done true
25078 6023 Acked 7022 Write 1 New Done Done true
25079 6024 Acked 7023 Read 5 New Done Done true
25080 6025 Acked 7024 Read 6 New Done Done true
25081 6026 Acked 7025 Read 10 New Done Done true
25082 6027 Acked 7026 Write 4 New Done Done true
25083 6028 Acked 7027 Read 2 New Done Done true
25084 6029 Acked 7028 Flush 0 New Done Done true
25085 STATES DS:0 DS:1 DS:2 TOTAL
25086 New 301 0 0 301
25087 Sent 0 0 0 0
25088 Done 0 301 301 602
25089 Skipped 0 0 0 0
25090 Error 0 0 0 0
25091 Last Flush: 6727 7028 7028
25092 Downstairs last five completed: 6727 6726 6725 6724 6723
25093 Upstairs last five completed: 6029 6028 6027 6026 6025
25094 CLIENT: Up:0 ds:301 act:2
25095 ----------------------------------------------------------------
25096 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:301
25097 States: Offline Active Active
25098 GW_ID ACK DSID TYPE BLOCKS DS:0 DS:1 DS:2 REPLAY
25099 5729 Acked 6728 Read 6 New Done Done true
25100 5730 Acked 6729 Read 7 New Done Done true
25101 5731 Acked 6730 Write 8 New Done Done true
25102 5732 Acked 6731 Read 6 New Done Done true
25103 5733 Acked 6732 Flush 0 New Done Done true
25104 5734 Acked 6733 Write 6 New Done Done true
25105 5735 Acked 6734 Write 9 New Done Done true
25106 5736 Acked 6735 Read 6 New Done Done true
25107 5737 Acked 6736 Read 6 New Done Done true
25108 5738 Acked 6737 Read 5 New Done Done true
25109 5739 Acked 6738 Read 6 New Done Done true
25110 5740 Acked 6739 Read 5 New Done Done true
25111 5741 Acked 6740 Read 9 New Done Done true
25112 5742 Acked 6741 Read 10 New Done Done true
25113 5743 Acked 6742 Read 10 New Done Done true
25114 5744 Acked 6743 Write 4 New Done Done true
25115 5745 Acked 6744 Read 9 New Done Done true
25116 5746 Acked 6745 Write 3 New Done Done true
25117 5747 Acked 6746 Write 2 New Done Done true
25118 5748 Acked 6747 Write 10 New Done Done true
25119 5749 Acked 6748 Read 10 New Done Done true
25120 5750 Acked 6749 Write 2 New Done Done true
25121 5751 Acked 6750 Write 2 New Done Done true
25122 5752 Acked 6751 Read 7 New Done Done true
25123 5753 Acked 6752 Write 2 New Done Done true
25124 5754 Acked 6753 Flush 0 New Done Done true
25125 5755 Acked 6754 Read 1 New Done Done true
25126 5756 Acked 6755 Write 10 New Done Done true
25127 5757 Acked 6756 Read 4 New Done Done true
25128 5758 Acked 6757 Read 7 New Done Done true
25129 5759 Acked 6758 Read 10 New Done Done true
25130 5760 Acked 6759 Write 7 New Done Done true
25131 5761 Acked 6760 Flush 0 New Done Done true
25132 5762 Acked 6761 Read 2 New Done Done true
25133 5763 Acked 6762 Read 8 New Done Done true
25134 5764 Acked 6763 Flush 0 New Done Done true
25135 5765 Acked 6764 Write 4 New Done Done true
25136 5766 Acked 6765 Write 10 New Done Done true
25137 5767 Acked 6766 Read 4 New Done Done true
25138 5768 Acked 6767 Read 7 New Done Done true
25139 5769 Acked 6768 Read 1 New Done Done true
25140 5770 Acked 6769 Read 1 New Done Done true
25141 5771 Acked 6770 Write 3 New Done Done true
25142 5772 Acked 6771 Write 8 New Done Done true
25143 5773 Acked 6772 Read 1 New Done Done true
25144 5774 Acked 6773 Read 6 New Done Done true
25145 5775 Acked 6774 Write 10 New Done Done true
25146 5776 Acked 6775 Read 9 New Done Done true
25147 5777 Acked 6776 Write 8 New Done Done true
25148 5778 Acked 6777 Write 7 New Done Done true
25149 5779 Acked 6778 Flush 0 New Done Done true
25150 5780 Acked 6779 Read 4 New Done Done true
25151 5781 Acked 6780 Write 8 New Done Done true
25152 5782 Acked 6781 Read 1 New Done Done true
25153 5783 Acked 6782 Read 1 New Done Done true
25154 5784 Acked 6783 Write 4 New Done Done true
25155 5785 Acked 6784 Flush 0 New Done Done true
25156 5786 Acked 6785 Read 7 New Done Done true
25157 5787 Acked 6786 Write 3 New Done Done true
25158 5788 Acked 6787 Read 5 New Done Done true
25159 5789 Acked 6788 Read 1 New Done Done true
25160 5790 Acked 6789 Read 8 New Done Done true
25161 5791 Acked 6790 Write 10 New Done Done true
25162 5792 Acked 6791 Flush 0 New Done Done true
25163 5793 Acked 6792 Read 1 New Done Done true
25164 5794 Acked 6793 Read 1 New Done Done true
25165 5795 Acked 6794 Read 9 New Done Done true
25166 5796 Acked 6795 Read 7 New Done Done true
25167 5797 Acked 6796 Write 6 New Done Done true
25168 5798 Acked 6797 Read 10 New Done Done true
25169 5799 Acked 6798 Read 1 New Done Done true
25170 5800 Acked 6799 Write 9 New Done Done true
25171 5801 Acked 6800 Read 1 New Done Done true
25172 5802 Acked 6801 Read 8 New Done Done true
25173 5803 Acked 6802 Write 9 New Done Done true
25174 5804 Acked 6803 Write 3 New Done Done true
25175 5805 Acked 6804 Write 8 New Done Done true
25176 5806 Acked 6805 Write 9 New Done Done true
25177 5807 Acked 6806 Flush 0 New Done Done true
25178 5808 Acked 6807 Read 10 New Done Done true
25179 5809 Acked 6808 Flush 0 New Done Done true
25180 5810 Acked 6809 Write 4 New Done Done true
25181 5811 Acked 6810 Flush 0 New Done Done true
25182 5812 Acked 6811 Write 6 New Done Done true
25183 5813 Acked 6812 Read 10 New Done Done true
25184 5814 Acked 6813 Read 5 New Done Done true
25185 5815 Acked 6814 Write 8 New Done Done true
25186 5816 Acked 6815 Read 7 New Done Done true
25187 5817 Acked 6816 Read 3 New Done Done true
25188 5818 Acked 6817 Read 7 New Done Done true
25189 5819 Acked 6818 Read 6 New Done Done true
25190 5820 Acked 6819 Read 7 New Done Done true
25191 5821 Acked 6820 Read 1 New Done Done true
25192 5822 Acked 6821 Read 6 New Done Done true
25193 5823 Acked 6822 Read 1 New Done Done true
25194 5824 Acked 6823 Write 1 New Done Done true
25195 5825 Acked 6824 Read 9 New Done Done true
25196 5826 Acked 6825 Read 8 New Done Done true
25197 5827 Acked 6826 Write 8 New Done Done true
25198 5828 Acked 6827 Write 8 New Done Done true
25199 5829 Acked 6828 Write 9 New Done Done true
25200 5830 Acked 6829 Read 10 New Done Done true
25201 5831 Acked 6830 Flush 0 New Done Done true
25202 5832 Acked 6831 Read 6 New Done Done true
25203 5833 Acked 6832 Read 4 New Done Done true
25204 5834 Acked 6833 Write 9 New Done Done true
25205 5835 Acked 6834 Write 9 New Done Done true
25206 5836 Acked 6835 Read 2 New Done Done true
25207 5837 Acked 6836 Write 8 New Done Done true
25208 5838 Acked 6837 Write 10 New Done Done true
25209 5839 Acked 6838 Read 3 New Done Done true
25210 5840 Acked 6839 Read 3 New Done Done true
25211 5841 Acked 6840 Write 3 New Done Done true
25212 5842 Acked 6841 Read 6 New Done Done true
25213 5843 Acked 6842 Read 1 New Done Done true
25214 5844 Acked 6843 Read 2 New Done Done true
25215 5845 Acked 6844 Flush 0 New Done Done true
25216 5846 Acked 6845 Read 7 New Done Done true
25217 5847 Acked 6846 Read 7 New Done Done true
25218 5848 Acked 6847 Read 9 New Done Done true
25219 5849 Acked 6848 Write 10 New Done Done true
25220 5850 Acked 6849 Write 6 New Done Done true
25221 5851 Acked 6850 Read 2 New Done Done true
25222 5852 Acked 6851 Read 1 New Done Done true
25223 5853 Acked 6852 Read 10 New Done Done true
25224 5854 Acked 6853 Read 5 New Done Done true
25225 5855 Acked 6854 Write 9 New Done Done true
25226 5856 Acked 6855 Read 4 New Done Done true
25227 5857 Acked 6856 Write 9 New Done Done true
25228 5858 Acked 6857 Read 9 New Done Done true
25229 5859 Acked 6858 Read 6 New Done Done true
25230 5860 Acked 6859 Write 5 New Done Done true
25231 5861 Acked 6860 Read 5 New Done Done true
25232 5862 Acked 6861 Write 7 New Done Done true
25233 5863 Acked 6862 Read 4 New Done Done true
25234 5864 Acked 6863 Flush 0 New Done Done true
25235 5865 Acked 6864 Write 10 New Done Done true
25236 5866 Acked 6865 Read 1 New Done Done true
25237 5867 Acked 6866 Read 2 New Done Done true
25238 5868 Acked 6867 Read 9 New Done Done true
25239 5869 Acked 6868 Read 10 New Done Done true
25240 5870 Acked 6869 Write 1 New Done Done true
25241 5871 Acked 6870 Read 6 New Done Done true
25242 5872 Acked 6871 Read 10 New Done Done true
25243 5873 Acked 6872 Read 8 New Done Done true
25244 5874 Acked 6873 Read 10 New Done Done true
25245 5875 Acked 6874 Read 1 New Done Done true
25246 5876 Acked 6875 Write 7 New Done Done true
25247 5877 Acked 6876 Write 6 New Done Done true
25248 5878 Acked 6877 Read 2 New Done Done true
25249 5879 Acked 6878 Read 1 New Done Done true
25250 5880 Acked 6879 Flush 0 New Done Done true
25251 5881 Acked 6880 Flush 0 New Done Done true
25252 5882 Acked 6881 Write 6 New Done Done true
25253 5883 Acked 6882 Read 1 New Done Done true
25254 5884 Acked 6883 Read 10 New Done Done true
25255 5885 Acked 6884 Write 5 New Done Done true
25256 5886 Acked 6885 Write 9 New Done Done true
25257 5887 Acked 6886 Read 3 New Done Done true
25258 5888 Acked 6887 Read 7 New Done Done true
25259 5889 Acked 6888 Read 10 New Done Done true
25260 5890 Acked 6889 Write 6 New Done Done true
25261 5891 Acked 6890 Write 2 New Done Done true
25262 5892 Acked 6891 Write 9 New Done Done true
25263 5893 Acked 6892 Write 1 New Done Done true
25264 5894 Acked 6893 Read 8 New Done Done true
25265 5895 Acked 6894 Read 1 New Done Done true
25266 5896 Acked 6895 Write 1 New Done Done true
25267 5897 Acked 6896 Write 8 New Done Done true
25268 5898 Acked 6897 Flush 0 New Done Done true
25269 5899 Acked 6898 Read 7 New Done Done true
25270 5900 Acked 6899 Read 9 New Done Done true
25271 5901 Acked 6900 Read 2 New Done Done true
25272 5902 Acked 6901 Read 3 New Done Done true
25273 5903 Acked 6902 Read 6 New Done Done true
25274 5904 Acked 6903 Read 1 New Done Done true
25275 5905 Acked 6904 Write 6 New Done Done true
25276 5906 Acked 6905 Write 6 New Done Done true
25277 5907 Acked 6906 Read 9 New Done Done true
25278 5908 Acked 6907 Flush 0 New Done Done true
25279 5909 Acked 6908 Read 2 New Done Done true
25280 5910 Acked 6909 Flush 0 New Done Done true
25281 5911 Acked 6910 Write 2 New Done Done true
25282 5912 Acked 6911 Write 6 New Done Done true
25283 5913 Acked 6912 Read 9 New Done Done true
25284 5914 Acked 6913 Read 10 New Done Done true
25285 5915 Acked 6914 Read 9 New Done Done true
25286 5916 Acked 6915 Write 9 New Done Done true
25287 5917 Acked 6916 Read 3 New Done Done true
25288 5918 Acked 6917 Write 7 New Done Done true
25289 5919 Acked 6918 Read 7 New Done Done true
25290 5920 Acked 6919 Write 7 New Done Done true
25291 5921 Acked 6920 Read 10 New Done Done true
25292 5922 Acked 6921 Read 8 New Done Done true
25293 5923 Acked 6922 Read 3 New Done Done true
25294 5924 Acked 6923 Write 4 New Done Done true
25295 5925 Acked 6924 Read 6 New Done Done true
25296 5926 Acked 6925 Read 6 New Done Done true
25297 5927 Acked 6926 Read 4 New Done Done true
25298 5928 Acked 6927 Read 7 New Done Done true
25299 5929 Acked 6928 Write 7 New Done Done true
25300 5930 Acked 6929 Write 6 New Done Done true
25301 5931 Acked 6930 Flush 0 New Done Done true
25302 5932 Acked 6931 Flush 0 New Done Done true
25303 5933 Acked 6932 Read 5 New Done Done true
25304 5934 Acked 6933 Read 2 New Done Done true
25305 5935 Acked 6934 Flush 0 New Done Done true
25306 5936 Acked 6935 Read 6 New Done Done true
25307 5937 Acked 6936 Write 2 New Done Done true
25308 5938 Acked 6937 Write 2 New Done Done true
25309 5939 Acked 6938 Write 4 New Done Done true
25310 5940 Acked 6939 Read 4 New Done Done true
25311 5941 Acked 6940 Write 3 New Done Done true
25312 5942 Acked 6941 Flush 0 New Done Done true
25313 5943 Acked 6942 Flush 0 New Done Done true
25314 5944 Acked 6943 Read 7 New Done Done true
25315 5945 Acked 6944 Read 2 New Done Done true
25316 5946 Acked 6945 Read 2 New Done Done true
25317 5947 Acked 6946 Read 6 New Done Done true
25318 5948 Acked 6947 Read 3 New Done Done true
25319 5949 Acked 6948 Read 3 New Done Done true
25320 5950 Acked 6949 Read 1 New Done Done true
25321 5951 Acked 6950 Read 5 New Done Done true
25322 5952 Acked 6951 Write 5 New Done Done true
25323 5953 Acked 6952 Write 7 New Done Done true
25324 5954 Acked 6953 Read 5 New Done Done true
25325 5955 Acked 6954 Read 1 New Done Done true
25326 5956 Acked 6955 Write 8 New Done Done true
25327 5957 Acked 6956 Read 1 New Done Done true
25328 5958 Acked 6957 Read 7 New Done Done true
25329 5959 Acked 6958 Read 7 New Done Done true
25330 5960 Acked 6959 Read 9 New Done Done true
25331 5961 Acked 6960 Read 7 New Done Done true
25332 5962 Acked 6961 Write 1 New Done Done true
25333 5963 Acked 6962 Read 2 New Done Done true
25334 5964 Acked 6963 Read 10 New Done Done true
25335 5965 Acked 6964 Write 7 New Done Done true
25336 5966 Acked 6965 Read 6 New Done Done true
25337 5967 Acked 6966 Read 4 New Done Done true
25338 5968 Acked 6967 Flush 0 New Done Done true
25339 5969 Acked 6968 Read 6 New Done Done true
25340 5970 Acked 6969 Read 9 New Done Done true
25341 5971 Acked 6970 Read 9 New Done Done true
25342 5972 Acked 6971 Read 4 New Done Done true
25343 5973 Acked 6972 Write 3 New Done Done true
25344 5974 Acked 6973 Flush 0 New Done Done true
25345 5975 Acked 6974 Read 3 New Done Done true
25346 5976 Acked 6975 Read 3 New Done Done true
25347 5977 Acked 6976 Read 2 New Done Done true
25348 5978 Acked 6977 Read 10 New Done Done true
25349 5979 Acked 6978 Read 3 New Done Done true
25350 5980 Acked 6979 Read 10 New Done Done true
25351 5981 Acked 6980 Write 2 New Done Done true
25352 5982 Acked 6981 Write 10 New Done Done true
25353 5983 Acked 6982 Write 1 New Done Done true
25354 5984 Acked 6983 Read 1 New Done Done true
25355 5985 Acked 6984 Write 2 New Done Done true
25356 5986 Acked 6985 Write 8 New Done Done true
25357 5987 Acked 6986 Write 7 New Done Done true
25358 5988 Acked 6987 Write 4 New Done Done true
25359 5989 Acked 6988 Read 7 New Done Done true
25360 5990 Acked 6989 Write 2 New Done Done true
25361 5991 Acked 6990 Read 7 New Done Done true
25362 5992 Acked 6991 Read 7 New Done Done true
25363 5993 Acked 6992 Read 8 New Done Done true
25364 5994 Acked 6993 Write 8 New Done Done true
25365 5995 Acked 6994 Read 8 New Done Done true
25366 5996 Acked 6995 Read 9 New Done Done true
25367 5997 Acked 6996 Write 3 New Done Done true
25368 5998 Acked 6997 Write 5 New Done Done true
25369 5999 Acked 6998 Write 1 New Done Done true
25370 6000 Acked 6999 Write 6 New Done Done true
25371 6001 Acked 7000 Read 8 New Done Done true
25372 6002 Acked 7001 Write 10 New Done Done true
25373 6003 Acked 7002 Flush 0 New Done Done true
25374 6004 Acked 7003 Write 10 New Done Done true
25375 6005 Acked 7004 Write 9 New Done Done true
25376 6006 Acked 7005 Read 4 New Done Done true
25377 6007 Acked 7006 Read 3 New Done Done true
25378 6008 Acked 7007 Write 6 New Done Done true
25379 6009 Acked 7008 Write 2 New Done Done true
25380 6010 Acked 7009 Write 2 New Done Done true
25381 6011 Acked 7010 Write 8 New Done Done true
25382 6012 Acked 7011 Write 5 New Done Done true
25383 6013 Acked 7012 Write 2 New Done Done true
25384 6014 Acked 7013 Read 9 New Done Done true
25385 6015 Acked 7014 Write 5 New Done Done true
25386 6016 Acked 7015 Read 1 New Done Done true
25387 6017 Acked 7016 Flush 0 New Done Done true
25388 6018 Acked 7017 Read 7 New Done Done true
25389 6019 Acked 7018 Write 1 New Done Done true
25390 6020 Acked 7019 Read 4 New Done Done true
25391 6021 Acked 7020 Read 1 New Done Done true
25392 6022 Acked 7021 Read 7 New Done Done true
25393 6023 Acked 7022 Write 1 New Done Done true
25394 6024 Acked 7023 Read 5 New Done Done true
25395 6025 Acked 7024 Read 6 New Done Done true
25396 6026 Acked 7025 Read 10 New Done Done true
25397 6027 Acked 7026 Write 4 New Done Done true
25398 6028 Acked 7027 Read 2 New Done Done true
25399 6029 Acked 7028 Flush 0 New Done Done true
25400 STATES DS:0 DS:1 DS:2 TOTAL
25401 New 301 0 0 301
25402 Sent 0 0 0 0
25403 Done 0 301 301 602
25404 Skipped 0 0 0 0
25405 Error 0 0 0 0
25406 Last Flush: 6727 7028 7028
25407 Downstairs last five completed: 6727 6726 6725 6724 6723
25408 Upstairs last five completed: 6029 6028 6027 6026 6025
25409 CLIENT: Up:0 ds:301 act:2
254102024-04-20T01:10:26.140ZINFOcrucible: connecting to 127.0.0.1:8810 = io task client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
254112024-04-20T01:10:26.140ZINFOcrucible: ds_connection connected from Ok(127.0.0.1:51020) = io task client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
254122024-04-20T01:10:26.141ZINFOcrucible: downstairs client at Some(127.0.0.1:8810) has region UUID 12345678-0000-0000-0000-000000008810 = downstairs client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
254132024-04-20T01:10:26.141ZINFOcrucible: Returning UUID:12345678-0000-0000-0000-000000008810 matches = downstairs client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
254142024-04-20T01:10:26.141ZINFOcrucible: send last flush ID to this DS: 6727 = downstairs client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
254152024-04-20T01:10:26.142ZINFOcrucible: Replied this last flush ID: 6727 = downstairs client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
254162024-04-20T01:10:26.142ZINFOcrucible: ds_transition from Offline to Replay = downstairs client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
254172024-04-20T01:10:26.142ZINFOcrucible: [0] Transition from Offline to Replay = downstairs client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
254182024-04-20T01:10:26.142ZINFOcrucible: ds_transition from Replay to Active = downstairs client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
254192024-04-20T01:10:26.142ZINFOcrucible: [0] Transition from Replay to Active = downstairs client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
25420 ----------------------------------------------------------------
25421 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:0
25422 Downstairs last five completed: 7028 7027 7026 7025 7024
25423 Upstairs last five completed: 6029 6028 6027 6026 6025
25424 CLIENT: Up:0 ds:0 act:3
25425 Replay: All jobs finished, all DS active.
25426 Main task has work to do, go find it
25427 got dsc Stop(2)
25428 stop 2
25429 Apr 20 01:10:26.449 INFO request completed, [8830] Got stop action so:false kr:false
25430 latency_us: 307, response_code: 204, uri: /stop/cid/2, method: POST, req_id: c6b868c6-141c-4d1f-900f-74518ee64c78, remote_addr: 127.0.0.1:60352, local_addr: 127.0.0.1:9998
254312024-04-20T01:10:26.450ZWARNcrucible: downstairs disconnected = io task client = 2 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
254322024-04-20T01:10:26.450ZWARNcrucible: client task is sending Done(Finished) = io task client = 2 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
254332024-04-20T01:10:26.450ZWARNcrucible: downstairs task for 2 stopped due to Finished session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
254342024-04-20T01:10:26.450ZINFOcrucible: Gone missing, transition from Active to Offline = downstairs client = 2 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
254352024-04-20T01:10:26.450ZINFOcrucible: [2] client re-new 0 jobs since flush 7028 = downstairs session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
254362024-04-20T01:10:26.450ZINFOcrucible: [2] Marked 0 jobs for replay since flush: 7028 = downstairs session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
254372024-04-20T01:10:26.450ZINFOcrucible: client task is exiting = io task client = 2 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
25438 Apr 20 01:10:26.450 INFO request completed, latency_us: 162, response_code: 200, uri: /state/cid/2, method: GET, req_id: 6e23d499-a626-46a9-9e45-99ef89d1e5a5, remote_addr: 127.0.0.1:60352, local_addr: 127.0.0.1:9998
25439 [8830] Exited with: ExitStatus(unix_wait_status(9))
25440 [8830][2] reports Exit
25441 Apr 20 01:10:30.453 INFO request completed, latency_us: 219, response_code: 200, uri: /state/cid/2, method: GET, req_id: c467e1e0-7d3a-4c6a-be49-d3e07d5fbc6e, remote_addr: 127.0.0.1:60352, local_addr: 127.0.0.1:9998
25442 001/300 Flush
25443 002/300 Write block 60 len 12288 data: 5 6 5
25444 003/300 Write block 4989 len 8192 data: 4 5
25445 004/300 Write block 3251 len 4096 data: 4
25446 005/300 Write block 4870 len 32768 data: 6 7 7 9 9 10 10 10
25447 006/300 Write block 3386 len 24576 data: 5 5 5 6 4 5
25448 007/300 Write block 734 len 24576 data: 6 6 7 8 7 6
25449 008/300 Read block 3499 len 40960
25450 009/300 Read block 888 len 4096
25451 010/300 Flush
25452 011/300 Write block 3337 len 12288 data: 3 4 6
25453 012/300 Read block 2057 len 28672
25454 013/300 Read block 1088 len 12288
25455 014/300 Write block 4402 len 36864 data: 4 4 3 3 4 7 7 7 5
25456 015/300 Flush
25457 016/300 Read block 292 len 36864
25458 017/300 Write block 3700 len 40960 data: 4 6 6 6 7 5 5 5 5 5
25459 018/300 Read block 3005 len 4096
25460 019/300 Read block 4344 len 20480
25461 020/300 Read block 4003 len 24576
25462 021/300 Flush
25463 022/300 Write block 4193 len 40960 data: 4 4 4 4 6 6 7 7 7 7
25464 023/300 Read block 3276 len 8192
25465 024/300 Write block 2699 len 40960 data: 5 5 5 4 4 4 3 2 3 3
25466 025/300 Read block 4723 len 32768
25467 026/300 Read block 4839 len 16384
25468 027/300 Write block 1669 len 12288 data: 5 5 4
25469 028/300 Write block 32 len 36864 data: 2 2 2 2 3 4 5 6 6
25470 029/300 Write block 2432 len 32768 data: 3 3 3 3 3 3 4 6
25471 030/300 Flush
25472 031/300 Write block 3033 len 16384 data: 2 2 3 4
25473 032/300 Read block 1270 len 24576
25474 033/300 Read block 4131 len 16384
25475 034/300 Write block 3586 len 4096 data: 3
25476 035/300 Read block 908 len 24576
25477 036/300 Write block 479 len 12288 data: 5 4 4
25478 037/300 Write block 1472 len 16384 data: 6 6 4 5
25479 038/300 Read block 3134 len 24576
25480 039/300 Read block 2206 len 32768
25481 040/300 Write block 2621 len 28672 data: 6 6 5 5 5 4 4
25482 041/300 Read block 2674 len 28672
25483 042/300 Write block 4003 len 20480 data: 7 7 8 7 5
25484 043/300 Read block 3803 len 32768
25485 044/300 Read block 343 len 12288
25486 045/300 Read block 3917 len 4096
25487 046/300 Read block 4593 len 8192
25488 047/300 Write block 1464 len 12288 data: 3 5 5
25489 048/300 Write block 4922 len 8192 data: 6 4
25490 049/300 Write block 4547 len 8192 data: 5 5
25491 050/300 Read block 4553 len 40960
25492 051/300 Write block 2499 len 16384 data: 5 5 4 4
25493 052/300 Write block 2978 len 36864 data: 3 2 6 6 7 7 5 5 5
25494 053/300 Flush
25495 054/300 Read block 3188 len 4096
25496 055/300 Write block 1663 len 36864 data: 4 5 5 5 8 7 6 6 5
25497 056/300 Read block 4104 len 40960
25498 057/300 Write block 631 len 8192 data: 3 2
25499 058/300 Read block 2559 len 20480
25500 059/300 Write block 1249 len 40960 data: 3 3 2 3 5 5 7 7 5 5
25501 060/300 Read block 2587 len 28672
25502 061/300 Write block 2170 len 32768 data: 6 6 6 4 4 3 4 3
25503 062/300 Write block 2802 len 28672 data: 5 5 6 4 4 4 4
25504 063/300 Read block 190 len 4096
25505 064/300 Write block 934 len 20480 data: 4 5 5 5 4
25506 065/300 Write block 3210 len 40960 data: 4 4 5 5 3 3 4 3 2 3
25507 066/300 Write block 2298 len 36864 data: 4 3 3 4 6 5 6 6 5
25508 067/300 Write block 3339 len 12288 data: 7 6 6
25509 068/300 Write block 1628 len 8192 data: 3 3
25510 069/300 Read block 4009 len 36864
25511 070/300 Read block 3429 len 24576
25512 071/300 Read block 1149 len 32768
25513 072/300 Read block 4762 len 32768
25514 073/300 Write block 4596 len 28672 data: 3 5 5 5 4 3 2
25515 074/300 Read block 966 len 8192
25516 075/300 Read block 3448 len 16384
25517 076/300 Write block 2583 len 28672 data: 4 6 6 6 5 5 5
25518 077/300 Write block 949 len 28672 data: 5 5 7 6 6 4 3
25519 078/300 Write block 2266 len 16384 data: 4 2 3 2
25520 079/300 Read block 4041 len 24576
25521 080/300 Flush
25522 081/300 Read block 3907 len 40960
25523 082/300 Read block 1333 len 12288
25524 083/300 Read block 3974 len 16384
25525 084/300 Flush
25526 085/300 Write block 1868 len 8192 data: 4 4
25527 086/300 Read block 3023 len 40960
25528 087/300 Write block 4675 len 40960 data: 6 7 7 7 7 4 5 6 5 5
25529 088/300 Read block 2182 len 28672
25530 089/300 Read block 1318 len 24576
25531 090/300 Write block 4667 len 36864 data: 3 3 3 5 5 3 4 4 7
25532 091/300 Write block 4048 len 36864 data: 3 3 4 4 5 6 7 6 4
25533 092/300 Write block 815 len 36864 data: 5 3 4 4 3 4 4 4 5
25534 093/300 Write block 1589 len 24576 data: 6 5 6 6 5 6
25535 094/300 Read block 4112 len 8192
25536 095/300 Write block 3749 len 32768 data: 5 6 7 6 5 5 6 6
25537 096/300 Read block 4676 len 28672
25538 097/300 Read block 95 len 16384
25539 098/300 Read block 4134 len 40960
25540 099/300 Write block 2574 len 32768 data: 3 3 2 3 4 5 4 4
25541 100/300 Read block 3189 len 20480
25542 101/300 Write block 1304 len 40960 data: 9 9 9 9 7 5 5 5 5 4
25543 102/300 Read block 3219 len 36864
25544 103/300 Read block 3718 len 12288
25545 104/300 Write block 2515 len 40960 data: 7 7 8 7 6 6 5 5 5 4
25546 105/300 Write block 2858 len 24576 data: 5 5 4 4 4 5
25547 106/300 Read block 4228 len 4096
25548 107/300 Write block 2936 len 36864 data: 2 4 6 5 5 5 4 4 5
25549 108/300 Write block 4726 len 24576 data: 4 4 4 3 3 3
25550 109/300 Flush
25551 110/300 Write block 1172 len 36864 data: 6 6 6 5 5 3 4 4 4
25552 111/300 Write block 1684 len 32768 data: 4 5 6 5 4 4 3 3
25553 112/300 Read block 3339 len 20480
25554 113/300 Write block 2532 len 12288 data: 5 4 3
25555 114/300 Write block 759 len 4096 data: 3
25556 115/300 Flush
25557 116/300 Read block 2591 len 4096
25558 117/300 Flush
25559 118/300 Write block 4592 len 16384 data: 3 3 4 3
25560 119/300 Read block 1056 len 32768
25561 120/300 Write block 2861 len 16384 data: 5 5 6 5
25562 121/300 Read block 911 len 28672
25563 122/300 Flush
25564 123/300 Read block 4865 len 16384
25565 124/300 Read block 2103 len 4096
25566 125/300 Read block 3414 len 36864
25567 126/300 Write block 3956 len 12288 data: 10 9 9
25568 127/300 Read block 135 len 4096
25569 128/300 Read block 219 len 40960
25570 129/300 Write block 3406 len 12288 data: 6 4 3
25571 130/300 Read block 8 len 4096
25572 131/300 Write block 4970 len 20480 data: 4 4 4 4 2
25573 132/300 Write block 596 len 40960 data: 5 5 5 4 3 3 5 4 5 5
25574 133/300 Read block 3495 len 12288
25575 134/300 Read block 4218 len 20480
25576 135/300 Write block 2531 len 16384 data: 5 6 5 4
25577 136/300 Read block 1393 len 40960
25578 137/300 Write block 1232 len 4096 data: 6
25579 138/300 Write block 523 len 12288 data: 8 8 7
25580 139/300 Read block 3670 len 12288
25581 140/300 Read block 3000 len 28672
25582 141/300 Read block 719 len 32768
25583 142/300 Read block 1215 len 20480
25584 143/300 Read block 3531 len 20480
25585 144/300 Read block 2573 len 12288
25586 145/300 Read block 3178 len 24576
25587 146/300 Read block 399 len 8192
25588 147/300 Read block 1752 len 20480
25589 148/300 Write block 2614 len 24576 data: 4 4 6 6 6 7
25590 149/300 Read block 4195 len 32768
25591 150/300 Write block 3307 len 4096 data: 5
25592 151/300 Read block 3632 len 32768
25593 152/300 Read block 2648 len 40960
25594 153/300 Write block 3544 len 4096 data: 3
25595 154/300 Read block 4512 len 16384
25596 155/300 Read block 2372 len 20480
25597 156/300 Read block 405 len 32768
25598 157/300 Read block 4490 len 40960
25599 158/300 Write block 4615 len 24576 data: 4 3 3 3 3 3
25600 159/300 Write block 3395 len 24576 data: 4 4 4 3 4 5
25601 160/300 Read block 2813 len 16384
25602 161/300 Write block 1099 len 16384 data: 6 9 8 8
25603 162/300 Write block 3581 len 32768 data: 5 4 5 4 4 4 3 3
25604 163/300 Write block 1090 len 36864 data: 7 7 5 6 5 5 5 6 7
25605 164/300 Write block 1367 len 20480 data: 4 4 3 3 4
25606 165/300 Read block 4124 len 20480
25607 166/300 Write block 2100 len 28672 data: 3 5 6 6 5 5 5
25608 167/300 Read block 817 len 4096
25609 168/300 Write block 658 len 12288 data: 6 5 5
25610 169/300 Write block 1086 len 36864 data: 6 5 5 5 8 8 6 7 6
25611 170/300 Write block 267 len 12288 data: 4 6 7
25612 171/300 Flush
25613 172/300 Read block 2088 len 8192
25614 173/300 Write block 1451 len 24576 data: 4 4 3 3 4 4
25615 174/300 Write block 632 len 12288 data: 3 3 3
25616 175/300 Write block 678 len 32768 data: 5 4 3 4 5 5 7 7
25617 176/300 Flush
25618 177/300 Flush
25619 178/300 Write block 4873 len 36864 data: 10 10 11 11 11 8 7 6 5
25620 179/300 Read block 1660 len 12288
25621 180/300 Write block 2871 len 4096 data: 3
25622 181/300 Write block 4899 len 4096 data: 4
25623 182/300 Write block 3789 len 28672 data: 10 8 5 4 4 4 4
25624 183/300 Read block 2678 len 12288
25625 184/300 Flush
25626 185/300 Flush
25627 186/300 Read block 814 len 40960
25628 187/300 Read block 733 len 28672
25629 188/300 Write block 2821 len 20480 data: 5 4 4 5 4
25630 189/300 Read block 232 len 36864
25631 190/300 Read block 910 len 28672
25632 191/300 Write block 1866 len 16384 data: 3 4 5 5
25633 192/300 Read block 1044 len 40960
25634 193/300 Write block 349 len 4096 data: 3
25635 194/300 Read block 2476 len 36864
25636 195/300 Write block 723 len 36864 data: 5 4 4 4 4 6 8 7 6
25637 196/300 Write block 3623 len 32768 data: 2 3 2 2 2 2 2 2
25638 197/300 Write block 678 len 8192 data: 6 5
25639 198/300 Read block 4150 len 4096
25640 199/300 Write block 536 len 4096 data: 4
25641 200/300 Read block 3475 len 12288
25642 201/300 Read block 659 len 4096
25643 202/300 Write block 3122 len 28672 data: 4 4 4 4 4 5 6
25644 203/300 Read block 685 len 8192
25645 204/300 Read block 561 len 36864
25646 205/300 Read block 1560 len 4096
25647 206/300 Write block 482 len 12288 data: 4 4 4
25648 207/300 Flush
25649 208/300 Read block 4913 len 4096
25650 209/300 Write block 3678 len 8192 data: 3 4
25651 210/300 Write block 1723 len 12288 data: 5 5 5
25652 211/300 Write block 2659 len 32768 data: 3 4 4 4 5 8 8 8
25653 212/300 Read block 2330 len 16384
25654 213/300 Read block 1712 len 32768
25655 214/300 Read block 3805 len 28672
25656 215/300 Read block 1695 len 12288
25657 216/300 Read block 3421 len 20480
25658 217/300 Read block 265 len 12288
25659 218/300 Write block 2148 len 24576 data: 3 2 3 3 4 5
25660 219/300 Read block 4991 len 36864
25661 220/300 Read block 4698 len 40960
25662 221/300 Read block 1193 len 40960
25663 222/300 Write block 4021 len 24576 data: 4 5 5 5 5 5
25664 223/300 Write block 3999 len 16384 data: 4 5 7 7
25665 224/300 Flush
25666 225/300 Flush
25667 226/300 Read block 297 len 4096
25668 227/300 Read block 2294 len 4096
25669 228/300 Flush
25670 229/300 Write block 4490 len 36864 data: 4 4 3 3 3 5 5 3 3
25671 230/300 Write block 3938 len 40960 data: 2 3 2 3 2 2 3 3 4 4
25672 231/300 Read block 2491 len 16384
25673 232/300 Write block 264 len 24576 data: 5 4 4 5 7 8
25674 233/300 Read block 1359 len 12288
25675 234/300 Read block 1739 len 24576
25676 235/300 Write block 1015 len 16384 data: 4 4 3 4
25677 236/300 Write block 106 len 36864 data: 3 3 3 3 3 4 6 7 6
25678 237/300 Read block 4741 len 20480
25679 238/300 Write block 2077 len 4096 data: 4
25680 239/300 Write block 419 len 16384 data: 5 5 5 7
25681 240/300 Read block 1351 len 20480
25682 241/300 Flush
25683 242/300 Write block 3032 len 24576 data: 2 3 3 4 5 6
25684 243/300 Write block 1960 len 28672 data: 6 4 4 5 4 3 3
25685 244/300 Write block 1519 len 40960 data: 9 7 6 5 4 4 4 3 4 4
25686 245/300 Read block 3574 len 32768
25687 246/300 Flush
25688 247/300 Read block 2633 len 4096
25689 248/300 Read block 2780 len 24576
25690 249/300 Write block 810 len 4096 data: 4
25691 250/300 Write block 979 len 16384 data: 5 4 4 3
25692 251/300 Read block 3118 len 16384
25693 252/300 Read block 2155 len 32768
25694 253/300 Write block 4716 len 16384 data: 4 4 2 2
25695 254/300 Flush
25696 255/300 Read block 3943 len 32768
25697 256/300 Write block 919 len 12288 data: 5 5 4
25698 257/300 Read block 2178 len 28672
25699 258/300 Write block 3436 len 40960 data: 4 3 5 5 6 7 7 4 5 5
25700 259/300 Flush
25701 260/300 Read block 244 len 32768
25702 261/300 Read block 4258 len 8192
25703 262/300 Write block 1067 len 8192 data: 2 2
25704 263/300 Flush
25705 264/300 Read block 2672 len 12288
25706 265/300 Read block 2918 len 28672
25707 266/300 Write block 2646 len 4096 data: 6
25708 267/300 Read block 2340 len 24576
25709 268/300 Write block 416 len 4096 data: 6
25710 269/300 Write block 3398 len 32768 data: 4 5 6 4 3 3 3 5
25711 270/300 Read block 513 len 8192
25712 271/300 Write block 2900 len 4096 data: 6
25713 272/300 Read block 4981 len 16384
25714 273/300 Read block 1583 len 16384
25715 274/300 Read block 4492 len 8192
25716 275/300 Write block 2718 len 28672 data: 5 7 4 5 6 7 9
25717 276/300 Flush
25718 277/300 Flush
25719 278/300 Read block 1573 len 28672
25720 279/300 Read block 3627 len 12288
25721 280/300 Write block 671 len 20480 data: 6 5 7 7 6
25722 281/300 Read block 2765 len 12288
25723 282/300 Read block 881 len 12288
25724 283/300 Read block 1969 len 20480
25725 284/300 Write block 1530 len 12288 data: 6 6 5
25726 285/300 Read block 292 len 32768
25727 286/300 Read block 1575 len 4096
25728 287/300 Read block 218 len 8192
25729 288/300 Read block 1709 len 40960
25730 289/300 Read block 3982 len 16384
25731 290/300 Read block 4449 len 40960
25732 291/300 Write block 2189 len 32768 data: 4 4 4 4 5 5 5 4
25733 292/300 Read block 4683 len 4096
25734 293/300 Read block 107 len 16384
25735 294/300 Read block 4170 len 32768
25736 295/300 Write block 3207 len 28672 data: 4 3 4 5 5 6 6
25737 296/300 Read block 1177 len 40960
25738 297/300 Flush
25739 298/300 Write block 1890 len 4096 data: 2
25740 299/300 Read block 1105 len 12288
25741 300/300 Read block 3038 len 20480
25742 Main task has work to do, go find it
25743 got dsc Start(2)
25744 start 2
25745 Apr 20 01:10:30.755 INFO request completed, latency_us: 216, response_code: 204, uri: /start/cid/2, method: POST, req_id: 94bc7c37-f713-4b98-b797-4852a18fb85d, remote_addr: 127.0.0.1:60352, local_addr: 127.0.0.1:9998
25746 Replay: started 2, returned:Ok(())
25747 ----------------------------------------------------------------
25748 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:300
25749 States: Active Active Offline
25750 GW_ID ACK DSID TYPE BLOCKS DS:0 DS:1 DS:2 REPLAY
25751 6030 Acked 7029 Flush 0 Done Done New false
25752 6031 Acked 7030 Write 3 Done Done New false
25753 6032 Acked 7031 Write 2 Done Done New false
25754 6033 Acked 7032 Write 1 Done Done New false
25755 6034 Acked 7033 Write 8 Done Done New false
25756 6035 Acked 7034 Write 6 Done Done New false
25757 6036 Acked 7035 Write 6 Done Done New false
25758 6037 Acked 7036 Read 10 Done Done New false
25759 6038 Acked 7037 Read 1 Done Done New false
25760 6039 Acked 7038 Flush 0 Done Done New false
25761 6040 Acked 7039 Write 3 Done Done New false
25762 6041 Acked 7040 Read 7 Done Done New false
25763 6042 Acked 7041 Read 3 Done Done New false
25764 6043 Acked 7042 Write 9 Done Done New false
25765 6044 Acked 7043 Flush 0 Done Done New false
25766 6045 Acked 7044 Read 9 Done Done New false
25767 6046 Acked 7045 Write 10 Done Done New false
25768 6047 Acked 7046 Read 1 Done Done New false
25769 6048 Acked 7047 Read 5 Done Done New false
25770 6049 Acked 7048 Read 6 Done Done New false
25771 6050 Acked 7049 Flush 0 Done Done New false
25772 6051 Acked 7050 Write 10 Done Done New false
25773 6052 Acked 7051 Read 2 Done Done New false
25774 6053 Acked 7052 Write 10 Done Done New false
25775 6054 Acked 7053 Read 8 Done Done New false
25776 6055 Acked 7054 Read 4 Done Done New false
25777 6056 Acked 7055 Write 3 Done Done New false
25778 6057 Acked 7056 Write 9 Done Done New false
25779 6058 Acked 7057 Write 8 Done Done New false
25780 6059 Acked 7058 Flush 0 Done Done New false
25781 6060 Acked 7059 Write 4 Done Done New false
25782 6061 Acked 7060 Read 6 Done Done New false
25783 6062 Acked 7061 Read 4 Done Done New false
25784 6063 Acked 7062 Write 1 Done Done New false
25785 6064 Acked 7063 Read 6 Done Done New false
25786 6065 Acked 7064 Write 3 Done Done New false
25787 6066 Acked 7065 Write 4 Done Done New false
25788 6067 Acked 7066 Read 6 Done Done New false
25789 6068 Acked 7067 Read 8 Done Done New false
25790 6069 Acked 7068 Write 7 Done Done New false
25791 6070 Acked 7069 Read 7 Done Done New false
25792 6071 Acked 7070 Write 5 Done Done New false
25793 6072 Acked 7071 Read 8 Done Done New false
25794 6073 Acked 7072 Read 3 Done Done New false
25795 6074 Acked 7073 Read 1 Done Done New false
25796 6075 Acked 7074 Read 2 Done Done New false
25797 6076 Acked 7075 Write 3 Done Done New false
25798 6077 Acked 7076 Write 2 Done Done New false
25799 6078 Acked 7077 Write 2 Done Done New false
25800 6079 Acked 7078 Read 10 Done Done New false
25801 6080 Acked 7079 Write 4 Done Done New false
25802 6081 Acked 7080 Write 9 Done Done New false
25803 6082 Acked 7081 Flush 0 Done Done New false
25804 6083 Acked 7082 Read 1 Done Done New false
25805 6084 Acked 7083 Write 9 Done Done New false
25806 6085 Acked 7084 Read 10 Done Done New false
25807 6086 Acked 7085 Write 2 Done Done New false
25808 6087 Acked 7086 Read 5 Done Done New false
25809 6088 Acked 7087 Write 10 Done Done New false
25810 6089 Acked 7088 Read 7 Done Done New false
25811 6090 Acked 7089 Write 8 Done Done New false
25812 6091 Acked 7090 Write 7 Done Done New false
25813 6092 Acked 7091 Read 1 Done Done New false
25814 6093 Acked 7092 Write 5 Done Done New false
25815 6094 Acked 7093 Write 10 Done Done New false
25816 6095 Acked 7094 Write 9 Done Done New false
25817 6096 Acked 7095 Write 3 Done Done New false
25818 6097 Acked 7096 Write 2 Done Done New false
25819 6098 Acked 7097 Read 9 Done Done New false
25820 6099 Acked 7098 Read 6 Done Done New false
25821 6100 Acked 7099 Read 8 Done Done New false
25822 6101 Acked 7100 Read 8 Done Done New false
25823 6102 Acked 7101 Write 7 Done Done New false
25824 6103 Acked 7102 Read 2 Done Done New false
25825 6104 Acked 7103 Read 4 Done Done New false
25826 6105 Acked 7104 Write 7 Done Done New false
25827 6106 Acked 7105 Write 7 Done Done New false
25828 6107 Acked 7106 Write 4 Done Done New false
25829 6108 Acked 7107 Read 6 Done Done New false
25830 6109 Acked 7108 Flush 0 Done Done New false
25831 6110 Acked 7109 Read 10 Done Done New false
25832 6111 Acked 7110 Read 3 Done Done New false
25833 6112 Acked 7111 Read 4 Done Done New false
25834 6113 Acked 7112 Flush 0 Done Done New false
25835 6114 Acked 7113 Write 2 Done Done New false
25836 6115 Acked 7114 Read 10 Done Done New false
25837 6116 Acked 7115 Write 10 Done Done New false
25838 6117 Acked 7116 Read 7 Done Done New false
25839 6118 Acked 7117 Read 6 Done Done New false
25840 6119 Acked 7118 Write 9 Done Done New false
25841 6120 Acked 7119 Write 9 Done Done New false
25842 6121 Acked 7120 Write 9 Done Done New false
25843 6122 Acked 7121 Write 6 Done Done New false
25844 6123 Acked 7122 Read 2 Done Done New false
25845 6124 Acked 7123 Write 8 Done Done New false
25846 6125 Acked 7124 Read 7 Done Done New false
25847 6126 Acked 7125 Read 4 Done Done New false
25848 6127 Acked 7126 Read 10 Done Done New false
25849 6128 Acked 7127 Write 8 Done Done New false
25850 6129 Acked 7128 Read 5 Done Done New false
25851 6130 Acked 7129 Write 10 Done Done New false
25852 6131 Acked 7130 Read 9 Done Done New false
25853 6132 Acked 7131 Read 3 Done Done New false
25854 6133 Acked 7132 Write 10 Done Done New false
25855 6134 Acked 7133 Write 6 Done Done New false
25856 6135 Acked 7134 Read 1 Done Done New false
25857 6136 Acked 7135 Write 9 Done Done New false
25858 6137 Acked 7136 Write 6 Done Done New false
25859 6138 Acked 7137 Flush 0 Done Done New false
25860 6139 Acked 7138 Write 9 Done Done New false
25861 6140 Acked 7139 Write 8 Done Done New false
25862 6141 Acked 7140 Read 5 Done Done New false
25863 6142 Acked 7141 Write 3 Done Done New false
25864 6143 Acked 7142 Write 1 Done Done New false
25865 6144 Acked 7143 Flush 0 Done Done New false
25866 6145 Acked 7144 Read 1 Done Done New false
25867 6146 Acked 7145 Flush 0 Done Done New false
25868 6147 Acked 7146 Write 4 Done Done New false
25869 6148 Acked 7147 Read 8 Done Done New false
25870 6149 Acked 7148 Write 4 Done Done New false
25871 6150 Acked 7149 Read 7 Done Done New false
25872 6151 Acked 7150 Flush 0 Done Done New false
25873 6152 Acked 7151 Read 4 Done Done New false
25874 6153 Acked 7152 Read 1 Done Done New false
25875 6154 Acked 7153 Read 9 Done Done New false
25876 6155 Acked 7154 Write 3 Done Done New false
25877 6156 Acked 7155 Read 1 Done Done New false
25878 6157 Acked 7156 Read 10 Done Done New false
25879 6158 Acked 7157 Write 3 Done Done New false
25880 6159 Acked 7158 Read 1 Done Done New false
25881 6160 Acked 7159 Write 5 Done Done New false
25882 6161 Acked 7160 Write 10 Done Done New false
25883 6162 Acked 7161 Read 3 Done Done New false
25884 6163 Acked 7162 Read 5 Done Done New false
25885 6164 Acked 7163 Write 4 Done Done New false
25886 6165 Acked 7164 Read 10 Done Done New false
25887 6166 Acked 7165 Write 1 Done Done New false
25888 6167 Acked 7166 Write 3 Done Done New false
25889 6168 Acked 7167 Read 3 Done Done New false
25890 6169 Acked 7168 Read 7 Done Done New false
25891 6170 Acked 7169 Read 8 Done Done New false
25892 6171 Acked 7170 Read 5 Done Done New false
25893 6172 Acked 7171 Read 5 Done Done New false
25894 6173 Acked 7172 Read 3 Done Done New false
25895 6174 Acked 7173 Read 6 Done Done New false
25896 6175 Acked 7174 Read 2 Done Done New false
25897 6176 Acked 7175 Read 5 Done Done New false
25898 6177 Acked 7176 Write 6 Done Done New false
25899 6178 Acked 7177 Read 8 Done Done New false
25900 6179 Acked 7178 Write 1 Done Done New false
25901 6180 Acked 7179 Read 8 Done Done New false
25902 6181 Acked 7180 Read 10 Done Done New false
25903 6182 Acked 7181 Write 1 Done Done New false
25904 6183 Acked 7182 Read 4 Done Done New false
25905 6184 Acked 7183 Read 5 Done Done New false
25906 6185 Acked 7184 Read 8 Done Done New false
25907 6186 Acked 7185 Read 10 Done Done New false
25908 6187 Acked 7186 Write 6 Done Done New false
25909 6188 Acked 7187 Write 6 Done Done New false
25910 6189 Acked 7188 Read 4 Done Done New false
25911 6190 Acked 7189 Write 4 Done Done New false
25912 6191 Acked 7190 Write 8 Done Done New false
25913 6192 Acked 7191 Write 9 Done Done New false
25914 6193 Acked 7192 Write 5 Done Done New false
25915 6194 Acked 7193 Read 5 Done Done New false
25916 6195 Acked 7194 Write 7 Done Done New false
25917 6196 Acked 7195 Read 1 Done Done New false
25918 6197 Acked 7196 Write 3 Done Done New false
25919 6198 Acked 7197 Write 9 Done Done New false
25920 6199 Acked 7198 Write 3 Done Done New false
25921 6200 Acked 7199 Flush 0 Done Done New false
25922 6201 Acked 7200 Read 2 Done Done New false
25923 6202 Acked 7201 Write 6 Done Done New false
25924 6203 Acked 7202 Write 3 Done Done New false
25925 6204 Acked 7203 Write 8 Done Done New false
25926 6205 Acked 7204 Flush 0 Done Done New false
25927 6206 Acked 7205 Flush 0 Done Done New false
25928 6207 Acked 7206 Write 9 Done Done New false
25929 6208 Acked 7207 Read 3 Done Done New false
25930 6209 Acked 7208 Write 1 Done Done New false
25931 6210 Acked 7209 Write 1 Done Done New false
25932 6211 Acked 7210 Write 7 Done Done New false
25933 6212 Acked 7211 Read 3 Done Done New false
25934 6213 Acked 7212 Flush 0 Done Done New false
25935 6214 Acked 7213 Flush 0 Done Done New false
25936 6215 Acked 7214 Read 10 Done Done New false
25937 6216 Acked 7215 Read 7 Done Done New false
25938 6217 Acked 7216 Write 5 Done Done New false
25939 6218 Acked 7217 Read 9 Done Done New false
25940 6219 Acked 7218 Read 7 Done Done New false
25941 6220 Acked 7219 Write 4 Done Done New false
25942 6221 Acked 7220 Read 10 Done Done New false
25943 6222 Acked 7221 Write 1 Done Done New false
25944 6223 Acked 7222 Read 9 Done Done New false
25945 6224 Acked 7223 Write 9 Done Done New false
25946 6225 Acked 7224 Write 8 Done Done New false
25947 6226 Acked 7225 Write 2 Done Done New false
25948 6227 Acked 7226 Read 1 Done Done New false
25949 6228 Acked 7227 Write 1 Done Done New false
25950 6229 Acked 7228 Read 3 Done Done New false
25951 6230 Acked 7229 Read 1 Done Done New false
25952 6231 Acked 7230 Write 7 Done Done New false
25953 6232 Acked 7231 Read 2 Done Done New false
25954 6233 Acked 7232 Read 9 Done Done New false
25955 6234 Acked 7233 Read 1 Done Done New false
25956 6235 Acked 7234 Write 3 Done Done New false
25957 6236 Acked 7235 Flush 0 Done Done New false
25958 6237 Acked 7236 Read 1 Done Done New false
25959 6238 Acked 7237 Write 2 Done Done New false
25960 6239 Acked 7238 Write 3 Done Done New false
25961 6240 Acked 7239 Write 8 Done Done New false
25962 6241 Acked 7240 Read 4 Done Done New false
25963 6242 Acked 7241 Read 8 Done Done New false
25964 6243 Acked 7242 Read 7 Done Done New false
25965 6244 Acked 7243 Read 3 Done Done New false
25966 6245 Acked 7244 Read 5 Done Done New false
25967 6246 Acked 7245 Read 3 Done Done New false
25968 6247 Acked 7246 Write 6 Done Done New false
25969 6248 Acked 7247 Read 9 Done Done New false
25970 6249 Acked 7248 Read 10 Done Done New false
25971 6250 Acked 7249 Read 10 Done Done New false
25972 6251 Acked 7250 Write 6 Done Done New false
25973 6252 Acked 7251 Write 4 Done Done New false
25974 6253 Acked 7252 Flush 0 Done Done New false
25975 6254 Acked 7253 Flush 0 Done Done New false
25976 6255 Acked 7254 Read 1 Done Done New false
25977 6256 Acked 7255 Read 1 Done Done New false
25978 6257 Acked 7256 Flush 0 Done Done New false
25979 6258 Acked 7257 Write 9 Done Done New false
25980 6259 Acked 7258 Write 10 Done Done New false
25981 6260 Acked 7259 Read 4 Done Done New false
25982 6261 Acked 7260 Write 6 Done Done New false
25983 6262 Acked 7261 Read 3 Done Done New false
25984 6263 Acked 7262 Read 6 Done Done New false
25985 6264 Acked 7263 Write 4 Done Done New false
25986 6265 Acked 7264 Write 9 Done Done New false
25987 6266 Acked 7265 Read 5 Done Done New false
25988 6267 Acked 7266 Write 1 Done Done New false
25989 6268 Acked 7267 Write 4 Done Done New false
25990 6269 Acked 7268 Read 5 Done Done New false
25991 6270 Acked 7269 Flush 0 Done Done New false
25992 6271 Acked 7270 Write 6 Done Done New false
25993 6272 Acked 7271 Write 7 Done Done New false
25994 6273 Acked 7272 Write 10 Done Done New false
25995 6274 Acked 7273 Read 8 Done Done New false
25996 6275 Acked 7274 Flush 0 Done Done New false
25997 6276 Acked 7275 Read 1 Done Done New false
25998 6277 Acked 7276 Read 6 Done Done New false
25999 6278 Acked 7277 Write 1 Done Done New false
26000 6279 Acked 7278 Write 4 Done Done New false
26001 6280 Acked 7279 Read 4 Done Done New false
26002 6281 Acked 7280 Read 8 Done Done New false
26003 6282 Acked 7281 Write 4 Done Done New false
26004 6283 Acked 7282 Flush 0 Done Done New false
26005 6284 Acked 7283 Read 8 Done Done New false
26006 6285 Acked 7284 Write 3 Done Done New false
26007 6286 Acked 7285 Read 7 Done Done New false
26008 6287 Acked 7286 Write 10 Done Done New false
26009 6288 Acked 7287 Flush 0 Done Done New false
26010 6289 Acked 7288 Read 8 Done Done New false
26011 6290 Acked 7289 Read 2 Done Done New false
26012 6291 Acked 7290 Write 2 Done Done New false
26013 6292 Acked 7291 Flush 0 Done Done New false
26014 6293 Acked 7292 Read 3 Done Done New false
26015 6294 Acked 7293 Read 7 Done Done New false
26016 6295 Acked 7294 Write 1 Done Done New false
26017 6296 Acked 7295 Read 6 Done Done New false
26018 6297 Acked 7296 Write 1 Done Done New false
26019 6298 Acked 7297 Write 8 Done Done New false
26020 6299 Acked 7298 Read 2 Done Done New false
26021 6300 Acked 7299 Write 1 Done Done New false
26022 6301 Acked 7300 Read 4 Done Done New false
26023 6302 Acked 7301 Read 4 Done Done New false
26024 6303 Acked 7302 Read 2 Done Done New false
26025 6304 Acked 7303 Write 7 Done Done New false
26026 6305 Acked 7304 Flush 0 Done Done New false
26027 6306 Acked 7305 Flush 0 Done Done New false
26028 6307 Acked 7306 Read 7 Done Done New false
26029 6308 Acked 7307 Read 3 Done Done New false
26030 6309 Acked 7308 Write 5 Done Done New false
26031 6310 Acked 7309 Read 3 Done Done New false
26032 6311 Acked 7310 Read 3 Done Done New false
26033 6312 Acked 7311 Read 5 Done Done New false
26034 6313 Acked 7312 Write 3 Done Done New false
26035 6314 Acked 7313 Read 8 Done Done New false
26036 6315 Acked 7314 Read 1 Done Done New false
26037 6316 Acked 7315 Read 2 Done Done New false
26038 6317 Acked 7316 Read 10 Done Done New false
26039 6318 Acked 7317 Read 4 Done Done New false
26040 6319 Acked 7318 Read 10 Done Done New false
26041 6320 Acked 7319 Write 8 Done Done New false
26042 6321 Acked 7320 Read 1 Done Done New false
26043 6322 Acked 7321 Read 4 Done Done New false
26044 6323 Acked 7322 Read 8 Done Done New false
26045 6324 Acked 7323 Write 7 Done Done New false
26046 6325 Acked 7324 Read 10 Done Done New false
26047 6326 Acked 7325 Flush 0 Done Done New false
26048 6327 Acked 7326 Write 1 Done Done New false
26049 6328 Acked 7327 Read 3 Done Done New false
26050 6329 Acked 7328 Read 5 Done Done New false
26051 STATES DS:0 DS:1 DS:2 TOTAL
26052 New 0 0 300 300
26053 Sent 0 0 0 0
26054 Done 300 300 0 600
26055 Skipped 0 0 0 0
26056 Error 0 0 0 0
26057 Last Flush: 7325 7325 7028
26058 Downstairs last five completed: 7028 7027 7026 7025 7024
26059 Upstairs last five completed: 6329 6328 6327 6326 6325
26060 CLIENT: Up:0 ds:300 act:2
26061 [8830] got start action
26062 [8830] I am going to restart
26063 Starting downstairs at port 8830
26064 Make output file at "/tmp/dsc/downstairs-8830.txt"
26065 [8830][2] reports Starting
26066 Downstairs /var/tmp/dsc/region/8830 port 8830 PID:Some(1217)
26067 [8830][2] reports Running
26068 ----------------------------------------------------------------
26069 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:301
26070 States: Active Active Offline
26071 GW_ID ACK DSID TYPE BLOCKS DS:0 DS:1 DS:2 REPLAY
26072 6030 Acked 7029 Flush 0 Done Done New false
26073 6031 Acked 7030 Write 3 Done Done New false
26074 6032 Acked 7031 Write 2 Done Done New false
26075 6033 Acked 7032 Write 1 Done Done New false
26076 6034 Acked 7033 Write 8 Done Done New false
26077 6035 Acked 7034 Write 6 Done Done New false
26078 6036 Acked 7035 Write 6 Done Done New false
26079 6037 Acked 7036 Read 10 Done Done New false
26080 6038 Acked 7037 Read 1 Done Done New false
26081 6039 Acked 7038 Flush 0 Done Done New false
26082 6040 Acked 7039 Write 3 Done Done New false
26083 6041 Acked 7040 Read 7 Done Done New false
26084 6042 Acked 7041 Read 3 Done Done New false
26085 6043 Acked 7042 Write 9 Done Done New false
26086 6044 Acked 7043 Flush 0 Done Done New false
26087 6045 Acked 7044 Read 9 Done Done New false
26088 6046 Acked 7045 Write 10 Done Done New false
26089 6047 Acked 7046 Read 1 Done Done New false
26090 6048 Acked 7047 Read 5 Done Done New false
26091 6049 Acked 7048 Read 6 Done Done New false
26092 6050 Acked 7049 Flush 0 Done Done New false
26093 6051 Acked 7050 Write 10 Done Done New false
26094 6052 Acked 7051 Read 2 Done Done New false
26095 6053 Acked 7052 Write 10 Done Done New false
26096 6054 Acked 7053 Read 8 Done Done New false
26097 6055 Acked 7054 Read 4 Done Done New false
26098 6056 Acked 7055 Write 3 Done Done New false
26099 6057 Acked 7056 Write 9 Done Done New false
26100 6058 Acked 7057 Write 8 Done Done New false
26101 6059 Acked 7058 Flush 0 Done Done New false
26102 6060 Acked 7059 Write 4 Done Done New false
26103 6061 Acked 7060 Read 6 Done Done New false
26104 6062 Acked 7061 Read 4 Done Done New false
26105 6063 Acked 7062 Write 1 Done Done New false
26106 6064 Acked 7063 Read 6 Done Done New false
26107 6065 Acked 7064 Write 3 Done Done New false
26108 6066 Acked 7065 Write 4 Done Done New false
26109 6067 Acked 7066 Read 6 Done Done New false
26110 6068 Acked 7067 Read 8 Done Done New false
26111 6069 Acked 7068 Write 7 Done Done New false
26112 6070 Acked 7069 Read 7 Done Done New false
26113 6071 Acked 7070 Write 5 Done Done New false
26114 6072 Acked 7071 Read 8 Done Done New false
26115 6073 Acked 7072 Read 3 Done Done New false
26116 6074 Acked 7073 Read 1 Done Done New false
26117 6075 Acked 7074 Read 2 Done Done New false
26118 6076 Acked 7075 Write 3 Done Done New false
26119 6077 Acked 7076 Write 2 Done Done New false
26120 6078 Acked 7077 Write 2 Done Done New false
26121 6079 Acked 7078 Read 10 Done Done New false
26122 6080 Acked 7079 Write 4 Done Done New false
26123 6081 Acked 7080 Write 9 Done Done New false
26124 6082 Acked 7081 Flush 0 Done Done New false
26125 6083 Acked 7082 Read 1 Done Done New false
26126 6084 Acked 7083 Write 9 Done Done New false
26127 6085 Acked 7084 Read 10 Done Done New false
26128 6086 Acked 7085 Write 2 Done Done New false
26129 6087 Acked 7086 Read 5 Done Done New false
26130 6088 Acked 7087 Write 10 Done Done New false
26131 6089 Acked 7088 Read 7 Done Done New false
26132 6090 Acked 7089 Write 8 Done Done New false
26133 6091 Acked 7090 Write 7 Done Done New false
26134 6092 Acked 7091 Read 1 Done Done New false
26135 6093 Acked 7092 Write 5 Done Done New false
26136 6094 Acked 7093 Write 10 Done Done New false
26137 6095 Acked 7094 Write 9 Done Done New false
26138 6096 Acked 7095 Write 3 Done Done New false
26139 6097 Acked 7096 Write 2 Done Done New false
26140 6098 Acked 7097 Read 9 Done Done New false
26141 6099 Acked 7098 Read 6 Done Done New false
26142 6100 Acked 7099 Read 8 Done Done New false
26143 6101 Acked 7100 Read 8 Done Done New false
26144 6102 Acked 7101 Write 7 Done Done New false
26145 6103 Acked 7102 Read 2 Done Done New false
26146 6104 Acked 7103 Read 4 Done Done New false
26147 6105 Acked 7104 Write 7 Done Done New false
26148 6106 Acked 7105 Write 7 Done Done New false
26149 6107 Acked 7106 Write 4 Done Done New false
26150 6108 Acked 7107 Read 6 Done Done New false
26151 6109 Acked 7108 Flush 0 Done Done New false
26152 6110 Acked 7109 Read 10 Done Done New false
26153 6111 Acked 7110 Read 3 Done Done New false
26154 6112 Acked 7111 Read 4 Done Done New false
26155 6113 Acked 7112 Flush 0 Done Done New false
26156 6114 Acked 7113 Write 2 Done Done New false
26157 6115 Acked 7114 Read 10 Done Done New false
26158 6116 Acked 7115 Write 10 Done Done New false
26159 6117 Acked 7116 Read 7 Done Done New false
26160 6118 Acked 7117 Read 6 Done Done New false
26161 6119 Acked 7118 Write 9 Done Done New false
26162 6120 Acked 7119 Write 9 Done Done New false
26163 6121 Acked 7120 Write 9 Done Done New false
26164 6122 Acked 7121 Write 6 Done Done New false
26165 6123 Acked 7122 Read 2 Done Done New false
26166 6124 Acked 7123 Write 8 Done Done New false
26167 6125 Acked 7124 Read 7 Done Done New false
26168 6126 Acked 7125 Read 4 Done Done New false
26169 6127 Acked 7126 Read 10 Done Done New false
26170 6128 Acked 7127 Write 8 Done Done New false
26171 6129 Acked 7128 Read 5 Done Done New false
26172 6130 Acked 7129 Write 10 Done Done New false
26173 6131 Acked 7130 Read 9 Done Done New false
26174 6132 Acked 7131 Read 3 Done Done New false
26175 6133 Acked 7132 Write 10 Done Done New false
26176 6134 Acked 7133 Write 6 Done Done New false
26177 6135 Acked 7134 Read 1 Done Done New false
26178 6136 Acked 7135 Write 9 Done Done New false
26179 6137 Acked 7136 Write 6 Done Done New false
26180 6138 Acked 7137 Flush 0 Done Done New false
26181 6139 Acked 7138 Write 9 Done Done New false
26182 6140 Acked 7139 Write 8 Done Done New false
26183 6141 Acked 7140 Read 5 Done Done New false
26184 6142 Acked 7141 Write 3 Done Done New false
26185 6143 Acked 7142 Write 1 Done Done New false
26186 6144 Acked 7143 Flush 0 Done Done New false
26187 6145 Acked 7144 Read 1 Done Done New false
26188 6146 Acked 7145 Flush 0 Done Done New false
26189 6147 Acked 7146 Write 4 Done Done New false
26190 6148 Acked 7147 Read 8 Done Done New false
26191 6149 Acked 7148 Write 4 Done Done New false
26192 6150 Acked 7149 Read 7 Done Done New false
26193 6151 Acked 7150 Flush 0 Done Done New false
26194 6152 Acked 7151 Read 4 Done Done New false
26195 6153 Acked 7152 Read 1 Done Done New false
26196 6154 Acked 7153 Read 9 Done Done New false
26197 6155 Acked 7154 Write 3 Done Done New false
26198 6156 Acked 7155 Read 1 Done Done New false
26199 6157 Acked 7156 Read 10 Done Done New false
26200 6158 Acked 7157 Write 3 Done Done New false
26201 6159 Acked 7158 Read 1 Done Done New false
26202 6160 Acked 7159 Write 5 Done Done New false
26203 6161 Acked 7160 Write 10 Done Done New false
26204 6162 Acked 7161 Read 3 Done Done New false
26205 6163 Acked 7162 Read 5 Done Done New false
26206 6164 Acked 7163 Write 4 Done Done New false
26207 6165 Acked 7164 Read 10 Done Done New false
26208 6166 Acked 7165 Write 1 Done Done New false
26209 6167 Acked 7166 Write 3 Done Done New false
26210 6168 Acked 7167 Read 3 Done Done New false
26211 6169 Acked 7168 Read 7 Done Done New false
26212 6170 Acked 7169 Read 8 Done Done New false
26213 6171 Acked 7170 Read 5 Done Done New false
26214 6172 Acked 7171 Read 5 Done Done New false
26215 6173 Acked 7172 Read 3 Done Done New false
26216 6174 Acked 7173 Read 6 Done Done New false
26217 6175 Acked 7174 Read 2 Done Done New false
26218 6176 Acked 7175 Read 5 Done Done New false
26219 6177 Acked 7176 Write 6 Done Done New false
26220 6178 Acked 7177 Read 8 Done Done New false
26221 6179 Acked 7178 Write 1 Done Done New false
26222 6180 Acked 7179 Read 8 Done Done New false
26223 6181 Acked 7180 Read 10 Done Done New false
26224 6182 Acked 7181 Write 1 Done Done New false
26225 6183 Acked 7182 Read 4 Done Done New false
26226 6184 Acked 7183 Read 5 Done Done New false
26227 6185 Acked 7184 Read 8 Done Done New false
26228 6186 Acked 7185 Read 10 Done Done New false
26229 6187 Acked 7186 Write 6 Done Done New false
26230 6188 Acked 7187 Write 6 Done Done New false
26231 6189 Acked 7188 Read 4 Done Done New false
26232 6190 Acked 7189 Write 4 Done Done New false
26233 6191 Acked 7190 Write 8 Done Done New false
26234 6192 Acked 7191 Write 9 Done Done New false
26235 6193 Acked 7192 Write 5 Done Done New false
26236 6194 Acked 7193 Read 5 Done Done New false
26237 6195 Acked 7194 Write 7 Done Done New false
26238 6196 Acked 7195 Read 1 Done Done New false
26239 6197 Acked 7196 Write 3 Done Done New false
26240 6198 Acked 7197 Write 9 Done Done New false
26241 6199 Acked 7198 Write 3 Done Done New false
26242 6200 Acked 7199 Flush 0 Done Done New false
26243 6201 Acked 7200 Read 2 Done Done New false
26244 6202 Acked 7201 Write 6 Done Done New false
26245 6203 Acked 7202 Write 3 Done Done New false
26246 6204 Acked 7203 Write 8 Done Done New false
26247 6205 Acked 7204 Flush 0 Done Done New false
26248 6206 Acked 7205 Flush 0 Done Done New false
26249 6207 Acked 7206 Write 9 Done Done New false
26250 6208 Acked 7207 Read 3 Done Done New false
26251 6209 Acked 7208 Write 1 Done Done New false
26252 6210 Acked 7209 Write 1 Done Done New false
26253 6211 Acked 7210 Write 7 Done Done New false
26254 6212 Acked 7211 Read 3 Done Done New false
26255 6213 Acked 7212 Flush 0 Done Done New false
26256 6214 Acked 7213 Flush 0 Done Done New false
26257 6215 Acked 7214 Read 10 Done Done New false
26258 6216 Acked 7215 Read 7 Done Done New false
26259 6217 Acked 7216 Write 5 Done Done New false
26260 6218 Acked 7217 Read 9 Done Done New false
26261 6219 Acked 7218 Read 7 Done Done New false
26262 6220 Acked 7219 Write 4 Done Done New false
26263 6221 Acked 7220 Read 10 Done Done New false
26264 6222 Acked 7221 Write 1 Done Done New false
26265 6223 Acked 7222 Read 9 Done Done New false
26266 6224 Acked 7223 Write 9 Done Done New false
26267 6225 Acked 7224 Write 8 Done Done New false
26268 6226 Acked 7225 Write 2 Done Done New false
26269 6227 Acked 7226 Read 1 Done Done New false
26270 6228 Acked 7227 Write 1 Done Done New false
26271 6229 Acked 7228 Read 3 Done Done New false
26272 6230 Acked 7229 Read 1 Done Done New false
26273 6231 Acked 7230 Write 7 Done Done New false
26274 6232 Acked 7231 Read 2 Done Done New false
26275 6233 Acked 7232 Read 9 Done Done New false
26276 6234 Acked 7233 Read 1 Done Done New false
26277 6235 Acked 7234 Write 3 Done Done New false
26278 6236 Acked 7235 Flush 0 Done Done New false
26279 6237 Acked 7236 Read 1 Done Done New false
26280 6238 Acked 7237 Write 2 Done Done New false
26281 6239 Acked 7238 Write 3 Done Done New false
26282 6240 Acked 7239 Write 8 Done Done New false
26283 6241 Acked 7240 Read 4 Done Done New false
26284 6242 Acked 7241 Read 8 Done Done New false
26285 6243 Acked 7242 Read 7 Done Done New false
26286 6244 Acked 7243 Read 3 Done Done New false
26287 6245 Acked 7244 Read 5 Done Done New false
26288 6246 Acked 7245 Read 3 Done Done New false
26289 6247 Acked 7246 Write 6 Done Done New false
26290 6248 Acked 7247 Read 9 Done Done New false
26291 6249 Acked 7248 Read 10 Done Done New false
26292 6250 Acked 7249 Read 10 Done Done New false
26293 6251 Acked 7250 Write 6 Done Done New false
26294 6252 Acked 7251 Write 4 Done Done New false
26295 6253 Acked 7252 Flush 0 Done Done New false
26296 6254 Acked 7253 Flush 0 Done Done New false
26297 6255 Acked 7254 Read 1 Done Done New false
26298 6256 Acked 7255 Read 1 Done Done New false
26299 6257 Acked 7256 Flush 0 Done Done New false
26300 6258 Acked 7257 Write 9 Done Done New false
26301 6259 Acked 7258 Write 10 Done Done New false
26302 6260 Acked 7259 Read 4 Done Done New false
26303 6261 Acked 7260 Write 6 Done Done New false
26304 6262 Acked 7261 Read 3 Done Done New false
26305 6263 Acked 7262 Read 6 Done Done New false
26306 6264 Acked 7263 Write 4 Done Done New false
26307 6265 Acked 7264 Write 9 Done Done New false
26308 6266 Acked 7265 Read 5 Done Done New false
26309 6267 Acked 7266 Write 1 Done Done New false
26310 6268 Acked 7267 Write 4 Done Done New false
26311 6269 Acked 7268 Read 5 Done Done New false
26312 6270 Acked 7269 Flush 0 Done Done New false
26313 6271 Acked 7270 Write 6 Done Done New false
26314 6272 Acked 7271 Write 7 Done Done New false
26315 6273 Acked 7272 Write 10 Done Done New false
26316 6274 Acked 7273 Read 8 Done Done New false
26317 6275 Acked 7274 Flush 0 Done Done New false
26318 6276 Acked 7275 Read 1 Done Done New false
26319 6277 Acked 7276 Read 6 Done Done New false
26320 6278 Acked 7277 Write 1 Done Done New false
26321 6279 Acked 7278 Write 4 Done Done New false
26322 6280 Acked 7279 Read 4 Done Done New false
26323 6281 Acked 7280 Read 8 Done Done New false
26324 6282 Acked 7281 Write 4 Done Done New false
26325 6283 Acked 7282 Flush 0 Done Done New false
26326 6284 Acked 7283 Read 8 Done Done New false
26327 6285 Acked 7284 Write 3 Done Done New false
26328 6286 Acked 7285 Read 7 Done Done New false
26329 6287 Acked 7286 Write 10 Done Done New false
26330 6288 Acked 7287 Flush 0 Done Done New false
26331 6289 Acked 7288 Read 8 Done Done New false
26332 6290 Acked 7289 Read 2 Done Done New false
26333 6291 Acked 7290 Write 2 Done Done New false
26334 6292 Acked 7291 Flush 0 Done Done New false
26335 6293 Acked 7292 Read 3 Done Done New false
26336 6294 Acked 7293 Read 7 Done Done New false
26337 6295 Acked 7294 Write 1 Done Done New false
26338 6296 Acked 7295 Read 6 Done Done New false
26339 6297 Acked 7296 Write 1 Done Done New false
26340 6298 Acked 7297 Write 8 Done Done New false
26341 6299 Acked 7298 Read 2 Done Done New false
26342 6300 Acked 7299 Write 1 Done Done New false
26343 6301 Acked 7300 Read 4 Done Done New false
26344 6302 Acked 7301 Read 4 Done Done New false
26345 6303 Acked 7302 Read 2 Done Done New false
26346 6304 Acked 7303 Write 7 Done Done New false
26347 6305 Acked 7304 Flush 0 Done Done New false
26348 6306 Acked 7305 Flush 0 Done Done New false
26349 6307 Acked 7306 Read 7 Done Done New false
26350 6308 Acked 7307 Read 3 Done Done New false
26351 6309 Acked 7308 Write 5 Done Done New false
26352 6310 Acked 7309 Read 3 Done Done New false
26353 6311 Acked 7310 Read 3 Done Done New false
26354 6312 Acked 7311 Read 5 Done Done New false
26355 6313 Acked 7312 Write 3 Done Done New false
26356 6314 Acked 7313 Read 8 Done Done New false
26357 6315 Acked 7314 Read 1 Done Done New false
26358 6316 Acked 7315 Read 2 Done Done New false
26359 6317 Acked 7316 Read 10 Done Done New false
26360 6318 Acked 7317 Read 4 Done Done New false
26361 6319 Acked 7318 Read 10 Done Done New false
26362 6320 Acked 7319 Write 8 Done Done New false
26363 6321 Acked 7320 Read 1 Done Done New false
26364 6322 Acked 7321 Read 4 Done Done New false
26365 6323 Acked 7322 Read 8 Done Done New false
26366 6324 Acked 7323 Write 7 Done Done New false
26367 6325 Acked 7324 Read 10 Done Done New false
26368 6326 Acked 7325 Flush 0 Done Done New false
26369 6327 Acked 7326 Write 1 Done Done New false
26370 6328 Acked 7327 Read 3 Done Done New false
26371 6329 Acked 7328 Read 5 Done Done New false
26372 6330 Acked 7329 Flush 0 Done Done New false
26373 STATES DS:0 DS:1 DS:2 TOTAL
26374 New 0 0 301 301
26375 Sent 0 0 0 0
26376 Done 301 301 0 602
26377 Skipped 0 0 0 0
26378 Error 0 0 0 0
26379 Last Flush: 7329 7329 7028
26380 Downstairs last five completed: 7028 7027 7026 7025 7024
26381 Upstairs last five completed: 6330 6329 6328 6327 6326
26382 CLIENT: Up:0 ds:301 act:2
263832024-04-20T01:10:36.451ZINFOcrucible: connecting to 127.0.0.1:8830 = io task client = 2 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
263842024-04-20T01:10:36.451ZINFOcrucible: ds_connection connected from Ok(127.0.0.1:43255) = io task client = 2 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
263852024-04-20T01:10:36.452ZINFOcrucible: downstairs client at Some(127.0.0.1:8830) has region UUID 12345678-0000-0000-0000-000000008830 = downstairs client = 2 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
263862024-04-20T01:10:36.453ZINFOcrucible: Returning UUID:12345678-0000-0000-0000-000000008830 matches = downstairs client = 2 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
263872024-04-20T01:10:36.453ZINFOcrucible: send last flush ID to this DS: 7028 = downstairs client = 2 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
263882024-04-20T01:10:36.453ZINFOcrucible: Replied this last flush ID: 7028 = downstairs client = 2 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
263892024-04-20T01:10:36.453ZINFOcrucible: ds_transition from Offline to Replay = downstairs client = 2 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
263902024-04-20T01:10:36.453ZINFOcrucible: [2] Transition from Offline to Replay = downstairs client = 2 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
263912024-04-20T01:10:36.453ZINFOcrucible: ds_transition from Replay to Active = downstairs client = 2 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
263922024-04-20T01:10:36.453ZINFOcrucible: [2] Transition from Replay to Active = downstairs client = 2 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
26393 ----------------------------------------------------------------
26394 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:0
26395 Downstairs last five completed: 7329 7328 7327 7326 7325
26396 Upstairs last five completed: 6330 6329 6328 6327 6326
26397 CLIENT: Up:0 ds:0 act:3
26398 Replay: All jobs finished, all DS active.
26399 Main task has work to do, go find it
26400 got dsc Stop(0)
26401 stop 0
26402 Apr 20 01:10:38.759 INFO request completed, latency_us[8810] Got stop action so:false kr:false
26403 : 307, response_code: 204, uri: /stop/cid/0, method: POST, req_id: e05ecff3-e205-41cd-a5e1-6ab3a78261b5, remote_addr: 127.0.0.1:60352, local_addr: 127.0.0.1:9998
26404 Apr 20 01:10:38.760 INFO request completed, latency_us: 154, response_code: 200, uri: /state/cid/0, method: GET, req_id: 13b54d57-3948-4cc6-85ea-546aa19b73c7, remote_addr: 127.0.0.1:60352, local_addr: 127.{"msg":"downstairs disconnected","v":0,"name":"crucible","level":40,"time":"2024-04-20T01:10:38.760662956Z","hostname":"w-01HVWGBJP7HK0H9TQ26T6N3X8M","pid":1196,"":"io task","client":"0","":"downstairs","session_id":"132b460a-26a0-4532-b1ab-4f8c07d4c6c7"}
26405 0.0.1:9998
264062024-04-20T01:10:38.760ZWARNcrucible: client task is sending Done(Finished) = io task client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
264072024-04-20T01:10:38.760ZWARNcrucible: downstairs task for 0 stopped due to Finished session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
264082024-04-20T01:10:38.760ZINFOcrucible: Gone missing, transition from Active to Offline = downstairs client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
264092024-04-20T01:10:38.760ZINFOcrucible: [0] client re-new 0 jobs since flush 7329 = downstairs session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
264102024-04-20T01:10:38.760ZINFOcrucible: [0] Marked 0 jobs for replay since flush: 7329 = downstairs session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
264112024-04-20T01:10:38.760ZINFOcrucible: client task is exiting = io task client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
26412 [8810] Exited with: ExitStatus(unix_wait_status(9))
26413 [8810][0] reports Exit
26414 Apr 20 01:10:42.762 INFO request completed, latency_us: 203, response_code: 200, uri: /state/cid/0, method: GET, req_id: 96bb7843-b2b5-41e5-8a49-f74b38904390, remote_addr: 127.0.0.1:60352, local_addr: 127.0.0.1:9998
26415 001/300 Write block 4093 len 24576 data: 4 4 4 3 3 2
26416 002/300 Read block 2144 len 32768
26417 003/300 Flush
26418 004/300 Read block 443 len 24576
26419 005/300 Write block 4988 len 20480 data: 3 5 6 6 6
26420 006/300 Read block 2672 len 28672
26421 007/300 Read block 1436 len 8192
26422 008/300 Read block 1071 len 16384
26423 009/300 Read block 1233 len 4096
26424 010/300 Read block 3440 len 28672
26425 011/300 Write block 4566 len 36864 data: 5 5 8 8 9 9 9 7 7
26426 012/300 Write block 1801 len 36864 data: 6 6 6 8 5 5 4 5 5
26427 013/300 Read block 3737 len 32768
26428 014/300 Read block 2198 len 12288
26429 015/300 Read block 4264 len 40960
26430 016/300 Write block 273 len 40960 data: 4 5 6 7 8 7 7 4 3 2
26431 017/300 Write block 1325 len 16384 data: 5 5 4 4
26432 018/300 Write block 4863 len 8192 data: 6 5
26433 019/300 Flush
26434 020/300 Write block 3194 len 4096 data: 4
26435 021/300 Read block 4381 len 24576
26436 022/300 Flush
26437 023/300 Flush
26438 024/300 Write block 2941 len 16384 data: 6 5 5 6
26439 025/300 Write block 969 len 28672 data: 5 3 5 5 4 5 4
26440 026/300 Write block 164 len 40960 data: 4 5 4 4 4 4 4 4 4 5
26441 027/300 Write block 2666 len 16384 data: 9 7 7 7
26442 028/300 Read block 1892 len 32768
26443 029/300 Write block 4334 len 12288 data: 2 2 3
26444 030/300 Flush
26445 031/300 Read block 3327 len 4096
26446 032/300 Read block 1918 len 28672
26447 033/300 Read block 268 len 24576
26448 034/300 Write block 1472 len 20480 data: 7 7 5 6 5
26449 035/300 Write block 2609 len 32768 data: 4 4 5 4 4 5 5 7
26450 036/300 Read block 4946 len 4096
26451 037/300 Flush
26452 038/300 Write block 738 len 28672 data: 8 7 6 6 5 5 5
26453 039/300 Read block 1989 len 32768
26454 040/300 Write block 2025 len 36864 data: 8 10 8 5 4 3 3 2 2
26455 041/300 Flush
26456 042/300 Write block 4699 len 20480 data: 2 4 6 6 6
26457 043/300 Write block 2330 len 4096 data: 5
26458 044/300 Flush
26459 045/300 Read block 741 len 8192
26460 046/300 Read block 2895 len 12288
26461 047/300 Read block 4309 len 4096
26462 048/300 Read block 2481 len 40960
26463 049/300 Read block 997 len 20480
26464 050/300 Write block 1933 len 8192 data: 3 3
26465 051/300 Flush
26466 052/300 Flush
26467 053/300 Read block 2263 len 28672
26468 054/300 Write block 2467 len 16384 data: 6 6 8 8
26469 055/300 Read block 1569 len 36864
26470 056/300 Write block 633 len 36864 data: 4 4 3 4 3 3 3 3 3
26471 057/300 Write block 640 len 20480 data: 4 4 3 4 5
26472 058/300 Write block 982 len 20480 data: 4 3 2 2 3
26473 059/300 Read block 3026 len 16384
26474 060/300 Read block 3487 len 28672
26475 061/300 Write block 4675 len 16384 data: 8 8 8 8
26476 062/300 Flush
26477 063/300 Read block 1566 len 32768
26478 064/300 Read block 610 len 8192
26479 065/300 Read block 1628 len 20480
26480 066/300 Flush
26481 067/300 Write block 2838 len 16384 data: 3 4 4 6
26482 068/300 Read block 4921 len 8192
26483 069/300 Write block 3080 len 16384 data: 5 6 3 4
26484 070/300 Flush
26485 071/300 Flush
26486 072/300 Read block 4327 len 4096
26487 073/300 Write block 2361 len 12288 data: 4 5 5
26488 074/300 Read block 2365 len 8192
26489 075/300 Write block 3932 len 24576 data: 3 4 3 2 2 2
26490 076/300 Read block 1244 len 32768
26491 077/300 Write block 2169 len 40960 data: 6 7 7 7 5 5 4 5 4 4
26492 078/300 Write block 2699 len 16384 data: 6 6 6 5
26493 079/300 Write block 3284 len 20480 data: 7 6 6 6 4
26494 080/300 Read block 2889 len 16384
26495 081/300 Write block 517 len 12288 data: 5 6 6
26496 082/300 Read block 1381 len 24576
26497 083/300 Read block 3255 len 12288
26498 084/300 Write block 349 len 32768 data: 4 3 3 4 3 3 3 3
26499 085/300 Read block 4438 len 28672
26500 086/300 Flush
26501 087/300 Read block 4115 len 32768
26502 088/300 Read block 3456 len 36864
26503 089/300 Read block 4435 len 40960
26504 090/300 Write block 2433 len 20480 data: 4 4 4 4 4
26505 091/300 Write block 2060 len 40960 data: 7 8 7 7 7 7 7 6 8 8
26506 092/300 Write block 2616 len 16384 data: 8 7 7 8
26507 093/300 Read block 1806 len 4096
26508 094/300 Read block 1171 len 20480
26509 095/300 Read block 2327 len 28672
26510 096/300 Read block 3716 len 20480
26511 097/300 Write block 4959 len 4096 data: 3
26512 098/300 Read block 2268 len 4096
26513 099/300 Write block 2712 len 16384 data: 3 4 4 4
26514 100/300 Read block 888 len 4096
26515 101/300 Read block 130 len 32768
26516 102/300 Read block 4525 len 12288
26517 103/300 Read block 227 len 28672
26518 104/300 Write block 3261 len 36864 data: 2 2 2 2 2 2 2 3 4
26519 105/300 Read block 1643 len 4096
26520 106/300 Flush
26521 107/300 Write block 1863 len 20480 data: 3 3 3 4 5
26522 108/300 Read block 4391 len 20480
26523 109/300 Write block 3901 len 8192 data: 4 4
26524 110/300 Write block 2837 len 32768 data: 3 4 5 5 7 6 8 6
26525 111/300 Write block 3826 len 40960 data: 2 2 3 3 3 3 3 2 2 4
26526 112/300 Read block 1962 len 16384
26527 113/300 Read block 340 len 20480
26528 114/300 Read block 2895 len 36864
26529 115/300 Read block 1893 len 28672
26530 116/300 Read block 3900 len 28672
26531 117/300 Write block 2386 len 4096 data: 4
26532 118/300 Flush
26533 119/300 Flush
26534 120/300 Read block 2818 len 36864
26535 121/300 Read block 2322 len 20480
26536 122/300 Read block 2271 len 24576
26537 123/300 Write block 32 len 16384 data: 3 3 3 3
26538 124/300 Read block 4906 len 24576
26539 125/300 Write block 2558 len 32768 data: 3 5 5 5 6 6 6 6
26540 126/300 Write block 1636 len 12288 data: 4 5 6
26541 127/300 Read block 3367 len 16384
26542 128/300 Write block 3851 len 8192 data: 3 2
26543 129/300 Write block 3099 len 36864 data: 8 9 7 7 7 7 7 6 6
26544 130/300 Read block 2656 len 36864
26545 131/300 Write block 323 len 28672 data: 7 7 9 8 7 6 6
26546 132/300 Write block 1833 len 40960 data: 6 5 7 6 5 5 5 4 3 3
26547 133/300 Write block 1873 len 16384 data: 3 5 4 6
26548 134/300 Write block 2207 len 16384 data: 5 4 4 4
26549 135/300 Read block 3879 len 28672
26550 136/300 Read block 2171 len 36864
26551 137/300 Read block 4054 len 20480
26552 138/300 Read block 2215 len 12288
26553 139/300 Flush
26554 140/300 Read block 2165 len 32768
26555 141/300 Read block 1274 len 12288
26556 142/300 Read block 1212 len 8192
26557 143/300 Read block 1357 len 28672
26558 144/300 Write block 4605 len 32768 data: 2 4 5 4 3 3 3 3
26559 145/300 Read block 3634 len 4096
26560 146/300 Flush
26561 147/300 Write block 287 len 8192 data: 2 2
26562 148/300 Write block 3805 len 12288 data: 4 4 4
26563 149/300 Read block 2337 len 12288
26564 150/300 Read block 3582 len 12288
26565 151/300 Write block 3333 len 20480 data: 2 3 4 3 4
26566 152/300 Write block 3759 len 40960 data: 4 3 4 3 3 3 3 3 5 5
26567 153/300 Read block 2020 len 32768
26568 154/300 Read block 3645 len 28672
26569 155/300 Flush
26570 156/300 Write block 4895 len 32768 data: 4 5 4 4 5 3 3 4
26571 157/300 Read block 1429 len 40960
26572 158/300 Read block 4097 len 24576
26573 159/300 Write block 4242 len 40960 data: 6 6 6 8 9 5 5 4 4 5
26574 160/300 Write block 413 len 12288 data: 6 7 7
26575 161/300 Read block 2192 len 24576
26576 162/300 Read block 2879 len 16384
26577 163/300 Read block 2387 len 4096
26578 164/300 Read block 4653 len 16384
26579 165/300 Write block 476 len 16384 data: 4 4 5 6
26580 166/300 Read block 1477 len 36864
26581 167/300 Read block 1841 len 28672
26582 168/300 Read block 4190 len 20480
26583 169/300 Read block 4724 len 40960
26584 170/300 Write block 2723 len 20480 data: 8 10 9 11 12
26585 171/300 Write block 1344 len 40960 data: 4 3 4 4 5 4 4 3 4 3
26586 172/300 Flush
26587 173/300 Read block 1676 len 8192
26588 174/300 Read block 2951 len 32768
26589 175/300 Write block 982 len 20480 data: 5 4 3 3 4
26590 176/300 Write block 3123 len 16384 data: 5 5 5 5
26591 177/300 Write block 642 len 40960 data: 4 5 6 6 5 6 4 4 2 4
26592 178/300 Read block 4318 len 40960
26593 179/300 Write block 1481 len 36864 data: 2 3 3 3 3 3 4 4 4
26594 180/300 Read block 4088 len 12288
26595 181/300 Read block 2295 len 28672
26596 182/300 Read block 529 len 8192
26597 183/300 Write block 748 len 32768 data: 7 7 6 6 6 5 3 3
26598 184/300 Write block 783 len 24576 data: 5 4 5 5 4 6
26599 185/300 Write block 836 len 36864 data: 5 7 6 5 5 6 5 5 4
26600 186/300 Flush
26601 187/300 Write block 970 len 36864 data: 4 6 6 5 6 5 4 4 5
26602 188/300 Read block 2244 len 36864
26603 189/300 Flush
26604 190/300 Read block 2278 len 36864
26605 191/300 Read block 918 len 4096
26606 192/300 Write block 4773 len 16384 data: 4 4 3 4
26607 193/300 Read block 4952 len 40960
26608 194/300 Read block 3523 len 12288
26609 195/300 Write block 3471 len 4096 data: 3
26610 196/300 Write block 1714 len 4096 data: 6
26611 197/300 Write block 3254 len 20480 data: 3 3 2 2 2
26612 198/300 Flush
26613 199/300 Write block 2368 len 40960 data: 3 3 3 3 3 2 2 2 2 4
26614 200/300 Read block 4429 len 4096
26615 201/300 Write block 3967 len 8192 data: 3 3
26616 202/300 Write block 1710 len 32768 data: 7 7 6 7 7 2 2 2
26617 203/300 Flush
26618 204/300 Read block 3877 len 4096
26619 205/300 Flush
26620 206/300 Write block 4259 len 36864 data: 5 6 6 5 5 5 5 5 6
26621 207/300 Write block 3047 len 20480 data: 6 5 5 5 2
26622 208/300 Flush
26623 209/300 Read block 3268 len 36864
26624 210/300 Write block 2673 len 24576 data: 6 5 5 5 5 4
26625 211/300 Write block 3541 len 12288 data: 4 3 3
26626 212/300 Write block 4606 len 28672 data: 5 6 5 4 4 4 4
26627 213/300 Read block 664 len 8192
26628 214/300 Write block 2616 len 16384 data: 9 8 8 9
26629 215/300 Write block 2049 len 8192 data: 4 4
26630 216/300 Flush
26631 217/300 Read block 2843 len 12288
26632 218/300 Read block 3691 len 32768
26633 219/300 Read block 3626 len 32768
26634 220/300 Read block 2863 len 16384
26635 221/300 Write block 3289 len 4096 data: 3
26636 222/300 Read block 2781 len 4096
26637 223/300 Read block 758 len 16384
26638 224/300 Read block 1303 len 4096
26639 225/300 Write block 4256 len 24576 data: 6 5 5 6 7 7
26640 226/300 Flush
26641 227/300 Read block 3196 len 4096
26642 228/300 Read block 3793 len 24576
26643 229/300 Write block 852 len 28672 data: 4 5 4 4 3 4 4
26644 230/300 Read block 1539 len 28672
26645 231/300 Flush
26646 232/300 Flush
26647 233/300 Read block 4440 len 40960
26648 234/300 Read block 55 len 32768
26649 235/300 Write block 1984 len 20480 data: 3 4 5 6 7
26650 236/300 Write block 2404 len 12288 data: 4 3 3
26651 237/300 Read block 2695 len 36864
26652 238/300 Write block 3735 len 20480 data: 6 6 6 6 6
26653 239/300 Write block 2406 len 4096 data: 4
26654 240/300 Read block 4704 len 40960
26655 241/300 Read block 4233 len 8192
26656 242/300 Read block 2926 len 16384
26657 243/300 Write block 566 len 16384 data: 3 4 3 3
26658 244/300 Read block 4392 len 4096
26659 245/300 Read block 3866 len 12288
26660 246/300 Write block 1911 len 16384 data: 4 3 3 5
26661 247/300 Read block 692 len 24576
26662 248/300 Read block 2681 len 20480
26663 249/300 Write block 4416 len 28672 data: 5 5 5 4 4 2 2
26664 250/300 Write block 3942 len 24576 data: 3 3 4 4 5 5
26665 251/300 Read block 1391 len 16384
26666 252/300 Read block 654 len 36864
26667 253/300 Read block 109 len 28672
26668 254/300 Write block 170 len 28672 data: 5 5 5 6 4 5 5
26669 255/300 Read block 135 len 4096
26670 256/300 Write block 73 len 28672 data: 4 4 4 3 2 2 2
26671 257/300 Flush
26672 258/300 Read block 3793 len 28672
26673 259/300 Read block 3697 len 40960
26674 260/300 Read block 2502 len 36864
26675 261/300 Write block 3086 len 4096 data: 4
26676 262/300 Flush
26677 263/300 Write block 1399 len 32768 data: 6 6 5 5 5 5 5 6
26678 264/300 Write block 4819 len 24576 data: 6 7 8 8 7 7
26679 265/300 Read block 683 len 28672
26680 266/300 Read block 3990 len 28672
26681 267/300 Write block 3963 len 40960 data: 4 4 3 3 4 4 3 3 3 4
26682 268/300 Write block 3066 len 8192 data: 3 3
26683 269/300 Write block 4993 len 24576 data: 5 5 5 6 4 3
26684 270/300 Read block 4775 len 20480
26685 271/300 Write block 3582 len 16384 data: 5 6 5 5
26686 272/300 Read block 159 len 4096
26687 273/300 Read block 1570 len 16384
26688 274/300 Write block 2460 len 20480 data: 5 5 5 6 7
26689 275/300 Write block 33 len 32768 data: 4 4 4 4 5 6 7 7
26690 276/300 Read block 709 len 40960
26691 277/300 Write block 277 len 32768 data: 9 8 8 5 4 3 2 2
26692 278/300 Read block 2647 len 28672
26693 279/300 Read block 4629 len 28672
26694 280/300 Read block 2481 len 16384
26695 281/300 Read block 1223 len 24576
26696 282/300 Read block 745 len 8192
26697 283/300 Read block 4812 len 40960
26698 284/300 Read block 3615 len 24576
26699 285/300 Read block 3340 len 20480
26700 286/300 Write block 4670 len 20480 data: 6 6 4 5 5
26701 287/300 Read block 122 len 40960
26702 288/300 Read block 3705 len 12288
26703 289/300 Read block 456 len 8192
26704 290/300 Read block 4243 len 4096
26705 291/300 Write block 1109 len 4096 data: 3
26706 292/300 Read block 3035 len 16384
26707 293/300 Write block 3473 len 8192 data: 3 3
26708 294/300 Write block 4900 len 8192 data: 4 4
26709 295/300 Write block 4769 len 12288 data: 7 5 5
26710 296/300 Write block 3253 len 24576 data: 3 4 4 3 3 3
26711 297/300 Flush
26712 298/300 Read block 4513 len 24576
26713 299/300 Write block 1546 len 24576 data: 7 8 7 7 7 5
26714 300/300 Read block 63 len 40960
26715 Main task has work to do, go find it
26716 got dsc Start(0)
26717 start 0
26718 Apr 20 01:10:43.069 INFO request completed, latency_us: 204, response_code: 204, uri: /start/cid/0, method: POST, req_id: cc713dff-6a66-4ab9-91ad-047d783c6492, remote_addr: 127.0.0.1:60352, local_addr: 127.0.0.1:9998
26719 Replay: started 0, returned:Ok(())
26720 ----------------------------------------------------------------
26721 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:300
26722 States: Offline Active Active
26723 GW_ID ACK DSID TYPE BLOCKS DS:0 DS:1 DS:2 REPLAY
26724 6331 Acked 7330 Write 6 New Done Done false
26725 6332 Acked 7331 Read 8 New Done Done false
26726 6333 Acked 7332 Flush 0 New Done Done false
26727 6334 Acked 7333 Read 6 New Done Done false
26728 6335 Acked 7334 Write 5 New Done Done false
26729 6336 Acked 7335 Read 7 New Done Done false
26730 6337 Acked 7336 Read 2 New Done Done false
26731 6338 Acked 7337 Read 4 New Done Done false
26732 6339 Acked 7338 Read 1 New Done Done false
26733 6340 Acked 7339 Read 7 New Done Done false
26734 6341 Acked 7340 Write 9 New Done Done false
26735 6342 Acked 7341 Write 9 New Done Done false
26736 6343 Acked 7342 Read 8 New Done Done false
26737 6344 Acked 7343 Read 3 New Done Done false
26738 6345 Acked 7344 Read 10 New Done Done false
26739 6346 Acked 7345 Write 10 New Done Done false
26740 6347 Acked 7346 Write 4 New Done Done false
26741 6348 Acked 7347 Write 2 New Done Done false
26742 6349 Acked 7348 Flush 0 New Done Done false
26743 6350 Acked 7349 Write 1 New Done Done false
26744 6351 Acked 7350 Read 6 New Done Done false
26745 6352 Acked 7351 Flush 0 New Done Done false
26746 6353 Acked 7352 Flush 0 New Done Done false
26747 6354 Acked 7353 Write 4 New Done Done false
26748 6355 Acked 7354 Write 7 New Done Done false
26749 6356 Acked 7355 Write 10 New Done Done false
26750 6357 Acked 7356 Write 4 New Done Done false
26751 6358 Acked 7357 Read 8 New Done Done false
26752 6359 Acked 7358 Write 3 New Done Done false
26753 6360 Acked 7359 Flush 0 New Done Done false
26754 6361 Acked 7360 Read 1 New Done Done false
26755 6362 Acked 7361 Read 7 New Done Done false
26756 6363 Acked 7362 Read 6 New Done Done false
26757 6364 Acked 7363 Write 5 New Done Done false
26758 6365 Acked 7364 Write 8 New Done Done false
26759 6366 Acked 7365 Read 1 New Done Done false
26760 6367 Acked 7366 Flush 0 New Done Done false
26761 6368 Acked 7367 Write 7 New Done Done false
26762 6369 Acked 7368 Read 8 New Done Done false
26763 6370 Acked 7369 Write 9 New Done Done false
26764 6371 Acked 7370 Flush 0 New Done Done false
26765 6372 Acked 7371 Write 5 New Done Done false
26766 6373 Acked 7372 Write 1 New Done Done false
26767 6374 Acked 7373 Flush 0 New Done Done false
26768 6375 Acked 7374 Read 2 New Done Done false
26769 6376 Acked 7375 Read 3 New Done Done false
26770 6377 Acked 7376 Read 1 New Done Done false
26771 6378 Acked 7377 Read 10 New Done Done false
26772 6379 Acked 7378 Read 5 New Done Done false
26773 6380 Acked 7379 Write 2 New Done Done false
26774 6381 Acked 7380 Flush 0 New Done Done false
26775 6382 Acked 7381 Flush 0 New Done Done false
26776 6383 Acked 7382 Read 7 New Done Done false
26777 6384 Acked 7383 Write 4 New Done Done false
26778 6385 Acked 7384 Read 9 New Done Done false
26779 6386 Acked 7385 Write 9 New Done Done false
26780 6387 Acked 7386 Write 5 New Done Done false
26781 6388 Acked 7387 Write 5 New Done Done false
26782 6389 Acked 7388 Read 4 New Done Done false
26783 6390 Acked 7389 Read 7 New Done Done false
26784 6391 Acked 7390 Write 4 New Done Done false
26785 6392 Acked 7391 Flush 0 New Done Done false
26786 6393 Acked 7392 Read 8 New Done Done false
26787 6394 Acked 7393 Read 2 New Done Done false
26788 6395 Acked 7394 Read 5 New Done Done false
26789 6396 Acked 7395 Flush 0 New Done Done false
26790 6397 Acked 7396 Write 4 New Done Done false
26791 6398 Acked 7397 Read 2 New Done Done false
26792 6399 Acked 7398 Write 4 New Done Done false
26793 6400 Acked 7399 Flush 0 New Done Done false
26794 6401 Acked 7400 Flush 0 New Done Done false
26795 6402 Acked 7401 Read 1 New Done Done false
26796 6403 Acked 7402 Write 3 New Done Done false
26797 6404 Acked 7403 Read 2 New Done Done false
26798 6405 Acked 7404 Write 6 New Done Done false
26799 6406 Acked 7405 Read 8 New Done Done false
26800 6407 Acked 7406 Write 10 New Done Done false
26801 6408 Acked 7407 Write 4 New Done Done false
26802 6409 Acked 7408 Write 5 New Done Done false
26803 6410 Acked 7409 Read 4 New Done Done false
26804 6411 Acked 7410 Write 3 New Done Done false
26805 6412 Acked 7411 Read 6 New Done Done false
26806 6413 Acked 7412 Read 3 New Done Done false
26807 6414 Acked 7413 Write 8 New Done Done false
26808 6415 Acked 7414 Read 7 New Done Done false
26809 6416 Acked 7415 Flush 0 New Done Done false
26810 6417 Acked 7416 Read 8 New Done Done false
26811 6418 Acked 7417 Read 9 New Done Done false
26812 6419 Acked 7418 Read 10 New Done Done false
26813 6420 Acked 7419 Write 5 New Done Done false
26814 6421 Acked 7420 Write 10 New Done Done false
26815 6422 Acked 7421 Write 4 New Done Done false
26816 6423 Acked 7422 Read 1 New Done Done false
26817 6424 Acked 7423 Read 5 New Done Done false
26818 6425 Acked 7424 Read 7 New Done Done false
26819 6426 Acked 7425 Read 5 New Done Done false
26820 6427 Acked 7426 Write 1 New Done Done false
26821 6428 Acked 7427 Read 1 New Done Done false
26822 6429 Acked 7428 Write 4 New Done Done false
26823 6430 Acked 7429 Read 1 New Done Done false
26824 6431 Acked 7430 Read 8 New Done Done false
26825 6432 Acked 7431 Read 3 New Done Done false
26826 6433 Acked 7432 Read 7 New Done Done false
26827 6434 Acked 7433 Write 9 New Done Done false
26828 6435 Acked 7434 Read 1 New Done Done false
26829 6436 Acked 7435 Flush 0 New Done Done false
26830 6437 Acked 7436 Write 5 New Done Done false
26831 6438 Acked 7437 Read 5 New Done Done false
26832 6439 Acked 7438 Write 2 New Done Done false
26833 6440 Acked 7439 Write 8 New Done Done false
26834 6441 Acked 7440 Write 10 New Done Done false
26835 6442 Acked 7441 Read 4 New Done Done false
26836 6443 Acked 7442 Read 5 New Done Done false
26837 6444 Acked 7443 Read 9 New Done Done false
26838 6445 Acked 7444 Read 7 New Done Done false
26839 6446 Acked 7445 Read 7 New Done Done false
26840 6447 Acked 7446 Write 1 New Done Done false
26841 6448 Acked 7447 Flush 0 New Done Done false
26842 6449 Acked 7448 Flush 0 New Done Done false
26843 6450 Acked 7449 Read 9 New Done Done false
26844 6451 Acked 7450 Read 5 New Done Done false
26845 6452 Acked 7451 Read 6 New Done Done false
26846 6453 Acked 7452 Write 4 New Done Done false
26847 6454 Acked 7453 Read 6 New Done Done false
26848 6455 Acked 7454 Write 8 New Done Done false
26849 6456 Acked 7455 Write 3 New Done Done false
26850 6457 Acked 7456 Read 4 New Done Done false
26851 6458 Acked 7457 Write 2 New Done Done false
26852 6459 Acked 7458 Write 9 New Done Done false
26853 6460 Acked 7459 Read 9 New Done Done false
26854 6461 Acked 7460 Write 7 New Done Done false
26855 6462 Acked 7461 Write 10 New Done Done false
26856 6463 Acked 7462 Write 4 New Done Done false
26857 6464 Acked 7463 Write 4 New Done Done false
26858 6465 Acked 7464 Read 7 New Done Done false
26859 6466 Acked 7465 Read 9 New Done Done false
26860 6467 Acked 7466 Read 5 New Done Done false
26861 6468 Acked 7467 Read 3 New Done Done false
26862 6469 Acked 7468 Flush 0 New Done Done false
26863 6470 Acked 7469 Read 8 New Done Done false
26864 6471 Acked 7470 Read 3 New Done Done false
26865 6472 Acked 7471 Read 2 New Done Done false
26866 6473 Acked 7472 Read 7 New Done Done false
26867 6474 Acked 7473 Write 8 New Done Done false
26868 6475 Acked 7474 Read 1 New Done Done false
26869 6476 Acked 7475 Flush 0 New Done Done false
26870 6477 Acked 7476 Write 2 New Done Done false
26871 6478 Acked 7477 Write 3 New Done Done false
26872 6479 Acked 7478 Read 3 New Done Done false
26873 6480 Acked 7479 Read 3 New Done Done false
26874 6481 Acked 7480 Write 5 New Done Done false
26875 6482 Acked 7481 Write 10 New Done Done false
26876 6483 Acked 7482 Read 8 New Done Done false
26877 6484 Acked 7483 Read 7 New Done Done false
26878 6485 Acked 7484 Flush 0 New Done Done false
26879 6486 Acked 7485 Write 8 New Done Done false
26880 6487 Acked 7486 Read 10 New Done Done false
26881 6488 Acked 7487 Read 6 New Done Done false
26882 6489 Acked 7488 Write 10 New Done Done false
26883 6490 Acked 7489 Write 3 New Done Done false
26884 6491 Acked 7490 Read 6 New Done Done false
26885 6492 Acked 7491 Read 4 New Done Done false
26886 6493 Acked 7492 Read 1 New Done Done false
26887 6494 Acked 7493 Read 4 New Done Done false
26888 6495 Acked 7494 Write 4 New Done Done false
26889 6496 Acked 7495 Read 9 New Done Done false
26890 6497 Acked 7496 Read 7 New Done Done false
26891 6498 Acked 7497 Read 5 New Done Done false
26892 6499 Acked 7498 Read 10 New Done Done false
26893 6500 Acked 7499 Write 5 New Done Done false
26894 6501 Acked 7500 Write 10 New Done Done false
26895 6502 Acked 7501 Flush 0 New Done Done false
26896 6503 Acked 7502 Read 2 New Done Done false
26897 6504 Acked 7503 Read 8 New Done Done false
26898 6505 Acked 7504 Write 5 New Done Done false
26899 6506 Acked 7505 Write 4 New Done Done false
26900 6507 Acked 7506 Write 10 New Done Done false
26901 6508 Acked 7507 Read 10 New Done Done false
26902 6509 Acked 7508 Write 9 New Done Done false
26903 6510 Acked 7509 Read 3 New Done Done false
26904 6511 Acked 7510 Read 7 New Done Done false
26905 6512 Acked 7511 Read 2 New Done Done false
26906 6513 Acked 7512 Write 8 New Done Done false
26907 6514 Acked 7513 Write 6 New Done Done false
26908 6515 Acked 7514 Write 9 New Done Done false
26909 6516 Acked 7515 Flush 0 New Done Done false
26910 6517 Acked 7516 Write 9 New Done Done false
26911 6518 Acked 7517 Read 9 New Done Done false
26912 6519 Acked 7518 Flush 0 New Done Done false
26913 6520 Acked 7519 Read 9 New Done Done false
26914 6521 Acked 7520 Read 1 New Done Done false
26915 6522 Acked 7521 Write 4 New Done Done false
26916 6523 Acked 7522 Read 10 New Done Done false
26917 6524 Acked 7523 Read 3 New Done Done false
26918 6525 Acked 7524 Write 1 New Done Done false
26919 6526 Acked 7525 Write 1 New Done Done false
26920 6527 Acked 7526 Write 5 New Done Done false
26921 6528 Acked 7527 Flush 0 New Done Done false
26922 6529 Acked 7528 Write 10 New Done Done false
26923 6530 Acked 7529 Read 1 New Done Done false
26924 6531 Acked 7530 Write 2 New Done Done false
26925 6532 Acked 7531 Write 8 New Done Done false
26926 6533 Acked 7532 Flush 0 New Done Done false
26927 6534 Acked 7533 Read 1 New Done Done false
26928 6535 Acked 7534 Flush 0 New Done Done false
26929 6536 Acked 7535 Write 9 New Done Done false
26930 6537 Acked 7536 Write 5 New Done Done false
26931 6538 Acked 7537 Flush 0 New Done Done false
26932 6539 Acked 7538 Read 9 New Done Done false
26933 6540 Acked 7539 Write 6 New Done Done false
26934 6541 Acked 7540 Write 3 New Done Done false
26935 6542 Acked 7541 Write 7 New Done Done false
26936 6543 Acked 7542 Read 2 New Done Done false
26937 6544 Acked 7543 Write 4 New Done Done false
26938 6545 Acked 7544 Write 2 New Done Done false
26939 6546 Acked 7545 Flush 0 New Done Done false
26940 6547 Acked 7546 Read 3 New Done Done false
26941 6548 Acked 7547 Read 8 New Done Done false
26942 6549 Acked 7548 Read 8 New Done Done false
26943 6550 Acked 7549 Read 4 New Done Done false
26944 6551 Acked 7550 Write 1 New Done Done false
26945 6552 Acked 7551 Read 1 New Done Done false
26946 6553 Acked 7552 Read 4 New Done Done false
26947 6554 Acked 7553 Read 1 New Done Done false
26948 6555 Acked 7554 Write 6 New Done Done false
26949 6556 Acked 7555 Flush 0 New Done Done false
26950 6557 Acked 7556 Read 1 New Done Done false
26951 6558 Acked 7557 Read 6 New Done Done false
26952 6559 Acked 7558 Write 7 New Done Done false
26953 6560 Acked 7559 Read 7 New Done Done false
26954 6561 Acked 7560 Flush 0 New Done Done false
26955 6562 Acked 7561 Flush 0 New Done Done false
26956 6563 Acked 7562 Read 10 New Done Done false
26957 6564 Acked 7563 Read 8 New Done Done false
26958 6565 Acked 7564 Write 5 New Done Done false
26959 6566 Acked 7565 Write 3 New Done Done false
26960 6567 Acked 7566 Read 9 New Done Done false
26961 6568 Acked 7567 Write 5 New Done Done false
26962 6569 Acked 7568 Write 1 New Done Done false
26963 6570 Acked 7569 Read 10 New Done Done false
26964 6571 Acked 7570 Read 2 New Done Done false
26965 6572 Acked 7571 Read 4 New Done Done false
26966 6573 Acked 7572 Write 4 New Done Done false
26967 6574 Acked 7573 Read 1 New Done Done false
26968 6575 Acked 7574 Read 3 New Done Done false
26969 6576 Acked 7575 Write 4 New Done Done false
26970 6577 Acked 7576 Read 6 New Done Done false
26971 6578 Acked 7577 Read 5 New Done Done false
26972 6579 Acked 7578 Write 7 New Done Done false
26973 6580 Acked 7579 Write 6 New Done Done false
26974 6581 Acked 7580 Read 4 New Done Done false
26975 6582 Acked 7581 Read 9 New Done Done false
26976 6583 Acked 7582 Read 7 New Done Done false
26977 6584 Acked 7583 Write 7 New Done Done false
26978 6585 Acked 7584 Read 1 New Done Done false
26979 6586 Acked 7585 Write 7 New Done Done false
26980 6587 Acked 7586 Flush 0 New Done Done false
26981 6588 Acked 7587 Read 7 New Done Done false
26982 6589 Acked 7588 Read 10 New Done Done false
26983 6590 Acked 7589 Read 9 New Done Done false
26984 6591 Acked 7590 Write 1 New Done Done false
26985 6592 Acked 7591 Flush 0 New Done Done false
26986 6593 Acked 7592 Write 8 New Done Done false
26987 6594 Acked 7593 Write 6 New Done Done false
26988 6595 Acked 7594 Read 7 New Done Done false
26989 6596 Acked 7595 Read 7 New Done Done false
26990 6597 Acked 7596 Write 10 New Done Done false
26991 6598 Acked 7597 Write 2 New Done Done false
26992 6599 Acked 7598 Write 6 New Done Done false
26993 6600 Acked 7599 Read 5 New Done Done false
26994 6601 Acked 7600 Write 4 New Done Done false
26995 6602 Acked 7601 Read 1 New Done Done false
26996 6603 Acked 7602 Read 4 New Done Done false
26997 6604 Acked 7603 Write 5 New Done Done false
26998 6605 Acked 7604 Write 8 New Done Done false
26999 6606 Acked 7605 Read 10 New Done Done false
27000 6607 Acked 7606 Write 8 New Done Done false
27001 6608 Acked 7607 Read 7 New Done Done false
27002 6609 Acked 7608 Read 7 New Done Done false
27003 6610 Acked 7609 Read 4 New Done Done false
27004 6611 Acked 7610 Read 6 New Done Done false
27005 6612 Acked 7611 Read 2 New Done Done false
27006 6613 Acked 7612 Read 10 New Done Done false
27007 6614 Acked 7613 Read 6 New Done Done false
27008 6615 Acked 7614 Read 5 New Done Done false
27009 6616 Acked 7615 Write 5 New Done Done false
27010 6617 Acked 7616 Read 10 New Done Done false
27011 6618 Acked 7617 Read 3 New Done Done false
27012 6619 Acked 7618 Read 2 New Done Done false
27013 6620 Acked 7619 Read 1 New Done Done false
27014 6621 Acked 7620 Write 1 New Done Done false
27015 6622 Acked 7621 Read 4 New Done Done false
27016 6623 Acked 7622 Write 2 New Done Done false
27017 6624 Acked 7623 Write 2 New Done Done false
27018 6625 Acked 7624 Write 3 New Done Done false
27019 6626 Acked 7625 Write 6 New Done Done false
27020 6627 Acked 7626 Flush 0 New Done Done false
27021 6628 Acked 7627 Read 6 New Done Done false
27022 6629 Acked 7628 Write 6 New Done Done false
27023 6630 Acked 7629 Read 10 New Done Done false
27024 STATES DS:0 DS:1 DS:2 TOTAL
27025 New 300 0 0 300
27026 Sent 0 0 0 0
27027 Done 0 300 300 600
27028 Skipped 0 0 0 0
27029 Error 0 0 0 0
27030 Last Flush: 7329 7626 7626
27031 Downstairs last five completed: 7329 7328 7327 7326 7325
27032 Upstairs last five completed: 6630 6629 6628 6627 6626
27033 CLIENT: Up:0 ds:300 act:2
27034 [8810] got start action
27035 [8810] I am going to restart
27036 Starting downstairs at port 8810
27037 Make output file at "/tmp/dsc/downstairs-8810.txt"
27038 [8810][0] reports Starting
27039 Downstairs /var/tmp/dsc/region/8810 port 8810 PID:Some(1218)
27040 [8810][0] reports Running
27041 ----------------------------------------------------------------
27042 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:301
27043 States: Offline Active Active
27044 GW_ID ACK DSID TYPE BLOCKS DS:0 DS:1 DS:2 REPLAY
27045 6331 Acked 7330 Write 6 New Done Done false
27046 6332 Acked 7331 Read 8 New Done Done false
27047 6333 Acked 7332 Flush 0 New Done Done false
27048 6334 Acked 7333 Read 6 New Done Done false
27049 6335 Acked 7334 Write 5 New Done Done false
27050 6336 Acked 7335 Read 7 New Done Done false
27051 6337 Acked 7336 Read 2 New Done Done false
27052 6338 Acked 7337 Read 4 New Done Done false
27053 6339 Acked 7338 Read 1 New Done Done false
27054 6340 Acked 7339 Read 7 New Done Done false
27055 6341 Acked 7340 Write 9 New Done Done false
27056 6342 Acked 7341 Write 9 New Done Done false
27057 6343 Acked 7342 Read 8 New Done Done false
27058 6344 Acked 7343 Read 3 New Done Done false
27059 6345 Acked 7344 Read 10 New Done Done false
27060 6346 Acked 7345 Write 10 New Done Done false
27061 6347 Acked 7346 Write 4 New Done Done false
27062 6348 Acked 7347 Write 2 New Done Done false
27063 6349 Acked 7348 Flush 0 New Done Done false
27064 6350 Acked 7349 Write 1 New Done Done false
27065 6351 Acked 7350 Read 6 New Done Done false
27066 6352 Acked 7351 Flush 0 New Done Done false
27067 6353 Acked 7352 Flush 0 New Done Done false
27068 6354 Acked 7353 Write 4 New Done Done false
27069 6355 Acked 7354 Write 7 New Done Done false
27070 6356 Acked 7355 Write 10 New Done Done false
27071 6357 Acked 7356 Write 4 New Done Done false
27072 6358 Acked 7357 Read 8 New Done Done false
27073 6359 Acked 7358 Write 3 New Done Done false
27074 6360 Acked 7359 Flush 0 New Done Done false
27075 6361 Acked 7360 Read 1 New Done Done false
27076 6362 Acked 7361 Read 7 New Done Done false
27077 6363 Acked 7362 Read 6 New Done Done false
27078 6364 Acked 7363 Write 5 New Done Done false
27079 6365 Acked 7364 Write 8 New Done Done false
27080 6366 Acked 7365 Read 1 New Done Done false
27081 6367 Acked 7366 Flush 0 New Done Done false
27082 6368 Acked 7367 Write 7 New Done Done false
27083 6369 Acked 7368 Read 8 New Done Done false
27084 6370 Acked 7369 Write 9 New Done Done false
27085 6371 Acked 7370 Flush 0 New Done Done false
27086 6372 Acked 7371 Write 5 New Done Done false
27087 6373 Acked 7372 Write 1 New Done Done false
27088 6374 Acked 7373 Flush 0 New Done Done false
27089 6375 Acked 7374 Read 2 New Done Done false
27090 6376 Acked 7375 Read 3 New Done Done false
27091 6377 Acked 7376 Read 1 New Done Done false
27092 6378 Acked 7377 Read 10 New Done Done false
27093 6379 Acked 7378 Read 5 New Done Done false
27094 6380 Acked 7379 Write 2 New Done Done false
27095 6381 Acked 7380 Flush 0 New Done Done false
27096 6382 Acked 7381 Flush 0 New Done Done false
27097 6383 Acked 7382 Read 7 New Done Done false
27098 6384 Acked 7383 Write 4 New Done Done false
27099 6385 Acked 7384 Read 9 New Done Done false
27100 6386 Acked 7385 Write 9 New Done Done false
27101 6387 Acked 7386 Write 5 New Done Done false
27102 6388 Acked 7387 Write 5 New Done Done false
27103 6389 Acked 7388 Read 4 New Done Done false
27104 6390 Acked 7389 Read 7 New Done Done false
27105 6391 Acked 7390 Write 4 New Done Done false
27106 6392 Acked 7391 Flush 0 New Done Done false
27107 6393 Acked 7392 Read 8 New Done Done false
27108 6394 Acked 7393 Read 2 New Done Done false
27109 6395 Acked 7394 Read 5 New Done Done false
27110 6396 Acked 7395 Flush 0 New Done Done false
27111 6397 Acked 7396 Write 4 New Done Done false
27112 6398 Acked 7397 Read 2 New Done Done false
27113 6399 Acked 7398 Write 4 New Done Done false
27114 6400 Acked 7399 Flush 0 New Done Done false
27115 6401 Acked 7400 Flush 0 New Done Done false
27116 6402 Acked 7401 Read 1 New Done Done false
27117 6403 Acked 7402 Write 3 New Done Done false
27118 6404 Acked 7403 Read 2 New Done Done false
27119 6405 Acked 7404 Write 6 New Done Done false
27120 6406 Acked 7405 Read 8 New Done Done false
27121 6407 Acked 7406 Write 10 New Done Done false
27122 6408 Acked 7407 Write 4 New Done Done false
27123 6409 Acked 7408 Write 5 New Done Done false
27124 6410 Acked 7409 Read 4 New Done Done false
27125 6411 Acked 7410 Write 3 New Done Done false
27126 6412 Acked 7411 Read 6 New Done Done false
27127 6413 Acked 7412 Read 3 New Done Done false
27128 6414 Acked 7413 Write 8 New Done Done false
27129 6415 Acked 7414 Read 7 New Done Done false
27130 6416 Acked 7415 Flush 0 New Done Done false
27131 6417 Acked 7416 Read 8 New Done Done false
27132 6418 Acked 7417 Read 9 New Done Done false
27133 6419 Acked 7418 Read 10 New Done Done false
27134 6420 Acked 7419 Write 5 New Done Done false
27135 6421 Acked 7420 Write 10 New Done Done false
27136 6422 Acked 7421 Write 4 New Done Done false
27137 6423 Acked 7422 Read 1 New Done Done false
27138 6424 Acked 7423 Read 5 New Done Done false
27139 6425 Acked 7424 Read 7 New Done Done false
27140 6426 Acked 7425 Read 5 New Done Done false
27141 6427 Acked 7426 Write 1 New Done Done false
27142 6428 Acked 7427 Read 1 New Done Done false
27143 6429 Acked 7428 Write 4 New Done Done false
27144 6430 Acked 7429 Read 1 New Done Done false
27145 6431 Acked 7430 Read 8 New Done Done false
27146 6432 Acked 7431 Read 3 New Done Done false
27147 6433 Acked 7432 Read 7 New Done Done false
27148 6434 Acked 7433 Write 9 New Done Done false
27149 6435 Acked 7434 Read 1 New Done Done false
27150 6436 Acked 7435 Flush 0 New Done Done false
27151 6437 Acked 7436 Write 5 New Done Done false
27152 6438 Acked 7437 Read 5 New Done Done false
27153 6439 Acked 7438 Write 2 New Done Done false
27154 6440 Acked 7439 Write 8 New Done Done false
27155 6441 Acked 7440 Write 10 New Done Done false
27156 6442 Acked 7441 Read 4 New Done Done false
27157 6443 Acked 7442 Read 5 New Done Done false
27158 6444 Acked 7443 Read 9 New Done Done false
27159 6445 Acked 7444 Read 7 New Done Done false
27160 6446 Acked 7445 Read 7 New Done Done false
27161 6447 Acked 7446 Write 1 New Done Done false
27162 6448 Acked 7447 Flush 0 New Done Done false
27163 6449 Acked 7448 Flush 0 New Done Done false
27164 6450 Acked 7449 Read 9 New Done Done false
27165 6451 Acked 7450 Read 5 New Done Done false
27166 6452 Acked 7451 Read 6 New Done Done false
27167 6453 Acked 7452 Write 4 New Done Done false
27168 6454 Acked 7453 Read 6 New Done Done false
27169 6455 Acked 7454 Write 8 New Done Done false
27170 6456 Acked 7455 Write 3 New Done Done false
27171 6457 Acked 7456 Read 4 New Done Done false
27172 6458 Acked 7457 Write 2 New Done Done false
27173 6459 Acked 7458 Write 9 New Done Done false
27174 6460 Acked 7459 Read 9 New Done Done false
27175 6461 Acked 7460 Write 7 New Done Done false
27176 6462 Acked 7461 Write 10 New Done Done false
27177 6463 Acked 7462 Write 4 New Done Done false
27178 6464 Acked 7463 Write 4 New Done Done false
27179 6465 Acked 7464 Read 7 New Done Done false
27180 6466 Acked 7465 Read 9 New Done Done false
27181 6467 Acked 7466 Read 5 New Done Done false
27182 6468 Acked 7467 Read 3 New Done Done false
27183 6469 Acked 7468 Flush 0 New Done Done false
27184 6470 Acked 7469 Read 8 New Done Done false
27185 6471 Acked 7470 Read 3 New Done Done false
27186 6472 Acked 7471 Read 2 New Done Done false
27187 6473 Acked 7472 Read 7 New Done Done false
27188 6474 Acked 7473 Write 8 New Done Done false
27189 6475 Acked 7474 Read 1 New Done Done false
27190 6476 Acked 7475 Flush 0 New Done Done false
27191 6477 Acked 7476 Write 2 New Done Done false
27192 6478 Acked 7477 Write 3 New Done Done false
27193 6479 Acked 7478 Read 3 New Done Done false
27194 6480 Acked 7479 Read 3 New Done Done false
27195 6481 Acked 7480 Write 5 New Done Done false
27196 6482 Acked 7481 Write 10 New Done Done false
27197 6483 Acked 7482 Read 8 New Done Done false
27198 6484 Acked 7483 Read 7 New Done Done false
27199 6485 Acked 7484 Flush 0 New Done Done false
27200 6486 Acked 7485 Write 8 New Done Done false
27201 6487 Acked 7486 Read 10 New Done Done false
27202 6488 Acked 7487 Read 6 New Done Done false
27203 6489 Acked 7488 Write 10 New Done Done false
27204 6490 Acked 7489 Write 3 New Done Done false
27205 6491 Acked 7490 Read 6 New Done Done false
27206 6492 Acked 7491 Read 4 New Done Done false
27207 6493 Acked 7492 Read 1 New Done Done false
27208 6494 Acked 7493 Read 4 New Done Done false
27209 6495 Acked 7494 Write 4 New Done Done false
27210 6496 Acked 7495 Read 9 New Done Done false
27211 6497 Acked 7496 Read 7 New Done Done false
27212 6498 Acked 7497 Read 5 New Done Done false
27213 6499 Acked 7498 Read 10 New Done Done false
27214 6500 Acked 7499 Write 5 New Done Done false
27215 6501 Acked 7500 Write 10 New Done Done false
27216 6502 Acked 7501 Flush 0 New Done Done false
27217 6503 Acked 7502 Read 2 New Done Done false
27218 6504 Acked 7503 Read 8 New Done Done false
27219 6505 Acked 7504 Write 5 New Done Done false
27220 6506 Acked 7505 Write 4 New Done Done false
27221 6507 Acked 7506 Write 10 New Done Done false
27222 6508 Acked 7507 Read 10 New Done Done false
27223 6509 Acked 7508 Write 9 New Done Done false
27224 6510 Acked 7509 Read 3 New Done Done false
27225 6511 Acked 7510 Read 7 New Done Done false
27226 6512 Acked 7511 Read 2 New Done Done false
27227 6513 Acked 7512 Write 8 New Done Done false
27228 6514 Acked 7513 Write 6 New Done Done false
27229 6515 Acked 7514 Write 9 New Done Done false
27230 6516 Acked 7515 Flush 0 New Done Done false
27231 6517 Acked 7516 Write 9 New Done Done false
27232 6518 Acked 7517 Read 9 New Done Done false
27233 6519 Acked 7518 Flush 0 New Done Done false
27234 6520 Acked 7519 Read 9 New Done Done false
27235 6521 Acked 7520 Read 1 New Done Done false
27236 6522 Acked 7521 Write 4 New Done Done false
27237 6523 Acked 7522 Read 10 New Done Done false
27238 6524 Acked 7523 Read 3 New Done Done false
27239 6525 Acked 7524 Write 1 New Done Done false
27240 6526 Acked 7525 Write 1 New Done Done false
27241 6527 Acked 7526 Write 5 New Done Done false
27242 6528 Acked 7527 Flush 0 New Done Done false
27243 6529 Acked 7528 Write 10 New Done Done false
27244 6530 Acked 7529 Read 1 New Done Done false
27245 6531 Acked 7530 Write 2 New Done Done false
27246 6532 Acked 7531 Write 8 New Done Done false
27247 6533 Acked 7532 Flush 0 New Done Done false
27248 6534 Acked 7533 Read 1 New Done Done false
27249 6535 Acked 7534 Flush 0 New Done Done false
27250 6536 Acked 7535 Write 9 New Done Done false
27251 6537 Acked 7536 Write 5 New Done Done false
27252 6538 Acked 7537 Flush 0 New Done Done false
27253 6539 Acked 7538 Read 9 New Done Done false
27254 6540 Acked 7539 Write 6 New Done Done false
27255 6541 Acked 7540 Write 3 New Done Done false
27256 6542 Acked 7541 Write 7 New Done Done false
27257 6543 Acked 7542 Read 2 New Done Done false
27258 6544 Acked 7543 Write 4 New Done Done false
27259 6545 Acked 7544 Write 2 New Done Done false
27260 6546 Acked 7545 Flush 0 New Done Done false
27261 6547 Acked 7546 Read 3 New Done Done false
27262 6548 Acked 7547 Read 8 New Done Done false
27263 6549 Acked 7548 Read 8 New Done Done false
27264 6550 Acked 7549 Read 4 New Done Done false
27265 6551 Acked 7550 Write 1 New Done Done false
27266 6552 Acked 7551 Read 1 New Done Done false
27267 6553 Acked 7552 Read 4 New Done Done false
27268 6554 Acked 7553 Read 1 New Done Done false
27269 6555 Acked 7554 Write 6 New Done Done false
27270 6556 Acked 7555 Flush 0 New Done Done false
27271 6557 Acked 7556 Read 1 New Done Done false
27272 6558 Acked 7557 Read 6 New Done Done false
27273 6559 Acked 7558 Write 7 New Done Done false
27274 6560 Acked 7559 Read 7 New Done Done false
27275 6561 Acked 7560 Flush 0 New Done Done false
27276 6562 Acked 7561 Flush 0 New Done Done false
27277 6563 Acked 7562 Read 10 New Done Done false
27278 6564 Acked 7563 Read 8 New Done Done false
27279 6565 Acked 7564 Write 5 New Done Done false
27280 6566 Acked 7565 Write 3 New Done Done false
27281 6567 Acked 7566 Read 9 New Done Done false
27282 6568 Acked 7567 Write 5 New Done Done false
27283 6569 Acked 7568 Write 1 New Done Done false
27284 6570 Acked 7569 Read 10 New Done Done false
27285 6571 Acked 7570 Read 2 New Done Done false
27286 6572 Acked 7571 Read 4 New Done Done false
27287 6573 Acked 7572 Write 4 New Done Done false
27288 6574 Acked 7573 Read 1 New Done Done false
27289 6575 Acked 7574 Read 3 New Done Done false
27290 6576 Acked 7575 Write 4 New Done Done false
27291 6577 Acked 7576 Read 6 New Done Done false
27292 6578 Acked 7577 Read 5 New Done Done false
27293 6579 Acked 7578 Write 7 New Done Done false
27294 6580 Acked 7579 Write 6 New Done Done false
27295 6581 Acked 7580 Read 4 New Done Done false
27296 6582 Acked 7581 Read 9 New Done Done false
27297 6583 Acked 7582 Read 7 New Done Done false
27298 6584 Acked 7583 Write 7 New Done Done false
27299 6585 Acked 7584 Read 1 New Done Done false
27300 6586 Acked 7585 Write 7 New Done Done false
27301 6587 Acked 7586 Flush 0 New Done Done false
27302 6588 Acked 7587 Read 7 New Done Done false
27303 6589 Acked 7588 Read 10 New Done Done false
27304 6590 Acked 7589 Read 9 New Done Done false
27305 6591 Acked 7590 Write 1 New Done Done false
27306 6592 Acked 7591 Flush 0 New Done Done false
27307 6593 Acked 7592 Write 8 New Done Done false
27308 6594 Acked 7593 Write 6 New Done Done false
27309 6595 Acked 7594 Read 7 New Done Done false
27310 6596 Acked 7595 Read 7 New Done Done false
27311 6597 Acked 7596 Write 10 New Done Done false
27312 6598 Acked 7597 Write 2 New Done Done false
27313 6599 Acked 7598 Write 6 New Done Done false
27314 6600 Acked 7599 Read 5 New Done Done false
27315 6601 Acked 7600 Write 4 New Done Done false
27316 6602 Acked 7601 Read 1 New Done Done false
27317 6603 Acked 7602 Read 4 New Done Done false
27318 6604 Acked 7603 Write 5 New Done Done false
27319 6605 Acked 7604 Write 8 New Done Done false
27320 6606 Acked 7605 Read 10 New Done Done false
27321 6607 Acked 7606 Write 8 New Done Done false
27322 6608 Acked 7607 Read 7 New Done Done false
27323 6609 Acked 7608 Read 7 New Done Done false
27324 6610 Acked 7609 Read 4 New Done Done false
27325 6611 Acked 7610 Read 6 New Done Done false
27326 6612 Acked 7611 Read 2 New Done Done false
27327 6613 Acked 7612 Read 10 New Done Done false
27328 6614 Acked 7613 Read 6 New Done Done false
27329 6615 Acked 7614 Read 5 New Done Done false
27330 6616 Acked 7615 Write 5 New Done Done false
27331 6617 Acked 7616 Read 10 New Done Done false
27332 6618 Acked 7617 Read 3 New Done Done false
27333 6619 Acked 7618 Read 2 New Done Done false
27334 6620 Acked 7619 Read 1 New Done Done false
27335 6621 Acked 7620 Write 1 New Done Done false
27336 6622 Acked 7621 Read 4 New Done Done false
27337 6623 Acked 7622 Write 2 New Done Done false
27338 6624 Acked 7623 Write 2 New Done Done false
27339 6625 Acked 7624 Write 3 New Done Done false
27340 6626 Acked 7625 Write 6 New Done Done false
27341 6627 Acked 7626 Flush 0 New Done Done false
27342 6628 Acked 7627 Read 6 New Done Done false
27343 6629 Acked 7628 Write 6 New Done Done false
27344 6630 Acked 7629 Read 10 New Done Done false
27345 6631 Acked 7630 Flush 0 New Done Done false
27346 STATES DS:0 DS:1 DS:2 TOTAL
27347 New 301 0 0 301
27348 Sent 0 0 0 0
27349 Done 0 301 301 602
27350 Skipped 0 0 0 0
27351 Error 0 0 0 0
27352 Last Flush: 7329 7630 7630
27353 Downstairs last five completed: 7329 7328 7327 7326 7325
27354 Upstairs last five completed: 6631 6630 6629 6628 6627
27355 CLIENT: Up:0 ds:301 act:2
273562024-04-20T01:10:48.761ZINFOcrucible: connecting to 127.0.0.1:8810 = io task client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
273572024-04-20T01:10:48.761ZINFOcrucible: ds_connection connected from Ok(127.0.0.1:55164) = io task client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
273582024-04-20T01:10:48.763ZINFOcrucible: downstairs client at Some(127.0.0.1:8810) has region UUID 12345678-0000-0000-0000-000000008810 = downstairs client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
273592024-04-20T01:10:48.763ZINFOcrucible: Returning UUID:12345678-0000-0000-0000-000000008810 matches = downstairs client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
273602024-04-20T01:10:48.763ZINFOcrucible: send last flush ID to this DS: 7329 = downstairs client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
273612024-04-20T01:10:48.763ZINFOcrucible: Replied this last flush ID: 7329 = downstairs client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
273622024-04-20T01:10:48.763ZINFOcrucible: ds_transition from Offline to Replay = downstairs client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
273632024-04-20T01:10:48.763ZINFOcrucible: [0] Transition from Offline to Replay = downstairs client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
273642024-04-20T01:10:48.763ZINFOcrucible: ds_transition from Replay to Active = downstairs client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
273652024-04-20T01:10:48.763ZINFOcrucible: [0] Transition from Replay to Active = downstairs client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
27366 ----------------------------------------------------------------
27367 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:0
27368 Downstairs last five completed: 7630 7629 7628 7627 7626
27369 Upstairs last five completed: 6631 6630 6629 6628 6627
27370 CLIENT: Up:0 ds:0 act:3
27371 Replay: All jobs finished, all DS active.
27372 Main task has work to do, go find it
27373 got dsc Stop(0)
27374 stop 0
27375 Apr 20 01:10:51.074 INFO request completed, latency_us: 347, response_code: 204, uri: /stop/cid/0, method: POST, req_id: 8df0221a-dd6e-40b7-b65d-3d870e830c55, remote_addr: 127.[8810] Got stop action so:false kr:false
27376 0.0.1:60352, local_addr: 127.0.0.1:9998
273772024-04-20T01:10:51.075ZWARNcrucible: downstairs disconnected = io task client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
273782024-04-20T01:10:51.075ZWARNcrucible: client task is sending Done(Finished) = io task client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
273792024-04-20T01:10:51.075ZWARNcrucible: downstairs task for 0 stopped due to Finished session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
273802024-04-20T01:10:51.075ZINFOcrucible: Gone missing, transition from Active to Offline = downstairs client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
273812024-04-20T01:10:51.075ZINFOcrucible: [0] client re-new 0 jobs since flush 7630 = downstairs session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
273822024-04-20T01:10:51.075ZINFOcrucible: [0] Marked 0 jobs for replay since flush: 7630 = downstairs session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
27383 Apr 20 01:10:51.075 INFO {"msg":"client task is exiting","v":0,"name":"crucible","level":30,"time":"2024-04-20T01:10:51.075776482Z","hostname":"w-01HVWGBJP7HK0H9TQ26T6N3X8M","pid":1196,"":"io task","client":"0","":"downstairs","session_id":"132b460a-26a0-4532-b1ab-4f8c07d4c6c7"}
27384 request completed, latency_us: 129, response_code: 200, uri: /state/cid/0, method: GET, req_id: c0fc7d41-971d-4e32-ae41-4ce699961519, remote_addr: 127.0.0.1:60352, local_addr: 127.0.0.1:9998
27385 [8810] Exited with: ExitStatus(unix_wait_status(9))
27386 [8810][0] reports Exit
27387 Apr 20 01:10:55.078 INFO request completed, latency_us: 200, response_code: 200, uri: /state/cid/0, method: GET, req_id: 72515438-0ac4-4fd6-a675-8b9a53409b38, remote_addr: 127.0.0.1:60352, local_addr: 127.0.0.1:9998
27388 001/300 Read block 1131 len 4096
27389 002/300 Write block 3445 len 24576 data: 6 5 4 6 6 4
27390 003/300 Flush
27391 004/300 Read block 4612 len 32768
27392 005/300 Write block 4431 len 16384 data: 8 9 7 6
27393 006/300 Write block 3991 len 40960 data: 4 4 4 3 3 4 5 5 5 6
27394 007/300 Write block 4335 len 20480 data: 3 4 3 3 3
27395 008/300 Read block 3685 len 32768
27396 009/300 Write block 3038 len 8192 data: 6 4
27397 010/300 Write block 4341 len 32768 data: 3 3 4 4 4 5 5 7
27398 011/300 Read block 3409 len 16384
27399 012/300 Write block 3383 len 36864 data: 5 5 5 6 6 6 7 5 6
27400 013/300 Flush
27401 014/300 Flush
27402 015/300 Flush
27403 016/300 Write block 966 len 4096 data: 6
27404 017/300 Read block 3845 len 4096
27405 018/300 Read block 589 len 40960
27406 019/300 Write block 1450 len 24576 data: 4 5 5 4 4 5
27407 020/300 Read block 1461 len 4096
27408 021/300 Read block 3644 len 12288
27409 022/300 Read block 1474 len 16384
27410 023/300 Read block 3714 len 12288
27411 024/300 Flush
27412 025/300 Read block 1444 len 4096
27413 026/300 Read block 1207 len 4096
27414 027/300 Read block 3942 len 16384
27415 028/300 Read block 4165 len 28672
27416 029/300 Write block 4563 len 20480 data: 4 5 4 6 6
27417 030/300 Read block 566 len 40960
27418 031/300 Read block 3399 len 36864
27419 032/300 Read block 2338 len 40960
27420 033/300 Write block 4593 len 4096 data: 4
27421 034/300 Flush
27422 035/300 Read block 3960 len 36864
27423 036/300 Read block 804 len 8192
27424 037/300 Write block 2571 len 24576 data: 2 2 3 4 4 3
27425 038/300 Flush
27426 039/300 Read block 1625 len 24576
27427 040/300 Write block 4003 len 12288 data: 8 8 9
27428 041/300 Read block 2018 len 24576
27429 042/300 Flush
27430 043/300 Read block 451 len 36864
27431 044/300 Write block 1869 len 24576 data: 6 4 4 5 4 6
27432 045/300 Read block 3440 len 20480
27433 046/300 Write block 848 len 24576 data: 4 4 3 4 5 6
27434 047/300 Write block 838 len 36864 data: 7 6 6 7 6 6 5 3 3
27435 048/300 Write block 1130 len 32768 data: 6 6 7 6 6 7 6 6
27436 049/300 Write block 2684 len 36864 data: 5 5 5 5 5 4 4 4 3
27437 050/300 Write block 1804 len 16384 data: 9 6 6 5
27438 051/300 Write block 2932 len 20480 data: 4 4 3 2 3
27439 052/300 Read block 3136 len 20480
27440 053/300 Write block 1450 len 40960 data: 5 6 6 5 5 6 5 3 3 3
27441 054/300 Flush
27442 055/300 Write block 3786 len 12288 data: 8 9 9
27443 056/300 Write block 4547 len 28672 data: 6 6 4 4 4 4 3
27444 057/300 Write block 953 len 12288 data: 7 5 4
27445 058/300 Read block 4018 len 24576
27446 059/300 Read block 1870 len 20480
27447 060/300 Read block 2886 len 40960
27448 061/300 Read block 2240 len 12288
27449 062/300 Read block 4069 len 8192
27450 063/300 Read block 4427 len 8192
27451 064/300 Flush
27452 065/300 Write block 50 len 40960 data: 2 2 4 4 4 3 2 2 3 3
27453 066/300 Write block 483 len 28672 data: 5 5 3 4 4 3 2
27454 067/300 Write block 4665 len 40960 data: 4 3 4 4 4 7 7 5 6 6
27455 068/300 Write block 1065 len 8192 data: 4 2
27456 069/300 Write block 955 len 20480 data: 5 3 3 3 4
27457 070/300 Read block 9 len 12288
27458 071/300 Write block 3307 len 40960 data: 6 5 4 4 5 4 4 4 4 3
27459 072/300 Write block 45 len 4096 data: 5
27460 073/300 Read block 832 len 32768
27461 074/300 Read block 999 len 28672
27462 075/300 Read block 4937 len 12288
27463 076/300 Write block 595 len 28672 data: 6 6 6 6 5 4 4
27464 077/300 Write block 3183 len 24576 data: 5 5 5 6 6 6
27465 078/300 Read block 3450 len 4096
27466 079/300 Read block 459 len 8192
27467 080/300 Write block 3075 len 28672 data: 3 3 4 4 5 6 7
27468 081/300 Read block 3592 len 28672
27469 082/300 Read block 1576 len 8192
27470 083/300 Write block 4819 len 16384 data: 7 8 9 9
27471 084/300 Write block 2477 len 16384 data: 3 2 3 2
27472 085/300 Read block 4222 len 12288
27473 086/300 Write block 2805 len 12288 data: 5 5 5
27474 087/300 Write block 2742 len 16384 data: 5 5 5 5
27475 088/300 Flush
27476 089/300 Write block 2749 len 24576 data: 7 7 6 7 8 7
27477 090/300 Write block 888 len 16384 data: 5 5 3 3
27478 091/300 Read block 1195 len 20480
27479 092/300 Write block 4324 len 12288 data: 3 3 3
27480 093/300 Read block 4577 len 36864
27481 094/300 Read block 4420 len 32768
27482 095/300 Read block 3298 len 28672
27483 096/300 Read block 737 len 28672
27484 097/300 Read block 4599 len 40960
27485 098/300 Write block 1856 len 40960 data: 5 6 5 4 2 3 4 4 4 4
27486 099/300 Write block 4608 len 12288 data: 6 5 5
27487 100/300 Read block 644 len 28672
27488 101/300 Read block 4907 len 16384
27489 102/300 Read block 3651 len 12288
27490 103/300 Read block 2639 len 36864
27491 104/300 Read block 613 len 24576
27492 105/300 Read block 4061 len 4096
27493 106/300 Read block 2013 len 32768
27494 107/300 Read block 2405 len 40960
27495 108/300 Read block 2573 len 32768
27496 109/300 Read block 816 len 36864
27497 110/300 Read block 4467 len 40960
27498 111/300 Write block 4720 len 24576 data: 2 3 4 5 4 4
27499 112/300 Read block 1858 len 20480
27500 113/300 Write block 4662 len 4096 data: 5
27501 114/300 Write block 2688 len 36864 data: 6 5 5 5 4 3 3 2 3
27502 115/300 Write block 2079 len 40960 data: 4 3 4 3 4 4 6 8 6 4
27503 116/300 Write block 3841 len 40960 data: 4 4 2 2 3 3 4 4 4 4
27504 117/300 Write block 2324 len 40960 data: 3 5 5 6 6 5 6 5 5 6
27505 118/300 Write block 2174 len 16384 data: 6 5 6 5
27506 119/300 Flush
27507 120/300 Flush
27508 121/300 Read block 1934 len 16384
27509 122/300 Read block 1810 len 28672
27510 123/300 Read block 2079 len 40960
27511 124/300 Read block 597 len 36864
27512 125/300 Write block 3293 len 36864 data: 2 2 4 4 4 4 4 4 4
27513 126/300 Read block 2952 len 24576
27514 127/300 Read block 1378 len 28672
27515 128/300 Read block 3771 len 20480
27516 129/300 Write block 2458 len 20480 data: 6 4 6 6 6
27517 130/300 Read block 584 len 8192
27518 131/300 Read block 3350 len 12288
27519 132/300 Write block 4889 len 16384 data: 7 5 4 5
27520 133/300 Read block 111 len 32768
27521 134/300 Write block 3843 len 16384 data: 3 3 4 4
27522 135/300 Read block 3333 len 4096
27523 136/300 Write block 3195 len 16384 data: 7 7 6 8
27524 137/300 Read block 3174 len 32768
27525 138/300 Read block 3330 len 24576
27526 139/300 Read block 2516 len 28672
27527 140/300 Write block 4967 len 24576 data: 3 3 4 5 5 5
27528 141/300 Read block 3286 len 12288
27529 142/300 Write block 4320 len 16384 data: 5 4 3 4
27530 143/300 Flush
27531 144/300 Write block 1681 len 4096 data: 5
27532 145/300 Read block 2762 len 40960
27533 146/300 Write block 3970 len 40960 data: 4 4 5 4 4 3 3 2 3 3
27534 147/300 Write block 1869 len 4096 data: 7
27535 148/300 Write block 2104 len 32768 data: 6 6 6 4 3 2 4 4
27536 149/300 Write block 4646 len 16384 data: 2 2 2 3
27537 150/300 Read block 660 len 16384
27538 151/300 Read block 958 len 40960
27539 152/300 Write block 3629 len 4096 data: 3
27540 153/300 Read block 2936 len 28672
27541 154/300 Write block 4838 len 36864 data: 4 4 5 6 6 7 7 6 7
27542 155/300 Write block 801 len 36864 data: 6 6 6 5 3 3 3 3 2
27543 156/300 Write block 575 len 40960 data: 6 4 5 5 5 6 6 4 4 4
27544 157/300 Read block 4799 len 32768
27545 158/300 Flush
27546 159/300 Read block 3539 len 16384
27547 160/300 Read block 987 len 32768
27548 161/300 Read block 2298 len 36864
27549 162/300 Write block 311 len 4096 data: 5
27550 163/300 Read block 2942 len 8192
27551 164/300 Flush
27552 165/300 Write block 3122 len 28672 data: 5 6 6 6 6 6 7
27553 166/300 Write block 3180 len 40960 data: 5 5 6 6 6 6 7 7 7 6
27554 167/300 Read block 2396 len 8192
27555 168/300 Write block 167 len 36864 data: 5 5 5 6 6 6 7 5 6
27556 169/300 Flush
27557 170/300 Write block 3491 len 12288 data: 7 7 7
27558 171/300 Read block 777 len 8192
27559 172/300 Read block 386 len 20480
27560 173/300 Read block 3147 len 12288
27561 174/300 Write block 3445 len 16384 data: 7 6 5 7
27562 175/300 Flush
27563 176/300 Read block 269 len 20480
27564 177/300 Write block 2871 len 16384 data: 4 3 3 5
27565 178/300 Flush
27566 179/300 Write block 3708 len 24576 data: 6 6 5 5 5 5
27567 180/300 Write block 4285 len 4096 data: 3
27568 181/300 Read block 4935 len 12288
27569 182/300 Read block 4210 len 4096
27570 183/300 Read block 2603 len 4096
27571 184/300 Read block 1788 len 16384
27572 185/300 Flush
27573 186/300 Read block 1385 len 8192
27574 187/300 Read block 4646 len 12288
27575 188/300 Write block 4824 len 24576 data: 8 8 8 7 6 4
27576 189/300 Read block 536 len 8192
27577 190/300 Write block 2222 len 32768 data: 6 5 5 6 6 5 5 6
27578 191/300 Read block 2486 len 8192
27579 192/300 Read block 2105 len 8192
27580 193/300 Read block 1447 len 32768
27581 194/300 Write block 646 len 12288 data: 6 7 5
27582 195/300 Write block 3636 len 12288 data: 5 5 3
27583 196/300 Write block 756 len 8192 data: 4 3
27584 197/300 Write block 1688 len 32768 data: 5 5 4 4 2 3 4 5
27585 198/300 Write block 2080 len 36864 data: 4 5 4 5 5 7 9 7 5
27586 199/300 Flush
27587 200/300 Read block 1217 len 16384
27588 201/300 Read block 3965 len 20480
27589 202/300 Write block 2654 len 20480 data: 3 3 3 3 4
27590 203/300 Read block 2557 len 12288
27591 204/300 Read block 606 len 16384
27592 205/300 Write block 4827 len 12288 data: 8 7 5
27593 206/300 Write block 2198 len 32768 data: 4 3 3 2 2 4 4 3
27594 207/300 Write block 214 len 12288 data: 2 2 2
27595 208/300 Write block 708 len 16384 data: 2 2 3 3
27596 209/300 Write block 219 len 8192 data: 4 5
27597 210/300 Read block 1055 len 32768
27598 211/300 Read block 2497 len 36864
27599 212/300 Write block 4342 len 32768 data: 4 5 5 5 6 6 8 7
27600 213/300 Write block 650 len 4096 data: 3
27601 214/300 Read block 4775 len 36864
27602 215/300 Write block 3006 len 8192 data: 8 8
27603 216/300 Read block 2396 len 28672
27604 217/300 Write block 18 len 20480 data: 3 4 5 5 4
27605 218/300 Write block 4246 len 40960 data: 10 6 6 5 5 6 6 6 7 7
27606 219/300 Write block 3513 len 20480 data: 4 5 5 6 6
27607 220/300 Read block 119 len 16384
27608 221/300 Read block 1330 len 4096
27609 222/300 Read block 2102 len 16384
27610 223/300 Write block 3710 len 36864 data: 6 6 6 6 5 6 6 5 5
27611 224/300 Read block 4466 len 16384
27612 225/300 Read block 3166 len 8192
27613 226/300 Read block 1057 len 36864
27614 227/300 Read block 3343 len 4096
27615 228/300 Read block 1009 len 8192
27616 229/300 Read block 2803 len 4096
27617 230/300 Read block 1144 len 40960
27618 231/300 Flush
27619 232/300 Flush
27620 233/300 Read block 2064 len 24576
27621 234/300 Read block 81 len 28672
27622 235/300 Read block 1022 len 12288
27623 236/300 Read block 530 len 24576
27624 237/300 Write block 2056 len 40960 data: 7 8 8 8 8 9 8 8 8 8
27625 238/300 Read block 2813 len 40960
27626 239/300 Write block 3877 len 36864 data: 5 5 5 4 5 5 5 7 7
27627 240/300 Read block 4591 len 36864
27628 241/300 Write block 1772 len 8192 data: 7 7
27629 242/300 Flush
27630 243/300 Read block 2394 len 12288
27631 244/300 Read block 910 len 32768
27632 245/300 Write block 3535 len 8192 data: 5 6
27633 246/300 Read block 3130 len 12288
27634 247/300 Read block 3859 len 12288
27635 248/300 Read block 2352 len 4096
27636 249/300 Write block 3310 len 16384 data: 5 6 5 5
27637 250/300 Write block 2023 len 40960 data: 10 9 9 11 9 6 5 4 4 3
27638 251/300 Read block 2102 len 40960
27639 252/300 Flush
27640 253/300 Read block 4324 len 20480
27641 254/300 Read block 4739 len 12288
27642 255/300 Read block 49 len 8192
27643 256/300 Read block 2338 len 16384
27644 257/300 Read block 1427 len 28672
27645 258/300 Write block 1551 len 36864 data: 6 7 6 4 4 5 5 5 5
27646 259/300 Read block 2274 len 20480
27647 260/300 Read block 296 len 24576
27648 261/300 Read block 80 len 36864
27649 262/300 Read block 1118 len 36864
27650 263/300 Write block 3610 len 40960 data: 6 4 3 4 6 5 4 4 5 5
27651 264/300 Read block 1535 len 8192
27652 265/300 Read block 1403 len 4096
27653 266/300 Read block 3328 len 4096
27654 267/300 Write block 1442 len 36864 data: 10 7 7 8 6 6 4 4 6
27655 268/300 Write block 4258 len 8192 data: 6 7
27656 269/300 Read block 4011 len 36864
27657 270/300 Flush
27658 271/300 Write block 790 len 24576 data: 5 4 4 3 4 4
27659 272/300 Read block 4914 len 20480
27660 273/300 Write block 3648 len 8192 data: 3 4
27661 274/300 Write block 1020 len 16384 data: 4 3 3 3
27662 275/300 Write block 1688 len 12288 data: 6 6 5
27663 276/300 Read block 4189 len 32768
27664 277/300 Read block 3557 len 8192
27665 278/300 Write block 829 len 24576 data: 6 5 5 4 5 6
27666 279/300 Write block 4286 len 16384 data: 3 4 3 3
27667 280/300 Read block 945 len 12288
27668 281/300 Read block 2346 len 36864
27669 282/300 Read block 2845 len 8192
27670 283/300 Write block 3646 len 24576 data: 5 4 4 5 4 4
27671 284/300 Read block 4347 len 36864
27672 285/300 Read block 3144 len 4096
27673 286/300 Write block 3474 len 24576 data: 4 2 4 6 6 6
27674 287/300 Write block 3815 len 28672 data: 4 6 6 6 2 2 2
27675 288/300 Read block 575 len 16384
27676 289/300 Read block 802 len 36864
27677 290/300 Read block 2846 len 20480
27678 291/300 Write block 1109 len 4096 data: 4
27679 292/300 Read block 920 len 12288
27680 293/300 Read block 4780 len 40960
27681 294/300 Read block 2723 len 36864
27682 295/300 Write block 3957 len 16384 data: 10 10 9 8
27683 296/300 Read block 1986 len 12288
27684 297/300 Write block 1008 len 40960 data: 2 3 3 4 3 5 3 5 5 4
27685 298/300 Read block 3800 len 32768
27686 299/300 Read block 1900 len 32768
27687 300/300 Read block 4511 len 4096
27688 Main task has work to do, go find it
27689 got dsc Start(0)
27690 start 0
27691 Apr 20 01:10:55.380 INFO request completed, latency_us: 208, response_code: 204, uri: /start/cid/0, method: POST, req_id: a6ef3766-7d0d-4cfd-9f59-0833d3728a02, remote_addr: 127.0.0.1:60352, local_addr: 127.0.0.1:9998
27692 Replay: started 0, returned:Ok(())
27693 ----------------------------------------------------------------
27694 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:301
27695 States: Offline Active Active
27696 GW_ID ACK DSID TYPE BLOCKS DS:0 DS:1 DS:2 REPLAY
27697 6632 Acked 7631 Read 1 New Done Done false
27698 6633 Acked 7632 Write 6 New Done Done false
27699 6634 Acked 7633 Flush 0 New Done Done false
27700 6635 Acked 7634 Read 8 New Done Done false
27701 6636 Acked 7635 Write 4 New Done Done false
27702 6637 Acked 7636 Write 10 New Done Done false
27703 6638 Acked 7637 Write 5 New Done Done false
27704 6639 Acked 7638 Read 8 New Done Done false
27705 6640 Acked 7639 Write 2 New Done Done false
27706 6641 Acked 7640 Write 8 New Done Done false
27707 6642 Acked 7641 Read 4 New Done Done false
27708 6643 Acked 7642 Write 9 New Done Done false
27709 6644 Acked 7643 Flush 0 New Done Done false
27710 6645 Acked 7644 Flush 0 New Done Done false
27711 6646 Acked 7645 Flush 0 New Done Done false
27712 6647 Acked 7646 Write 1 New Done Done false
27713 6648 Acked 7647 Read 1 New Done Done false
27714 6649 Acked 7648 Read 10 New Done Done false
27715 6650 Acked 7649 Write 6 New Done Done false
27716 6651 Acked 7650 Read 1 New Done Done false
27717 6652 Acked 7651 Read 3 New Done Done false
27718 6653 Acked 7652 Read 4 New Done Done false
27719 6654 Acked 7653 Read 3 New Done Done false
27720 6655 Acked 7654 Flush 0 New Done Done false
27721 6656 Acked 7655 Read 1 New Done Done false
27722 6657 Acked 7656 Read 1 New Done Done false
27723 6658 Acked 7657 Read 4 New Done Done false
27724 6659 Acked 7658 Read 7 New Done Done false
27725 6660 Acked 7659 Write 5 New Done Done false
27726 6661 Acked 7660 Read 10 New Done Done false
27727 6662 Acked 7661 Read 9 New Done Done false
27728 6663 Acked 7662 Read 10 New Done Done false
27729 6664 Acked 7663 Write 1 New Done Done false
27730 6665 Acked 7664 Flush 0 New Done Done false
27731 6666 Acked 7665 Read 9 New Done Done false
27732 6667 Acked 7666 Read 2 New Done Done false
27733 6668 Acked 7667 Write 6 New Done Done false
27734 6669 Acked 7668 Flush 0 New Done Done false
27735 6670 Acked 7669 Read 6 New Done Done false
27736 6671 Acked 7670 Write 3 New Done Done false
27737 6672 Acked 7671 Read 6 New Done Done false
27738 6673 Acked 7672 Flush 0 New Done Done false
27739 6674 Acked 7673 Read 9 New Done Done false
27740 6675 Acked 7674 Write 6 New Done Done false
27741 6676 Acked 7675 Read 5 New Done Done false
27742 6677 Acked 7676 Write 6 New Done Done false
27743 6678 Acked 7677 Write 9 New Done Done false
27744 6679 Acked 7678 Write 8 New Done Done false
27745 6680 Acked 7679 Write 9 New Done Done false
27746 6681 Acked 7680 Write 4 New Done Done false
27747 6682 Acked 7681 Write 5 New Done Done false
27748 6683 Acked 7682 Read 5 New Done Done false
27749 6684 Acked 7683 Write 10 New Done Done false
27750 6685 Acked 7684 Flush 0 New Done Done false
27751 6686 Acked 7685 Write 3 New Done Done false
27752 6687 Acked 7686 Write 7 New Done Done false
27753 6688 Acked 7687 Write 3 New Done Done false
27754 6689 Acked 7688 Read 6 New Done Done false
27755 6690 Acked 7689 Read 5 New Done Done false
27756 6691 Acked 7690 Read 10 New Done Done false
27757 6692 Acked 7691 Read 3 New Done Done false
27758 6693 Acked 7692 Read 2 New Done Done false
27759 6694 Acked 7693 Read 2 New Done Done false
27760 6695 Acked 7694 Flush 0 New Done Done false
27761 6696 Acked 7695 Write 10 New Done Done false
27762 6697 Acked 7696 Write 7 New Done Done false
27763 6698 Acked 7697 Write 10 New Done Done false
27764 6699 Acked 7698 Write 2 New Done Done false
27765 6700 Acked 7699 Write 5 New Done Done false
27766 6701 Acked 7700 Read 3 New Done Done false
27767 6702 Acked 7701 Write 10 New Done Done false
27768 6703 Acked 7702 Write 1 New Done Done false
27769 6704 Acked 7703 Read 8 New Done Done false
27770 6705 Acked 7704 Read 7 New Done Done false
27771 6706 Acked 7705 Read 3 New Done Done false
27772 6707 Acked 7706 Write 7 New Done Done false
27773 6708 Acked 7707 Write 6 New Done Done false
27774 6709 Acked 7708 Read 1 New Done Done false
27775 6710 Acked 7709 Read 2 New Done Done false
27776 6711 Acked 7710 Write 7 New Done Done false
27777 6712 Acked 7711 Read 7 New Done Done false
27778 6713 Acked 7712 Read 2 New Done Done false
27779 6714 Acked 7713 Write 4 New Done Done false
27780 6715 Acked 7714 Write 4 New Done Done false
27781 6716 Acked 7715 Read 3 New Done Done false
27782 6717 Acked 7716 Write 3 New Done Done false
27783 6718 Acked 7717 Write 4 New Done Done false
27784 6719 Acked 7718 Flush 0 New Done Done false
27785 6720 Acked 7719 Write 6 New Done Done false
27786 6721 Acked 7720 Write 4 New Done Done false
27787 6722 Acked 7721 Read 5 New Done Done false
27788 6723 Acked 7722 Write 3 New Done Done false
27789 6724 Acked 7723 Read 9 New Done Done false
27790 6725 Acked 7724 Read 8 New Done Done false
27791 6726 Acked 7725 Read 7 New Done Done false
27792 6727 Acked 7726 Read 7 New Done Done false
27793 6728 Acked 7727 Read 10 New Done Done false
27794 6729 Acked 7728 Write 10 New Done Done false
27795 6730 Acked 7729 Write 3 New Done Done false
27796 6731 Acked 7730 Read 7 New Done Done false
27797 6732 Acked 7731 Read 4 New Done Done false
27798 6733 Acked 7732 Read 3 New Done Done false
27799 6734 Acked 7733 Read 9 New Done Done false
27800 6735 Acked 7734 Read 6 New Done Done false
27801 6736 Acked 7735 Read 1 New Done Done false
27802 6737 Acked 7736 Read 8 New Done Done false
27803 6738 Acked 7737 Read 10 New Done Done false
27804 6739 Acked 7738 Read 8 New Done Done false
27805 6740 Acked 7739 Read 9 New Done Done false
27806 6741 Acked 7740 Read 10 New Done Done false
27807 6742 Acked 7741 Write 6 New Done Done false
27808 6743 Acked 7742 Read 5 New Done Done false
27809 6744 Acked 7743 Write 1 New Done Done false
27810 6745 Acked 7744 Write 9 New Done Done false
27811 6746 Acked 7745 Write 10 New Done Done false
27812 6747 Acked 7746 Write 10 New Done Done false
27813 6748 Acked 7747 Write 10 New Done Done false
27814 6749 Acked 7748 Write 4 New Done Done false
27815 6750 Acked 7749 Flush 0 New Done Done false
27816 6751 Acked 7750 Flush 0 New Done Done false
27817 6752 Acked 7751 Read 4 New Done Done false
27818 6753 Acked 7752 Read 7 New Done Done false
27819 6754 Acked 7753 Read 10 New Done Done false
27820 6755 Acked 7754 Read 9 New Done Done false
27821 6756 Acked 7755 Write 9 New Done Done false
27822 6757 Acked 7756 Read 6 New Done Done false
27823 6758 Acked 7757 Read 7 New Done Done false
27824 6759 Acked 7758 Read 5 New Done Done false
27825 6760 Acked 7759 Write 5 New Done Done false
27826 6761 Acked 7760 Read 2 New Done Done false
27827 6762 Acked 7761 Read 3 New Done Done false
27828 6763 Acked 7762 Write 4 New Done Done false
27829 6764 Acked 7763 Read 8 New Done Done false
27830 6765 Acked 7764 Write 4 New Done Done false
27831 6766 Acked 7765 Read 1 New Done Done false
27832 6767 Acked 7766 Write 4 New Done Done false
27833 6768 Acked 7767 Read 8 New Done Done false
27834 6769 Acked 7768 Read 6 New Done Done false
27835 6770 Acked 7769 Read 7 New Done Done false
27836 6771 Acked 7770 Write 6 New Done Done false
27837 6772 Acked 7771 Read 3 New Done Done false
27838 6773 Acked 7772 Flush 0 New Done Done false
27839 6774 Acked 7773 Write 4 New Done Done false
27840 6775 Acked 7774 Flush 0 New Done Done false
27841 6776 Acked 7775 Write 1 New Done Done false
27842 6777 Acked 7776 Read 10 New Done Done false
27843 6778 Acked 7777 Write 10 New Done Done false
27844 6779 Acked 7778 Write 1 New Done Done false
27845 6780 Acked 7779 Write 8 New Done Done false
27846 6781 Acked 7780 Write 4 New Done Done false
27847 6782 Acked 7781 Read 4 New Done Done false
27848 6783 Acked 7782 Read 10 New Done Done false
27849 6784 Acked 7783 Write 1 New Done Done false
27850 6785 Acked 7784 Read 7 New Done Done false
27851 6786 Acked 7785 Write 9 New Done Done false
27852 6787 Acked 7786 Write 9 New Done Done false
27853 6788 Acked 7787 Write 10 New Done Done false
27854 6789 Acked 7788 Read 8 New Done Done false
27855 6790 Acked 7789 Flush 0 New Done Done false
27856 6791 Acked 7790 Read 4 New Done Done false
27857 6792 Acked 7791 Read 8 New Done Done false
27858 6793 Acked 7792 Read 9 New Done Done false
27859 6794 Acked 7793 Write 1 New Done Done false
27860 6795 Acked 7794 Read 2 New Done Done false
27861 6796 Acked 7795 Flush 0 New Done Done false
27862 6797 Acked 7796 Write 7 New Done Done false
27863 6798 Acked 7797 Write 10 New Done Done false
27864 6799 Acked 7798 Read 2 New Done Done false
27865 6800 Acked 7799 Write 9 New Done Done false
27866 6801 Acked 7800 Flush 0 New Done Done false
27867 6802 Acked 7801 Write 3 New Done Done false
27868 6803 Acked 7802 Read 2 New Done Done false
27869 6804 Acked 7803 Read 5 New Done Done false
27870 6805 Acked 7804 Read 3 New Done Done false
27871 6806 Acked 7805 Write 4 New Done Done false
27872 6807 Acked 7806 Flush 0 New Done Done false
27873 6808 Acked 7807 Read 5 New Done Done false
27874 6809 Acked 7808 Write 4 New Done Done false
27875 6810 Acked 7809 Flush 0 New Done Done false
27876 6811 Acked 7810 Write 6 New Done Done false
27877 6812 Acked 7811 Write 1 New Done Done false
27878 6813 Acked 7812 Read 3 New Done Done false
27879 6814 Acked 7813 Read 1 New Done Done false
27880 6815 Acked 7814 Read 1 New Done Done false
27881 6816 Acked 7815 Read 4 New Done Done false
27882 6817 Acked 7816 Flush 0 New Done Done false
27883 6818 Acked 7817 Read 2 New Done Done false
27884 6819 Acked 7818 Read 3 New Done Done false
27885 6820 Acked 7819 Write 6 New Done Done false
27886 6821 Acked 7820 Read 2 New Done Done false
27887 6822 Acked 7821 Write 8 New Done Done false
27888 6823 Acked 7822 Read 2 New Done Done false
27889 6824 Acked 7823 Read 2 New Done Done false
27890 6825 Acked 7824 Read 8 New Done Done false
27891 6826 Acked 7825 Write 3 New Done Done false
27892 6827 Acked 7826 Write 3 New Done Done false
27893 6828 Acked 7827 Write 2 New Done Done false
27894 6829 Acked 7828 Write 8 New Done Done false
27895 6830 Acked 7829 Write 9 New Done Done false
27896 6831 Acked 7830 Flush 0 New Done Done false
27897 6832 Acked 7831 Read 4 New Done Done false
27898 6833 Acked 7832 Read 5 New Done Done false
27899 6834 Acked 7833 Write 5 New Done Done false
27900 6835 Acked 7834 Read 3 New Done Done false
27901 6836 Acked 7835 Read 4 New Done Done false
27902 6837 Acked 7836 Write 3 New Done Done false
27903 6838 Acked 7837 Write 8 New Done Done false
27904 6839 Acked 7838 Write 3 New Done Done false
27905 6840 Acked 7839 Write 4 New Done Done false
27906 6841 Acked 7840 Write 2 New Done Done false
27907 6842 Acked 7841 Read 8 New Done Done false
27908 6843 Acked 7842 Read 9 New Done Done false
27909 6844 Acked 7843 Write 8 New Done Done false
27910 6845 Acked 7844 Write 1 New Done Done false
27911 6846 Acked 7845 Read 9 New Done Done false
27912 6847 Acked 7846 Write 2 New Done Done false
27913 6848 Acked 7847 Read 7 New Done Done false
27914 6849 Acked 7848 Write 5 New Done Done false
27915 6850 Acked 7849 Write 10 New Done Done false
27916 6851 Acked 7850 Write 5 New Done Done false
27917 6852 Acked 7851 Read 4 New Done Done false
27918 6853 Acked 7852 Read 1 New Done Done false
27919 6854 Acked 7853 Read 4 New Done Done false
27920 6855 Acked 7854 Write 9 New Done Done false
27921 6856 Acked 7855 Read 4 New Done Done false
27922 6857 Acked 7856 Read 2 New Done Done false
27923 6858 Acked 7857 Read 9 New Done Done false
27924 6859 Acked 7858 Read 1 New Done Done false
27925 6860 Acked 7859 Read 2 New Done Done false
27926 6861 Acked 7860 Read 1 New Done Done false
27927 6862 Acked 7861 Read 10 New Done Done false
27928 6863 Acked 7862 Flush 0 New Done Done false
27929 6864 Acked 7863 Flush 0 New Done Done false
27930 6865 Acked 7864 Read 6 New Done Done false
27931 6866 Acked 7865 Read 7 New Done Done false
27932 6867 Acked 7866 Read 3 New Done Done false
27933 6868 Acked 7867 Read 6 New Done Done false
27934 6869 Acked 7868 Write 10 New Done Done false
27935 6870 Acked 7869 Read 10 New Done Done false
27936 6871 Acked 7870 Write 9 New Done Done false
27937 6872 Acked 7871 Read 9 New Done Done false
27938 6873 Acked 7872 Write 2 New Done Done false
27939 6874 Acked 7873 Flush 0 New Done Done false
27940 6875 Acked 7874 Read 3 New Done Done false
27941 6876 Acked 7875 Read 8 New Done Done false
27942 6877 Acked 7876 Write 2 New Done Done false
27943 6878 Acked 7877 Read 3 New Done Done false
27944 6879 Acked 7878 Read 3 New Done Done false
27945 6880 Acked 7879 Read 1 New Done Done false
27946 6881 Acked 7880 Write 4 New Done Done false
27947 6882 Acked 7881 Write 10 New Done Done false
27948 6883 Acked 7882 Read 10 New Done Done false
27949 6884 Acked 7883 Flush 0 New Done Done false
27950 6885 Acked 7884 Read 5 New Done Done false
27951 6886 Acked 7885 Read 3 New Done Done false
27952 6887 Acked 7886 Read 2 New Done Done false
27953 6888 Acked 7887 Read 4 New Done Done false
27954 6889 Acked 7888 Read 7 New Done Done false
27955 6890 Acked 7889 Write 9 New Done Done false
27956 6891 Acked 7890 Read 5 New Done Done false
27957 6892 Acked 7891 Read 6 New Done Done false
27958 6893 Acked 7892 Read 9 New Done Done false
27959 6894 Acked 7893 Read 9 New Done Done false
27960 6895 Acked 7894 Write 10 New Done Done false
27961 6896 Acked 7895 Read 2 New Done Done false
27962 6897 Acked 7896 Read 1 New Done Done false
27963 6898 Acked 7897 Read 1 New Done Done false
27964 6899 Acked 7898 Write 9 New Done Done false
27965 6900 Acked 7899 Write 2 New Done Done false
27966 6901 Acked 7900 Read 9 New Done Done false
27967 6902 Acked 7901 Flush 0 New Done Done false
27968 6903 Acked 7902 Write 6 New Done Done false
27969 6904 Acked 7903 Read 5 New Done Done false
27970 6905 Acked 7904 Write 2 New Done Done false
27971 6906 Acked 7905 Write 4 New Done Done false
27972 6907 Acked 7906 Write 3 New Done Done false
27973 6908 Acked 7907 Read 8 New Done Done false
27974 6909 Acked 7908 Read 2 New Done Done false
27975 6910 Acked 7909 Write 6 New Done Done false
27976 6911 Acked 7910 Write 4 New Done Done false
27977 6912 Acked 7911 Read 3 New Done Done false
27978 6913 Acked 7912 Read 9 New Done Done false
27979 6914 Acked 7913 Read 2 New Done Done false
27980 6915 Acked 7914 Write 6 New Done Done false
27981 6916 Acked 7915 Read 9 New Done Done false
27982 6917 Acked 7916 Read 1 New Done Done false
27983 6918 Acked 7917 Write 6 New Done Done false
27984 6919 Acked 7918 Write 7 New Done Done false
27985 6920 Acked 7919 Read 4 New Done Done false
27986 6921 Acked 7920 Read 9 New Done Done false
27987 6922 Acked 7921 Read 5 New Done Done false
27988 6923 Acked 7922 Write 1 New Done Done false
27989 6924 Acked 7923 Read 3 New Done Done false
27990 6925 Acked 7924 Read 10 New Done Done false
27991 6926 Acked 7925 Read 9 New Done Done false
27992 6927 Acked 7926 Write 4 New Done Done false
27993 6928 Acked 7927 Read 3 New Done Done false
27994 6929 Acked 7928 Write 10 New Done Done false
27995 6930 Acked 7929 Read 8 New Done Done false
27996 6931 Acked 7930 Read 8 New Done Done false
27997 6932 Acked 7931 Read 1 New Done Done false
27998 STATES DS:0 DS:1 DS:2 TOTAL
27999 New 301 0 0 301
28000 Sent 0 0 0 0
28001 Done 0 301 301 602
28002 Skipped 0 0 0 0
28003 Error 0 0 0 0
28004 Last Flush: 7630 7901 7901
28005 Downstairs last five completed: 7630 7629 7628 7627 7626
28006 Upstairs last five completed: 6932 6931 6930 6929 6928
28007 CLIENT: Up:0 ds:301 act:2
28008 [8810] got start action
28009 [8810] I am going to restart
28010 Starting downstairs at port 8810
28011 Make output file at "/tmp/dsc/downstairs-8810.txt"
28012 [8810][0] reports Starting
28013 Downstairs /var/tmp/dsc/region/8810 port 8810 PID:Some(1219)
28014 [8810][0] reports Running
28015 ----------------------------------------------------------------
28016 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:302
28017 States: Offline Active Active
28018 GW_ID ACK DSID TYPE BLOCKS DS:0 DS:1 DS:2 REPLAY
28019 6632 Acked 7631 Read 1 New Done Done false
28020 6633 Acked 7632 Write 6 New Done Done false
28021 6634 Acked 7633 Flush 0 New Done Done false
28022 6635 Acked 7634 Read 8 New Done Done false
28023 6636 Acked 7635 Write 4 New Done Done false
28024 6637 Acked 7636 Write 10 New Done Done false
28025 6638 Acked 7637 Write 5 New Done Done false
28026 6639 Acked 7638 Read 8 New Done Done false
28027 6640 Acked 7639 Write 2 New Done Done false
28028 6641 Acked 7640 Write 8 New Done Done false
28029 6642 Acked 7641 Read 4 New Done Done false
28030 6643 Acked 7642 Write 9 New Done Done false
28031 6644 Acked 7643 Flush 0 New Done Done false
28032 6645 Acked 7644 Flush 0 New Done Done false
28033 6646 Acked 7645 Flush 0 New Done Done false
28034 6647 Acked 7646 Write 1 New Done Done false
28035 6648 Acked 7647 Read 1 New Done Done false
28036 6649 Acked 7648 Read 10 New Done Done false
28037 6650 Acked 7649 Write 6 New Done Done false
28038 6651 Acked 7650 Read 1 New Done Done false
28039 6652 Acked 7651 Read 3 New Done Done false
28040 6653 Acked 7652 Read 4 New Done Done false
28041 6654 Acked 7653 Read 3 New Done Done false
28042 6655 Acked 7654 Flush 0 New Done Done false
28043 6656 Acked 7655 Read 1 New Done Done false
28044 6657 Acked 7656 Read 1 New Done Done false
28045 6658 Acked 7657 Read 4 New Done Done false
28046 6659 Acked 7658 Read 7 New Done Done false
28047 6660 Acked 7659 Write 5 New Done Done false
28048 6661 Acked 7660 Read 10 New Done Done false
28049 6662 Acked 7661 Read 9 New Done Done false
28050 6663 Acked 7662 Read 10 New Done Done false
28051 6664 Acked 7663 Write 1 New Done Done false
28052 6665 Acked 7664 Flush 0 New Done Done false
28053 6666 Acked 7665 Read 9 New Done Done false
28054 6667 Acked 7666 Read 2 New Done Done false
28055 6668 Acked 7667 Write 6 New Done Done false
28056 6669 Acked 7668 Flush 0 New Done Done false
28057 6670 Acked 7669 Read 6 New Done Done false
28058 6671 Acked 7670 Write 3 New Done Done false
28059 6672 Acked 7671 Read 6 New Done Done false
28060 6673 Acked 7672 Flush 0 New Done Done false
28061 6674 Acked 7673 Read 9 New Done Done false
28062 6675 Acked 7674 Write 6 New Done Done false
28063 6676 Acked 7675 Read 5 New Done Done false
28064 6677 Acked 7676 Write 6 New Done Done false
28065 6678 Acked 7677 Write 9 New Done Done false
28066 6679 Acked 7678 Write 8 New Done Done false
28067 6680 Acked 7679 Write 9 New Done Done false
28068 6681 Acked 7680 Write 4 New Done Done false
28069 6682 Acked 7681 Write 5 New Done Done false
28070 6683 Acked 7682 Read 5 New Done Done false
28071 6684 Acked 7683 Write 10 New Done Done false
28072 6685 Acked 7684 Flush 0 New Done Done false
28073 6686 Acked 7685 Write 3 New Done Done false
28074 6687 Acked 7686 Write 7 New Done Done false
28075 6688 Acked 7687 Write 3 New Done Done false
28076 6689 Acked 7688 Read 6 New Done Done false
28077 6690 Acked 7689 Read 5 New Done Done false
28078 6691 Acked 7690 Read 10 New Done Done false
28079 6692 Acked 7691 Read 3 New Done Done false
28080 6693 Acked 7692 Read 2 New Done Done false
28081 6694 Acked 7693 Read 2 New Done Done false
28082 6695 Acked 7694 Flush 0 New Done Done false
28083 6696 Acked 7695 Write 10 New Done Done false
28084 6697 Acked 7696 Write 7 New Done Done false
28085 6698 Acked 7697 Write 10 New Done Done false
28086 6699 Acked 7698 Write 2 New Done Done false
28087 6700 Acked 7699 Write 5 New Done Done false
28088 6701 Acked 7700 Read 3 New Done Done false
28089 6702 Acked 7701 Write 10 New Done Done false
28090 6703 Acked 7702 Write 1 New Done Done false
28091 6704 Acked 7703 Read 8 New Done Done false
28092 6705 Acked 7704 Read 7 New Done Done false
28093 6706 Acked 7705 Read 3 New Done Done false
28094 6707 Acked 7706 Write 7 New Done Done false
28095 6708 Acked 7707 Write 6 New Done Done false
28096 6709 Acked 7708 Read 1 New Done Done false
28097 6710 Acked 7709 Read 2 New Done Done false
28098 6711 Acked 7710 Write 7 New Done Done false
28099 6712 Acked 7711 Read 7 New Done Done false
28100 6713 Acked 7712 Read 2 New Done Done false
28101 6714 Acked 7713 Write 4 New Done Done false
28102 6715 Acked 7714 Write 4 New Done Done false
28103 6716 Acked 7715 Read 3 New Done Done false
28104 6717 Acked 7716 Write 3 New Done Done false
28105 6718 Acked 7717 Write 4 New Done Done false
28106 6719 Acked 7718 Flush 0 New Done Done false
28107 6720 Acked 7719 Write 6 New Done Done false
28108 6721 Acked 7720 Write 4 New Done Done false
28109 6722 Acked 7721 Read 5 New Done Done false
28110 6723 Acked 7722 Write 3 New Done Done false
28111 6724 Acked 7723 Read 9 New Done Done false
28112 6725 Acked 7724 Read 8 New Done Done false
28113 6726 Acked 7725 Read 7 New Done Done false
28114 6727 Acked 7726 Read 7 New Done Done false
28115 6728 Acked 7727 Read 10 New Done Done false
28116 6729 Acked 7728 Write 10 New Done Done false
28117 6730 Acked 7729 Write 3 New Done Done false
28118 6731 Acked 7730 Read 7 New Done Done false
28119 6732 Acked 7731 Read 4 New Done Done false
28120 6733 Acked 7732 Read 3 New Done Done false
28121 6734 Acked 7733 Read 9 New Done Done false
28122 6735 Acked 7734 Read 6 New Done Done false
28123 6736 Acked 7735 Read 1 New Done Done false
28124 6737 Acked 7736 Read 8 New Done Done false
28125 6738 Acked 7737 Read 10 New Done Done false
28126 6739 Acked 7738 Read 8 New Done Done false
28127 6740 Acked 7739 Read 9 New Done Done false
28128 6741 Acked 7740 Read 10 New Done Done false
28129 6742 Acked 7741 Write 6 New Done Done false
28130 6743 Acked 7742 Read 5 New Done Done false
28131 6744 Acked 7743 Write 1 New Done Done false
28132 6745 Acked 7744 Write 9 New Done Done false
28133 6746 Acked 7745 Write 10 New Done Done false
28134 6747 Acked 7746 Write 10 New Done Done false
28135 6748 Acked 7747 Write 10 New Done Done false
28136 6749 Acked 7748 Write 4 New Done Done false
28137 6750 Acked 7749 Flush 0 New Done Done false
28138 6751 Acked 7750 Flush 0 New Done Done false
28139 6752 Acked 7751 Read 4 New Done Done false
28140 6753 Acked 7752 Read 7 New Done Done false
28141 6754 Acked 7753 Read 10 New Done Done false
28142 6755 Acked 7754 Read 9 New Done Done false
28143 6756 Acked 7755 Write 9 New Done Done false
28144 6757 Acked 7756 Read 6 New Done Done false
28145 6758 Acked 7757 Read 7 New Done Done false
28146 6759 Acked 7758 Read 5 New Done Done false
28147 6760 Acked 7759 Write 5 New Done Done false
28148 6761 Acked 7760 Read 2 New Done Done false
28149 6762 Acked 7761 Read 3 New Done Done false
28150 6763 Acked 7762 Write 4 New Done Done false
28151 6764 Acked 7763 Read 8 New Done Done false
28152 6765 Acked 7764 Write 4 New Done Done false
28153 6766 Acked 7765 Read 1 New Done Done false
28154 6767 Acked 7766 Write 4 New Done Done false
28155 6768 Acked 7767 Read 8 New Done Done false
28156 6769 Acked 7768 Read 6 New Done Done false
28157 6770 Acked 7769 Read 7 New Done Done false
28158 6771 Acked 7770 Write 6 New Done Done false
28159 6772 Acked 7771 Read 3 New Done Done false
28160 6773 Acked 7772 Flush 0 New Done Done false
28161 6774 Acked 7773 Write 4 New Done Done false
28162 6775 Acked 7774 Flush 0 New Done Done false
28163 6776 Acked 7775 Write 1 New Done Done false
28164 6777 Acked 7776 Read 10 New Done Done false
28165 6778 Acked 7777 Write 10 New Done Done false
28166 6779 Acked 7778 Write 1 New Done Done false
28167 6780 Acked 7779 Write 8 New Done Done false
28168 6781 Acked 7780 Write 4 New Done Done false
28169 6782 Acked 7781 Read 4 New Done Done false
28170 6783 Acked 7782 Read 10 New Done Done false
28171 6784 Acked 7783 Write 1 New Done Done false
28172 6785 Acked 7784 Read 7 New Done Done false
28173 6786 Acked 7785 Write 9 New Done Done false
28174 6787 Acked 7786 Write 9 New Done Done false
28175 6788 Acked 7787 Write 10 New Done Done false
28176 6789 Acked 7788 Read 8 New Done Done false
28177 6790 Acked 7789 Flush 0 New Done Done false
28178 6791 Acked 7790 Read 4 New Done Done false
28179 6792 Acked 7791 Read 8 New Done Done false
28180 6793 Acked 7792 Read 9 New Done Done false
28181 6794 Acked 7793 Write 1 New Done Done false
28182 6795 Acked 7794 Read 2 New Done Done false
28183 6796 Acked 7795 Flush 0 New Done Done false
28184 6797 Acked 7796 Write 7 New Done Done false
28185 6798 Acked 7797 Write 10 New Done Done false
28186 6799 Acked 7798 Read 2 New Done Done false
28187 6800 Acked 7799 Write 9 New Done Done false
28188 6801 Acked 7800 Flush 0 New Done Done false
28189 6802 Acked 7801 Write 3 New Done Done false
28190 6803 Acked 7802 Read 2 New Done Done false
28191 6804 Acked 7803 Read 5 New Done Done false
28192 6805 Acked 7804 Read 3 New Done Done false
28193 6806 Acked 7805 Write 4 New Done Done false
28194 6807 Acked 7806 Flush 0 New Done Done false
28195 6808 Acked 7807 Read 5 New Done Done false
28196 6809 Acked 7808 Write 4 New Done Done false
28197 6810 Acked 7809 Flush 0 New Done Done false
28198 6811 Acked 7810 Write 6 New Done Done false
28199 6812 Acked 7811 Write 1 New Done Done false
28200 6813 Acked 7812 Read 3 New Done Done false
28201 6814 Acked 7813 Read 1 New Done Done false
28202 6815 Acked 7814 Read 1 New Done Done false
28203 6816 Acked 7815 Read 4 New Done Done false
28204 6817 Acked 7816 Flush 0 New Done Done false
28205 6818 Acked 7817 Read 2 New Done Done false
28206 6819 Acked 7818 Read 3 New Done Done false
28207 6820 Acked 7819 Write 6 New Done Done false
28208 6821 Acked 7820 Read 2 New Done Done false
28209 6822 Acked 7821 Write 8 New Done Done false
28210 6823 Acked 7822 Read 2 New Done Done false
28211 6824 Acked 7823 Read 2 New Done Done false
28212 6825 Acked 7824 Read 8 New Done Done false
28213 6826 Acked 7825 Write 3 New Done Done false
28214 6827 Acked 7826 Write 3 New Done Done false
28215 6828 Acked 7827 Write 2 New Done Done false
28216 6829 Acked 7828 Write 8 New Done Done false
28217 6830 Acked 7829 Write 9 New Done Done false
28218 6831 Acked 7830 Flush 0 New Done Done false
28219 6832 Acked 7831 Read 4 New Done Done false
28220 6833 Acked 7832 Read 5 New Done Done false
28221 6834 Acked 7833 Write 5 New Done Done false
28222 6835 Acked 7834 Read 3 New Done Done false
28223 6836 Acked 7835 Read 4 New Done Done false
28224 6837 Acked 7836 Write 3 New Done Done false
28225 6838 Acked 7837 Write 8 New Done Done false
28226 6839 Acked 7838 Write 3 New Done Done false
28227 6840 Acked 7839 Write 4 New Done Done false
28228 6841 Acked 7840 Write 2 New Done Done false
28229 6842 Acked 7841 Read 8 New Done Done false
28230 6843 Acked 7842 Read 9 New Done Done false
28231 6844 Acked 7843 Write 8 New Done Done false
28232 6845 Acked 7844 Write 1 New Done Done false
28233 6846 Acked 7845 Read 9 New Done Done false
28234 6847 Acked 7846 Write 2 New Done Done false
28235 6848 Acked 7847 Read 7 New Done Done false
28236 6849 Acked 7848 Write 5 New Done Done false
28237 6850 Acked 7849 Write 10 New Done Done false
28238 6851 Acked 7850 Write 5 New Done Done false
28239 6852 Acked 7851 Read 4 New Done Done false
28240 6853 Acked 7852 Read 1 New Done Done false
28241 6854 Acked 7853 Read 4 New Done Done false
28242 6855 Acked 7854 Write 9 New Done Done false
28243 6856 Acked 7855 Read 4 New Done Done false
28244 6857 Acked 7856 Read 2 New Done Done false
28245 6858 Acked 7857 Read 9 New Done Done false
28246 6859 Acked 7858 Read 1 New Done Done false
28247 6860 Acked 7859 Read 2 New Done Done false
28248 6861 Acked 7860 Read 1 New Done Done false
28249 6862 Acked 7861 Read 10 New Done Done false
28250 6863 Acked 7862 Flush 0 New Done Done false
28251 6864 Acked 7863 Flush 0 New Done Done false
28252 6865 Acked 7864 Read 6 New Done Done false
28253 6866 Acked 7865 Read 7 New Done Done false
28254 6867 Acked 7866 Read 3 New Done Done false
28255 6868 Acked 7867 Read 6 New Done Done false
28256 6869 Acked 7868 Write 10 New Done Done false
28257 6870 Acked 7869 Read 10 New Done Done false
28258 6871 Acked 7870 Write 9 New Done Done false
28259 6872 Acked 7871 Read 9 New Done Done false
28260 6873 Acked 7872 Write 2 New Done Done false
28261 6874 Acked 7873 Flush 0 New Done Done false
28262 6875 Acked 7874 Read 3 New Done Done false
28263 6876 Acked 7875 Read 8 New Done Done false
28264 6877 Acked 7876 Write 2 New Done Done false
28265 6878 Acked 7877 Read 3 New Done Done false
28266 6879 Acked 7878 Read 3 New Done Done false
28267 6880 Acked 7879 Read 1 New Done Done false
28268 6881 Acked 7880 Write 4 New Done Done false
28269 6882 Acked 7881 Write 10 New Done Done false
28270 6883 Acked 7882 Read 10 New Done Done false
28271 6884 Acked 7883 Flush 0 New Done Done false
28272 6885 Acked 7884 Read 5 New Done Done false
28273 6886 Acked 7885 Read 3 New Done Done false
28274 6887 Acked 7886 Read 2 New Done Done false
28275 6888 Acked 7887 Read 4 New Done Done false
28276 6889 Acked 7888 Read 7 New Done Done false
28277 6890 Acked 7889 Write 9 New Done Done false
28278 6891 Acked 7890 Read 5 New Done Done false
28279 6892 Acked 7891 Read 6 New Done Done false
28280 6893 Acked 7892 Read 9 New Done Done false
28281 6894 Acked 7893 Read 9 New Done Done false
28282 6895 Acked 7894 Write 10 New Done Done false
28283 6896 Acked 7895 Read 2 New Done Done false
28284 6897 Acked 7896 Read 1 New Done Done false
28285 6898 Acked 7897 Read 1 New Done Done false
28286 6899 Acked 7898 Write 9 New Done Done false
28287 6900 Acked 7899 Write 2 New Done Done false
28288 6901 Acked 7900 Read 9 New Done Done false
28289 6902 Acked 7901 Flush 0 New Done Done false
28290 6903 Acked 7902 Write 6 New Done Done false
28291 6904 Acked 7903 Read 5 New Done Done false
28292 6905 Acked 7904 Write 2 New Done Done false
28293 6906 Acked 7905 Write 4 New Done Done false
28294 6907 Acked 7906 Write 3 New Done Done false
28295 6908 Acked 7907 Read 8 New Done Done false
28296 6909 Acked 7908 Read 2 New Done Done false
28297 6910 Acked 7909 Write 6 New Done Done false
28298 6911 Acked 7910 Write 4 New Done Done false
28299 6912 Acked 7911 Read 3 New Done Done false
28300 6913 Acked 7912 Read 9 New Done Done false
28301 6914 Acked 7913 Read 2 New Done Done false
28302 6915 Acked 7914 Write 6 New Done Done false
28303 6916 Acked 7915 Read 9 New Done Done false
28304 6917 Acked 7916 Read 1 New Done Done false
28305 6918 Acked 7917 Write 6 New Done Done false
28306 6919 Acked 7918 Write 7 New Done Done false
28307 6920 Acked 7919 Read 4 New Done Done false
28308 6921 Acked 7920 Read 9 New Done Done false
28309 6922 Acked 7921 Read 5 New Done Done false
28310 6923 Acked 7922 Write 1 New Done Done false
28311 6924 Acked 7923 Read 3 New Done Done false
28312 6925 Acked 7924 Read 10 New Done Done false
28313 6926 Acked 7925 Read 9 New Done Done false
28314 6927 Acked 7926 Write 4 New Done Done false
28315 6928 Acked 7927 Read 3 New Done Done false
28316 6929 Acked 7928 Write 10 New Done Done false
28317 6930 Acked 7929 Read 8 New Done Done false
28318 6931 Acked 7930 Read 8 New Done Done false
28319 6932 Acked 7931 Read 1 New Done Done false
28320 6933 Acked 7932 Flush 0 New Done Done false
28321 STATES DS:0 DS:1 DS:2 TOTAL
28322 New 302 0 0 302
28323 Sent 0 0 0 0
28324 Done 0 302 302 604
28325 Skipped 0 0 0 0
28326 Error 0 0 0 0
28327 Last Flush: 7630 7932 7932
28328 Downstairs last five completed: 7630 7629 7628 7627 7626
28329 Upstairs last five completed: 6933 6932 6931 6930 6929
28330 CLIENT: Up:0 ds:302 act:2
283312024-04-20T01:11:01.077ZINFOcrucible: connecting to 127.0.0.1:8810 = io task client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
283322024-04-20T01:11:01.077ZINFOcrucible: ds_connection connected from Ok(127.0.0.1:58132) = io task client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
283332024-04-20T01:11:01.078ZINFOcrucible: downstairs client at Some(127.0.0.1:8810) has region UUID 12345678-0000-0000-0000-000000008810 = downstairs client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
283342024-04-20T01:11:01.078ZINFOcrucible: Returning UUID:12345678-0000-0000-0000-000000008810 matches = downstairs client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
283352024-04-20T01:11:01.078ZINFOcrucible: send last flush ID to this DS: 7630 = downstairs client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
283362024-04-20T01:11:01.079ZINFOcrucible: Replied this last flush ID: 7630 = downstairs client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
283372024-04-20T01:11:01.079ZINFOcrucible: ds_transition from Offline to Replay = downstairs client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
283382024-04-20T01:11:01.079ZINFOcrucible: [0] Transition from Offline to Replay = downstairs client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
283392024-04-20T01:11:01.079ZINFOcrucible: ds_transition from Replay to Active = downstairs client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
283402024-04-20T01:11:01.079ZINFOcrucible: [0] Transition from Replay to Active = downstairs client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
28341 ----------------------------------------------------------------
28342 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:0
28343 Downstairs last five completed: 7932 7931 7930 7929 7928
28344 Upstairs last five completed: 6933 6932 6931 6930 6929
28345 CLIENT: Up:0 ds:0 act:3
28346 Replay: All jobs finished, all DS active.
28347 Main task has work to do, go find it
28348 got dsc Stop(0)
28349 stop 0
28350 Apr 20 01:11:03.386 INFO request completed, latency_us: 307, response_code: 204, uri: /stop/cid/0, method[8810] Got stop action so:false kr:false
28351 : POST, req_id: 1a0573f4-910f-4b3b-9f97-36aad43b4cbc, remote_addr: 127.0.0.1:60352, local_addr: 127.0.0.1:9998
283522024-04-20T01:11:03.387ZWARNcrucible: downstairs disconnected = io task client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
283532024-04-20T01:11:03.387ZWARNcrucible: client task is sending Done(Finished) = io task client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
283542024-04-20T01:11:03.387ZWARNcrucible: downstairs task for 0 stopped due to Finished session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
283552024-04-20T01:11:03.387ZINFOcrucible: Gone missing, transition from Active to Offline = downstairs client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
283562024-04-20T01:11:03.387ZINFOcrucible: [0] client re-new 0 jobs since flush 7932 = downstairs session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
283572024-04-20T01:11:03.387ZINFOcrucible: [0] Marked 0 jobs for replay since flush: 7932 = downstairs session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
283582024-04-20T01:11:03.387ZINFOcrucible: client task is exiting = io task client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
28359 Apr 20 01:11:03.387 INFO request completed, latency_us: 136, response_code: 200, uri: /state/cid/0, method: GET, req_id: 80676f3c-48f6-42a0-a4d2-79af2a3b9db0, remote_addr: 127.0.0.1:60352, local_addr: 127.0.0.1:9998
28360 [8810] Exited with: ExitStatus(unix_wait_status(9))
28361 [8810][0] reports Exit
28362 Apr 20 01:11:07.390 INFO request completed, latency_us: 198, response_code: 200, uri: /state/cid/0, method: GET, req_id: 1a54032d-d216-4d61-8d5a-264869bb9133, remote_addr: 127.0.0.1:60352, local_addr: 127.0.0.1:9998
28363 001/300 Write block 2523 len 24576 data: 6 5 5 4 4 5
28364 002/300 Write block 1601 len 24576 data: 3 4 4 4 4 6
28365 003/300 Write block 0 len 36864 data: 2 2 3 3 3 3 3 3 4
28366 004/300 Read block 3472 len 8192
28367 005/300 Read block 4245 len 12288
28368 006/300 Read block 2458 len 12288
28369 007/300 Write block 2332 len 12288 data: 6 7 7
28370 008/300 Write block 364 len 32768 data: 7 7 6 6 6 4 4 3
28371 009/300 Read block 1452 len 40960
28372 010/300 Read block 4986 len 4096
28373 011/300 Write block 3392 len 8192 data: 4 5
28374 012/300 Read block 2955 len 12288
28375 013/300 Read block 182 len 16384
28376 014/300 Read block 476 len 12288
28377 015/300 Write block 4284 len 8192 data: 3 4
28378 016/300 Read block 3822 len 4096
28379 017/300 Write block 1199 len 40960 data: 7 6 5 5 5 4 3 6 6 5
28380 018/300 Read block 4899 len 36864
28381 019/300 Write block 2243 len 24576 data: 4 5 5 5 4 5
28382 020/300 Write block 2383 len 36864 data: 2 2 3 5 5 5 5 5 6
28383 021/300 Write block 4737 len 24576 data: 3 6 6 6 5 5
28384 022/300 Read block 225 len 28672
28385 023/300 Write block 846 len 36864 data: 4 4 5 5 4 5 6 7 5
28386 024/300 Write block 2888 len 36864 data: 3 4 7 7 7 5 3 5 5
28387 025/300 Read block 604 len 12288
28388 026/300 Read block 2914 len 28672
28389 027/300 Read block 2025 len 24576
28390 028/300 Read block 1170 len 32768
28391 029/300 Read block 3668 len 24576
28392 030/300 Read block 3829 len 28672
28393 031/300 Read block 2164 len 32768
28394 032/300 Read block 2525 len 8192
28395 033/300 Write block 3095 len 32768 data: 3 3 5 8 9 10 8 8
28396 034/300 Read block 2183 len 8192
28397 035/300 Read block 2193 len 28672
28398 036/300 Write block 4133 len 32768 data: 2 2 3 3 5 3 4 5
28399 037/300 Flush
28400 038/300 Write block 4599 len 12288 data: 6 5 4
28401 039/300 Write block 6 len 36864 data: 4 4 5 5 5 4 6 7 7
28402 040/300 Write block 2596 len 24576 data: 2 4 4 5 6 6
28403 041/300 Read block 4789 len 40960
28404 042/300 Write block 4461 len 20480 data: 4 4 5 5 4
28405 043/300 Write block 3603 len 32768 data: 5 5 5 5 6 6 6 7
28406 044/300 Read block 202 len 28672
28407 045/300 Write block 4270 len 12288 data: 6 6 6
28408 046/300 Write block 4504 len 12288 data: 3 3 3
28409 047/300 Write block 3053 len 4096 data: 2
28410 048/300 Read block 3661 len 16384
28411 049/300 Read block 1277 len 12288
28412 050/300 Read block 2005 len 4096
28413 051/300 Write block 1928 len 24576 data: 4 4 4 4 3 4
28414 052/300 Read block 724 len 32768
28415 053/300 Write block 4712 len 36864 data: 5 4 7 5 5 5 3 3 3
28416 054/300 Read block 3540 len 8192
28417 055/300 Write block 884 len 20480 data: 2 2 2 4 6
28418 056/300 Write block 4724 len 16384 data: 5 5 5 5
28419 057/300 Write block 4505 len 32768 data: 4 4 3 3 2 2 2 2
28420 058/300 Read block 212 len 4096
28421 059/300 Write block 4354 len 16384 data: 6 6 4 4
28422 060/300 Write block 4960 len 16384 data: 4 4 3 3
28423 061/300 Read block 4455 len 40960
28424 062/300 Write block 3745 len 4096 data: 4
28425 063/300 Read block 4275 len 16384
28426 064/300 Read block 3827 len 16384
28427 065/300 Read block 1351 len 8192
28428 066/300 Read block 1181 len 28672
28429 067/300 Write block 2791 len 16384 data: 3 3 4 4
28430 068/300 Write block 4765 len 12288 data: 5 4 4
28431 069/300 Read block 3068 len 24576
28432 070/300 Write block 2970 len 40960 data: 3 5 5 5 5 5 4 4 4 3
28433 071/300 Write block 3063 len 24576 data: 4 4 4 4 4 3
28434 072/300 Write block 1770 len 16384 data: 7 7 8 8
28435 073/300 Write block 4980 len 36864 data: 3 4 5 5 3 3 3 3 4
28436 074/300 Flush
28437 075/300 Read block 1144 len 16384
28438 076/300 Read block 4576 len 40960
28439 077/300 Read block 1588 len 36864
28440 078/300 Read block 2277 len 8192
28441 079/300 Read block 3345 len 32768
28442 080/300 Write block 1589 len 40960 data: 7 6 7 7 6 7 6 5 4 4
28443 081/300 Write block 1710 len 28672 data: 8 8 7 8 8 3 3
28444 082/300 Flush
28445 083/300 Read block 2740 len 12288
28446 084/300 Read block 651 len 24576
28447 085/300 Read block 1620 len 20480
28448 086/300 Write block 1977 len 32768 data: 3 3 3 4 4 4 2 4
28449 087/300 Write block 91 len 28672 data: 7 7 7 7 6 6 6
28450 088/300 Read block 407 len 4096
28451 089/300 Read block 3641 len 36864
28452 090/300 Write block 3655 len 40960 data: 2 2 2 2 2 2 2 2 3 3
28453 091/300 Read block 3382 len 20480
28454 092/300 Write block 335 len 20480 data: 2 2 2 2 3
28455 093/300 Write block 2318 len 36864 data: 7 6 6 3 3 3 4 6 6
28456 094/300 Read block 2845 len 4096
28457 095/300 Read block 2817 len 32768
28458 096/300 Flush
28459 097/300 Read block 461 len 12288
28460 098/300 Write block 761 len 32768 data: 4 5 5 5 5 4 5 5
28461 099/300 Read block 1890 len 36864
28462 100/300 Flush
28463 101/300 Read block 1100 len 16384
28464 102/300 Read block 2137 len 32768
28465 103/300 Read block 2916 len 20480
28466 104/300 Write block 2620 len 32768 data: 7 7 7 6 6 6 5 5
28467 105/300 Flush
28468 106/300 Write block 4955 len 24576 data: 7 4 3 3 4 5
28469 107/300 Read block 100 len 8192
28470 108/300 Read block 753 len 4096
28471 109/300 Write block 2291 len 28672 data: 4 4 4 4 3 3 4
28472 110/300 Write block 4848 len 24576 data: 6 5 5 6 6 3
28473 111/300 Read block 2992 len 20480
28474 112/300 Write block 4768 len 20480 data: 5 8 6 6 5
28475 113/300 Write block 1429 len 28672 data: 4 4 5 5 5 5 6
28476 114/300 Read block 4127 len 12288
28477 115/300 Write block 323 len 16384 data: 8 8 10 9
28478 116/300 Read block 1308 len 16384
28479 117/300 Read block 3566 len 12288
28480 118/300 Read block 3470 len 4096
28481 119/300 Write block 3266 len 12288 data: 3 3 4
28482 120/300 Write block 4314 len 24576 data: 5 6 6 5 5 6
28483 121/300 Write block 2459 len 36864 data: 5 7 7 7 7 8 7 6 7
28484 122/300 Read block 2661 len 24576
28485 123/300 Read block 3125 len 28672
28486 124/300 Write block 3364 len 8192 data: 4 4
28487 125/300 Write block 3130 len 12288 data: 7 5 4
28488 126/300 Read block 4679 len 20480
28489 127/300 Read block 1529 len 4096
28490 128/300 Write block 1684 len 32768 data: 5 6 7 6 7 7 6 5
28491 129/300 Read block 3273 len 32768
28492 130/300 Write block 2061 len 4096 data: 10
28493 131/300 Read block 1957 len 40960
28494 132/300 Write block 907 len 12288 data: 5 5 5
28495 133/300 Read block 561 len 32768
28496 134/300 Read block 3801 len 4096
28497 135/300 Write block 1731 len 20480 data: 4 4 4 3 4
28498 136/300 Read block 3626 len 4096
28499 137/300 Read block 344 len 36864
28500 138/300 Read block 642 len 40960
28501 139/300 Read block 3989 len 20480
28502 140/300 Read block 772 len 4096
28503 141/300 Write block 3859 len 24576 data: 7 6 6 7 6 6
28504 142/300 Flush
28505 143/300 Read block 4721 len 28672
28506 144/300 Read block 1463 len 36864
28507 145/300 Write block 877 len 8192 data: 7 6
28508 146/300 Read block 3146 len 28672
28509 147/300 Write block 186 len 24576 data: 2 2 2 5 5 5
28510 148/300 Write block 3299 len 4096 data: 5
28511 149/300 Read block 1106 len 24576
28512 150/300 Read block 2013 len 32768
28513 151/300 Read block 3084 len 40960
28514 152/300 Flush
28515 153/300 Flush
28516 154/300 Write block 1019 len 8192 data: 4 5
28517 155/300 Read block 3428 len 32768
28518 156/300 Write block 2570 len 12288 data: 3 3 3
28519 157/300 Read block 2361 len 4096
28520 158/300 Flush
28521 159/300 Write block 580 len 12288 data: 7 7 5
28522 160/300 Read block 152 len 32768
28523 161/300 Read block 4074 len 28672
28524 162/300 Write block 142 len 24576 data: 3 3 3 2 2 4
28525 163/300 Read block 4109 len 36864
28526 164/300 Flush
28527 165/300 Read block 3091 len 12288
28528 166/300 Read block 2447 len 4096
28529 167/300 Write block 4569 len 36864 data: 9 10 10 10 8 8 7 6 3
28530 168/300 Write block 3250 len 16384 data: 4 5 4 4
28531 169/300 Read block 4686 len 32768
28532 170/300 Read block 3956 len 12288
28533 171/300 Write block 1656 len 40960 data: 4 4 2 2 2 3 3 5 6 6
28534 172/300 Flush
28535 173/300 Flush
28536 174/300 Read block 293 len 4096
28537 175/300 Read block 1528 len 8192
28538 176/300 Read block 4466 len 4096
28539 177/300 Flush
28540 178/300 Write block 4769 len 8192 data: 9 7
28541 179/300 Read block 770 len 12288
28542 180/300 Read block 3476 len 32768
28543 181/300 Read block 3759 len 4096
28544 182/300 Write block 2936 len 8192 data: 4 5
28545 183/300 Read block 1483 len 16384
28546 184/300 Write block 1781 len 12288 data: 5 6 6
28547 185/300 Write block 3427 len 8192 data: 5 5
28548 186/300 Write block 1188 len 12288 data: 5 7 6
28549 187/300 Flush
28550 188/300 Read block 2301 len 40960
28551 189/300 Read block 2932 len 8192
28552 190/300 Write block 1846 len 16384 data: 2 2 2 2
28553 191/300 Read block 2593 len 8192
28554 192/300 Write block 2964 len 28672 data: 4 5 4 5 5 4 4
28555 193/300 Read block 862 len 28672
28556 194/300 Read block 59 len 8192
28557 195/300 Read block 2114 len 12288
28558 196/300 Read block 4085 len 4096
28559 197/300 Read block 835 len 4096
28560 198/300 Read block 3848 len 4096
28561 199/300 Read block 4844 len 8192
28562 200/300 Write block 800 len 32768 data: 6 7 7 7 6 4 4 4
28563 201/300 Write block 2634 len 16384 data: 5 4 6 6
28564 202/300 Write block 4860 len 16384 data: 6 8 7 7
28565 203/300 Read block 504 len 32768
28566 204/300 Write block 3267 len 4096 data: 4
28567 205/300 Read block 4005 len 8192
28568 206/300 Write block 4948 len 8192 data: 8 7
28569 207/300 Read block 3315 len 40960
28570 208/300 Read block 3027 len 36864
28571 209/300 Read block 1722 len 40960
28572 210/300 Write block 4251 len 36864 data: 7 7 7 8 8 7 6 7 8
28573 211/300 Read block 4223 len 28672
28574 212/300 Read block 2832 len 12288
28575 213/300 Flush
28576 214/300 Read block 1705 len 4096
28577 215/300 Write block 3211 len 36864 data: 6 7 7 4 4 5 4 3 4
28578 216/300 Flush
28579 217/300 Read block 4954 len 16384
28580 218/300 Write block 1599 len 20480 data: 2 2 4 5 5
28581 219/300 Read block 118 len 4096
28582 220/300 Write block 1015 len 16384 data: 6 6 5 5
28583 221/300 Read block 2237 len 40960
28584 222/300 Read block 3267 len 28672
28585 223/300 Read block 2774 len 40960
28586 224/300 Read block 2529 len 28672
28587 225/300 Read block 688 len 16384
28588 226/300 Read block 1531 len 4096
28589 227/300 Write block 524 len 12288 data: 9 8 7
28590 228/300 Read block 1249 len 32768
28591 229/300 Read block 1530 len 32768
28592 230/300 Write block 1156 len 12288 data: 6 6 4
28593 231/300 Write block 2915 len 40960 data: 3 3 3 3 3 3 3 3 3 3
28594 232/300 Read block 4897 len 16384
28595 233/300 Write block 4163 len 28672 data: 4 4 4 4 4 5 7
28596 234/300 Write block 1955 len 32768 data: 5 5 6 6 6 7 5 5
28597 235/300 Write block 4751 len 32768 data: 5 6 5 6 7 7 7 6
28598 236/300 Flush
28599 237/300 Read block 4529 len 4096
28600 238/300 Read block 2622 len 32768
28601 239/300 Read block 3406 len 12288
28602 240/300 Read block 189 len 28672
28603 241/300 Write block 2566 len 4096 data: 5
28604 242/300 Write block 1348 len 40960 data: 6 5 5 4 5 4 3 3 6 6
28605 243/300 Flush
28606 244/300 Write block 254 len 28672 data: 6 4 4 3 2 2 3
28607 245/300 Write block 119 len 20480 data: 4 4 5 5 5
28608 246/300 Read block 4250 len 28672
28609 247/300 Write block 4066 len 36864 data: 4 4 5 5 5 5 5 7 8
28610 248/300 Read block 2538 len 4096
28611 249/300 Flush
28612 250/300 Write block 4740 len 16384 data: 7 6 6 7
28613 251/300 Write block 4993 len 16384 data: 6 6 6 7
28614 252/300 Flush
28615 253/300 Read block 1149 len 36864
28616 254/300 Read block 678 len 12288
28617 255/300 Write block 3269 len 24576 data: 5 3 4 4 4 4
28618 256/300 Flush
28619 257/300 Write block 2848 len 12288 data: 10 7 8
28620 258/300 Write block 2974 len 8192 data: 6 6
28621 259/300 Read block 3284 len 8192
28622 260/300 Read block 4345 len 4096
28623 261/300 Read block 2812 len 28672
28624 262/300 Read block 603 len 8192
28625 263/300 Flush
28626 264/300 Flush
28627 265/300 Read block 3389 len 40960
28628 266/300 Read block 1284 len 8192
28629 267/300 Write block 951 len 8192 data: 8 7
28630 268/300 Flush
28631 269/300 Write block 2676 len 28672 data: 6 6 5 4 4 4 5
28632 270/300 Write block 3244 len 12288 data: 2 3 4
28633 271/300 Read block 2727 len 8192
28634 272/300 Read block 308 len 32768
28635 273/300 Flush
28636 274/300 Flush
28637 275/300 Read block 2958 len 36864
28638 276/300 Read block 2319 len 4096
28639 277/300 Write block 1374 len 32768 data: 3 3 3 3 5 4 5 5
28640 278/300 Write block 3611 len 32768 data: 5 4 5 7 6 5 5 6
28641 279/300 Read block 2856 len 8192
28642 280/300 Flush
28643 281/300 Read block 2187 len 12288
28644 282/300 Flush
28645 283/300 Flush
28646 284/300 Read block 2107 len 36864
28647 285/300 Read block 946 len 40960
28648 286/300 Read block 1433 len 8192
28649 287/300 Read block 319 len 32768
28650 288/300 Read block 4912 len 40960
28651 289/300 Write block 2720 len 12288 data: 5 6 7
28652 290/300 Write block 2990 len 28672 data: 6 6 7 9 11 12 11
28653 291/300 Write block 2600 len 36864 data: 7 7 5 6 6 7 6 4 4
28654 292/300 Read block 2357 len 8192
28655 293/300 Read block 2155 len 36864
28656 294/300 Write block 3883 len 16384 data: 6 8 8 7
28657 295/300 Read block 1121 len 16384
28658 296/300 Flush
28659 297/300 Read block 3693 len 24576
28660 298/300 Read block 3636 len 20480
28661 299/300 Flush
28662 300/300 Read block 2957 len 20480
28663 Main task has work to do, go find it
28664 got dsc Start(0)
28665 start 0
28666 Apr 20 01:11:07.689 INFO request completed, latency_us: 207, response_code: 204, uri: /start/cid/0, method: POST, req_id: 6602d3e0-db91-47b1-a67c-77cd6ce2cbe9, remote_addr: 127.0.0.1:60352, local_addr: 127.0.0.1:9998
28667 Replay: started 0, returned:Ok(())
28668 ----------------------------------------------------------------
28669 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:300
28670 States: Offline Active Active
28671 GW_ID ACK DSID TYPE BLOCKS DS:0 DS:1 DS:2 REPLAY
28672 6934 Acked 7933 Write 6 New Done Done false
28673 6935 Acked 7934 Write 6 New Done Done false
28674 6936 Acked 7935 Write 9 New Done Done false
28675 6937 Acked 7936 Read 2 New Done Done false
28676 6938 Acked 7937 Read 3 New Done Done false
28677 6939 Acked 7938 Read 3 New Done Done false
28678 6940 Acked 7939 Write 3 New Done Done false
28679 6941 Acked 7940 Write 8 New Done Done false
28680 6942 Acked 7941 Read 10 New Done Done false
28681 6943 Acked 7942 Read 1 New Done Done false
28682 6944 Acked 7943 Write 2 New Done Done false
28683 6945 Acked 7944 Read 3 New Done Done false
28684 6946 Acked 7945 Read 4 New Done Done false
28685 6947 Acked 7946 Read 3 New Done Done false
28686 6948 Acked 7947 Write 2 New Done Done false
28687 6949 Acked 7948 Read 1 New Done Done false
28688 6950 Acked 7949 Write 10 New Done Done false
28689 6951 Acked 7950 Read 9 New Done Done false
28690 6952 Acked 7951 Write 6 New Done Done false
28691 6953 Acked 7952 Write 9 New Done Done false
28692 6954 Acked 7953 Write 6 New Done Done false
28693 6955 Acked 7954 Read 7 New Done Done false
28694 6956 Acked 7955 Write 9 New Done Done false
28695 6957 Acked 7956 Write 9 New Done Done false
28696 6958 Acked 7957 Read 3 New Done Done false
28697 6959 Acked 7958 Read 7 New Done Done false
28698 6960 Acked 7959 Read 6 New Done Done false
28699 6961 Acked 7960 Read 8 New Done Done false
28700 6962 Acked 7961 Read 6 New Done Done false
28701 6963 Acked 7962 Read 7 New Done Done false
28702 6964 Acked 7963 Read 8 New Done Done false
28703 6965 Acked 7964 Read 2 New Done Done false
28704 6966 Acked 7965 Write 8 New Done Done false
28705 6967 Acked 7966 Read 2 New Done Done false
28706 6968 Acked 7967 Read 7 New Done Done false
28707 6969 Acked 7968 Write 8 New Done Done false
28708 6970 Acked 7969 Flush 0 New Done Done false
28709 6971 Acked 7970 Write 3 New Done Done false
28710 6972 Acked 7971 Write 9 New Done Done false
28711 6973 Acked 7972 Write 6 New Done Done false
28712 6974 Acked 7973 Read 10 New Done Done false
28713 6975 Acked 7974 Write 5 New Done Done false
28714 6976 Acked 7975 Write 8 New Done Done false
28715 6977 Acked 7976 Read 7 New Done Done false
28716 6978 Acked 7977 Write 3 New Done Done false
28717 6979 Acked 7978 Write 3 New Done Done false
28718 6980 Acked 7979 Write 1 New Done Done false
28719 6981 Acked 7980 Read 4 New Done Done false
28720 6982 Acked 7981 Read 3 New Done Done false
28721 6983 Acked 7982 Read 1 New Done Done false
28722 6984 Acked 7983 Write 6 New Done Done false
28723 6985 Acked 7984 Read 8 New Done Done false
28724 6986 Acked 7985 Write 9 New Done Done false
28725 6987 Acked 7986 Read 2 New Done Done false
28726 6988 Acked 7987 Write 5 New Done Done false
28727 6989 Acked 7988 Write 4 New Done Done false
28728 6990 Acked 7989 Write 8 New Done Done false
28729 6991 Acked 7990 Read 1 New Done Done false
28730 6992 Acked 7991 Write 4 New Done Done false
28731 6993 Acked 7992 Write 4 New Done Done false
28732 6994 Acked 7993 Read 10 New Done Done false
28733 6995 Acked 7994 Write 1 New Done Done false
28734 6996 Acked 7995 Read 4 New Done Done false
28735 6997 Acked 7996 Read 4 New Done Done false
28736 6998 Acked 7997 Read 2 New Done Done false
28737 6999 Acked 7998 Read 7 New Done Done false
28738 7000 Acked 7999 Write 4 New Done Done false
28739 7001 Acked 8000 Write 3 New Done Done false
28740 7002 Acked 8001 Read 6 New Done Done false
28741 7003 Acked 8002 Write 10 New Done Done false
28742 7004 Acked 8003 Write 6 New Done Done false
28743 7005 Acked 8004 Write 4 New Done Done false
28744 7006 Acked 8005 Write 9 New Done Done false
28745 7007 Acked 8006 Flush 0 New Done Done false
28746 7008 Acked 8007 Read 4 New Done Done false
28747 7009 Acked 8008 Read 10 New Done Done false
28748 7010 Acked 8009 Read 9 New Done Done false
28749 7011 Acked 8010 Read 2 New Done Done false
28750 7012 Acked 8011 Read 8 New Done Done false
28751 7013 Acked 8012 Write 10 New Done Done false
28752 7014 Acked 8013 Write 7 New Done Done false
28753 7015 Acked 8014 Flush 0 New Done Done false
28754 7016 Acked 8015 Read 3 New Done Done false
28755 7017 Acked 8016 Read 6 New Done Done false
28756 7018 Acked 8017 Read 5 New Done Done false
28757 7019 Acked 8018 Write 8 New Done Done false
28758 7020 Acked 8019 Write 7 New Done Done false
28759 7021 Acked 8020 Read 1 New Done Done false
28760 7022 Acked 8021 Read 9 New Done Done false
28761 7023 Acked 8022 Write 10 New Done Done false
28762 7024 Acked 8023 Read 5 New Done Done false
28763 7025 Acked 8024 Write 5 New Done Done false
28764 7026 Acked 8025 Write 9 New Done Done false
28765 7027 Acked 8026 Read 1 New Done Done false
28766 7028 Acked 8027 Read 8 New Done Done false
28767 7029 Acked 8028 Flush 0 New Done Done false
28768 7030 Acked 8029 Read 3 New Done Done false
28769 7031 Acked 8030 Write 8 New Done Done false
28770 7032 Acked 8031 Read 9 New Done Done false
28771 7033 Acked 8032 Flush 0 New Done Done false
28772 7034 Acked 8033 Read 4 New Done Done false
28773 7035 Acked 8034 Read 8 New Done Done false
28774 7036 Acked 8035 Read 5 New Done Done false
28775 7037 Acked 8036 Write 8 New Done Done false
28776 7038 Acked 8037 Flush 0 New Done Done false
28777 7039 Acked 8038 Write 6 New Done Done false
28778 7040 Acked 8039 Read 2 New Done Done false
28779 7041 Acked 8040 Read 1 New Done Done false
28780 7042 Acked 8041 Write 7 New Done Done false
28781 7043 Acked 8042 Write 6 New Done Done false
28782 7044 Acked 8043 Read 5 New Done Done false
28783 7045 Acked 8044 Write 5 New Done Done false
28784 7046 Acked 8045 Write 7 New Done Done false
28785 7047 Acked 8046 Read 3 New Done Done false
28786 7048 Acked 8047 Write 4 New Done Done false
28787 7049 Acked 8048 Read 4 New Done Done false
28788 7050 Acked 8049 Read 3 New Done Done false
28789 7051 Acked 8050 Read 1 New Done Done false
28790 7052 Acked 8051 Write 3 New Done Done false
28791 7053 Acked 8052 Write 6 New Done Done false
28792 7054 Acked 8053 Write 9 New Done Done false
28793 7055 Acked 8054 Read 6 New Done Done false
28794 7056 Acked 8055 Read 7 New Done Done false
28795 7057 Acked 8056 Write 2 New Done Done false
28796 7058 Acked 8057 Write 3 New Done Done false
28797 7059 Acked 8058 Read 5 New Done Done false
28798 7060 Acked 8059 Read 1 New Done Done false
28799 7061 Acked 8060 Write 8 New Done Done false
28800 7062 Acked 8061 Read 8 New Done Done false
28801 7063 Acked 8062 Write 1 New Done Done false
28802 7064 Acked 8063 Read 10 New Done Done false
28803 7065 Acked 8064 Write 3 New Done Done false
28804 7066 Acked 8065 Read 8 New Done Done false
28805 7067 Acked 8066 Read 1 New Done Done false
28806 7068 Acked 8067 Write 5 New Done Done false
28807 7069 Acked 8068 Read 1 New Done Done false
28808 7070 Acked 8069 Read 9 New Done Done false
28809 7071 Acked 8070 Read 10 New Done Done false
28810 7072 Acked 8071 Read 5 New Done Done false
28811 7073 Acked 8072 Read 1 New Done Done false
28812 7074 Acked 8073 Write 6 New Done Done false
28813 7075 Acked 8074 Flush 0 New Done Done false
28814 7076 Acked 8075 Read 7 New Done Done false
28815 7077 Acked 8076 Read 9 New Done Done false
28816 7078 Acked 8077 Write 2 New Done Done false
28817 7079 Acked 8078 Read 7 New Done Done false
28818 7080 Acked 8079 Write 6 New Done Done false
28819 7081 Acked 8080 Write 1 New Done Done false
28820 7082 Acked 8081 Read 6 New Done Done false
28821 7083 Acked 8082 Read 8 New Done Done false
28822 7084 Acked 8083 Read 10 New Done Done false
28823 7085 Acked 8084 Flush 0 New Done Done false
28824 7086 Acked 8085 Flush 0 New Done Done false
28825 7087 Acked 8086 Write 2 New Done Done false
28826 7088 Acked 8087 Read 8 New Done Done false
28827 7089 Acked 8088 Write 3 New Done Done false
28828 7090 Acked 8089 Read 1 New Done Done false
28829 7091 Acked 8090 Flush 0 New Done Done false
28830 7092 Acked 8091 Write 3 New Done Done false
28831 7093 Acked 8092 Read 8 New Done Done false
28832 7094 Acked 8093 Read 7 New Done Done false
28833 7095 Acked 8094 Write 6 New Done Done false
28834 7096 Acked 8095 Read 9 New Done Done false
28835 7097 Acked 8096 Flush 0 New Done Done false
28836 7098 Acked 8097 Read 3 New Done Done false
28837 7099 Acked 8098 Read 1 New Done Done false
28838 7100 Acked 8099 Write 9 New Done Done false
28839 7101 Acked 8100 Write 4 New Done Done false
28840 7102 Acked 8101 Read 8 New Done Done false
28841 7103 Acked 8102 Read 3 New Done Done false
28842 7104 Acked 8103 Write 10 New Done Done false
28843 7105 Acked 8104 Flush 0 New Done Done false
28844 7106 Acked 8105 Flush 0 New Done Done false
28845 7107 Acked 8106 Read 1 New Done Done false
28846 7108 Acked 8107 Read 2 New Done Done false
28847 7109 Acked 8108 Read 1 New Done Done false
28848 7110 Acked 8109 Flush 0 New Done Done false
28849 7111 Acked 8110 Write 2 New Done Done false
28850 7112 Acked 8111 Read 3 New Done Done false
28851 7113 Acked 8112 Read 8 New Done Done false
28852 7114 Acked 8113 Read 1 New Done Done false
28853 7115 Acked 8114 Write 2 New Done Done false
28854 7116 Acked 8115 Read 4 New Done Done false
28855 7117 Acked 8116 Write 3 New Done Done false
28856 7118 Acked 8117 Write 2 New Done Done false
28857 7119 Acked 8118 Write 3 New Done Done false
28858 7120 Acked 8119 Flush 0 New Done Done false
28859 7121 Acked 8120 Read 10 New Done Done false
28860 7122 Acked 8121 Read 2 New Done Done false
28861 7123 Acked 8122 Write 4 New Done Done false
28862 7124 Acked 8123 Read 2 New Done Done false
28863 7125 Acked 8124 Write 7 New Done Done false
28864 7126 Acked 8125 Read 7 New Done Done false
28865 7127 Acked 8126 Read 2 New Done Done false
28866 7128 Acked 8127 Read 3 New Done Done false
28867 7129 Acked 8128 Read 1 New Done Done false
28868 7130 Acked 8129 Read 1 New Done Done false
28869 7131 Acked 8130 Read 1 New Done Done false
28870 7132 Acked 8131 Read 2 New Done Done false
28871 7133 Acked 8132 Write 8 New Done Done false
28872 7134 Acked 8133 Write 4 New Done Done false
28873 7135 Acked 8134 Write 4 New Done Done false
28874 7136 Acked 8135 Read 8 New Done Done false
28875 7137 Acked 8136 Write 1 New Done Done false
28876 7138 Acked 8137 Read 2 New Done Done false
28877 7139 Acked 8138 Write 2 New Done Done false
28878 7140 Acked 8139 Read 10 New Done Done false
28879 7141 Acked 8140 Read 9 New Done Done false
28880 7142 Acked 8141 Read 10 New Done Done false
28881 7143 Acked 8142 Write 9 New Done Done false
28882 7144 Acked 8143 Read 7 New Done Done false
28883 7145 Acked 8144 Read 3 New Done Done false
28884 7146 Acked 8145 Flush 0 New Done Done false
28885 7147 Acked 8146 Read 1 New Done Done false
28886 7148 Acked 8147 Write 9 New Done Done false
28887 7149 Acked 8148 Flush 0 New Done Done false
28888 7150 Acked 8149 Read 4 New Done Done false
28889 7151 Acked 8150 Write 5 New Done Done false
28890 7152 Acked 8151 Read 1 New Done Done false
28891 7153 Acked 8152 Write 4 New Done Done false
28892 7154 Acked 8153 Read 10 New Done Done false
28893 7155 Acked 8154 Read 7 New Done Done false
28894 7156 Acked 8155 Read 10 New Done Done false
28895 7157 Acked 8156 Read 7 New Done Done false
28896 7158 Acked 8157 Read 4 New Done Done false
28897 7159 Acked 8158 Read 1 New Done Done false
28898 7160 Acked 8159 Write 3 New Done Done false
28899 7161 Acked 8160 Read 8 New Done Done false
28900 7162 Acked 8161 Read 8 New Done Done false
28901 7163 Acked 8162 Write 3 New Done Done false
28902 7164 Acked 8163 Write 10 New Done Done false
28903 7165 Acked 8164 Read 4 New Done Done false
28904 7166 Acked 8165 Write 7 New Done Done false
28905 7167 Acked 8166 Write 8 New Done Done false
28906 7168 Acked 8167 Write 8 New Done Done false
28907 7169 Acked 8168 Flush 0 New Done Done false
28908 7170 Acked 8169 Read 1 New Done Done false
28909 7171 Acked 8170 Read 8 New Done Done false
28910 7172 Acked 8171 Read 3 New Done Done false
28911 7173 Acked 8172 Read 7 New Done Done false
28912 7174 Acked 8173 Write 1 New Done Done false
28913 7175 Acked 8174 Write 10 New Done Done false
28914 7176 Acked 8175 Flush 0 New Done Done false
28915 7177 Acked 8176 Write 7 New Done Done false
28916 7178 Acked 8177 Write 5 New Done Done false
28917 7179 Acked 8178 Read 7 New Done Done false
28918 7180 Acked 8179 Write 9 New Done Done false
28919 7181 Acked 8180 Read 1 New Done Done false
28920 7182 Acked 8181 Flush 0 New Done Done false
28921 7183 Acked 8182 Write 4 New Done Done false
28922 7184 Acked 8183 Write 4 New Done Done false
28923 7185 Acked 8184 Flush 0 New Done Done false
28924 7186 Acked 8185 Read 9 New Done Done false
28925 7187 Acked 8186 Read 3 New Done Done false
28926 7188 Acked 8187 Write 6 New Done Done false
28927 7189 Acked 8188 Flush 0 New Done Done false
28928 7190 Acked 8189 Write 3 New Done Done false
28929 7191 Acked 8190 Write 2 New Done Done false
28930 7192 Acked 8191 Read 2 New Done Done false
28931 7193 Acked 8192 Read 1 New Done Done false
28932 7194 Acked 8193 Read 7 New Done Done false
28933 7195 Acked 8194 Read 2 New Done Done false
28934 7196 Acked 8195 Flush 0 New Done Done false
28935 7197 Acked 8196 Flush 0 New Done Done false
28936 7198 Acked 8197 Read 10 New Done Done false
28937 7199 Acked 8198 Read 2 New Done Done false
28938 7200 Acked 8199 Write 2 New Done Done false
28939 7201 Acked 8200 Flush 0 New Done Done false
28940 7202 Acked 8201 Write 7 New Done Done false
28941 7203 Acked 8202 Write 3 New Done Done false
28942 7204 Acked 8203 Read 2 New Done Done false
28943 7205 Acked 8204 Read 8 New Done Done false
28944 7206 Acked 8205 Flush 0 New Done Done false
28945 7207 Acked 8206 Flush 0 New Done Done false
28946 7208 Acked 8207 Read 9 New Done Done false
28947 7209 Acked 8208 Read 1 New Done Done false
28948 7210 Acked 8209 Write 8 New Done Done false
28949 7211 Acked 8210 Write 8 New Done Done false
28950 7212 Acked 8211 Read 2 New Done Done false
28951 7213 Acked 8212 Flush 0 New Done Done false
28952 7214 Acked 8213 Read 3 New Done Done false
28953 7215 Acked 8214 Flush 0 New Done Done false
28954 7216 Acked 8215 Flush 0 New Done Done false
28955 7217 Acked 8216 Read 9 New Done Done false
28956 7218 Acked 8217 Read 10 New Done Done false
28957 7219 Acked 8218 Read 2 New Done Done false
28958 7220 Acked 8219 Read 8 New Done Done false
28959 7221 Acked 8220 Read 10 New Done Done false
28960 7222 Acked 8221 Write 3 New Done Done false
28961 7223 Acked 8222 Write 7 New Done Done false
28962 7224 Acked 8223 Write 9 New Done Done false
28963 7225 Acked 8224 Read 2 New Done Done false
28964 7226 Acked 8225 Read 9 New Done Done false
28965 7227 Acked 8226 Write 4 New Done Done false
28966 7228 Acked 8227 Read 4 New Done Done false
28967 7229 Acked 8228 Flush 0 New Done Done false
28968 7230 Acked 8229 Read 6 New Done Done false
28969 7231 Acked 8230 Read 5 New Done Done false
28970 7232 Acked 8231 Flush 0 New Done Done false
28971 7233 Acked 8232 Read 5 New Done Done false
28972 STATES DS:0 DS:1 DS:2 TOTAL
28973 New 300 0 0 300
28974 Sent 0 0 0 0
28975 Done 0 300 300 600
28976 Skipped 0 0 0 0
28977 Error 0 0 0 0
28978 Last Flush: 7932 8231 8231
28979 Downstairs last five completed: 7932 7931 7930 7929 7928
28980 Upstairs last five completed: 7233 7232 7231 7230 7229
28981 CLIENT: Up:0 ds:300 act:2
28982 [8810] got start action
28983 [8810] I am going to restart
28984 Starting downstairs at port 8810
28985 Make output file at "/tmp/dsc/downstairs-8810.txt"
28986 [8810][0] reports Starting
28987 Downstairs /var/tmp/dsc/region/8810 port 8810 PID:Some(1220)
28988 [8810][0] reports Running
28989 ----------------------------------------------------------------
28990 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:301
28991 States: Offline Active Active
28992 GW_ID ACK DSID TYPE BLOCKS DS:0 DS:1 DS:2 REPLAY
28993 6934 Acked 7933 Write 6 New Done Done false
28994 6935 Acked 7934 Write 6 New Done Done false
28995 6936 Acked 7935 Write 9 New Done Done false
28996 6937 Acked 7936 Read 2 New Done Done false
28997 6938 Acked 7937 Read 3 New Done Done false
28998 6939 Acked 7938 Read 3 New Done Done false
28999 6940 Acked 7939 Write 3 New Done Done false
29000 6941 Acked 7940 Write 8 New Done Done false
29001 6942 Acked 7941 Read 10 New Done Done false
29002 6943 Acked 7942 Read 1 New Done Done false
29003 6944 Acked 7943 Write 2 New Done Done false
29004 6945 Acked 7944 Read 3 New Done Done false
29005 6946 Acked 7945 Read 4 New Done Done false
29006 6947 Acked 7946 Read 3 New Done Done false
29007 6948 Acked 7947 Write 2 New Done Done false
29008 6949 Acked 7948 Read 1 New Done Done false
29009 6950 Acked 7949 Write 10 New Done Done false
29010 6951 Acked 7950 Read 9 New Done Done false
29011 6952 Acked 7951 Write 6 New Done Done false
29012 6953 Acked 7952 Write 9 New Done Done false
29013 6954 Acked 7953 Write 6 New Done Done false
29014 6955 Acked 7954 Read 7 New Done Done false
29015 6956 Acked 7955 Write 9 New Done Done false
29016 6957 Acked 7956 Write 9 New Done Done false
29017 6958 Acked 7957 Read 3 New Done Done false
29018 6959 Acked 7958 Read 7 New Done Done false
29019 6960 Acked 7959 Read 6 New Done Done false
29020 6961 Acked 7960 Read 8 New Done Done false
29021 6962 Acked 7961 Read 6 New Done Done false
29022 6963 Acked 7962 Read 7 New Done Done false
29023 6964 Acked 7963 Read 8 New Done Done false
29024 6965 Acked 7964 Read 2 New Done Done false
29025 6966 Acked 7965 Write 8 New Done Done false
29026 6967 Acked 7966 Read 2 New Done Done false
29027 6968 Acked 7967 Read 7 New Done Done false
29028 6969 Acked 7968 Write 8 New Done Done false
29029 6970 Acked 7969 Flush 0 New Done Done false
29030 6971 Acked 7970 Write 3 New Done Done false
29031 6972 Acked 7971 Write 9 New Done Done false
29032 6973 Acked 7972 Write 6 New Done Done false
29033 6974 Acked 7973 Read 10 New Done Done false
29034 6975 Acked 7974 Write 5 New Done Done false
29035 6976 Acked 7975 Write 8 New Done Done false
29036 6977 Acked 7976 Read 7 New Done Done false
29037 6978 Acked 7977 Write 3 New Done Done false
29038 6979 Acked 7978 Write 3 New Done Done false
29039 6980 Acked 7979 Write 1 New Done Done false
29040 6981 Acked 7980 Read 4 New Done Done false
29041 6982 Acked 7981 Read 3 New Done Done false
29042 6983 Acked 7982 Read 1 New Done Done false
29043 6984 Acked 7983 Write 6 New Done Done false
29044 6985 Acked 7984 Read 8 New Done Done false
29045 6986 Acked 7985 Write 9 New Done Done false
29046 6987 Acked 7986 Read 2 New Done Done false
29047 6988 Acked 7987 Write 5 New Done Done false
29048 6989 Acked 7988 Write 4 New Done Done false
29049 6990 Acked 7989 Write 8 New Done Done false
29050 6991 Acked 7990 Read 1 New Done Done false
29051 6992 Acked 7991 Write 4 New Done Done false
29052 6993 Acked 7992 Write 4 New Done Done false
29053 6994 Acked 7993 Read 10 New Done Done false
29054 6995 Acked 7994 Write 1 New Done Done false
29055 6996 Acked 7995 Read 4 New Done Done false
29056 6997 Acked 7996 Read 4 New Done Done false
29057 6998 Acked 7997 Read 2 New Done Done false
29058 6999 Acked 7998 Read 7 New Done Done false
29059 7000 Acked 7999 Write 4 New Done Done false
29060 7001 Acked 8000 Write 3 New Done Done false
29061 7002 Acked 8001 Read 6 New Done Done false
29062 7003 Acked 8002 Write 10 New Done Done false
29063 7004 Acked 8003 Write 6 New Done Done false
29064 7005 Acked 8004 Write 4 New Done Done false
29065 7006 Acked 8005 Write 9 New Done Done false
29066 7007 Acked 8006 Flush 0 New Done Done false
29067 7008 Acked 8007 Read 4 New Done Done false
29068 7009 Acked 8008 Read 10 New Done Done false
29069 7010 Acked 8009 Read 9 New Done Done false
29070 7011 Acked 8010 Read 2 New Done Done false
29071 7012 Acked 8011 Read 8 New Done Done false
29072 7013 Acked 8012 Write 10 New Done Done false
29073 7014 Acked 8013 Write 7 New Done Done false
29074 7015 Acked 8014 Flush 0 New Done Done false
29075 7016 Acked 8015 Read 3 New Done Done false
29076 7017 Acked 8016 Read 6 New Done Done false
29077 7018 Acked 8017 Read 5 New Done Done false
29078 7019 Acked 8018 Write 8 New Done Done false
29079 7020 Acked 8019 Write 7 New Done Done false
29080 7021 Acked 8020 Read 1 New Done Done false
29081 7022 Acked 8021 Read 9 New Done Done false
29082 7023 Acked 8022 Write 10 New Done Done false
29083 7024 Acked 8023 Read 5 New Done Done false
29084 7025 Acked 8024 Write 5 New Done Done false
29085 7026 Acked 8025 Write 9 New Done Done false
29086 7027 Acked 8026 Read 1 New Done Done false
29087 7028 Acked 8027 Read 8 New Done Done false
29088 7029 Acked 8028 Flush 0 New Done Done false
29089 7030 Acked 8029 Read 3 New Done Done false
29090 7031 Acked 8030 Write 8 New Done Done false
29091 7032 Acked 8031 Read 9 New Done Done false
29092 7033 Acked 8032 Flush 0 New Done Done false
29093 7034 Acked 8033 Read 4 New Done Done false
29094 7035 Acked 8034 Read 8 New Done Done false
29095 7036 Acked 8035 Read 5 New Done Done false
29096 7037 Acked 8036 Write 8 New Done Done false
29097 7038 Acked 8037 Flush 0 New Done Done false
29098 7039 Acked 8038 Write 6 New Done Done false
29099 7040 Acked 8039 Read 2 New Done Done false
29100 7041 Acked 8040 Read 1 New Done Done false
29101 7042 Acked 8041 Write 7 New Done Done false
29102 7043 Acked 8042 Write 6 New Done Done false
29103 7044 Acked 8043 Read 5 New Done Done false
29104 7045 Acked 8044 Write 5 New Done Done false
29105 7046 Acked 8045 Write 7 New Done Done false
29106 7047 Acked 8046 Read 3 New Done Done false
29107 7048 Acked 8047 Write 4 New Done Done false
29108 7049 Acked 8048 Read 4 New Done Done false
29109 7050 Acked 8049 Read 3 New Done Done false
29110 7051 Acked 8050 Read 1 New Done Done false
29111 7052 Acked 8051 Write 3 New Done Done false
29112 7053 Acked 8052 Write 6 New Done Done false
29113 7054 Acked 8053 Write 9 New Done Done false
29114 7055 Acked 8054 Read 6 New Done Done false
29115 7056 Acked 8055 Read 7 New Done Done false
29116 7057 Acked 8056 Write 2 New Done Done false
29117 7058 Acked 8057 Write 3 New Done Done false
29118 7059 Acked 8058 Read 5 New Done Done false
29119 7060 Acked 8059 Read 1 New Done Done false
29120 7061 Acked 8060 Write 8 New Done Done false
29121 7062 Acked 8061 Read 8 New Done Done false
29122 7063 Acked 8062 Write 1 New Done Done false
29123 7064 Acked 8063 Read 10 New Done Done false
29124 7065 Acked 8064 Write 3 New Done Done false
29125 7066 Acked 8065 Read 8 New Done Done false
29126 7067 Acked 8066 Read 1 New Done Done false
29127 7068 Acked 8067 Write 5 New Done Done false
29128 7069 Acked 8068 Read 1 New Done Done false
29129 7070 Acked 8069 Read 9 New Done Done false
29130 7071 Acked 8070 Read 10 New Done Done false
29131 7072 Acked 8071 Read 5 New Done Done false
29132 7073 Acked 8072 Read 1 New Done Done false
29133 7074 Acked 8073 Write 6 New Done Done false
29134 7075 Acked 8074 Flush 0 New Done Done false
29135 7076 Acked 8075 Read 7 New Done Done false
29136 7077 Acked 8076 Read 9 New Done Done false
29137 7078 Acked 8077 Write 2 New Done Done false
29138 7079 Acked 8078 Read 7 New Done Done false
29139 7080 Acked 8079 Write 6 New Done Done false
29140 7081 Acked 8080 Write 1 New Done Done false
29141 7082 Acked 8081 Read 6 New Done Done false
29142 7083 Acked 8082 Read 8 New Done Done false
29143 7084 Acked 8083 Read 10 New Done Done false
29144 7085 Acked 8084 Flush 0 New Done Done false
29145 7086 Acked 8085 Flush 0 New Done Done false
29146 7087 Acked 8086 Write 2 New Done Done false
29147 7088 Acked 8087 Read 8 New Done Done false
29148 7089 Acked 8088 Write 3 New Done Done false
29149 7090 Acked 8089 Read 1 New Done Done false
29150 7091 Acked 8090 Flush 0 New Done Done false
29151 7092 Acked 8091 Write 3 New Done Done false
29152 7093 Acked 8092 Read 8 New Done Done false
29153 7094 Acked 8093 Read 7 New Done Done false
29154 7095 Acked 8094 Write 6 New Done Done false
29155 7096 Acked 8095 Read 9 New Done Done false
29156 7097 Acked 8096 Flush 0 New Done Done false
29157 7098 Acked 8097 Read 3 New Done Done false
29158 7099 Acked 8098 Read 1 New Done Done false
29159 7100 Acked 8099 Write 9 New Done Done false
29160 7101 Acked 8100 Write 4 New Done Done false
29161 7102 Acked 8101 Read 8 New Done Done false
29162 7103 Acked 8102 Read 3 New Done Done false
29163 7104 Acked 8103 Write 10 New Done Done false
29164 7105 Acked 8104 Flush 0 New Done Done false
29165 7106 Acked 8105 Flush 0 New Done Done false
29166 7107 Acked 8106 Read 1 New Done Done false
29167 7108 Acked 8107 Read 2 New Done Done false
29168 7109 Acked 8108 Read 1 New Done Done false
29169 7110 Acked 8109 Flush 0 New Done Done false
29170 7111 Acked 8110 Write 2 New Done Done false
29171 7112 Acked 8111 Read 3 New Done Done false
29172 7113 Acked 8112 Read 8 New Done Done false
29173 7114 Acked 8113 Read 1 New Done Done false
29174 7115 Acked 8114 Write 2 New Done Done false
29175 7116 Acked 8115 Read 4 New Done Done false
29176 7117 Acked 8116 Write 3 New Done Done false
29177 7118 Acked 8117 Write 2 New Done Done false
29178 7119 Acked 8118 Write 3 New Done Done false
29179 7120 Acked 8119 Flush 0 New Done Done false
29180 7121 Acked 8120 Read 10 New Done Done false
29181 7122 Acked 8121 Read 2 New Done Done false
29182 7123 Acked 8122 Write 4 New Done Done false
29183 7124 Acked 8123 Read 2 New Done Done false
29184 7125 Acked 8124 Write 7 New Done Done false
29185 7126 Acked 8125 Read 7 New Done Done false
29186 7127 Acked 8126 Read 2 New Done Done false
29187 7128 Acked 8127 Read 3 New Done Done false
29188 7129 Acked 8128 Read 1 New Done Done false
29189 7130 Acked 8129 Read 1 New Done Done false
29190 7131 Acked 8130 Read 1 New Done Done false
29191 7132 Acked 8131 Read 2 New Done Done false
29192 7133 Acked 8132 Write 8 New Done Done false
29193 7134 Acked 8133 Write 4 New Done Done false
29194 7135 Acked 8134 Write 4 New Done Done false
29195 7136 Acked 8135 Read 8 New Done Done false
29196 7137 Acked 8136 Write 1 New Done Done false
29197 7138 Acked 8137 Read 2 New Done Done false
29198 7139 Acked 8138 Write 2 New Done Done false
29199 7140 Acked 8139 Read 10 New Done Done false
29200 7141 Acked 8140 Read 9 New Done Done false
29201 7142 Acked 8141 Read 10 New Done Done false
29202 7143 Acked 8142 Write 9 New Done Done false
29203 7144 Acked 8143 Read 7 New Done Done false
29204 7145 Acked 8144 Read 3 New Done Done false
29205 7146 Acked 8145 Flush 0 New Done Done false
29206 7147 Acked 8146 Read 1 New Done Done false
29207 7148 Acked 8147 Write 9 New Done Done false
29208 7149 Acked 8148 Flush 0 New Done Done false
29209 7150 Acked 8149 Read 4 New Done Done false
29210 7151 Acked 8150 Write 5 New Done Done false
29211 7152 Acked 8151 Read 1 New Done Done false
29212 7153 Acked 8152 Write 4 New Done Done false
29213 7154 Acked 8153 Read 10 New Done Done false
29214 7155 Acked 8154 Read 7 New Done Done false
29215 7156 Acked 8155 Read 10 New Done Done false
29216 7157 Acked 8156 Read 7 New Done Done false
29217 7158 Acked 8157 Read 4 New Done Done false
29218 7159 Acked 8158 Read 1 New Done Done false
29219 7160 Acked 8159 Write 3 New Done Done false
29220 7161 Acked 8160 Read 8 New Done Done false
29221 7162 Acked 8161 Read 8 New Done Done false
29222 7163 Acked 8162 Write 3 New Done Done false
29223 7164 Acked 8163 Write 10 New Done Done false
29224 7165 Acked 8164 Read 4 New Done Done false
29225 7166 Acked 8165 Write 7 New Done Done false
29226 7167 Acked 8166 Write 8 New Done Done false
29227 7168 Acked 8167 Write 8 New Done Done false
29228 7169 Acked 8168 Flush 0 New Done Done false
29229 7170 Acked 8169 Read 1 New Done Done false
29230 7171 Acked 8170 Read 8 New Done Done false
29231 7172 Acked 8171 Read 3 New Done Done false
29232 7173 Acked 8172 Read 7 New Done Done false
29233 7174 Acked 8173 Write 1 New Done Done false
29234 7175 Acked 8174 Write 10 New Done Done false
29235 7176 Acked 8175 Flush 0 New Done Done false
29236 7177 Acked 8176 Write 7 New Done Done false
29237 7178 Acked 8177 Write 5 New Done Done false
29238 7179 Acked 8178 Read 7 New Done Done false
29239 7180 Acked 8179 Write 9 New Done Done false
29240 7181 Acked 8180 Read 1 New Done Done false
29241 7182 Acked 8181 Flush 0 New Done Done false
29242 7183 Acked 8182 Write 4 New Done Done false
29243 7184 Acked 8183 Write 4 New Done Done false
29244 7185 Acked 8184 Flush 0 New Done Done false
29245 7186 Acked 8185 Read 9 New Done Done false
29246 7187 Acked 8186 Read 3 New Done Done false
29247 7188 Acked 8187 Write 6 New Done Done false
29248 7189 Acked 8188 Flush 0 New Done Done false
29249 7190 Acked 8189 Write 3 New Done Done false
29250 7191 Acked 8190 Write 2 New Done Done false
29251 7192 Acked 8191 Read 2 New Done Done false
29252 7193 Acked 8192 Read 1 New Done Done false
29253 7194 Acked 8193 Read 7 New Done Done false
29254 7195 Acked 8194 Read 2 New Done Done false
29255 7196 Acked 8195 Flush 0 New Done Done false
29256 7197 Acked 8196 Flush 0 New Done Done false
29257 7198 Acked 8197 Read 10 New Done Done false
29258 7199 Acked 8198 Read 2 New Done Done false
29259 7200 Acked 8199 Write 2 New Done Done false
29260 7201 Acked 8200 Flush 0 New Done Done false
29261 7202 Acked 8201 Write 7 New Done Done false
29262 7203 Acked 8202 Write 3 New Done Done false
29263 7204 Acked 8203 Read 2 New Done Done false
29264 7205 Acked 8204 Read 8 New Done Done false
29265 7206 Acked 8205 Flush 0 New Done Done false
29266 7207 Acked 8206 Flush 0 New Done Done false
29267 7208 Acked 8207 Read 9 New Done Done false
29268 7209 Acked 8208 Read 1 New Done Done false
29269 7210 Acked 8209 Write 8 New Done Done false
29270 7211 Acked 8210 Write 8 New Done Done false
29271 7212 Acked 8211 Read 2 New Done Done false
29272 7213 Acked 8212 Flush 0 New Done Done false
29273 7214 Acked 8213 Read 3 New Done Done false
29274 7215 Acked 8214 Flush 0 New Done Done false
29275 7216 Acked 8215 Flush 0 New Done Done false
29276 7217 Acked 8216 Read 9 New Done Done false
29277 7218 Acked 8217 Read 10 New Done Done false
29278 7219 Acked 8218 Read 2 New Done Done false
29279 7220 Acked 8219 Read 8 New Done Done false
29280 7221 Acked 8220 Read 10 New Done Done false
29281 7222 Acked 8221 Write 3 New Done Done false
29282 7223 Acked 8222 Write 7 New Done Done false
29283 7224 Acked 8223 Write 9 New Done Done false
29284 7225 Acked 8224 Read 2 New Done Done false
29285 7226 Acked 8225 Read 9 New Done Done false
29286 7227 Acked 8226 Write 4 New Done Done false
29287 7228 Acked 8227 Read 4 New Done Done false
29288 7229 Acked 8228 Flush 0 New Done Done false
29289 7230 Acked 8229 Read 6 New Done Done false
29290 7231 Acked 8230 Read 5 New Done Done false
29291 7232 Acked 8231 Flush 0 New Done Done false
29292 7233 Acked 8232 Read 5 New Done Done false
29293 7234 Acked 8233 Flush 0 New Done Done false
29294 STATES DS:0 DS:1 DS:2 TOTAL
29295 New 301 0 0 301
29296 Sent 0 0 0 0
29297 Done 0 301 301 602
29298 Skipped 0 0 0 0
29299 Error 0 0 0 0
29300 Last Flush: 7932 8233 8233
29301 Downstairs last five completed: 7932 7931 7930 7929 7928
29302 Upstairs last five completed: 7234 7233 7232 7231 7230
29303 CLIENT: Up:0 ds:301 act:2
293042024-04-20T01:11:13.388ZINFOcrucible: connecting to 127.0.0.1:8810 = io task client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
293052024-04-20T01:11:13.388ZINFOcrucible: ds_connection connected from Ok(127.0.0.1:41232) = io task client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
293062024-04-20T01:11:13.389ZINFOcrucible: downstairs client at Some(127.0.0.1:8810) has region UUID 12345678-0000-0000-0000-000000008810 = downstairs client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
293072024-04-20T01:11:13.390ZINFOcrucible: Returning UUID:12345678-0000-0000-0000-000000008810 matches = downstairs client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
293082024-04-20T01:11:13.390ZINFOcrucible: send last flush ID to this DS: 7932 = downstairs client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
293092024-04-20T01:11:13.390ZINFOcrucible: Replied this last flush ID: 7932 = downstairs client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
293102024-04-20T01:11:13.390ZINFOcrucible: ds_transition from Offline to Replay = downstairs client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
293112024-04-20T01:11:13.390ZINFOcrucible: [0] Transition from Offline to Replay = downstairs client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
293122024-04-20T01:11:13.390ZINFOcrucible: ds_transition from Replay to Active = downstairs client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
293132024-04-20T01:11:13.390ZINFOcrucible: [0] Transition from Replay to Active = downstairs client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
29314 ----------------------------------------------------------------
29315 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:0
29316 Downstairs last five completed: 8233 8232 8231 8230 8229
29317 Upstairs last five completed: 7234 7233 7232 7231 7230
29318 CLIENT: Up:0 ds:0 act:3
29319 Replay: All jobs finished, all DS active.
29320 Main task has work to do, go find it
29321 got dsc Stop(0)
29322 stop 0
29323 Apr 20 01:11:15.694 INFO request completed, latency_us: 349, response_code: 204, uri: /stop/cid/0, method: POST, req_id: 7ac6d477-ce42-48f4-a4c9-175cbc014373, remote_addr: 127.0.0.1:60352, local_addr: 127.0.0[8810] Got stop action so:false kr:false
29324 .1:9998
293252024-04-20T01:11:15.695ZWARNcrucible: downstairs disconnected = io task client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
293262024-04-20T01:11:15.695ZWARNcrucible: client task is sending Done(Finished) = io task client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
29327 Apr 20 01:11:15.695 INFO request completed, latency_us: 116, response_code: 200, uri: /state/cid/0, method: {"msg":"downstairs task for 0 stopped due to Finished","v":0,"name":"crucible","level":40,"time":"2024-04-20T01:11:15.695489957Z","hostname":"w-01HVWGBJP7HK0H9TQ26T6N3X8M","pid":1196,"session_id":"132b460a-26a0-4532-b1ab-4f8c07d4c6c7"}
29328 GET, req_id: 9e375e7e-2289-458e-a45d-da90c6530a56, remote_addr: 127.0.0.1:60352, local_addr: 127.0.0.1:9998
293292024-04-20T01:11:15.695ZINFOcrucible: Gone missing, transition from Active to Offline = downstairs client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
293302024-04-20T01:11:15.695ZINFOcrucible: [0] client re-new 0 jobs since flush 8233 = downstairs session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
293312024-04-20T01:11:15.695ZINFOcrucible: [0] Marked 0 jobs for replay since flush: 8233 = downstairs session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
293322024-04-20T01:11:15.695ZINFOcrucible: client task is exiting = io task client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
29333 [8810] Exited with: ExitStatus(unix_wait_status(9))
29334 [8810][0] reports Exit
29335 Apr 20 01:11:19.698 INFO request completed, latency_us: 239, response_code: 200, uri: /state/cid/0, method: GET, req_id: 0f006be6-ea2c-4872-be60-610997ebb989, remote_addr: 127.0.0.1:60352, local_addr: 127.0.0.1:9998
29336 001/300 Write block 3253 len 32768 data: 5 5 5 4 4 4 3 3
29337 002/300 Read block 2463 len 40960
29338 003/300 Flush
29339 004/300 Read block 3108 len 20480
29340 005/300 Write block 1044 len 36864 data: 6 6 6 7 6 5 5 4 4
29341 006/300 Read block 134 len 4096
29342 007/300 Write block 1510 len 40960 data: 2 3 4 4 3 3 4 6 8 10
29343 008/300 Read block 3636 len 40960
29344 009/300 Flush
29345 010/300 Write block 1464 len 36864 data: 4 6 6 4 5 5 5 6 8
29346 011/300 Flush
29347 012/300 Write block 2614 len 16384 data: 6 6 10 9
29348 013/300 Write block 1405 len 20480 data: 6 7 5 5 4
29349 014/300 Read block 1441 len 32768
29350 015/300 Read block 4859 len 24576
29351 016/300 Read block 3570 len 24576
29352 017/300 Read block 3048 len 8192
29353 018/300 Read block 3163 len 28672
29354 019/300 Read block 99 len 20480
29355 020/300 Write block 1052 len 16384 data: 5 4 4 4
29356 021/300 Read block 635 len 40960
29357 022/300 Read block 4348 len 16384
29358 023/300 Read block 1602 len 32768
29359 024/300 Write block 3108 len 28672 data: 4 4 5 5 4 5 5
29360 025/300 Read block 2674 len 4096
29361 026/300 Write block 4560 len 16384 data: 5 5 4 5
29362 027/300 Write block 3598 len 8192 data: 6 5
29363 028/300 Write block 2244 len 4096 data: 6
29364 029/300 Flush
29365 030/300 Write block 3156 len 12288 data: 5 5 4
29366 031/300 Read block 2843 len 36864
29367 032/300 Read block 3894 len 32768
29368 033/300 Read block 3270 len 24576
29369 034/300 Read block 2559 len 16384
29370 035/300 Read block 4640 len 36864
29371 036/300 Write block 823 len 36864 data: 6 5 5 4 6 6 7 6 6
29372 037/300 Flush
29373 038/300 Write block 1318 len 36864 data: 4 4 4 4 4 4 5 6 6
29374 039/300 Write block 3881 len 32768 data: 6 6 7 9 9 8 6 6
29375 040/300 Read block 975 len 40960
29376 041/300 Write block 2017 len 24576 data: 4 4 5 5 6 8
29377 042/300 Read block 2219 len 36864
29378 043/300 Write block 749 len 20480 data: 8 7 7 7 6
29379 044/300 Flush
29380 045/300 Read block 512 len 20480
29381 046/300 Read block 800 len 40960
29382 047/300 Read block 3380 len 12288
29383 048/300 Read block 2498 len 28672
29384 049/300 Read block 4974 len 36864
29385 050/300 Read block 1026 len 4096
29386 051/300 Read block 3681 len 12288
29387 052/300 Write block 2346 len 28672 data: 6 6 10 7 8 7 7
29388 053/300 Read block 1317 len 32768
29389 054/300 Write block 893 len 8192 data: 3 4
29390 055/300 Read block 3606 len 4096
29391 056/300 Write block 886 len 24576 data: 3 5 7 6 4 4
29392 057/300 Write block 564 len 36864 data: 4 3 4 5 4 4 4 5 5
29393 058/300 Read block 2177 len 28672
29394 059/300 Read block 350 len 8192
29395 060/300 Read block 1275 len 4096
29396 061/300 Flush
29397 062/300 Read block 3529 len 12288
29398 063/300 Read block 3673 len 40960
29399 064/300 Read block 522 len 24576
29400 065/300 Read block 2395 len 12288
29401 066/300 Read block 1694 len 28672
29402 067/300 Read block 2424 len 4096
29403 068/300 Read block 219 len 16384
29404 069/300 Write block 4237 len 20480 data: 4 5 5 6 6
29405 070/300 Read block 1401 len 12288
29406 071/300 Write block 3616 len 8192 data: 6 6
29407 072/300 Flush
29408 073/300 Write block 2400 len 20480 data: 6 6 4 4 5
29409 074/300 Write block 2627 len 16384 data: 6 4 4 4
29410 075/300 Write block 318 len 32768 data: 7 6 6 6 5 9 9 11
29411 076/300 Flush
29412 077/300 Read block 3148 len 28672
29413 078/300 Read block 4174 len 32768
29414 079/300 Write block 2779 len 8192 data: 2 3
29415 080/300 Flush
29416 081/300 Read block 2430 len 4096
29417 082/300 Read block 4986 len 40960
29418 083/300 Read block 3332 len 36864
29419 084/300 Read block 1534 len 32768
29420 085/300 Write block 2095 len 32768 data: 6 7 6 5 4 4 6 7
29421 086/300 Read block 4843 len 40960
29422 087/300 Write block 1158 len 24576 data: 5 3 4 4 5 4
29423 088/300 Read block 1683 len 28672
29424 089/300 Write block 1514 len 16384 data: 4 4 5 7
29425 090/300 Write block 3921 len 4096 data: 6
29426 091/300 Read block 3950 len 40960
29427 092/300 Write block 2835 len 36864 data: 4 5 4 5 6 6 8 7 9
29428 093/300 Flush
29429 094/300 Write block 379 len 4096 data: 2
29430 095/300 Write block 1193 len 24576 data: 5 4 4 5 5 5
29431 096/300 Read block 1225 len 32768
29432 097/300 Read block 831 len 12288
29433 098/300 Write block 1992 len 28672 data: 4 4 2 2 2 3 4
29434 099/300 Write block 4616 len 20480 data: 4 4 4 4 4
29435 100/300 Write block 3979 len 12288 data: 4 5 5
29436 101/300 Read block 893 len 4096
29437 102/300 Read block 986 len 32768
29438 103/300 Read block 4415 len 8192
29439 104/300 Read block 1167 len 20480
29440 105/300 Write block 4178 len 24576 data: 3 3 4 5 7 5
29441 106/300 Write block 2284 len 28672 data: 2 3 3 4 5 5 5
29442 107/300 Read block 1787 len 4096
29443 108/300 Read block 425 len 20480
29444 109/300 Read block 1278 len 28672
29445 110/300 Write block 2958 len 40960 data: 2 2 3 3 4 4 5 6 5 6
29446 111/300 Read block 951 len 32768
29447 112/300 Read block 1297 len 12288
29448 113/300 Write block 3336 len 40960 data: 4 5 5 8 7 7 7 7 5 5
29449 114/300 Write block 3357 len 24576 data: 5 5 4 3 3 3
29450 115/300 Write block 4875 len 20480 data: 12 12 12 9 8
29451 116/300 Read block 4115 len 20480
29452 117/300 Write block 2949 len 20480 data: 2 2 2 4 3
29453 118/300 Read block 2599 len 24576
29454 119/300 Read block 4301 len 32768
29455 120/300 Read block 4546 len 24576
29456 121/300 Read block 3028 len 16384
29457 122/300 Write block 897 len 16384 data: 3 3 4 4
29458 123/300 Read block 4716 len 28672
29459 124/300 Read block 3764 len 20480
29460 125/300 Write block 1091 len 8192 data: 9 7
29461 126/300 Write block 1890 len 28672 data: 3 3 4 5 5 6 7
29462 127/300 Flush
29463 128/300 Write block 2867 len 20480 data: 6 5 5 4 5
29464 129/300 Read block 1197 len 4096
29465 130/300 Read block 1554 len 16384
29466 131/300 Write block 4497 len 4096 data: 4
29467 132/300 Flush
29468 133/300 Write block 2584 len 16384 data: 7 7 7 6
29469 134/300 Read block 771 len 20480
29470 135/300 Write block 1449 len 12288 data: 5 7 7
29471 136/300 Read block 3381 len 32768
29472 137/300 Write block 111 len 20480 data: 5 7 8 7 6
29473 138/300 Flush
29474 139/300 Read block 1276 len 8192
29475 140/300 Read block 3554 len 16384
29476 141/300 Write block 4957 len 24576 data: 4 4 5 6 5 4
29477 142/300 Read block 2454 len 28672
29478 143/300 Write block 504 len 24576 data: 6 5 8 8 8 6
29479 144/300 Write block 2526 len 12288 data: 5 5 6
29480 145/300 Read block 4429 len 16384
29481 146/300 Write block 828 len 24576 data: 7 8 7 7 5 6
29482 147/300 Read block 210 len 16384
29483 148/300 Read block 3919 len 16384
29484 149/300 Read block 87 len 40960
29485 150/300 Read block 905 len 36864
29486 151/300 Read block 4178 len 12288
29487 152/300 Read block 3663 len 12288
29488 153/300 Write block 3988 len 12288 data: 3 3 4
29489 154/300 Flush
29490 155/300 Read block 628 len 40960
29491 156/300 Read block 1025 len 4096
29492 157/300 Read block 1477 len 16384
29493 158/300 Write block 1012 len 28672 data: 4 6 4 7 7 6 6
29494 159/300 Read block 2237 len 40960
29495 160/300 Write block 1667 len 16384 data: 9 8 7 7
29496 161/300 Read block 3035 len 16384
29497 162/300 Write block 3365 len 4096 data: 5
29498 163/300 Read block 3003 len 20480
29499 164/300 Read block 4767 len 28672
29500 165/300 Read block 797 len 28672
29501 166/300 Read block 4140 len 8192
29502 167/300 Read block 864 len 28672
29503 168/300 Flush
29504 169/300 Read block 2110 len 8192
29505 170/300 Write block 2728 len 16384 data: 12 11 6 4
29506 171/300 Flush
29507 172/300 Read block 629 len 28672
29508 173/300 Write block 3333 len 40960 data: 3 4 5 5 6 6 9 8 8 8
29509 174/300 Write block 4972 len 12288 data: 6 5 3
29510 175/300 Flush
29511 176/300 Flush
29512 177/300 Write block 3735 len 8192 data: 7 7
29513 178/300 Read block 2938 len 32768
29514 179/300 Read block 595 len 12288
29515 180/300 Read block 3449 len 8192
29516 181/300 Read block 3751 len 24576
29517 182/300 Flush
29518 183/300 Write block 1287 len 20480 data: 3 2 3 3 3
29519 184/300 Read block 4739 len 12288
29520 185/300 Write block 3040 len 36864 data: 4 4 3 4 4 4 6 7 6
29521 186/300 Read block 1930 len 28672
29522 187/300 Flush
29523 188/300 Write block 1288 len 16384 data: 3 4 4 4
29524 189/300 Read block 1761 len 36864
29525 190/300 Read block 3117 len 12288
29526 191/300 Write block 4 len 32768 data: 4 4 5 5 6 6 6 5
29527 192/300 Write block 3978 len 24576 data: 4 5 6 6 4 5
29528 193/300 Write block 4318 len 4096 data: 6
29529 194/300 Read block 2463 len 28672
29530 195/300 Read block 901 len 12288
29531 196/300 Write block 4481 len 8192 data: 8 8
29532 197/300 Write block 2696 len 20480 data: 4 5 6 7 7
29533 198/300 Write block 3980 len 32768 data: 7 7 5 6 5 5 4 3
29534 199/300 Write block 2931 len 32768 data: 4 5 5 4 3 5 6 7
29535 200/300 Read block 3025 len 16384
29536 201/300 Write block 847 len 24576 data: 5 6 6 5 6 7
29537 202/300 Write block 222 len 20480 data: 6 5 4 4 5
29538 203/300 Write block 4302 len 4096 data: 6
29539 204/300 Flush
29540 205/300 Read block 4430 len 8192
29541 206/300 Write block 3689 len 4096 data: 5
29542 207/300 Read block 4946 len 4096
29543 208/300 Read block 1270 len 32768
29544 209/300 Write block 1852 len 12288 data: 6 7 6
29545 210/300 Read block 2290 len 36864
29546 211/300 Write block 191 len 24576 data: 6 6 6 5 4 4
29547 212/300 Write block 337 len 20480 data: 3 3 4 3 4
29548 213/300 Read block 2924 len 20480
29549 214/300 Read block 1663 len 20480
29550 215/300 Write block 882 len 4096 data: 3
29551 216/300 Write block 347 len 12288 data: 3 4 5
29552 217/300 Write block 2618 len 8192 data: 9 10
29553 218/300 Read block 358 len 24576
29554 219/300 Write block 135 len 32768 data: 2 2 2 2 2 3 3 4
29555 220/300 Write block 4571 len 4096 data: 11
29556 221/300 Flush
29557 222/300 Write block 2613 len 4096 data: 5
29558 223/300 Flush
29559 224/300 Write block 626 len 4096 data: 5
29560 225/300 Read block 1276 len 28672
29561 226/300 Write block 4391 len 28672 data: 4 3 3 2 2 2 3
29562 227/300 Write block 41 len 24576 data: 5 5 6 5 6 5
29563 228/300 Read block 1963 len 32768
29564 229/300 Flush
29565 230/300 Write block 879 len 4096 data: 5
29566 231/300 Read block 2094 len 12288
29567 232/300 Read block 4274 len 28672
29568 233/300 Read block 3644 len 36864
29569 234/300 Read block 2513 len 8192
29570 235/300 Read block 1167 len 16384
29571 236/300 Write block 3548 len 40960 data: 4 4 4 4 4 5 5 4 4 4
29572 237/300 Write block 1055 len 28672 data: 5 7 7 6 7 6 6
29573 238/300 Write block 284 len 4096 data: 3
29574 239/300 Read block 2641 len 16384
29575 240/300 Read block 4070 len 36864
29576 241/300 Read block 3569 len 24576
29577 242/300 Read block 3485 len 24576
29578 243/300 Read block 4242 len 36864
29579 244/300 Write block 654 len 32768 data: 4 3 3 7 7 6 6 6
29580 245/300 Write block 3377 len 8192 data: 4 5
29581 246/300 Read block 3112 len 32768
29582 247/300 Read block 58 len 12288
29583 248/300 Read block 4256 len 20480
29584 249/300 Read block 236 len 28672
29585 250/300 Write block 2311 len 16384 data: 6 8 8 7
29586 251/300 Write block 3874 len 16384 data: 5 5 5 6
29587 252/300 Flush
29588 253/300 Write block 594 len 4096 data: 5
29589 254/300 Read block 1286 len 24576
29590 255/300 Read block 1978 len 12288
29591 256/300 Write block 1061 len 24576 data: 7 6 5 5 5 3
29592 257/300 Write block 3570 len 8192 data: 4 4
29593 258/300 Write block 2223 len 28672 data: 6 6 7 7 6 6 7
29594 259/300 Read block 3229 len 16384
29595 260/300 Write block 577 len 28672 data: 6 6 6 8 8 6 5
29596 261/300 Write block 3175 len 20480 data: 3 3 4 5 5
29597 262/300 Write block 199 len 12288 data: 4 5 5
29598 263/300 Read block 3101 len 8192
29599 264/300 Write block 914 len 12288 data: 5 4 6
29600 265/300 Read block 2746 len 32768
29601 266/300 Write block 1852 len 32768 data: 7 8 7 6 6 7 6 5
29602 267/300 Flush
29603 268/300 Write block 3743 len 32768 data: 4 4 5 6 6 5 6 7
29604 269/300 Read block 1382 len 24576
29605 270/300 Read block 1733 len 36864
29606 271/300 Read block 2326 len 36864
29607 272/300 Read block 432 len 36864
29608 273/300 Write block 4865 len 32768 data: 5 5 6 6 7 7 8 8
29609 274/300 Read block 3442 len 36864
29610 275/300 Read block 2627 len 12288
29611 276/300 Read block 4841 len 4096
29612 277/300 Read block 2713 len 20480
29613 278/300 Read block 2926 len 32768
29614 279/300 Write block 3695 len 16384 data: 4 3 4 5
29615 280/300 Flush
29616 281/300 Read block 1860 len 36864
29617 282/300 Read block 140 len 4096
29618 283/300 Read block 1978 len 20480
29619 284/300 Write block 3308 len 24576 data: 6 5 6 7 6 6
29620 285/300 Read block 970 len 12288
29621 286/300 Read block 1779 len 32768
29622 287/300 Write block 1985 len 16384 data: 5 6 7 8
29623 288/300 Write block 3527 len 4096 data: 4
29624 289/300 Write block 1449 len 24576 data: 6 8 8 7 6 6
29625 290/300 Read block 1748 len 16384
29626 291/300 Read block 4084 len 8192
29627 292/300 Write block 4034 len 40960 data: 3 4 3 2 2 3 4 6 8 7
29628 293/300 Write block 2623 len 28672 data: 7 7 7 6 7 5 5
29629 294/300 Flush
29630 295/300 Write block 3303 len 12288 data: 5 3 4
29631 296/300 Read block 61 len 24576
29632 297/300 Write block 2740 len 32768 data: 4 5 6 6 6 6 6 5
29633 298/300 Read block 4756 len 32768
29634 299/300 Write block 1278 len 20480 data: 3 3 4 3 4
29635 300/300 Read block 4491 len 8192
29636 Main task has work to do, go find it
29637 got dsc Start(0)
29638 start 0
29639 Apr 20 01:11:20.000 INFO request completed, latency_us: 202, response_code: 204, uri: /start/cid/0, method: POST, req_id: 7f213e67-6849-4bde-bdf6-c12d82c18e95, remote_addr: 127.0.0.1:60352, local_addr: 127.0.0.1:9998
29640 Replay: started 0, returned:Ok(())
29641 ----------------------------------------------------------------
29642 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:300
29643 States: Offline Active Active
29644 GW_ID ACK DSID TYPE BLOCKS DS:0 DS:1 DS:2 REPLAY
29645 7235 Acked 8234 Write 8 New Done Done false
29646 7236 Acked 8235 Read 10 New Done Done false
29647 7237 Acked 8236 Flush 0 New Done Done false
29648 7238 Acked 8237 Read 5 New Done Done false
29649 7239 Acked 8238 Write 9 New Done Done false
29650 7240 Acked 8239 Read 1 New Done Done false
29651 7241 Acked 8240 Write 10 New Done Done false
29652 7242 Acked 8241 Read 10 New Done Done false
29653 7243 Acked 8242 Flush 0 New Done Done false
29654 7244 Acked 8243 Write 9 New Done Done false
29655 7245 Acked 8244 Flush 0 New Done Done false
29656 7246 Acked 8245 Write 4 New Done Done false
29657 7247 Acked 8246 Write 5 New Done Done false
29658 7248 Acked 8247 Read 8 New Done Done false
29659 7249 Acked 8248 Read 6 New Done Done false
29660 7250 Acked 8249 Read 6 New Done Done false
29661 7251 Acked 8250 Read 2 New Done Done false
29662 7252 Acked 8251 Read 7 New Done Done false
29663 7253 Acked 8252 Read 5 New Done Done false
29664 7254 Acked 8253 Write 4 New Done Done false
29665 7255 Acked 8254 Read 10 New Done Done false
29666 7256 Acked 8255 Read 4 New Done Done false
29667 7257 Acked 8256 Read 8 New Done Done false
29668 7258 Acked 8257 Write 7 New Done Done false
29669 7259 Acked 8258 Read 1 New Done Done false
29670 7260 Acked 8259 Write 4 New Done Done false
29671 7261 Acked 8260 Write 2 New Done Done false
29672 7262 Acked 8261 Write 1 New Done Done false
29673 7263 Acked 8262 Flush 0 New Done Done false
29674 7264 Acked 8263 Write 3 New Done Done false
29675 7265 Acked 8264 Read 9 New Done Done false
29676 7266 Acked 8265 Read 8 New Done Done false
29677 7267 Acked 8266 Read 6 New Done Done false
29678 7268 Acked 8267 Read 4 New Done Done false
29679 7269 Acked 8268 Read 9 New Done Done false
29680 7270 Acked 8269 Write 9 New Done Done false
29681 7271 Acked 8270 Flush 0 New Done Done false
29682 7272 Acked 8271 Write 9 New Done Done false
29683 7273 Acked 8272 Write 8 New Done Done false
29684 7274 Acked 8273 Read 10 New Done Done false
29685 7275 Acked 8274 Write 6 New Done Done false
29686 7276 Acked 8275 Read 9 New Done Done false
29687 7277 Acked 8276 Write 5 New Done Done false
29688 7278 Acked 8277 Flush 0 New Done Done false
29689 7279 Acked 8278 Read 5 New Done Done false
29690 7280 Acked 8279 Read 10 New Done Done false
29691 7281 Acked 8280 Read 3 New Done Done false
29692 7282 Acked 8281 Read 7 New Done Done false
29693 7283 Acked 8282 Read 9 New Done Done false
29694 7284 Acked 8283 Read 1 New Done Done false
29695 7285 Acked 8284 Read 3 New Done Done false
29696 7286 Acked 8285 Write 7 New Done Done false
29697 7287 Acked 8286 Read 8 New Done Done false
29698 7288 Acked 8287 Write 2 New Done Done false
29699 7289 Acked 8288 Read 1 New Done Done false
29700 7290 Acked 8289 Write 6 New Done Done false
29701 7291 Acked 8290 Write 9 New Done Done false
29702 7292 Acked 8291 Read 7 New Done Done false
29703 7293 Acked 8292 Read 2 New Done Done false
29704 7294 Acked 8293 Read 1 New Done Done false
29705 7295 Acked 8294 Flush 0 New Done Done false
29706 7296 Acked 8295 Read 3 New Done Done false
29707 7297 Acked 8296 Read 10 New Done Done false
29708 7298 Acked 8297 Read 6 New Done Done false
29709 7299 Acked 8298 Read 3 New Done Done false
29710 7300 Acked 8299 Read 7 New Done Done false
29711 7301 Acked 8300 Read 1 New Done Done false
29712 7302 Acked 8301 Read 4 New Done Done false
29713 7303 Acked 8302 Write 5 New Done Done false
29714 7304 Acked 8303 Read 3 New Done Done false
29715 7305 Acked 8304 Write 2 New Done Done false
29716 7306 Acked 8305 Flush 0 New Done Done false
29717 7307 Acked 8306 Write 5 New Done Done false
29718 7308 Acked 8307 Write 4 New Done Done false
29719 7309 Acked 8308 Write 8 New Done Done false
29720 7310 Acked 8309 Flush 0 New Done Done false
29721 7311 Acked 8310 Read 7 New Done Done false
29722 7312 Acked 8311 Read 8 New Done Done false
29723 7313 Acked 8312 Write 2 New Done Done false
29724 7314 Acked 8313 Flush 0 New Done Done false
29725 7315 Acked 8314 Read 1 New Done Done false
29726 7316 Acked 8315 Read 10 New Done Done false
29727 7317 Acked 8316 Read 9 New Done Done false
29728 7318 Acked 8317 Read 8 New Done Done false
29729 7319 Acked 8318 Write 8 New Done Done false
29730 7320 Acked 8319 Read 10 New Done Done false
29731 7321 Acked 8320 Write 6 New Done Done false
29732 7322 Acked 8321 Read 7 New Done Done false
29733 7323 Acked 8322 Write 4 New Done Done false
29734 7324 Acked 8323 Write 1 New Done Done false
29735 7325 Acked 8324 Read 10 New Done Done false
29736 7326 Acked 8325 Write 9 New Done Done false
29737 7327 Acked 8326 Flush 0 New Done Done false
29738 7328 Acked 8327 Write 1 New Done Done false
29739 7329 Acked 8328 Write 6 New Done Done false
29740 7330 Acked 8329 Read 8 New Done Done false
29741 7331 Acked 8330 Read 3 New Done Done false
29742 7332 Acked 8331 Write 7 New Done Done false
29743 7333 Acked 8332 Write 5 New Done Done false
29744 7334 Acked 8333 Write 3 New Done Done false
29745 7335 Acked 8334 Read 1 New Done Done false
29746 7336 Acked 8335 Read 8 New Done Done false
29747 7337 Acked 8336 Read 2 New Done Done false
29748 7338 Acked 8337 Read 5 New Done Done false
29749 7339 Acked 8338 Write 6 New Done Done false
29750 7340 Acked 8339 Write 7 New Done Done false
29751 7341 Acked 8340 Read 1 New Done Done false
29752 7342 Acked 8341 Read 5 New Done Done false
29753 7343 Acked 8342 Read 7 New Done Done false
29754 7344 Acked 8343 Write 10 New Done Done false
29755 7345 Acked 8344 Read 8 New Done Done false
29756 7346 Acked 8345 Read 3 New Done Done false
29757 7347 Acked 8346 Write 10 New Done Done false
29758 7348 Acked 8347 Write 6 New Done Done false
29759 7349 Acked 8348 Write 5 New Done Done false
29760 7350 Acked 8349 Read 5 New Done Done false
29761 7351 Acked 8350 Write 5 New Done Done false
29762 7352 Acked 8351 Read 6 New Done Done false
29763 7353 Acked 8352 Read 8 New Done Done false
29764 7354 Acked 8353 Read 6 New Done Done false
29765 7355 Acked 8354 Read 4 New Done Done false
29766 7356 Acked 8355 Write 4 New Done Done false
29767 7357 Acked 8356 Read 7 New Done Done false
29768 7358 Acked 8357 Read 5 New Done Done false
29769 7359 Acked 8358 Write 2 New Done Done false
29770 7360 Acked 8359 Write 7 New Done Done false
29771 7361 Acked 8360 Flush 0 New Done Done false
29772 7362 Acked 8361 Write 5 New Done Done false
29773 7363 Acked 8362 Read 1 New Done Done false
29774 7364 Acked 8363 Read 4 New Done Done false
29775 7365 Acked 8364 Write 1 New Done Done false
29776 7366 Acked 8365 Flush 0 New Done Done false
29777 7367 Acked 8366 Write 4 New Done Done false
29778 7368 Acked 8367 Read 5 New Done Done false
29779 7369 Acked 8368 Write 3 New Done Done false
29780 7370 Acked 8369 Read 8 New Done Done false
29781 7371 Acked 8370 Write 5 New Done Done false
29782 7372 Acked 8371 Flush 0 New Done Done false
29783 7373 Acked 8372 Read 2 New Done Done false
29784 7374 Acked 8373 Read 4 New Done Done false
29785 7375 Acked 8374 Write 6 New Done Done false
29786 7376 Acked 8375 Read 7 New Done Done false
29787 7377 Acked 8376 Write 6 New Done Done false
29788 7378 Acked 8377 Write 3 New Done Done false
29789 7379 Acked 8378 Read 4 New Done Done false
29790 7380 Acked 8379 Write 6 New Done Done false
29791 7381 Acked 8380 Read 4 New Done Done false
29792 7382 Acked 8381 Read 4 New Done Done false
29793 7383 Acked 8382 Read 10 New Done Done false
29794 7384 Acked 8383 Read 9 New Done Done false
29795 7385 Acked 8384 Read 3 New Done Done false
29796 7386 Acked 8385 Read 3 New Done Done false
29797 7387 Acked 8386 Write 3 New Done Done false
29798 7388 Acked 8387 Flush 0 New Done Done false
29799 7389 Acked 8388 Read 10 New Done Done false
29800 7390 Acked 8389 Read 1 New Done Done false
29801 7391 Acked 8390 Read 4 New Done Done false
29802 7392 Acked 8391 Write 7 New Done Done false
29803 7393 Acked 8392 Read 10 New Done Done false
29804 7394 Acked 8393 Write 4 New Done Done false
29805 7395 Acked 8394 Read 4 New Done Done false
29806 7396 Acked 8395 Write 1 New Done Done false
29807 7397 Acked 8396 Read 5 New Done Done false
29808 7398 Acked 8397 Read 7 New Done Done false
29809 7399 Acked 8398 Read 7 New Done Done false
29810 7400 Acked 8399 Read 2 New Done Done false
29811 7401 Acked 8400 Read 7 New Done Done false
29812 7402 Acked 8401 Flush 0 New Done Done false
29813 7403 Acked 8402 Read 2 New Done Done false
29814 7404 Acked 8403 Write 4 New Done Done false
29815 7405 Acked 8404 Flush 0 New Done Done false
29816 7406 Acked 8405 Read 7 New Done Done false
29817 7407 Acked 8406 Write 10 New Done Done false
29818 7408 Acked 8407 Write 3 New Done Done false
29819 7409 Acked 8408 Flush 0 New Done Done false
29820 7410 Acked 8409 Flush 0 New Done Done false
29821 7411 Acked 8410 Write 2 New Done Done false
29822 7412 Acked 8411 Read 8 New Done Done false
29823 7413 Acked 8412 Read 3 New Done Done false
29824 7414 Acked 8413 Read 2 New Done Done false
29825 7415 Acked 8414 Read 6 New Done Done false
29826 7416 Acked 8415 Flush 0 New Done Done false
29827 7417 Acked 8416 Write 5 New Done Done false
29828 7418 Acked 8417 Read 3 New Done Done false
29829 7419 Acked 8418 Write 9 New Done Done false
29830 7420 Acked 8419 Read 7 New Done Done false
29831 7421 Acked 8420 Flush 0 New Done Done false
29832 7422 Acked 8421 Write 4 New Done Done false
29833 7423 Acked 8422 Read 9 New Done Done false
29834 7424 Acked 8423 Read 3 New Done Done false
29835 7425 Acked 8424 Write 8 New Done Done false
29836 7426 Acked 8425 Write 6 New Done Done false
29837 7427 Acked 8426 Write 1 New Done Done false
29838 7428 Acked 8427 Read 7 New Done Done false
29839 7429 Acked 8428 Read 3 New Done Done false
29840 7430 Acked 8429 Write 2 New Done Done false
29841 7431 Acked 8430 Write 5 New Done Done false
29842 7432 Acked 8431 Write 8 New Done Done false
29843 7433 Acked 8432 Write 8 New Done Done false
29844 7434 Acked 8433 Read 4 New Done Done false
29845 7435 Acked 8434 Write 6 New Done Done false
29846 7436 Acked 8435 Write 5 New Done Done false
29847 7437 Acked 8436 Write 1 New Done Done false
29848 7438 Acked 8437 Flush 0 New Done Done false
29849 7439 Acked 8438 Read 2 New Done Done false
29850 7440 Acked 8439 Write 1 New Done Done false
29851 7441 Acked 8440 Read 1 New Done Done false
29852 7442 Acked 8441 Read 8 New Done Done false
29853 7443 Acked 8442 Write 3 New Done Done false
29854 7444 Acked 8443 Read 9 New Done Done false
29855 7445 Acked 8444 Write 6 New Done Done false
29856 7446 Acked 8445 Write 5 New Done Done false
29857 7447 Acked 8446 Read 5 New Done Done false
29858 7448 Acked 8447 Read 5 New Done Done false
29859 7449 Acked 8448 Write 1 New Done Done false
29860 7450 Acked 8449 Write 3 New Done Done false
29861 7451 Acked 8450 Write 2 New Done Done false
29862 7452 Acked 8451 Read 6 New Done Done false
29863 7453 Acked 8452 Write 8 New Done Done false
29864 7454 Acked 8453 Write 1 New Done Done false
29865 7455 Acked 8454 Flush 0 New Done Done false
29866 7456 Acked 8455 Write 1 New Done Done false
29867 7457 Acked 8456 Flush 0 New Done Done false
29868 7458 Acked 8457 Write 1 New Done Done false
29869 7459 Acked 8458 Read 7 New Done Done false
29870 7460 Acked 8459 Write 7 New Done Done false
29871 7461 Acked 8460 Write 6 New Done Done false
29872 7462 Acked 8461 Read 8 New Done Done false
29873 7463 Acked 8462 Flush 0 New Done Done false
29874 7464 Acked 8463 Write 1 New Done Done false
29875 7465 Acked 8464 Read 3 New Done Done false
29876 7466 Acked 8465 Read 7 New Done Done false
29877 7467 Acked 8466 Read 9 New Done Done false
29878 7468 Acked 8467 Read 2 New Done Done false
29879 7469 Acked 8468 Read 4 New Done Done false
29880 7470 Acked 8469 Write 10 New Done Done false
29881 7471 Acked 8470 Write 7 New Done Done false
29882 7472 Acked 8471 Write 1 New Done Done false
29883 7473 Acked 8472 Read 4 New Done Done false
29884 7474 Acked 8473 Read 9 New Done Done false
29885 7475 Acked 8474 Read 6 New Done Done false
29886 7476 Acked 8475 Read 6 New Done Done false
29887 7477 Acked 8476 Read 9 New Done Done false
29888 7478 Acked 8477 Write 8 New Done Done false
29889 7479 Acked 8478 Write 2 New Done Done false
29890 7480 Acked 8479 Read 8 New Done Done false
29891 7481 Acked 8480 Read 3 New Done Done false
29892 7482 Acked 8481 Read 5 New Done Done false
29893 7483 Acked 8482 Read 7 New Done Done false
29894 7484 Acked 8483 Write 4 New Done Done false
29895 7485 Acked 8484 Write 4 New Done Done false
29896 7486 Acked 8485 Flush 0 New Done Done false
29897 7487 Acked 8486 Write 1 New Done Done false
29898 7488 Acked 8487 Read 6 New Done Done false
29899 7489 Acked 8488 Read 3 New Done Done false
29900 7490 Acked 8489 Write 6 New Done Done false
29901 7491 Acked 8490 Write 2 New Done Done false
29902 7492 Acked 8491 Write 7 New Done Done false
29903 7493 Acked 8492 Read 4 New Done Done false
29904 7494 Acked 8493 Write 7 New Done Done false
29905 7495 Acked 8494 Write 5 New Done Done false
29906 7496 Acked 8495 Write 3 New Done Done false
29907 7497 Acked 8496 Read 2 New Done Done false
29908 7498 Acked 8497 Write 3 New Done Done false
29909 7499 Acked 8498 Read 8 New Done Done false
29910 7500 Acked 8499 Write 8 New Done Done false
29911 7501 Acked 8500 Flush 0 New Done Done false
29912 7502 Acked 8501 Write 8 New Done Done false
29913 7503 Acked 8502 Read 6 New Done Done false
29914 7504 Acked 8503 Read 9 New Done Done false
29915 7505 Acked 8504 Read 9 New Done Done false
29916 7506 Acked 8505 Read 9 New Done Done false
29917 7507 Acked 8506 Write 8 New Done Done false
29918 7508 Acked 8507 Read 9 New Done Done false
29919 7509 Acked 8508 Read 3 New Done Done false
29920 7510 Acked 8509 Read 1 New Done Done false
29921 7511 Acked 8510 Read 5 New Done Done false
29922 7512 Acked 8511 Read 8 New Done Done false
29923 7513 Acked 8512 Write 4 New Done Done false
29924 7514 Acked 8513 Flush 0 New Done Done false
29925 7515 Acked 8514 Read 9 New Done Done false
29926 7516 Acked 8515 Read 1 New Done Done false
29927 7517 Acked 8516 Read 5 New Done Done false
29928 7518 Acked 8517 Write 6 New Done Done false
29929 7519 Acked 8518 Read 3 New Done Done false
29930 7520 Acked 8519 Read 8 New Done Done false
29931 7521 Acked 8520 Write 4 New Done Done false
29932 7522 Acked 8521 Write 1 New Done Done false
29933 7523 Acked 8522 Write 6 New Done Done false
29934 7524 Acked 8523 Read 4 New Done Done false
29935 7525 Acked 8524 Read 2 New Done Done false
29936 7526 Acked 8525 Write 10 New Done Done false
29937 7527 Acked 8526 Write 7 New Done Done false
29938 7528 Acked 8527 Flush 0 New Done Done false
29939 7529 Acked 8528 Write 3 New Done Done false
29940 7530 Acked 8529 Read 6 New Done Done false
29941 7531 Acked 8530 Write 8 New Done Done false
29942 7532 Acked 8531 Read 8 New Done Done false
29943 7533 Acked 8532 Write 5 New Done Done false
29944 7534 Acked 8533 Read 2 New Done Done false
29945 STATES DS:0 DS:1 DS:2 TOTAL
29946 New 300 0 0 300
29947 Sent 0 0 0 0
29948 Done 0 300 300 600
29949 Skipped 0 0 0 0
29950 Error 0 0 0 0
29951 Last Flush: 8233 8527 8527
29952 Downstairs last five completed: 8233 8232 8231 8230 8229
29953 Upstairs last five completed: 7534 7533 7532 7531 7530
29954 CLIENT: Up:0 ds:300 act:2
29955 [8810] got start action
29956 [8810] I am going to restart
29957 Starting downstairs at port 8810
29958 Make output file at "/tmp/dsc/downstairs-8810.txt"
29959 [8810][0] reports Starting
29960 Downstairs /var/tmp/dsc/region/8810 port 8810 PID:Some(1221)
29961 [8810][0] reports Running
29962 ----------------------------------------------------------------
29963 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:301
29964 States: Offline Active Active
29965 GW_ID ACK DSID TYPE BLOCKS DS:0 DS:1 DS:2 REPLAY
29966 7235 Acked 8234 Write 8 New Done Done false
29967 7236 Acked 8235 Read 10 New Done Done false
29968 7237 Acked 8236 Flush 0 New Done Done false
29969 7238 Acked 8237 Read 5 New Done Done false
29970 7239 Acked 8238 Write 9 New Done Done false
29971 7240 Acked 8239 Read 1 New Done Done false
29972 7241 Acked 8240 Write 10 New Done Done false
29973 7242 Acked 8241 Read 10 New Done Done false
29974 7243 Acked 8242 Flush 0 New Done Done false
29975 7244 Acked 8243 Write 9 New Done Done false
29976 7245 Acked 8244 Flush 0 New Done Done false
29977 7246 Acked 8245 Write 4 New Done Done false
29978 7247 Acked 8246 Write 5 New Done Done false
29979 7248 Acked 8247 Read 8 New Done Done false
29980 7249 Acked 8248 Read 6 New Done Done false
29981 7250 Acked 8249 Read 6 New Done Done false
29982 7251 Acked 8250 Read 2 New Done Done false
29983 7252 Acked 8251 Read 7 New Done Done false
29984 7253 Acked 8252 Read 5 New Done Done false
29985 7254 Acked 8253 Write 4 New Done Done false
29986 7255 Acked 8254 Read 10 New Done Done false
29987 7256 Acked 8255 Read 4 New Done Done false
29988 7257 Acked 8256 Read 8 New Done Done false
29989 7258 Acked 8257 Write 7 New Done Done false
29990 7259 Acked 8258 Read 1 New Done Done false
29991 7260 Acked 8259 Write 4 New Done Done false
29992 7261 Acked 8260 Write 2 New Done Done false
29993 7262 Acked 8261 Write 1 New Done Done false
29994 7263 Acked 8262 Flush 0 New Done Done false
29995 7264 Acked 8263 Write 3 New Done Done false
29996 7265 Acked 8264 Read 9 New Done Done false
29997 7266 Acked 8265 Read 8 New Done Done false
29998 7267 Acked 8266 Read 6 New Done Done false
29999 7268 Acked 8267 Read 4 New Done Done false
30000 7269 Acked 8268 Read 9 New Done Done false
30001 7270 Acked 8269 Write 9 New Done Done false
30002 7271 Acked 8270 Flush 0 New Done Done false
30003 7272 Acked 8271 Write 9 New Done Done false
30004 7273 Acked 8272 Write 8 New Done Done false
30005 7274 Acked 8273 Read 10 New Done Done false
30006 7275 Acked 8274 Write 6 New Done Done false
30007 7276 Acked 8275 Read 9 New Done Done false
30008 7277 Acked 8276 Write 5 New Done Done false
30009 7278 Acked 8277 Flush 0 New Done Done false
30010 7279 Acked 8278 Read 5 New Done Done false
30011 7280 Acked 8279 Read 10 New Done Done false
30012 7281 Acked 8280 Read 3 New Done Done false
30013 7282 Acked 8281 Read 7 New Done Done false
30014 7283 Acked 8282 Read 9 New Done Done false
30015 7284 Acked 8283 Read 1 New Done Done false
30016 7285 Acked 8284 Read 3 New Done Done false
30017 7286 Acked 8285 Write 7 New Done Done false
30018 7287 Acked 8286 Read 8 New Done Done false
30019 7288 Acked 8287 Write 2 New Done Done false
30020 7289 Acked 8288 Read 1 New Done Done false
30021 7290 Acked 8289 Write 6 New Done Done false
30022 7291 Acked 8290 Write 9 New Done Done false
30023 7292 Acked 8291 Read 7 New Done Done false
30024 7293 Acked 8292 Read 2 New Done Done false
30025 7294 Acked 8293 Read 1 New Done Done false
30026 7295 Acked 8294 Flush 0 New Done Done false
30027 7296 Acked 8295 Read 3 New Done Done false
30028 7297 Acked 8296 Read 10 New Done Done false
30029 7298 Acked 8297 Read 6 New Done Done false
30030 7299 Acked 8298 Read 3 New Done Done false
30031 7300 Acked 8299 Read 7 New Done Done false
30032 7301 Acked 8300 Read 1 New Done Done false
30033 7302 Acked 8301 Read 4 New Done Done false
30034 7303 Acked 8302 Write 5 New Done Done false
30035 7304 Acked 8303 Read 3 New Done Done false
30036 7305 Acked 8304 Write 2 New Done Done false
30037 7306 Acked 8305 Flush 0 New Done Done false
30038 7307 Acked 8306 Write 5 New Done Done false
30039 7308 Acked 8307 Write 4 New Done Done false
30040 7309 Acked 8308 Write 8 New Done Done false
30041 7310 Acked 8309 Flush 0 New Done Done false
30042 7311 Acked 8310 Read 7 New Done Done false
30043 7312 Acked 8311 Read 8 New Done Done false
30044 7313 Acked 8312 Write 2 New Done Done false
30045 7314 Acked 8313 Flush 0 New Done Done false
30046 7315 Acked 8314 Read 1 New Done Done false
30047 7316 Acked 8315 Read 10 New Done Done false
30048 7317 Acked 8316 Read 9 New Done Done false
30049 7318 Acked 8317 Read 8 New Done Done false
30050 7319 Acked 8318 Write 8 New Done Done false
30051 7320 Acked 8319 Read 10 New Done Done false
30052 7321 Acked 8320 Write 6 New Done Done false
30053 7322 Acked 8321 Read 7 New Done Done false
30054 7323 Acked 8322 Write 4 New Done Done false
30055 7324 Acked 8323 Write 1 New Done Done false
30056 7325 Acked 8324 Read 10 New Done Done false
30057 7326 Acked 8325 Write 9 New Done Done false
30058 7327 Acked 8326 Flush 0 New Done Done false
30059 7328 Acked 8327 Write 1 New Done Done false
30060 7329 Acked 8328 Write 6 New Done Done false
30061 7330 Acked 8329 Read 8 New Done Done false
30062 7331 Acked 8330 Read 3 New Done Done false
30063 7332 Acked 8331 Write 7 New Done Done false
30064 7333 Acked 8332 Write 5 New Done Done false
30065 7334 Acked 8333 Write 3 New Done Done false
30066 7335 Acked 8334 Read 1 New Done Done false
30067 7336 Acked 8335 Read 8 New Done Done false
30068 7337 Acked 8336 Read 2 New Done Done false
30069 7338 Acked 8337 Read 5 New Done Done false
30070 7339 Acked 8338 Write 6 New Done Done false
30071 7340 Acked 8339 Write 7 New Done Done false
30072 7341 Acked 8340 Read 1 New Done Done false
30073 7342 Acked 8341 Read 5 New Done Done false
30074 7343 Acked 8342 Read 7 New Done Done false
30075 7344 Acked 8343 Write 10 New Done Done false
30076 7345 Acked 8344 Read 8 New Done Done false
30077 7346 Acked 8345 Read 3 New Done Done false
30078 7347 Acked 8346 Write 10 New Done Done false
30079 7348 Acked 8347 Write 6 New Done Done false
30080 7349 Acked 8348 Write 5 New Done Done false
30081 7350 Acked 8349 Read 5 New Done Done false
30082 7351 Acked 8350 Write 5 New Done Done false
30083 7352 Acked 8351 Read 6 New Done Done false
30084 7353 Acked 8352 Read 8 New Done Done false
30085 7354 Acked 8353 Read 6 New Done Done false
30086 7355 Acked 8354 Read 4 New Done Done false
30087 7356 Acked 8355 Write 4 New Done Done false
30088 7357 Acked 8356 Read 7 New Done Done false
30089 7358 Acked 8357 Read 5 New Done Done false
30090 7359 Acked 8358 Write 2 New Done Done false
30091 7360 Acked 8359 Write 7 New Done Done false
30092 7361 Acked 8360 Flush 0 New Done Done false
30093 7362 Acked 8361 Write 5 New Done Done false
30094 7363 Acked 8362 Read 1 New Done Done false
30095 7364 Acked 8363 Read 4 New Done Done false
30096 7365 Acked 8364 Write 1 New Done Done false
30097 7366 Acked 8365 Flush 0 New Done Done false
30098 7367 Acked 8366 Write 4 New Done Done false
30099 7368 Acked 8367 Read 5 New Done Done false
30100 7369 Acked 8368 Write 3 New Done Done false
30101 7370 Acked 8369 Read 8 New Done Done false
30102 7371 Acked 8370 Write 5 New Done Done false
30103 7372 Acked 8371 Flush 0 New Done Done false
30104 7373 Acked 8372 Read 2 New Done Done false
30105 7374 Acked 8373 Read 4 New Done Done false
30106 7375 Acked 8374 Write 6 New Done Done false
30107 7376 Acked 8375 Read 7 New Done Done false
30108 7377 Acked 8376 Write 6 New Done Done false
30109 7378 Acked 8377 Write 3 New Done Done false
30110 7379 Acked 8378 Read 4 New Done Done false
30111 7380 Acked 8379 Write 6 New Done Done false
30112 7381 Acked 8380 Read 4 New Done Done false
30113 7382 Acked 8381 Read 4 New Done Done false
30114 7383 Acked 8382 Read 10 New Done Done false
30115 7384 Acked 8383 Read 9 New Done Done false
30116 7385 Acked 8384 Read 3 New Done Done false
30117 7386 Acked 8385 Read 3 New Done Done false
30118 7387 Acked 8386 Write 3 New Done Done false
30119 7388 Acked 8387 Flush 0 New Done Done false
30120 7389 Acked 8388 Read 10 New Done Done false
30121 7390 Acked 8389 Read 1 New Done Done false
30122 7391 Acked 8390 Read 4 New Done Done false
30123 7392 Acked 8391 Write 7 New Done Done false
30124 7393 Acked 8392 Read 10 New Done Done false
30125 7394 Acked 8393 Write 4 New Done Done false
30126 7395 Acked 8394 Read 4 New Done Done false
30127 7396 Acked 8395 Write 1 New Done Done false
30128 7397 Acked 8396 Read 5 New Done Done false
30129 7398 Acked 8397 Read 7 New Done Done false
30130 7399 Acked 8398 Read 7 New Done Done false
30131 7400 Acked 8399 Read 2 New Done Done false
30132 7401 Acked 8400 Read 7 New Done Done false
30133 7402 Acked 8401 Flush 0 New Done Done false
30134 7403 Acked 8402 Read 2 New Done Done false
30135 7404 Acked 8403 Write 4 New Done Done false
30136 7405 Acked 8404 Flush 0 New Done Done false
30137 7406 Acked 8405 Read 7 New Done Done false
30138 7407 Acked 8406 Write 10 New Done Done false
30139 7408 Acked 8407 Write 3 New Done Done false
30140 7409 Acked 8408 Flush 0 New Done Done false
30141 7410 Acked 8409 Flush 0 New Done Done false
30142 7411 Acked 8410 Write 2 New Done Done false
30143 7412 Acked 8411 Read 8 New Done Done false
30144 7413 Acked 8412 Read 3 New Done Done false
30145 7414 Acked 8413 Read 2 New Done Done false
30146 7415 Acked 8414 Read 6 New Done Done false
30147 7416 Acked 8415 Flush 0 New Done Done false
30148 7417 Acked 8416 Write 5 New Done Done false
30149 7418 Acked 8417 Read 3 New Done Done false
30150 7419 Acked 8418 Write 9 New Done Done false
30151 7420 Acked 8419 Read 7 New Done Done false
30152 7421 Acked 8420 Flush 0 New Done Done false
30153 7422 Acked 8421 Write 4 New Done Done false
30154 7423 Acked 8422 Read 9 New Done Done false
30155 7424 Acked 8423 Read 3 New Done Done false
30156 7425 Acked 8424 Write 8 New Done Done false
30157 7426 Acked 8425 Write 6 New Done Done false
30158 7427 Acked 8426 Write 1 New Done Done false
30159 7428 Acked 8427 Read 7 New Done Done false
30160 7429 Acked 8428 Read 3 New Done Done false
30161 7430 Acked 8429 Write 2 New Done Done false
30162 7431 Acked 8430 Write 5 New Done Done false
30163 7432 Acked 8431 Write 8 New Done Done false
30164 7433 Acked 8432 Write 8 New Done Done false
30165 7434 Acked 8433 Read 4 New Done Done false
30166 7435 Acked 8434 Write 6 New Done Done false
30167 7436 Acked 8435 Write 5 New Done Done false
30168 7437 Acked 8436 Write 1 New Done Done false
30169 7438 Acked 8437 Flush 0 New Done Done false
30170 7439 Acked 8438 Read 2 New Done Done false
30171 7440 Acked 8439 Write 1 New Done Done false
30172 7441 Acked 8440 Read 1 New Done Done false
30173 7442 Acked 8441 Read 8 New Done Done false
30174 7443 Acked 8442 Write 3 New Done Done false
30175 7444 Acked 8443 Read 9 New Done Done false
30176 7445 Acked 8444 Write 6 New Done Done false
30177 7446 Acked 8445 Write 5 New Done Done false
30178 7447 Acked 8446 Read 5 New Done Done false
30179 7448 Acked 8447 Read 5 New Done Done false
30180 7449 Acked 8448 Write 1 New Done Done false
30181 7450 Acked 8449 Write 3 New Done Done false
30182 7451 Acked 8450 Write 2 New Done Done false
30183 7452 Acked 8451 Read 6 New Done Done false
30184 7453 Acked 8452 Write 8 New Done Done false
30185 7454 Acked 8453 Write 1 New Done Done false
30186 7455 Acked 8454 Flush 0 New Done Done false
30187 7456 Acked 8455 Write 1 New Done Done false
30188 7457 Acked 8456 Flush 0 New Done Done false
30189 7458 Acked 8457 Write 1 New Done Done false
30190 7459 Acked 8458 Read 7 New Done Done false
30191 7460 Acked 8459 Write 7 New Done Done false
30192 7461 Acked 8460 Write 6 New Done Done false
30193 7462 Acked 8461 Read 8 New Done Done false
30194 7463 Acked 8462 Flush 0 New Done Done false
30195 7464 Acked 8463 Write 1 New Done Done false
30196 7465 Acked 8464 Read 3 New Done Done false
30197 7466 Acked 8465 Read 7 New Done Done false
30198 7467 Acked 8466 Read 9 New Done Done false
30199 7468 Acked 8467 Read 2 New Done Done false
30200 7469 Acked 8468 Read 4 New Done Done false
30201 7470 Acked 8469 Write 10 New Done Done false
30202 7471 Acked 8470 Write 7 New Done Done false
30203 7472 Acked 8471 Write 1 New Done Done false
30204 7473 Acked 8472 Read 4 New Done Done false
30205 7474 Acked 8473 Read 9 New Done Done false
30206 7475 Acked 8474 Read 6 New Done Done false
30207 7476 Acked 8475 Read 6 New Done Done false
30208 7477 Acked 8476 Read 9 New Done Done false
30209 7478 Acked 8477 Write 8 New Done Done false
30210 7479 Acked 8478 Write 2 New Done Done false
30211 7480 Acked 8479 Read 8 New Done Done false
30212 7481 Acked 8480 Read 3 New Done Done false
30213 7482 Acked 8481 Read 5 New Done Done false
30214 7483 Acked 8482 Read 7 New Done Done false
30215 7484 Acked 8483 Write 4 New Done Done false
30216 7485 Acked 8484 Write 4 New Done Done false
30217 7486 Acked 8485 Flush 0 New Done Done false
30218 7487 Acked 8486 Write 1 New Done Done false
30219 7488 Acked 8487 Read 6 New Done Done false
30220 7489 Acked 8488 Read 3 New Done Done false
30221 7490 Acked 8489 Write 6 New Done Done false
30222 7491 Acked 8490 Write 2 New Done Done false
30223 7492 Acked 8491 Write 7 New Done Done false
30224 7493 Acked 8492 Read 4 New Done Done false
30225 7494 Acked 8493 Write 7 New Done Done false
30226 7495 Acked 8494 Write 5 New Done Done false
30227 7496 Acked 8495 Write 3 New Done Done false
30228 7497 Acked 8496 Read 2 New Done Done false
30229 7498 Acked 8497 Write 3 New Done Done false
30230 7499 Acked 8498 Read 8 New Done Done false
30231 7500 Acked 8499 Write 8 New Done Done false
30232 7501 Acked 8500 Flush 0 New Done Done false
30233 7502 Acked 8501 Write 8 New Done Done false
30234 7503 Acked 8502 Read 6 New Done Done false
30235 7504 Acked 8503 Read 9 New Done Done false
30236 7505 Acked 8504 Read 9 New Done Done false
30237 7506 Acked 8505 Read 9 New Done Done false
30238 7507 Acked 8506 Write 8 New Done Done false
30239 7508 Acked 8507 Read 9 New Done Done false
30240 7509 Acked 8508 Read 3 New Done Done false
30241 7510 Acked 8509 Read 1 New Done Done false
30242 7511 Acked 8510 Read 5 New Done Done false
30243 7512 Acked 8511 Read 8 New Done Done false
30244 7513 Acked 8512 Write 4 New Done Done false
30245 7514 Acked 8513 Flush 0 New Done Done false
30246 7515 Acked 8514 Read 9 New Done Done false
30247 7516 Acked 8515 Read 1 New Done Done false
30248 7517 Acked 8516 Read 5 New Done Done false
30249 7518 Acked 8517 Write 6 New Done Done false
30250 7519 Acked 8518 Read 3 New Done Done false
30251 7520 Acked 8519 Read 8 New Done Done false
30252 7521 Acked 8520 Write 4 New Done Done false
30253 7522 Acked 8521 Write 1 New Done Done false
30254 7523 Acked 8522 Write 6 New Done Done false
30255 7524 Acked 8523 Read 4 New Done Done false
30256 7525 Acked 8524 Read 2 New Done Done false
30257 7526 Acked 8525 Write 10 New Done Done false
30258 7527 Acked 8526 Write 7 New Done Done false
30259 7528 Acked 8527 Flush 0 New Done Done false
30260 7529 Acked 8528 Write 3 New Done Done false
30261 7530 Acked 8529 Read 6 New Done Done false
30262 7531 Acked 8530 Write 8 New Done Done false
30263 7532 Acked 8531 Read 8 New Done Done false
30264 7533 Acked 8532 Write 5 New Done Done false
30265 7534 Acked 8533 Read 2 New Done Done false
30266 7535 Acked 8534 Flush 0 New Done Done false
30267 STATES DS:0 DS:1 DS:2 TOTAL
30268 New 301 0 0 301
30269 Sent 0 0 0 0
30270 Done 0 301 301 602
30271 Skipped 0 0 0 0
30272 Error 0 0 0 0
30273 Last Flush: 8233 8534 8534
30274 Downstairs last five completed: 8233 8232 8231 8230 8229
30275 Upstairs last five completed: 7535 7534 7533 7532 7531
30276 CLIENT: Up:0 ds:301 act:2
302772024-04-20T01:11:25.697ZINFOcrucible: connecting to 127.0.0.1:8810 = io task client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
302782024-04-20T01:11:25.697ZINFOcrucible: ds_connection connected from Ok(127.0.0.1:59571) = io task client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
302792024-04-20T01:11:25.699ZINFOcrucible: downstairs client at Some(127.0.0.1:8810) has region UUID 12345678-0000-0000-0000-000000008810 = downstairs client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
302802024-04-20T01:11:25.699ZINFOcrucible: Returning UUID:12345678-0000-0000-0000-000000008810 matches = downstairs client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
302812024-04-20T01:11:25.699ZINFOcrucible: send last flush ID to this DS: 8233 = downstairs client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
302822024-04-20T01:11:25.699ZINFOcrucible: Replied this last flush ID: 8233 = downstairs client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
302832024-04-20T01:11:25.699ZINFOcrucible: ds_transition from Offline to Replay = downstairs client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
302842024-04-20T01:11:25.699ZINFOcrucible: [0] Transition from Offline to Replay = downstairs client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
302852024-04-20T01:11:25.699ZINFOcrucible: ds_transition from Replay to Active = downstairs client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
302862024-04-20T01:11:25.699ZINFOcrucible: [0] Transition from Replay to Active = downstairs client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
30287 ----------------------------------------------------------------
30288 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:0
30289 Downstairs last five completed: 8534 8533 8532 8531 8530
30290 Upstairs last five completed: 7535 7534 7533 7532 7531
30291 CLIENT: Up:0 ds:0 act:3
30292 Replay: All jobs finished, all DS active.
30293 Main task has work to do, go find it
30294 got dsc Stop(0)
30295 stop 0
30296 [8810] Got stop action so:false kr:false
30297 Apr 20 01:11:28.006 INFO request completed, latency_us: 360, response_code: 204, uri: /stop/cid/0, method: POST, req_id: 805b973a-20f3-4a9c-bf26-95e77c38ee13, remote_addr: 127.0.0.1:60352, local_addr: 127.0.0.1:9998
302982024-04-20T01:11:28.006ZWARNcrucible: downstairs disconnected = io task client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
302992024-04-20T01:11:28.006ZWARNcrucible: client task is sending Done(Finished) = io task client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
303002024-04-20T01:11:28.007ZWARNcrucible: downstairs task for 0 stopped due to Finished session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
303012024-04-20T01:11:28.007ZINFOcrucible: Gone missing, transition from Active to Offline = downstairs client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
30302 Apr 20 01:11:28.007 INFO request completed, latency_us: 146, response_code: 200, uri: /state/cid/0, method: GET, req_id: 58ec3fc9-300c-4b52-8b78-12d3b4b05876, remote_addr: 127.0.0.1:60352, local_addr: 127.0.0{"msg":"[0] client re-new 0 jobs since flush 8534","v":0,"name":"crucible","level":30,"time":"2024-04-20T01:11:28.00707321Z","hostname":"w-01HVWGBJP7HK0H9TQ26T6N3X8M","pid":1196,"":"downstairs","":"downstairs","session_id":"132b460a-26a0-4532-b1ab-4f8c07d4c6c7"}
30303 .1:9998
303042024-04-20T01:11:28.007ZINFOcrucible: [0] Marked 0 jobs for replay since flush: 8534 = downstairs session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
303052024-04-20T01:11:28.007ZINFOcrucible: client task is exiting = io task client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
30306 [8810] Exited with: ExitStatus(unix_wait_status(9))
30307 [8810][0] reports Exit
30308 Apr 20 01:11:32.008 INFO request completed, latency_us: 198, response_code: 200, uri: /state/cid/0, method: GET, req_id: 42d8cc98-05da-4e08-af64-d69b58f2ae1b, remote_addr: 127.0.0.1:60352, local_addr: 127.0.0.1:9998
30309 001/300 Read block 3430 len 32768
30310 002/300 Write block 966 len 12288 data: 7 5 5
30311 003/300 Read block 509 len 4096
30312 004/300 Write block 3826 len 32768 data: 3 3 4 4 4 4 4 3
30313 005/300 Read block 2935 len 36864
30314 006/300 Write block 589 len 28672 data: 5 5 5 5 5 6 7
30315 007/300 Flush
30316 008/300 Read block 1331 len 20480
30317 009/300 Flush
30318 010/300 Read block 654 len 20480
30319 011/300 Read block 1139 len 12288
30320 012/300 Write block 3209 len 12288 data: 5 6 7
30321 013/300 Read block 1545 len 20480
30322 014/300 Write block 3066 len 36864 data: 5 5 4 3 3 3 4 4 3
30323 015/300 Read block 3629 len 12288
30324 016/300 Read block 2274 len 24576
30325 017/300 Read block 2942 len 4096
30326 018/300 Write block 2214 len 16384 data: 4 4 3 3
30327 019/300 Write block 4007 len 4096 data: 6
30328 020/300 Read block 2655 len 40960
30329 021/300 Read block 3597 len 24576
30330 022/300 Read block 395 len 24576
30331 023/300 Read block 3298 len 8192
30332 024/300 Read block 309 len 36864
30333 025/300 Write block 1869 len 40960 data: 8 5 5 6 5 7 5 7 3 3
30334 026/300 Write block 242 len 12288 data: 4 5 7
30335 027/300 Read block 124 len 36864
30336 028/300 Read block 2705 len 24576
30337 029/300 Write block 4022 len 16384 data: 6 6 6 6
30338 030/300 Read block 4478 len 12288
30339 031/300 Read block 4075 len 12288
30340 032/300 Read block 1556 len 8192
30341 033/300 Read block 1303 len 16384
30342 034/300 Read block 1886 len 40960
30343 035/300 Write block 2878 len 20480 data: 5 5 5 3 4
30344 036/300 Write block 1841 len 8192 data: 4 4
30345 037/300 Write block 4373 len 36864 data: 4 5 5 4 3 4 4 4 6
30346 038/300 Read block 3280 len 32768
30347 039/300 Read block 4969 len 24576
30348 040/300 Write block 2485 len 20480 data: 2 3 3 3 3
30349 041/300 Write block 2544 len 24576 data: 3 3 3 3 3 3
30350 042/300 Flush
30351 043/300 Read block 2166 len 24576
30352 044/300 Read block 3973 len 8192
30353 045/300 Read block 2640 len 20480
30354 046/300 Flush
30355 047/300 Read block 3301 len 40960
30356 048/300 Read block 3899 len 12288
30357 049/300 Write block 4525 len 16384 data: 4 4 3 4
30358 050/300 Read block 3958 len 16384
30359 051/300 Write block 2325 len 40960 data: 7 7 7 7 6 7 6 7 8 8
30360 052/300 Write block 2708 len 8192 data: 4 3
30361 053/300 Read block 3266 len 4096
30362 054/300 Read block 785 len 28672
30363 055/300 Read block 4634 len 16384
30364 056/300 Write block 4443 len 20480 data: 5 7 7 8 7
30365 057/300 Read block 2362 len 20480
30366 058/300 Read block 4751 len 16384
30367 059/300 Write block 3193 len 12288 data: 4 5 8
30368 060/300 Write block 2679 len 36864 data: 5 5 5 6 5 6 6 6 6
30369 061/300 Read block 1418 len 24576
30370 062/300 Write block 2439 len 24576 data: 7 5 5 4 4 3
30371 063/300 Read block 4685 len 8192
30372 064/300 Write block 3703 len 24576 data: 7 8 6 6 6 7
30373 065/300 Write block 1881 len 20480 data: 3 3 4 3 3
30374 066/300 Read block 406 len 20480
30375 067/300 Write block 4070 len 4096 data: 6
30376 068/300 Read block 4816 len 12288
30377 069/300 Read block 2380 len 36864
30378 070/300 Write block 2178 len 8192 data: 5 3
30379 071/300 Read block 4610 len 36864
30380 072/300 Write block 862 len 24576 data: 5 4 3 4 4 4
30381 073/300 Read block 4103 len 16384
30382 074/300 Read block 186 len 20480
30383 075/300 Read block 1559 len 40960
30384 076/300 Read block 4223 len 20480
30385 077/300 Write block 3017 len 32768 data: 6 6 6 6 7 7 8 8
30386 078/300 Write block 4659 len 36864 data: 5 4 4 6 5 4 5 4 5
30387 079/300 Read block 1672 len 36864
30388 080/300 Read block 608 len 12288
30389 081/300 Read block 1097 len 20480
30390 082/300 Read block 3047 len 8192
30391 083/300 Write block 4668 len 28672 data: 5 5 8 8 6 7 7
30392 084/300 Read block 2581 len 20480
30393 085/300 Write block 1431 len 32768 data: 6 6 6 6 7 6 4 5
30394 086/300 Write block 475 len 8192 data: 4 5
30395 087/300 Read block 4776 len 20480
30396 088/300 Write block 2059 len 24576 data: 9 9 11 9 9 9
30397 089/300 Read block 1319 len 16384
30398 090/300 Read block 1318 len 12288
30399 091/300 Write block 1920 len 8192 data: 4 3
30400 092/300 Write block 4847 len 20480 data: 6 7 6 6 7
30401 093/300 Flush
30402 094/300 Read block 3510 len 8192
30403 095/300 Write block 1998 len 28672 data: 5 4 4 4 5 6 6
30404 096/300 Read block 3950 len 40960
30405 097/300 Write block 2042 len 28672 data: 2 2 2 4 5 5 5
30406 098/300 Read block 1352 len 8192
30407 099/300 Read block 3127 len 20480
30408 100/300 Write block 2316 len 32768 data: 7 6 8 7 7 4 4 4
30409 101/300 Read block 2712 len 16384
30410 102/300 Read block 3660 len 20480
30411 103/300 Read block 2329 len 24576
30412 104/300 Read block 1577 len 32768
30413 105/300 Write block 4758 len 32768 data: 7 6 6 4 4 5 6 6
30414 106/300 Write block 3309 len 32768 data: 6 7 8 7 7 5 5 4
30415 107/300 Write block 2096 len 32768 data: 8 7 6 5 5 7 8 7
30416 108/300 Write block 1379 len 20480 data: 5 6 6 5 4
30417 109/300 Read block 2404 len 28672
30418 110/300 Flush
30419 111/300 Flush
30420 112/300 Read block 2535 len 24576
30421 113/300 Flush
30422 114/300 Read block 1306 len 8192
30423 115/300 Flush
30424 116/300 Read block 4208 len 16384
30425 117/300 Write block 4849 len 16384 data: 7 7 8 7
30426 118/300 Write block 2339 len 36864 data: 5 5 4 4 5 5 6 7 7
30427 119/300 Write block 1163 len 24576 data: 5 5 5 4 4 5
30428 120/300 Read block 2413 len 8192
30429 121/300 Read block 2260 len 12288
30430 122/300 Write block 1459 len 40960 data: 4 3 3 3 2 5 7 7 5 6
30431 123/300 Write block 3753 len 36864 data: 6 6 7 7 6 5 5 4 5
30432 124/300 Read block 722 len 12288
30433 125/300 Write block 602 len 36864 data: 6 5 6 6 4 5 6 5 6
30434 126/300 Read block 4927 len 28672
30435 127/300 Read block 278 len 24576
30436 128/300 Flush
30437 129/300 Flush
30438 130/300 Read block 264 len 4096
30439 131/300 Write block 3757 len 4096 data: 7
30440 132/300 Write block 3434 len 4096 data: 6
30441 133/300 Read block 3029 len 36864
30442 134/300 Read block 2667 len 4096
30443 135/300 Write block 2839 len 28672 data: 7 7 9 8 10 7 8
30444 136/300 Write block 2610 len 28672 data: 5 6 5 6 7 7 11
30445 137/300 Write block 852 len 28672 data: 8 8 6 5 4 5 5
30446 138/300 Write block 151 len 24576 data: 3 3 4 4 3 3
30447 139/300 Write block 4360 len 24576 data: 5 5 5 4 4 4
30448 140/300 Read block 2456 len 36864
30449 141/300 Write block 1110 len 16384 data: 4 6 4 4
30450 142/300 Read block 3661 len 28672
30451 143/300 Read block 4789 len 20480
30452 144/300 Flush
30453 145/300 Write block 1107 len 8192 data: 5 5
30454 146/300 Write block 1668 len 28672 data: 9 8 8 6 4 4 4
30455 147/300 Write block 4184 len 20480 data: 4 4 6 5 5
30456 148/300 Write block 2928 len 16384 data: 3 2 3 5
30457 149/300 Write block 1457 len 8192 data: 4 4
30458 150/300 Read block 1900 len 36864
30459 151/300 Read block 2685 len 28672
30460 152/300 Write block 3742 len 40960 data: 4 5 5 6 7 7 6 7 8 8
30461 153/300 Read block 3054 len 28672
30462 154/300 Write block 3261 len 36864 data: 3 3 3 3 3 4 5 5 6
30463 155/300 Read block 2954 len 36864
30464 156/300 Read block 1738 len 40960
30465 157/300 Write block 2983 len 40960 data: 8 6 6 6 3 5 6 7 7 8
30466 158/300 Write block 1436 len 36864 data: 7 5 6 6 8 10 11 8 8
30467 159/300 Write block 1251 len 16384 data: 3 4 6 6
30468 160/300 Flush
30469 161/300 Write block 2623 len 40960 data: 8 8 8 7 8 6 6 5 4 4
30470 162/300 Write block 4036 len 24576 data: 4 3 3 4 5 7
30471 163/300 Read block 2156 len 20480
30472 164/300 Read block 3548 len 20480
30473 165/300 Write block 4605 len 16384 data: 3 6 7 7
30474 166/300 Read block 1169 len 32768
30475 167/300 Read block 456 len 12288
30476 168/300 Write block 3995 len 4096 data: 4
30477 169/300 Write block 1977 len 8192 data: 4 4
30478 170/300 Read block 3198 len 24576
30479 171/300 Read block 3238 len 20480
30480 172/300 Read block 663 len 8192
30481 173/300 Write block 2479 len 12288 data: 4 3 2
30482 174/300 Read block 1822 len 12288
30483 175/300 Write block 474 len 12288 data: 3 5 6
30484 176/300 Flush
30485 177/300 Read block 2492 len 4096
30486 178/300 Read block 3923 len 12288
30487 179/300 Read block 991 len 8192
30488 180/300 Read block 3491 len 28672
30489 181/300 Read block 3532 len 40960
30490 182/300 Write block 4173 len 8192 data: 6 7
30491 183/300 Write block 2425 len 20480 data: 5 8 6 5 5
30492 184/300 Flush
30493 185/300 Write block 2595 len 16384 data: 3 3 5 5
30494 186/300 Write block 1240 len 4096 data: 3
30495 187/300 Read block 4350 len 20480
30496 188/300 Read block 4039 len 40960
30497 189/300 Write block 3426 len 28672 data: 5 6 6 6 6 7 9
30498 190/300 Flush
30499 191/300 Read block 1853 len 20480
30500 192/300 Read block 959 len 40960
30501 193/300 Write block 76 len 36864 data: 4 3 3 3 2 4 4 5 5
30502 194/300 Read block 4148 len 4096
30503 195/300 Read block 4159 len 20480
30504 196/300 Read block 4347 len 12288
30505 197/300 Read block 2951 len 32768
30506 198/300 Read block 3919 len 4096
30507 199/300 Read block 1668 len 20480
30508 200/300 Read block 316 len 40960
30509 201/300 Read block 105 len 32768
30510 202/300 Flush
30511 203/300 Write block 4439 len 12288 data: 2 2 2
30512 204/300 Write block 3939 len 4096 data: 4
30513 205/300 Read block 4733 len 20480
30514 206/300 Read block 2423 len 16384
30515 207/300 Write block 2284 len 8192 data: 3 4
30516 208/300 Read block 4820 len 20480
30517 209/300 Write block 3573 len 40960 data: 4 4 3 4 4 3 4 4 6 6
30518 210/300 Read block 3856 len 36864
30519 211/300 Read block 1501 len 4096
30520 212/300 Read block 292 len 8192
30521 213/300 Read block 4403 len 8192
30522 214/300 Flush
30523 215/300 Read block 1407 len 20480
30524 216/300 Write block 1354 len 4096 data: 4
30525 217/300 Flush
30526 218/300 Read block 4548 len 24576
30527 219/300 Read block 3411 len 36864
30528 220/300 Flush
30529 221/300 Read block 4273 len 24576
30530 222/300 Write block 3489 len 16384 data: 6 7 8 8
30531 223/300 Read block 3365 len 4096
30532 224/300 Write block 4000 len 40960 data: 7 8 8 9 9 10 8 7 3 4
30533 225/300 Flush
30534 226/300 Read block 4584 len 32768
30535 227/300 Read block 1554 len 4096
30536 228/300 Read block 851 len 40960
30537 229/300 Read block 3624 len 24576
30538 230/300 Read block 744 len 24576
30539 231/300 Write block 2415 len 8192 data: 4 4
30540 232/300 Read block 4931 len 8192
30541 233/300 Read block 2898 len 12288
30542 234/300 Write block 932 len 4096 data: 3
30543 235/300 Read block 3135 len 24576
30544 236/300 Read block 4835 len 36864
30545 237/300 Read block 1698 len 12288
30546 238/300 Read block 4453 len 8192
30547 239/300 Read block 1763 len 12288
30548 240/300 Read block 3086 len 12288
30549 241/300 Read block 3531 len 32768
30550 242/300 Write block 1352 len 16384 data: 6 5 5 4
30551 243/300 Write block 4049 len 40960 data: 4 5 5 6 7 8 7 5 3 2
30552 244/300 Read block 3460 len 4096
30553 245/300 Read block 3613 len 4096
30554 246/300 Read block 328 len 4096
30555 247/300 Read block 1105 len 8192
30556 248/300 Read block 1818 len 20480
30557 249/300 Write block 3337 len 20480 data: 7 7 10 9 9
30558 250/300 Write block 2275 len 32768 data: 4 3 3 3 3 3 2 2
30559 251/300 Write block 330 len 8192 data: 4 2
30560 252/300 Write block 4784 len 4096 data: 6
30561 253/300 Write block 4039 len 32768 data: 5 6 8 9 8 8 7 6
30562 254/300 Read block 4082 len 24576
30563 255/300 Read block 4651 len 28672
30564 256/300 Flush
30565 257/300 Read block 1457 len 16384
30566 258/300 Write block 1050 len 16384 data: 6 5 6 5
30567 259/300 Read block 4300 len 4096
30568 260/300 Read block 4155 len 28672
30569 261/300 Write block 1323 len 12288 data: 5 6 7
30570 262/300 Write block 2760 len 20480 data: 4 3 3 4 4
30571 263/300 Flush
30572 264/300 Read block 2096 len 40960
30573 265/300 Write block 4254 len 40960 data: 9 9 8 7 8 9 8 8 6 6
30574 266/300 Read block 2614 len 40960
30575 267/300 Read block 4905 len 24576
30576 268/300 Write block 364 len 40960 data: 8 8 7 7 7 5 5 4 4 4
30577 269/300 Write block 3269 len 24576 data: 7 4 5 5 5 5
30578 270/300 Write block 2760 len 40960 data: 5 4 4 5 5 5 8 9 10 9
30579 271/300 Read block 2237 len 20480
30580 272/300 Flush
30581 273/300 Write block 730 len 24576 data: 8 7 5 6 7 7
30582 274/300 Read block 3636 len 24576
30583 275/300 Read block 1016 len 32768
30584 276/300 Flush
30585 277/300 Read block 421 len 40960
30586 278/300 Flush
30587 279/300 Flush
30588 280/300 Flush
30589 281/300 Read block 932 len 12288
30590 282/300 Read block 4082 len 12288
30591 283/300 Write block 733 len 16384 data: 7 8 8 8
30592 284/300 Read block 2535 len 40960
30593 285/300 Write block 4360 len 32768 data: 6 6 6 5 5 5 5 5
30594 286/300 Read block 3951 len 24576
30595 287/300 Read block 2558 len 8192
30596 288/300 Write block 3466 len 4096 data: 5
30597 289/300 Read block 2111 len 40960
30598 290/300 Write block 2106 len 32768 data: 7 5 4 3 5 5 4 4
30599 291/300 Write block 3514 len 28672 data: 6 6 7 7 5 5 5
30600 292/300 Read block 2058 len 40960
30601 293/300 Read block 919 len 4096
30602 294/300 Write block 2039 len 4096 data: 2
30603 295/300 Flush
30604 296/300 Write block 3733 len 4096 data: 5
30605 297/300 Read block 4248 len 40960
30606 298/300 Read block 4374 len 36864
30607 299/300 Write block 4357 len 16384 data: 5 5 5 7
30608 300/300 Write block 2654 len 12288 data: 4 4 4
30609 Main task has work to do, go find it
30610 got dsc Start(0)
30611 start 0
30612 Apr 20 01:11:32.308 INFO request completed, latency_us: 207, response_code: 204, uri: /start/cid/0, method: POST, req_id: 5f1b3e14-6db2-4fc6-81bd-16c921fe2b1f, remote_addr: 127.0.0.1:60352, local_addr: 127.0.0.1:9998
30613 Replay: started 0, returned:Ok(())
30614 ----------------------------------------------------------------
30615 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:301
30616 States: Offline Active Active
30617 GW_ID ACK DSID TYPE BLOCKS DS:0 DS:1 DS:2 REPLAY
30618 7536 Acked 8535 Read 8 New Done Done false
30619 7537 Acked 8536 Write 3 New Done Done false
30620 7538 Acked 8537 Read 1 New Done Done false
30621 7539 Acked 8538 Write 8 New Done Done false
30622 7540 Acked 8539 Read 9 New Done Done false
30623 7541 Acked 8540 Write 7 New Done Done false
30624 7542 Acked 8541 Flush 0 New Done Done false
30625 7543 Acked 8542 Read 5 New Done Done false
30626 7544 Acked 8543 Flush 0 New Done Done false
30627 7545 Acked 8544 Read 5 New Done Done false
30628 7546 Acked 8545 Read 3 New Done Done false
30629 7547 Acked 8546 Write 3 New Done Done false
30630 7548 Acked 8547 Read 5 New Done Done false
30631 7549 Acked 8548 Write 9 New Done Done false
30632 7550 Acked 8549 Read 3 New Done Done false
30633 7551 Acked 8550 Read 6 New Done Done false
30634 7552 Acked 8551 Read 1 New Done Done false
30635 7553 Acked 8552 Write 4 New Done Done false
30636 7554 Acked 8553 Write 1 New Done Done false
30637 7555 Acked 8554 Read 10 New Done Done false
30638 7556 Acked 8555 Read 6 New Done Done false
30639 7557 Acked 8556 Read 6 New Done Done false
30640 7558 Acked 8557 Read 2 New Done Done false
30641 7559 Acked 8558 Read 9 New Done Done false
30642 7560 Acked 8559 Write 10 New Done Done false
30643 7561 Acked 8560 Write 3 New Done Done false
30644 7562 Acked 8561 Read 9 New Done Done false
30645 7563 Acked 8562 Read 6 New Done Done false
30646 7564 Acked 8563 Write 4 New Done Done false
30647 7565 Acked 8564 Read 3 New Done Done false
30648 7566 Acked 8565 Read 3 New Done Done false
30649 7567 Acked 8566 Read 2 New Done Done false
30650 7568 Acked 8567 Read 4 New Done Done false
30651 7569 Acked 8568 Read 10 New Done Done false
30652 7570 Acked 8569 Write 5 New Done Done false
30653 7571 Acked 8570 Write 2 New Done Done false
30654 7572 Acked 8571 Write 9 New Done Done false
30655 7573 Acked 8572 Read 8 New Done Done false
30656 7574 Acked 8573 Read 6 New Done Done false
30657 7575 Acked 8574 Write 5 New Done Done false
30658 7576 Acked 8575 Write 6 New Done Done false
30659 7577 Acked 8576 Flush 0 New Done Done false
30660 7578 Acked 8577 Read 6 New Done Done false
30661 7579 Acked 8578 Read 2 New Done Done false
30662 7580 Acked 8579 Read 5 New Done Done false
30663 7581 Acked 8580 Flush 0 New Done Done false
30664 7582 Acked 8581 Read 10 New Done Done false
30665 7583 Acked 8582 Read 3 New Done Done false
30666 7584 Acked 8583 Write 4 New Done Done false
30667 7585 Acked 8584 Read 4 New Done Done false
30668 7586 Acked 8585 Write 10 New Done Done false
30669 7587 Acked 8586 Write 2 New Done Done false
30670 7588 Acked 8587 Read 1 New Done Done false
30671 7589 Acked 8588 Read 7 New Done Done false
30672 7590 Acked 8589 Read 4 New Done Done false
30673 7591 Acked 8590 Write 5 New Done Done false
30674 7592 Acked 8591 Read 5 New Done Done false
30675 7593 Acked 8592 Read 4 New Done Done false
30676 7594 Acked 8593 Write 3 New Done Done false
30677 7595 Acked 8594 Write 9 New Done Done false
30678 7596 Acked 8595 Read 6 New Done Done false
30679 7597 Acked 8596 Write 6 New Done Done false
30680 7598 Acked 8597 Read 2 New Done Done false
30681 7599 Acked 8598 Write 6 New Done Done false
30682 7600 Acked 8599 Write 5 New Done Done false
30683 7601 Acked 8600 Read 5 New Done Done false
30684 7602 Acked 8601 Write 1 New Done Done false
30685 7603 Acked 8602 Read 3 New Done Done false
30686 7604 Acked 8603 Read 9 New Done Done false
30687 7605 Acked 8604 Write 2 New Done Done false
30688 7606 Acked 8605 Read 9 New Done Done false
30689 7607 Acked 8606 Write 6 New Done Done false
30690 7608 Acked 8607 Read 4 New Done Done false
30691 7609 Acked 8608 Read 5 New Done Done false
30692 7610 Acked 8609 Read 10 New Done Done false
30693 7611 Acked 8610 Read 5 New Done Done false
30694 7612 Acked 8611 Write 8 New Done Done false
30695 7613 Acked 8612 Write 9 New Done Done false
30696 7614 Acked 8613 Read 9 New Done Done false
30697 7615 Acked 8614 Read 3 New Done Done false
30698 7616 Acked 8615 Read 5 New Done Done false
30699 7617 Acked 8616 Read 2 New Done Done false
30700 7618 Acked 8617 Write 7 New Done Done false
30701 7619 Acked 8618 Read 5 New Done Done false
30702 7620 Acked 8619 Write 8 New Done Done false
30703 7621 Acked 8620 Write 2 New Done Done false
30704 7622 Acked 8621 Read 5 New Done Done false
30705 7623 Acked 8622 Write 6 New Done Done false
30706 7624 Acked 8623 Read 4 New Done Done false
30707 7625 Acked 8624 Read 3 New Done Done false
30708 7626 Acked 8625 Write 2 New Done Done false
30709 7627 Acked 8626 Write 5 New Done Done false
30710 7628 Acked 8627 Flush 0 New Done Done false
30711 7629 Acked 8628 Read 2 New Done Done false
30712 7630 Acked 8629 Write 7 New Done Done false
30713 7631 Acked 8630 Read 10 New Done Done false
30714 7632 Acked 8631 Write 7 New Done Done false
30715 7633 Acked 8632 Read 2 New Done Done false
30716 7634 Acked 8633 Read 5 New Done Done false
30717 7635 Acked 8634 Write 8 New Done Done false
30718 7636 Acked 8635 Read 4 New Done Done false
30719 7637 Acked 8636 Read 5 New Done Done false
30720 7638 Acked 8637 Read 6 New Done Done false
30721 7639 Acked 8638 Read 8 New Done Done false
30722 7640 Acked 8639 Write 8 New Done Done false
30723 7641 Acked 8640 Write 8 New Done Done false
30724 7642 Acked 8641 Write 8 New Done Done false
30725 7643 Acked 8642 Write 5 New Done Done false
30726 7644 Acked 8643 Read 7 New Done Done false
30727 7645 Acked 8644 Flush 0 New Done Done false
30728 7646 Acked 8645 Flush 0 New Done Done false
30729 7647 Acked 8646 Read 6 New Done Done false
30730 7648 Acked 8647 Flush 0 New Done Done false
30731 7649 Acked 8648 Read 2 New Done Done false
30732 7650 Acked 8649 Flush 0 New Done Done false
30733 7651 Acked 8650 Read 4 New Done Done false
30734 7652 Acked 8651 Write 4 New Done Done false
30735 7653 Acked 8652 Write 9 New Done Done false
30736 7654 Acked 8653 Write 6 New Done Done false
30737 7655 Acked 8654 Read 2 New Done Done false
30738 7656 Acked 8655 Read 3 New Done Done false
30739 7657 Acked 8656 Write 10 New Done Done false
30740 7658 Acked 8657 Write 9 New Done Done false
30741 7659 Acked 8658 Read 3 New Done Done false
30742 7660 Acked 8659 Write 9 New Done Done false
30743 7661 Acked 8660 Read 7 New Done Done false
30744 7662 Acked 8661 Read 6 New Done Done false
30745 7663 Acked 8662 Flush 0 New Done Done false
30746 7664 Acked 8663 Flush 0 New Done Done false
30747 7665 Acked 8664 Read 1 New Done Done false
30748 7666 Acked 8665 Write 1 New Done Done false
30749 7667 Acked 8666 Write 1 New Done Done false
30750 7668 Acked 8667 Read 9 New Done Done false
30751 7669 Acked 8668 Read 1 New Done Done false
30752 7670 Acked 8669 Write 7 New Done Done false
30753 7671 Acked 8670 Write 7 New Done Done false
30754 7672 Acked 8671 Write 7 New Done Done false
30755 7673 Acked 8672 Write 6 New Done Done false
30756 7674 Acked 8673 Write 6 New Done Done false
30757 7675 Acked 8674 Read 9 New Done Done false
30758 7676 Acked 8675 Write 4 New Done Done false
30759 7677 Acked 8676 Read 7 New Done Done false
30760 7678 Acked 8677 Read 5 New Done Done false
30761 7679 Acked 8678 Flush 0 New Done Done false
30762 7680 Acked 8679 Write 2 New Done Done false
30763 7681 Acked 8680 Write 7 New Done Done false
30764 7682 Acked 8681 Write 5 New Done Done false
30765 7683 Acked 8682 Write 4 New Done Done false
30766 7684 Acked 8683 Write 2 New Done Done false
30767 7685 Acked 8684 Read 9 New Done Done false
30768 7686 Acked 8685 Read 7 New Done Done false
30769 7687 Acked 8686 Write 10 New Done Done false
30770 7688 Acked 8687 Read 7 New Done Done false
30771 7689 Acked 8688 Write 9 New Done Done false
30772 7690 Acked 8689 Read 9 New Done Done false
30773 7691 Acked 8690 Read 10 New Done Done false
30774 7692 Acked 8691 Write 10 New Done Done false
30775 7693 Acked 8692 Write 9 New Done Done false
30776 7694 Acked 8693 Write 4 New Done Done false
30777 7695 Acked 8694 Flush 0 New Done Done false
30778 7696 Acked 8695 Write 10 New Done Done false
30779 7697 Acked 8696 Write 6 New Done Done false
30780 7698 Acked 8697 Read 5 New Done Done false
30781 7699 Acked 8698 Read 5 New Done Done false
30782 7700 Acked 8699 Write 4 New Done Done false
30783 7701 Acked 8700 Read 8 New Done Done false
30784 7702 Acked 8701 Read 3 New Done Done false
30785 7703 Acked 8702 Write 1 New Done Done false
30786 7704 Acked 8703 Write 2 New Done Done false
30787 7705 Acked 8704 Read 6 New Done Done false
30788 7706 Acked 8705 Read 5 New Done Done false
30789 7707 Acked 8706 Read 2 New Done Done false
30790 7708 Acked 8707 Write 3 New Done Done false
30791 7709 Acked 8708 Read 3 New Done Done false
30792 7710 Acked 8709 Write 3 New Done Done false
30793 7711 Acked 8710 Flush 0 New Done Done false
30794 7712 Acked 8711 Read 1 New Done Done false
30795 7713 Acked 8712 Read 3 New Done Done false
30796 7714 Acked 8713 Read 2 New Done Done false
30797 7715 Acked 8714 Read 7 New Done Done false
30798 7716 Acked 8715 Read 10 New Done Done false
30799 7717 Acked 8716 Write 2 New Done Done false
30800 7718 Acked 8717 Write 5 New Done Done false
30801 7719 Acked 8718 Flush 0 New Done Done false
30802 7720 Acked 8719 Write 4 New Done Done false
30803 7721 Acked 8720 Write 1 New Done Done false
30804 7722 Acked 8721 Read 5 New Done Done false
30805 7723 Acked 8722 Read 10 New Done Done false
30806 7724 Acked 8723 Write 7 New Done Done false
30807 7725 Acked 8724 Flush 0 New Done Done false
30808 7726 Acked 8725 Read 5 New Done Done false
30809 7727 Acked 8726 Read 10 New Done Done false
30810 7728 Acked 8727 Write 9 New Done Done false
30811 7729 Acked 8728 Read 1 New Done Done false
30812 7730 Acked 8729 Read 5 New Done Done false
30813 7731 Acked 8730 Read 3 New Done Done false
30814 7732 Acked 8731 Read 8 New Done Done false
30815 7733 Acked 8732 Read 1 New Done Done false
30816 7734 Acked 8733 Read 5 New Done Done false
30817 7735 Acked 8734 Read 10 New Done Done false
30818 7736 Acked 8735 Read 8 New Done Done false
30819 7737 Acked 8736 Flush 0 New Done Done false
30820 7738 Acked 8737 Write 3 New Done Done false
30821 7739 Acked 8738 Write 1 New Done Done false
30822 7740 Acked 8739 Read 5 New Done Done false
30823 7741 Acked 8740 Read 4 New Done Done false
30824 7742 Acked 8741 Write 2 New Done Done false
30825 7743 Acked 8742 Read 5 New Done Done false
30826 7744 Acked 8743 Write 10 New Done Done false
30827 7745 Acked 8744 Read 9 New Done Done false
30828 7746 Acked 8745 Read 1 New Done Done false
30829 7747 Acked 8746 Read 2 New Done Done false
30830 7748 Acked 8747 Read 2 New Done Done false
30831 7749 Acked 8748 Flush 0 New Done Done false
30832 7750 Acked 8749 Read 5 New Done Done false
30833 7751 Acked 8750 Write 1 New Done Done false
30834 7752 Acked 8751 Flush 0 New Done Done false
30835 7753 Acked 8752 Read 6 New Done Done false
30836 7754 Acked 8753 Read 9 New Done Done false
30837 7755 Acked 8754 Flush 0 New Done Done false
30838 7756 Acked 8755 Read 6 New Done Done false
30839 7757 Acked 8756 Write 4 New Done Done false
30840 7758 Acked 8757 Read 1 New Done Done false
30841 7759 Acked 8758 Write 10 New Done Done false
30842 7760 Acked 8759 Flush 0 New Done Done false
30843 7761 Acked 8760 Read 8 New Done Done false
30844 7762 Acked 8761 Read 1 New Done Done false
30845 7763 Acked 8762 Read 10 New Done Done false
30846 7764 Acked 8763 Read 6 New Done Done false
30847 7765 Acked 8764 Read 6 New Done Done false
30848 7766 Acked 8765 Write 2 New Done Done false
30849 7767 Acked 8766 Read 2 New Done Done false
30850 7768 Acked 8767 Read 3 New Done Done false
30851 7769 Acked 8768 Write 1 New Done Done false
30852 7770 Acked 8769 Read 6 New Done Done false
30853 7771 Acked 8770 Read 9 New Done Done false
30854 7772 Acked 8771 Read 3 New Done Done false
30855 7773 Acked 8772 Read 2 New Done Done false
30856 7774 Acked 8773 Read 3 New Done Done false
30857 7775 Acked 8774 Read 3 New Done Done false
30858 7776 Acked 8775 Read 8 New Done Done false
30859 7777 Acked 8776 Write 4 New Done Done false
30860 7778 Acked 8777 Write 10 New Done Done false
30861 7779 Acked 8778 Read 1 New Done Done false
30862 7780 Acked 8779 Read 1 New Done Done false
30863 7781 Acked 8780 Read 1 New Done Done false
30864 7782 Acked 8781 Read 2 New Done Done false
30865 7783 Acked 8782 Read 5 New Done Done false
30866 7784 Acked 8783 Write 5 New Done Done false
30867 7785 Acked 8784 Write 8 New Done Done false
30868 7786 Acked 8785 Write 2 New Done Done false
30869 7787 Acked 8786 Write 1 New Done Done false
30870 7788 Acked 8787 Write 8 New Done Done false
30871 7789 Acked 8788 Read 6 New Done Done false
30872 7790 Acked 8789 Read 7 New Done Done false
30873 7791 Acked 8790 Flush 0 New Done Done false
30874 7792 Acked 8791 Read 4 New Done Done false
30875 7793 Acked 8792 Write 4 New Done Done false
30876 7794 Acked 8793 Read 1 New Done Done false
30877 7795 Acked 8794 Read 7 New Done Done false
30878 7796 Acked 8795 Write 3 New Done Done false
30879 7797 Acked 8796 Write 5 New Done Done false
30880 7798 Acked 8797 Flush 0 New Done Done false
30881 7799 Acked 8798 Read 10 New Done Done false
30882 7800 Acked 8799 Write 10 New Done Done false
30883 7801 Acked 8800 Read 10 New Done Done false
30884 7802 Acked 8801 Read 6 New Done Done false
30885 7803 Acked 8802 Write 10 New Done Done false
30886 7804 Acked 8803 Write 6 New Done Done false
30887 7805 Acked 8804 Write 10 New Done Done false
30888 7806 Acked 8805 Read 5 New Done Done false
30889 7807 Acked 8806 Flush 0 New Done Done false
30890 7808 Acked 8807 Write 6 New Done Done false
30891 7809 Acked 8808 Read 6 New Done Done false
30892 7810 Acked 8809 Read 8 New Done Done false
30893 7811 Acked 8810 Flush 0 New Done Done false
30894 7812 Acked 8811 Read 10 New Done Done false
30895 7813 Acked 8812 Flush 0 New Done Done false
30896 7814 Acked 8813 Flush 0 New Done Done false
30897 7815 Acked 8814 Flush 0 New Done Done false
30898 7816 Acked 8815 Read 3 New Done Done false
30899 7817 Acked 8816 Read 3 New Done Done false
30900 7818 Acked 8817 Write 4 New Done Done false
30901 7819 Acked 8818 Read 10 New Done Done false
30902 7820 Acked 8819 Write 8 New Done Done false
30903 7821 Acked 8820 Read 6 New Done Done false
30904 7822 Acked 8821 Read 2 New Done Done false
30905 7823 Acked 8822 Write 1 New Done Done false
30906 7824 Acked 8823 Read 10 New Done Done false
30907 7825 Acked 8824 Write 8 New Done Done false
30908 7826 Acked 8825 Write 7 New Done Done false
30909 7827 Acked 8826 Read 10 New Done Done false
30910 7828 Acked 8827 Read 1 New Done Done false
30911 7829 Acked 8828 Write 1 New Done Done false
30912 7830 Acked 8829 Flush 0 New Done Done false
30913 7831 Acked 8830 Write 1 New Done Done false
30914 7832 Acked 8831 Read 10 New Done Done false
30915 7833 Acked 8832 Flush 0 New Done Done false
30916 7834 Acked 8833 Read 9 New Done Done false
30917 7835 Acked 8834 Write 4 New Done Done false
30918 7836 Acked 8835 Write 3 New Done Done false
30919 STATES DS:0 DS:1 DS:2 TOTAL
30920 New 301 0 0 301
30921 Sent 0 0 0 0
30922 Done 0 301 301 602
30923 Skipped 0 0 0 0
30924 Error 0 0 0 0
30925 Last Flush: 8534 8832 8832
30926 Downstairs last five completed: 8534 8533 8532 8531 8530
30927 Upstairs last five completed: 7836 7835 7834 7833 7832
30928 CLIENT: Up:0 ds:301 act:2
30929 [8810] got start action
30930 [8810] I am going to restart
30931 Starting downstairs at port 8810
30932 Make output file at "/tmp/dsc/downstairs-8810.txt"
30933 [8810][0] reports Starting
30934 Downstairs /var/tmp/dsc/region/8810 port 8810 PID:Some(1222)
30935 [8810][0] reports Running
30936 ----------------------------------------------------------------
30937 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:302
30938 States: Offline Active Active
30939 GW_ID ACK DSID TYPE BLOCKS DS:0 DS:1 DS:2 REPLAY
30940 7536 Acked 8535 Read 8 New Done Done false
30941 7537 Acked 8536 Write 3 New Done Done false
30942 7538 Acked 8537 Read 1 New Done Done false
30943 7539 Acked 8538 Write 8 New Done Done false
30944 7540 Acked 8539 Read 9 New Done Done false
30945 7541 Acked 8540 Write 7 New Done Done false
30946 7542 Acked 8541 Flush 0 New Done Done false
30947 7543 Acked 8542 Read 5 New Done Done false
30948 7544 Acked 8543 Flush 0 New Done Done false
30949 7545 Acked 8544 Read 5 New Done Done false
30950 7546 Acked 8545 Read 3 New Done Done false
30951 7547 Acked 8546 Write 3 New Done Done false
30952 7548 Acked 8547 Read 5 New Done Done false
30953 7549 Acked 8548 Write 9 New Done Done false
30954 7550 Acked 8549 Read 3 New Done Done false
30955 7551 Acked 8550 Read 6 New Done Done false
30956 7552 Acked 8551 Read 1 New Done Done false
30957 7553 Acked 8552 Write 4 New Done Done false
30958 7554 Acked 8553 Write 1 New Done Done false
30959 7555 Acked 8554 Read 10 New Done Done false
30960 7556 Acked 8555 Read 6 New Done Done false
30961 7557 Acked 8556 Read 6 New Done Done false
30962 7558 Acked 8557 Read 2 New Done Done false
30963 7559 Acked 8558 Read 9 New Done Done false
30964 7560 Acked 8559 Write 10 New Done Done false
30965 7561 Acked 8560 Write 3 New Done Done false
30966 7562 Acked 8561 Read 9 New Done Done false
30967 7563 Acked 8562 Read 6 New Done Done false
30968 7564 Acked 8563 Write 4 New Done Done false
30969 7565 Acked 8564 Read 3 New Done Done false
30970 7566 Acked 8565 Read 3 New Done Done false
30971 7567 Acked 8566 Read 2 New Done Done false
30972 7568 Acked 8567 Read 4 New Done Done false
30973 7569 Acked 8568 Read 10 New Done Done false
30974 7570 Acked 8569 Write 5 New Done Done false
30975 7571 Acked 8570 Write 2 New Done Done false
30976 7572 Acked 8571 Write 9 New Done Done false
30977 7573 Acked 8572 Read 8 New Done Done false
30978 7574 Acked 8573 Read 6 New Done Done false
30979 7575 Acked 8574 Write 5 New Done Done false
30980 7576 Acked 8575 Write 6 New Done Done false
30981 7577 Acked 8576 Flush 0 New Done Done false
30982 7578 Acked 8577 Read 6 New Done Done false
30983 7579 Acked 8578 Read 2 New Done Done false
30984 7580 Acked 8579 Read 5 New Done Done false
30985 7581 Acked 8580 Flush 0 New Done Done false
30986 7582 Acked 8581 Read 10 New Done Done false
30987 7583 Acked 8582 Read 3 New Done Done false
30988 7584 Acked 8583 Write 4 New Done Done false
30989 7585 Acked 8584 Read 4 New Done Done false
30990 7586 Acked 8585 Write 10 New Done Done false
30991 7587 Acked 8586 Write 2 New Done Done false
30992 7588 Acked 8587 Read 1 New Done Done false
30993 7589 Acked 8588 Read 7 New Done Done false
30994 7590 Acked 8589 Read 4 New Done Done false
30995 7591 Acked 8590 Write 5 New Done Done false
30996 7592 Acked 8591 Read 5 New Done Done false
30997 7593 Acked 8592 Read 4 New Done Done false
30998 7594 Acked 8593 Write 3 New Done Done false
30999 7595 Acked 8594 Write 9 New Done Done false
31000 7596 Acked 8595 Read 6 New Done Done false
31001 7597 Acked 8596 Write 6 New Done Done false
31002 7598 Acked 8597 Read 2 New Done Done false
31003 7599 Acked 8598 Write 6 New Done Done false
31004 7600 Acked 8599 Write 5 New Done Done false
31005 7601 Acked 8600 Read 5 New Done Done false
31006 7602 Acked 8601 Write 1 New Done Done false
31007 7603 Acked 8602 Read 3 New Done Done false
31008 7604 Acked 8603 Read 9 New Done Done false
31009 7605 Acked 8604 Write 2 New Done Done false
31010 7606 Acked 8605 Read 9 New Done Done false
31011 7607 Acked 8606 Write 6 New Done Done false
31012 7608 Acked 8607 Read 4 New Done Done false
31013 7609 Acked 8608 Read 5 New Done Done false
31014 7610 Acked 8609 Read 10 New Done Done false
31015 7611 Acked 8610 Read 5 New Done Done false
31016 7612 Acked 8611 Write 8 New Done Done false
31017 7613 Acked 8612 Write 9 New Done Done false
31018 7614 Acked 8613 Read 9 New Done Done false
31019 7615 Acked 8614 Read 3 New Done Done false
31020 7616 Acked 8615 Read 5 New Done Done false
31021 7617 Acked 8616 Read 2 New Done Done false
31022 7618 Acked 8617 Write 7 New Done Done false
31023 7619 Acked 8618 Read 5 New Done Done false
31024 7620 Acked 8619 Write 8 New Done Done false
31025 7621 Acked 8620 Write 2 New Done Done false
31026 7622 Acked 8621 Read 5 New Done Done false
31027 7623 Acked 8622 Write 6 New Done Done false
31028 7624 Acked 8623 Read 4 New Done Done false
31029 7625 Acked 8624 Read 3 New Done Done false
31030 7626 Acked 8625 Write 2 New Done Done false
31031 7627 Acked 8626 Write 5 New Done Done false
31032 7628 Acked 8627 Flush 0 New Done Done false
31033 7629 Acked 8628 Read 2 New Done Done false
31034 7630 Acked 8629 Write 7 New Done Done false
31035 7631 Acked 8630 Read 10 New Done Done false
31036 7632 Acked 8631 Write 7 New Done Done false
31037 7633 Acked 8632 Read 2 New Done Done false
31038 7634 Acked 8633 Read 5 New Done Done false
31039 7635 Acked 8634 Write 8 New Done Done false
31040 7636 Acked 8635 Read 4 New Done Done false
31041 7637 Acked 8636 Read 5 New Done Done false
31042 7638 Acked 8637 Read 6 New Done Done false
31043 7639 Acked 8638 Read 8 New Done Done false
31044 7640 Acked 8639 Write 8 New Done Done false
31045 7641 Acked 8640 Write 8 New Done Done false
31046 7642 Acked 8641 Write 8 New Done Done false
31047 7643 Acked 8642 Write 5 New Done Done false
31048 7644 Acked 8643 Read 7 New Done Done false
31049 7645 Acked 8644 Flush 0 New Done Done false
31050 7646 Acked 8645 Flush 0 New Done Done false
31051 7647 Acked 8646 Read 6 New Done Done false
31052 7648 Acked 8647 Flush 0 New Done Done false
31053 7649 Acked 8648 Read 2 New Done Done false
31054 7650 Acked 8649 Flush 0 New Done Done false
31055 7651 Acked 8650 Read 4 New Done Done false
31056 7652 Acked 8651 Write 4 New Done Done false
31057 7653 Acked 8652 Write 9 New Done Done false
31058 7654 Acked 8653 Write 6 New Done Done false
31059 7655 Acked 8654 Read 2 New Done Done false
31060 7656 Acked 8655 Read 3 New Done Done false
31061 7657 Acked 8656 Write 10 New Done Done false
31062 7658 Acked 8657 Write 9 New Done Done false
31063 7659 Acked 8658 Read 3 New Done Done false
31064 7660 Acked 8659 Write 9 New Done Done false
31065 7661 Acked 8660 Read 7 New Done Done false
31066 7662 Acked 8661 Read 6 New Done Done false
31067 7663 Acked 8662 Flush 0 New Done Done false
31068 7664 Acked 8663 Flush 0 New Done Done false
31069 7665 Acked 8664 Read 1 New Done Done false
31070 7666 Acked 8665 Write 1 New Done Done false
31071 7667 Acked 8666 Write 1 New Done Done false
31072 7668 Acked 8667 Read 9 New Done Done false
31073 7669 Acked 8668 Read 1 New Done Done false
31074 7670 Acked 8669 Write 7 New Done Done false
31075 7671 Acked 8670 Write 7 New Done Done false
31076 7672 Acked 8671 Write 7 New Done Done false
31077 7673 Acked 8672 Write 6 New Done Done false
31078 7674 Acked 8673 Write 6 New Done Done false
31079 7675 Acked 8674 Read 9 New Done Done false
31080 7676 Acked 8675 Write 4 New Done Done false
31081 7677 Acked 8676 Read 7 New Done Done false
31082 7678 Acked 8677 Read 5 New Done Done false
31083 7679 Acked 8678 Flush 0 New Done Done false
31084 7680 Acked 8679 Write 2 New Done Done false
31085 7681 Acked 8680 Write 7 New Done Done false
31086 7682 Acked 8681 Write 5 New Done Done false
31087 7683 Acked 8682 Write 4 New Done Done false
31088 7684 Acked 8683 Write 2 New Done Done false
31089 7685 Acked 8684 Read 9 New Done Done false
31090 7686 Acked 8685 Read 7 New Done Done false
31091 7687 Acked 8686 Write 10 New Done Done false
31092 7688 Acked 8687 Read 7 New Done Done false
31093 7689 Acked 8688 Write 9 New Done Done false
31094 7690 Acked 8689 Read 9 New Done Done false
31095 7691 Acked 8690 Read 10 New Done Done false
31096 7692 Acked 8691 Write 10 New Done Done false
31097 7693 Acked 8692 Write 9 New Done Done false
31098 7694 Acked 8693 Write 4 New Done Done false
31099 7695 Acked 8694 Flush 0 New Done Done false
31100 7696 Acked 8695 Write 10 New Done Done false
31101 7697 Acked 8696 Write 6 New Done Done false
31102 7698 Acked 8697 Read 5 New Done Done false
31103 7699 Acked 8698 Read 5 New Done Done false
31104 7700 Acked 8699 Write 4 New Done Done false
31105 7701 Acked 8700 Read 8 New Done Done false
31106 7702 Acked 8701 Read 3 New Done Done false
31107 7703 Acked 8702 Write 1 New Done Done false
31108 7704 Acked 8703 Write 2 New Done Done false
31109 7705 Acked 8704 Read 6 New Done Done false
31110 7706 Acked 8705 Read 5 New Done Done false
31111 7707 Acked 8706 Read 2 New Done Done false
31112 7708 Acked 8707 Write 3 New Done Done false
31113 7709 Acked 8708 Read 3 New Done Done false
31114 7710 Acked 8709 Write 3 New Done Done false
31115 7711 Acked 8710 Flush 0 New Done Done false
31116 7712 Acked 8711 Read 1 New Done Done false
31117 7713 Acked 8712 Read 3 New Done Done false
31118 7714 Acked 8713 Read 2 New Done Done false
31119 7715 Acked 8714 Read 7 New Done Done false
31120 7716 Acked 8715 Read 10 New Done Done false
31121 7717 Acked 8716 Write 2 New Done Done false
31122 7718 Acked 8717 Write 5 New Done Done false
31123 7719 Acked 8718 Flush 0 New Done Done false
31124 7720 Acked 8719 Write 4 New Done Done false
31125 7721 Acked 8720 Write 1 New Done Done false
31126 7722 Acked 8721 Read 5 New Done Done false
31127 7723 Acked 8722 Read 10 New Done Done false
31128 7724 Acked 8723 Write 7 New Done Done false
31129 7725 Acked 8724 Flush 0 New Done Done false
31130 7726 Acked 8725 Read 5 New Done Done false
31131 7727 Acked 8726 Read 10 New Done Done false
31132 7728 Acked 8727 Write 9 New Done Done false
31133 7729 Acked 8728 Read 1 New Done Done false
31134 7730 Acked 8729 Read 5 New Done Done false
31135 7731 Acked 8730 Read 3 New Done Done false
31136 7732 Acked 8731 Read 8 New Done Done false
31137 7733 Acked 8732 Read 1 New Done Done false
31138 7734 Acked 8733 Read 5 New Done Done false
31139 7735 Acked 8734 Read 10 New Done Done false
31140 7736 Acked 8735 Read 8 New Done Done false
31141 7737 Acked 8736 Flush 0 New Done Done false
31142 7738 Acked 8737 Write 3 New Done Done false
31143 7739 Acked 8738 Write 1 New Done Done false
31144 7740 Acked 8739 Read 5 New Done Done false
31145 7741 Acked 8740 Read 4 New Done Done false
31146 7742 Acked 8741 Write 2 New Done Done false
31147 7743 Acked 8742 Read 5 New Done Done false
31148 7744 Acked 8743 Write 10 New Done Done false
31149 7745 Acked 8744 Read 9 New Done Done false
31150 7746 Acked 8745 Read 1 New Done Done false
31151 7747 Acked 8746 Read 2 New Done Done false
31152 7748 Acked 8747 Read 2 New Done Done false
31153 7749 Acked 8748 Flush 0 New Done Done false
31154 7750 Acked 8749 Read 5 New Done Done false
31155 7751 Acked 8750 Write 1 New Done Done false
31156 7752 Acked 8751 Flush 0 New Done Done false
31157 7753 Acked 8752 Read 6 New Done Done false
31158 7754 Acked 8753 Read 9 New Done Done false
31159 7755 Acked 8754 Flush 0 New Done Done false
31160 7756 Acked 8755 Read 6 New Done Done false
31161 7757 Acked 8756 Write 4 New Done Done false
31162 7758 Acked 8757 Read 1 New Done Done false
31163 7759 Acked 8758 Write 10 New Done Done false
31164 7760 Acked 8759 Flush 0 New Done Done false
31165 7761 Acked 8760 Read 8 New Done Done false
31166 7762 Acked 8761 Read 1 New Done Done false
31167 7763 Acked 8762 Read 10 New Done Done false
31168 7764 Acked 8763 Read 6 New Done Done false
31169 7765 Acked 8764 Read 6 New Done Done false
31170 7766 Acked 8765 Write 2 New Done Done false
31171 7767 Acked 8766 Read 2 New Done Done false
31172 7768 Acked 8767 Read 3 New Done Done false
31173 7769 Acked 8768 Write 1 New Done Done false
31174 7770 Acked 8769 Read 6 New Done Done false
31175 7771 Acked 8770 Read 9 New Done Done false
31176 7772 Acked 8771 Read 3 New Done Done false
31177 7773 Acked 8772 Read 2 New Done Done false
31178 7774 Acked 8773 Read 3 New Done Done false
31179 7775 Acked 8774 Read 3 New Done Done false
31180 7776 Acked 8775 Read 8 New Done Done false
31181 7777 Acked 8776 Write 4 New Done Done false
31182 7778 Acked 8777 Write 10 New Done Done false
31183 7779 Acked 8778 Read 1 New Done Done false
31184 7780 Acked 8779 Read 1 New Done Done false
31185 7781 Acked 8780 Read 1 New Done Done false
31186 7782 Acked 8781 Read 2 New Done Done false
31187 7783 Acked 8782 Read 5 New Done Done false
31188 7784 Acked 8783 Write 5 New Done Done false
31189 7785 Acked 8784 Write 8 New Done Done false
31190 7786 Acked 8785 Write 2 New Done Done false
31191 7787 Acked 8786 Write 1 New Done Done false
31192 7788 Acked 8787 Write 8 New Done Done false
31193 7789 Acked 8788 Read 6 New Done Done false
31194 7790 Acked 8789 Read 7 New Done Done false
31195 7791 Acked 8790 Flush 0 New Done Done false
31196 7792 Acked 8791 Read 4 New Done Done false
31197 7793 Acked 8792 Write 4 New Done Done false
31198 7794 Acked 8793 Read 1 New Done Done false
31199 7795 Acked 8794 Read 7 New Done Done false
31200 7796 Acked 8795 Write 3 New Done Done false
31201 7797 Acked 8796 Write 5 New Done Done false
31202 7798 Acked 8797 Flush 0 New Done Done false
31203 7799 Acked 8798 Read 10 New Done Done false
31204 7800 Acked 8799 Write 10 New Done Done false
31205 7801 Acked 8800 Read 10 New Done Done false
31206 7802 Acked 8801 Read 6 New Done Done false
31207 7803 Acked 8802 Write 10 New Done Done false
31208 7804 Acked 8803 Write 6 New Done Done false
31209 7805 Acked 8804 Write 10 New Done Done false
31210 7806 Acked 8805 Read 5 New Done Done false
31211 7807 Acked 8806 Flush 0 New Done Done false
31212 7808 Acked 8807 Write 6 New Done Done false
31213 7809 Acked 8808 Read 6 New Done Done false
31214 7810 Acked 8809 Read 8 New Done Done false
31215 7811 Acked 8810 Flush 0 New Done Done false
31216 7812 Acked 8811 Read 10 New Done Done false
31217 7813 Acked 8812 Flush 0 New Done Done false
31218 7814 Acked 8813 Flush 0 New Done Done false
31219 7815 Acked 8814 Flush 0 New Done Done false
31220 7816 Acked 8815 Read 3 New Done Done false
31221 7817 Acked 8816 Read 3 New Done Done false
31222 7818 Acked 8817 Write 4 New Done Done false
31223 7819 Acked 8818 Read 10 New Done Done false
31224 7820 Acked 8819 Write 8 New Done Done false
31225 7821 Acked 8820 Read 6 New Done Done false
31226 7822 Acked 8821 Read 2 New Done Done false
31227 7823 Acked 8822 Write 1 New Done Done false
31228 7824 Acked 8823 Read 10 New Done Done false
31229 7825 Acked 8824 Write 8 New Done Done false
31230 7826 Acked 8825 Write 7 New Done Done false
31231 7827 Acked 8826 Read 10 New Done Done false
31232 7828 Acked 8827 Read 1 New Done Done false
31233 7829 Acked 8828 Write 1 New Done Done false
31234 7830 Acked 8829 Flush 0 New Done Done false
31235 7831 Acked 8830 Write 1 New Done Done false
31236 7832 Acked 8831 Read 10 New Done Done false
31237 7833 Acked 8832 Flush 0 New Done Done false
31238 7834 Acked 8833 Read 9 New Done Done false
31239 7835 Acked 8834 Write 4 New Done Done false
31240 7836 Acked 8835 Write 3 New Done Done false
31241 7837 Acked 8836 Flush 0 New Done Done false
31242 STATES DS:0 DS:1 DS:2 TOTAL
31243 New 302 0 0 302
31244 Sent 0 0 0 0
31245 Done 0 302 302 604
31246 Skipped 0 0 0 0
31247 Error 0 0 0 0
31248 Last Flush: 8534 8836 8836
31249 Downstairs last five completed: 8534 8533 8532 8531 8530
31250 Upstairs last five completed: 7837 7836 7835 7834 7833
31251 CLIENT: Up:0 ds:302 act:2
312522024-04-20T01:11:38.007ZINFOcrucible: connecting to 127.0.0.1:8810 = io task client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
312532024-04-20T01:11:38.007ZINFOcrucible: ds_connection connected from Ok(127.0.0.1:60402) = io task client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
312542024-04-20T01:11:38.009ZINFOcrucible: downstairs client at Some(127.0.0.1:8810) has region UUID 12345678-0000-0000-0000-000000008810 = downstairs client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
312552024-04-20T01:11:38.009ZINFOcrucible: Returning UUID:12345678-0000-0000-0000-000000008810 matches = downstairs client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
312562024-04-20T01:11:38.009ZINFOcrucible: send last flush ID to this DS: 8534 = downstairs client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
312572024-04-20T01:11:38.009ZINFOcrucible: Replied this last flush ID: 8534 = downstairs client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
312582024-04-20T01:11:38.009ZINFOcrucible: ds_transition from Offline to Replay = downstairs client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
312592024-04-20T01:11:38.009ZINFOcrucible: [0] Transition from Offline to Replay = downstairs client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
312602024-04-20T01:11:38.009ZINFOcrucible: ds_transition from Replay to Active = downstairs client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
312612024-04-20T01:11:38.009ZINFOcrucible: [0] Transition from Replay to Active = downstairs client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
31262 ----------------------------------------------------------------
31263 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:0
31264 Downstairs last five completed: 8836 8835 8834 8833 8832
31265 Upstairs last five completed: 7837 7836 7835 7834 7833
31266 CLIENT: Up:0 ds:0 act:3
31267 Replay: All jobs finished, all DS active.
31268 Main task has work to do, go find it
31269 got dsc Stop(1)
31270 stop 1
31271 Apr 20 01:11:40.313 INFO request completed, latency_us: 299[8820] Got stop action so:false kr:false
31272 , response_code: 204, uri: /stop/cid/1, method: POST, req_id: 196f1126-46d4-4aef-bdc2-4be871b31e2c, remote_addr: 127.0.0.1:60352, local_addr: 127.0.0.1:9998
31273 Apr 20 01:11:40.314 INFO request completed, latency_us: 123, response_code: 200, uri: /state/cid/1, {"msg":"downstairs disconnected","v":0,"name":"crucible","level":40,"time":"2024-04-20T01:11:40.314566467Z","hostname":"w-01HVWGBJP7HK0H9TQ26T6N3X8M","pid":1196,"":"io task","client":"1","":"downstairs","session_id":"132b460a-26a0-4532-b1ab-4f8c07d4c6c7"}
31274 method: GET, req_id: bd075f78-8539-42eb-b892-c5ababdf3127, remote_addr: 127.0.0.1:60352, local_addr:{"msg":"client task is sending Done(Finished)","v":0,"name":"crucible","level":40,"time":"2024-04-20T01:11:40.314633956Z","hostname":"w-01HVWGBJP7HK0H9TQ26T6N3X8M","pid":1196,"":"io task","client":"1","":"downstairs","session_id":"132b460a-26a0-4532-b1ab-4f8c07d4c6c7"}
31275 127.0.0{"msg":"downstairs task for 1 stopped due to Finished","v":0,"name":"crucible","level":40,"time":"2024-04-20T01:11:40.314673744Z","hostname":"w-01HVWGBJP7HK0H9TQ26T6N3X8M","pid":1196,"session_id":"132b460a-26a0-4532-b1ab-4f8c07d4c6c7"}
31276 .1:9998
312772024-04-20T01:11:40.314ZINFOcrucible: Gone missing, transition from Active to Offline = downstairs client = 1 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
312782024-04-20T01:11:40.314ZINFOcrucible: [1] client re-new 0 jobs since flush 8836 = downstairs session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
312792024-04-20T01:11:40.314ZINFOcrucible: [1] Marked 0 jobs for replay since flush: 8836 = downstairs session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
312802024-04-20T01:11:40.314ZINFOcrucible: client task is exiting = io task client = 1 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
31281 [8820] Exited with: ExitStatus(unix_wait_status(9))
31282 [8820][1] reports Exit
31283 Apr 20 01:11:44.316 INFO request completed, latency_us: 177, response_code: 200, uri: /state/cid/1, method: GET, req_id: 624e4a34-f25e-406b-b00f-3f53e65c2b64, remote_addr: 127.0.0.1:60352, local_addr: 127.0.0.1:9998
31284 001/300 Flush
31285 002/300 Write block 1431 len 40960 data: 7 7 7 7 8 8 6 7 7 9
31286 003/300 Read block 4938 len 24576
31287 004/300 Write block 263 len 4096 data: 4
31288 005/300 Flush
31289 006/300 Read block 1307 len 16384
31290 007/300 Read block 823 len 20480
31291 008/300 Read block 2219 len 28672
31292 009/300 Write block 3324 len 28672 data: 4 5 5 6 6 5 3
31293 010/300 Write block 613 len 20480 data: 5 6 6 5 5
31294 011/300 Read block 1771 len 24576
31295 012/300 Read block 207 len 36864
31296 013/300 Write block 2277 len 8192 data: 4 4
31297 014/300 Write block 535 len 16384 data: 3 5 4 4
31298 015/300 Write block 4803 len 20480 data: 7 7 5 6 5
31299 016/300 Write block 2532 len 36864 data: 7 6 5 3 6 7 7 6 7
31300 017/300 Read block 4790 len 32768
31301 018/300 Read block 3852 len 20480
31302 019/300 Write block 324 len 28672 data: 10 12 10 8 7 7 5
31303 020/300 Flush
31304 021/300 Write block 5 len 8192 data: 5 6
31305 022/300 Write block 2353 len 32768 data: 6 5 7 7 5 7 6 4
31306 023/300 Read block 4385 len 32768
31307 024/300 Write block 3166 len 24576 data: 4 3 3 4 4 4
31308 025/300 Write block 3803 len 4096 data: 6
31309 026/300 Read block 4524 len 36864
31310 027/300 Read block 2343 len 16384
31311 028/300 Read block 4671 len 40960
31312 029/300 Write block 1244 len 28672 data: 7 5 5 3 3 4 4
31313 030/300 Read block 1253 len 12288
31314 031/300 Read block 2964 len 36864
31315 032/300 Read block 1853 len 8192
31316 033/300 Write block 2871 len 24576 data: 6 4 4 6 5 5
31317 034/300 Write block 1512 len 36864 data: 5 5 5 5 6 8 9 11 8
31318 035/300 Read block 2704 len 40960
31319 036/300 Write block 2987 len 8192 data: 4 6
31320 037/300 Read block 1603 len 28672
31321 038/300 Read block 599 len 36864
31322 039/300 Read block 2288 len 8192
31323 040/300 Read block 2870 len 24576
31324 041/300 Read block 156 len 24576
31325 042/300 Write block 3476 len 40960 data: 5 7 7 7 6 6 5 4 5 6
31326 043/300 Write block 462 len 36864 data: 3 4 4 4 7 7 6 7 6
31327 044/300 Write block 448 len 24576 data: 5 5 6 6 5 6
31328 045/300 Write block 1054 len 20480 data: 5 6 8 8 7
31329 046/300 Read block 1364 len 20480
31330 047/300 Read block 1649 len 8192
31331 048/300 Read block 1053 len 32768
31332 049/300 Flush
31333 050/300 Read block 3607 len 32768
31334 051/300 Flush
31335 052/300 Write block 2453 len 36864 data: 4 4 4 3 3 7 6 8 8
31336 053/300 Write block 2921 len 12288 data: 4 4 4
31337 054/300 Read block 3439 len 16384
31338 055/300 Write block 2380 len 4096 data: 3
31339 056/300 Read block 3476 len 36864
31340 057/300 Read block 687 len 8192
31341 058/300 Read block 1174 len 20480
31342 059/300 Read block 2211 len 36864
31343 060/300 Write block 3778 len 20480 data: 4 4 4 5 4
31344 061/300 Flush
31345 062/300 Write block 3089 len 8192 data: 4 3
31346 063/300 Write block 1456 len 24576 data: 6 5 5 5 4 4
31347 064/300 Write block 4089 len 32768 data: 4 5 5 4 5 5 5 4
31348 065/300 Read block 3956 len 20480
31349 066/300 Read block 4176 len 12288
31350 067/300 Write block 3169 len 12288 data: 5 5 5
31351 068/300 Write block 3029 len 12288 data: 4 3 3
31352 069/300 Flush
31353 070/300 Write block 2348 len 16384 data: 11 8 9 8
31354 071/300 Read block 3195 len 16384
31355 072/300 Flush
31356 073/300 Write block 724 len 28672 data: 5 5 5 5 7 9 9
31357 074/300 Write block 2850 len 36864 data: 9 4 4 6 6 6 6 5 6
31358 075/300 Write block 1233 len 36864 data: 6 6 6 6 4 4 3 4 3
31359 076/300 Write block 120 len 12288 data: 5 6 6
31360 077/300 Read block 2931 len 32768
31361 078/300 Read block 856 len 24576
31362 079/300 Read block 282 len 40960
31363 080/300 Read block 2566 len 8192
31364 081/300 Write block 1499 len 4096 data: 5
31365 082/300 Read block 2213 len 12288
31366 083/300 Flush
31367 084/300 Write block 832 len 4096 data: 6
31368 085/300 Read block 4844 len 28672
31369 086/300 Read block 4329 len 36864
31370 087/300 Write block 1250 len 28672 data: 5 4 5 7 7 8 8
31371 088/300 Write block 1554 len 20480 data: 5 5 6 6 6
31372 089/300 Write block 1814 len 36864 data: 5 6 4 5 6 7 6 6 6
31373 090/300 Read block 447 len 36864
31374 091/300 Read block 1054 len 16384
31375 092/300 Flush
31376 093/300 Read block 2901 len 40960
31377 094/300 Read block 3226 len 32768
31378 095/300 Write block 2280 len 16384 data: 4 3 3 2
31379 096/300 Write block 4786 len 12288 data: 6 6 5
31380 097/300 Write block 280 len 24576 data: 6 5 4 3 4 2
31381 098/300 Read block 1470 len 36864
31382 099/300 Write block 1249 len 40960 data: 5 6 5 6 8 8 9 9 6 6
31383 100/300 Read block 1617 len 8192
31384 101/300 Read block 1762 len 12288
31385 102/300 Read block 1117 len 20480
31386 103/300 Read block 2191 len 32768
31387 104/300 Write block 3345 len 16384 data: 6 4 4 4
31388 105/300 Flush
31389 106/300 Read block 4484 len 36864
31390 107/300 Flush
31391 108/300 Flush
31392 109/300 Read block 1216 len 20480
31393 110/300 Read block 4950 len 20480
31394 111/300 Read block 2245 len 12288
31395 112/300 Read block 1518 len 24576
31396 113/300 Write block 1586 len 24576 data: 5 5 4 8 7 8
31397 114/300 Read block 818 len 4096
31398 115/300 Write block 4687 len 40960 data: 3 3 3 4 4 4 4 4 4 3
31399 116/300 Read block 2062 len 20480
31400 117/300 Read block 4674 len 12288
31401 118/300 Flush
31402 119/300 Write block 2445 len 16384 data: 3 4 3 3
31403 120/300 Flush
31404 121/300 Write block 4947 len 20480 data: 7 9 8 8 9
31405 122/300 Read block 2358 len 32768
31406 123/300 Read block 2669 len 28672
31407 124/300 Write block 1007 len 40960 data: 2 3 4 4 5 5 7 5 8 8
31408 125/300 Flush
31409 126/300 Read block 4195 len 40960
31410 127/300 Read block 3243 len 36864
31411 128/300 Read block 214 len 28672
31412 129/300 Write block 2681 len 12288 data: 6 7 6
31413 130/300 Write block 4114 len 8192 data: 6 6
31414 131/300 Read block 2681 len 16384
31415 132/300 Write block 913 len 4096 data: 5
31416 133/300 Read block 93 len 28672
31417 134/300 Write block 1669 len 32768 data: 9 9 7 5 5 5 4 5
31418 135/300 Write block 3515 len 28672 data: 7 8 8 6 6 6 5
31419 136/300 Write block 4355 len 24576 data: 7 5 6 6 6 8
31420 137/300 Read block 2615 len 36864
31421 138/300 Flush
31422 139/300 Read block 3145 len 20480
31423 140/300 Write block 2824 len 28672 data: 6 5 4 3 3 6 5
31424 141/300 Write block 3761 len 4096 data: 6
31425 142/300 Flush
31426 143/300 Read block 1782 len 12288
31427 144/300 Write block 771 len 24576 data: 8 9 8 8 7 6
31428 145/300 Read block 3063 len 36864
31429 146/300 Write block 4516 len 40960 data: 4 5 6 6 8 9 8 6 5 5
31430 147/300 Read block 3674 len 20480
31431 148/300 Read block 1129 len 20480
31432 149/300 Write block 995 len 40960 data: 5 5 5 5 5 3 3 4 3 4
31433 150/300 Write block 2066 len 16384 data: 8 7 9 9
31434 151/300 Read block 3851 len 32768
31435 152/300 Read block 869 len 36864
31436 153/300 Write block 1092 len 36864 data: 8 8 7 6 6 7 8 7 10
31437 154/300 Read block 110 len 16384
31438 155/300 Read block 3771 len 8192
31439 156/300 Read block 3812 len 32768
31440 157/300 Write block 1282 len 32768 data: 5 3 3 3 3 4 4 5
31441 158/300 Read block 4786 len 8192
31442 159/300 Read block 678 len 36864
31443 160/300 Write block 1309 len 36864 data: 6 6 6 6 5 3 3 4 4
31444 161/300 Read block 3595 len 40960
31445 162/300 Flush
31446 163/300 Read block 609 len 4096
31447 164/300 Write block 4685 len 4096 data: 3
31448 165/300 Read block 1348 len 4096
31449 166/300 Read block 1783 len 12288
31450 167/300 Write block 722 len 20480 data: 6 6 6 6 6
31451 168/300 Read block 4119 len 24576
31452 169/300 Read block 4011 len 40960
31453 170/300 Read block 2781 len 4096
31454 171/300 Write block 1028 len 4096 data: 3
31455 172/300 Read block 932 len 28672
31456 173/300 Read block 2568 len 12288
31457 174/300 Write block 2703 len 36864 data: 5 5 4 3 4 5 4 3 4
31458 175/300 Flush
31459 176/300 Write block 188 len 24576 data: 3 6 6 7 7 7
31460 177/300 Write block 511 len 32768 data: 5 6 8 6 7 8 6 7
31461 178/300 Write block 2069 len 40960 data: 10 5 6 6 5 5 4 3 5 4
31462 179/300 Write block 1822 len 12288 data: 7 6 5
31463 180/300 Read block 4686 len 20480
31464 181/300 Read block 725 len 40960
31465 182/300 Write block 193 len 12288 data: 8 6 5
31466 183/300 Write block 2969 len 24576 data: 5 5 6 6 6 7
31467 184/300 Write block 4517 len 8192 data: 6 7
31468 185/300 Read block 489 len 40960
31469 186/300 Read block 1891 len 4096
31470 187/300 Write block 4048 len 8192 data: 4 5
31471 188/300 Write block 1440 len 40960 data: 10 11 12 9 9 9 7 7 5 7
31472 189/300 Flush
31473 190/300 Read block 1120 len 40960
31474 191/300 Read block 1588 len 16384
31475 192/300 Write block 1102 len 28672 data: 9 7 6 5 6 6 6
31476 193/300 Write block 409 len 40960 data: 3 3 5 6 7 8 8 7 6 6
31477 194/300 Read block 1990 len 32768
31478 195/300 Read block 1738 len 16384
31479 196/300 Write block 3313 len 40960 data: 8 6 6 5 2 2 2 2 3 3
31480 197/300 Write block 368 len 8192 data: 8 6
31481 198/300 Write block 1764 len 8192 data: 3 3
31482 199/300 Flush
31483 200/300 Write block 2652 len 12288 data: 3 3 5
31484 201/300 Write block 2099 len 12288 data: 6 6 8
31485 202/300 Write block 4000 len 20480 data: 8 9 9 10 10
31486 203/300 Write block 705 len 36864 data: 2 2 2 3 3 4 4 4 3
31487 204/300 Write block 1641 len 24576 data: 3 3 3 3 4 3
31488 205/300 Read block 1910 len 32768
31489 206/300 Read block 4107 len 4096
31490 207/300 Read block 87 len 16384
31491 208/300 Flush
31492 209/300 Read block 303 len 36864
31493 210/300 Write block 4179 len 32768 data: 4 5 6 8 6 5 5 7
31494 211/300 Flush
31495 212/300 Read block 4870 len 36864
31496 213/300 Write block 1752 len 28672 data: 2 3 3 3 3 4 5
31497 214/300 Write block 4034 len 12288 data: 4 5 5
31498 215/300 Read block 3203 len 4096
31499 216/300 Write block 3845 len 40960 data: 5 5 5 5 5 5 4 3 2 2
31500 217/300 Write block 3752 len 16384 data: 7 7 7 8
31501 218/300 Write block 1501 len 28672 data: 4 3 3 2 2 2 2
31502 219/300 Read block 4015 len 20480
31503 220/300 Write block 3315 len 32768 data: 7 6 3 3 3 3 4 4
31504 221/300 Read block 1113 len 16384
31505 222/300 Flush
31506 223/300 Write block 2449 len 40960 data: 4 4 4 4 5 5 5 4 4 8
31507 224/300 Write block 1563 len 20480 data: 3 2 4 5 5
31508 225/300 Read block 2821 len 32768
31509 226/300 Read block 1380 len 20480
31510 227/300 Read block 2567 len 24576
31511 228/300 Read block 3620 len 28672
31512 229/300 Write block 264 len 16384 data: 6 5 5 6
31513 230/300 Read block 4605 len 32768
31514 231/300 Read block 3244 len 36864
31515 232/300 Write block 179 len 40960 data: 4 4 4 3 3 2 2 3 3 4
31516 233/300 Flush
31517 234/300 Write block 3432 len 40960 data: 10 7 7 6 5 4 6 6 7 8
31518 235/300 Read block 2597 len 8192
31519 236/300 Read block 90 len 28672
31520 237/300 Write block 3662 len 40960 data: 3 4 4 2 2 2 2 2 2 2
31521 238/300 Read block 1954 len 12288
31522 239/300 Read block 2050 len 40960
31523 240/300 Write block 2429 len 36864 data: 6 3 4 4 5 5 5 5 5
31524 241/300 Read block 1722 len 16384
31525 242/300 Write block 2898 len 32768 data: 5 5 7 6 5 6 6 5
31526 243/300 Read block 4320 len 28672
31527 244/300 Read block 2901 len 8192
31528 245/300 Read block 4490 len 20480
31529 246/300 Write block 245 len 36864 data: 10 8 8 7 7 8 8 8 5
31530 247/300 Write block 1416 len 16384 data: 6 6 6 5
31531 248/300 Write block 3439 len 40960 data: 7 8 9 8 5 6 8 7 6 8
31532 249/300 Read block 2152 len 24576
31533 250/300 Write block 1577 len 28672 data: 4 5 3 2 2 3 3
31534 251/300 Read block 3879 len 40960
31535 252/300 Read block 2363 len 16384
31536 253/300 Write block 1754 len 40960 data: 4 4 4 5 6 6 6 5 4 3
31537 254/300 Read block 736 len 4096
31538 255/300 Read block 2014 len 28672
31539 256/300 Write block 3358 len 36864 data: 6 5 4 4 4 4 5 6 4
31540 257/300 Write block 3350 len 20480 data: 3 3 4 3 4
31541 258/300 Read block 487 len 40960
31542 259/300 Read block 134 len 8192
31543 260/300 Flush
31544 261/300 Flush
31545 262/300 Read block 552 len 16384
31546 263/300 Write block 4017 len 20480 data: 5 4 3 3 5
31547 264/300 Write block 3519 len 28672 data: 7 7 6 5 3 3 3
31548 265/300 Read block 4022 len 36864
31549 266/300 Write block 4065 len 20480 data: 5 5 5 6 6
31550 267/300 Write block 811 len 40960 data: 4 4 4 4 6 4 5 5 4 5
31551 268/300 Flush
31552 269/300 Flush
31553 270/300 Write block 3621 len 24576 data: 5 3 3 4 3 3
31554 271/300 Write block 880 len 4096 data: 6
31555 272/300 Write block 2562 len 8192 data: 7 7
31556 273/300 Read block 3985 len 20480
31557 274/300 Read block 3899 len 8192
31558 275/300 Read block 3072 len 28672
31559 276/300 Write block 325 len 24576 data: 13 11 9 8 8 6
31560 277/300 Write block 714 len 40960 data: 3 3 3 5 5 5 4 5 7 7
31561 278/300 Read block 2045 len 36864
31562 279/300 Read block 2306 len 28672
31563 280/300 Read block 1322 len 16384
31564 281/300 Read block 3803 len 8192
31565 282/300 Write block 771 len 12288 data: 9 10 9
31566 283/300 Read block 822 len 12288
31567 284/300 Write block 4312 len 4096 data: 6
31568 285/300 Read block 4591 len 4096
31569 286/300 Read block 2856 len 8192
31570 287/300 Read block 1765 len 32768
31571 288/300 Read block 2037 len 32768
31572 289/300 Write block 1376 len 16384 data: 4 4 6 6
31573 290/300 Read block 680 len 4096
31574 291/300 Write block 838 len 20480 data: 8 7 7 8 7
31575 292/300 Flush
31576 293/300 Read block 4940 len 4096
31577 294/300 Write block 3079 len 16384 data: 6 7 8 4
31578 295/300 Read block 4461 len 8192
31579 296/300 Write block 77 len 36864 data: 4 4 4 3 5 5 6 6 6
31580 297/300 Write block 821 len 24576 data: 5 5 7 6 6 5
31581 298/300 Read block 1034 len 32768
31582 299/300 Write block 4325 len 20480 data: 4 4 4 2 2
31583 300/300 Write block 4333 len 28672 data: 2 3 4 5 4 4 4
31584 Main task has work to do, go find it
31585 got dsc Start(1)
31586 start 1
31587 Apr 20 01:11:44.629 INFO request completed, latency_us: 250, response_code: 204, uri: /start/cid/1, method: POST, req_id: 684a9efd-a885-4b32-acf0-651e05e2e70e, remote_addr: 127.0.0.1:60352, local_addr: 127.0.0.1:9998
31588 Replay: started 1, returned:Ok(())
31589 ----------------------------------------------------------------
31590 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:301
31591 States: Active Offline Active
31592 GW_ID ACK DSID TYPE BLOCKS DS:0 DS:1 DS:2 REPLAY
31593 7838 Acked 8837 Flush 0 Done New Done false
31594 7839 Acked 8838 Write 10 Done New Done false
31595 7840 Acked 8839 Read 6 Done New Done false
31596 7841 Acked 8840 Write 1 Done New Done false
31597 7842 Acked 8841 Flush 0 Done New Done false
31598 7843 Acked 8842 Read 4 Done New Done false
31599 7844 Acked 8843 Read 5 Done New Done false
31600 7845 Acked 8844 Read 7 Done New Done false
31601 7846 Acked 8845 Write 7 Done New Done false
31602 7847 Acked 8846 Write 5 Done New Done false
31603 7848 Acked 8847 Read 6 Done New Done false
31604 7849 Acked 8848 Read 9 Done New Done false
31605 7850 Acked 8849 Write 2 Done New Done false
31606 7851 Acked 8850 Write 4 Done New Done false
31607 7852 Acked 8851 Flush 0 Done New Done false
31608 7853 Acked 8852 Write 5 Done New Done false
31609 7854 Acked 8853 Write 9 Done New Done false
31610 7855 Acked 8854 Read 8 Done New Done false
31611 7856 Acked 8855 Read 5 Done New Done false
31612 7857 Acked 8856 Write 7 Done New Done false
31613 7858 Acked 8857 Flush 0 Done New Done false
31614 7859 Acked 8858 Write 2 Done New Done false
31615 7860 Acked 8859 Write 8 Done New Done false
31616 7861 Acked 8860 Read 8 Done New Done false
31617 7862 Acked 8861 Write 6 Done New Done false
31618 7863 Acked 8862 Write 1 Done New Done false
31619 7864 Acked 8863 Read 9 Done New Done false
31620 7865 Acked 8864 Read 4 Done New Done false
31621 7866 Acked 8865 Read 10 Done New Done false
31622 7867 Acked 8866 Write 7 Done New Done false
31623 7868 Acked 8867 Read 3 Done New Done false
31624 7869 Acked 8868 Read 9 Done New Done false
31625 7870 Acked 8869 Read 2 Done New Done false
31626 7871 Acked 8870 Write 6 Done New Done false
31627 7872 Acked 8871 Write 9 Done New Done false
31628 7873 Acked 8872 Read 10 Done New Done false
31629 7874 Acked 8873 Write 2 Done New Done false
31630 7875 Acked 8874 Read 7 Done New Done false
31631 7876 Acked 8875 Read 9 Done New Done false
31632 7877 Acked 8876 Read 2 Done New Done false
31633 7878 Acked 8877 Read 6 Done New Done false
31634 7879 Acked 8878 Read 6 Done New Done false
31635 7880 Acked 8879 Write 10 Done New Done false
31636 7881 Acked 8880 Write 9 Done New Done false
31637 7882 Acked 8881 Write 6 Done New Done false
31638 7883 Acked 8882 Write 5 Done New Done false
31639 7884 Acked 8883 Read 5 Done New Done false
31640 7885 Acked 8884 Read 2 Done New Done false
31641 7886 Acked 8885 Read 8 Done New Done false
31642 7887 Acked 8886 Flush 0 Done New Done false
31643 7888 Acked 8887 Read 8 Done New Done false
31644 7889 Acked 8888 Flush 0 Done New Done false
31645 7890 Acked 8889 Write 9 Done New Done false
31646 7891 Acked 8890 Write 3 Done New Done false
31647 7892 Acked 8891 Read 4 Done New Done false
31648 7893 Acked 8892 Write 1 Done New Done false
31649 7894 Acked 8893 Read 9 Done New Done false
31650 7895 Acked 8894 Read 2 Done New Done false
31651 7896 Acked 8895 Read 5 Done New Done false
31652 7897 Acked 8896 Read 9 Done New Done false
31653 7898 Acked 8897 Write 5 Done New Done false
31654 7899 Acked 8898 Flush 0 Done New Done false
31655 7900 Acked 8899 Write 2 Done New Done false
31656 7901 Acked 8900 Write 6 Done New Done false
31657 7902 Acked 8901 Write 8 Done New Done false
31658 7903 Acked 8902 Read 5 Done New Done false
31659 7904 Acked 8903 Read 3 Done New Done false
31660 7905 Acked 8904 Write 3 Done New Done false
31661 7906 Acked 8905 Write 3 Done New Done false
31662 7907 Acked 8906 Flush 0 Done New Done false
31663 7908 Acked 8907 Write 4 Done New Done false
31664 7909 Acked 8908 Read 4 Done New Done false
31665 7910 Acked 8909 Flush 0 Done New Done false
31666 7911 Acked 8910 Write 7 Done New Done false
31667 7912 Acked 8911 Write 9 Done New Done false
31668 7913 Acked 8912 Write 9 Done New Done false
31669 7914 Acked 8913 Write 3 Done New Done false
31670 7915 Acked 8914 Read 8 Done New Done false
31671 7916 Acked 8915 Read 6 Done New Done false
31672 7917 Acked 8916 Read 10 Done New Done false
31673 7918 Acked 8917 Read 2 Done New Done false
31674 7919 Acked 8918 Write 1 Done New Done false
31675 7920 Acked 8919 Read 3 Done New Done false
31676 7921 Acked 8920 Flush 0 Done New Done false
31677 7922 Acked 8921 Write 1 Done New Done false
31678 7923 Acked 8922 Read 7 Done New Done false
31679 7924 Acked 8923 Read 9 Done New Done false
31680 7925 Acked 8924 Write 7 Done New Done false
31681 7926 Acked 8925 Write 5 Done New Done false
31682 7927 Acked 8926 Write 9 Done New Done false
31683 7928 Acked 8927 Read 9 Done New Done false
31684 7929 Acked 8928 Read 4 Done New Done false
31685 7930 Acked 8929 Flush 0 Done New Done false
31686 7931 Acked 8930 Read 10 Done New Done false
31687 7932 Acked 8931 Read 8 Done New Done false
31688 7933 Acked 8932 Write 4 Done New Done false
31689 7934 Acked 8933 Write 3 Done New Done false
31690 7935 Acked 8934 Write 6 Done New Done false
31691 7936 Acked 8935 Read 9 Done New Done false
31692 7937 Acked 8936 Write 10 Done New Done false
31693 7938 Acked 8937 Read 2 Done New Done false
31694 7939 Acked 8938 Read 3 Done New Done false
31695 7940 Acked 8939 Read 5 Done New Done false
31696 7941 Acked 8940 Read 8 Done New Done false
31697 7942 Acked 8941 Write 4 Done New Done false
31698 7943 Acked 8942 Flush 0 Done New Done false
31699 7944 Acked 8943 Read 9 Done New Done false
31700 7945 Acked 8944 Flush 0 Done New Done false
31701 7946 Acked 8945 Flush 0 Done New Done false
31702 7947 Acked 8946 Read 5 Done New Done false
31703 7948 Acked 8947 Read 5 Done New Done false
31704 7949 Acked 8948 Read 3 Done New Done false
31705 7950 Acked 8949 Read 6 Done New Done false
31706 7951 Acked 8950 Write 6 Done New Done false
31707 7952 Acked 8951 Read 1 Done New Done false
31708 7953 Acked 8952 Write 10 Done New Done false
31709 7954 Acked 8953 Read 5 Done New Done false
31710 7955 Acked 8954 Read 3 Done New Done false
31711 7956 Acked 8955 Flush 0 Done New Done false
31712 7957 Acked 8956 Write 4 Done New Done false
31713 7958 Acked 8957 Flush 0 Done New Done false
31714 7959 Acked 8958 Write 5 Done New Done false
31715 7960 Acked 8959 Read 8 Done New Done false
31716 7961 Acked 8960 Read 7 Done New Done false
31717 7962 Acked 8961 Write 10 Done New Done false
31718 7963 Acked 8962 Flush 0 Done New Done false
31719 7964 Acked 8963 Read 10 Done New Done false
31720 7965 Acked 8964 Read 9 Done New Done false
31721 7966 Acked 8965 Read 7 Done New Done false
31722 7967 Acked 8966 Write 3 Done New Done false
31723 7968 Acked 8967 Write 2 Done New Done false
31724 7969 Acked 8968 Read 4 Done New Done false
31725 7970 Acked 8969 Write 1 Done New Done false
31726 7971 Acked 8970 Read 7 Done New Done false
31727 7972 Acked 8971 Write 8 Done New Done false
31728 7973 Acked 8972 Write 7 Done New Done false
31729 7974 Acked 8973 Write 6 Done New Done false
31730 7975 Acked 8974 Read 9 Done New Done false
31731 7976 Acked 8975 Flush 0 Done New Done false
31732 7977 Acked 8976 Read 5 Done New Done false
31733 7978 Acked 8977 Write 7 Done New Done false
31734 7979 Acked 8978 Write 1 Done New Done false
31735 7980 Acked 8979 Flush 0 Done New Done false
31736 7981 Acked 8980 Read 3 Done New Done false
31737 7982 Acked 8981 Write 6 Done New Done false
31738 7983 Acked 8982 Read 9 Done New Done false
31739 7984 Acked 8983 Write 10 Done New Done false
31740 7985 Acked 8984 Read 5 Done New Done false
31741 7986 Acked 8985 Read 5 Done New Done false
31742 7987 Acked 8986 Write 10 Done New Done false
31743 7988 Acked 8987 Write 4 Done New Done false
31744 7989 Acked 8988 Read 8 Done New Done false
31745 7990 Acked 8989 Read 9 Done New Done false
31746 7991 Acked 8990 Write 9 Done New Done false
31747 7992 Acked 8991 Read 4 Done New Done false
31748 7993 Acked 8992 Read 2 Done New Done false
31749 7994 Acked 8993 Read 8 Done New Done false
31750 7995 Acked 8994 Write 8 Done New Done false
31751 7996 Acked 8995 Read 2 Done New Done false
31752 7997 Acked 8996 Read 9 Done New Done false
31753 7998 Acked 8997 Write 9 Done New Done false
31754 7999 Acked 8998 Read 10 Done New Done false
31755 8000 Acked 8999 Flush 0 Done New Done false
31756 8001 Acked 9000 Read 1 Done New Done false
31757 8002 Acked 9001 Write 1 Done New Done false
31758 8003 Acked 9002 Read 1 Done New Done false
31759 8004 Acked 9003 Read 3 Done New Done false
31760 8005 Acked 9004 Write 5 Done New Done false
31761 8006 Acked 9005 Read 6 Done New Done false
31762 8007 Acked 9006 Read 10 Done New Done false
31763 8008 Acked 9007 Read 1 Done New Done false
31764 8009 Acked 9008 Write 1 Done New Done false
31765 8010 Acked 9009 Read 7 Done New Done false
31766 8011 Acked 9010 Read 3 Done New Done false
31767 8012 Acked 9011 Write 9 Done New Done false
31768 8013 Acked 9012 Flush 0 Done New Done false
31769 8014 Acked 9013 Write 6 Done New Done false
31770 8015 Acked 9014 Write 8 Done New Done false
31771 8016 Acked 9015 Write 10 Done New Done false
31772 8017 Acked 9016 Write 3 Done New Done false
31773 8018 Acked 9017 Read 5 Done New Done false
31774 8019 Acked 9018 Read 10 Done New Done false
31775 8020 Acked 9019 Write 3 Done New Done false
31776 8021 Acked 9020 Write 6 Done New Done false
31777 8022 Acked 9021 Write 2 Done New Done false
31778 8023 Acked 9022 Read 10 Done New Done false
31779 8024 Acked 9023 Read 1 Done New Done false
31780 8025 Acked 9024 Write 2 Done New Done false
31781 8026 Acked 9025 Write 10 Done New Done false
31782 8027 Acked 9026 Flush 0 Done New Done false
31783 8028 Acked 9027 Read 10 Done New Done false
31784 8029 Acked 9028 Read 4 Done New Done false
31785 8030 Acked 9029 Write 7 Done New Done false
31786 8031 Acked 9030 Write 10 Done New Done false
31787 8032 Acked 9031 Read 8 Done New Done false
31788 8033 Acked 9032 Read 4 Done New Done false
31789 8034 Acked 9033 Write 10 Done New Done false
31790 8035 Acked 9034 Write 2 Done New Done false
31791 8036 Acked 9035 Write 2 Done New Done false
31792 8037 Acked 9036 Flush 0 Done New Done false
31793 8038 Acked 9037 Write 3 Done New Done false
31794 8039 Acked 9038 Write 3 Done New Done false
31795 8040 Acked 9039 Write 5 Done New Done false
31796 8041 Acked 9040 Write 9 Done New Done false
31797 8042 Acked 9041 Write 6 Done New Done false
31798 8043 Acked 9042 Read 8 Done New Done false
31799 8044 Acked 9043 Read 1 Done New Done false
31800 8045 Acked 9044 Read 4 Done New Done false
31801 8046 Acked 9045 Flush 0 Done New Done false
31802 8047 Acked 9046 Read 9 Done New Done false
31803 8048 Acked 9047 Write 8 Done New Done false
31804 8049 Acked 9048 Flush 0 Done New Done false
31805 8050 Acked 9049 Read 9 Done New Done false
31806 8051 Acked 9050 Write 7 Done New Done false
31807 8052 Acked 9051 Write 3 Done New Done false
31808 8053 Acked 9052 Read 1 Done New Done false
31809 8054 Acked 9053 Write 10 Done New Done false
31810 8055 Acked 9054 Write 4 Done New Done false
31811 8056 Acked 9055 Write 7 Done New Done false
31812 8057 Acked 9056 Read 5 Done New Done false
31813 8058 Acked 9057 Write 8 Done New Done false
31814 8059 Acked 9058 Read 4 Done New Done false
31815 8060 Acked 9059 Flush 0 Done New Done false
31816 8061 Acked 9060 Write 10 Done New Done false
31817 8062 Acked 9061 Write 5 Done New Done false
31818 8063 Acked 9062 Read 8 Done New Done false
31819 8064 Acked 9063 Read 5 Done New Done false
31820 8065 Acked 9064 Read 6 Done New Done false
31821 8066 Acked 9065 Read 7 Done New Done false
31822 8067 Acked 9066 Write 4 Done New Done false
31823 8068 Acked 9067 Read 8 Done New Done false
31824 8069 Acked 9068 Read 9 Done New Done false
31825 8070 Acked 9069 Write 10 Done New Done false
31826 8071 Acked 9070 Flush 0 Done New Done false
31827 8072 Acked 9071 Write 10 Done New Done false
31828 8073 Acked 9072 Read 2 Done New Done false
31829 8074 Acked 9073 Read 7 Done New Done false
31830 8075 Acked 9074 Write 10 Done New Done false
31831 8076 Acked 9075 Read 3 Done New Done false
31832 8077 Acked 9076 Read 10 Done New Done false
31833 8078 Acked 9077 Write 9 Done New Done false
31834 8079 Acked 9078 Read 4 Done New Done false
31835 8080 Acked 9079 Write 8 Done New Done false
31836 8081 Acked 9080 Read 7 Done New Done false
31837 8082 Acked 9081 Read 2 Done New Done false
31838 8083 Acked 9082 Read 5 Done New Done false
31839 8084 Acked 9083 Write 9 Done New Done false
31840 8085 Acked 9084 Write 4 Done New Done false
31841 8086 Acked 9085 Write 10 Done New Done false
31842 8087 Acked 9086 Read 6 Done New Done false
31843 8088 Acked 9087 Write 7 Done New Done false
31844 8089 Acked 9088 Read 10 Done New Done false
31845 8090 Acked 9089 Read 4 Done New Done false
31846 8091 Acked 9090 Write 10 Done New Done false
31847 8092 Acked 9091 Read 1 Done New Done false
31848 8093 Acked 9092 Read 7 Done New Done false
31849 8094 Acked 9093 Write 9 Done New Done false
31850 8095 Acked 9094 Write 5 Done New Done false
31851 8096 Acked 9095 Read 10 Done New Done false
31852 8097 Acked 9096 Read 2 Done New Done false
31853 8098 Acked 9097 Flush 0 Done New Done false
31854 8099 Acked 9098 Flush 0 Done New Done false
31855 8100 Acked 9099 Read 4 Done New Done false
31856 8101 Acked 9100 Write 5 Done New Done false
31857 8102 Acked 9101 Write 7 Done New Done false
31858 8103 Acked 9102 Read 9 Done New Done false
31859 8104 Acked 9103 Write 5 Done New Done false
31860 8105 Acked 9104 Write 10 Done New Done false
31861 8106 Acked 9105 Flush 0 Done New Done false
31862 8107 Acked 9106 Flush 0 Done New Done false
31863 8108 Acked 9107 Write 6 Done New Done false
31864 8109 Acked 9108 Write 1 Done New Done false
31865 8110 Acked 9109 Write 2 Done New Done false
31866 8111 Acked 9110 Read 5 Done New Done false
31867 8112 Acked 9111 Read 2 Done New Done false
31868 8113 Acked 9112 Read 7 Done New Done false
31869 8114 Acked 9113 Write 6 Done New Done false
31870 8115 Acked 9114 Write 10 Done New Done false
31871 8116 Acked 9115 Read 9 Done New Done false
31872 8117 Acked 9116 Read 7 Done New Done false
31873 8118 Acked 9117 Read 4 Done New Done false
31874 8119 Acked 9118 Read 2 Done New Done false
31875 8120 Acked 9119 Write 3 Done New Done false
31876 8121 Acked 9120 Read 3 Done New Done false
31877 8122 Acked 9121 Write 1 Done New Done false
31878 8123 Acked 9122 Read 1 Done New Done false
31879 8124 Acked 9123 Read 2 Done New Done false
31880 8125 Acked 9124 Read 8 Done New Done false
31881 8126 Acked 9125 Read 8 Done New Done false
31882 8127 Acked 9126 Write 4 Done New Done false
31883 8128 Acked 9127 Read 1 Done New Done false
31884 8129 Acked 9128 Write 5 Done New Done false
31885 8130 Acked 9129 Flush 0 Done New Done false
31886 8131 Acked 9130 Read 1 Done New Done false
31887 8132 Acked 9131 Write 4 Done New Done false
31888 8133 Acked 9132 Read 2 Done New Done false
31889 8134 Acked 9133 Write 9 Done New Done false
31890 8135 Acked 9134 Write 6 Done New Done false
31891 8136 Acked 9135 Read 8 Done New Done false
31892 8137 Acked 9136 Write 5 Done New Done false
31893 8138 Acked 9137 Write 7 Done New Done false
31894 STATES DS:0 DS:1 DS:2 TOTAL
31895 New 0 301 0 301
31896 Sent 0 0 0 0
31897 Done 301 0 301 602
31898 Skipped 0 0 0 0
31899 Error 0 0 0 0
31900 Last Flush: 9129 8836 9129
31901 Downstairs last five completed: 8836 8835 8834 8833 8832
31902 Upstairs last five completed: 8138 8137 8136 8135 8134
31903 CLIENT: Up:0 ds:301 act:2
31904 [8820] got start action
31905 [8820] I am going to restart
31906 Starting downstairs at port 8820
31907 Make output file at "/tmp/dsc/downstairs-8820.txt"
31908 [8820][1] reports Starting
31909 Downstairs /var/tmp/dsc/region/8820 port 8820 PID:Some(1223)
31910 [8820][1] reports Running
31911 ----------------------------------------------------------------
31912 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:302
31913 States: Active Offline Active
31914 GW_ID ACK DSID TYPE BLOCKS DS:0 DS:1 DS:2 REPLAY
31915 7838 Acked 8837 Flush 0 Done New Done false
31916 7839 Acked 8838 Write 10 Done New Done false
31917 7840 Acked 8839 Read 6 Done New Done false
31918 7841 Acked 8840 Write 1 Done New Done false
31919 7842 Acked 8841 Flush 0 Done New Done false
31920 7843 Acked 8842 Read 4 Done New Done false
31921 7844 Acked 8843 Read 5 Done New Done false
31922 7845 Acked 8844 Read 7 Done New Done false
31923 7846 Acked 8845 Write 7 Done New Done false
31924 7847 Acked 8846 Write 5 Done New Done false
31925 7848 Acked 8847 Read 6 Done New Done false
31926 7849 Acked 8848 Read 9 Done New Done false
31927 7850 Acked 8849 Write 2 Done New Done false
31928 7851 Acked 8850 Write 4 Done New Done false
31929 7852 Acked 8851 Flush 0 Done New Done false
31930 7853 Acked 8852 Write 5 Done New Done false
31931 7854 Acked 8853 Write 9 Done New Done false
31932 7855 Acked 8854 Read 8 Done New Done false
31933 7856 Acked 8855 Read 5 Done New Done false
31934 7857 Acked 8856 Write 7 Done New Done false
31935 7858 Acked 8857 Flush 0 Done New Done false
31936 7859 Acked 8858 Write 2 Done New Done false
31937 7860 Acked 8859 Write 8 Done New Done false
31938 7861 Acked 8860 Read 8 Done New Done false
31939 7862 Acked 8861 Write 6 Done New Done false
31940 7863 Acked 8862 Write 1 Done New Done false
31941 7864 Acked 8863 Read 9 Done New Done false
31942 7865 Acked 8864 Read 4 Done New Done false
31943 7866 Acked 8865 Read 10 Done New Done false
31944 7867 Acked 8866 Write 7 Done New Done false
31945 7868 Acked 8867 Read 3 Done New Done false
31946 7869 Acked 8868 Read 9 Done New Done false
31947 7870 Acked 8869 Read 2 Done New Done false
31948 7871 Acked 8870 Write 6 Done New Done false
31949 7872 Acked 8871 Write 9 Done New Done false
31950 7873 Acked 8872 Read 10 Done New Done false
31951 7874 Acked 8873 Write 2 Done New Done false
31952 7875 Acked 8874 Read 7 Done New Done false
31953 7876 Acked 8875 Read 9 Done New Done false
31954 7877 Acked 8876 Read 2 Done New Done false
31955 7878 Acked 8877 Read 6 Done New Done false
31956 7879 Acked 8878 Read 6 Done New Done false
31957 7880 Acked 8879 Write 10 Done New Done false
31958 7881 Acked 8880 Write 9 Done New Done false
31959 7882 Acked 8881 Write 6 Done New Done false
31960 7883 Acked 8882 Write 5 Done New Done false
31961 7884 Acked 8883 Read 5 Done New Done false
31962 7885 Acked 8884 Read 2 Done New Done false
31963 7886 Acked 8885 Read 8 Done New Done false
31964 7887 Acked 8886 Flush 0 Done New Done false
31965 7888 Acked 8887 Read 8 Done New Done false
31966 7889 Acked 8888 Flush 0 Done New Done false
31967 7890 Acked 8889 Write 9 Done New Done false
31968 7891 Acked 8890 Write 3 Done New Done false
31969 7892 Acked 8891 Read 4 Done New Done false
31970 7893 Acked 8892 Write 1 Done New Done false
31971 7894 Acked 8893 Read 9 Done New Done false
31972 7895 Acked 8894 Read 2 Done New Done false
31973 7896 Acked 8895 Read 5 Done New Done false
31974 7897 Acked 8896 Read 9 Done New Done false
31975 7898 Acked 8897 Write 5 Done New Done false
31976 7899 Acked 8898 Flush 0 Done New Done false
31977 7900 Acked 8899 Write 2 Done New Done false
31978 7901 Acked 8900 Write 6 Done New Done false
31979 7902 Acked 8901 Write 8 Done New Done false
31980 7903 Acked 8902 Read 5 Done New Done false
31981 7904 Acked 8903 Read 3 Done New Done false
31982 7905 Acked 8904 Write 3 Done New Done false
31983 7906 Acked 8905 Write 3 Done New Done false
31984 7907 Acked 8906 Flush 0 Done New Done false
31985 7908 Acked 8907 Write 4 Done New Done false
31986 7909 Acked 8908 Read 4 Done New Done false
31987 7910 Acked 8909 Flush 0 Done New Done false
31988 7911 Acked 8910 Write 7 Done New Done false
31989 7912 Acked 8911 Write 9 Done New Done false
31990 7913 Acked 8912 Write 9 Done New Done false
31991 7914 Acked 8913 Write 3 Done New Done false
31992 7915 Acked 8914 Read 8 Done New Done false
31993 7916 Acked 8915 Read 6 Done New Done false
31994 7917 Acked 8916 Read 10 Done New Done false
31995 7918 Acked 8917 Read 2 Done New Done false
31996 7919 Acked 8918 Write 1 Done New Done false
31997 7920 Acked 8919 Read 3 Done New Done false
31998 7921 Acked 8920 Flush 0 Done New Done false
31999 7922 Acked 8921 Write 1 Done New Done false
32000 7923 Acked 8922 Read 7 Done New Done false
32001 7924 Acked 8923 Read 9 Done New Done false
32002 7925 Acked 8924 Write 7 Done New Done false
32003 7926 Acked 8925 Write 5 Done New Done false
32004 7927 Acked 8926 Write 9 Done New Done false
32005 7928 Acked 8927 Read 9 Done New Done false
32006 7929 Acked 8928 Read 4 Done New Done false
32007 7930 Acked 8929 Flush 0 Done New Done false
32008 7931 Acked 8930 Read 10 Done New Done false
32009 7932 Acked 8931 Read 8 Done New Done false
32010 7933 Acked 8932 Write 4 Done New Done false
32011 7934 Acked 8933 Write 3 Done New Done false
32012 7935 Acked 8934 Write 6 Done New Done false
32013 7936 Acked 8935 Read 9 Done New Done false
32014 7937 Acked 8936 Write 10 Done New Done false
32015 7938 Acked 8937 Read 2 Done New Done false
32016 7939 Acked 8938 Read 3 Done New Done false
32017 7940 Acked 8939 Read 5 Done New Done false
32018 7941 Acked 8940 Read 8 Done New Done false
32019 7942 Acked 8941 Write 4 Done New Done false
32020 7943 Acked 8942 Flush 0 Done New Done false
32021 7944 Acked 8943 Read 9 Done New Done false
32022 7945 Acked 8944 Flush 0 Done New Done false
32023 7946 Acked 8945 Flush 0 Done New Done false
32024 7947 Acked 8946 Read 5 Done New Done false
32025 7948 Acked 8947 Read 5 Done New Done false
32026 7949 Acked 8948 Read 3 Done New Done false
32027 7950 Acked 8949 Read 6 Done New Done false
32028 7951 Acked 8950 Write 6 Done New Done false
32029 7952 Acked 8951 Read 1 Done New Done false
32030 7953 Acked 8952 Write 10 Done New Done false
32031 7954 Acked 8953 Read 5 Done New Done false
32032 7955 Acked 8954 Read 3 Done New Done false
32033 7956 Acked 8955 Flush 0 Done New Done false
32034 7957 Acked 8956 Write 4 Done New Done false
32035 7958 Acked 8957 Flush 0 Done New Done false
32036 7959 Acked 8958 Write 5 Done New Done false
32037 7960 Acked 8959 Read 8 Done New Done false
32038 7961 Acked 8960 Read 7 Done New Done false
32039 7962 Acked 8961 Write 10 Done New Done false
32040 7963 Acked 8962 Flush 0 Done New Done false
32041 7964 Acked 8963 Read 10 Done New Done false
32042 7965 Acked 8964 Read 9 Done New Done false
32043 7966 Acked 8965 Read 7 Done New Done false
32044 7967 Acked 8966 Write 3 Done New Done false
32045 7968 Acked 8967 Write 2 Done New Done false
32046 7969 Acked 8968 Read 4 Done New Done false
32047 7970 Acked 8969 Write 1 Done New Done false
32048 7971 Acked 8970 Read 7 Done New Done false
32049 7972 Acked 8971 Write 8 Done New Done false
32050 7973 Acked 8972 Write 7 Done New Done false
32051 7974 Acked 8973 Write 6 Done New Done false
32052 7975 Acked 8974 Read 9 Done New Done false
32053 7976 Acked 8975 Flush 0 Done New Done false
32054 7977 Acked 8976 Read 5 Done New Done false
32055 7978 Acked 8977 Write 7 Done New Done false
32056 7979 Acked 8978 Write 1 Done New Done false
32057 7980 Acked 8979 Flush 0 Done New Done false
32058 7981 Acked 8980 Read 3 Done New Done false
32059 7982 Acked 8981 Write 6 Done New Done false
32060 7983 Acked 8982 Read 9 Done New Done false
32061 7984 Acked 8983 Write 10 Done New Done false
32062 7985 Acked 8984 Read 5 Done New Done false
32063 7986 Acked 8985 Read 5 Done New Done false
32064 7987 Acked 8986 Write 10 Done New Done false
32065 7988 Acked 8987 Write 4 Done New Done false
32066 7989 Acked 8988 Read 8 Done New Done false
32067 7990 Acked 8989 Read 9 Done New Done false
32068 7991 Acked 8990 Write 9 Done New Done false
32069 7992 Acked 8991 Read 4 Done New Done false
32070 7993 Acked 8992 Read 2 Done New Done false
32071 7994 Acked 8993 Read 8 Done New Done false
32072 7995 Acked 8994 Write 8 Done New Done false
32073 7996 Acked 8995 Read 2 Done New Done false
32074 7997 Acked 8996 Read 9 Done New Done false
32075 7998 Acked 8997 Write 9 Done New Done false
32076 7999 Acked 8998 Read 10 Done New Done false
32077 8000 Acked 8999 Flush 0 Done New Done false
32078 8001 Acked 9000 Read 1 Done New Done false
32079 8002 Acked 9001 Write 1 Done New Done false
32080 8003 Acked 9002 Read 1 Done New Done false
32081 8004 Acked 9003 Read 3 Done New Done false
32082 8005 Acked 9004 Write 5 Done New Done false
32083 8006 Acked 9005 Read 6 Done New Done false
32084 8007 Acked 9006 Read 10 Done New Done false
32085 8008 Acked 9007 Read 1 Done New Done false
32086 8009 Acked 9008 Write 1 Done New Done false
32087 8010 Acked 9009 Read 7 Done New Done false
32088 8011 Acked 9010 Read 3 Done New Done false
32089 8012 Acked 9011 Write 9 Done New Done false
32090 8013 Acked 9012 Flush 0 Done New Done false
32091 8014 Acked 9013 Write 6 Done New Done false
32092 8015 Acked 9014 Write 8 Done New Done false
32093 8016 Acked 9015 Write 10 Done New Done false
32094 8017 Acked 9016 Write 3 Done New Done false
32095 8018 Acked 9017 Read 5 Done New Done false
32096 8019 Acked 9018 Read 10 Done New Done false
32097 8020 Acked 9019 Write 3 Done New Done false
32098 8021 Acked 9020 Write 6 Done New Done false
32099 8022 Acked 9021 Write 2 Done New Done false
32100 8023 Acked 9022 Read 10 Done New Done false
32101 8024 Acked 9023 Read 1 Done New Done false
32102 8025 Acked 9024 Write 2 Done New Done false
32103 8026 Acked 9025 Write 10 Done New Done false
32104 8027 Acked 9026 Flush 0 Done New Done false
32105 8028 Acked 9027 Read 10 Done New Done false
32106 8029 Acked 9028 Read 4 Done New Done false
32107 8030 Acked 9029 Write 7 Done New Done false
32108 8031 Acked 9030 Write 10 Done New Done false
32109 8032 Acked 9031 Read 8 Done New Done false
32110 8033 Acked 9032 Read 4 Done New Done false
32111 8034 Acked 9033 Write 10 Done New Done false
32112 8035 Acked 9034 Write 2 Done New Done false
32113 8036 Acked 9035 Write 2 Done New Done false
32114 8037 Acked 9036 Flush 0 Done New Done false
32115 8038 Acked 9037 Write 3 Done New Done false
32116 8039 Acked 9038 Write 3 Done New Done false
32117 8040 Acked 9039 Write 5 Done New Done false
32118 8041 Acked 9040 Write 9 Done New Done false
32119 8042 Acked 9041 Write 6 Done New Done false
32120 8043 Acked 9042 Read 8 Done New Done false
32121 8044 Acked 9043 Read 1 Done New Done false
32122 8045 Acked 9044 Read 4 Done New Done false
32123 8046 Acked 9045 Flush 0 Done New Done false
32124 8047 Acked 9046 Read 9 Done New Done false
32125 8048 Acked 9047 Write 8 Done New Done false
32126 8049 Acked 9048 Flush 0 Done New Done false
32127 8050 Acked 9049 Read 9 Done New Done false
32128 8051 Acked 9050 Write 7 Done New Done false
32129 8052 Acked 9051 Write 3 Done New Done false
32130 8053 Acked 9052 Read 1 Done New Done false
32131 8054 Acked 9053 Write 10 Done New Done false
32132 8055 Acked 9054 Write 4 Done New Done false
32133 8056 Acked 9055 Write 7 Done New Done false
32134 8057 Acked 9056 Read 5 Done New Done false
32135 8058 Acked 9057 Write 8 Done New Done false
32136 8059 Acked 9058 Read 4 Done New Done false
32137 8060 Acked 9059 Flush 0 Done New Done false
32138 8061 Acked 9060 Write 10 Done New Done false
32139 8062 Acked 9061 Write 5 Done New Done false
32140 8063 Acked 9062 Read 8 Done New Done false
32141 8064 Acked 9063 Read 5 Done New Done false
32142 8065 Acked 9064 Read 6 Done New Done false
32143 8066 Acked 9065 Read 7 Done New Done false
32144 8067 Acked 9066 Write 4 Done New Done false
32145 8068 Acked 9067 Read 8 Done New Done false
32146 8069 Acked 9068 Read 9 Done New Done false
32147 8070 Acked 9069 Write 10 Done New Done false
32148 8071 Acked 9070 Flush 0 Done New Done false
32149 8072 Acked 9071 Write 10 Done New Done false
32150 8073 Acked 9072 Read 2 Done New Done false
32151 8074 Acked 9073 Read 7 Done New Done false
32152 8075 Acked 9074 Write 10 Done New Done false
32153 8076 Acked 9075 Read 3 Done New Done false
32154 8077 Acked 9076 Read 10 Done New Done false
32155 8078 Acked 9077 Write 9 Done New Done false
32156 8079 Acked 9078 Read 4 Done New Done false
32157 8080 Acked 9079 Write 8 Done New Done false
32158 8081 Acked 9080 Read 7 Done New Done false
32159 8082 Acked 9081 Read 2 Done New Done false
32160 8083 Acked 9082 Read 5 Done New Done false
32161 8084 Acked 9083 Write 9 Done New Done false
32162 8085 Acked 9084 Write 4 Done New Done false
32163 8086 Acked 9085 Write 10 Done New Done false
32164 8087 Acked 9086 Read 6 Done New Done false
32165 8088 Acked 9087 Write 7 Done New Done false
32166 8089 Acked 9088 Read 10 Done New Done false
32167 8090 Acked 9089 Read 4 Done New Done false
32168 8091 Acked 9090 Write 10 Done New Done false
32169 8092 Acked 9091 Read 1 Done New Done false
32170 8093 Acked 9092 Read 7 Done New Done false
32171 8094 Acked 9093 Write 9 Done New Done false
32172 8095 Acked 9094 Write 5 Done New Done false
32173 8096 Acked 9095 Read 10 Done New Done false
32174 8097 Acked 9096 Read 2 Done New Done false
32175 8098 Acked 9097 Flush 0 Done New Done false
32176 8099 Acked 9098 Flush 0 Done New Done false
32177 8100 Acked 9099 Read 4 Done New Done false
32178 8101 Acked 9100 Write 5 Done New Done false
32179 8102 Acked 9101 Write 7 Done New Done false
32180 8103 Acked 9102 Read 9 Done New Done false
32181 8104 Acked 9103 Write 5 Done New Done false
32182 8105 Acked 9104 Write 10 Done New Done false
32183 8106 Acked 9105 Flush 0 Done New Done false
32184 8107 Acked 9106 Flush 0 Done New Done false
32185 8108 Acked 9107 Write 6 Done New Done false
32186 8109 Acked 9108 Write 1 Done New Done false
32187 8110 Acked 9109 Write 2 Done New Done false
32188 8111 Acked 9110 Read 5 Done New Done false
32189 8112 Acked 9111 Read 2 Done New Done false
32190 8113 Acked 9112 Read 7 Done New Done false
32191 8114 Acked 9113 Write 6 Done New Done false
32192 8115 Acked 9114 Write 10 Done New Done false
32193 8116 Acked 9115 Read 9 Done New Done false
32194 8117 Acked 9116 Read 7 Done New Done false
32195 8118 Acked 9117 Read 4 Done New Done false
32196 8119 Acked 9118 Read 2 Done New Done false
32197 8120 Acked 9119 Write 3 Done New Done false
32198 8121 Acked 9120 Read 3 Done New Done false
32199 8122 Acked 9121 Write 1 Done New Done false
32200 8123 Acked 9122 Read 1 Done New Done false
32201 8124 Acked 9123 Read 2 Done New Done false
32202 8125 Acked 9124 Read 8 Done New Done false
32203 8126 Acked 9125 Read 8 Done New Done false
32204 8127 Acked 9126 Write 4 Done New Done false
32205 8128 Acked 9127 Read 1 Done New Done false
32206 8129 Acked 9128 Write 5 Done New Done false
32207 8130 Acked 9129 Flush 0 Done New Done false
32208 8131 Acked 9130 Read 1 Done New Done false
32209 8132 Acked 9131 Write 4 Done New Done false
32210 8133 Acked 9132 Read 2 Done New Done false
32211 8134 Acked 9133 Write 9 Done New Done false
32212 8135 Acked 9134 Write 6 Done New Done false
32213 8136 Acked 9135 Read 8 Done New Done false
32214 8137 Acked 9136 Write 5 Done New Done false
32215 8138 Acked 9137 Write 7 Done New Done false
32216 8139 Acked 9138 Flush 0 Done New Done false
32217 STATES DS:0 DS:1 DS:2 TOTAL
32218 New 0 302 0 302
32219 Sent 0 0 0 0
32220 Done 302 0 302 604
32221 Skipped 0 0 0 0
32222 Error 0 0 0 0
32223 Last Flush: 9138 8836 9138
32224 Downstairs last five completed: 8836 8835 8834 8833 8832
32225 Upstairs last five completed: 8139 8138 8137 8136 8135
32226 CLIENT: Up:0 ds:302 act:2
322272024-04-20T01:11:50.316ZINFOcrucible: connecting to 127.0.0.1:8820 = io task client = 1 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
322282024-04-20T01:11:50.316ZINFOcrucible: ds_connection connected from Ok(127.0.0.1:59859) = io task client = 1 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
322292024-04-20T01:11:50.318ZINFOcrucible: downstairs client at Some(127.0.0.1:8820) has region UUID 12345678-0000-0000-0000-000000008820 = downstairs client = 1 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
322302024-04-20T01:11:50.318ZINFOcrucible: Returning UUID:12345678-0000-0000-0000-000000008820 matches = downstairs client = 1 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
322312024-04-20T01:11:50.318ZINFOcrucible: send last flush ID to this DS: 8836 = downstairs client = 1 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
322322024-04-20T01:11:50.318ZINFOcrucible: Replied this last flush ID: 8836 = downstairs client = 1 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
322332024-04-20T01:11:50.318ZINFOcrucible: ds_transition from Offline to Replay = downstairs client = 1 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
322342024-04-20T01:11:50.318ZINFOcrucible: [1] Transition from Offline to Replay = downstairs client = 1 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
322352024-04-20T01:11:50.318ZINFOcrucible: ds_transition from Replay to Active = downstairs client = 1 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
322362024-04-20T01:11:50.318ZINFOcrucible: [1] Transition from Replay to Active = downstairs client = 1 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
32237 ----------------------------------------------------------------
32238 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:0
32239 Downstairs last five completed: 9138 9137 9136 9135 9134
32240 Upstairs last five completed: 8139 8138 8137 8136 8135
32241 CLIENT: Up:0 ds:0 act:3
32242 Replay: All jobs finished, all DS active.
32243 Main task has work to do, go find it
32244 got dsc Stop(0)
32245 stop 0
32246 Apr 20 01:11:52.634 [8810] Got stop action so:false kr:false
32247 INFO request completed, latency_us: 337, response_code: 204, uri: /stop/cid/0, method: POST, req_id: 1c52b325-cf49-4b52-b45e-d662ed96c152, remote_addr: 127.0.0.1:60352, local_addr: 127.0.0.1:9998
32248 Apr 20 01:11:52.635 INFO request completed, latency_us: 107, response_code: 200, uri: {"msg":"downstairs disconnected","v":0,"name":"crucible","level":40,"time":"2024-04-20T01:11:52.635422416Z","hostname":"w-01HVWGBJP7HK0H9TQ26T6N3X8M","pid":1196,"":"io task","client":"0","":"downstairs","session_id":"132b460a-26a0-4532-b1ab-4f8c07d4c6c7"}
32249 /state/cid/0, method: GET{"msg":"client task is sending Done(Finished)","v":0,"name":"crucible","level":40,"time":"2024-04-20T01:11:52.635490344Z","hostname":"w-01HVWGBJP7HK0H9TQ26T6N3X8M","pid":1196,"":"io task","client":"0","":"downstairs","session_id":"132b460a-26a0-4532-b1ab-4f8c07d4c6c7"}
32250 , req_id: 235ae99d-6389-4324-99d4-365d614269b4, {"msg":"downstairs task for 0 stopped due to Finished","v":0,"name":"crucible","level":40,"time":"2024-04-20T01:11:52.635517804Z","hostname":"w-01HVWGBJP7HK0H9TQ26T6N3X8M","pid":1196,"session_id":"132b460a-26a0-4532-b1ab-4f8c07d4c6c7"}
32251 remote_addr{"msg":"Gone missing, transition from Active to Offline","v":0,"name":"crucible","level":30,"time":"2024-04-20T01:11:52.635540693Z","hostname":"w-01HVWGBJP7HK0H9TQ26T6N3X8M","pid":1196,"client":"0","":"downstairs","session_id":"132b460a-26a0-4532-b1ab-4f8c07d4c6c7"}
32252 : 127.{"msg":"[0] client re-new 0 jobs since flush 9138","v":0,"name":"crucible","level":30,"time":"2024-04-20T01:11:52.635599071Z","hostname":"w-01HVWGBJP7HK0H9TQ26T6N3X8M","pid":1196,"":"downstairs","":"downstairs","session_id":"132b460a-26a0-4532-b1ab-4f8c07d4c6c7"}
32253 0.0.1:60352, local_addr:{"msg":"[0] Marked 0 jobs for replay since flush: 9138","v":0,"name":"crucible","level":30,"time":"2024-04-20T01:11:52.63563341Z","hostname":"w-01HVWGBJP7HK0H9TQ26T6N3X8M","pid":1196,"":"downstairs","":"downstairs","session_id":"132b460a-26a0-4532-b1ab-4f8c07d4c6c7"}
32254 127.0.0.1:9998
322552024-04-20T01:11:52.635ZINFOcrucible: client task is exiting = io task client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
32256 [8810] Exited with: ExitStatus(unix_wait_status(9))
32257 [8810][0] reports Exit
32258 Apr 20 01:11:56.637 INFO request completed, latency_us: 239, response_code: 200, uri: /state/cid/0, method: GET, req_id: 262aec68-a473-466b-ac7b-a4e74a08d5f3, remote_addr: 127.0.0.1:60352, local_addr: 127.0.0.1:9998
32259 001/300 Write block 3606 len 40960 data: 6 7 7 7 8 6 5 6 8 7
32260 002/300 Read block 4392 len 40960
32261 003/300 Read block 2093 len 20480
32262 004/300 Read block 4092 len 40960
32263 005/300 Read block 1977 len 16384
32264 006/300 Read block 1946 len 40960
32265 007/300 Write block 2934 len 8192 data: 5 4
32266 008/300 Flush
32267 009/300 Read block 4701 len 36864
32268 010/300 Read block 2749 len 24576
32269 011/300 Read block 2186 len 32768
32270 012/300 Write block 169 len 36864 data: 6 7 7 7 8 6 7 6 5
32271 013/300 Write block 4547 len 16384 data: 7 7 5 5
32272 014/300 Write block 3141 len 20480 data: 2 2 2 2 2
32273 015/300 Write block 3181 len 24576 data: 6 7 7 7 7 8
32274 016/300 Read block 1839 len 36864
32275 017/300 Write block 4891 len 12288 data: 5 6 5
32276 018/300 Write block 3120 len 4096 data: 5
32277 019/300 Flush
32278 020/300 Read block 4990 len 20480
32279 021/300 Read block 4056 len 28672
32280 022/300 Read block 2881 len 28672
32281 023/300 Write block 3415 len 12288 data: 3 4 5
32282 024/300 Read block 3701 len 8192
32283 025/300 Write block 295 len 24576 data: 5 6 6 8 8 7
32284 026/300 Read block 69 len 4096
32285 027/300 Flush
32286 028/300 Write block 279 len 8192 data: 9 7
32287 029/300 Write block 431 len 28672 data: 4 4 3 3 3 3 4
32288 030/300 Write block 3561 len 4096 data: 3
32289 031/300 Write block 344 len 20480 data: 5 4 5 4 5
32290 032/300 Read block 4646 len 40960
32291 033/300 Write block 4275 len 28672 data: 5 4 3 3 4 4 4
32292 034/300 Write block 4301 len 16384 data: 6 7 6 5
32293 035/300 Read block 3019 len 4096
32294 036/300 Write block 4576 len 20480 data: 7 4 4 5 4
32295 037/300 Write block 4156 len 40960 data: 3 3 5 5 5 5 4 5 5 5
32296 038/300 Write block 4470 len 24576 data: 3 5 5 5 5 5
32297 039/300 Read block 1645 len 40960
32298 040/300 Write block 290 len 12288 data: 3 3 3
32299 041/300 Read block 1850 len 24576
32300 042/300 Write block 166 len 20480 data: 5 6 6 7 8
32301 043/300 Read block 4029 len 28672
32302 044/300 Read block 3508 len 8192
32303 045/300 Write block 1900 len 24576 data: 5 4 6 8 6 6
32304 046/300 Read block 648 len 12288
32305 047/300 Read block 2247 len 12288
32306 048/300 Flush
32307 049/300 Read block 222 len 24576
32308 050/300 Write block 1798 len 8192 data: 6 6
32309 051/300 Write block 4004 len 8192 data: 11 11
32310 052/300 Read block 1070 len 28672
32311 053/300 Read block 3189 len 24576
32312 054/300 Write block 3787 len 32768 data: 10 10 11 9 6 5 5 5
32313 055/300 Write block 451 len 16384 data: 7 6 7 5
32314 056/300 Read block 1428 len 24576
32315 057/300 Write block 4176 len 32768 data: 3 3 4 5 6 7 9 7
32316 058/300 Read block 936 len 16384
32317 059/300 Flush
32318 060/300 Write block 3705 len 40960 data: 7 7 7 8 7 7 7 7 7 6
32319 061/300 Read block 4279 len 16384
32320 062/300 Read block 2811 len 28672
32321 063/300 Flush
32322 064/300 Read block 4527 len 40960
32323 065/300 Read block 2159 len 24576
32324 066/300 Write block 2621 len 32768 data: 8 8 9 9 9 8 9 7
32325 067/300 Write block 3881 len 4096 data: 7
32326 068/300 Read block 3648 len 8192
32327 069/300 Write block 3053 len 36864 data: 3 2 2 3 3 3 4 4 4
32328 070/300 Read block 499 len 4096
32329 071/300 Read block 2662 len 20480
32330 072/300 Flush
32331 073/300 Read block 1078 len 4096
32332 074/300 Read block 1643 len 4096
32333 075/300 Write block 2746 len 40960 data: 7 6 6 8 8 7 8 9 8 7
32334 076/300 Read block 4680 len 40960
32335 077/300 Read block 3622 len 36864
32336 078/300 Write block 3390 len 24576 data: 6 7 5 6 5 5
32337 079/300 Read block 2268 len 36864
32338 080/300 Read block 3447 len 40960
32339 081/300 Read block 1555 len 12288
32340 082/300 Flush
32341 083/300 Read block 3578 len 32768
32342 084/300 Read block 2808 len 12288
32343 085/300 Write block 989 len 8192 data: 2 3
32344 086/300 Read block 941 len 28672
32345 087/300 Read block 4537 len 24576
32346 088/300 Write block 3567 len 36864 data: 4 3 3 5 5 4 5 5 4
32347 089/300 Read block 1952 len 40960
32348 090/300 Read block 3705 len 24576
32349 091/300 Flush
32350 092/300 Read block 3937 len 32768
32351 093/300 Write block 1377 len 36864 data: 5 7 7 7 7 6 5 5 6
32352 094/300 Flush
32353 095/300 Write block 388 len 8192 data: 5 5
32354 096/300 Write block 3767 len 4096 data: 6
32355 097/300 Write block 3891 len 36864 data: 5 6 5 5 4 4 5 3 5
32356 098/300 Write block 3649 len 20480 data: 6 5 5 3 2
32357 099/300 Read block 4213 len 12288
32358 100/300 Write block 1827 len 20480 data: 4 5 5 5 4
32359 101/300 Write block 1694 len 8192 data: 5 6
32360 102/300 Read block 1068 len 40960
32361 103/300 Read block 3185 len 36864
32362 104/300 Read block 820 len 4096
32363 105/300 Write block 2600 len 24576 data: 8 8 6 7 7 8
32364 106/300 Write block 1525 len 24576 data: 5 4 5 5 5 7
32365 107/300 Write block 82 len 32768 data: 6 7 7 7 7 8 8 8
32366 108/300 Write block 4128 len 8192 data: 7 7
32367 109/300 Read block 2629 len 28672
32368 110/300 Write block 2813 len 20480 data: 9 7 7 6 5
32369 111/300 Read block 4136 len 20480
32370 112/300 Read block 3723 len 28672
32371 113/300 Read block 3348 len 36864
32372 114/300 Write block 3116 len 40960 data: 7 8 8 6 6 4 6 7 7 7
32373 115/300 Flush
32374 116/300 Read block 2443 len 16384
32375 117/300 Write block 375 len 4096 data: 4
32376 118/300 Write block 3481 len 24576 data: 7 6 5 6 7 5
32377 119/300 Read block 2147 len 20480
32378 120/300 Write block 1768 len 20480 data: 7 6 8 8 9
32379 121/300 Read block 4659 len 12288
32380 122/300 Flush
32381 123/300 Read block 2148 len 20480
32382 124/300 Read block 2532 len 8192
32383 125/300 Read block 4268 len 20480
32384 126/300 Read block 530 len 28672
32385 127/300 Read block 3419 len 24576
32386 128/300 Write block 1746 len 40960 data: 5 5 5 5 4 3 3 4 5 5
32387 129/300 Read block 2669 len 32768
32388 130/300 Write block 1173 len 8192 data: 7 7
32389 131/300 Read block 423 len 12288
32390 132/300 Flush
32391 133/300 Read block 2367 len 28672
32392 134/300 Read block 2636 len 36864
32393 135/300 Read block 3224 len 4096
32394 136/300 Read block 3365 len 36864
32395 137/300 Write block 2440 len 24576 data: 6 6 5 5 4 4
32396 138/300 Read block 729 len 40960
32397 139/300 Write block 4575 len 4096 data: 8
32398 140/300 Read block 487 len 28672
32399 141/300 Write block 1844 len 40960 data: 2 2 3 3 3 3 6 6 8 9
32400 142/300 Flush
32401 143/300 Write block 3567 len 32768 data: 5 4 4 6 6 5 6 6
32402 144/300 Read block 2876 len 36864
32403 145/300 Write block 71 len 20480 data: 4 3 5 5 5
32404 146/300 Write block 4210 len 4096 data: 3
32405 147/300 Write block 29 len 12288 data: 2 2 2
32406 148/300 Write block 1824 len 24576 data: 6 2 4 5 6 6
32407 149/300 Write block 168 len 8192 data: 7 8
32408 150/300 Read block 2581 len 32768
32409 151/300 Read block 4977 len 36864
32410 152/300 Read block 3311 len 12288
32411 153/300 Write block 4623 len 12288 data: 4 4 4
32412 154/300 Write block 2572 len 24576 data: 4 4 5 5 4 4
32413 155/300 Read block 2433 len 40960
32414 156/300 Read block 1387 len 4096
32415 157/300 Read block 4286 len 40960
32416 158/300 Write block 3754 len 4096 data: 8
32417 159/300 Read block 2418 len 28672
32418 160/300 Read block 1229 len 16384
32419 161/300 Read block 4664 len 32768
32420 162/300 Read block 453 len 36864
32421 163/300 Write block 4316 len 12288 data: 7 6 7
32422 164/300 Write block 2303 len 36864 data: 6 7 7 6 4 3 5 5 7
32423 165/300 Flush
32424 166/300 Write block 1422 len 16384 data: 4 3 2 2
32425 167/300 Write block 1363 len 36864 data: 5 4 3 5 5 5 4 4 5
32426 168/300 Read block 92 len 36864
32427 169/300 Read block 4953 len 20480
32428 170/300 Write block 4862 len 16384 data: 8 8 6 6
32429 171/300 Write block 2920 len 36864 data: 4 5 5 5 4 3 3 3 4
32430 172/300 Write block 1483 len 4096 data: 4
32431 173/300 Read block 1827 len 24576
32432 174/300 Write block 4980 len 4096 data: 4
32433 175/300 Write block 548 len 36864 data: 3 2 3 3 3 3 3 3 4
32434 176/300 Write block 3197 len 8192 data: 7 9
32435 177/300 Flush
32436 178/300 Write block 3313 len 8192 data: 9 7
32437 179/300 Write block 1414 len 32768 data: 6 5 7 7 7 6 5 4
32438 180/300 Write block 3473 len 40960 data: 4 5 3 6 8 8 8 7 8 7
32439 181/300 Read block 2080 len 32768
32440 182/300 Write block 4117 len 36864 data: 4 5 6 5 6 5 8 8 8
32441 183/300 Write block 2839 len 20480 data: 8 8 10 9 11
32442 184/300 Write block 4794 len 24576 data: 3 2 3 5 5 5
32443 185/300 Read block 372 len 4096
32444 186/300 Write block 3556 len 4096 data: 5
32445 187/300 Write block 1811 len 24576 data: 3 4 5 6 7 5
32446 188/300 Read block 4734 len 12288
32447 189/300 Read block 3543 len 16384
32448 190/300 Write block 1360 len 32768 data: 6 5 5 6 5 4 6 6
32449 191/300 Write block 4698 len 40960 data: 3 3 5 7 7 7 5 5 6 5
32450 192/300 Read block 2260 len 16384
32451 193/300 Read block 258 len 40960
32452 194/300 Flush
32453 195/300 Write block 1753 len 24576 data: 5 6 6 5 6 7
32454 196/300 Write block 3807 len 20480 data: 5 4 3 3 3
32455 197/300 Read block 2202 len 12288
32456 198/300 Write block 279 len 16384 data: 10 8 6 5
32457 199/300 Read block 2975 len 40960
32458 200/300 Read block 4499 len 16384
32459 201/300 Read block 4211 len 24576
32460 202/300 Write block 2654 len 36864 data: 6 5 5 4 5 4 5 5 5
32461 203/300 Read block 4481 len 28672
32462 204/300 Flush
32463 205/300 Write block 4042 len 36864 data: 10 9 9 8 7 5 5 6 6
32464 206/300 Read block 2502 len 40960
32465 207/300 Read block 4310 len 20480
32466 208/300 Write block 3483 len 28672 data: 6 7 8 6 5 6 7
32467 209/300 Write block 4886 len 12288 data: 5 6 6
32468 210/300 Read block 797 len 36864
32469 211/300 Write block 707 len 32768 data: 3 4 4 5 5 5 4 4
32470 212/300 Write block 1608 len 28672 data: 7 6 4 3 4 5 6
32471 213/300 Write block 4792 len 16384 data: 4 4 4 3
32472 214/300 Flush
32473 215/300 Write block 4224 len 16384 data: 5 6 6 6
32474 216/300 Write block 2361 len 40960 data: 5 6 6 5 5 4 4 4 4 4
32475 217/300 Write block 237 len 4096 data: 4
32476 218/300 Write block 4543 len 36864 data: 4 6 6 6 8 8 6 6 5
32477 219/300 Read block 4416 len 12288
32478 220/300 Write block 1272 len 40960 data: 4 5 5 5 5 4 4 4 5 4
32479 221/300 Write block 1388 len 32768 data: 6 5 5 5 5 4 4 3
32480 222/300 Write block 3054 len 28672 data: 3 3 4 4 4 5 5
32481 223/300 Read block 4102 len 40960
32482 224/300 Read block 3212 len 12288
32483 225/300 Write block 991 len 12288 data: 4 5 6
32484 226/300 Read block 2766 len 4096
32485 227/300 Write block 1091 len 28672 data: 10 9 9 8 7 7 8
32486 228/300 Read block 1670 len 20480
32487 229/300 Read block 753 len 40960
32488 230/300 Flush
32489 231/300 Write block 3981 len 8192 data: 8 6
32490 232/300 Read block 1591 len 24576
32491 233/300 Read block 2406 len 16384
32492 234/300 Flush
32493 235/300 Read block 3782 len 8192
32494 236/300 Read block 505 len 40960
32495 237/300 Read block 4056 len 8192
32496 238/300 Read block 4376 len 40960
32497 239/300 Write block 3835 len 40960 data: 5 6 6 6 6 6 5 5 4 4
32498 240/300 Read block 2997 len 36864
32499 241/300 Flush
32500 242/300 Flush
32501 243/300 Read block 4619 len 8192
32502 244/300 Flush
32503 245/300 Write block 2341 len 24576 data: 5 5 6 6 7 8
32504 246/300 Write block 362 len 8192 data: 7 7
32505 247/300 Read block 1725 len 36864
32506 248/300 Write block 1818 len 32768 data: 7 8 7 7 8 7 7 3
32507 249/300 Read block 1378 len 20480
32508 250/300 Read block 27 len 28672
32509 251/300 Read block 4145 len 40960
32510 252/300 Read block 19 len 40960
32511 253/300 Write block 2226 len 32768 data: 8 7 7 8 5 4 4 3
32512 254/300 Read block 2038 len 8192
32513 255/300 Write block 4317 len 16384 data: 7 8 7 6
32514 256/300 Write block 2695 len 32768 data: 3 5 6 7 8 8 7 6
32515 257/300 Flush
32516 258/300 Read block 1062 len 24576
32517 259/300 Write block 1390 len 24576 data: 6 6 6 5 5 4
32518 260/300 Write block 4967 len 20480 data: 4 4 5 6 6
32519 261/300 Flush
32520 262/300 Read block 2077 len 4096
32521 263/300 Read block 4177 len 8192
32522 264/300 Write block 3642 len 24576 data: 4 5 5 5 6 5
32523 265/300 Read block 1385 len 36864
32524 266/300 Read block 3704 len 12288
32525 267/300 Read block 2777 len 28672
32526 268/300 Write block 4174 len 32768 data: 8 4 4 4 5 6 7 8
32527 269/300 Read block 3898 len 16384
32528 270/300 Flush
32529 271/300 Read block 2109 len 24576
32530 272/300 Read block 2570 len 16384
32531 273/300 Write block 774 len 40960 data: 9 8 7 5 4 3 3 4 4 6
32532 274/300 Read block 21 len 40960
32533 275/300 Write block 747 len 36864 data: 7 8 9 8 8 8 7 4 4
32534 276/300 Write block 1010 len 20480 data: 5 6 6 8 6
32535 277/300 Read block 2377 len 32768
32536 278/300 Flush
32537 279/300 Read block 985 len 40960
32538 280/300 Read block 1971 len 20480
32539 281/300 Write block 4334 len 24576 data: 4 5 6 5 5 5
32540 282/300 Write block 1211 len 40960 data: 4 5 7 7 6 6 7 5 5 4
32541 283/300 Write block 3839 len 8192 data: 7 7
32542 284/300 Write block 1961 len 28672 data: 6 6 6 5 4 4 3
32543 285/300 Read block 3528 len 40960
32544 286/300 Read block 1592 len 36864
32545 287/300 Read block 119 len 24576
32546 288/300 Write block 1540 len 12288 data: 5 5 7
32547 289/300 Read block 1329 len 24576
32548 290/300 Read block 2370 len 28672
32549 291/300 Read block 3009 len 40960
32550 292/300 Write block 2700 len 28672 data: 9 8 7 6 6 5 4
32551 293/300 Write block 3976 len 16384 data: 4 3 5 6
32552 294/300 Write block 4051 len 12288 data: 6 7 8
32553 295/300 Write block 2188 len 8192 data: 4 5
32554 296/300 Write block 4976 len 24576 data: 2 2 2 3 5 5
32555 297/300 Write block 4431 len 16384 data: 9 10 8 7
32556 298/300 Write block 3218 len 4096 data: 4
32557 299/300 Read block 4724 len 40960
32558 300/300 Write block 2644 len 40960 data: 7 6 7 6 5 4 3 3 4 4
32559 Main task has work to do, go find it
32560 got dsc Start(0)
32561 start 0
32562 Apr 20 01:11:56.953 INFO request completed, latency_us: 203, response_code: 204, uri: /start/cid/0, method: POST, req_id: 3e8d7665-a075-4c7f-990f-5d888ff863aa, remote_addr: 127.0.0.1:60352, local_addr: 127.0.0.1:9998
32563 Replay: started 0, returned:Ok(())
32564 ----------------------------------------------------------------
32565 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:301
32566 States: Offline Active Active
32567 GW_ID ACK DSID TYPE BLOCKS DS:0 DS:1 DS:2 REPLAY
32568 8140 Acked 9139 Write 10 New Done Done false
32569 8141 Acked 9140 Read 10 New Done Done false
32570 8142 Acked 9141 Read 5 New Done Done false
32571 8143 Acked 9142 Read 10 New Done Done false
32572 8144 Acked 9143 Read 4 New Done Done false
32573 8145 Acked 9144 Read 10 New Done Done false
32574 8146 Acked 9145 Write 2 New Done Done false
32575 8147 Acked 9146 Flush 0 New Done Done false
32576 8148 Acked 9147 Read 9 New Done Done false
32577 8149 Acked 9148 Read 6 New Done Done false
32578 8150 Acked 9149 Read 8 New Done Done false
32579 8151 Acked 9150 Write 9 New Done Done false
32580 8152 Acked 9151 Write 4 New Done Done false
32581 8153 Acked 9152 Write 5 New Done Done false
32582 8154 Acked 9153 Write 6 New Done Done false
32583 8155 Acked 9154 Read 9 New Done Done false
32584 8156 Acked 9155 Write 3 New Done Done false
32585 8157 Acked 9156 Write 1 New Done Done false
32586 8158 Acked 9157 Flush 0 New Done Done false
32587 8159 Acked 9158 Read 5 New Done Done false
32588 8160 Acked 9159 Read 7 New Done Done false
32589 8161 Acked 9160 Read 7 New Done Done false
32590 8162 Acked 9161 Write 3 New Done Done false
32591 8163 Acked 9162 Read 2 New Done Done false
32592 8164 Acked 9163 Write 6 New Done Done false
32593 8165 Acked 9164 Read 1 New Done Done false
32594 8166 Acked 9165 Flush 0 New Done Done false
32595 8167 Acked 9166 Write 2 New Done Done false
32596 8168 Acked 9167 Write 7 New Done Done false
32597 8169 Acked 9168 Write 1 New Done Done false
32598 8170 Acked 9169 Write 5 New Done Done false
32599 8171 Acked 9170 Read 10 New Done Done false
32600 8172 Acked 9171 Write 7 New Done Done false
32601 8173 Acked 9172 Write 4 New Done Done false
32602 8174 Acked 9173 Read 1 New Done Done false
32603 8175 Acked 9174 Write 5 New Done Done false
32604 8176 Acked 9175 Write 10 New Done Done false
32605 8177 Acked 9176 Write 6 New Done Done false
32606 8178 Acked 9177 Read 10 New Done Done false
32607 8179 Acked 9178 Write 3 New Done Done false
32608 8180 Acked 9179 Read 6 New Done Done false
32609 8181 Acked 9180 Write 5 New Done Done false
32610 8182 Acked 9181 Read 7 New Done Done false
32611 8183 Acked 9182 Read 2 New Done Done false
32612 8184 Acked 9183 Write 6 New Done Done false
32613 8185 Acked 9184 Read 3 New Done Done false
32614 8186 Acked 9185 Read 3 New Done Done false
32615 8187 Acked 9186 Flush 0 New Done Done false
32616 8188 Acked 9187 Read 6 New Done Done false
32617 8189 Acked 9188 Write 2 New Done Done false
32618 8190 Acked 9189 Write 2 New Done Done false
32619 8191 Acked 9190 Read 7 New Done Done false
32620 8192 Acked 9191 Read 6 New Done Done false
32621 8193 Acked 9192 Write 8 New Done Done false
32622 8194 Acked 9193 Write 4 New Done Done false
32623 8195 Acked 9194 Read 6 New Done Done false
32624 8196 Acked 9195 Write 8 New Done Done false
32625 8197 Acked 9196 Read 4 New Done Done false
32626 8198 Acked 9197 Flush 0 New Done Done false
32627 8199 Acked 9198 Write 10 New Done Done false
32628 8200 Acked 9199 Read 4 New Done Done false
32629 8201 Acked 9200 Read 7 New Done Done false
32630 8202 Acked 9201 Flush 0 New Done Done false
32631 8203 Acked 9202 Read 10 New Done Done false
32632 8204 Acked 9203 Read 6 New Done Done false
32633 8205 Acked 9204 Write 8 New Done Done false
32634 8206 Acked 9205 Write 1 New Done Done false
32635 8207 Acked 9206 Read 2 New Done Done false
32636 8208 Acked 9207 Write 9 New Done Done false
32637 8209 Acked 9208 Read 1 New Done Done false
32638 8210 Acked 9209 Read 5 New Done Done false
32639 8211 Acked 9210 Flush 0 New Done Done false
32640 8212 Acked 9211 Read 1 New Done Done false
32641 8213 Acked 9212 Read 1 New Done Done false
32642 8214 Acked 9213 Write 10 New Done Done false
32643 8215 Acked 9214 Read 10 New Done Done false
32644 8216 Acked 9215 Read 9 New Done Done false
32645 8217 Acked 9216 Write 6 New Done Done false
32646 8218 Acked 9217 Read 9 New Done Done false
32647 8219 Acked 9218 Read 10 New Done Done false
32648 8220 Acked 9219 Read 3 New Done Done false
32649 8221 Acked 9220 Flush 0 New Done Done false
32650 8222 Acked 9221 Read 8 New Done Done false
32651 8223 Acked 9222 Read 3 New Done Done false
32652 8224 Acked 9223 Write 2 New Done Done false
32653 8225 Acked 9224 Read 7 New Done Done false
32654 8226 Acked 9225 Read 6 New Done Done false
32655 8227 Acked 9226 Write 9 New Done Done false
32656 8228 Acked 9227 Read 10 New Done Done false
32657 8229 Acked 9228 Read 6 New Done Done false
32658 8230 Acked 9229 Flush 0 New Done Done false
32659 8231 Acked 9230 Read 8 New Done Done false
32660 8232 Acked 9231 Write 9 New Done Done false
32661 8233 Acked 9232 Flush 0 New Done Done false
32662 8234 Acked 9233 Write 2 New Done Done false
32663 8235 Acked 9234 Write 1 New Done Done false
32664 8236 Acked 9235 Write 9 New Done Done false
32665 8237 Acked 9236 Write 5 New Done Done false
32666 8238 Acked 9237 Read 3 New Done Done false
32667 8239 Acked 9238 Write 5 New Done Done false
32668 8240 Acked 9239 Write 2 New Done Done false
32669 8241 Acked 9240 Read 10 New Done Done false
32670 8242 Acked 9241 Read 9 New Done Done false
32671 8243 Acked 9242 Read 1 New Done Done false
32672 8244 Acked 9243 Write 6 New Done Done false
32673 8245 Acked 9244 Write 6 New Done Done false
32674 8246 Acked 9245 Write 8 New Done Done false
32675 8247 Acked 9246 Write 2 New Done Done false
32676 8248 Acked 9247 Read 7 New Done Done false
32677 8249 Acked 9248 Write 5 New Done Done false
32678 8250 Acked 9249 Read 5 New Done Done false
32679 8251 Acked 9250 Read 7 New Done Done false
32680 8252 Acked 9251 Read 9 New Done Done false
32681 8253 Acked 9252 Write 10 New Done Done false
32682 8254 Acked 9253 Flush 0 New Done Done false
32683 8255 Acked 9254 Read 4 New Done Done false
32684 8256 Acked 9255 Write 1 New Done Done false
32685 8257 Acked 9256 Write 6 New Done Done false
32686 8258 Acked 9257 Read 5 New Done Done false
32687 8259 Acked 9258 Write 5 New Done Done false
32688 8260 Acked 9259 Read 3 New Done Done false
32689 8261 Acked 9260 Flush 0 New Done Done false
32690 8262 Acked 9261 Read 5 New Done Done false
32691 8263 Acked 9262 Read 2 New Done Done false
32692 8264 Acked 9263 Read 5 New Done Done false
32693 8265 Acked 9264 Read 7 New Done Done false
32694 8266 Acked 9265 Read 6 New Done Done false
32695 8267 Acked 9266 Write 10 New Done Done false
32696 8268 Acked 9267 Read 8 New Done Done false
32697 8269 Acked 9268 Write 2 New Done Done false
32698 8270 Acked 9269 Read 3 New Done Done false
32699 8271 Acked 9270 Flush 0 New Done Done false
32700 8272 Acked 9271 Read 7 New Done Done false
32701 8273 Acked 9272 Read 9 New Done Done false
32702 8274 Acked 9273 Read 1 New Done Done false
32703 8275 Acked 9274 Read 9 New Done Done false
32704 8276 Acked 9275 Write 6 New Done Done false
32705 8277 Acked 9276 Read 10 New Done Done false
32706 8278 Acked 9277 Write 1 New Done Done false
32707 8279 Acked 9278 Read 7 New Done Done false
32708 8280 Acked 9279 Write 10 New Done Done false
32709 8281 Acked 9280 Flush 0 New Done Done false
32710 8282 Acked 9281 Write 8 New Done Done false
32711 8283 Acked 9282 Read 9 New Done Done false
32712 8284 Acked 9283 Write 5 New Done Done false
32713 8285 Acked 9284 Write 1 New Done Done false
32714 8286 Acked 9285 Write 3 New Done Done false
32715 8287 Acked 9286 Write 6 New Done Done false
32716 8288 Acked 9287 Write 2 New Done Done false
32717 8289 Acked 9288 Read 8 New Done Done false
32718 8290 Acked 9289 Read 9 New Done Done false
32719 8291 Acked 9290 Read 3 New Done Done false
32720 8292 Acked 9291 Write 3 New Done Done false
32721 8293 Acked 9292 Write 6 New Done Done false
32722 8294 Acked 9293 Read 10 New Done Done false
32723 8295 Acked 9294 Read 1 New Done Done false
32724 8296 Acked 9295 Read 10 New Done Done false
32725 8297 Acked 9296 Write 1 New Done Done false
32726 8298 Acked 9297 Read 7 New Done Done false
32727 8299 Acked 9298 Read 4 New Done Done false
32728 8300 Acked 9299 Read 8 New Done Done false
32729 8301 Acked 9300 Read 9 New Done Done false
32730 8302 Acked 9301 Write 3 New Done Done false
32731 8303 Acked 9302 Write 9 New Done Done false
32732 8304 Acked 9303 Flush 0 New Done Done false
32733 8305 Acked 9304 Write 4 New Done Done false
32734 8306 Acked 9305 Write 9 New Done Done false
32735 8307 Acked 9306 Read 9 New Done Done false
32736 8308 Acked 9307 Read 5 New Done Done false
32737 8309 Acked 9308 Write 4 New Done Done false
32738 8310 Acked 9309 Write 9 New Done Done false
32739 8311 Acked 9310 Write 1 New Done Done false
32740 8312 Acked 9311 Read 6 New Done Done false
32741 8313 Acked 9312 Write 1 New Done Done false
32742 8314 Acked 9313 Write 9 New Done Done false
32743 8315 Acked 9314 Write 2 New Done Done false
32744 8316 Acked 9315 Flush 0 New Done Done false
32745 8317 Acked 9316 Write 2 New Done Done false
32746 8318 Acked 9317 Write 8 New Done Done false
32747 8319 Acked 9318 Write 10 New Done Done false
32748 8320 Acked 9319 Read 8 New Done Done false
32749 8321 Acked 9320 Write 9 New Done Done false
32750 8322 Acked 9321 Write 5 New Done Done false
32751 8323 Acked 9322 Write 6 New Done Done false
32752 8324 Acked 9323 Read 1 New Done Done false
32753 8325 Acked 9324 Write 1 New Done Done false
32754 8326 Acked 9325 Write 6 New Done Done false
32755 8327 Acked 9326 Read 3 New Done Done false
32756 8328 Acked 9327 Read 4 New Done Done false
32757 8329 Acked 9328 Write 8 New Done Done false
32758 8330 Acked 9329 Write 10 New Done Done false
32759 8331 Acked 9330 Read 4 New Done Done false
32760 8332 Acked 9331 Read 10 New Done Done false
32761 8333 Acked 9332 Flush 0 New Done Done false
32762 8334 Acked 9333 Write 6 New Done Done false
32763 8335 Acked 9334 Write 5 New Done Done false
32764 8336 Acked 9335 Read 3 New Done Done false
32765 8337 Acked 9336 Write 4 New Done Done false
32766 8338 Acked 9337 Read 10 New Done Done false
32767 8339 Acked 9338 Read 4 New Done Done false
32768 8340 Acked 9339 Read 6 New Done Done false
32769 8341 Acked 9340 Write 9 New Done Done false
32770 8342 Acked 9341 Read 7 New Done Done false
32771 8343 Acked 9342 Flush 0 New Done Done false
32772 8344 Acked 9343 Write 9 New Done Done false
32773 8345 Acked 9344 Read 10 New Done Done false
32774 8346 Acked 9345 Read 5 New Done Done false
32775 8347 Acked 9346 Write 7 New Done Done false
32776 8348 Acked 9347 Write 3 New Done Done false
32777 8349 Acked 9348 Read 9 New Done Done false
32778 8350 Acked 9349 Flush 0 New Done Done false
32779 8351 Acked 9350 Write 8 New Done Done false
32780 8352 Acked 9351 Write 7 New Done Done false
32781 8353 Acked 9352 Write 4 New Done Done false
32782 8354 Acked 9353 Flush 0 New Done Done false
32783 8355 Acked 9354 Write 4 New Done Done false
32784 8356 Acked 9355 Write 10 New Done Done false
32785 8357 Acked 9356 Write 1 New Done Done false
32786 8358 Acked 9357 Write 9 New Done Done false
32787 8359 Acked 9358 Read 3 New Done Done false
32788 8360 Acked 9359 Write 10 New Done Done false
32789 8361 Acked 9360 Write 8 New Done Done false
32790 8362 Acked 9361 Write 7 New Done Done false
32791 8363 Acked 9362 Read 10 New Done Done false
32792 8364 Acked 9363 Read 3 New Done Done false
32793 8365 Acked 9364 Write 3 New Done Done false
32794 8366 Acked 9365 Read 1 New Done Done false
32795 8367 Acked 9366 Write 7 New Done Done false
32796 8368 Acked 9367 Read 5 New Done Done false
32797 8369 Acked 9368 Read 10 New Done Done false
32798 8370 Acked 9369 Flush 0 New Done Done false
32799 8371 Acked 9370 Write 2 New Done Done false
32800 8372 Acked 9371 Read 6 New Done Done false
32801 8373 Acked 9372 Read 4 New Done Done false
32802 8374 Acked 9373 Flush 0 New Done Done false
32803 8375 Acked 9374 Read 2 New Done Done false
32804 8376 Acked 9375 Read 10 New Done Done false
32805 8377 Acked 9376 Read 2 New Done Done false
32806 8378 Acked 9377 Read 10 New Done Done false
32807 8379 Acked 9378 Write 10 New Done Done false
32808 8380 Acked 9379 Read 9 New Done Done false
32809 8381 Acked 9380 Flush 0 New Done Done false
32810 8382 Acked 9381 Flush 0 New Done Done false
32811 8383 Acked 9382 Read 2 New Done Done false
32812 8384 Acked 9383 Flush 0 New Done Done false
32813 8385 Acked 9384 Write 6 New Done Done false
32814 8386 Acked 9385 Write 2 New Done Done false
32815 8387 Acked 9386 Read 9 New Done Done false
32816 8388 Acked 9387 Write 8 New Done Done false
32817 8389 Acked 9388 Read 5 New Done Done false
32818 8390 Acked 9389 Read 7 New Done Done false
32819 8391 Acked 9390 Read 10 New Done Done false
32820 8392 Acked 9391 Read 10 New Done Done false
32821 8393 Acked 9392 Write 8 New Done Done false
32822 8394 Acked 9393 Read 2 New Done Done false
32823 8395 Acked 9394 Write 4 New Done Done false
32824 8396 Acked 9395 Write 8 New Done Done false
32825 8397 Acked 9396 Flush 0 New Done Done false
32826 8398 Acked 9397 Read 6 New Done Done false
32827 8399 Acked 9398 Write 6 New Done Done false
32828 8400 Acked 9399 Write 5 New Done Done false
32829 8401 Acked 9400 Flush 0 New Done Done false
32830 8402 Acked 9401 Read 1 New Done Done false
32831 8403 Acked 9402 Read 2 New Done Done false
32832 8404 Acked 9403 Write 6 New Done Done false
32833 8405 Acked 9404 Read 9 New Done Done false
32834 8406 Acked 9405 Read 3 New Done Done false
32835 8407 Acked 9406 Read 7 New Done Done false
32836 8408 Acked 9407 Write 8 New Done Done false
32837 8409 Acked 9408 Read 4 New Done Done false
32838 8410 Acked 9409 Flush 0 New Done Done false
32839 8411 Acked 9410 Read 6 New Done Done false
32840 8412 Acked 9411 Read 4 New Done Done false
32841 8413 Acked 9412 Write 10 New Done Done false
32842 8414 Acked 9413 Read 10 New Done Done false
32843 8415 Acked 9414 Write 9 New Done Done false
32844 8416 Acked 9415 Write 5 New Done Done false
32845 8417 Acked 9416 Read 8 New Done Done false
32846 8418 Acked 9417 Flush 0 New Done Done false
32847 8419 Acked 9418 Read 10 New Done Done false
32848 8420 Acked 9419 Read 5 New Done Done false
32849 8421 Acked 9420 Write 6 New Done Done false
32850 8422 Acked 9421 Write 10 New Done Done false
32851 8423 Acked 9422 Write 2 New Done Done false
32852 8424 Acked 9423 Write 7 New Done Done false
32853 8425 Acked 9424 Read 10 New Done Done false
32854 8426 Acked 9425 Read 9 New Done Done false
32855 8427 Acked 9426 Read 6 New Done Done false
32856 8428 Acked 9427 Write 3 New Done Done false
32857 8429 Acked 9428 Read 6 New Done Done false
32858 8430 Acked 9429 Read 7 New Done Done false
32859 8431 Acked 9430 Read 10 New Done Done false
32860 8432 Acked 9431 Write 7 New Done Done false
32861 8433 Acked 9432 Write 4 New Done Done false
32862 8434 Acked 9433 Write 3 New Done Done false
32863 8435 Acked 9434 Write 2 New Done Done false
32864 8436 Acked 9435 Write 6 New Done Done false
32865 8437 Acked 9436 Write 4 New Done Done false
32866 8438 Acked 9437 Write 1 New Done Done false
32867 8439 Acked 9438 Read 10 New Done Done false
32868 8440 Acked 9439 Write 10 New Done Done false
32869 STATES DS:0 DS:1 DS:2 TOTAL
32870 New 301 0 0 301
32871 Sent 0 0 0 0
32872 Done 0 301 301 602
32873 Skipped 0 0 0 0
32874 Error 0 0 0 0
32875 Last Flush: 9138 9417 9417
32876 Downstairs last five completed: 9138 9137 9136 9135 9134
32877 Upstairs last five completed: 8440 8439 8438 8437 8436
32878 CLIENT: Up:0 ds:301 act:2
32879 [8810] got start action
32880 [8810] I am going to restart
32881 Starting downstairs at port 8810
32882 Make output file at "/tmp/dsc/downstairs-8810.txt"
32883 [8810][0] reports Starting
32884 Downstairs /var/tmp/dsc/region/8810 port 8810 PID:Some(1224)
32885 [8810][0] reports Running
32886 ----------------------------------------------------------------
32887 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:302
32888 States: Offline Active Active
32889 GW_ID ACK DSID TYPE BLOCKS DS:0 DS:1 DS:2 REPLAY
32890 8140 Acked 9139 Write 10 New Done Done false
32891 8141 Acked 9140 Read 10 New Done Done false
32892 8142 Acked 9141 Read 5 New Done Done false
32893 8143 Acked 9142 Read 10 New Done Done false
32894 8144 Acked 9143 Read 4 New Done Done false
32895 8145 Acked 9144 Read 10 New Done Done false
32896 8146 Acked 9145 Write 2 New Done Done false
32897 8147 Acked 9146 Flush 0 New Done Done false
32898 8148 Acked 9147 Read 9 New Done Done false
32899 8149 Acked 9148 Read 6 New Done Done false
32900 8150 Acked 9149 Read 8 New Done Done false
32901 8151 Acked 9150 Write 9 New Done Done false
32902 8152 Acked 9151 Write 4 New Done Done false
32903 8153 Acked 9152 Write 5 New Done Done false
32904 8154 Acked 9153 Write 6 New Done Done false
32905 8155 Acked 9154 Read 9 New Done Done false
32906 8156 Acked 9155 Write 3 New Done Done false
32907 8157 Acked 9156 Write 1 New Done Done false
32908 8158 Acked 9157 Flush 0 New Done Done false
32909 8159 Acked 9158 Read 5 New Done Done false
32910 8160 Acked 9159 Read 7 New Done Done false
32911 8161 Acked 9160 Read 7 New Done Done false
32912 8162 Acked 9161 Write 3 New Done Done false
32913 8163 Acked 9162 Read 2 New Done Done false
32914 8164 Acked 9163 Write 6 New Done Done false
32915 8165 Acked 9164 Read 1 New Done Done false
32916 8166 Acked 9165 Flush 0 New Done Done false
32917 8167 Acked 9166 Write 2 New Done Done false
32918 8168 Acked 9167 Write 7 New Done Done false
32919 8169 Acked 9168 Write 1 New Done Done false
32920 8170 Acked 9169 Write 5 New Done Done false
32921 8171 Acked 9170 Read 10 New Done Done false
32922 8172 Acked 9171 Write 7 New Done Done false
32923 8173 Acked 9172 Write 4 New Done Done false
32924 8174 Acked 9173 Read 1 New Done Done false
32925 8175 Acked 9174 Write 5 New Done Done false
32926 8176 Acked 9175 Write 10 New Done Done false
32927 8177 Acked 9176 Write 6 New Done Done false
32928 8178 Acked 9177 Read 10 New Done Done false
32929 8179 Acked 9178 Write 3 New Done Done false
32930 8180 Acked 9179 Read 6 New Done Done false
32931 8181 Acked 9180 Write 5 New Done Done false
32932 8182 Acked 9181 Read 7 New Done Done false
32933 8183 Acked 9182 Read 2 New Done Done false
32934 8184 Acked 9183 Write 6 New Done Done false
32935 8185 Acked 9184 Read 3 New Done Done false
32936 8186 Acked 9185 Read 3 New Done Done false
32937 8187 Acked 9186 Flush 0 New Done Done false
32938 8188 Acked 9187 Read 6 New Done Done false
32939 8189 Acked 9188 Write 2 New Done Done false
32940 8190 Acked 9189 Write 2 New Done Done false
32941 8191 Acked 9190 Read 7 New Done Done false
32942 8192 Acked 9191 Read 6 New Done Done false
32943 8193 Acked 9192 Write 8 New Done Done false
32944 8194 Acked 9193 Write 4 New Done Done false
32945 8195 Acked 9194 Read 6 New Done Done false
32946 8196 Acked 9195 Write 8 New Done Done false
32947 8197 Acked 9196 Read 4 New Done Done false
32948 8198 Acked 9197 Flush 0 New Done Done false
32949 8199 Acked 9198 Write 10 New Done Done false
32950 8200 Acked 9199 Read 4 New Done Done false
32951 8201 Acked 9200 Read 7 New Done Done false
32952 8202 Acked 9201 Flush 0 New Done Done false
32953 8203 Acked 9202 Read 10 New Done Done false
32954 8204 Acked 9203 Read 6 New Done Done false
32955 8205 Acked 9204 Write 8 New Done Done false
32956 8206 Acked 9205 Write 1 New Done Done false
32957 8207 Acked 9206 Read 2 New Done Done false
32958 8208 Acked 9207 Write 9 New Done Done false
32959 8209 Acked 9208 Read 1 New Done Done false
32960 8210 Acked 9209 Read 5 New Done Done false
32961 8211 Acked 9210 Flush 0 New Done Done false
32962 8212 Acked 9211 Read 1 New Done Done false
32963 8213 Acked 9212 Read 1 New Done Done false
32964 8214 Acked 9213 Write 10 New Done Done false
32965 8215 Acked 9214 Read 10 New Done Done false
32966 8216 Acked 9215 Read 9 New Done Done false
32967 8217 Acked 9216 Write 6 New Done Done false
32968 8218 Acked 9217 Read 9 New Done Done false
32969 8219 Acked 9218 Read 10 New Done Done false
32970 8220 Acked 9219 Read 3 New Done Done false
32971 8221 Acked 9220 Flush 0 New Done Done false
32972 8222 Acked 9221 Read 8 New Done Done false
32973 8223 Acked 9222 Read 3 New Done Done false
32974 8224 Acked 9223 Write 2 New Done Done false
32975 8225 Acked 9224 Read 7 New Done Done false
32976 8226 Acked 9225 Read 6 New Done Done false
32977 8227 Acked 9226 Write 9 New Done Done false
32978 8228 Acked 9227 Read 10 New Done Done false
32979 8229 Acked 9228 Read 6 New Done Done false
32980 8230 Acked 9229 Flush 0 New Done Done false
32981 8231 Acked 9230 Read 8 New Done Done false
32982 8232 Acked 9231 Write 9 New Done Done false
32983 8233 Acked 9232 Flush 0 New Done Done false
32984 8234 Acked 9233 Write 2 New Done Done false
32985 8235 Acked 9234 Write 1 New Done Done false
32986 8236 Acked 9235 Write 9 New Done Done false
32987 8237 Acked 9236 Write 5 New Done Done false
32988 8238 Acked 9237 Read 3 New Done Done false
32989 8239 Acked 9238 Write 5 New Done Done false
32990 8240 Acked 9239 Write 2 New Done Done false
32991 8241 Acked 9240 Read 10 New Done Done false
32992 8242 Acked 9241 Read 9 New Done Done false
32993 8243 Acked 9242 Read 1 New Done Done false
32994 8244 Acked 9243 Write 6 New Done Done false
32995 8245 Acked 9244 Write 6 New Done Done false
32996 8246 Acked 9245 Write 8 New Done Done false
32997 8247 Acked 9246 Write 2 New Done Done false
32998 8248 Acked 9247 Read 7 New Done Done false
32999 8249 Acked 9248 Write 5 New Done Done false
33000 8250 Acked 9249 Read 5 New Done Done false
33001 8251 Acked 9250 Read 7 New Done Done false
33002 8252 Acked 9251 Read 9 New Done Done false
33003 8253 Acked 9252 Write 10 New Done Done false
33004 8254 Acked 9253 Flush 0 New Done Done false
33005 8255 Acked 9254 Read 4 New Done Done false
33006 8256 Acked 9255 Write 1 New Done Done false
33007 8257 Acked 9256 Write 6 New Done Done false
33008 8258 Acked 9257 Read 5 New Done Done false
33009 8259 Acked 9258 Write 5 New Done Done false
33010 8260 Acked 9259 Read 3 New Done Done false
33011 8261 Acked 9260 Flush 0 New Done Done false
33012 8262 Acked 9261 Read 5 New Done Done false
33013 8263 Acked 9262 Read 2 New Done Done false
33014 8264 Acked 9263 Read 5 New Done Done false
33015 8265 Acked 9264 Read 7 New Done Done false
33016 8266 Acked 9265 Read 6 New Done Done false
33017 8267 Acked 9266 Write 10 New Done Done false
33018 8268 Acked 9267 Read 8 New Done Done false
33019 8269 Acked 9268 Write 2 New Done Done false
33020 8270 Acked 9269 Read 3 New Done Done false
33021 8271 Acked 9270 Flush 0 New Done Done false
33022 8272 Acked 9271 Read 7 New Done Done false
33023 8273 Acked 9272 Read 9 New Done Done false
33024 8274 Acked 9273 Read 1 New Done Done false
33025 8275 Acked 9274 Read 9 New Done Done false
33026 8276 Acked 9275 Write 6 New Done Done false
33027 8277 Acked 9276 Read 10 New Done Done false
33028 8278 Acked 9277 Write 1 New Done Done false
33029 8279 Acked 9278 Read 7 New Done Done false
33030 8280 Acked 9279 Write 10 New Done Done false
33031 8281 Acked 9280 Flush 0 New Done Done false
33032 8282 Acked 9281 Write 8 New Done Done false
33033 8283 Acked 9282 Read 9 New Done Done false
33034 8284 Acked 9283 Write 5 New Done Done false
33035 8285 Acked 9284 Write 1 New Done Done false
33036 8286 Acked 9285 Write 3 New Done Done false
33037 8287 Acked 9286 Write 6 New Done Done false
33038 8288 Acked 9287 Write 2 New Done Done false
33039 8289 Acked 9288 Read 8 New Done Done false
33040 8290 Acked 9289 Read 9 New Done Done false
33041 8291 Acked 9290 Read 3 New Done Done false
33042 8292 Acked 9291 Write 3 New Done Done false
33043 8293 Acked 9292 Write 6 New Done Done false
33044 8294 Acked 9293 Read 10 New Done Done false
33045 8295 Acked 9294 Read 1 New Done Done false
33046 8296 Acked 9295 Read 10 New Done Done false
33047 8297 Acked 9296 Write 1 New Done Done false
33048 8298 Acked 9297 Read 7 New Done Done false
33049 8299 Acked 9298 Read 4 New Done Done false
33050 8300 Acked 9299 Read 8 New Done Done false
33051 8301 Acked 9300 Read 9 New Done Done false
33052 8302 Acked 9301 Write 3 New Done Done false
33053 8303 Acked 9302 Write 9 New Done Done false
33054 8304 Acked 9303 Flush 0 New Done Done false
33055 8305 Acked 9304 Write 4 New Done Done false
33056 8306 Acked 9305 Write 9 New Done Done false
33057 8307 Acked 9306 Read 9 New Done Done false
33058 8308 Acked 9307 Read 5 New Done Done false
33059 8309 Acked 9308 Write 4 New Done Done false
33060 8310 Acked 9309 Write 9 New Done Done false
33061 8311 Acked 9310 Write 1 New Done Done false
33062 8312 Acked 9311 Read 6 New Done Done false
33063 8313 Acked 9312 Write 1 New Done Done false
33064 8314 Acked 9313 Write 9 New Done Done false
33065 8315 Acked 9314 Write 2 New Done Done false
33066 8316 Acked 9315 Flush 0 New Done Done false
33067 8317 Acked 9316 Write 2 New Done Done false
33068 8318 Acked 9317 Write 8 New Done Done false
33069 8319 Acked 9318 Write 10 New Done Done false
33070 8320 Acked 9319 Read 8 New Done Done false
33071 8321 Acked 9320 Write 9 New Done Done false
33072 8322 Acked 9321 Write 5 New Done Done false
33073 8323 Acked 9322 Write 6 New Done Done false
33074 8324 Acked 9323 Read 1 New Done Done false
33075 8325 Acked 9324 Write 1 New Done Done false
33076 8326 Acked 9325 Write 6 New Done Done false
33077 8327 Acked 9326 Read 3 New Done Done false
33078 8328 Acked 9327 Read 4 New Done Done false
33079 8329 Acked 9328 Write 8 New Done Done false
33080 8330 Acked 9329 Write 10 New Done Done false
33081 8331 Acked 9330 Read 4 New Done Done false
33082 8332 Acked 9331 Read 10 New Done Done false
33083 8333 Acked 9332 Flush 0 New Done Done false
33084 8334 Acked 9333 Write 6 New Done Done false
33085 8335 Acked 9334 Write 5 New Done Done false
33086 8336 Acked 9335 Read 3 New Done Done false
33087 8337 Acked 9336 Write 4 New Done Done false
33088 8338 Acked 9337 Read 10 New Done Done false
33089 8339 Acked 9338 Read 4 New Done Done false
33090 8340 Acked 9339 Read 6 New Done Done false
33091 8341 Acked 9340 Write 9 New Done Done false
33092 8342 Acked 9341 Read 7 New Done Done false
33093 8343 Acked 9342 Flush 0 New Done Done false
33094 8344 Acked 9343 Write 9 New Done Done false
33095 8345 Acked 9344 Read 10 New Done Done false
33096 8346 Acked 9345 Read 5 New Done Done false
33097 8347 Acked 9346 Write 7 New Done Done false
33098 8348 Acked 9347 Write 3 New Done Done false
33099 8349 Acked 9348 Read 9 New Done Done false
33100 8350 Acked 9349 Flush 0 New Done Done false
33101 8351 Acked 9350 Write 8 New Done Done false
33102 8352 Acked 9351 Write 7 New Done Done false
33103 8353 Acked 9352 Write 4 New Done Done false
33104 8354 Acked 9353 Flush 0 New Done Done false
33105 8355 Acked 9354 Write 4 New Done Done false
33106 8356 Acked 9355 Write 10 New Done Done false
33107 8357 Acked 9356 Write 1 New Done Done false
33108 8358 Acked 9357 Write 9 New Done Done false
33109 8359 Acked 9358 Read 3 New Done Done false
33110 8360 Acked 9359 Write 10 New Done Done false
33111 8361 Acked 9360 Write 8 New Done Done false
33112 8362 Acked 9361 Write 7 New Done Done false
33113 8363 Acked 9362 Read 10 New Done Done false
33114 8364 Acked 9363 Read 3 New Done Done false
33115 8365 Acked 9364 Write 3 New Done Done false
33116 8366 Acked 9365 Read 1 New Done Done false
33117 8367 Acked 9366 Write 7 New Done Done false
33118 8368 Acked 9367 Read 5 New Done Done false
33119 8369 Acked 9368 Read 10 New Done Done false
33120 8370 Acked 9369 Flush 0 New Done Done false
33121 8371 Acked 9370 Write 2 New Done Done false
33122 8372 Acked 9371 Read 6 New Done Done false
33123 8373 Acked 9372 Read 4 New Done Done false
33124 8374 Acked 9373 Flush 0 New Done Done false
33125 8375 Acked 9374 Read 2 New Done Done false
33126 8376 Acked 9375 Read 10 New Done Done false
33127 8377 Acked 9376 Read 2 New Done Done false
33128 8378 Acked 9377 Read 10 New Done Done false
33129 8379 Acked 9378 Write 10 New Done Done false
33130 8380 Acked 9379 Read 9 New Done Done false
33131 8381 Acked 9380 Flush 0 New Done Done false
33132 8382 Acked 9381 Flush 0 New Done Done false
33133 8383 Acked 9382 Read 2 New Done Done false
33134 8384 Acked 9383 Flush 0 New Done Done false
33135 8385 Acked 9384 Write 6 New Done Done false
33136 8386 Acked 9385 Write 2 New Done Done false
33137 8387 Acked 9386 Read 9 New Done Done false
33138 8388 Acked 9387 Write 8 New Done Done false
33139 8389 Acked 9388 Read 5 New Done Done false
33140 8390 Acked 9389 Read 7 New Done Done false
33141 8391 Acked 9390 Read 10 New Done Done false
33142 8392 Acked 9391 Read 10 New Done Done false
33143 8393 Acked 9392 Write 8 New Done Done false
33144 8394 Acked 9393 Read 2 New Done Done false
33145 8395 Acked 9394 Write 4 New Done Done false
33146 8396 Acked 9395 Write 8 New Done Done false
33147 8397 Acked 9396 Flush 0 New Done Done false
33148 8398 Acked 9397 Read 6 New Done Done false
33149 8399 Acked 9398 Write 6 New Done Done false
33150 8400 Acked 9399 Write 5 New Done Done false
33151 8401 Acked 9400 Flush 0 New Done Done false
33152 8402 Acked 9401 Read 1 New Done Done false
33153 8403 Acked 9402 Read 2 New Done Done false
33154 8404 Acked 9403 Write 6 New Done Done false
33155 8405 Acked 9404 Read 9 New Done Done false
33156 8406 Acked 9405 Read 3 New Done Done false
33157 8407 Acked 9406 Read 7 New Done Done false
33158 8408 Acked 9407 Write 8 New Done Done false
33159 8409 Acked 9408 Read 4 New Done Done false
33160 8410 Acked 9409 Flush 0 New Done Done false
33161 8411 Acked 9410 Read 6 New Done Done false
33162 8412 Acked 9411 Read 4 New Done Done false
33163 8413 Acked 9412 Write 10 New Done Done false
33164 8414 Acked 9413 Read 10 New Done Done false
33165 8415 Acked 9414 Write 9 New Done Done false
33166 8416 Acked 9415 Write 5 New Done Done false
33167 8417 Acked 9416 Read 8 New Done Done false
33168 8418 Acked 9417 Flush 0 New Done Done false
33169 8419 Acked 9418 Read 10 New Done Done false
33170 8420 Acked 9419 Read 5 New Done Done false
33171 8421 Acked 9420 Write 6 New Done Done false
33172 8422 Acked 9421 Write 10 New Done Done false
33173 8423 Acked 9422 Write 2 New Done Done false
33174 8424 Acked 9423 Write 7 New Done Done false
33175 8425 Acked 9424 Read 10 New Done Done false
33176 8426 Acked 9425 Read 9 New Done Done false
33177 8427 Acked 9426 Read 6 New Done Done false
33178 8428 Acked 9427 Write 3 New Done Done false
33179 8429 Acked 9428 Read 6 New Done Done false
33180 8430 Acked 9429 Read 7 New Done Done false
33181 8431 Acked 9430 Read 10 New Done Done false
33182 8432 Acked 9431 Write 7 New Done Done false
33183 8433 Acked 9432 Write 4 New Done Done false
33184 8434 Acked 9433 Write 3 New Done Done false
33185 8435 Acked 9434 Write 2 New Done Done false
33186 8436 Acked 9435 Write 6 New Done Done false
33187 8437 Acked 9436 Write 4 New Done Done false
33188 8438 Acked 9437 Write 1 New Done Done false
33189 8439 Acked 9438 Read 10 New Done Done false
33190 8440 Acked 9439 Write 10 New Done Done false
33191 8441 Acked 9440 Flush 0 New Done Done false
33192 STATES DS:0 DS:1 DS:2 TOTAL
33193 New 302 0 0 302
33194 Sent 0 0 0 0
33195 Done 0 302 302 604
33196 Skipped 0 0 0 0
33197 Error 0 0 0 0
33198 Last Flush: 9138 9440 9440
33199 Downstairs last five completed: 9138 9137 9136 9135 9134
33200 Upstairs last five completed: 8441 8440 8439 8438 8437
33201 CLIENT: Up:0 ds:302 act:2
332022024-04-20T01:12:02.637ZINFOcrucible: connecting to 127.0.0.1:8810 = io task client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
332032024-04-20T01:12:02.637ZINFOcrucible: ds_connection connected from Ok(127.0.0.1:52079) = io task client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
332042024-04-20T01:12:02.638ZINFOcrucible: downstairs client at Some(127.0.0.1:8810) has region UUID 12345678-0000-0000-0000-000000008810 = downstairs client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
332052024-04-20T01:12:02.638ZINFOcrucible: Returning UUID:12345678-0000-0000-0000-000000008810 matches = downstairs client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
332062024-04-20T01:12:02.638ZINFOcrucible: send last flush ID to this DS: 9138 = downstairs client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
332072024-04-20T01:12:02.639ZINFOcrucible: Replied this last flush ID: 9138 = downstairs client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
332082024-04-20T01:12:02.639ZINFOcrucible: ds_transition from Offline to Replay = downstairs client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
332092024-04-20T01:12:02.639ZINFOcrucible: [0] Transition from Offline to Replay = downstairs client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
332102024-04-20T01:12:02.639ZINFOcrucible: ds_transition from Replay to Active = downstairs client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
332112024-04-20T01:12:02.639ZINFOcrucible: [0] Transition from Replay to Active = downstairs client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
33212 ----------------------------------------------------------------
33213 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:0
33214 Downstairs last five completed: 9440 9439 9438 9437 9436
33215 Upstairs last five completed: 8441 8440 8439 8438 8437
33216 CLIENT: Up:0 ds:0 act:3
33217 Replay: All jobs finished, all DS active.
33218 Main task has work to do, go find it
33219 got dsc Stop(1)
33220 stop 1
33221 [8820] Got stop action so:false kr:false
33222 Apr 20 01:12:04.958 INFO request completed, latency_us: 327, response_code: 204, uri: /stop/cid/1, method: POST, req_id: 8610ca64-fb1c-4b45-8423-c19a92cd37bb, remote_addr: 127.0.0.1:60352, local_addr: 127.0.0.1:9998
332232024-04-20T01:12:04.958ZWARNcrucible: downstairs disconnected = io task client = 1 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
332242024-04-20T01:12:04.958ZWARNcrucible: client task is sending Done(Finished) = io task client = 1 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
332252024-04-20T01:12:04.958ZWARNcrucible: downstairs task for 1 stopped due to Finished session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
332262024-04-20T01:12:04.959ZINFOcrucible: Gone missing, transition from Active to Offline = downstairs client = 1 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
33227 Apr 20 01:12:04.959 INFO request completed, latency_us: 158{"msg":"[1] client re-new 0 jobs since flush 9440","v":0,"name":"crucible","level":30,"time":"2024-04-20T01:12:04.959076609Z","hostname":"w-01HVWGBJP7HK0H9TQ26T6N3X8M","pid":1196,"":"downstairs","":"downstairs","session_id":"132b460a-26a0-4532-b1ab-4f8c07d4c6c7"}
33228 , response_code: 200, uri{"msg":"[1] Marked 0 jobs for replay since flush: 9440","v":0,"name":"crucible","level":30,"time":"2024-04-20T01:12:04.959130168Z","hostname":"w-01HVWGBJP7HK0H9TQ26T6N3X8M","pid":1196,"":"downstairs","":"downstairs","session_id":"132b460a-26a0-4532-b1ab-4f8c07d4c6c7"}
33229 : /state/cid/1, method: GET, req_id:{"msg":"client task is exiting","v":0,"name":"crucible","level":30,"time":"2024-04-20T01:12:04.959174507Z","hostname":"w-01HVWGBJP7HK0H9TQ26T6N3X8M","pid":1196,"":"io task","client":"1","":"downstairs","session_id":"132b460a-26a0-4532-b1ab-4f8c07d4c6c7"}
33230 8701d754-2a3b-4a9f-a43c-d1e66b3b2120, remote_addr: 127.0.0.1:60352, local_addr: 127.0.0.1:9998
33231 [8820] Exited with: ExitStatus(unix_wait_status(9))
33232 [8820][1] reports Exit
33233 Apr 20 01:12:08.960 INFO request completed, latency_us: 181, response_code: 200, uri: /state/cid/1, method: GET, req_id: f4eda969-22f1-4fdb-b806-a39e2e29dc64, remote_addr: 127.0.0.1:60352, local_addr: 127.0.0.1:9998
33234 001/300 Read block 461 len 8192
33235 002/300 Read block 744 len 16384
33236 003/300 Flush
33237 004/300 Read block 4929 len 4096
33238 005/300 Flush
33239 006/300 Write block 2101 len 20480 data: 9 9 8 7 7
33240 007/300 Read block 4797 len 16384
33241 008/300 Write block 4552 len 16384 data: 5 4 3 4
33242 009/300 Write block 1065 len 12288 data: 6 4 3
33243 010/300 Flush
33244 011/300 Read block 3354 len 32768
33245 012/300 Write block 4827 len 16384 data: 9 8 6 4
33246 013/300 Read block 2652 len 24576
33247 014/300 Write block 139 len 36864 data: 3 4 4 5 4 4 3 3 5
33248 015/300 Write block 3310 len 16384 data: 8 9 8 10
33249 016/300 Read block 4804 len 36864
33250 017/300 Write block 4409 len 36864 data: 8 6 6 7 9 7 7 6 6
33251 018/300 Write block 1384 len 20480 data: 6 7 5 6 7
33252 019/300 Read block 38 len 32768
33253 020/300 Read block 149 len 32768
33254 021/300 Read block 1261 len 36864
33255 022/300 Write block 2086 len 36864 data: 10 8 6 6 7 8 8 8 6
33256 023/300 Write block 4884 len 20480 data: 3 4 6 7 7
33257 024/300 Write block 301 len 40960 data: 5 5 5 4 3 2 3 3 4 5
33258 025/300 Read block 3631 len 40960
33259 026/300 Read block 2329 len 16384
33260 027/300 Flush
33261 028/300 Read block 4015 len 16384
33262 029/300 Read block 2587 len 28672
33263 030/300 Read block 3148 len 28672
33264 031/300 Write block 314 len 28672 data: 5 6 6 6 8 7 7
33265 032/300 Write block 3910 len 4096 data: 6
33266 033/300 Read block 3964 len 32768
33267 034/300 Flush
33268 035/300 Read block 2524 len 12288
33269 036/300 Write block 1044 len 28672 data: 7 7 7 8 7 6 7
33270 037/300 Read block 283 len 12288
33271 038/300 Read block 510 len 8192
33272 039/300 Read block 1897 len 28672
33273 040/300 Write block 2045 len 28672 data: 5 6 6 6 5 5 6
33274 041/300 Read block 2643 len 16384
33275 042/300 Read block 2398 len 4096
33276 043/300 Write block 3828 len 36864 data: 5 5 5 5 5 4 3 6 7
33277 044/300 Read block 1995 len 20480
33278 045/300 Read block 3731 len 36864
33279 046/300 Read block 2096 len 24576
33280 047/300 Read block 896 len 28672
33281 048/300 Read block 4726 len 40960
33282 049/300 Write block 1478 len 8192 data: 3 3
33283 050/300 Read block 65 len 28672
33284 051/300 Read block 1607 len 28672
33285 052/300 Read block 616 len 28672
33286 053/300 Read block 49 len 36864
33287 054/300 Write block 1903 len 36864 data: 9 7 7 4 4 3 3 3 5
33288 055/300 Read block 330 len 24576
33289 056/300 Read block 1308 len 12288
33290 057/300 Write block 1570 len 4096 data: 6
33291 058/300 Write block 1217 len 12288 data: 8 6 6
33292 059/300 Write block 2274 len 40960 data: 3 5 4 5 5 4 5 4 4 3
33293 060/300 Read block 4963 len 4096
33294 061/300 Write block 2172 len 4096 data: 8
33295 062/300 Read block 2366 len 20480
33296 063/300 Read block 470 len 12288
33297 064/300 Write block 1638 len 40960 data: 7 4 4 4 4 4 4 5 4 3
33298 065/300 Read block 1070 len 12288
33299 066/300 Read block 3215 len 8192
33300 067/300 Flush
33301 068/300 Write block 2362 len 4096 data: 7
33302 069/300 Read block 1681 len 28672
33303 070/300 Write block 2674 len 16384 data: 6 6 7 7
33304 071/300 Read block 4544 len 40960
33305 072/300 Read block 3683 len 16384
33306 073/300 Read block 4485 len 40960
33307 074/300 Flush
33308 075/300 Write block 2049 len 12288 data: 6 6 7
33309 076/300 Write block 4038 len 28672 data: 4 6 7 9 11 10 10
33310 077/300 Write block 3805 len 32768 data: 5 5 6 5 4 4 4 4
33311 078/300 Flush
33312 079/300 Read block 1033 len 40960
33313 080/300 Flush
33314 081/300 Write block 2961 len 4096 data: 4
33315 082/300 Read block 1850 len 12288
33316 083/300 Write block 3220 len 4096 data: 4
33317 084/300 Write block 1678 len 32768 data: 5 4 6 6 6 4 6 7
33318 085/300 Write block 3926 len 40960 data: 5 5 5 4 4 3 4 5 4 3
33319 086/300 Read block 4694 len 24576
33320 087/300 Flush
33321 088/300 Write block 2849 len 32768 data: 8 10 5 5 7 7 7 7
33322 089/300 Read block 3872 len 12288
33323 090/300 Write block 2877 len 24576 data: 5 6 6 6 4 5
33324 091/300 Write block 1912 len 32768 data: 4 4 6 5 6 5 5 4
33325 092/300 Read block 826 len 40960
33326 093/300 Read block 4536 len 12288
33327 094/300 Read block 2764 len 12288
33328 095/300 Write block 930 len 40960 data: 3 3 4 3 5 6 6 6 5 3
33329 096/300 Read block 146 len 36864
33330 097/300 Write block 2487 len 20480 data: 4 4 4 3 3
33331 098/300 Write block 3436 len 24576 data: 6 5 7 8 9 10
33332 099/300 Flush
33333 100/300 Write block 314 len 4096 data: 6
33334 101/300 Read block 3855 len 16384
33335 102/300 Read block 505 len 28672
33336 103/300 Write block 2782 len 8192 data: 3 3
33337 104/300 Write block 1151 len 24576 data: 3 5 5 6 7 7
33338 105/300 Flush
33339 106/300 Write block 1932 len 24576 data: 4 5 4 3 4 3
33340 107/300 Read block 458 len 32768
33341 108/300 Read block 2380 len 4096
33342 109/300 Read block 345 len 28672
33343 110/300 Write block 3715 len 12288 data: 7 7 6
33344 111/300 Write block 1281 len 24576 data: 5 6 4 4 4 4
33345 112/300 Read block 2637 len 8192
33346 113/300 Write block 4037 len 20480 data: 4 5 7 8 10
33347 114/300 Read block 3879 len 4096
33348 115/300 Write block 378 len 8192 data: 2 3
33349 116/300 Flush
33350 117/300 Read block 1427 len 12288
33351 118/300 Write block 2887 len 36864 data: 3 4 5 8 8 8 6 4 6
33352 119/300 Read block 599 len 32768
33353 120/300 Read block 4219 len 24576
33354 121/300 Write block 4056 len 12288 data: 6 4 3
33355 122/300 Read block 3916 len 28672
33356 123/300 Write block 4048 len 16384 data: 6 7 7 7
33357 124/300 Write block 4812 len 40960 data: 4 4 4 3 5 5 5 8 9 10
33358 125/300 Read block 1826 len 24576
33359 126/300 Write block 3980 len 28672 data: 8 9 7 7 6 6 5
33360 127/300 Read block 4373 len 28672
33361 128/300 Read block 2635 len 12288
33362 129/300 Read block 2613 len 4096
33363 130/300 Read block 4333 len 32768
33364 131/300 Read block 230 len 36864
33365 132/300 Read block 3330 len 16384
33366 133/300 Read block 3477 len 4096
33367 134/300 Write block 2679 len 32768 data: 6 6 7 8 7 7 7 7
33368 135/300 Write block 4315 len 32768 data: 7 8 8 9 8 7 5 4
33369 136/300 Read block 864 len 4096
33370 137/300 Write block 703 len 28672 data: 4 4 3 3 4 5 5
33371 138/300 Write block 3316 len 20480 data: 7 4 4 4 4
33372 139/300 Read block 1484 len 24576
33373 140/300 Read block 98 len 28672
33374 141/300 Write block 3035 len 28672 data: 5 6 7 7 5 5 5
33375 142/300 Write block 401 len 24576 data: 8 7 7 6 5 5
33376 143/300 Read block 3097 len 4096
33377 144/300 Write block 3126 len 8192 data: 7 7
33378 145/300 Read block 1426 len 40960
33379 146/300 Read block 2691 len 8192
33380 147/300 Write block 1748 len 8192 data: 6 6
33381 148/300 Write block 3736 len 16384 data: 8 7 7 7
33382 149/300 Read block 3511 len 28672
33383 150/300 Read block 1135 len 12288
33384 151/300 Flush
33385 152/300 Flush
33386 153/300 Flush
33387 154/300 Read block 2687 len 12288
33388 155/300 Write block 2536 len 12288 data: 7 8 8
33389 156/300 Write block 4900 len 28672 data: 5 5 5 4 3 3 4
33390 157/300 Write block 2313 len 4096 data: 9
33391 158/300 Read block 3597 len 20480
33392 159/300 Read block 315 len 20480
33393 160/300 Write block 4371 len 28672 data: 4 4 5 6 6 5 4
33394 161/300 Write block 2531 len 28672 data: 6 8 7 6 4 8 9
33395 162/300 Read block 2363 len 24576
33396 163/300 Write block 3888 len 12288 data: 7 4 4
33397 164/300 Write block 2706 len 4096 data: 5
33398 165/300 Read block 3009 len 8192
33399 166/300 Write block 3267 len 24576 data: 6 6 8 5 6 6
33400 167/300 Read block 4717 len 12288
33401 168/300 Write block 3884 len 32768 data: 10 10 9 7 8 5 5 6
33402 169/300 Write block 4276 len 16384 data: 5 4 4 5
33403 170/300 Read block 281 len 32768
33404 171/300 Flush
33405 172/300 Write block 4763 len 36864 data: 6 7 7 5 5 6 10 8 7
33406 173/300 Write block 3880 len 32768 data: 5 8 7 8 11 11 10 8
33407 174/300 Read block 3244 len 4096
33408 175/300 Read block 2944 len 28672
33409 176/300 Read block 2993 len 32768
33410 177/300 Read block 2495 len 8192
33411 178/300 Read block 4990 len 24576
33412 179/300 Write block 1645 len 20480 data: 6 5 4 3 4
33413 180/300 Read block 2466 len 4096
33414 181/300 Read block 194 len 20480
33415 182/300 Read block 3503 len 24576
33416 183/300 Read block 1969 len 28672
33417 184/300 Write block 3506 len 4096 data: 3
33418 185/300 Write block 2896 len 12288 data: 6 5 6
33419 186/300 Write block 1160 len 4096 data: 5
33420 187/300 Read block 3764 len 8192
33421 188/300 Read block 3810 len 28672
33422 189/300 Read block 923 len 28672
33423 190/300 Read block 3052 len 8192
33424 191/300 Write block 3077 len 8192 data: 5 5
33425 192/300 Write block 4799 len 4096 data: 6
33426 193/300 Read block 663 len 36864
33427 194/300 Write block 2383 len 8192 data: 3 3
33428 195/300 Write block 429 len 32768 data: 5 5 5 5 4 4 4 4
33429 196/300 Read block 1390 len 16384
33430 197/300 Read block 3640 len 24576
33431 198/300 Write block 1431 len 32768 data: 8 8 8 8 9 9 7 8
33432 199/300 Read block 2985 len 8192
33433 200/300 Write block 4022 len 36864 data: 7 7 7 7 6 4 4 4 3
33434 201/300 Write block 4704 len 40960 data: 6 6 7 6 5 6 5 6 6 5
33435 202/300 Read block 802 len 4096
33436 203/300 Read block 1675 len 28672
33437 204/300 Read block 2484 len 32768
33438 205/300 Write block 2617 len 24576 data: 10 10 11 8 9 9
33439 206/300 Write block 3079 len 12288 data: 7 8 9
33440 207/300 Read block 4533 len 36864
33441 208/300 Read block 4530 len 24576
33442 209/300 Read block 4880 len 4096
33443 210/300 Read block 3433 len 4096
33444 211/300 Write block 483 len 32768 data: 6 6 4 5 5 4 3 2
33445 212/300 Write block 2197 len 8192 data: 4 5
33446 213/300 Read block 4097 len 40960
33447 214/300 Write block 2482 len 32768 data: 2 2 2 3 4 5 5 5
33448 215/300 Write block 2883 len 8192 data: 3 4
33449 216/300 Write block 1547 len 40960 data: 9 8 8 8 7 8 7 6 6 7
33450 217/300 Write block 3911 len 28672 data: 6 7 7 6 5 5 7
33451 218/300 Flush
33452 219/300 Write block 1317 len 16384 data: 5 5 5 5
33453 220/300 Read block 3727 len 40960
33454 221/300 Write block 4886 len 32768 data: 7 8 8 8 6 6 7 6
33455 222/300 Write block 3144 len 4096 data: 3
33456 223/300 Flush
33457 224/300 Write block 796 len 4096 data: 4
33458 225/300 Flush
33459 226/300 Read block 4577 len 36864
33460 227/300 Read block 94 len 36864
33461 228/300 Read block 2837 len 16384
33462 229/300 Read block 2492 len 20480
33463 230/300 Write block 2559 len 8192 data: 6 6
33464 231/300 Write block 4363 len 16384 data: 6 6 6 6
33465 232/300 Write block 1699 len 12288 data: 6 5 5
33466 233/300 Read block 1677 len 16384
33467 234/300 Write block 623 len 20480 data: 6 4 6 6 4
33468 235/300 Read block 3343 len 8192
33469 236/300 Read block 4679 len 12288
33470 237/300 Read block 207 len 20480
33471 238/300 Read block 3110 len 8192
33472 239/300 Write block 3215 len 12288 data: 5 6 5
33473 240/300 Flush
33474 241/300 Read block 3288 len 24576
33475 242/300 Read block 3488 len 4096
33476 243/300 Read block 2960 len 20480
33477 244/300 Read block 1099 len 12288
33478 245/300 Read block 3277 len 28672
33479 246/300 Read block 0 len 28672
33480 247/300 Read block 2207 len 28672
33481 248/300 Write block 2626 len 24576 data: 9 10 8 7 6 5
33482 249/300 Write block 308 len 12288 data: 4 5 6
33483 250/300 Write block 3827 len 28672 data: 4 6 6 6 6 6 5
33484 251/300 Read block 997 len 32768
33485 252/300 Write block 2125 len 40960 data: 5 7 7 7 6 6 5 4 4 3
33486 253/300 Read block 2224 len 36864
33487 254/300 Read block 1205 len 16384
33488 255/300 Write block 3204 len 40960 data: 6 3 4 5 4 6 7 8 8 8
33489 256/300 Read block 2483 len 16384
33490 257/300 Read block 1019 len 12288
33491 258/300 Write block 147 len 4096 data: 6
33492 259/300 Read block 4335 len 36864
33493 260/300 Write block 3770 len 16384 data: 3 4 4 4
33494 261/300 Read block 1010 len 20480
33495 262/300 Write block 4775 len 4096 data: 4
33496 263/300 Write block 647 len 12288 data: 8 6 5
33497 264/300 Flush
33498 265/300 Read block 2587 len 32768
33499 266/300 Write block 3022 len 40960 data: 8 9 9 7 5 5 5 5 4 4
33500 267/300 Read block 4312 len 32768
33501 268/300 Read block 789 len 20480
33502 269/300 Read block 1248 len 12288
33503 270/300 Write block 2289 len 20480 data: 6 6 5 5 5
33504 271/300 Flush
33505 272/300 Write block 1674 len 36864 data: 6 5 6 4 6 5 7 7 7
33506 273/300 Read block 1739 len 20480
33507 274/300 Read block 777 len 20480
33508 275/300 Write block 951 len 36864 data: 9 8 8 6 6 4 4 4 5
33509 276/300 Read block 3566 len 8192
33510 277/300 Read block 321 len 16384
33511 278/300 Flush
33512 279/300 Read block 3835 len 40960
33513 280/300 Write block 2088 len 4096 data: 7
33514 281/300 Read block 3453 len 32768
33515 282/300 Write block 2051 len 8192 data: 8 6
33516 283/300 Read block 523 len 36864
33517 284/300 Write block 1813 len 40960 data: 6 7 8 6 6 8 9 8 8 9
33518 285/300 Read block 4899 len 4096
33519 286/300 Write block 1371 len 16384 data: 6 4 3 4
33520 287/300 Write block 2499 len 12288 data: 6 6 5
33521 288/300 Flush
33522 289/300 Read block 3082 len 20480
33523 290/300 Read block 4441 len 12288
33524 291/300 Write block 1958 len 36864 data: 7 7 8 7 7 7 6 5 5
33525 292/300 Write block 4895 len 20480 data: 5 6 5 5 6
33526 293/300 Read block 4472 len 16384
33527 294/300 Read block 4300 len 20480
33528 295/300 Read block 3747 len 24576
33529 296/300 Write block 3501 len 20480 data: 6 5 4 4 4
33530 297/300 Write block 3051 len 8192 data: 3 2
33531 298/300 Read block 1225 len 28672
33532 299/300 Flush
33533 300/300 Write block 2060 len 40960 data: 10 12 10 10 10 9 9 8 10 11
33534 Main task has work to do, go find it
33535 got dsc Start(1)
33536 start 1
33537 Apr 20 01:12:09.262 INFO request completed, latency_us: 261, response_code: 204, uri: /start/cid/1, method: POST, req_id: 6037ecfb-b05b-47a3-b6fe-af0f3216738b, remote_addr: 127.0.0.1:60352, local_addr: 127.0.0.1:9998
33538 Replay: started 1, returned:Ok(())
33539 ----------------------------------------------------------------
33540 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:300
33541 States: Active Offline Active
33542 GW_ID ACK DSID TYPE BLOCKS DS:0 DS:1 DS:2 REPLAY
33543 8442 Acked 9441 Read 2 Done New Done false
33544 8443 Acked 9442 Read 4 Done New Done false
33545 8444 Acked 9443 Flush 0 Done New Done false
33546 8445 Acked 9444 Read 1 Done New Done false
33547 8446 Acked 9445 Flush 0 Done New Done false
33548 8447 Acked 9446 Write 5 Done New Done false
33549 8448 Acked 9447 Read 4 Done New Done false
33550 8449 Acked 9448 Write 4 Done New Done false
33551 8450 Acked 9449 Write 3 Done New Done false
33552 8451 Acked 9450 Flush 0 Done New Done false
33553 8452 Acked 9451 Read 8 Done New Done false
33554 8453 Acked 9452 Write 4 Done New Done false
33555 8454 Acked 9453 Read 6 Done New Done false
33556 8455 Acked 9454 Write 9 Done New Done false
33557 8456 Acked 9455 Write 4 Done New Done false
33558 8457 Acked 9456 Read 9 Done New Done false
33559 8458 Acked 9457 Write 9 Done New Done false
33560 8459 Acked 9458 Write 5 Done New Done false
33561 8460 Acked 9459 Read 8 Done New Done false
33562 8461 Acked 9460 Read 8 Done New Done false
33563 8462 Acked 9461 Read 9 Done New Done false
33564 8463 Acked 9462 Write 9 Done New Done false
33565 8464 Acked 9463 Write 5 Done New Done false
33566 8465 Acked 9464 Write 10 Done New Done false
33567 8466 Acked 9465 Read 10 Done New Done false
33568 8467 Acked 9466 Read 4 Done New Done false
33569 8468 Acked 9467 Flush 0 Done New Done false
33570 8469 Acked 9468 Read 4 Done New Done false
33571 8470 Acked 9469 Read 7 Done New Done false
33572 8471 Acked 9470 Read 7 Done New Done false
33573 8472 Acked 9471 Write 7 Done New Done false
33574 8473 Acked 9472 Write 1 Done New Done false
33575 8474 Acked 9473 Read 8 Done New Done false
33576 8475 Acked 9474 Flush 0 Done New Done false
33577 8476 Acked 9475 Read 3 Done New Done false
33578 8477 Acked 9476 Write 7 Done New Done false
33579 8478 Acked 9477 Read 3 Done New Done false
33580 8479 Acked 9478 Read 2 Done New Done false
33581 8480 Acked 9479 Read 7 Done New Done false
33582 8481 Acked 9480 Write 7 Done New Done false
33583 8482 Acked 9481 Read 4 Done New Done false
33584 8483 Acked 9482 Read 1 Done New Done false
33585 8484 Acked 9483 Write 9 Done New Done false
33586 8485 Acked 9484 Read 5 Done New Done false
33587 8486 Acked 9485 Read 9 Done New Done false
33588 8487 Acked 9486 Read 6 Done New Done false
33589 8488 Acked 9487 Read 7 Done New Done false
33590 8489 Acked 9488 Read 10 Done New Done false
33591 8490 Acked 9489 Write 2 Done New Done false
33592 8491 Acked 9490 Read 7 Done New Done false
33593 8492 Acked 9491 Read 7 Done New Done false
33594 8493 Acked 9492 Read 7 Done New Done false
33595 8494 Acked 9493 Read 9 Done New Done false
33596 8495 Acked 9494 Write 9 Done New Done false
33597 8496 Acked 9495 Read 6 Done New Done false
33598 8497 Acked 9496 Read 3 Done New Done false
33599 8498 Acked 9497 Write 1 Done New Done false
33600 8499 Acked 9498 Write 3 Done New Done false
33601 8500 Acked 9499 Write 10 Done New Done false
33602 8501 Acked 9500 Read 1 Done New Done false
33603 8502 Acked 9501 Write 1 Done New Done false
33604 8503 Acked 9502 Read 5 Done New Done false
33605 8504 Acked 9503 Read 3 Done New Done false
33606 8505 Acked 9504 Write 10 Done New Done false
33607 8506 Acked 9505 Read 3 Done New Done false
33608 8507 Acked 9506 Read 2 Done New Done false
33609 8508 Acked 9507 Flush 0 Done New Done false
33610 8509 Acked 9508 Write 1 Done New Done false
33611 8510 Acked 9509 Read 7 Done New Done false
33612 8511 Acked 9510 Write 4 Done New Done false
33613 8512 Acked 9511 Read 10 Done New Done false
33614 8513 Acked 9512 Read 4 Done New Done false
33615 8514 Acked 9513 Read 10 Done New Done false
33616 8515 Acked 9514 Flush 0 Done New Done false
33617 8516 Acked 9515 Write 3 Done New Done false
33618 8517 Acked 9516 Write 7 Done New Done false
33619 8518 Acked 9517 Write 8 Done New Done false
33620 8519 Acked 9518 Flush 0 Done New Done false
33621 8520 Acked 9519 Read 10 Done New Done false
33622 8521 Acked 9520 Flush 0 Done New Done false
33623 8522 Acked 9521 Write 1 Done New Done false
33624 8523 Acked 9522 Read 3 Done New Done false
33625 8524 Acked 9523 Write 1 Done New Done false
33626 8525 Acked 9524 Write 8 Done New Done false
33627 8526 Acked 9525 Write 10 Done New Done false
33628 8527 Acked 9526 Read 6 Done New Done false
33629 8528 Acked 9527 Flush 0 Done New Done false
33630 8529 Acked 9528 Write 8 Done New Done false
33631 8530 Acked 9529 Read 3 Done New Done false
33632 8531 Acked 9530 Write 6 Done New Done false
33633 8532 Acked 9531 Write 8 Done New Done false
33634 8533 Acked 9532 Read 10 Done New Done false
33635 8534 Acked 9533 Read 3 Done New Done false
33636 8535 Acked 9534 Read 3 Done New Done false
33637 8536 Acked 9535 Write 10 Done New Done false
33638 8537 Acked 9536 Read 9 Done New Done false
33639 8538 Acked 9537 Write 5 Done New Done false
33640 8539 Acked 9538 Write 6 Done New Done false
33641 8540 Acked 9539 Flush 0 Done New Done false
33642 8541 Acked 9540 Write 1 Done New Done false
33643 8542 Acked 9541 Read 4 Done New Done false
33644 8543 Acked 9542 Read 7 Done New Done false
33645 8544 Acked 9543 Write 2 Done New Done false
33646 8545 Acked 9544 Write 6 Done New Done false
33647 8546 Acked 9545 Flush 0 Done New Done false
33648 8547 Acked 9546 Write 6 Done New Done false
33649 8548 Acked 9547 Read 8 Done New Done false
33650 8549 Acked 9548 Read 1 Done New Done false
33651 8550 Acked 9549 Read 7 Done New Done false
33652 8551 Acked 9550 Write 3 Done New Done false
33653 8552 Acked 9551 Write 6 Done New Done false
33654 8553 Acked 9552 Read 2 Done New Done false
33655 8554 Acked 9553 Write 5 Done New Done false
33656 8555 Acked 9554 Read 1 Done New Done false
33657 8556 Acked 9555 Write 2 Done New Done false
33658 8557 Acked 9556 Flush 0 Done New Done false
33659 8558 Acked 9557 Read 3 Done New Done false
33660 8559 Acked 9558 Write 9 Done New Done false
33661 8560 Acked 9559 Read 8 Done New Done false
33662 8561 Acked 9560 Read 6 Done New Done false
33663 8562 Acked 9561 Write 3 Done New Done false
33664 8563 Acked 9562 Read 7 Done New Done false
33665 8564 Acked 9563 Write 4 Done New Done false
33666 8565 Acked 9564 Write 10 Done New Done false
33667 8566 Acked 9565 Read 6 Done New Done false
33668 8567 Acked 9566 Write 7 Done New Done false
33669 8568 Acked 9567 Read 7 Done New Done false
33670 8569 Acked 9568 Read 3 Done New Done false
33671 8570 Acked 9569 Read 1 Done New Done false
33672 8571 Acked 9570 Read 8 Done New Done false
33673 8572 Acked 9571 Read 9 Done New Done false
33674 8573 Acked 9572 Read 4 Done New Done false
33675 8574 Acked 9573 Read 1 Done New Done false
33676 8575 Acked 9574 Write 8 Done New Done false
33677 8576 Acked 9575 Write 8 Done New Done false
33678 8577 Acked 9576 Read 1 Done New Done false
33679 8578 Acked 9577 Write 7 Done New Done false
33680 8579 Acked 9578 Write 5 Done New Done false
33681 8580 Acked 9579 Read 6 Done New Done false
33682 8581 Acked 9580 Read 7 Done New Done false
33683 8582 Acked 9581 Write 7 Done New Done false
33684 8583 Acked 9582 Write 6 Done New Done false
33685 8584 Acked 9583 Read 1 Done New Done false
33686 8585 Acked 9584 Write 2 Done New Done false
33687 8586 Acked 9585 Read 10 Done New Done false
33688 8587 Acked 9586 Read 2 Done New Done false
33689 8588 Acked 9587 Write 2 Done New Done false
33690 8589 Acked 9588 Write 4 Done New Done false
33691 8590 Acked 9589 Read 7 Done New Done false
33692 8591 Acked 9590 Read 3 Done New Done false
33693 8592 Acked 9591 Flush 0 Done New Done false
33694 8593 Acked 9592 Flush 0 Done New Done false
33695 8594 Acked 9593 Flush 0 Done New Done false
33696 8595 Acked 9594 Read 3 Done New Done false
33697 8596 Acked 9595 Write 3 Done New Done false
33698 8597 Acked 9596 Write 7 Done New Done false
33699 8598 Acked 9597 Write 1 Done New Done false
33700 8599 Acked 9598 Read 5 Done New Done false
33701 8600 Acked 9599 Read 5 Done New Done false
33702 8601 Acked 9600 Write 7 Done New Done false
33703 8602 Acked 9601 Write 7 Done New Done false
33704 8603 Acked 9602 Read 6 Done New Done false
33705 8604 Acked 9603 Write 3 Done New Done false
33706 8605 Acked 9604 Write 1 Done New Done false
33707 8606 Acked 9605 Read 2 Done New Done false
33708 8607 Acked 9606 Write 6 Done New Done false
33709 8608 Acked 9607 Read 3 Done New Done false
33710 8609 Acked 9608 Write 8 Done New Done false
33711 8610 Acked 9609 Write 4 Done New Done false
33712 8611 Acked 9610 Read 8 Done New Done false
33713 8612 Acked 9611 Flush 0 Done New Done false
33714 8613 Acked 9612 Write 9 Done New Done false
33715 8614 Acked 9613 Write 8 Done New Done false
33716 8615 Acked 9614 Read 1 Done New Done false
33717 8616 Acked 9615 Read 7 Done New Done false
33718 8617 Acked 9616 Read 8 Done New Done false
33719 8618 Acked 9617 Read 2 Done New Done false
33720 8619 Acked 9618 Read 6 Done New Done false
33721 8620 Acked 9619 Write 5 Done New Done false
33722 8621 Acked 9620 Read 1 Done New Done false
33723 8622 Acked 9621 Read 5 Done New Done false
33724 8623 Acked 9622 Read 6 Done New Done false
33725 8624 Acked 9623 Read 7 Done New Done false
33726 8625 Acked 9624 Write 1 Done New Done false
33727 8626 Acked 9625 Write 3 Done New Done false
33728 8627 Acked 9626 Write 1 Done New Done false
33729 8628 Acked 9627 Read 2 Done New Done false
33730 8629 Acked 9628 Read 7 Done New Done false
33731 8630 Acked 9629 Read 7 Done New Done false
33732 8631 Acked 9630 Read 2 Done New Done false
33733 8632 Acked 9631 Write 2 Done New Done false
33734 8633 Acked 9632 Write 1 Done New Done false
33735 8634 Acked 9633 Read 9 Done New Done false
33736 8635 Acked 9634 Write 2 Done New Done false
33737 8636 Acked 9635 Write 8 Done New Done false
33738 8637 Acked 9636 Read 4 Done New Done false
33739 8638 Acked 9637 Read 6 Done New Done false
33740 8639 Acked 9638 Write 8 Done New Done false
33741 8640 Acked 9639 Read 2 Done New Done false
33742 8641 Acked 9640 Write 9 Done New Done false
33743 8642 Acked 9641 Write 10 Done New Done false
33744 8643 Acked 9642 Read 1 Done New Done false
33745 8644 Acked 9643 Read 7 Done New Done false
33746 8645 Acked 9644 Read 8 Done New Done false
33747 8646 Acked 9645 Write 6 Done New Done false
33748 8647 Acked 9646 Write 3 Done New Done false
33749 8648 Acked 9647 Read 9 Done New Done false
33750 8649 Acked 9648 Read 6 Done New Done false
33751 8650 Acked 9649 Read 1 Done New Done false
33752 8651 Acked 9650 Read 1 Done New Done false
33753 8652 Acked 9651 Write 8 Done New Done false
33754 8653 Acked 9652 Write 2 Done New Done false
33755 8654 Acked 9653 Read 10 Done New Done false
33756 8655 Acked 9654 Write 8 Done New Done false
33757 8656 Acked 9655 Write 2 Done New Done false
33758 8657 Acked 9656 Write 10 Done New Done false
33759 8658 Acked 9657 Write 7 Done New Done false
33760 8659 Acked 9658 Flush 0 Done New Done false
33761 8660 Acked 9659 Write 4 Done New Done false
33762 8661 Acked 9660 Read 10 Done New Done false
33763 8662 Acked 9661 Write 8 Done New Done false
33764 8663 Acked 9662 Write 1 Done New Done false
33765 8664 Acked 9663 Flush 0 Done New Done false
33766 8665 Acked 9664 Write 1 Done New Done false
33767 8666 Acked 9665 Flush 0 Done New Done false
33768 8667 Acked 9666 Read 9 Done New Done false
33769 8668 Acked 9667 Read 9 Done New Done false
33770 8669 Acked 9668 Read 4 Done New Done false
33771 8670 Acked 9669 Read 5 Done New Done false
33772 8671 Acked 9670 Write 2 Done New Done false
33773 8672 Acked 9671 Write 4 Done New Done false
33774 8673 Acked 9672 Write 3 Done New Done false
33775 8674 Acked 9673 Read 4 Done New Done false
33776 8675 Acked 9674 Write 5 Done New Done false
33777 8676 Acked 9675 Read 2 Done New Done false
33778 8677 Acked 9676 Read 3 Done New Done false
33779 8678 Acked 9677 Read 5 Done New Done false
33780 8679 Acked 9678 Read 2 Done New Done false
33781 8680 Acked 9679 Write 3 Done New Done false
33782 8681 Acked 9680 Flush 0 Done New Done false
33783 8682 Acked 9681 Read 6 Done New Done false
33784 8683 Acked 9682 Read 1 Done New Done false
33785 8684 Acked 9683 Read 5 Done New Done false
33786 8685 Acked 9684 Read 3 Done New Done false
33787 8686 Acked 9685 Read 7 Done New Done false
33788 8687 Acked 9686 Read 7 Done New Done false
33789 8688 Acked 9687 Read 7 Done New Done false
33790 8689 Acked 9688 Write 6 Done New Done false
33791 8690 Acked 9689 Write 3 Done New Done false
33792 8691 Acked 9690 Write 7 Done New Done false
33793 8692 Acked 9691 Read 8 Done New Done false
33794 8693 Acked 9692 Write 10 Done New Done false
33795 8694 Acked 9693 Read 9 Done New Done false
33796 8695 Acked 9694 Read 4 Done New Done false
33797 8696 Acked 9695 Write 10 Done New Done false
33798 8697 Acked 9696 Read 4 Done New Done false
33799 8698 Acked 9697 Read 3 Done New Done false
33800 8699 Acked 9698 Write 1 Done New Done false
33801 8700 Acked 9699 Read 9 Done New Done false
33802 8701 Acked 9700 Write 4 Done New Done false
33803 8702 Acked 9701 Read 5 Done New Done false
33804 8703 Acked 9702 Write 1 Done New Done false
33805 8704 Acked 9703 Write 3 Done New Done false
33806 8705 Acked 9704 Flush 0 Done New Done false
33807 8706 Acked 9705 Read 8 Done New Done false
33808 8707 Acked 9706 Write 10 Done New Done false
33809 8708 Acked 9707 Read 8 Done New Done false
33810 8709 Acked 9708 Read 5 Done New Done false
33811 8710 Acked 9709 Read 3 Done New Done false
33812 8711 Acked 9710 Write 5 Done New Done false
33813 8712 Acked 9711 Flush 0 Done New Done false
33814 8713 Acked 9712 Write 9 Done New Done false
33815 8714 Acked 9713 Read 5 Done New Done false
33816 8715 Acked 9714 Read 5 Done New Done false
33817 8716 Acked 9715 Write 9 Done New Done false
33818 8717 Acked 9716 Read 2 Done New Done false
33819 8718 Acked 9717 Read 4 Done New Done false
33820 8719 Acked 9718 Flush 0 Done New Done false
33821 8720 Acked 9719 Read 10 Done New Done false
33822 8721 Acked 9720 Write 1 Done New Done false
33823 8722 Acked 9721 Read 8 Done New Done false
33824 8723 Acked 9722 Write 2 Done New Done false
33825 8724 Acked 9723 Read 9 Done New Done false
33826 8725 Acked 9724 Write 10 Done New Done false
33827 8726 Acked 9725 Read 1 Done New Done false
33828 8727 Acked 9726 Write 4 Done New Done false
33829 8728 Acked 9727 Write 3 Done New Done false
33830 8729 Acked 9728 Flush 0 Done New Done false
33831 8730 Acked 9729 Read 5 Done New Done false
33832 8731 Acked 9730 Read 3 Done New Done false
33833 8732 Acked 9731 Write 9 Done New Done false
33834 8733 Acked 9732 Write 5 Done New Done false
33835 8734 Acked 9733 Read 4 Done New Done false
33836 8735 Acked 9734 Read 5 Done New Done false
33837 8736 Acked 9735 Read 6 Done New Done false
33838 8737 Acked 9736 Write 5 Done New Done false
33839 8738 Acked 9737 Write 2 Done New Done false
33840 8739 Acked 9738 Read 7 Done New Done false
33841 8740 Acked 9739 Flush 0 Done New Done false
33842 8741 Acked 9740 Write 10 Done New Done false
33843 STATES DS:0 DS:1 DS:2 TOTAL
33844 New 0 300 0 300
33845 Sent 0 0 0 0
33846 Done 300 0 300 600
33847 Skipped 0 0 0 0
33848 Error 0 0 0 0
33849 Last Flush: 9739 9440 9739
33850 Downstairs last five completed: 9440 9439 9438 9437 9436
33851 Upstairs last five completed: 8741 8740 8739 8738 8737
33852 CLIENT: Up:0 ds:300 act:2
33853 [8820] got start action
33854 [8820] I am going to restart
33855 Starting downstairs at port 8820
33856 Make output file at "/tmp/dsc/downstairs-8820.txt"
33857 [8820][1] reports Starting
33858 Downstairs /var/tmp/dsc/region/8820 port 8820 PID:Some(1225)
33859 [8820][1] reports Running
33860 ----------------------------------------------------------------
33861 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:301
33862 States: Active Offline Active
33863 GW_ID ACK DSID TYPE BLOCKS DS:0 DS:1 DS:2 REPLAY
33864 8442 Acked 9441 Read 2 Done New Done false
33865 8443 Acked 9442 Read 4 Done New Done false
33866 8444 Acked 9443 Flush 0 Done New Done false
33867 8445 Acked 9444 Read 1 Done New Done false
33868 8446 Acked 9445 Flush 0 Done New Done false
33869 8447 Acked 9446 Write 5 Done New Done false
33870 8448 Acked 9447 Read 4 Done New Done false
33871 8449 Acked 9448 Write 4 Done New Done false
33872 8450 Acked 9449 Write 3 Done New Done false
33873 8451 Acked 9450 Flush 0 Done New Done false
33874 8452 Acked 9451 Read 8 Done New Done false
33875 8453 Acked 9452 Write 4 Done New Done false
33876 8454 Acked 9453 Read 6 Done New Done false
33877 8455 Acked 9454 Write 9 Done New Done false
33878 8456 Acked 9455 Write 4 Done New Done false
33879 8457 Acked 9456 Read 9 Done New Done false
33880 8458 Acked 9457 Write 9 Done New Done false
33881 8459 Acked 9458 Write 5 Done New Done false
33882 8460 Acked 9459 Read 8 Done New Done false
33883 8461 Acked 9460 Read 8 Done New Done false
33884 8462 Acked 9461 Read 9 Done New Done false
33885 8463 Acked 9462 Write 9 Done New Done false
33886 8464 Acked 9463 Write 5 Done New Done false
33887 8465 Acked 9464 Write 10 Done New Done false
33888 8466 Acked 9465 Read 10 Done New Done false
33889 8467 Acked 9466 Read 4 Done New Done false
33890 8468 Acked 9467 Flush 0 Done New Done false
33891 8469 Acked 9468 Read 4 Done New Done false
33892 8470 Acked 9469 Read 7 Done New Done false
33893 8471 Acked 9470 Read 7 Done New Done false
33894 8472 Acked 9471 Write 7 Done New Done false
33895 8473 Acked 9472 Write 1 Done New Done false
33896 8474 Acked 9473 Read 8 Done New Done false
33897 8475 Acked 9474 Flush 0 Done New Done false
33898 8476 Acked 9475 Read 3 Done New Done false
33899 8477 Acked 9476 Write 7 Done New Done false
33900 8478 Acked 9477 Read 3 Done New Done false
33901 8479 Acked 9478 Read 2 Done New Done false
33902 8480 Acked 9479 Read 7 Done New Done false
33903 8481 Acked 9480 Write 7 Done New Done false
33904 8482 Acked 9481 Read 4 Done New Done false
33905 8483 Acked 9482 Read 1 Done New Done false
33906 8484 Acked 9483 Write 9 Done New Done false
33907 8485 Acked 9484 Read 5 Done New Done false
33908 8486 Acked 9485 Read 9 Done New Done false
33909 8487 Acked 9486 Read 6 Done New Done false
33910 8488 Acked 9487 Read 7 Done New Done false
33911 8489 Acked 9488 Read 10 Done New Done false
33912 8490 Acked 9489 Write 2 Done New Done false
33913 8491 Acked 9490 Read 7 Done New Done false
33914 8492 Acked 9491 Read 7 Done New Done false
33915 8493 Acked 9492 Read 7 Done New Done false
33916 8494 Acked 9493 Read 9 Done New Done false
33917 8495 Acked 9494 Write 9 Done New Done false
33918 8496 Acked 9495 Read 6 Done New Done false
33919 8497 Acked 9496 Read 3 Done New Done false
33920 8498 Acked 9497 Write 1 Done New Done false
33921 8499 Acked 9498 Write 3 Done New Done false
33922 8500 Acked 9499 Write 10 Done New Done false
33923 8501 Acked 9500 Read 1 Done New Done false
33924 8502 Acked 9501 Write 1 Done New Done false
33925 8503 Acked 9502 Read 5 Done New Done false
33926 8504 Acked 9503 Read 3 Done New Done false
33927 8505 Acked 9504 Write 10 Done New Done false
33928 8506 Acked 9505 Read 3 Done New Done false
33929 8507 Acked 9506 Read 2 Done New Done false
33930 8508 Acked 9507 Flush 0 Done New Done false
33931 8509 Acked 9508 Write 1 Done New Done false
33932 8510 Acked 9509 Read 7 Done New Done false
33933 8511 Acked 9510 Write 4 Done New Done false
33934 8512 Acked 9511 Read 10 Done New Done false
33935 8513 Acked 9512 Read 4 Done New Done false
33936 8514 Acked 9513 Read 10 Done New Done false
33937 8515 Acked 9514 Flush 0 Done New Done false
33938 8516 Acked 9515 Write 3 Done New Done false
33939 8517 Acked 9516 Write 7 Done New Done false
33940 8518 Acked 9517 Write 8 Done New Done false
33941 8519 Acked 9518 Flush 0 Done New Done false
33942 8520 Acked 9519 Read 10 Done New Done false
33943 8521 Acked 9520 Flush 0 Done New Done false
33944 8522 Acked 9521 Write 1 Done New Done false
33945 8523 Acked 9522 Read 3 Done New Done false
33946 8524 Acked 9523 Write 1 Done New Done false
33947 8525 Acked 9524 Write 8 Done New Done false
33948 8526 Acked 9525 Write 10 Done New Done false
33949 8527 Acked 9526 Read 6 Done New Done false
33950 8528 Acked 9527 Flush 0 Done New Done false
33951 8529 Acked 9528 Write 8 Done New Done false
33952 8530 Acked 9529 Read 3 Done New Done false
33953 8531 Acked 9530 Write 6 Done New Done false
33954 8532 Acked 9531 Write 8 Done New Done false
33955 8533 Acked 9532 Read 10 Done New Done false
33956 8534 Acked 9533 Read 3 Done New Done false
33957 8535 Acked 9534 Read 3 Done New Done false
33958 8536 Acked 9535 Write 10 Done New Done false
33959 8537 Acked 9536 Read 9 Done New Done false
33960 8538 Acked 9537 Write 5 Done New Done false
33961 8539 Acked 9538 Write 6 Done New Done false
33962 8540 Acked 9539 Flush 0 Done New Done false
33963 8541 Acked 9540 Write 1 Done New Done false
33964 8542 Acked 9541 Read 4 Done New Done false
33965 8543 Acked 9542 Read 7 Done New Done false
33966 8544 Acked 9543 Write 2 Done New Done false
33967 8545 Acked 9544 Write 6 Done New Done false
33968 8546 Acked 9545 Flush 0 Done New Done false
33969 8547 Acked 9546 Write 6 Done New Done false
33970 8548 Acked 9547 Read 8 Done New Done false
33971 8549 Acked 9548 Read 1 Done New Done false
33972 8550 Acked 9549 Read 7 Done New Done false
33973 8551 Acked 9550 Write 3 Done New Done false
33974 8552 Acked 9551 Write 6 Done New Done false
33975 8553 Acked 9552 Read 2 Done New Done false
33976 8554 Acked 9553 Write 5 Done New Done false
33977 8555 Acked 9554 Read 1 Done New Done false
33978 8556 Acked 9555 Write 2 Done New Done false
33979 8557 Acked 9556 Flush 0 Done New Done false
33980 8558 Acked 9557 Read 3 Done New Done false
33981 8559 Acked 9558 Write 9 Done New Done false
33982 8560 Acked 9559 Read 8 Done New Done false
33983 8561 Acked 9560 Read 6 Done New Done false
33984 8562 Acked 9561 Write 3 Done New Done false
33985 8563 Acked 9562 Read 7 Done New Done false
33986 8564 Acked 9563 Write 4 Done New Done false
33987 8565 Acked 9564 Write 10 Done New Done false
33988 8566 Acked 9565 Read 6 Done New Done false
33989 8567 Acked 9566 Write 7 Done New Done false
33990 8568 Acked 9567 Read 7 Done New Done false
33991 8569 Acked 9568 Read 3 Done New Done false
33992 8570 Acked 9569 Read 1 Done New Done false
33993 8571 Acked 9570 Read 8 Done New Done false
33994 8572 Acked 9571 Read 9 Done New Done false
33995 8573 Acked 9572 Read 4 Done New Done false
33996 8574 Acked 9573 Read 1 Done New Done false
33997 8575 Acked 9574 Write 8 Done New Done false
33998 8576 Acked 9575 Write 8 Done New Done false
33999 8577 Acked 9576 Read 1 Done New Done false
34000 8578 Acked 9577 Write 7 Done New Done false
34001 8579 Acked 9578 Write 5 Done New Done false
34002 8580 Acked 9579 Read 6 Done New Done false
34003 8581 Acked 9580 Read 7 Done New Done false
34004 8582 Acked 9581 Write 7 Done New Done false
34005 8583 Acked 9582 Write 6 Done New Done false
34006 8584 Acked 9583 Read 1 Done New Done false
34007 8585 Acked 9584 Write 2 Done New Done false
34008 8586 Acked 9585 Read 10 Done New Done false
34009 8587 Acked 9586 Read 2 Done New Done false
34010 8588 Acked 9587 Write 2 Done New Done false
34011 8589 Acked 9588 Write 4 Done New Done false
34012 8590 Acked 9589 Read 7 Done New Done false
34013 8591 Acked 9590 Read 3 Done New Done false
34014 8592 Acked 9591 Flush 0 Done New Done false
34015 8593 Acked 9592 Flush 0 Done New Done false
34016 8594 Acked 9593 Flush 0 Done New Done false
34017 8595 Acked 9594 Read 3 Done New Done false
34018 8596 Acked 9595 Write 3 Done New Done false
34019 8597 Acked 9596 Write 7 Done New Done false
34020 8598 Acked 9597 Write 1 Done New Done false
34021 8599 Acked 9598 Read 5 Done New Done false
34022 8600 Acked 9599 Read 5 Done New Done false
34023 8601 Acked 9600 Write 7 Done New Done false
34024 8602 Acked 9601 Write 7 Done New Done false
34025 8603 Acked 9602 Read 6 Done New Done false
34026 8604 Acked 9603 Write 3 Done New Done false
34027 8605 Acked 9604 Write 1 Done New Done false
34028 8606 Acked 9605 Read 2 Done New Done false
34029 8607 Acked 9606 Write 6 Done New Done false
34030 8608 Acked 9607 Read 3 Done New Done false
34031 8609 Acked 9608 Write 8 Done New Done false
34032 8610 Acked 9609 Write 4 Done New Done false
34033 8611 Acked 9610 Read 8 Done New Done false
34034 8612 Acked 9611 Flush 0 Done New Done false
34035 8613 Acked 9612 Write 9 Done New Done false
34036 8614 Acked 9613 Write 8 Done New Done false
34037 8615 Acked 9614 Read 1 Done New Done false
34038 8616 Acked 9615 Read 7 Done New Done false
34039 8617 Acked 9616 Read 8 Done New Done false
34040 8618 Acked 9617 Read 2 Done New Done false
34041 8619 Acked 9618 Read 6 Done New Done false
34042 8620 Acked 9619 Write 5 Done New Done false
34043 8621 Acked 9620 Read 1 Done New Done false
34044 8622 Acked 9621 Read 5 Done New Done false
34045 8623 Acked 9622 Read 6 Done New Done false
34046 8624 Acked 9623 Read 7 Done New Done false
34047 8625 Acked 9624 Write 1 Done New Done false
34048 8626 Acked 9625 Write 3 Done New Done false
34049 8627 Acked 9626 Write 1 Done New Done false
34050 8628 Acked 9627 Read 2 Done New Done false
34051 8629 Acked 9628 Read 7 Done New Done false
34052 8630 Acked 9629 Read 7 Done New Done false
34053 8631 Acked 9630 Read 2 Done New Done false
34054 8632 Acked 9631 Write 2 Done New Done false
34055 8633 Acked 9632 Write 1 Done New Done false
34056 8634 Acked 9633 Read 9 Done New Done false
34057 8635 Acked 9634 Write 2 Done New Done false
34058 8636 Acked 9635 Write 8 Done New Done false
34059 8637 Acked 9636 Read 4 Done New Done false
34060 8638 Acked 9637 Read 6 Done New Done false
34061 8639 Acked 9638 Write 8 Done New Done false
34062 8640 Acked 9639 Read 2 Done New Done false
34063 8641 Acked 9640 Write 9 Done New Done false
34064 8642 Acked 9641 Write 10 Done New Done false
34065 8643 Acked 9642 Read 1 Done New Done false
34066 8644 Acked 9643 Read 7 Done New Done false
34067 8645 Acked 9644 Read 8 Done New Done false
34068 8646 Acked 9645 Write 6 Done New Done false
34069 8647 Acked 9646 Write 3 Done New Done false
34070 8648 Acked 9647 Read 9 Done New Done false
34071 8649 Acked 9648 Read 6 Done New Done false
34072 8650 Acked 9649 Read 1 Done New Done false
34073 8651 Acked 9650 Read 1 Done New Done false
34074 8652 Acked 9651 Write 8 Done New Done false
34075 8653 Acked 9652 Write 2 Done New Done false
34076 8654 Acked 9653 Read 10 Done New Done false
34077 8655 Acked 9654 Write 8 Done New Done false
34078 8656 Acked 9655 Write 2 Done New Done false
34079 8657 Acked 9656 Write 10 Done New Done false
34080 8658 Acked 9657 Write 7 Done New Done false
34081 8659 Acked 9658 Flush 0 Done New Done false
34082 8660 Acked 9659 Write 4 Done New Done false
34083 8661 Acked 9660 Read 10 Done New Done false
34084 8662 Acked 9661 Write 8 Done New Done false
34085 8663 Acked 9662 Write 1 Done New Done false
34086 8664 Acked 9663 Flush 0 Done New Done false
34087 8665 Acked 9664 Write 1 Done New Done false
34088 8666 Acked 9665 Flush 0 Done New Done false
34089 8667 Acked 9666 Read 9 Done New Done false
34090 8668 Acked 9667 Read 9 Done New Done false
34091 8669 Acked 9668 Read 4 Done New Done false
34092 8670 Acked 9669 Read 5 Done New Done false
34093 8671 Acked 9670 Write 2 Done New Done false
34094 8672 Acked 9671 Write 4 Done New Done false
34095 8673 Acked 9672 Write 3 Done New Done false
34096 8674 Acked 9673 Read 4 Done New Done false
34097 8675 Acked 9674 Write 5 Done New Done false
34098 8676 Acked 9675 Read 2 Done New Done false
34099 8677 Acked 9676 Read 3 Done New Done false
34100 8678 Acked 9677 Read 5 Done New Done false
34101 8679 Acked 9678 Read 2 Done New Done false
34102 8680 Acked 9679 Write 3 Done New Done false
34103 8681 Acked 9680 Flush 0 Done New Done false
34104 8682 Acked 9681 Read 6 Done New Done false
34105 8683 Acked 9682 Read 1 Done New Done false
34106 8684 Acked 9683 Read 5 Done New Done false
34107 8685 Acked 9684 Read 3 Done New Done false
34108 8686 Acked 9685 Read 7 Done New Done false
34109 8687 Acked 9686 Read 7 Done New Done false
34110 8688 Acked 9687 Read 7 Done New Done false
34111 8689 Acked 9688 Write 6 Done New Done false
34112 8690 Acked 9689 Write 3 Done New Done false
34113 8691 Acked 9690 Write 7 Done New Done false
34114 8692 Acked 9691 Read 8 Done New Done false
34115 8693 Acked 9692 Write 10 Done New Done false
34116 8694 Acked 9693 Read 9 Done New Done false
34117 8695 Acked 9694 Read 4 Done New Done false
34118 8696 Acked 9695 Write 10 Done New Done false
34119 8697 Acked 9696 Read 4 Done New Done false
34120 8698 Acked 9697 Read 3 Done New Done false
34121 8699 Acked 9698 Write 1 Done New Done false
34122 8700 Acked 9699 Read 9 Done New Done false
34123 8701 Acked 9700 Write 4 Done New Done false
34124 8702 Acked 9701 Read 5 Done New Done false
34125 8703 Acked 9702 Write 1 Done New Done false
34126 8704 Acked 9703 Write 3 Done New Done false
34127 8705 Acked 9704 Flush 0 Done New Done false
34128 8706 Acked 9705 Read 8 Done New Done false
34129 8707 Acked 9706 Write 10 Done New Done false
34130 8708 Acked 9707 Read 8 Done New Done false
34131 8709 Acked 9708 Read 5 Done New Done false
34132 8710 Acked 9709 Read 3 Done New Done false
34133 8711 Acked 9710 Write 5 Done New Done false
34134 8712 Acked 9711 Flush 0 Done New Done false
34135 8713 Acked 9712 Write 9 Done New Done false
34136 8714 Acked 9713 Read 5 Done New Done false
34137 8715 Acked 9714 Read 5 Done New Done false
34138 8716 Acked 9715 Write 9 Done New Done false
34139 8717 Acked 9716 Read 2 Done New Done false
34140 8718 Acked 9717 Read 4 Done New Done false
34141 8719 Acked 9718 Flush 0 Done New Done false
34142 8720 Acked 9719 Read 10 Done New Done false
34143 8721 Acked 9720 Write 1 Done New Done false
34144 8722 Acked 9721 Read 8 Done New Done false
34145 8723 Acked 9722 Write 2 Done New Done false
34146 8724 Acked 9723 Read 9 Done New Done false
34147 8725 Acked 9724 Write 10 Done New Done false
34148 8726 Acked 9725 Read 1 Done New Done false
34149 8727 Acked 9726 Write 4 Done New Done false
34150 8728 Acked 9727 Write 3 Done New Done false
34151 8729 Acked 9728 Flush 0 Done New Done false
34152 8730 Acked 9729 Read 5 Done New Done false
34153 8731 Acked 9730 Read 3 Done New Done false
34154 8732 Acked 9731 Write 9 Done New Done false
34155 8733 Acked 9732 Write 5 Done New Done false
34156 8734 Acked 9733 Read 4 Done New Done false
34157 8735 Acked 9734 Read 5 Done New Done false
34158 8736 Acked 9735 Read 6 Done New Done false
34159 8737 Acked 9736 Write 5 Done New Done false
34160 8738 Acked 9737 Write 2 Done New Done false
34161 8739 Acked 9738 Read 7 Done New Done false
34162 8740 Acked 9739 Flush 0 Done New Done false
34163 8741 Acked 9740 Write 10 Done New Done false
34164 8742 Acked 9741 Flush 0 Done New Done false
34165 STATES DS:0 DS:1 DS:2 TOTAL
34166 New 0 301 0 301
34167 Sent 0 0 0 0
34168 Done 301 0 301 602
34169 Skipped 0 0 0 0
34170 Error 0 0 0 0
34171 Last Flush: 9741 9440 9741
34172 Downstairs last five completed: 9440 9439 9438 9437 9436
34173 Upstairs last five completed: 8742 8741 8740 8739 8738
34174 CLIENT: Up:0 ds:301 act:2
341752024-04-20T01:12:14.960ZINFOcrucible: connecting to 127.0.0.1:8820 = io task client = 1 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
341762024-04-20T01:12:14.960ZINFOcrucible: ds_connection connected from Ok(127.0.0.1:38808) = io task client = 1 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
341772024-04-20T01:12:14.961ZINFOcrucible: downstairs client at Some(127.0.0.1:8820) has region UUID 12345678-0000-0000-0000-000000008820 = downstairs client = 1 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
341782024-04-20T01:12:14.961ZINFOcrucible: Returning UUID:12345678-0000-0000-0000-000000008820 matches = downstairs client = 1 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
341792024-04-20T01:12:14.961ZINFOcrucible: send last flush ID to this DS: 9440 = downstairs client = 1 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
341802024-04-20T01:12:14.962ZINFOcrucible: Replied this last flush ID: 9440 = downstairs client = 1 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
341812024-04-20T01:12:14.962ZINFOcrucible: ds_transition from Offline to Replay = downstairs client = 1 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
341822024-04-20T01:12:14.962ZINFOcrucible: [1] Transition from Offline to Replay = downstairs client = 1 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
341832024-04-20T01:12:14.962ZINFOcrucible: ds_transition from Replay to Active = downstairs client = 1 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
341842024-04-20T01:12:14.962ZINFOcrucible: [1] Transition from Replay to Active = downstairs client = 1 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
34185 ----------------------------------------------------------------
34186 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:0
34187 Downstairs last five completed: 9741 9740 9739 9738 9737
34188 Upstairs last five completed: 8742 8741 8740 8739 8738
34189 CLIENT: Up:0 ds:0 act:3
34190 Replay: All jobs finished, all DS active.
34191 Main task has work to do, go find it
34192 got dsc Stop(0)
34193 stop 0
34194 [8810] Got stop action so:false kr:false
34195 Apr 20 01:12:17.266 INFO request completed, latency_us: 357, response_code: 204, uri: /stop/cid/0, method: POST, req_id: d16de332-2b6a-471f-93f3-689889a80d12, remote_addr: 127.0.0.1:60352, local_addr: 127.0.0.1:9998
341962024-04-20T01:12:17.267ZWARNcrucible: downstairs disconnected = io task client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
341972024-04-20T01:12:17.267ZWARNcrucible: client task is sending Done(Finished) = io task client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
341982024-04-20T01:12:17.267ZWARNcrucible: downstairs task for 0 stopped due to Finished session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
341992024-04-20T01:12:17.267ZINFOcrucible: Gone missing, transition from Active to Offline = downstairs client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
342002024-04-20T01:12:17.267ZINFOcrucible: [0] client re-new 0 jobs since flush 9741 = downstairs session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
34201 Apr 20 01:12:17.267 INFO{"msg":"[0] Marked 0 jobs for replay since flush: 9741","v":0,"name":"crucible","level":30,"time":"2024-04-20T01:12:17.26784216Z","hostname":"w-01HVWGBJP7HK0H9TQ26T6N3X8M","pid":1196,"":"downstairs","":"downstairs","session_id":"132b460a-26a0-4532-b1ab-4f8c07d4c6c7"}
34202 request completed, latency_us: 167, response_code: {"msg":"client task is exiting","v":0,"name":"crucible","level":30,"time":"2024-04-20T01:12:17.267867629Z","hostname":"w-01HVWGBJP7HK0H9TQ26T6N3X8M","pid":1196,"":"io task","client":"0","":"downstairs","session_id":"132b460a-26a0-4532-b1ab-4f8c07d4c6c7"}
34203 200, uri: /state/cid/0, method: GET, req_id: 9c58ee0b-38ad-4290-add0-278a8ce70374, remote_addr: 127.0.0.1:60352, local_addr: 127.0.0.1:9998
34204 [8810] Exited with: ExitStatus(unix_wait_status(9))
34205 [8810][0] reports Exit
34206 Apr 20 01:12:21.270 INFO request completed, latency_us: 196, response_code: 200, uri: /state/cid/0, method: GET, req_id: 0b96bf4e-42fd-43c6-a602-e2493ab2538f, remote_addr: 127.0.0.1:60352, local_addr: 127.0.0.1:9998
34207 001/300 Write block 4489 len 28672 data: 4 5 5 4 4 4 6
34208 002/300 Write block 4724 len 4096 data: 6
34209 003/300 Write block 2911 len 20480 data: 6 7 5 4 4
34210 004/300 Write block 2861 len 12288 data: 6 6 7
34211 005/300 Write block 2137 len 8192 data: 3 6
34212 006/300 Flush
34213 007/300 Read block 4325 len 24576
34214 008/300 Write block 129 len 24576 data: 3 4 4 3 3 3
34215 009/300 Write block 820 len 8192 data: 6 6
34216 010/300 Read block 4723 len 4096
34217 011/300 Read block 2389 len 36864
34218 012/300 Read block 1317 len 16384
34219 013/300 Write block 4225 len 12288 data: 7 7 7
34220 014/300 Flush
34221 015/300 Read block 4837 len 12288
34222 016/300 Read block 4126 len 40960
34223 017/300 Read block 2217 len 28672
34224 018/300 Write block 2079 len 36864 data: 5 5 6 5 6 6 8 11 9
34225 019/300 Write block 300 len 28672 data: 8 6 6 6 5 4 3
34226 020/300 Write block 1257 len 8192 data: 7 7
34227 021/300 Read block 1586 len 4096
34228 022/300 Flush
34229 023/300 Read block 47 len 36864
34230 024/300 Flush
34231 025/300 Write block 1742 len 28672 data: 4 5 6 5 6 6 7
34232 026/300 Write block 2592 len 36864 data: 4 3 3 4 4 6 6 6 9
34233 027/300 Read block 1168 len 32768
34234 028/300 Write block 4290 len 36864 data: 3 5 6 7 7 7 5 6 7
34235 029/300 Read block 180 len 8192
34236 030/300 Read block 4463 len 28672
34237 031/300 Write block 767 len 32768 data: 6 6 6 8 10 11 10 10
34238 032/300 Write block 1256 len 4096 data: 10
34239 033/300 Flush
34240 034/300 Write block 2998 len 40960 data: 9 8 6 5 5 5 4 3 9 9
34241 035/300 Read block 4612 len 36864
34242 036/300 Read block 3234 len 24576
34243 037/300 Flush
34244 038/300 Read block 4123 len 28672
34245 039/300 Write block 1141 len 32768 data: 6 5 4 3 2 2 2 2
34246 040/300 Write block 407 len 40960 data: 4 4 4 4 6 7 8 9 9 8
34247 041/300 Read block 1259 len 36864
34248 042/300 Read block 4480 len 28672
34249 043/300 Read block 1087 len 4096
34250 044/300 Read block 2769 len 20480
34251 045/300 Read block 3213 len 16384
34252 046/300 Write block 2797 len 4096 data: 5
34253 047/300 Write block 2691 len 28672 data: 6 5 4 4 4 6 7
34254 048/300 Write block 1337 len 16384 data: 3 3 2 2
34255 049/300 Write block 1434 len 36864 data: 9 10 10 8 9 8 11 12 13
34256 050/300 Read block 456 len 28672
34257 051/300 Read block 498 len 36864
34258 052/300 Read block 1258 len 32768
34259 053/300 Read block 735 len 24576
34260 054/300 Write block 265 len 24576 data: 6 6 7 8 9 8
34261 055/300 Read block 3796 len 36864
34262 056/300 Write block 3968 len 32768 data: 5 4 5 5 6 5 5 4
34263 057/300 Read block 1031 len 12288
34264 058/300 Flush
34265 059/300 Read block 4045 len 32768
34266 060/300 Read block 4450 len 16384
34267 061/300 Write block 1518 len 24576 data: 10 12 9 7 6 5
34268 062/300 Read block 1511 len 8192
34269 063/300 Flush
34270 064/300 Read block 4818 len 24576
34271 065/300 Write block 455 len 36864 data: 4 3 2 2 2 2 2 4 5
34272 066/300 Read block 3773 len 12288
34273 067/300 Read block 21 len 12288
34274 068/300 Write block 4657 len 12288 data: 7 5 6
34275 069/300 Read block 3780 len 40960
34276 070/300 Read block 1978 len 16384
34277 071/300 Read block 2041 len 24576
34278 072/300 Write block 2297 len 4096 data: 5
34279 073/300 Read block 4515 len 20480
34280 074/300 Read block 3392 len 32768
34281 075/300 Read block 2717 len 8192
34282 076/300 Read block 4492 len 24576
34283 077/300 Read block 1809 len 40960
34284 078/300 Write block 3507 len 8192 data: 4 4
34285 079/300 Write block 1205 len 24576 data: 4 7 7 6 5 4
34286 080/300 Read block 4471 len 24576
34287 081/300 Write block 4048 len 4096 data: 7
34288 082/300 Read block 491 len 32768
34289 083/300 Write block 310 len 4096 data: 7
34290 084/300 Flush
34291 085/300 Read block 4272 len 8192
34292 086/300 Read block 3009 len 20480
34293 087/300 Write block 4237 len 40960 data: 5 6 6 7 7 7 7 7 9 11
34294 088/300 Write block 35 len 16384 data: 5 5 6 7
34295 089/300 Read block 153 len 20480
34296 090/300 Read block 2775 len 36864
34297 091/300 Write block 3630 len 28672 data: 3 4 3 4 4 4 6
34298 092/300 Write block 2421 len 24576 data: 3 3 5 5 6 9
34299 093/300 Write block 1577 len 12288 data: 5 6 4
34300 094/300 Read block 4753 len 36864
34301 095/300 Read block 1307 len 12288
34302 096/300 Read block 3781 len 40960
34303 097/300 Read block 3583 len 20480
34304 098/300 Read block 2628 len 4096
34305 099/300 Write block 4434 len 8192 data: 8 6
34306 100/300 Write block 634 len 36864 data: 5 4 5 4 4 4 5 5 5
34307 101/300 Read block 1495 len 20480
34308 102/300 Read block 4398 len 36864
34309 103/300 Read block 3205 len 36864
34310 104/300 Write block 3249 len 4096 data: 5
34311 105/300 Write block 1990 len 20480 data: 7 5 5 5 3
34312 106/300 Write block 3497 len 40960 data: 6 6 6 6 7 6 5 5 5 4
34313 107/300 Read block 4274 len 36864
34314 108/300 Read block 3116 len 36864
34315 109/300 Write block 2178 len 24576 data: 6 4 3 3 3 5
34316 110/300 Write block 1737 len 20480 data: 3 4 5 4 4
34317 111/300 Write block 3458 len 8192 data: 7 6
34318 112/300 Write block 4863 len 12288 data: 9 7 7
34319 113/300 Read block 3685 len 20480
34320 114/300 Read block 1108 len 24576
34321 115/300 Read block 1998 len 24576
34322 116/300 Read block 4778 len 20480
34323 117/300 Read block 1780 len 40960
34324 118/300 Write block 3293 len 8192 data: 3 3
34325 119/300 Write block 1965 len 28672 data: 6 6 4 4 4 3 3
34326 120/300 Write block 935 len 36864 data: 7 7 7 6 4 2 2 3 3
34327 121/300 Read block 1979 len 24576
34328 122/300 Read block 395 len 16384
34329 123/300 Flush
34330 124/300 Read block 929 len 40960
34331 125/300 Read block 2677 len 12288
34332 126/300 Write block 2376 len 24576 data: 3 5 4 3 4 3
34333 127/300 Read block 1303 len 32768
34334 128/300 Read block 1957 len 36864
34335 129/300 Read block 2695 len 32768
34336 130/300 Write block 175 len 8192 data: 8 7
34337 131/300 Read block 779 len 36864
34338 132/300 Read block 3988 len 12288
34339 133/300 Read block 2299 len 12288
34340 134/300 Flush
34341 135/300 Read block 412 len 32768
34342 136/300 Read block 1789 len 8192
34343 137/300 Write block 4647 len 8192 data: 3 3
34344 138/300 Read block 1022 len 32768
34345 139/300 Write block 4666 len 40960 data: 5 6 6 6 9 9 7 8 8 9
34346 140/300 Read block 3398 len 12288
34347 141/300 Write block 2061 len 28672 data: 13 11 11 11 10 10 9
34348 142/300 Read block 1503 len 12288
34349 143/300 Flush
34350 144/300 Read block 2984 len 20480
34351 145/300 Read block 3290 len 36864
34352 146/300 Write block 2663 len 24576 data: 6 9 9 10 8 8
34353 147/300 Write block 3239 len 24576 data: 5 4 3 3 2 3
34354 148/300 Read block 2006 len 4096
34355 149/300 Flush
34356 150/300 Write block 3084 len 4096 data: 5
34357 151/300 Flush
34358 152/300 Write block 4547 len 4096 data: 9
34359 153/300 Write block 264 len 28672 data: 7 7 7 8 9 10 9
34360 154/300 Write block 685 len 40960 data: 8 7 5 6 6 7 7 7 8 8
34361 155/300 Read block 4103 len 40960
34362 156/300 Write block 1743 len 32768 data: 6 7 6 7 7 8 7 5
34363 157/300 Read block 2200 len 4096
34364 158/300 Write block 4636 len 4096 data: 5
34365 159/300 Write block 3228 len 36864 data: 3 3 4 5 4 5 7 7 8
34366 160/300 Read block 2028 len 36864
34367 161/300 Write block 2416 len 16384 data: 5 4 4 4
34368 162/300 Read block 3756 len 20480
34369 163/300 Write block 4379 len 4096 data: 5
34370 164/300 Read block 2601 len 36864
34371 165/300 Write block 2482 len 28672 data: 3 3 3 4 5 6 6
34372 166/300 Write block 4056 len 4096 data: 7
34373 167/300 Read block 4979 len 12288
34374 168/300 Read block 4807 len 28672
34375 169/300 Write block 2852 len 40960 data: 6 8 8 8 8 6 7 6 5 7
34376 170/300 Write block 4943 len 20480 data: 6 4 5 6 8
34377 171/300 Write block 4008 len 40960 data: 4 5 4 3 3 4 4 4 5 6
34378 172/300 Flush
34379 173/300 Read block 2807 len 8192
34380 174/300 Read block 4649 len 8192
34381 175/300 Read block 4042 len 16384
34382 176/300 Flush
34383 177/300 Write block 1106 len 28672 data: 7 7 7 5 5 7 5
34384 178/300 Read block 4760 len 40960
34385 179/300 Read block 922 len 20480
34386 180/300 Read block 1864 len 20480
34387 181/300 Write block 2112 len 24576 data: 5 5 4 4 4 4
34388 182/300 Read block 4699 len 32768
34389 183/300 Read block 115 len 20480
34390 184/300 Read block 1846 len 40960
34391 185/300 Write block 4673 len 20480 data: 9 9 10 9 9
34392 186/300 Write block 64 len 4096 data: 6
34393 187/300 Write block 228 len 4096 data: 5
34394 188/300 Read block 991 len 24576
34395 189/300 Write block 4710 len 40960 data: 6 7 7 6 8 6 6 6 4 4
34396 190/300 Read block 1940 len 20480
34397 191/300 Write block 932 len 20480 data: 5 4 6 8 8
34398 192/300 Write block 3296 len 4096 data: 5
34399 193/300 Read block 4634 len 32768
34400 194/300 Write block 2482 len 12288 data: 4 4 4
34401 195/300 Read block 4090 len 24576
34402 196/300 Read block 3077 len 8192
34403 197/300 Write block 429 len 12288 data: 6 6 6
34404 198/300 Read block 3755 len 32768
34405 199/300 Read block 1907 len 12288
34406 200/300 Read block 1242 len 28672
34407 201/300 Read block 406 len 16384
34408 202/300 Read block 2655 len 40960
34409 203/300 Read block 3638 len 4096
34410 204/300 Read block 2557 len 32768
34411 205/300 Write block 2672 len 36864 data: 5 7 7 7 8 8 6 7 7
34412 206/300 Flush
34413 207/300 Write block 66 len 20480 data: 6 5 6 5 4
34414 208/300 Read block 4684 len 24576
34415 209/300 Read block 1599 len 20480
34416 210/300 Flush
34417 211/300 Read block 1521 len 8192
34418 212/300 Read block 857 len 8192
34419 213/300 Flush
34420 214/300 Write block 3316 len 32768 data: 8 5 5 5 5 5 5 3
34421 215/300 Write block 4984 len 36864 data: 4 4 4 4 5 6 7 7 7
34422 216/300 Write block 2050 len 8192 data: 7 9
34423 217/300 Read block 2001 len 32768
34424 218/300 Write block 2265 len 32768 data: 6 5 3 4 3 3 3 3
34425 219/300 Read block 2428 len 24576
34426 220/300 Write block 148 len 40960 data: 4 4 4 4 4 5 5 4 4 3
34427 221/300 Write block 546 len 8192 data: 5 4
34428 222/300 Read block 4331 len 40960
34429 223/300 Read block 1736 len 36864
34430 224/300 Write block 3347 len 4096 data: 5
34431 225/300 Write block 2817 len 28672 data: 6 6 6 6 6 5 5
34432 226/300 Read block 2812 len 40960
34433 227/300 Read block 466 len 24576
34434 228/300 Write block 4232 len 32768 data: 2 2 2 2 3 6 7 7
34435 229/300 Read block 2056 len 24576
34436 230/300 Write block 4548 len 32768 data: 9 7 7 6 6 5 4 5
34437 231/300 Read block 3845 len 40960
34438 232/300 Read block 1968 len 4096
34439 233/300 Read block 2234 len 24576
34440 234/300 Write block 4306 len 28672 data: 5 6 6 8 7 6 7
34441 235/300 Read block 2999 len 8192
34442 236/300 Read block 3094 len 4096
34443 237/300 Read block 4335 len 8192
34444 238/300 Read block 896 len 20480
34445 239/300 Flush
34446 240/300 Read block 3968 len 20480
34447 241/300 Flush
34448 242/300 Write block 1143 len 20480 data: 5 4 3 3 3
34449 243/300 Write block 4462 len 12288 data: 5 6 6
34450 244/300 Read block 3123 len 36864
34451 245/300 Read block 1682 len 16384
34452 246/300 Read block 4026 len 36864
34453 247/300 Write block 2745 len 28672 data: 7 8 7 7 9 9 8
34454 248/300 Read block 3023 len 16384
34455 249/300 Read block 2205 len 40960
34456 250/300 Write block 4898 len 36864 data: 6 7 6 6 6 5 4 4 5
34457 251/300 Write block 2946 len 4096 data: 4
34458 252/300 Read block 3141 len 32768
34459 253/300 Read block 3618 len 8192
34460 254/300 Read block 4023 len 12288
34461 255/300 Write block 2657 len 32768 data: 5 6 5 6 6 6 7 10
34462 256/300 Write block 194 len 16384 data: 7 6 5 4
34463 257/300 Write block 314 len 20480 data: 7 7 7 7 9
34464 258/300 Read block 456 len 24576
34465 259/300 Read block 5 len 12288
34466 260/300 Read block 2390 len 16384
34467 261/300 Write block 4265 len 36864 data: 6 6 7 6 7 7 7 7 7
34468 262/300 Read block 3321 len 40960
34469 263/300 Read block 1408 len 24576
34470 264/300 Write block 3162 len 28672 data: 5 4 4 3 5 4 4
34471 265/300 Read block 4069 len 32768
34472 266/300 Read block 1023 len 24576
34473 267/300 Write block 2344 len 24576 data: 7 8 9 8 12 9
34474 268/300 Read block 4579 len 8192
34475 269/300 Read block 501 len 12288
34476 270/300 Read block 1278 len 16384
34477 271/300 Write block 2302 len 36864 data: 7 7 8 8 7 5 4 6 6
34478 272/300 Read block 599 len 12288
34479 273/300 Write block 4009 len 8192 data: 6 5
34480 274/300 Read block 1918 len 40960
34481 275/300 Read block 867 len 20480
34482 276/300 Read block 1091 len 40960
34483 277/300 Write block 10 len 28672 data: 7 6 7 8 8 7 5
34484 278/300 Read block 80 len 40960
34485 279/300 Read block 3192 len 32768
34486 280/300 Read block 3804 len 20480
34487 281/300 Read block 3042 len 12288
34488 282/300 Write block 3011 len 8192 data: 9 7
34489 283/300 Read block 1042 len 4096
34490 284/300 Write block 3092 len 8192 data: 3 3
34491 285/300 Write block 4160 len 4096 data: 6
34492 286/300 Read block 2297 len 28672
34493 287/300 Write block 3549 len 24576 data: 5 5 5 5 6 6
34494 288/300 Read block 1557 len 8192
34495 289/300 Read block 4595 len 32768
34496 290/300 Read block 1335 len 36864
34497 291/300 Write block 617 len 12288 data: 6 6 4
34498 292/300 Write block 4688 len 28672 data: 4 4 5 5 5 5 5
34499 293/300 Flush
34500 294/300 Write block 2657 len 20480 data: 6 7 6 7 7
34501 295/300 Read block 766 len 32768
34502 296/300 Flush
34503 297/300 Read block 3722 len 20480
34504 298/300 Read block 4568 len 40960
34505 299/300 Write block 1384 len 8192 data: 7 8
34506 300/300 Write block 1187 len 28672 data: 5 6 8 7 7 6 6
34507 Main task has work to do, go find it
34508 got dsc Start(0)
34509 start 0
34510 Apr 20 01:12:21.619 INFO request completed, latency_us: 206, response_code: 204, uri: /start/cid/0, method: POST, req_id: a9678ec6-c105-4073-9705-572ef2d69ca2, remote_addr: 127.0.0.1:60352, local_addr: 127.0.0.1:9998
34511 Replay: started 0, returned:Ok(())
34512 ----------------------------------------------------------------
34513 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:301
34514 States: Offline Active Active
34515 GW_ID ACK DSID TYPE BLOCKS DS:0 DS:1 DS:2 REPLAY
34516 8743 Acked 9742 Write 7 New Done Done false
34517 8744 Acked 9743 Write 1 New Done Done false
34518 8745 Acked 9744 Write 5 New Done Done false
34519 8746 Acked 9745 Write 3 New Done Done false
34520 8747 Acked 9746 Write 2 New Done Done false
34521 8748 Acked 9747 Flush 0 New Done Done false
34522 8749 Acked 9748 Read 6 New Done Done false
34523 8750 Acked 9749 Write 6 New Done Done false
34524 8751 Acked 9750 Write 2 New Done Done false
34525 8752 Acked 9751 Read 1 New Done Done false
34526 8753 Acked 9752 Read 9 New Done Done false
34527 8754 Acked 9753 Read 4 New Done Done false
34528 8755 Acked 9754 Write 3 New Done Done false
34529 8756 Acked 9755 Flush 0 New Done Done false
34530 8757 Acked 9756 Read 3 New Done Done false
34531 8758 Acked 9757 Read 10 New Done Done false
34532 8759 Acked 9758 Read 7 New Done Done false
34533 8760 Acked 9759 Write 9 New Done Done false
34534 8761 Acked 9760 Write 7 New Done Done false
34535 8762 Acked 9761 Write 2 New Done Done false
34536 8763 Acked 9762 Read 1 New Done Done false
34537 8764 Acked 9763 Flush 0 New Done Done false
34538 8765 Acked 9764 Read 9 New Done Done false
34539 8766 Acked 9765 Flush 0 New Done Done false
34540 8767 Acked 9766 Write 7 New Done Done false
34541 8768 Acked 9767 Write 9 New Done Done false
34542 8769 Acked 9768 Read 8 New Done Done false
34543 8770 Acked 9769 Write 9 New Done Done false
34544 8771 Acked 9770 Read 2 New Done Done false
34545 8772 Acked 9771 Read 7 New Done Done false
34546 8773 Acked 9772 Write 8 New Done Done false
34547 8774 Acked 9773 Write 1 New Done Done false
34548 8775 Acked 9774 Flush 0 New Done Done false
34549 8776 Acked 9775 Write 10 New Done Done false
34550 8777 Acked 9776 Read 9 New Done Done false
34551 8778 Acked 9777 Read 6 New Done Done false
34552 8779 Acked 9778 Flush 0 New Done Done false
34553 8780 Acked 9779 Read 7 New Done Done false
34554 8781 Acked 9780 Write 8 New Done Done false
34555 8782 Acked 9781 Write 10 New Done Done false
34556 8783 Acked 9782 Read 9 New Done Done false
34557 8784 Acked 9783 Read 7 New Done Done false
34558 8785 Acked 9784 Read 1 New Done Done false
34559 8786 Acked 9785 Read 5 New Done Done false
34560 8787 Acked 9786 Read 4 New Done Done false
34561 8788 Acked 9787 Write 1 New Done Done false
34562 8789 Acked 9788 Write 7 New Done Done false
34563 8790 Acked 9789 Write 4 New Done Done false
34564 8791 Acked 9790 Write 9 New Done Done false
34565 8792 Acked 9791 Read 7 New Done Done false
34566 8793 Acked 9792 Read 9 New Done Done false
34567 8794 Acked 9793 Read 8 New Done Done false
34568 8795 Acked 9794 Read 6 New Done Done false
34569 8796 Acked 9795 Write 6 New Done Done false
34570 8797 Acked 9796 Read 9 New Done Done false
34571 8798 Acked 9797 Write 8 New Done Done false
34572 8799 Acked 9798 Read 3 New Done Done false
34573 8800 Acked 9799 Flush 0 New Done Done false
34574 8801 Acked 9800 Read 8 New Done Done false
34575 8802 Acked 9801 Read 4 New Done Done false
34576 8803 Acked 9802 Write 6 New Done Done false
34577 8804 Acked 9803 Read 2 New Done Done false
34578 8805 Acked 9804 Flush 0 New Done Done false
34579 8806 Acked 9805 Read 6 New Done Done false
34580 8807 Acked 9806 Write 9 New Done Done false
34581 8808 Acked 9807 Read 3 New Done Done false
34582 8809 Acked 9808 Read 3 New Done Done false
34583 8810 Acked 9809 Write 3 New Done Done false
34584 8811 Acked 9810 Read 10 New Done Done false
34585 8812 Acked 9811 Read 4 New Done Done false
34586 8813 Acked 9812 Read 6 New Done Done false
34587 8814 Acked 9813 Write 1 New Done Done false
34588 8815 Acked 9814 Read 5 New Done Done false
34589 8816 Acked 9815 Read 8 New Done Done false
34590 8817 Acked 9816 Read 2 New Done Done false
34591 8818 Acked 9817 Read 6 New Done Done false
34592 8819 Acked 9818 Read 10 New Done Done false
34593 8820 Acked 9819 Write 2 New Done Done false
34594 8821 Acked 9820 Write 6 New Done Done false
34595 8822 Acked 9821 Read 6 New Done Done false
34596 8823 Acked 9822 Write 1 New Done Done false
34597 8824 Acked 9823 Read 8 New Done Done false
34598 8825 Acked 9824 Write 1 New Done Done false
34599 8826 Acked 9825 Flush 0 New Done Done false
34600 8827 Acked 9826 Read 2 New Done Done false
34601 8828 Acked 9827 Read 5 New Done Done false
34602 8829 Acked 9828 Write 10 New Done Done false
34603 8830 Acked 9829 Write 4 New Done Done false
34604 8831 Acked 9830 Read 5 New Done Done false
34605 8832 Acked 9831 Read 9 New Done Done false
34606 8833 Acked 9832 Write 7 New Done Done false
34607 8834 Acked 9833 Write 6 New Done Done false
34608 8835 Acked 9834 Write 3 New Done Done false
34609 8836 Acked 9835 Read 9 New Done Done false
34610 8837 Acked 9836 Read 3 New Done Done false
34611 8838 Acked 9837 Read 10 New Done Done false
34612 8839 Acked 9838 Read 5 New Done Done false
34613 8840 Acked 9839 Read 1 New Done Done false
34614 8841 Acked 9840 Flush 0 New Done Done false
34615 8842 Acked 9841 Write 2 New Done Done false
34616 8843 Acked 9842 Write 9 New Done Done false
34617 8844 Acked 9843 Read 5 New Done Done false
34618 8845 Acked 9844 Read 9 New Done Done false
34619 8846 Acked 9845 Read 9 New Done Done false
34620 8847 Acked 9846 Write 1 New Done Done false
34621 8848 Acked 9847 Write 5 New Done Done false
34622 8849 Acked 9848 Write 10 New Done Done false
34623 8850 Acked 9849 Read 9 New Done Done false
34624 8851 Acked 9850 Read 9 New Done Done false
34625 8852 Acked 9851 Write 6 New Done Done false
34626 8853 Acked 9852 Write 5 New Done Done false
34627 8854 Acked 9853 Write 2 New Done Done false
34628 8855 Acked 9854 Write 3 New Done Done false
34629 8856 Acked 9855 Read 5 New Done Done false
34630 8857 Acked 9856 Read 6 New Done Done false
34631 8858 Acked 9857 Read 6 New Done Done false
34632 8859 Acked 9858 Read 5 New Done Done false
34633 8860 Acked 9859 Read 10 New Done Done false
34634 8861 Acked 9860 Write 2 New Done Done false
34635 8862 Acked 9861 Write 7 New Done Done false
34636 8863 Acked 9862 Write 9 New Done Done false
34637 8864 Acked 9863 Read 6 New Done Done false
34638 8865 Acked 9864 Read 4 New Done Done false
34639 8866 Acked 9865 Flush 0 New Done Done false
34640 8867 Acked 9866 Read 10 New Done Done false
34641 8868 Acked 9867 Read 3 New Done Done false
34642 8869 Acked 9868 Write 6 New Done Done false
34643 8870 Acked 9869 Read 8 New Done Done false
34644 8871 Acked 9870 Read 9 New Done Done false
34645 8872 Acked 9871 Read 8 New Done Done false
34646 8873 Acked 9872 Write 2 New Done Done false
34647 8874 Acked 9873 Read 9 New Done Done false
34648 8875 Acked 9874 Read 3 New Done Done false
34649 8876 Acked 9875 Read 3 New Done Done false
34650 8877 Acked 9876 Flush 0 New Done Done false
34651 8878 Acked 9877 Read 8 New Done Done false
34652 8879 Acked 9878 Read 2 New Done Done false
34653 8880 Acked 9879 Write 2 New Done Done false
34654 8881 Acked 9880 Read 8 New Done Done false
34655 8882 Acked 9881 Write 10 New Done Done false
34656 8883 Acked 9882 Read 3 New Done Done false
34657 8884 Acked 9883 Write 7 New Done Done false
34658 8885 Acked 9884 Read 3 New Done Done false
34659 8886 Acked 9885 Flush 0 New Done Done false
34660 8887 Acked 9886 Read 5 New Done Done false
34661 8888 Acked 9887 Read 9 New Done Done false
34662 8889 Acked 9888 Write 6 New Done Done false
34663 8890 Acked 9889 Write 6 New Done Done false
34664 8891 Acked 9890 Read 1 New Done Done false
34665 8892 Acked 9891 Flush 0 New Done Done false
34666 8893 Acked 9892 Write 1 New Done Done false
34667 8894 Acked 9893 Flush 0 New Done Done false
34668 8895 Acked 9894 Write 1 New Done Done false
34669 8896 Acked 9895 Write 7 New Done Done false
34670 8897 Acked 9896 Write 10 New Done Done false
34671 8898 Acked 9897 Read 10 New Done Done false
34672 8899 Acked 9898 Write 8 New Done Done false
34673 8900 Acked 9899 Read 1 New Done Done false
34674 8901 Acked 9900 Write 1 New Done Done false
34675 8902 Acked 9901 Write 9 New Done Done false
34676 8903 Acked 9902 Read 9 New Done Done false
34677 8904 Acked 9903 Write 4 New Done Done false
34678 8905 Acked 9904 Read 5 New Done Done false
34679 8906 Acked 9905 Write 1 New Done Done false
34680 8907 Acked 9906 Read 9 New Done Done false
34681 8908 Acked 9907 Write 7 New Done Done false
34682 8909 Acked 9908 Write 1 New Done Done false
34683 8910 Acked 9909 Read 3 New Done Done false
34684 8911 Acked 9910 Read 7 New Done Done false
34685 8912 Acked 9911 Write 10 New Done Done false
34686 8913 Acked 9912 Write 5 New Done Done false
34687 8914 Acked 9913 Write 10 New Done Done false
34688 8915 Acked 9914 Flush 0 New Done Done false
34689 8916 Acked 9915 Read 2 New Done Done false
34690 8917 Acked 9916 Read 2 New Done Done false
34691 8918 Acked 9917 Read 4 New Done Done false
34692 8919 Acked 9918 Flush 0 New Done Done false
34693 8920 Acked 9919 Write 7 New Done Done false
34694 8921 Acked 9920 Read 10 New Done Done false
34695 8922 Acked 9921 Read 5 New Done Done false
34696 8923 Acked 9922 Read 5 New Done Done false
34697 8924 Acked 9923 Write 6 New Done Done false
34698 8925 Acked 9924 Read 8 New Done Done false
34699 8926 Acked 9925 Read 5 New Done Done false
34700 8927 Acked 9926 Read 10 New Done Done false
34701 8928 Acked 9927 Write 5 New Done Done false
34702 8929 Acked 9928 Write 1 New Done Done false
34703 8930 Acked 9929 Write 1 New Done Done false
34704 8931 Acked 9930 Read 6 New Done Done false
34705 8932 Acked 9931 Write 10 New Done Done false
34706 8933 Acked 9932 Read 5 New Done Done false
34707 8934 Acked 9933 Write 5 New Done Done false
34708 8935 Acked 9934 Write 1 New Done Done false
34709 8936 Acked 9935 Read 8 New Done Done false
34710 8937 Acked 9936 Write 3 New Done Done false
34711 8938 Acked 9937 Read 6 New Done Done false
34712 8939 Acked 9938 Read 2 New Done Done false
34713 8940 Acked 9939 Write 3 New Done Done false
34714 8941 Acked 9940 Read 8 New Done Done false
34715 8942 Acked 9941 Read 3 New Done Done false
34716 8943 Acked 9942 Read 7 New Done Done false
34717 8944 Acked 9943 Read 4 New Done Done false
34718 8945 Acked 9944 Read 10 New Done Done false
34719 8946 Acked 9945 Read 1 New Done Done false
34720 8947 Acked 9946 Read 8 New Done Done false
34721 8948 Acked 9947 Write 9 New Done Done false
34722 8949 Acked 9948 Flush 0 New Done Done false
34723 8950 Acked 9949 Write 5 New Done Done false
34724 8951 Acked 9950 Read 6 New Done Done false
34725 8952 Acked 9951 Read 5 New Done Done false
34726 8953 Acked 9952 Flush 0 New Done Done false
34727 8954 Acked 9953 Read 2 New Done Done false
34728 8955 Acked 9954 Read 2 New Done Done false
34729 8956 Acked 9955 Flush 0 New Done Done false
34730 8957 Acked 9956 Write 8 New Done Done false
34731 8958 Acked 9957 Write 9 New Done Done false
34732 8959 Acked 9958 Write 2 New Done Done false
34733 8960 Acked 9959 Read 8 New Done Done false
34734 8961 Acked 9960 Write 8 New Done Done false
34735 8962 Acked 9961 Read 6 New Done Done false
34736 8963 Acked 9962 Write 10 New Done Done false
34737 8964 Acked 9963 Write 2 New Done Done false
34738 8965 Acked 9964 Read 10 New Done Done false
34739 8966 Acked 9965 Read 9 New Done Done false
34740 8967 Acked 9966 Write 1 New Done Done false
34741 8968 Acked 9967 Write 7 New Done Done false
34742 8969 Acked 9968 Read 10 New Done Done false
34743 8970 Acked 9969 Read 6 New Done Done false
34744 8971 Acked 9970 Write 8 New Done Done false
34745 8972 Acked 9971 Read 6 New Done Done false
34746 8973 Acked 9972 Write 8 New Done Done false
34747 8974 Acked 9973 Read 10 New Done Done false
34748 8975 Acked 9974 Read 1 New Done Done false
34749 8976 Acked 9975 Read 6 New Done Done false
34750 8977 Acked 9976 Write 7 New Done Done false
34751 8978 Acked 9977 Read 2 New Done Done false
34752 8979 Acked 9978 Read 1 New Done Done false
34753 8980 Acked 9979 Read 2 New Done Done false
34754 8981 Acked 9980 Read 5 New Done Done false
34755 8982 Acked 9981 Flush 0 New Done Done false
34756 8983 Acked 9982 Read 5 New Done Done false
34757 8984 Acked 9983 Flush 0 New Done Done false
34758 8985 Acked 9984 Write 5 New Done Done false
34759 8986 Acked 9985 Write 3 New Done Done false
34760 8987 Acked 9986 Read 9 New Done Done false
34761 8988 Acked 9987 Read 4 New Done Done false
34762 8989 Acked 9988 Read 9 New Done Done false
34763 8990 Acked 9989 Write 7 New Done Done false
34764 8991 Acked 9990 Read 4 New Done Done false
34765 8992 Acked 9991 Read 10 New Done Done false
34766 8993 Acked 9992 Write 9 New Done Done false
34767 8994 Acked 9993 Write 1 New Done Done false
34768 8995 Acked 9994 Read 8 New Done Done false
34769 8996 Acked 9995 Read 2 New Done Done false
34770 8997 Acked 9996 Read 3 New Done Done false
34771 8998 Acked 9997 Write 8 New Done Done false
34772 8999 Acked 9998 Write 4 New Done Done false
34773 9000 Acked 9999 Write 5 New Done Done false
34774 9001 Acked 10000 Read 6 New Done Done false
34775 9002 Acked 10001 Read 3 New Done Done false
34776 9003 Acked 10002 Read 4 New Done Done false
34777 9004 Acked 10003 Write 9 New Done Done false
34778 9005 Acked 10004 Read 10 New Done Done false
34779 9006 Acked 10005 Read 6 New Done Done false
34780 9007 Acked 10006 Write 7 New Done Done false
34781 9008 Acked 10007 Read 8 New Done Done false
34782 9009 Acked 10008 Read 6 New Done Done false
34783 9010 Acked 10009 Write 6 New Done Done false
34784 9011 Acked 10010 Read 2 New Done Done false
34785 9012 Acked 10011 Read 3 New Done Done false
34786 9013 Acked 10012 Read 4 New Done Done false
34787 9014 Acked 10013 Write 9 New Done Done false
34788 9015 Acked 10014 Read 3 New Done Done false
34789 9016 Acked 10015 Write 2 New Done Done false
34790 9017 Acked 10016 Read 10 New Done Done false
34791 9018 Acked 10017 Read 5 New Done Done false
34792 9019 Acked 10018 Read 10 New Done Done false
34793 9020 Acked 10019 Write 7 New Done Done false
34794 9021 Acked 10020 Read 10 New Done Done false
34795 9022 Acked 10021 Read 8 New Done Done false
34796 9023 Acked 10022 Read 5 New Done Done false
34797 9024 Acked 10023 Read 3 New Done Done false
34798 9025 Acked 10024 Write 2 New Done Done false
34799 9026 Acked 10025 Read 1 New Done Done false
34800 9027 Acked 10026 Write 2 New Done Done false
34801 9028 Acked 10027 Write 1 New Done Done false
34802 9029 Acked 10028 Read 7 New Done Done false
34803 9030 Acked 10029 Write 6 New Done Done false
34804 9031 Acked 10030 Read 2 New Done Done false
34805 9032 Acked 10031 Read 8 New Done Done false
34806 9033 Acked 10032 Read 9 New Done Done false
34807 9034 Acked 10033 Write 3 New Done Done false
34808 9035 Acked 10034 Write 7 New Done Done false
34809 9036 Acked 10035 Flush 0 New Done Done false
34810 9037 Acked 10036 Write 5 New Done Done false
34811 9038 Acked 10037 Read 8 New Done Done false
34812 9039 Acked 10038 Flush 0 New Done Done false
34813 9040 Acked 10039 Read 5 New Done Done false
34814 9041 Acked 10040 Read 10 New Done Done false
34815 9042 Acked 10041 Write 2 New Done Done false
34816 9043 Acked 10042 Write 7 New Done Done false
34817 STATES DS:0 DS:1 DS:2 TOTAL
34818 New 301 0 0 301
34819 Sent 0 0 0 0
34820 Done 0 301 301 602
34821 Skipped 0 0 0 0
34822 Error 0 0 0 0
34823 Last Flush: 9741 10038 10038
34824 Downstairs last five completed: 9741 9740 9739 9738 9737
34825 Upstairs last five completed: 9043 9042 9041 9040 9039
34826 CLIENT: Up:0 ds:301 act:2
34827 [8810] got start action
34828 [8810] I am going to restart
34829 Starting downstairs at port 8810
34830 Make output file at "/tmp/dsc/downstairs-8810.txt"
34831 [8810][0] reports Starting
34832 Downstairs /var/tmp/dsc/region/8810 port 8810 PID:Some(1226)
34833 [8810][0] reports Running
34834 ----------------------------------------------------------------
34835 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:302
34836 States: Offline Active Active
34837 GW_ID ACK DSID TYPE BLOCKS DS:0 DS:1 DS:2 REPLAY
34838 8743 Acked 9742 Write 7 New Done Done false
34839 8744 Acked 9743 Write 1 New Done Done false
34840 8745 Acked 9744 Write 5 New Done Done false
34841 8746 Acked 9745 Write 3 New Done Done false
34842 8747 Acked 9746 Write 2 New Done Done false
34843 8748 Acked 9747 Flush 0 New Done Done false
34844 8749 Acked 9748 Read 6 New Done Done false
34845 8750 Acked 9749 Write 6 New Done Done false
34846 8751 Acked 9750 Write 2 New Done Done false
34847 8752 Acked 9751 Read 1 New Done Done false
34848 8753 Acked 9752 Read 9 New Done Done false
34849 8754 Acked 9753 Read 4 New Done Done false
34850 8755 Acked 9754 Write 3 New Done Done false
34851 8756 Acked 9755 Flush 0 New Done Done false
34852 8757 Acked 9756 Read 3 New Done Done false
34853 8758 Acked 9757 Read 10 New Done Done false
34854 8759 Acked 9758 Read 7 New Done Done false
34855 8760 Acked 9759 Write 9 New Done Done false
34856 8761 Acked 9760 Write 7 New Done Done false
34857 8762 Acked 9761 Write 2 New Done Done false
34858 8763 Acked 9762 Read 1 New Done Done false
34859 8764 Acked 9763 Flush 0 New Done Done false
34860 8765 Acked 9764 Read 9 New Done Done false
34861 8766 Acked 9765 Flush 0 New Done Done false
34862 8767 Acked 9766 Write 7 New Done Done false
34863 8768 Acked 9767 Write 9 New Done Done false
34864 8769 Acked 9768 Read 8 New Done Done false
34865 8770 Acked 9769 Write 9 New Done Done false
34866 8771 Acked 9770 Read 2 New Done Done false
34867 8772 Acked 9771 Read 7 New Done Done false
34868 8773 Acked 9772 Write 8 New Done Done false
34869 8774 Acked 9773 Write 1 New Done Done false
34870 8775 Acked 9774 Flush 0 New Done Done false
34871 8776 Acked 9775 Write 10 New Done Done false
34872 8777 Acked 9776 Read 9 New Done Done false
34873 8778 Acked 9777 Read 6 New Done Done false
34874 8779 Acked 9778 Flush 0 New Done Done false
34875 8780 Acked 9779 Read 7 New Done Done false
34876 8781 Acked 9780 Write 8 New Done Done false
34877 8782 Acked 9781 Write 10 New Done Done false
34878 8783 Acked 9782 Read 9 New Done Done false
34879 8784 Acked 9783 Read 7 New Done Done false
34880 8785 Acked 9784 Read 1 New Done Done false
34881 8786 Acked 9785 Read 5 New Done Done false
34882 8787 Acked 9786 Read 4 New Done Done false
34883 8788 Acked 9787 Write 1 New Done Done false
34884 8789 Acked 9788 Write 7 New Done Done false
34885 8790 Acked 9789 Write 4 New Done Done false
34886 8791 Acked 9790 Write 9 New Done Done false
34887 8792 Acked 9791 Read 7 New Done Done false
34888 8793 Acked 9792 Read 9 New Done Done false
34889 8794 Acked 9793 Read 8 New Done Done false
34890 8795 Acked 9794 Read 6 New Done Done false
34891 8796 Acked 9795 Write 6 New Done Done false
34892 8797 Acked 9796 Read 9 New Done Done false
34893 8798 Acked 9797 Write 8 New Done Done false
34894 8799 Acked 9798 Read 3 New Done Done false
34895 8800 Acked 9799 Flush 0 New Done Done false
34896 8801 Acked 9800 Read 8 New Done Done false
34897 8802 Acked 9801 Read 4 New Done Done false
34898 8803 Acked 9802 Write 6 New Done Done false
34899 8804 Acked 9803 Read 2 New Done Done false
34900 8805 Acked 9804 Flush 0 New Done Done false
34901 8806 Acked 9805 Read 6 New Done Done false
34902 8807 Acked 9806 Write 9 New Done Done false
34903 8808 Acked 9807 Read 3 New Done Done false
34904 8809 Acked 9808 Read 3 New Done Done false
34905 8810 Acked 9809 Write 3 New Done Done false
34906 8811 Acked 9810 Read 10 New Done Done false
34907 8812 Acked 9811 Read 4 New Done Done false
34908 8813 Acked 9812 Read 6 New Done Done false
34909 8814 Acked 9813 Write 1 New Done Done false
34910 8815 Acked 9814 Read 5 New Done Done false
34911 8816 Acked 9815 Read 8 New Done Done false
34912 8817 Acked 9816 Read 2 New Done Done false
34913 8818 Acked 9817 Read 6 New Done Done false
34914 8819 Acked 9818 Read 10 New Done Done false
34915 8820 Acked 9819 Write 2 New Done Done false
34916 8821 Acked 9820 Write 6 New Done Done false
34917 8822 Acked 9821 Read 6 New Done Done false
34918 8823 Acked 9822 Write 1 New Done Done false
34919 8824 Acked 9823 Read 8 New Done Done false
34920 8825 Acked 9824 Write 1 New Done Done false
34921 8826 Acked 9825 Flush 0 New Done Done false
34922 8827 Acked 9826 Read 2 New Done Done false
34923 8828 Acked 9827 Read 5 New Done Done false
34924 8829 Acked 9828 Write 10 New Done Done false
34925 8830 Acked 9829 Write 4 New Done Done false
34926 8831 Acked 9830 Read 5 New Done Done false
34927 8832 Acked 9831 Read 9 New Done Done false
34928 8833 Acked 9832 Write 7 New Done Done false
34929 8834 Acked 9833 Write 6 New Done Done false
34930 8835 Acked 9834 Write 3 New Done Done false
34931 8836 Acked 9835 Read 9 New Done Done false
34932 8837 Acked 9836 Read 3 New Done Done false
34933 8838 Acked 9837 Read 10 New Done Done false
34934 8839 Acked 9838 Read 5 New Done Done false
34935 8840 Acked 9839 Read 1 New Done Done false
34936 8841 Acked 9840 Flush 0 New Done Done false
34937 8842 Acked 9841 Write 2 New Done Done false
34938 8843 Acked 9842 Write 9 New Done Done false
34939 8844 Acked 9843 Read 5 New Done Done false
34940 8845 Acked 9844 Read 9 New Done Done false
34941 8846 Acked 9845 Read 9 New Done Done false
34942 8847 Acked 9846 Write 1 New Done Done false
34943 8848 Acked 9847 Write 5 New Done Done false
34944 8849 Acked 9848 Write 10 New Done Done false
34945 8850 Acked 9849 Read 9 New Done Done false
34946 8851 Acked 9850 Read 9 New Done Done false
34947 8852 Acked 9851 Write 6 New Done Done false
34948 8853 Acked 9852 Write 5 New Done Done false
34949 8854 Acked 9853 Write 2 New Done Done false
34950 8855 Acked 9854 Write 3 New Done Done false
34951 8856 Acked 9855 Read 5 New Done Done false
34952 8857 Acked 9856 Read 6 New Done Done false
34953 8858 Acked 9857 Read 6 New Done Done false
34954 8859 Acked 9858 Read 5 New Done Done false
34955 8860 Acked 9859 Read 10 New Done Done false
34956 8861 Acked 9860 Write 2 New Done Done false
34957 8862 Acked 9861 Write 7 New Done Done false
34958 8863 Acked 9862 Write 9 New Done Done false
34959 8864 Acked 9863 Read 6 New Done Done false
34960 8865 Acked 9864 Read 4 New Done Done false
34961 8866 Acked 9865 Flush 0 New Done Done false
34962 8867 Acked 9866 Read 10 New Done Done false
34963 8868 Acked 9867 Read 3 New Done Done false
34964 8869 Acked 9868 Write 6 New Done Done false
34965 8870 Acked 9869 Read 8 New Done Done false
34966 8871 Acked 9870 Read 9 New Done Done false
34967 8872 Acked 9871 Read 8 New Done Done false
34968 8873 Acked 9872 Write 2 New Done Done false
34969 8874 Acked 9873 Read 9 New Done Done false
34970 8875 Acked 9874 Read 3 New Done Done false
34971 8876 Acked 9875 Read 3 New Done Done false
34972 8877 Acked 9876 Flush 0 New Done Done false
34973 8878 Acked 9877 Read 8 New Done Done false
34974 8879 Acked 9878 Read 2 New Done Done false
34975 8880 Acked 9879 Write 2 New Done Done false
34976 8881 Acked 9880 Read 8 New Done Done false
34977 8882 Acked 9881 Write 10 New Done Done false
34978 8883 Acked 9882 Read 3 New Done Done false
34979 8884 Acked 9883 Write 7 New Done Done false
34980 8885 Acked 9884 Read 3 New Done Done false
34981 8886 Acked 9885 Flush 0 New Done Done false
34982 8887 Acked 9886 Read 5 New Done Done false
34983 8888 Acked 9887 Read 9 New Done Done false
34984 8889 Acked 9888 Write 6 New Done Done false
34985 8890 Acked 9889 Write 6 New Done Done false
34986 8891 Acked 9890 Read 1 New Done Done false
34987 8892 Acked 9891 Flush 0 New Done Done false
34988 8893 Acked 9892 Write 1 New Done Done false
34989 8894 Acked 9893 Flush 0 New Done Done false
34990 8895 Acked 9894 Write 1 New Done Done false
34991 8896 Acked 9895 Write 7 New Done Done false
34992 8897 Acked 9896 Write 10 New Done Done false
34993 8898 Acked 9897 Read 10 New Done Done false
34994 8899 Acked 9898 Write 8 New Done Done false
34995 8900 Acked 9899 Read 1 New Done Done false
34996 8901 Acked 9900 Write 1 New Done Done false
34997 8902 Acked 9901 Write 9 New Done Done false
34998 8903 Acked 9902 Read 9 New Done Done false
34999 8904 Acked 9903 Write 4 New Done Done false
35000 8905 Acked 9904 Read 5 New Done Done false
35001 8906 Acked 9905 Write 1 New Done Done false
35002 8907 Acked 9906 Read 9 New Done Done false
35003 8908 Acked 9907 Write 7 New Done Done false
35004 8909 Acked 9908 Write 1 New Done Done false
35005 8910 Acked 9909 Read 3 New Done Done false
35006 8911 Acked 9910 Read 7 New Done Done false
35007 8912 Acked 9911 Write 10 New Done Done false
35008 8913 Acked 9912 Write 5 New Done Done false
35009 8914 Acked 9913 Write 10 New Done Done false
35010 8915 Acked 9914 Flush 0 New Done Done false
35011 8916 Acked 9915 Read 2 New Done Done false
35012 8917 Acked 9916 Read 2 New Done Done false
35013 8918 Acked 9917 Read 4 New Done Done false
35014 8919 Acked 9918 Flush 0 New Done Done false
35015 8920 Acked 9919 Write 7 New Done Done false
35016 8921 Acked 9920 Read 10 New Done Done false
35017 8922 Acked 9921 Read 5 New Done Done false
35018 8923 Acked 9922 Read 5 New Done Done false
35019 8924 Acked 9923 Write 6 New Done Done false
35020 8925 Acked 9924 Read 8 New Done Done false
35021 8926 Acked 9925 Read 5 New Done Done false
35022 8927 Acked 9926 Read 10 New Done Done false
35023 8928 Acked 9927 Write 5 New Done Done false
35024 8929 Acked 9928 Write 1 New Done Done false
35025 8930 Acked 9929 Write 1 New Done Done false
35026 8931 Acked 9930 Read 6 New Done Done false
35027 8932 Acked 9931 Write 10 New Done Done false
35028 8933 Acked 9932 Read 5 New Done Done false
35029 8934 Acked 9933 Write 5 New Done Done false
35030 8935 Acked 9934 Write 1 New Done Done false
35031 8936 Acked 9935 Read 8 New Done Done false
35032 8937 Acked 9936 Write 3 New Done Done false
35033 8938 Acked 9937 Read 6 New Done Done false
35034 8939 Acked 9938 Read 2 New Done Done false
35035 8940 Acked 9939 Write 3 New Done Done false
35036 8941 Acked 9940 Read 8 New Done Done false
35037 8942 Acked 9941 Read 3 New Done Done false
35038 8943 Acked 9942 Read 7 New Done Done false
35039 8944 Acked 9943 Read 4 New Done Done false
35040 8945 Acked 9944 Read 10 New Done Done false
35041 8946 Acked 9945 Read 1 New Done Done false
35042 8947 Acked 9946 Read 8 New Done Done false
35043 8948 Acked 9947 Write 9 New Done Done false
35044 8949 Acked 9948 Flush 0 New Done Done false
35045 8950 Acked 9949 Write 5 New Done Done false
35046 8951 Acked 9950 Read 6 New Done Done false
35047 8952 Acked 9951 Read 5 New Done Done false
35048 8953 Acked 9952 Flush 0 New Done Done false
35049 8954 Acked 9953 Read 2 New Done Done false
35050 8955 Acked 9954 Read 2 New Done Done false
35051 8956 Acked 9955 Flush 0 New Done Done false
35052 8957 Acked 9956 Write 8 New Done Done false
35053 8958 Acked 9957 Write 9 New Done Done false
35054 8959 Acked 9958 Write 2 New Done Done false
35055 8960 Acked 9959 Read 8 New Done Done false
35056 8961 Acked 9960 Write 8 New Done Done false
35057 8962 Acked 9961 Read 6 New Done Done false
35058 8963 Acked 9962 Write 10 New Done Done false
35059 8964 Acked 9963 Write 2 New Done Done false
35060 8965 Acked 9964 Read 10 New Done Done false
35061 8966 Acked 9965 Read 9 New Done Done false
35062 8967 Acked 9966 Write 1 New Done Done false
35063 8968 Acked 9967 Write 7 New Done Done false
35064 8969 Acked 9968 Read 10 New Done Done false
35065 8970 Acked 9969 Read 6 New Done Done false
35066 8971 Acked 9970 Write 8 New Done Done false
35067 8972 Acked 9971 Read 6 New Done Done false
35068 8973 Acked 9972 Write 8 New Done Done false
35069 8974 Acked 9973 Read 10 New Done Done false
35070 8975 Acked 9974 Read 1 New Done Done false
35071 8976 Acked 9975 Read 6 New Done Done false
35072 8977 Acked 9976 Write 7 New Done Done false
35073 8978 Acked 9977 Read 2 New Done Done false
35074 8979 Acked 9978 Read 1 New Done Done false
35075 8980 Acked 9979 Read 2 New Done Done false
35076 8981 Acked 9980 Read 5 New Done Done false
35077 8982 Acked 9981 Flush 0 New Done Done false
35078 8983 Acked 9982 Read 5 New Done Done false
35079 8984 Acked 9983 Flush 0 New Done Done false
35080 8985 Acked 9984 Write 5 New Done Done false
35081 8986 Acked 9985 Write 3 New Done Done false
35082 8987 Acked 9986 Read 9 New Done Done false
35083 8988 Acked 9987 Read 4 New Done Done false
35084 8989 Acked 9988 Read 9 New Done Done false
35085 8990 Acked 9989 Write 7 New Done Done false
35086 8991 Acked 9990 Read 4 New Done Done false
35087 8992 Acked 9991 Read 10 New Done Done false
35088 8993 Acked 9992 Write 9 New Done Done false
35089 8994 Acked 9993 Write 1 New Done Done false
35090 8995 Acked 9994 Read 8 New Done Done false
35091 8996 Acked 9995 Read 2 New Done Done false
35092 8997 Acked 9996 Read 3 New Done Done false
35093 8998 Acked 9997 Write 8 New Done Done false
35094 8999 Acked 9998 Write 4 New Done Done false
35095 9000 Acked 9999 Write 5 New Done Done false
35096 9001 Acked 10000 Read 6 New Done Done false
35097 9002 Acked 10001 Read 3 New Done Done false
35098 9003 Acked 10002 Read 4 New Done Done false
35099 9004 Acked 10003 Write 9 New Done Done false
35100 9005 Acked 10004 Read 10 New Done Done false
35101 9006 Acked 10005 Read 6 New Done Done false
35102 9007 Acked 10006 Write 7 New Done Done false
35103 9008 Acked 10007 Read 8 New Done Done false
35104 9009 Acked 10008 Read 6 New Done Done false
35105 9010 Acked 10009 Write 6 New Done Done false
35106 9011 Acked 10010 Read 2 New Done Done false
35107 9012 Acked 10011 Read 3 New Done Done false
35108 9013 Acked 10012 Read 4 New Done Done false
35109 9014 Acked 10013 Write 9 New Done Done false
35110 9015 Acked 10014 Read 3 New Done Done false
35111 9016 Acked 10015 Write 2 New Done Done false
35112 9017 Acked 10016 Read 10 New Done Done false
35113 9018 Acked 10017 Read 5 New Done Done false
35114 9019 Acked 10018 Read 10 New Done Done false
35115 9020 Acked 10019 Write 7 New Done Done false
35116 9021 Acked 10020 Read 10 New Done Done false
35117 9022 Acked 10021 Read 8 New Done Done false
35118 9023 Acked 10022 Read 5 New Done Done false
35119 9024 Acked 10023 Read 3 New Done Done false
35120 9025 Acked 10024 Write 2 New Done Done false
35121 9026 Acked 10025 Read 1 New Done Done false
35122 9027 Acked 10026 Write 2 New Done Done false
35123 9028 Acked 10027 Write 1 New Done Done false
35124 9029 Acked 10028 Read 7 New Done Done false
35125 9030 Acked 10029 Write 6 New Done Done false
35126 9031 Acked 10030 Read 2 New Done Done false
35127 9032 Acked 10031 Read 8 New Done Done false
35128 9033 Acked 10032 Read 9 New Done Done false
35129 9034 Acked 10033 Write 3 New Done Done false
35130 9035 Acked 10034 Write 7 New Done Done false
35131 9036 Acked 10035 Flush 0 New Done Done false
35132 9037 Acked 10036 Write 5 New Done Done false
35133 9038 Acked 10037 Read 8 New Done Done false
35134 9039 Acked 10038 Flush 0 New Done Done false
35135 9040 Acked 10039 Read 5 New Done Done false
35136 9041 Acked 10040 Read 10 New Done Done false
35137 9042 Acked 10041 Write 2 New Done Done false
35138 9043 Acked 10042 Write 7 New Done Done false
35139 9044 Acked 10043 Flush 0 New Done Done false
35140 STATES DS:0 DS:1 DS:2 TOTAL
35141 New 302 0 0 302
35142 Sent 0 0 0 0
35143 Done 0 302 302 604
35144 Skipped 0 0 0 0
35145 Error 0 0 0 0
35146 Last Flush: 9741 10043 10043
35147 Downstairs last five completed: 9741 9740 9739 9738 9737
35148 Upstairs last five completed: 9044 9043 9042 9041 9040
35149 CLIENT: Up:0 ds:302 act:2
351502024-04-20T01:12:27.269ZINFOcrucible: connecting to 127.0.0.1:8810 = io task client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
351512024-04-20T01:12:27.269ZINFOcrucible: ds_connection connected from Ok(127.0.0.1:34145) = io task client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
351522024-04-20T01:12:27.270ZINFOcrucible: downstairs client at Some(127.0.0.1:8810) has region UUID 12345678-0000-0000-0000-000000008810 = downstairs client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
351532024-04-20T01:12:27.270ZINFOcrucible: Returning UUID:12345678-0000-0000-0000-000000008810 matches = downstairs client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
351542024-04-20T01:12:27.270ZINFOcrucible: send last flush ID to this DS: 9741 = downstairs client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
351552024-04-20T01:12:27.270ZINFOcrucible: Replied this last flush ID: 9741 = downstairs client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
351562024-04-20T01:12:27.270ZINFOcrucible: ds_transition from Offline to Replay = downstairs client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
351572024-04-20T01:12:27.270ZINFOcrucible: [0] Transition from Offline to Replay = downstairs client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
351582024-04-20T01:12:27.270ZINFOcrucible: ds_transition from Replay to Active = downstairs client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
351592024-04-20T01:12:27.271ZINFOcrucible: [0] Transition from Replay to Active = downstairs client = 0 session_id = 132b460a-26a0-4532-b1ab-4f8c07d4c6c7
35160 ----------------------------------------------------------------
35161 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:0
35162 Downstairs last five completed: 10043 10042 10041 10040 10039
35163 Upstairs last five completed: 9044 9043 9042 9041 9040
35164 CLIENT: Up:0 ds:0 act:3
35165 Replay: All jobs finished, all DS active.
35166 Test replay has completed
35167 Wrote out file "alan"
35168 CLIENT: Tests done. All submitted work has been ACK'd
35169 ----------------------------------------------------------------
35170 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:0
35171 Downstairs last five completed: 10043 10042 10041 10040 10039
35172 Upstairs last five completed: 9044 9043 9042 9041 9040
35173 CLIENT: Up:0 ds:0 act:3
35174 CLIENT: All jobs finished, all DS active.
35175 Replays:30 time: 7:22
35176 Do final verify
351772024-04-20T01:12:29.656ZINFOcrucible: Upstairs starts
351782024-04-20T01:12:29.656ZINFOcrucible: Crucible Version: BuildInfo { version: "0.0.1", git_sha: "b97e434eec561fa80f965a2f40ec87c83a3a439e", git_commit_timestamp: "2024-04-20T00:34:22.000000000Z", git_branch: "artemis/remove-reqwest-block-io", rustc_semver: "1.76.0", rustc_channel: "stable", rustc_host_triple: "x86_64-unknown-illumos", rustc_commit_sha: "07dca489ac2d933c78d3c5158e3f43beefeb02ce", cargo_triple: "x86_64-unknown-illumos", debug: true, opt_level: 0, }
351792024-04-20T01:12:29.656ZINFOcrucible: Upstairs <-> Downstairs Message Version: 6
351802024-04-20T01:12:29.656ZINFOcrucible: Crucible d22bdf94-c692-49b8-931c-a8b2aa40610f has session id: bf590ce9-2fb3-4f80-aa72-367227e2654a session_id = bf590ce9-2fb3-4f80-aa72-367227e2654a
35181 {"msg":"Upstairs opts: Upstairs UUID: d22bdf94-c692-49b8-931c-a8b2aa40610f, Targets: [127.0.0.1:8810, 127.0.0.1:8820, 127.0.0.1:8830], lossy: false, flush_timeout: None, key populated: false, cert_pem populated: false, key_pem populated: false, root_cert_pem populated: false, Control: None, read_only: false","v":0,"name":"crucible","level":30,"time":"2024-04-20T01:12:29.656597009Z","hostname":"w-01HVWGBJP7HK0H9TQ26T6N3X8M","pid":1231,"Crucible runtime is spawned
35182 session_id":"bf590ce9-2fb3-4f80-aa72-367227e2654a"}
351832024-04-20T01:12:29.656ZINFOcrucible: Crucible stats registered with UUID: d22bdf94-c692-49b8-931c-a8b2aa40610f session_id = bf590ce9-2fb3-4f80-aa72-367227e2654a
351842024-04-20T01:12:29.656ZINFOcrucible: The guest has requested activation with gen:3
351852024-04-20T01:12:29.656ZINFOcrucible: d22bdf94-c692-49b8-931c-a8b2aa40610f active request set session_id = bf590ce9-2fb3-4f80-aa72-367227e2654a
351862024-04-20T01:12:29.656ZINFOcrucible: sending connect oneshot to client = downstairs client = 0 session_id = bf590ce9-2fb3-4f80-aa72-367227e2654a
351872024-04-20T01:12:29.656ZINFOcrucible: client set_active_request while in New; waiting... = downstairs client = 0 session_id = bf590ce9-2fb3-4f80-aa72-367227e2654a
351882024-04-20T01:12:29.656ZINFOcrucible: sending connect oneshot to client = downstairs client = 1 session_id = bf590ce9-2fb3-4f80-aa72-367227e2654a
351892024-04-20T01:12:29.656ZINFOcrucible: client set_active_request while in New; waiting... = downstairs client = 1 session_id = bf590ce9-2fb3-4f80-aa72-367227e2654a
351902024-04-20T01:12:29.656ZINFOcrucible: sending connect oneshot to client = downstairs client = 2 session_id = bf590ce9-2fb3-4f80-aa72-367227e2654a
351912024-04-20T01:12:29.656ZINFOcrucible: client set_active_request while in New; waiting... = downstairs client = 2 session_id = bf590ce9-2fb3-4f80-aa72-367227e2654a
351922024-04-20T01:12:29.656ZINFOcrucible: connecting to 127.0.0.1:8830 = io task client = 2 session_id = bf590ce9-2fb3-4f80-aa72-367227e2654a
351932024-04-20T01:12:29.656ZINFOcrucible: connecting to 127.0.0.1:8820 = io task client = 1 session_id = bf590ce9-2fb3-4f80-aa72-367227e2654a
351942024-04-20T01:12:29.656ZINFOcrucible: connecting to 127.0.0.1:8810 = io task client = 0 session_id = bf590ce9-2fb3-4f80-aa72-367227e2654a
351952024-04-20T01:12:29.657ZINFOcrucible: ds_connection connected from Ok(127.0.0.1:57742) = io task client = 2 session_id = bf590ce9-2fb3-4f80-aa72-367227e2654a
351962024-04-20T01:12:29.657ZINFOcrucible: ds_connection connected from Ok(127.0.0.1:50047) = io task client = 1 session_id = bf590ce9-2fb3-4f80-aa72-367227e2654a
351972024-04-20T01:12:29.657ZINFOcrucible: ds_connection connected from Ok(127.0.0.1:55261) = io task client = 0 session_id = bf590ce9-2fb3-4f80-aa72-367227e2654a
351982024-04-20T01:12:29.657ZINFOcrucible: ds_transition from New to WaitActive = downstairs client = 1 session_id = bf590ce9-2fb3-4f80-aa72-367227e2654a
351992024-04-20T01:12:29.658ZINFOcrucible: [1] Transition from New to WaitActive = downstairs client = 1 session_id = bf590ce9-2fb3-4f80-aa72-367227e2654a
352002024-04-20T01:12:29.658ZINFOcrucible: ds_transition from New to WaitActive = downstairs client = 2 session_id = bf590ce9-2fb3-4f80-aa72-367227e2654a
352012024-04-20T01:12:29.658ZINFOcrucible: [2] Transition from New to WaitActive = downstairs client = 2 session_id = bf590ce9-2fb3-4f80-aa72-367227e2654a
352022024-04-20T01:12:29.658ZINFOcrucible: ds_transition from New to WaitActive = downstairs client = 0 session_id = bf590ce9-2fb3-4f80-aa72-367227e2654a
352032024-04-20T01:12:29.658ZINFOcrucible: [0] Transition from New to WaitActive = downstairs client = 0 session_id = bf590ce9-2fb3-4f80-aa72-367227e2654a
352042024-04-20T01:12:29.658ZINFOcrucible: downstairs client at Some(127.0.0.1:8810) has region UUID 12345678-0000-0000-0000-000000008810 = downstairs client = 0 session_id = bf590ce9-2fb3-4f80-aa72-367227e2654a
352052024-04-20T01:12:29.658ZINFOcrucible: downstairs client at Some(127.0.0.1:8820) has region UUID 12345678-0000-0000-0000-000000008820 = downstairs client = 1 session_id = bf590ce9-2fb3-4f80-aa72-367227e2654a
352062024-04-20T01:12:29.658ZINFOcrucible: downstairs client at Some(127.0.0.1:8830) has region UUID 12345678-0000-0000-0000-000000008830 = downstairs client = 2 session_id = bf590ce9-2fb3-4f80-aa72-367227e2654a
352072024-04-20T01:12:29.659ZINFOcrucible: ds_transition from WaitActive to WaitQuorum = downstairs client = 0 session_id = bf590ce9-2fb3-4f80-aa72-367227e2654a
352082024-04-20T01:12:29.659ZINFOcrucible: [0] Transition from WaitActive to WaitQuorum = downstairs client = 0 session_id = bf590ce9-2fb3-4f80-aa72-367227e2654a
352092024-04-20T01:12:29.659ZINFOcrucible: Waiting for more clients to be ready session_id = bf590ce9-2fb3-4f80-aa72-367227e2654a
352102024-04-20T01:12:29.659ZINFOcrucible: ds_transition from WaitActive to WaitQuorum = downstairs client = 1 session_id = bf590ce9-2fb3-4f80-aa72-367227e2654a
352112024-04-20T01:12:29.659ZINFOcrucible: [1] Transition from WaitActive to WaitQuorum = downstairs client = 1 session_id = bf590ce9-2fb3-4f80-aa72-367227e2654a
352122024-04-20T01:12:29.659ZINFOcrucible: Waiting for more clients to be ready session_id = bf590ce9-2fb3-4f80-aa72-367227e2654a
352132024-04-20T01:12:29.659ZINFOcrucible: ds_transition from WaitActive to WaitQuorum = downstairs client = 2 session_id = bf590ce9-2fb3-4f80-aa72-367227e2654a
352142024-04-20T01:12:29.659ZINFOcrucible: [2] Transition from WaitActive to WaitQuorum = downstairs client = 2 session_id = bf590ce9-2fb3-4f80-aa72-367227e2654a
352152024-04-20T01:12:29.659ZINFOcrucible: [0]R flush_numbers[0..12]: [895, 895, 890, 895, 890, 893, 895, 877, 874, 890, 851, 897] = downstairs session_id = bf590ce9-2fb3-4f80-aa72-367227e2654a
352162024-04-20T01:12:29.659ZINFOcrucible: [0]R generation[0..12]: [2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2] = downstairs session_id = bf590ce9-2fb3-4f80-aa72-367227e2654a
352172024-04-20T01:12:29.659ZINFOcrucible: [0]R dirty[0..12]: [false, false, false, false, false, false, false, false, false, false, false, false] = downstairs session_id = bf590ce9-2fb3-4f80-aa72-367227e2654a
352182024-04-20T01:12:29.659ZINFOcrucible: [1]R flush_numbers[0..12]: [895, 895, 890, 895, 890, 893, 895, 877, 874, 890, 851, 897] = downstairs session_id = bf590ce9-2fb3-4f80-aa72-367227e2654a
352192024-04-20T01:12:29.659ZINFOcrucible: [1]R generation[0..12]: [2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2] = downstairs session_id = bf590ce9-2fb3-4f80-aa72-367227e2654a
352202024-04-20T01:12:29.659ZINFOcrucible: [1]R dirty[0..12]: [false, false, false, false, false, false, false, false, false, false, false, false] = downstairs session_id = bf590ce9-2fb3-4f80-aa72-367227e2654a
352212024-04-20T01:12:29.659ZINFOcrucible: [2]R flush_numbers[0..12]: [895, 895, 890, 895, 890, 893, 895, 877, 874, 890, 851, 897] = downstairs session_id = bf590ce9-2fb3-4f80-aa72-367227e2654a
352222024-04-20T01:12:29.659ZINFOcrucible: [2]R generation[0..12]: [2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2] = downstairs session_id = bf590ce9-2fb3-4f80-aa72-367227e2654a
35223 {"msg":"[2]R dirty[0..12]: [false, false, false, false, false, false, false, false, false, false, false, false]","v":0,"name":"crucible","level":30,"time":"2024-04-20T01:12:29.659573027Z","hostname":"w-01HVWGBJP7HK0H9TQ26T6N3X8M","pid":1231,"":"downstairs","":"downstairs","session_id":"bf590ce9-2fb3-4f80-aa72-367227e2654a"}Wait for a query_work_queue command to finish before sending IO
35224 
352252024-04-20T01:12:29.659ZINFOcrucible: Max found gen is 3 = downstairs session_id = bf590ce9-2fb3-4f80-aa72-367227e2654a
352262024-04-20T01:12:29.659ZINFOcrucible: Generation requested: 3 >= found:3 = downstairs session_id = bf590ce9-2fb3-4f80-aa72-367227e2654a
352272024-04-20T01:12:29.659ZINFOcrucible: Next flush: 898 = downstairs session_id = bf590ce9-2fb3-4f80-aa72-367227e2654a
352282024-04-20T01:12:29.659ZINFOcrucible: All extents match = downstairs session_id = bf590ce9-2fb3-4f80-aa72-367227e2654a
352292024-04-20T01:12:29.659ZINFOcrucible: No downstairs reconciliation required session_id = bf590ce9-2fb3-4f80-aa72-367227e2654a
352302024-04-20T01:12:29.659ZINFOcrucible: Transition from WaitQuorum to Active = downstairs client = 0 session_id = bf590ce9-2fb3-4f80-aa72-367227e2654a
352312024-04-20T01:12:29.659ZINFOcrucible: Transition from WaitQuorum to Active = downstairs client = 1 session_id = bf590ce9-2fb3-4f80-aa72-367227e2654a
352322024-04-20T01:12:29.659ZINFOcrucible: Transition from WaitQuorum to Active = downstairs client = 2 session_id = bf590ce9-2fb3-4f80-aa72-367227e2654a
352332024-04-20T01:12:29.659ZINFOcrucible: All required reconciliation work is completed session_id = bf590ce9-2fb3-4f80-aa72-367227e2654a
352342024-04-20T01:12:29.659ZINFOcrucible: Set Downstairs and Upstairs active after reconciliation session_id = bf590ce9-2fb3-4f80-aa72-367227e2654a
352352024-04-20T01:12:29.659ZINFOcrucible: d22bdf94-c692-49b8-931c-a8b2aa40610f is now active with session: bf590ce9-2fb3-4f80-aa72-367227e2654a session_id = bf590ce9-2fb3-4f80-aa72-367227e2654a
352362024-04-20T01:12:29.659ZINFOcrucible: Set Active after no reconciliation session_id = bf590ce9-2fb3-4f80-aa72-367227e2654a
352372024-04-20T01:12:29.659ZINFOcrucible: The guest has finished waiting for activation with:3
35238 Region: es:100 ec:50 bs:4096 ts:20480000 tb:5000 max_io:256 or 1048576
35239 Loading write count information from file "alan"
35240 Read and Verify all blocks (0..5000 range:false)
35241 Wrote out file "alan"
35242 Verify test completed
35243 Wrote out file "alan"
35244 CLIENT: Tests done. All submitted work has been ACK'd
35245 ----------------------------------------------------------------
35246 Crucible gen:3 GIO:true work queues: Upstairs:0 downstairs:20
35247 States: Active Active Active
35248 GW_ID ACK DSID TYPE BLOCKS DS:0 DS:1 DS:2 REPLAY
35249 1 Acked 1000 Read 256 Done Done Done false
35250 2 Acked 1001 Read 256 Done Done Done false
35251 3 Acked 1002 Read 256 Done Done Done false
35252 4 Acked 1003 Read 256 Done Done Done false
35253 5 Acked 1004 Read 256 Done Done Done false
35254 6 Acked 1005 Read 256 Done Done Done false
35255 7 Acked 1006 Read 256 Done Done Done false
35256 8 Acked 1007 Read 256 Done Done Done false
35257 9 Acked 1008 Read 256 Done Done Done false
35258 10 Acked 1009 Read 256 Done Done Done false
35259 11 Acked 1010 Read 256 Done Done Done false
35260 12 Acked 1011 Read 256 Done Done Done false
35261 13 Acked 1012 Read 256 Done Done Done false
35262 14 Acked 1013 Read 256 Done Done Done false
35263 15 Acked 1014 Read 256 Done Done Done false
35264 16 Acked 1015 Read 256 Done Done Done false
35265 17 Acked 1016 Read 256 Done Done Done false
35266 18 Acked 1017 Read 256 Done Done Done false
35267 19 Acked 1018 Read 136 Done Done Done false
35268 20 Acked 1019 Read 256 Done Done Done false
35269 STATES DS:0 DS:1 DS:2 TOTAL
35270 New 0 0 0 0
35271 Sent 0 0 0 0
35272 Done 20 20 20 60
35273 Skipped 0 0 0 0
35274 Error 0 0 0 0
35275 Last Flush: 0 0 0
35276 Downstairs last five completed:
35277 Upstairs last five completed: 20 19 18 17 16
35278 CLIENT: Up:0 ds:20 act:3
35279 ----------------------------------------------------------------
35280 Crucible gen:3 GIO:true work queues: Upstairs:0 downstairs:0
35281 Downstairs last five completed: 1020 1019 1018 1017 1016
35282 Upstairs last five completed: 21 20 19 18 17
35283 CLIENT: Up:0 ds:0 act:3
35284 CLIENT: All crucible jobs finished, exiting program
35285 Apr 20 01:12:33.887 INFO accepted connection, remote_addr: 127.0.0.1:42667, local_addr: 127.0.0.1:9998
35286 Main task has work to do, go find it
35287 got dsc Shutdown
35288 Shutdown
35289 Apr 20 01:12:33.889 INFO request completed, latency_us: 167, response_code: 204Shut it down
35290 , [8810] Disable keep_running
35291 uri: /shutdown, [8810] Got stop action so:false kr:false
35292 method: POST, req_id: 40b3226f-e932-4cc0-b6c8-2ea083329ff1, remote_addr: 127.0.0.1:42667, local_addr: 127.0.0.1:9998
35293 [8820] Disable keep_running
35294 [8820] Got stop action so:false kr:false
35295 [8830] Disable keep_running
35296 [8830] Got stop action so:false kr:false
35297 [8810] Exited with: ExitStatus(unix_wait_status(9))
35298 [8830] Exited with: ExitStatus(unix_wait_status(9))
35299 [8820] Exited with: ExitStatus(unix_wait_status(9))
35300 [8810][0] reports Exit
35301 [8830][2] reports Exit
35302 [8820][1] reports Exit
35303 April 20, 2024 at 01:12:38 AM UTC Test ends with 0