Max level shown:
1 starting January 10, 2025 at 04:35:13 PM UTC
2 Creating 3 downstairs regions
3 Creating region directory at: /var/tmp/dsc/region
4 Creating dsc directory at: /tmp/dsc
5 Downstairs region 0 created at /var/tmp/dsc/region/8810 in 0.2597911
6 Downstairs region 1 created at /var/tmp/dsc/region/8820 in 0.020997176
7 Downstairs region 2 created at /var/tmp/dsc/region/8830 in 0.020193588
8 Created 3 regions
9 Starting 3 downstairs
10 Using existing output directory "/tmp/dsc"
11 Update our region info with: Some(RegionExtentInfo { block_size: 4096, blocks_per_extent: 100, extent_count: 50 })
12 start ds: 8810
13 start ds: 8820
14 start ds: 8830
15 start access at:127.0.0.1:9998
16 Starting downstairs at port 8810
17 Starting downstairs at port 8820
18 Make output file at "/tmp/dsc/downstairs-8820.txt"
19 Make output file at "/tmp/dsc/downstairs-8810.txt"
20 Starting downstairs at port 8830
21 Make output file at "/tmp/dsc/downstairs-8830.txt"
22 [8810][0] initial start wait reports Starting
23 [8820][1] initial start wait reports Starting
24 [8830][2] initial start wait reports Starting
25 Downstairs /var/tmp/dsc/region/8830 port 8830 PID:Some(1192)
26 [8830][2] initial start wait reports Running
27 Downstairs /var/tmp/dsc/region/8810 port 8810 PID:Some(1193)
28 [8810][0] initial start wait reports Running
29 Downstairs /var/tmp/dsc/region/8820 port 8820 PID:Some(1194)
30 [8820][1] initial start wait reports Running
31 All downstairs are running
32 Jan 10 16:35:13.850 INFO listening, local_addr: 127.0.0.1:9998
33 Control access at:127.0.0.1:9998
34 Running initial fill
35 Jan 10 16:35:18.945 INFO accepted connection, remote_addr: 127.0.0.1:59003, local_addr: 127.0.0.1:9998
36 Jan 10 16:35:18.947 INFO request completed, latency_us: 543, response_code: 200, uri: /regioninfo, method: GET, req_id: 48f42b20-90ca-4274-bbc8-6c4b6c365f48, remote_addr: 127.0.0.1:59003, local_addr: 127.0.0.1:9998
37 Jan 10 16:35:18.949 INFO request completed, latency_us: 110, response_code: 200, uri: /regioncount, method: GET, req_id: dc47c711-8383-421e-8e88-b3c4b3e79ec9, remote_addr: 127.0.0.1:59003, local_addr: 127.0.0.1:9998
382025-01-10T16:35:18.949ZINFOcrucible: Use this region info from dsc: RegionExtentInfo { block_size: 4096, blocks_per_extent: 100, extent_count: 50 } task = crutest
392025-01-10T16:35:18.950ZINFOcrucible: dsc has 3 regions. This means 1 sub_volumes task = crutest
40 Jan 10 16:35:18.951 INFO request completed, latency_us: 156, response_code: 200, uri: /port/cid/0, method: GET, req_id: 74a1c30f-0324-4c1f-8a82-f5a281a946cd, remote_addr: 127.0.0.1:59003, local_addr: 127.0.0.1:9998
41 Jan 10 16:35:18.951 INFO request completed, latency_us: 103, response_code: 200, uri: /port/cid/1, method: GET, req_id: 002ff76e-3804-4fe8-9118-5b9607be1806, remote_addr: 127.0.0.1:59003, local_addr: 127.0.0.1:9998
42 Jan 10 16:35:18.952 INFO request completed, latency_us: 99, response_code: 200, uri: /port/cid/2, method: GET, req_id: a5201b7c-6879-424f-89f3-bb3b4b80c600, remote_addr: 127.0.0.1:59003, local_addr: 127.0.0.1:9998
432025-01-10T16:35:18.952ZINFOcrucible: SV 0 has targets: [127.0.0.1:8810, 127.0.0.1:8820, 127.0.0.1:8830] task = crutest
442025-01-10T16:35:18.953ZINFOcrucible: Upstairs starts
452025-01-10T16:35:18.954ZINFOcrucible: Crucible Version: BuildInfo { version: "0.0.1", git_sha: "56068760771d58f96ac946e6b2ae83073c18c1b4", git_commit_timestamp: "2025-01-10T16:19:36.000000000Z", git_branch: "alan/rust-1-84-please", rustc_semver: "1.84.0", rustc_channel: "stable", rustc_host_triple: "x86_64-unknown-illumos", rustc_commit_sha: "9fc6b43126469e3858e2fe86cafb4f0fd5068869", cargo_triple: "x86_64-unknown-illumos", debug: true, opt_level: 0, }
462025-01-10T16:35:18.954ZINFOcrucible: Upstairs <-> Downstairs Message Version: 12
472025-01-10T16:35:18.954ZINFOcrucible: Using region definition RegionDefinition { block_size: 4096, extent_size: Block { value: 100, shift: 12 }, extent_count: 50, uuid: 00000000-0000-0000-0000-000000000000, encrypted: false, database_read_version: 1, database_write_version: 1 }
482025-01-10T16:35:18.955ZINFOcrucible: Crucible fbca3bb3-fc25-4a44-b13d-5bb1875343ff has session id: e23d1179-a328-4966-939c-1f33b7c6302e session_id = e23d1179-a328-4966-939c-1f33b7c6302e
492025-01-10T16:35:18.955ZINFOcrucible: Upstairs opts: Upstairs UUID: fbca3bb3-fc25-4a44-b13d-5bb1875343ff, Targets: [127.0.0.1:8810, 127.0.0.1:8820, 127.0.0.1:8830], lossy: false, flush_timeout: None, key populated: false, cert_pem populated: false, key_pem populated: false, root_cert_pem populated: false, Control: None, read_only: false session_id = e23d1179-a328-4966-939c-1f33b7c6302e
502025-01-10T16:35:18.955ZINFOcrucible: Crucible stats registered with UUID: fbca3bb3-fc25-4a44-b13d-5bb1875343ff session_id = e23d1179-a328-4966-939c-1f33b7c6302e
512025-01-10T16:35:18.990ZINFOcrucible: Downstairs in volume = 3 task = crutest
522025-01-10T16:35:18.990ZINFOcrucible: The guest has requested activation with gen:1
532025-01-10T16:35:18.990ZINFOcrucible: fbca3bb3-fc25-4a44-b13d-5bb1875343ff active request set session_id = e23d1179-a328-4966-939c-1f33b7c6302e
542025-01-10T16:35:18.990ZINFOcrucible: sending connect oneshot to client = downstairs client = 0 session_id = e23d1179-a328-4966-939c-1f33b7c6302e
552025-01-10T16:35:18.990ZINFOcrucible: client set_active_request while in New; waiting... = downstairs client = 0 session_id = e23d1179-a328-4966-939c-1f33b7c6302e
562025-01-10T16:35:18.990ZINFOcrucible: sending connect oneshot to client = downstairs client = 1 session_id = e23d1179-a328-4966-939c-1f33b7c6302e
572025-01-10T16:35:18.990ZINFOcrucible: client set_active_request while in New; waiting... = downstairs client = 1 session_id = e23d1179-a328-4966-939c-1f33b7c6302e
582025-01-10T16:35:18.990ZINFOcrucible: sending connect oneshot to client = downstairs client = 2 session_id = e23d1179-a328-4966-939c-1f33b7c6302e
592025-01-10T16:35:18.990ZINFOcrucible: client set_active_request while in New; waiting... = downstairs client = 2 session_id = e23d1179-a328-4966-939c-1f33b7c6302e
602025-01-10T16:35:18.990ZINFOcrucible: connecting to 127.0.0.1:8830 = io task client = 2 session_id = e23d1179-a328-4966-939c-1f33b7c6302e
612025-01-10T16:35:18.990ZINFOcrucible: connecting to 127.0.0.1:8810 = io task client = 0 session_id = e23d1179-a328-4966-939c-1f33b7c6302e
622025-01-10T16:35:18.990ZINFOcrucible: connecting to 127.0.0.1:8820 = io task client = 1 session_id = e23d1179-a328-4966-939c-1f33b7c6302e
632025-01-10T16:35:18.990ZINFOcrucible: ds_connection connected from Ok(127.0.0.1:34691) = io task client = 1 session_id = e23d1179-a328-4966-939c-1f33b7c6302e
642025-01-10T16:35:18.990ZINFOcrucible: ds_connection connected from Ok(127.0.0.1:34261) = io task client = 0 session_id = e23d1179-a328-4966-939c-1f33b7c6302e
652025-01-10T16:35:18.990ZINFOcrucible: ds_connection connected from Ok(127.0.0.1:34205) = io task client = 2 session_id = e23d1179-a328-4966-939c-1f33b7c6302e
662025-01-10T16:35:18.992ZINFOcrucible: ds_transition from New to WaitActive = downstairs client = 2 session_id = e23d1179-a328-4966-939c-1f33b7c6302e
672025-01-10T16:35:18.992ZINFOcrucible: [2] Transition from New to WaitActive = downstairs client = 2 session_id = e23d1179-a328-4966-939c-1f33b7c6302e
682025-01-10T16:35:18.992ZINFOcrucible: ds_transition from New to WaitActive = downstairs client = 0 session_id = e23d1179-a328-4966-939c-1f33b7c6302e
692025-01-10T16:35:18.992ZINFOcrucible: [0] Transition from New to WaitActive = downstairs client = 0 session_id = e23d1179-a328-4966-939c-1f33b7c6302e
702025-01-10T16:35:18.992ZINFOcrucible: ds_transition from New to WaitActive = downstairs client = 1 session_id = e23d1179-a328-4966-939c-1f33b7c6302e
712025-01-10T16:35:18.992ZINFOcrucible: [1] Transition from New to WaitActive = downstairs client = 1 session_id = e23d1179-a328-4966-939c-1f33b7c6302e
722025-01-10T16:35:18.993ZINFOcrucible: downstairs client at Some(127.0.0.1:8820) has region UUID 12345678-0000-0000-0000-000000008820 = downstairs client = 1 session_id = e23d1179-a328-4966-939c-1f33b7c6302e
732025-01-10T16:35:18.993ZINFOcrucible: downstairs client at Some(127.0.0.1:8830) has region UUID 12345678-0000-0000-0000-000000008830 = downstairs client = 2 session_id = e23d1179-a328-4966-939c-1f33b7c6302e
742025-01-10T16:35:18.993ZINFOcrucible: downstairs client at Some(127.0.0.1:8810) has region UUID 12345678-0000-0000-0000-000000008810 = downstairs client = 0 session_id = e23d1179-a328-4966-939c-1f33b7c6302e
752025-01-10T16:35:18.994ZINFOcrucible: ds_transition from WaitActive to WaitQuorum = downstairs client = 1 session_id = e23d1179-a328-4966-939c-1f33b7c6302e
762025-01-10T16:35:18.994ZINFOcrucible: [1] Transition from WaitActive to WaitQuorum = downstairs client = 1 session_id = e23d1179-a328-4966-939c-1f33b7c6302e
772025-01-10T16:35:18.994ZINFOcrucible: Waiting for more clients to be ready session_id = e23d1179-a328-4966-939c-1f33b7c6302e
782025-01-10T16:35:18.994ZINFOcrucible: ds_transition from WaitActive to WaitQuorum = downstairs client = 0 session_id = e23d1179-a328-4966-939c-1f33b7c6302e
792025-01-10T16:35:18.994ZINFOcrucible: [0] Transition from WaitActive to WaitQuorum = downstairs client = 0 session_id = e23d1179-a328-4966-939c-1f33b7c6302e
802025-01-10T16:35:18.994ZINFOcrucible: Waiting for more clients to be ready session_id = e23d1179-a328-4966-939c-1f33b7c6302e
812025-01-10T16:35:18.994ZINFOcrucible: ds_transition from WaitActive to WaitQuorum = downstairs client = 2 session_id = e23d1179-a328-4966-939c-1f33b7c6302e
822025-01-10T16:35:18.994ZINFOcrucible: [2] Transition from WaitActive to WaitQuorum = downstairs client = 2 session_id = e23d1179-a328-4966-939c-1f33b7c6302e
832025-01-10T16:35:18.994ZINFOcrucible: [0]R flush_numbers[0..12]: [0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0] = downstairs session_id = e23d1179-a328-4966-939c-1f33b7c6302e
842025-01-10T16:35:18.994ZINFOcrucible: [0]R generation[0..12]: [0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0] = downstairs session_id = e23d1179-a328-4966-939c-1f33b7c6302e
852025-01-10T16:35:18.994ZINFOcrucible: [0]R dirty[0..12]: [false, false, false, false, false, false, false, false, false, false, false, false] = downstairs session_id = e23d1179-a328-4966-939c-1f33b7c6302e
862025-01-10T16:35:18.994ZINFOcrucible: [1]R flush_numbers[0..12]: [0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0] = downstairs session_id = e23d1179-a328-4966-939c-1f33b7c6302e
872025-01-10T16:35:18.994ZINFOcrucible: [1]R generation[0..12]: [0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0] = downstairs session_id = e23d1179-a328-4966-939c-1f33b7c6302e
882025-01-10T16:35:18.995ZINFOcrucible: [1]R dirty[0..12]: [false, false, false, false, false, false, false, false, false, false, false, false] = downstairs session_id = e23d1179-a328-4966-939c-1f33b7c6302e
892025-01-10T16:35:18.995ZINFOcrucible: [2]R flush_numbers[0..12]: [0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0] = downstairs session_id = e23d1179-a328-4966-939c-1f33b7c6302e
902025-01-10T16:35:18.995ZINFOcrucible: [2]R generation[0..12]: [0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0] = downstairs session_id = e23d1179-a328-4966-939c-1f33b7c6302e
912025-01-10T16:35:18.995ZINFOcrucible: [2]R dirty[0..12]: [false, false, false, false, false, false, false, false, false, false, false, false] = downstairs session_id = e23d1179-a328-4966-939c-1f33b7c6302e
922025-01-10T16:35:18.995ZINFOcrucible: Max found gen is 1 = downstairs session_id = e23d1179-a328-4966-939c-1f33b7c6302e
932025-01-10T16:35:18.995ZINFOcrucible: Generation requested: 1 >= found:1 = downstairs session_id = e23d1179-a328-4966-939c-1f33b7c6302e
942025-01-10T16:35:18.995ZINFOcrucible: Next flush: 1 = downstairs session_id = e23d1179-a328-4966-939c-1f33b7c6302e
952025-01-10T16:35:18.995ZINFOcrucible: All extents match = downstairs session_id = e23d1179-a328-4966-939c-1f33b7c6302e
962025-01-10T16:35:18.995ZINFOcrucible: No downstairs reconciliation required session_id = e23d1179-a328-4966-939c-1f33b7c6302e
972025-01-10T16:35:18.995ZINFOcrucible: Transition from WaitQuorum to Active = downstairs client = 0 session_id = e23d1179-a328-4966-939c-1f33b7c6302e
982025-01-10T16:35:18.995ZINFOcrucible: Transition from WaitQuorum to Active = downstairs client = 1 session_id = e23d1179-a328-4966-939c-1f33b7c6302e
992025-01-10T16:35:18.995ZINFOcrucible: Transition from WaitQuorum to Active = downstairs client = 2 session_id = e23d1179-a328-4966-939c-1f33b7c6302e
1002025-01-10T16:35:18.995ZINFOcrucible: All required reconciliation work is completed session_id = e23d1179-a328-4966-939c-1f33b7c6302e
1012025-01-10T16:35:18.995ZINFOcrucible: Set Downstairs and Upstairs active after reconciliation session_id = e23d1179-a328-4966-939c-1f33b7c6302e
1022025-01-10T16:35:18.995ZINFOcrucible: fbca3bb3-fc25-4a44-b13d-5bb1875343ff is now active with session: e23d1179-a328-4966-939c-1f33b7c6302e session_id = e23d1179-a328-4966-939c-1f33b7c6302e
1032025-01-10T16:35:18.995ZINFOcrucible: The guest has finished waiting for activation with:1
1042025-01-10T16:35:18.995ZINFOcrucible: Set Active after no reconciliation session_id = e23d1179-a328-4966-939c-1f33b7c6302e
105 Activate successful
106 Wait for a query_work_queue command to finish before sending IO
107 Disk: sv:1 bs:4096 ts:20480000 tb:5000 max_io:256 or 1048576
108 Fill test
109 Read and Verify all blocks (0..5000 range:false)
110 Wrote out file "/tmp/test_replay_verify.log"
111 CLIENT: Tests done. All submitted work has been ACK'd
112 ----------------------------------------------------------------
113 Crucible gen:1 GIO:true work queues: Upstairs:0 downstairs:20
114 States: Active Active Active
115 JOBID ACK TYPE BKS/EXT DS:0 DS:1 DS:2 REPLAY
116 1021 Acked Read 256 Done Done Done false
117 1022 Acked Read 256 Done Done Done false
118 1023 Acked Read 256 Done Done Done false
119 1024 Acked Read 256 Done Done Done false
120 1025 Acked Read 256 Done Done Done false
121 1026 Acked Read 256 Done Done Done false
122 1027 Acked Read 256 Done Done Done false
123 1028 Acked Read 256 Done Done Done false
124 1029 Acked Read 256 Done Done Done false
125 1030 Acked Read 256 Done Done Done false
126 1031 Acked Read 256 Done Done Done false
127 1032 Acked Read 256 Done Done Done false
128 1033 Acked Read 256 Done Done Done false
129 1034 Acked Read 256 Done Done Done false
130 1035 Acked Read 256 Done Done Done false
131 1036 Acked Read 256 Done Done Done false
132 1037 Acked Read 256 Done Done Done false
133 1038 Acked Read 256 Done Done Done false
134 1039 Acked Read 256 Done Done Done false
135 1040 Acked Read 136 Done Done Done false
136 STATES DS:0 DS:1 DS:2 TOTAL
137 Sent 0 0 0 0
138 Done 20 20 20 60
139 Skipped 0 0 0 0
140 Error 0 0 0 0
141 Last Flush: 1020 1020 1020
142 Downstairs last five completed: 1020 1019 1018 1017 1016
143 Upstairs last five completed: 1040 1039 1038 1037 1036
144 CLIENT: Up:0 ds:20 act:3
145 ----------------------------------------------------------------
146 Crucible gen:1 GIO:true work queues: Upstairs:0 downstairs:0
147 Downstairs last five completed: 1041 1040 1039 1038 1037
148 Upstairs last five completed: 1041 1040 1039 1038 1037
149 CLIENT: Up:0 ds:0 act:3
150 CLIENT: All crucible jobs finished, exiting program
1512025-01-10T16:35:23.552ZWARNcrucible: Guest handle has been dropped
152 Replay loop starts now January 10, 2025 at 04:35:23 PM UTC
153 Jan 10 16:35:23.624 INFO accepted connection, remote_addr: 127.0.0.1:39583, local_addr: 127.0.0.1:9998
154 Jan 10 16:35:23.624 INFO request completed, latency_us: 166, response_code: 200, uri: /regioninfo, method: GET, req_id: 20a60e62-64d0-4597-8fe2-d62e89417ae2, remote_addr: 127.0.0.1:39583, local_addr: 127.0.0.1:9998
1552025-01-10T16:35:23.625ZINFOcrucible: Use this region info from dsc: RegionExtentInfo { block_size: 4096, blocks_per_extent: 100, extent_count: 50 } task = crutest
156 Jan 10 16:35:23.625 INFO request completed, latency_us: 91, response_code: 200, uri: /regioncount, method: GET, req_id: c18a2a89-14ac-4ddb-8be7-c71a0e69a69a, remote_addr: 127.0.0.1:39583, local_addr: 127.0.0.1:9998
1572025-01-10T16:35:23.626ZINFOcrucible: dsc has 3 regions. This means 1 sub_volumes task = crutest
158 Jan 10 16:35:23.626 INFO request completed, latency_us: 110, response_code: 200, uri: /port/cid/0, method: GET, req_id: 2f709d5e-7d5a-4838-a1a2-39598ead9d16, remote_addr: 127.0.0.1:39583, local_addr: 127.0.0.1:9998
159 Jan 10 16:35:23.626 INFO request completed, latency_us: 89, response_code: 200, uri: /port/cid/1, method: GET, req_id: 4a65bd34-d37b-4d63-9f7b-17213f887009, remote_addr: 127.0.0.1:39583, local_addr: 127.0.0.1:9998
160 Jan 10 16:35:23.627 INFO request completed, latency_us: 89, response_code: 200, uri: /port/cid/2, method: GET, req_id: 0d2a602d-5f47-4045-8135-dc21071dac13, remote_addr: 127.0.0.1:39583, local_addr: 127.0.0.1:9998
1612025-01-10T16:35:23.627ZINFOcrucible: SV 0 has targets: [127.0.0.1:8810, 127.0.0.1:8820, 127.0.0.1:8830] task = crutest
1622025-01-10T16:35:23.627ZINFOcrucible: Upstairs starts
1632025-01-10T16:35:23.627ZINFOcrucible: Crucible Version: BuildInfo { version: "0.0.1", git_sha: "56068760771d58f96ac946e6b2ae83073c18c1b4", git_commit_timestamp: "2025-01-10T16:19:36.000000000Z", git_branch: "alan/rust-1-84-please", rustc_semver: "1.84.0", rustc_channel: "stable", rustc_host_triple: "x86_64-unknown-illumos", rustc_commit_sha: "9fc6b43126469e3858e2fe86cafb4f0fd5068869", cargo_triple: "x86_64-unknown-illumos", debug: true, opt_level: 0, }
1642025-01-10T16:35:23.627ZINFOcrucible: Upstairs <-> Downstairs Message Version: 12
1652025-01-10T16:35:23.627ZINFOcrucible: Using region definition RegionDefinition { block_size: 4096, extent_size: Block { value: 100, shift: 12 }, extent_count: 50, uuid: 00000000-0000-0000-0000-000000000000, encrypted: false, database_read_version: 1, database_write_version: 1 }
1662025-01-10T16:35:23.628ZINFOcrucible: Crucible 2be40dea-e5aa-4ab1-b978-2391fc46c583 has session id: 1df3ca91-4dc9-42d6-9897-461254b5afe2 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
1672025-01-10T16:35:23.628ZINFOcrucible: Upstairs opts: Upstairs UUID: 2be40dea-e5aa-4ab1-b978-2391fc46c583, Targets: [127.0.0.1:8810, 127.0.0.1:8820, 127.0.0.1:8830], lossy: false, flush_timeout: None, key populated: false, cert_pem populated: false, key_pem populated: false, root_cert_pem populated: false, Control: None, read_only: false session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
1682025-01-10T16:35:23.628ZINFOcrucible: Crucible stats registered with UUID: 2be40dea-e5aa-4ab1-b978-2391fc46c583 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
1692025-01-10T16:35:23.661ZINFOcrucible: Downstairs in volume = 3 task = crutest
1702025-01-10T16:35:23.661ZINFOcrucible: The guest has requested activation with gen:2
1712025-01-10T16:35:23.661ZINFOcrucible: 2be40dea-e5aa-4ab1-b978-2391fc46c583 active request set session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
1722025-01-10T16:35:23.661ZINFOcrucible: sending connect oneshot to client = downstairs client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
1732025-01-10T16:35:23.661ZINFOcrucible: client set_active_request while in New; waiting... = downstairs client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
1742025-01-10T16:35:23.661ZINFOcrucible: sending connect oneshot to client = downstairs client = 1 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
1752025-01-10T16:35:23.661ZINFOcrucible: client set_active_request while in New; waiting... = downstairs client = 1 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
1762025-01-10T16:35:23.661ZINFOcrucible: sending connect oneshot to client = downstairs client = 2 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
1772025-01-10T16:35:23.661ZINFOcrucible: client set_active_request while in New; waiting... = downstairs client = 2 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
1782025-01-10T16:35:23.661ZINFOcrucible: connecting to 127.0.0.1:8830 = io task client = 2 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
1792025-01-10T16:35:23.661ZINFOcrucible: connecting to 127.0.0.1:8810 = io task client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
1802025-01-10T16:35:23.661ZINFOcrucible: connecting to 127.0.0.1:8820 = io task client = 1 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
1812025-01-10T16:35:23.661ZINFOcrucible: ds_connection connected from Ok(127.0.0.1:56979) = io task client = 2 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
1822025-01-10T16:35:23.661ZINFOcrucible: ds_connection connected from Ok(127.0.0.1:62654) = io task client = 1 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
1832025-01-10T16:35:23.662ZINFOcrucible: ds_connection connected from Ok(127.0.0.1:62015) = io task client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
1842025-01-10T16:35:23.662ZINFOcrucible: ds_transition from New to WaitActive = downstairs client = 2 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
1852025-01-10T16:35:23.662ZINFOcrucible: [2] Transition from New to WaitActive = downstairs client = 2 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
1862025-01-10T16:35:23.662ZINFOcrucible: ds_transition from New to WaitActive = downstairs client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
1872025-01-10T16:35:23.662ZINFOcrucible: [0] Transition from New to WaitActive = downstairs client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
1882025-01-10T16:35:23.662ZINFOcrucible: ds_transition from New to WaitActive = downstairs client = 1 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
1892025-01-10T16:35:23.662ZINFOcrucible: [1] Transition from New to WaitActive = downstairs client = 1 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
1902025-01-10T16:35:23.663ZINFOcrucible: downstairs client at Some(127.0.0.1:8830) has region UUID 12345678-0000-0000-0000-000000008830 = downstairs client = 2 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
1912025-01-10T16:35:23.663ZINFOcrucible: downstairs client at Some(127.0.0.1:8810) has region UUID 12345678-0000-0000-0000-000000008810 = downstairs client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
1922025-01-10T16:35:23.663ZINFOcrucible: downstairs client at Some(127.0.0.1:8820) has region UUID 12345678-0000-0000-0000-000000008820 = downstairs client = 1 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
1932025-01-10T16:35:23.664ZINFOcrucible: ds_transition from WaitActive to WaitQuorum = downstairs client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
1942025-01-10T16:35:23.664ZINFOcrucible: [0] Transition from WaitActive to WaitQuorum = downstairs client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
1952025-01-10T16:35:23.664ZINFOcrucible: Waiting for more clients to be ready session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
1962025-01-10T16:35:23.664ZINFOcrucible: ds_transition from WaitActive to WaitQuorum = downstairs client = 1 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
1972025-01-10T16:35:23.664ZINFOcrucible: [1] Transition from WaitActive to WaitQuorum = downstairs client = 1 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
1982025-01-10T16:35:23.664ZINFOcrucible: Waiting for more clients to be ready session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
1992025-01-10T16:35:23.664ZINFOcrucible: ds_transition from WaitActive to WaitQuorum = downstairs client = 2 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
2002025-01-10T16:35:23.664ZINFOcrucible: [2] Transition from WaitActive to WaitQuorum = downstairs client = 2 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
2012025-01-10T16:35:23.664ZINFOcrucible: [0]R flush_numbers[0..12]: [1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1] = downstairs session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
2022025-01-10T16:35:23.664ZINFOcrucible: [0]R generation[0..12]: [1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1] = downstairs session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
2032025-01-10T16:35:23.664ZINFOcrucible: [0]R dirty[0..12]: [false, false, false, false, false, false, false, false, false, false, false, false] = downstairs session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
2042025-01-10T16:35:23.664ZINFOcrucible: [1]R flush_numbers[0..12]: [1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1] = downstairs session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
2052025-01-10T16:35:23.664ZINFOcrucible: [1]R generation[0..12]: [1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1] = downstairs session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
2062025-01-10T16:35:23.664ZINFOcrucible: [1]R dirty[0..12]: [false, false, false, false, false, false, false, false, false, false, false, false] = downstairs session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
2072025-01-10T16:35:23.664ZINFOcrucible: [2]R flush_numbers[0..12]: [1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1] = downstairs session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
2082025-01-10T16:35:23.664ZINFOcrucible: [2]R generation[0..12]: [1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1] = downstairs session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
2092025-01-10T16:35:23.664ZINFOcrucible: [2]R dirty[0..12]: [false, false, false, false, false, false, false, false, false, false, false, false] = downstairs session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
2102025-01-10T16:35:23.664ZINFOcrucible: Max found gen is 2 = downstairs session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
2112025-01-10T16:35:23.664ZINFOcrucible: Generation requested: 2 >= found:2 = downstairs session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
212 {"msg":"Next flush: 2","v":0,"name":"crucible","level":30Activate successful
213 ,Wait for a query_work_queue command to finish before sending IO
214 "time":"2025-01-10T16:35:23.664523068Z","hostname":"w-01JH8H1N3KXZ9F8ZV6CCMP5KTQ","pid":1202,"":"downstairs","":"downstairs","session_id":"1df3ca91-4dc9-42d6-9897-461254b5afe2"}
2152025-01-10T16:35:23.664ZINFOcrucible: All extents match = downstairs session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
2162025-01-10T16:35:23.664ZINFOcrucible: No downstairs reconciliation required session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
2172025-01-10T16:35:23.664ZINFOcrucible: Transition from WaitQuorum to Active = downstairs client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
2182025-01-10T16:35:23.664ZINFOcrucible: Transition from WaitQuorum to Active = downstairs client = 1 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
2192025-01-10T16:35:23.664ZINFOcrucible: Transition from WaitQuorum to Active = downstairs client = 2 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
2202025-01-10T16:35:23.664ZINFOcrucible: All required reconciliation work is completed session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
2212025-01-10T16:35:23.664ZINFOcrucible: Set Downstairs and Upstairs active after reconciliation session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
2222025-01-10T16:35:23.664ZINFOcrucible: 2be40dea-e5aa-4ab1-b978-2391fc46c583 is now active with session: 1df3ca91-4dc9-42d6-9897-461254b5afe2 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
2232025-01-10T16:35:23.664ZINFOcrucible: Set Active after no reconciliation session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
2242025-01-10T16:35:23.664ZINFOcrucible: The guest has finished waiting for activation with:2
225 Disk: sv:1 bs:4096 ts:20480000 tb:5000 max_io:256 or 1048576
226 Loading write count information from file "/tmp/test_replay_verify.log"
227 Jan 10 16:35:23.697 INFO accepted connection, remote_addr: 127.0.0.1:55917, local_addr: 127.0.0.1:9998
228 Main task has work to do, go find it
229 got dsc Stop(2)
230 stop 2
231 Jan 10 16:35:23.698 INFO request completed, latency_us: 186, response_code: 204, uri: /stop/cid/2, method: POST, req_id: 42b519c7-935c-4466-a5f5-46aaecd8c9ba, remote_addr: 127.0.0.1:55917, local_addr: 127.0.0.[8830] Got stop action so:false kr:false
232 1:9998
2332025-01-10T16:35:23.698ZWARNcrucible: downstairs disconnected = io task client = 2 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
234 Jan 10 16:35:23.698 INFO request completed, latency_us: 164, response_code: 200, uri: /state/cid/2, method: GET, req_id: b222ddac-17d7-4475-bced-c860e9913aa1, remote_addr: 127.0.0.1:55917, local_addr: 127.0.0.1:9998
2352025-01-10T16:35:23.699ZWARNcrucible: client task is sending Done(Finished) = io task client = 2 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
2362025-01-10T16:35:23.699ZWARNcrucible: downstairs task for 2 stopped due to Finished session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
2372025-01-10T16:35:23.699ZINFOcrucible: ds_transition from Active to Offline = downstairs client = 2 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
2382025-01-10T16:35:23.699ZINFOcrucible: [2] Transition from Active to Offline = downstairs client = 2 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
2392025-01-10T16:35:23.699ZINFOcrucible: client task is exiting = io task client = 2 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
240 [8830] Exited with: ExitStatus(unix_wait_status(9))
241 [8830][2] reports Exit
242 Jan 10 16:35:27.702 INFO request completed, latency_us: 331, response_code: 200, uri: /state/cid/2, method: GET, req_id: 3e41be40-435d-41fe-a672-4a23888996ee, remote_addr: 127.0.0.1:55917, local_addr: 127.0.0.1:9998
243 001/300 Write block 1012 len 24576 data: 2 2 2 2 2 2
244 002/300 Write block 4089 len 32768 data: 2 2 2 2 2 2 2 2
245 003/300 Write block 2688 len 12288 data: 2 2 2
246 004/300 Write block 3001 len 32768 data: 2 2 2 2 2 2 2 2
247 005/300 Flush
248 006/300 Read block 1003 len 32768
249 007/300 Write block 2149 len 12288 data: 2 2 2
250 008/300 Write block 13 len 20480 data: 2 2 2 2 2
251 009/300 Write block 4300 len 32768 data: 2 2 2 2 2 2 2 2
252 010/300 Write block 806 len 28672 data: 2 2 2 2 2 2 2
253 011/300 Read block 3612 len 24576
254 012/300 Write block 2087 len 4096 data: 2
255 013/300 Read block 261 len 40960
256 014/300 Read block 1299 len 8192
257 015/300 Write block 698 len 40960 data: 2 2 2 2 2 2 2 2 2 2
258 016/300 Read block 697 len 40960
259 017/300 Flush
260 018/300 Write block 2872 len 4096 data: 2
261 019/300 Read block 4733 len 12288
262 020/300 Read block 477 len 20480
263 021/300 Read block 82 len 4096
264 022/300 Read block 4623 len 32768
265 023/300 Read block 4964 len 24576
266 024/300 Flush
267 025/300 Read block 329 len 12288
268 026/300 Read block 3957 len 32768
269 027/300 Write block 4926 len 24576 data: 2 2 2 2 2 2
270 028/300 Flush
271 029/300 Write block 837 len 16384 data: 2 2 2 2
272 030/300 Read block 1149 len 36864
273 031/300 Read block 2941 len 16384
274 032/300 Read block 4748 len 28672
275 033/300 Read block 286 len 28672
276 034/300 Write block 1776 len 40960 data: 2 2 2 2 2 2 2 2 2 2
277 035/300 Write block 724 len 8192 data: 2 2
278 036/300 Flush
279 037/300 Write block 667 len 12288 data: 2 2 2
280 038/300 Write block 810 len 20480 data: 3 3 3 2 2
281 039/300 Read block 1133 len 12288
282 040/300 Read block 2640 len 8192
283 041/300 Read block 108 len 16384
284 042/300 Read block 2213 len 16384
285 043/300 Read block 2615 len 24576
286 044/300 Read block 584 len 8192
287 045/300 Read block 2559 len 20480
288 046/300 Write block 4208 len 32768 data: 2 2 2 2 2 2 2 2
289 047/300 Read block 2208 len 28672
290 048/300 Write block 1544 len 16384 data: 2 2 2 2
291 049/300 Write block 3380 len 36864 data: 2 2 2 2 2 2 2 2 2
292 050/300 Read block 1685 len 8192
293 051/300 Read block 3772 len 32768
294 052/300 Write block 4852 len 16384 data: 2 2 2 2
295 053/300 Read block 4322 len 32768
296 054/300 Read block 905 len 8192
297 055/300 Read block 4123 len 20480
298 056/300 Read block 2082 len 8192
299 057/300 Write block 705 len 24576 data: 3 3 3 2 2 2
300 058/300 Flush
301 059/300 Write block 4551 len 24576 data: 2 2 2 2 2 2
302 060/300 Read block 2981 len 16384
303 061/300 Write block 4889 len 4096 data: 2
304 062/300 Write block 2248 len 16384 data: 2 2 2 2
305 063/300 Write block 979 len 36864 data: 2 2 2 2 2 2 2 2 2
306 064/300 Write block 4531 len 12288 data: 2 2 2
307 065/300 Flush
308 066/300 Read block 2074 len 40960
309 067/300 Read block 166 len 12288
310 068/300 Read block 2398 len 4096
311 069/300 Read block 1376 len 4096
312 070/300 Read block 4839 len 32768
313 071/300 Write block 1485 len 8192 data: 2 2
314 072/300 Read block 2656 len 36864
315 073/300 Read block 4134 len 16384
316 074/300 Write block 4986 len 28672 data: 2 2 2 2 2 2 2
317 075/300 Read block 3184 len 12288
318 076/300 Read block 1581 len 32768
319 077/300 Read block 1897 len 4096
320 078/300 Read block 3409 len 12288
321 079/300 Write block 590 len 12288 data: 2 2 2
322 080/300 Write block 849 len 4096 data: 2
323 081/300 Write block 2952 len 4096 data: 2
324 082/300 Flush
325 083/300 Flush
326 084/300 Write block 1391 len 4096 data: 2
327 085/300 Read block 1118 len 4096
328 086/300 Read block 4820 len 16384
329 087/300 Read block 3922 len 24576
330 088/300 Read block 603 len 16384
331 089/300 Read block 4861 len 28672
332 090/300 Read block 4114 len 12288
333 091/300 Read block 3295 len 20480
334 092/300 Write block 1327 len 28672 data: 2 2 2 2 2 2 2
335 093/300 Read block 2140 len 28672
336 094/300 Read block 1325 len 4096
337 095/300 Write block 706 len 4096 data: 4
338 096/300 Write block 430 len 24576 data: 2 2 2 2 2 2
339 097/300 Read block 4199 len 20480
340 098/300 Write block 3832 len 16384 data: 2 2 2 2
341 099/300 Write block 732 len 12288 data: 2 2 2
342 100/300 Write block 882 len 20480 data: 2 2 2 2 2
343 101/300 Read block 2862 len 12288
344 102/300 Write block 2332 len 24576 data: 2 2 2 2 2 2
345 103/300 Read block 2494 len 4096
346 104/300 Read block 3093 len 36864
347 105/300 Read block 1170 len 20480
348 106/300 Write block 24 len 20480 data: 2 2 2 2 2
349 107/300 Write block 3512 len 24576 data: 2 2 2 2 2 2
350 108/300 Read block 1622 len 28672
351 109/300 Read block 3445 len 32768
352 110/300 Read block 771 len 36864
353 111/300 Read block 1073 len 36864
354 112/300 Flush
355 113/300 Read block 3153 len 8192
356 114/300 Read block 2023 len 16384
357 115/300 Read block 1765 len 36864
358 116/300 Write block 2502 len 32768 data: 2 2 2 2 2 2 2 2
359 117/300 Read block 4363 len 8192
360 118/300 Write block 2411 len 32768 data: 2 2 2 2 2 2 2 2
361 119/300 Read block 1420 len 28672
362 120/300 Flush
363 121/300 Read block 3594 len 12288
364 122/300 Read block 3061 len 4096
365 123/300 Read block 2862 len 32768
366 124/300 Read block 4646 len 32768
367 125/300 Write block 4463 len 4096 data: 2
368 126/300 Write block 1326 len 32768 data: 2 3 3 3 3 3 3 3
369 127/300 Read block 2368 len 20480
370 128/300 Read block 4599 len 20480
371 129/300 Read block 2523 len 16384
372 130/300 Read block 2600 len 40960
373 131/300 Read block 3043 len 36864
374 132/300 Read block 2211 len 32768
375 133/300 Read block 4042 len 20480
376 134/300 Write block 1221 len 4096 data: 2
377 135/300 Read block 3110 len 20480
378 136/300 Write block 3651 len 16384 data: 2 2 2 2
379 137/300 Write block 4473 len 12288 data: 2 2 2
380 138/300 Read block 3128 len 24576
381 139/300 Read block 4858 len 40960
382 140/300 Write block 966 len 24576 data: 2 2 2 2 2 2
383 141/300 Write block 877 len 20480 data: 2 2 2 2 2
384 142/300 Read block 1373 len 36864
385 143/300 Flush
386 144/300 Write block 3679 len 32768 data: 2 2 2 2 2 2 2 2
387 145/300 Read block 1143 len 28672
388 146/300 Write block 4699 len 40960 data: 2 2 2 2 2 2 2 2 2 2
389 147/300 Write block 973 len 36864 data: 2 2 2 2 2 2 3 3 3
390 148/300 Read block 1975 len 20480
391 149/300 Write block 603 len 24576 data: 2 2 2 2 2 2
392 150/300 Read block 791 len 28672
393 151/300 Read block 2983 len 16384
394 152/300 Read block 2160 len 8192
395 153/300 Flush
396 154/300 Write block 2655 len 12288 data: 2 2 2
397 155/300 Read block 4700 len 4096
398 156/300 Read block 2016 len 36864
399 157/300 Flush
400 158/300 Read block 2062 len 20480
401 159/300 Read block 360 len 12288
402 160/300 Read block 235 len 12288
403 161/300 Read block 304 len 12288
404 162/300 Flush
405 163/300 Write block 2289 len 32768 data: 2 2 2 2 2 2 2 2
406 164/300 Flush
407 165/300 Write block 2635 len 32768 data: 2 2 2 2 2 2 2 2
408 166/300 Write block 3725 len 20480 data: 2 2 2 2 2
409 167/300 Write block 3130 len 36864 data: 2 2 2 2 2 2 2 2 2
410 168/300 Write block 1780 len 32768 data: 3 3 3 3 3 3 2 2
411 169/300 Write block 2288 len 20480 data: 2 3 3 3 3
412 170/300 Flush
413 171/300 Read block 2110 len 40960
414 172/300 Read block 349 len 32768
415 173/300 Write block 2627 len 20480 data: 2 2 2 2 2
416 174/300 Read block 3979 len 32768
417 175/300 Read block 4146 len 20480
418 176/300 Read block 860 len 4096
419 177/300 Write block 4856 len 36864 data: 2 2 2 2 2 2 2 2 2
420 178/300 Read block 2865 len 28672
421 179/300 Read block 4293 len 36864
422 180/300 Read block 2480 len 36864
423 181/300 Write block 1708 len 8192 data: 2 2
424 182/300 Write block 1231 len 4096 data: 2
425 183/300 Read block 2535 len 40960
426 184/300 Write block 276 len 12288 data: 2 2 2
427 185/300 Write block 4309 len 8192 data: 2 2
428 186/300 Write block 3212 len 40960 data: 2 2 2 2 2 2 2 2 2 2
429 187/300 Write block 2247 len 12288 data: 2 3 3
430 188/300 Write block 3652 len 12288 data: 3 3 3
431 189/300 Flush
432 190/300 Write block 808 len 8192 data: 3 3
433 191/300 Write block 3131 len 28672 data: 3 3 3 3 3 3 3
434 192/300 Read block 1440 len 36864
435 193/300 Flush
436 194/300 Write block 3986 len 32768 data: 2 2 2 2 2 2 2 2
437 195/300 Write block 1657 len 12288 data: 2 2 2
438 196/300 Read block 1385 len 24576
439 197/300 Write block 947 len 40960 data: 2 2 2 2 2 2 2 2 2 2
440 198/300 Read block 2305 len 12288
441 199/300 Read block 2688 len 36864
442 200/300 Read block 1459 len 16384
443 201/300 Read block 4412 len 16384
444 202/300 Read block 495 len 20480
445 203/300 Read block 688 len 32768
446 204/300 Flush
447 205/300 Read block 450 len 32768
448 206/300 Read block 4609 len 20480
449 207/300 Read block 512 len 28672
450 208/300 Read block 1869 len 4096
451 209/300 Write block 1457 len 24576 data: 2 2 2 2 2 2
452 210/300 Read block 1819 len 16384
453 211/300 Read block 4613 len 28672
454 212/300 Read block 896 len 16384
455 213/300 Read block 2914 len 12288
456 214/300 Read block 3000 len 16384
457 215/300 Read block 215 len 8192
458 216/300 Write block 4962 len 36864 data: 2 2 2 2 2 2 2 2 2
459 217/300 Write block 951 len 28672 data: 3 3 3 3 3 3 2
460 218/300 Write block 4299 len 4096 data: 2
461 219/300 Write block 3352 len 8192 data: 2 2
462 220/300 Read block 1764 len 40960
463 221/300 Read block 242 len 4096
464 222/300 Read block 93 len 40960
465 223/300 Read block 2782 len 24576
466 224/300 Write block 3241 len 40960 data: 2 2 2 2 2 2 2 2 2 2
467 225/300 Flush
468 226/300 Write block 4179 len 24576 data: 2 2 2 2 2 2
469 227/300 Write block 4319 len 20480 data: 2 2 2 2 2
470 228/300 Flush
471 229/300 Read block 2117 len 16384
472 230/300 Read block 2174 len 24576
473 231/300 Read block 1646 len 12288
474 232/300 Read block 1861 len 12288
475 233/300 Read block 2781 len 4096
476 234/300 Read block 3586 len 8192
477 235/300 Read block 979 len 12288
478 236/300 Read block 1374 len 8192
479 237/300 Read block 1383 len 28672
480 238/300 Read block 4657 len 4096
481 239/300 Read block 2923 len 32768
482 240/300 Write block 1508 len 12288 data: 2 2 2
483 241/300 Read block 2650 len 32768
484 242/300 Read block 2607 len 8192
485 243/300 Read block 1951 len 8192
486 244/300 Read block 2164 len 12288
487 245/300 Write block 9 len 40960 data: 2 2 2 2 3 3 3 3 3 2
488 246/300 Flush
489 247/300 Write block 771 len 20480 data: 2 2 2 2 2
490 248/300 Write block 679 len 28672 data: 2 2 2 2 2 2 2
491 249/300 Read block 344 len 24576
492 250/300 Read block 2898 len 12288
493 251/300 Write block 573 len 16384 data: 2 2 2 2
494 252/300 Read block 374 len 8192
495 253/300 Read block 3306 len 24576
496 254/300 Read block 1274 len 12288
497 255/300 Write block 4287 len 8192 data: 2 2
498 256/300 Read block 4115 len 40960
499 257/300 Write block 2266 len 12288 data: 2 2 2
500 258/300 Write block 4270 len 4096 data: 2
501 259/300 Write block 2159 len 32768 data: 2 2 2 2 2 2 2 2
502 260/300 Read block 4922 len 28672
503 261/300 Read block 1100 len 16384
504 262/300 Write block 2931 len 32768 data: 2 2 2 2 2 2 2 2
505 263/300 Write block 3785 len 12288 data: 2 2 2
506 264/300 Write block 209 len 40960 data: 2 2 2 2 2 2 2 2 2 2
507 265/300 Write block 598 len 16384 data: 2 2 2 2
508 266/300 Write block 684 len 32768 data: 3 3 2 2 2 2 2 2
509 267/300 Read block 1714 len 40960
510 268/300 Write block 4761 len 12288 data: 2 2 2
511 269/300 Read block 1315 len 32768
512 270/300 Write block 758 len 36864 data: 2 2 2 2 2 2 2 2 2
513 271/300 Flush
514 272/300 Write block 1587 len 24576 data: 2 2 2 2 2 2
515 273/300 Write block 3086 len 20480 data: 2 2 2 2 2
516 274/300 Flush
517 275/300 Flush
518 276/300 Write block 1 len 4096 data: 2
519 277/300 Read block 3204 len 4096
520 278/300 Flush
521 279/300 Write block 1630 len 20480 data: 2 2 2 2 2
522 280/300 Write block 2310 len 32768 data: 2 2 2 2 2 2 2 2
523 281/300 Write block 4343 len 12288 data: 2 2 2
524 282/300 Write block 4166 len 8192 data: 2 2
525 283/300 Read block 3591 len 16384
526 284/300 Read block 655 len 12288
527 285/300 Read block 4643 len 16384
528 286/300 Read block 563 len 12288
529 287/300 Write block 3536 len 24576 data: 2 2 2 2 2 2
530 288/300 Write block 4015 len 12288 data: 2 2 2
531 289/300 Read block 1607 len 8192
532 290/300 Read block 482 len 20480
533 291/300 Write block 1669 len 4096 data: 2
534 292/300 Read block 954 len 20480
535 293/300 Flush
536 294/300 Read block 2302 len 24576
537 295/300 Read block 3986 len 40960
538 296/300 Flush
539 297/300 Read block 4625 len 40960
540 298/300 Write block 186 len 12288 data: 2 2 2
541 299/300 Flush
542 300/300 Write block 2861 len 32768 data: 2 2 2 2 2 2 2 2
543 301/300 Flush
544 Main task has work to do, go find it
545 got dsc Start(2)
546 start 2
547 Jan 10 16:35:27.937 INFO request completed, latency_us: 216, response_code: 204, uri: /start/cid/2, method: POST, req_id: dbe3efa2-ca49-4672-ab56-d5be0b3849f9, remote_addr: 127.0.0.1:55917, local_addr: 127.0.0.1:9998
548 Replay: started 2, returned:Ok(())
549 ----------------------------------------------------------------
550 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:301
551 States: Active Active Offline
552 JOBID ACK TYPE BKS/EXT DS:0 DS:1 DS:2 REPLAY
553 1000 Acked Write 6 Done Done Sent false
554 1001 Acked Write 8 Done Done Sent false
555 1002 Acked Write 3 Done Done Sent false
556 1003 Acked Write 8 Done Done Sent false
557 1004 Acked Flush 0 Done Done Sent false
558 1005 Acked Read 8 Done Done Sent false
559 1006 Acked Write 3 Done Done Sent false
560 1007 Acked Write 5 Done Done Sent false
561 1008 Acked Write 8 Done Done Sent false
562 1009 Acked Write 7 Done Done Sent false
563 1010 Acked Read 6 Done Done Sent false
564 1011 Acked Write 1 Done Done Sent false
565 1012 Acked Read 10 Done Done Sent false
566 1013 Acked Read 2 Done Done Sent false
567 1014 Acked Write 10 Done Done Sent false
568 1015 Acked Read 10 Done Done Sent false
569 1016 Acked Flush 0 Done Done Sent false
570 1017 Acked Write 1 Done Done Sent false
571 1018 Acked Read 3 Done Done Sent false
572 1019 Acked Read 5 Done Done Sent false
573 1020 Acked Read 1 Done Done Sent false
574 1021 Acked Read 8 Done Done Sent false
575 1022 Acked Read 6 Done Done Sent false
576 1023 Acked Flush 0 Done Done Sent false
577 1024 Acked Read 3 Done Done Sent false
578 1025 Acked Read 8 Done Done Sent false
579 1026 Acked Write 6 Done Done Sent false
580 1027 Acked Flush 0 Done Done Sent false
581 1028 Acked Write 4 Done Done Sent false
582 1029 Acked Read 9 Done Done Sent false
583 1030 Acked Read 4 Done Done Sent false
584 1031 Acked Read 7 Done Done Sent false
585 1032 Acked Read 7 Done Done Sent false
586 1033 Acked Write 10 Done Done Sent false
587 1034 Acked Write 2 Done Done Sent false
588 1035 Acked Flush 0 Done Done Sent false
589 1036 Acked Write 3 Done Done Sent false
590 1037 Acked Write 5 Done Done Sent false
591 1038 Acked Read 3 Done Done Sent false
592 1039 Acked Read 2 Done Done Sent false
593 1040 Acked Read 4 Done Done Sent false
594 1041 Acked Read 4 Done Done Sent false
595 1042 Acked Read 6 Done Done Sent false
596 1043 Acked Read 2 Done Done Sent false
597 1044 Acked Read 5 Done Done Sent false
598 1045 Acked Write 8 Done Done Sent false
599 1046 Acked Read 7 Done Done Sent false
600 1047 Acked Write 4 Done Done Sent false
601 1048 Acked Write 9 Done Done Sent false
602 1049 Acked Read 2 Done Done Sent false
603 1050 Acked Read 8 Done Done Sent false
604 1051 Acked Write 4 Done Done Sent false
605 1052 Acked Read 8 Done Done Sent false
606 1053 Acked Read 2 Done Done Sent false
607 1054 Acked Read 5 Done Done Sent false
608 1055 Acked Read 2 Done Done Sent false
609 1056 Acked Write 6 Done Done Sent false
610 1057 Acked Flush 0 Done Done Sent false
611 1058 Acked Write 6 Done Done Sent false
612 1059 Acked Read 4 Done Done Sent false
613 1060 Acked Write 1 Done Done Sent false
614 1061 Acked Write 4 Done Done Sent false
615 1062 Acked Write 9 Done Done Sent false
616 1063 Acked Write 3 Done Done Sent false
617 1064 Acked Flush 0 Done Done Sent false
618 1065 Acked Read 10 Done Done Sent false
619 1066 Acked Read 3 Done Done Sent false
620 1067 Acked Read 1 Done Done Sent false
621 1068 Acked Read 1 Done Done Sent false
622 1069 Acked Read 8 Done Done Sent false
623 1070 Acked Write 2 Done Done Sent false
624 1071 Acked Read 9 Done Done Sent false
625 1072 Acked Read 4 Done Done Sent false
626 1073 Acked Write 7 Done Done Sent false
627 1074 Acked Read 3 Done Done Sent false
628 1075 Acked Read 8 Done Done Sent false
629 1076 Acked Read 1 Done Done Sent false
630 1077 Acked Read 3 Done Done Sent false
631 1078 Acked Write 3 Done Done Sent false
632 1079 Acked Write 1 Done Done Sent false
633 1080 Acked Write 1 Done Done Sent false
634 1081 Acked Flush 0 Done Done Sent false
635 1082 Acked Flush 0 Done Done Sent false
636 1083 Acked Write 1 Done Done Sent false
637 1084 Acked Read 1 Done Done Sent false
638 1085 Acked Read 4 Done Done Sent false
639 1086 Acked Read 6 Done Done Sent false
640 1087 Acked Read 4 Done Done Sent false
641 1088 Acked Read 7 Done Done Sent false
642 1089 Acked Read 3 Done Done Sent false
643 1090 Acked Read 5 Done Done Sent false
644 1091 Acked Write 7 Done Done Sent false
645 1092 Acked Read 7 Done Done Sent false
646 1093 Acked Read 1 Done Done Sent false
647 1094 Acked Write 1 Done Done Sent false
648 1095 Acked Write 6 Done Done Sent false
649 1096 Acked Read 5 Done Done Sent false
650 1097 Acked Write 4 Done Done Sent false
651 1098 Acked Write 3 Done Done Sent false
652 1099 Acked Write 5 Done Done Sent false
653 1100 Acked Read 3 Done Done Sent false
654 1101 Acked Write 6 Done Done Sent false
655 1102 Acked Read 1 Done Done Sent false
656 1103 Acked Read 9 Done Done Sent false
657 1104 Acked Read 5 Done Done Sent false
658 1105 Acked Write 5 Done Done Sent false
659 1106 Acked Write 6 Done Done Sent false
660 1107 Acked Read 7 Done Done Sent false
661 1108 Acked Read 8 Done Done Sent false
662 1109 Acked Read 9 Done Done Sent false
663 1110 Acked Read 9 Done Done Sent false
664 1111 Acked Flush 0 Done Done Sent false
665 1112 Acked Read 2 Done Done Sent false
666 1113 Acked Read 4 Done Done Sent false
667 1114 Acked Read 9 Done Done Sent false
668 1115 Acked Write 8 Done Done Sent false
669 1116 Acked Read 2 Done Done Sent false
670 1117 Acked Write 8 Done Done Sent false
671 1118 Acked Read 7 Done Done Sent false
672 1119 Acked Flush 0 Done Done Sent false
673 1120 Acked Read 3 Done Done Sent false
674 1121 Acked Read 1 Done Done Sent false
675 1122 Acked Read 8 Done Done Sent false
676 1123 Acked Read 8 Done Done Sent false
677 1124 Acked Write 1 Done Done Sent false
678 1125 Acked Write 8 Done Done Sent false
679 1126 Acked Read 5 Done Done Sent false
680 1127 Acked Read 5 Done Done Sent false
681 1128 Acked Read 4 Done Done Sent false
682 1129 Acked Read 10 Done Done Sent false
683 1130 Acked Read 9 Done Done Sent false
684 1131 Acked Read 8 Done Done Sent false
685 1132 Acked Read 5 Done Done Sent false
686 1133 Acked Write 1 Done Done Sent false
687 1134 Acked Read 5 Done Done Sent false
688 1135 Acked Write 4 Done Done Sent false
689 1136 Acked Write 3 Done Done Sent false
690 1137 Acked Read 6 Done Done Sent false
691 1138 Acked Read 10 Done Done Sent false
692 1139 Acked Write 6 Done Done Sent false
693 1140 Acked Write 5 Done Done Sent false
694 1141 Acked Read 9 Done Done Sent false
695 1142 Acked Flush 0 Done Done Sent false
696 1143 Acked Write 8 Done Done Sent false
697 1144 Acked Read 7 Done Done Sent false
698 1145 Acked Write 10 Done Done Sent false
699 1146 Acked Write 9 Done Done Sent false
700 1147 Acked Read 5 Done Done Sent false
701 1148 Acked Write 6 Done Done Sent false
702 1149 Acked Read 7 Done Done Sent false
703 1150 Acked Read 4 Done Done Sent false
704 1151 Acked Read 2 Done Done Sent false
705 1152 Acked Flush 0 Done Done Sent false
706 1153 Acked Write 3 Done Done Sent false
707 1154 Acked Read 1 Done Done Sent false
708 1155 Acked Read 9 Done Done Sent false
709 1156 Acked Flush 0 Done Done Sent false
710 1157 Acked Read 5 Done Done Sent false
711 1158 Acked Read 3 Done Done Sent false
712 1159 Acked Read 3 Done Done Sent false
713 1160 Acked Read 3 Done Done Sent false
714 1161 Acked Flush 0 Done Done Sent false
715 1162 Acked Write 8 Done Done Sent false
716 1163 Acked Flush 0 Done Done Sent false
717 1164 Acked Write 8 Done Done Sent false
718 1165 Acked Write 5 Done Done Sent false
719 1166 Acked Write 9 Done Done Sent false
720 1167 Acked Write 8 Done Done Sent false
721 1168 Acked Write 5 Done Done Sent false
722 1169 Acked Flush 0 Done Done Sent false
723 1170 Acked Read 10 Done Done Sent false
724 1171 Acked Read 8 Done Done Sent false
725 1172 Acked Write 5 Done Done Sent false
726 1173 Acked Read 8 Done Done Sent false
727 1174 Acked Read 5 Done Done Sent false
728 1175 Acked Read 1 Done Done Sent false
729 1176 Acked Write 9 Done Done Sent false
730 1177 Acked Read 7 Done Done Sent false
731 1178 Acked Read 9 Done Done Sent false
732 1179 Acked Read 9 Done Done Sent false
733 1180 Acked Write 2 Done Done Sent false
734 1181 Acked Write 1 Done Done Sent false
735 1182 Acked Read 10 Done Done Sent false
736 1183 Acked Write 3 Done Done Sent false
737 1184 Acked Write 2 Done Done Sent false
738 1185 Acked Write 10 Done Done Sent false
739 1186 Acked Write 3 Done Done Sent false
740 1187 Acked Write 3 Done Done Sent false
741 1188 Acked Flush 0 Done Done Sent false
742 1189 Acked Write 2 Done Done Sent false
743 1190 Acked Write 7 Done Done Sent false
744 1191 Acked Read 9 Done Done Sent false
745 1192 Acked Flush 0 Done Done Sent false
746 1193 Acked Write 8 Done Done Sent false
747 1194 Acked Write 3 Done Done Sent false
748 1195 Acked Read 6 Done Done Sent false
749 1196 Acked Write 10 Done Done Sent false
750 1197 Acked Read 3 Done Done Sent false
751 1198 Acked Read 9 Done Done Sent false
752 1199 Acked Read 4 Done Done Sent false
753 1200 Acked Read 4 Done Done Sent false
754 1201 Acked Read 5 Done Done Sent false
755 1202 Acked Read 8 Done Done Sent false
756 1203 Acked Flush 0 Done Done Sent false
757 1204 Acked Read 8 Done Done Sent false
758 1205 Acked Read 5 Done Done Sent false
759 1206 Acked Read 7 Done Done Sent false
760 1207 Acked Read 1 Done Done Sent false
761 1208 Acked Write 6 Done Done Sent false
762 1209 Acked Read 4 Done Done Sent false
763 1210 Acked Read 7 Done Done Sent false
764 1211 Acked Read 4 Done Done Sent false
765 1212 Acked Read 3 Done Done Sent false
766 1213 Acked Read 4 Done Done Sent false
767 1214 Acked Read 2 Done Done Sent false
768 1215 Acked Write 9 Done Done Sent false
769 1216 Acked Write 7 Done Done Sent false
770 1217 Acked Write 1 Done Done Sent false
771 1218 Acked Write 2 Done Done Sent false
772 1219 Acked Read 10 Done Done Sent false
773 1220 Acked Read 1 Done Done Sent false
774 1221 Acked Read 10 Done Done Sent false
775 1222 Acked Read 6 Done Done Sent false
776 1223 Acked Write 10 Done Done Sent false
777 1224 Acked Flush 0 Done Done Sent false
778 1225 Acked Write 6 Done Done Sent false
779 1226 Acked Write 5 Done Done Sent false
780 1227 Acked Flush 0 Done Done Sent false
781 1228 Acked Read 4 Done Done Sent false
782 1229 Acked Read 6 Done Done Sent false
783 1230 Acked Read 3 Done Done Sent false
784 1231 Acked Read 3 Done Done Sent false
785 1232 Acked Read 1 Done Done Sent false
786 1233 Acked Read 2 Done Done Sent false
787 1234 Acked Read 3 Done Done Sent false
788 1235 Acked Read 2 Done Done Sent false
789 1236 Acked Read 7 Done Done Sent false
790 1237 Acked Read 1 Done Done Sent false
791 1238 Acked Read 8 Done Done Sent false
792 1239 Acked Write 3 Done Done Sent false
793 1240 Acked Read 8 Done Done Sent false
794 1241 Acked Read 2 Done Done Sent false
795 1242 Acked Read 2 Done Done Sent false
796 1243 Acked Read 3 Done Done Sent false
797 1244 Acked Write 10 Done Done Sent false
798 1245 Acked Flush 0 Done Done Sent false
799 1246 Acked Write 5 Done Done Sent false
800 1247 Acked Write 7 Done Done Sent false
801 1248 Acked Read 6 Done Done Sent false
802 1249 Acked Read 3 Done Done Sent false
803 1250 Acked Write 4 Done Done Sent false
804 1251 Acked Read 2 Done Done Sent false
805 1252 Acked Read 6 Done Done Sent false
806 1253 Acked Read 3 Done Done Sent false
807 1254 Acked Write 2 Done Done Sent false
808 1255 Acked Read 10 Done Done Sent false
809 1256 Acked Write 3 Done Done Sent false
810 1257 Acked Write 1 Done Done Sent false
811 1258 Acked Write 8 Done Done Sent false
812 1259 Acked Read 7 Done Done Sent false
813 1260 Acked Read 4 Done Done Sent false
814 1261 Acked Write 8 Done Done Sent false
815 1262 Acked Write 3 Done Done Sent false
816 1263 Acked Write 10 Done Done Sent false
817 1264 Acked Write 4 Done Done Sent false
818 1265 Acked Write 8 Done Done Sent false
819 1266 Acked Read 10 Done Done Sent false
820 1267 Acked Write 3 Done Done Sent false
821 1268 Acked Read 8 Done Done Sent false
822 1269 Acked Write 9 Done Done Sent false
823 1270 Acked Flush 0 Done Done Sent false
824 1271 Acked Write 6 Done Done Sent false
825 1272 Acked Write 5 Done Done Sent false
826 1273 Acked Flush 0 Done Done Sent false
827 1274 Acked Flush 0 Done Done Sent false
828 1275 Acked Write 1 Done Done Sent false
829 1276 Acked Read 1 Done Done Sent false
830 1277 Acked Flush 0 Done Done Sent false
831 1278 Acked Write 5 Done Done Sent false
832 1279 Acked Write 8 Done Done Sent false
833 1280 Acked Write 3 Done Done Sent false
834 1281 Acked Write 2 Done Done Sent false
835 1282 Acked Read 4 Done Done Sent false
836 1283 Acked Read 3 Done Done Sent false
837 1284 Acked Read 4 Done Done Sent false
838 1285 Acked Read 3 Done Done Sent false
839 1286 Acked Write 6 Done Done Sent false
840 1287 Acked Write 3 Done Done Sent false
841 1288 Acked Read 2 Done Done Sent false
842 1289 Acked Read 5 Done Done Sent false
843 1290 Acked Write 1 Done Done Sent false
844 1291 Acked Read 5 Done Done Sent false
845 1292 Acked Flush 0 Done Done Sent false
846 1293 Acked Read 6 Done Done Sent false
847 1294 Acked Read 10 Done Done Sent false
848 1295 Acked Flush 0 Done Done Sent false
849 1296 Acked Read 10 Done Done Sent false
850 1297 Acked Write 3 Done Done Sent false
851 1298 Acked Flush 0 Done Done Sent false
852 1299 Acked Write 8 Done Done Sent false
853 1300 Acked Flush 0 Done Done Sent false
854 STATES DS:0 DS:1 DS:2 TOTAL
855 Sent 0 0 301 301
856 Done 301 301 0 602
857 Skipped 0 0 0 0
858 Error 0 0 0 0
859 Last Flush: 1300 1300 0
860 Downstairs last five completed:
861 Upstairs last five completed: 1300 1299 1298 1297 1296
862 CLIENT: Up:0 ds:301 act:2
863 [8830] got start action
864 [8830] I am going to restart
865 Starting downstairs at port 8830
866 Make output file at "/tmp/dsc/downstairs-8830.txt"
867 [8830][2] reports Starting
868 Downstairs /var/tmp/dsc/region/8830 port 8830 PID:Some(1203)
869 [8830][2] reports Running
870 ----------------------------------------------------------------
871 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:301
872 States: Active Active Offline
873 JOBID ACK TYPE BKS/EXT DS:0 DS:1 DS:2 REPLAY
874 1000 Acked Write 6 Done Done Sent false
875 1001 Acked Write 8 Done Done Sent false
876 1002 Acked Write 3 Done Done Sent false
877 1003 Acked Write 8 Done Done Sent false
878 1004 Acked Flush 0 Done Done Sent false
879 1005 Acked Read 8 Done Done Sent false
880 1006 Acked Write 3 Done Done Sent false
881 1007 Acked Write 5 Done Done Sent false
882 1008 Acked Write 8 Done Done Sent false
883 1009 Acked Write 7 Done Done Sent false
884 1010 Acked Read 6 Done Done Sent false
885 1011 Acked Write 1 Done Done Sent false
886 1012 Acked Read 10 Done Done Sent false
887 1013 Acked Read 2 Done Done Sent false
888 1014 Acked Write 10 Done Done Sent false
889 1015 Acked Read 10 Done Done Sent false
890 1016 Acked Flush 0 Done Done Sent false
891 1017 Acked Write 1 Done Done Sent false
892 1018 Acked Read 3 Done Done Sent false
893 1019 Acked Read 5 Done Done Sent false
894 1020 Acked Read 1 Done Done Sent false
895 1021 Acked Read 8 Done Done Sent false
896 1022 Acked Read 6 Done Done Sent false
897 1023 Acked Flush 0 Done Done Sent false
898 1024 Acked Read 3 Done Done Sent false
899 1025 Acked Read 8 Done Done Sent false
900 1026 Acked Write 6 Done Done Sent false
901 1027 Acked Flush 0 Done Done Sent false
902 1028 Acked Write 4 Done Done Sent false
903 1029 Acked Read 9 Done Done Sent false
904 1030 Acked Read 4 Done Done Sent false
905 1031 Acked Read 7 Done Done Sent false
906 1032 Acked Read 7 Done Done Sent false
907 1033 Acked Write 10 Done Done Sent false
908 1034 Acked Write 2 Done Done Sent false
909 1035 Acked Flush 0 Done Done Sent false
910 1036 Acked Write 3 Done Done Sent false
911 1037 Acked Write 5 Done Done Sent false
912 1038 Acked Read 3 Done Done Sent false
913 1039 Acked Read 2 Done Done Sent false
914 1040 Acked Read 4 Done Done Sent false
915 1041 Acked Read 4 Done Done Sent false
916 1042 Acked Read 6 Done Done Sent false
917 1043 Acked Read 2 Done Done Sent false
918 1044 Acked Read 5 Done Done Sent false
919 1045 Acked Write 8 Done Done Sent false
920 1046 Acked Read 7 Done Done Sent false
921 1047 Acked Write 4 Done Done Sent false
922 1048 Acked Write 9 Done Done Sent false
923 1049 Acked Read 2 Done Done Sent false
924 1050 Acked Read 8 Done Done Sent false
925 1051 Acked Write 4 Done Done Sent false
926 1052 Acked Read 8 Done Done Sent false
927 1053 Acked Read 2 Done Done Sent false
928 1054 Acked Read 5 Done Done Sent false
929 1055 Acked Read 2 Done Done Sent false
930 1056 Acked Write 6 Done Done Sent false
931 1057 Acked Flush 0 Done Done Sent false
932 1058 Acked Write 6 Done Done Sent false
933 1059 Acked Read 4 Done Done Sent false
934 1060 Acked Write 1 Done Done Sent false
935 1061 Acked Write 4 Done Done Sent false
936 1062 Acked Write 9 Done Done Sent false
937 1063 Acked Write 3 Done Done Sent false
938 1064 Acked Flush 0 Done Done Sent false
939 1065 Acked Read 10 Done Done Sent false
940 1066 Acked Read 3 Done Done Sent false
941 1067 Acked Read 1 Done Done Sent false
942 1068 Acked Read 1 Done Done Sent false
943 1069 Acked Read 8 Done Done Sent false
944 1070 Acked Write 2 Done Done Sent false
945 1071 Acked Read 9 Done Done Sent false
946 1072 Acked Read 4 Done Done Sent false
947 1073 Acked Write 7 Done Done Sent false
948 1074 Acked Read 3 Done Done Sent false
949 1075 Acked Read 8 Done Done Sent false
950 1076 Acked Read 1 Done Done Sent false
951 1077 Acked Read 3 Done Done Sent false
952 1078 Acked Write 3 Done Done Sent false
953 1079 Acked Write 1 Done Done Sent false
954 1080 Acked Write 1 Done Done Sent false
955 1081 Acked Flush 0 Done Done Sent false
956 1082 Acked Flush 0 Done Done Sent false
957 1083 Acked Write 1 Done Done Sent false
958 1084 Acked Read 1 Done Done Sent false
959 1085 Acked Read 4 Done Done Sent false
960 1086 Acked Read 6 Done Done Sent false
961 1087 Acked Read 4 Done Done Sent false
962 1088 Acked Read 7 Done Done Sent false
963 1089 Acked Read 3 Done Done Sent false
964 1090 Acked Read 5 Done Done Sent false
965 1091 Acked Write 7 Done Done Sent false
966 1092 Acked Read 7 Done Done Sent false
967 1093 Acked Read 1 Done Done Sent false
968 1094 Acked Write 1 Done Done Sent false
969 1095 Acked Write 6 Done Done Sent false
970 1096 Acked Read 5 Done Done Sent false
971 1097 Acked Write 4 Done Done Sent false
972 1098 Acked Write 3 Done Done Sent false
973 1099 Acked Write 5 Done Done Sent false
974 1100 Acked Read 3 Done Done Sent false
975 1101 Acked Write 6 Done Done Sent false
976 1102 Acked Read 1 Done Done Sent false
977 1103 Acked Read 9 Done Done Sent false
978 1104 Acked Read 5 Done Done Sent false
979 1105 Acked Write 5 Done Done Sent false
980 1106 Acked Write 6 Done Done Sent false
981 1107 Acked Read 7 Done Done Sent false
982 1108 Acked Read 8 Done Done Sent false
983 1109 Acked Read 9 Done Done Sent false
984 1110 Acked Read 9 Done Done Sent false
985 1111 Acked Flush 0 Done Done Sent false
986 1112 Acked Read 2 Done Done Sent false
987 1113 Acked Read 4 Done Done Sent false
988 1114 Acked Read 9 Done Done Sent false
989 1115 Acked Write 8 Done Done Sent false
990 1116 Acked Read 2 Done Done Sent false
991 1117 Acked Write 8 Done Done Sent false
992 1118 Acked Read 7 Done Done Sent false
993 1119 Acked Flush 0 Done Done Sent false
994 1120 Acked Read 3 Done Done Sent false
995 1121 Acked Read 1 Done Done Sent false
996 1122 Acked Read 8 Done Done Sent false
997 1123 Acked Read 8 Done Done Sent false
998 1124 Acked Write 1 Done Done Sent false
999 1125 Acked Write 8 Done Done Sent false
1000 1126 Acked Read 5 Done Done Sent false
1001 1127 Acked Read 5 Done Done Sent false
1002 1128 Acked Read 4 Done Done Sent false
1003 1129 Acked Read 10 Done Done Sent false
1004 1130 Acked Read 9 Done Done Sent false
1005 1131 Acked Read 8 Done Done Sent false
1006 1132 Acked Read 5 Done Done Sent false
1007 1133 Acked Write 1 Done Done Sent false
1008 1134 Acked Read 5 Done Done Sent false
1009 1135 Acked Write 4 Done Done Sent false
1010 1136 Acked Write 3 Done Done Sent false
1011 1137 Acked Read 6 Done Done Sent false
1012 1138 Acked Read 10 Done Done Sent false
1013 1139 Acked Write 6 Done Done Sent false
1014 1140 Acked Write 5 Done Done Sent false
1015 1141 Acked Read 9 Done Done Sent false
1016 1142 Acked Flush 0 Done Done Sent false
1017 1143 Acked Write 8 Done Done Sent false
1018 1144 Acked Read 7 Done Done Sent false
1019 1145 Acked Write 10 Done Done Sent false
1020 1146 Acked Write 9 Done Done Sent false
1021 1147 Acked Read 5 Done Done Sent false
1022 1148 Acked Write 6 Done Done Sent false
1023 1149 Acked Read 7 Done Done Sent false
1024 1150 Acked Read 4 Done Done Sent false
1025 1151 Acked Read 2 Done Done Sent false
1026 1152 Acked Flush 0 Done Done Sent false
1027 1153 Acked Write 3 Done Done Sent false
1028 1154 Acked Read 1 Done Done Sent false
1029 1155 Acked Read 9 Done Done Sent false
1030 1156 Acked Flush 0 Done Done Sent false
1031 1157 Acked Read 5 Done Done Sent false
1032 1158 Acked Read 3 Done Done Sent false
1033 1159 Acked Read 3 Done Done Sent false
1034 1160 Acked Read 3 Done Done Sent false
1035 1161 Acked Flush 0 Done Done Sent false
1036 1162 Acked Write 8 Done Done Sent false
1037 1163 Acked Flush 0 Done Done Sent false
1038 1164 Acked Write 8 Done Done Sent false
1039 1165 Acked Write 5 Done Done Sent false
1040 1166 Acked Write 9 Done Done Sent false
1041 1167 Acked Write 8 Done Done Sent false
1042 1168 Acked Write 5 Done Done Sent false
1043 1169 Acked Flush 0 Done Done Sent false
1044 1170 Acked Read 10 Done Done Sent false
1045 1171 Acked Read 8 Done Done Sent false
1046 1172 Acked Write 5 Done Done Sent false
1047 1173 Acked Read 8 Done Done Sent false
1048 1174 Acked Read 5 Done Done Sent false
1049 1175 Acked Read 1 Done Done Sent false
1050 1176 Acked Write 9 Done Done Sent false
1051 1177 Acked Read 7 Done Done Sent false
1052 1178 Acked Read 9 Done Done Sent false
1053 1179 Acked Read 9 Done Done Sent false
1054 1180 Acked Write 2 Done Done Sent false
1055 1181 Acked Write 1 Done Done Sent false
1056 1182 Acked Read 10 Done Done Sent false
1057 1183 Acked Write 3 Done Done Sent false
1058 1184 Acked Write 2 Done Done Sent false
1059 1185 Acked Write 10 Done Done Sent false
1060 1186 Acked Write 3 Done Done Sent false
1061 1187 Acked Write 3 Done Done Sent false
1062 1188 Acked Flush 0 Done Done Sent false
1063 1189 Acked Write 2 Done Done Sent false
1064 1190 Acked Write 7 Done Done Sent false
1065 1191 Acked Read 9 Done Done Sent false
1066 1192 Acked Flush 0 Done Done Sent false
1067 1193 Acked Write 8 Done Done Sent false
1068 1194 Acked Write 3 Done Done Sent false
1069 1195 Acked Read 6 Done Done Sent false
1070 1196 Acked Write 10 Done Done Sent false
1071 1197 Acked Read 3 Done Done Sent false
1072 1198 Acked Read 9 Done Done Sent false
1073 1199 Acked Read 4 Done Done Sent false
1074 1200 Acked Read 4 Done Done Sent false
1075 1201 Acked Read 5 Done Done Sent false
1076 1202 Acked Read 8 Done Done Sent false
1077 1203 Acked Flush 0 Done Done Sent false
1078 1204 Acked Read 8 Done Done Sent false
1079 1205 Acked Read 5 Done Done Sent false
1080 1206 Acked Read 7 Done Done Sent false
1081 1207 Acked Read 1 Done Done Sent false
1082 1208 Acked Write 6 Done Done Sent false
1083 1209 Acked Read 4 Done Done Sent false
1084 1210 Acked Read 7 Done Done Sent false
1085 1211 Acked Read 4 Done Done Sent false
1086 1212 Acked Read 3 Done Done Sent false
1087 1213 Acked Read 4 Done Done Sent false
1088 1214 Acked Read 2 Done Done Sent false
1089 1215 Acked Write 9 Done Done Sent false
1090 1216 Acked Write 7 Done Done Sent false
1091 1217 Acked Write 1 Done Done Sent false
1092 1218 Acked Write 2 Done Done Sent false
1093 1219 Acked Read 10 Done Done Sent false
1094 1220 Acked Read 1 Done Done Sent false
1095 1221 Acked Read 10 Done Done Sent false
1096 1222 Acked Read 6 Done Done Sent false
1097 1223 Acked Write 10 Done Done Sent false
1098 1224 Acked Flush 0 Done Done Sent false
1099 1225 Acked Write 6 Done Done Sent false
1100 1226 Acked Write 5 Done Done Sent false
1101 1227 Acked Flush 0 Done Done Sent false
1102 1228 Acked Read 4 Done Done Sent false
1103 1229 Acked Read 6 Done Done Sent false
1104 1230 Acked Read 3 Done Done Sent false
1105 1231 Acked Read 3 Done Done Sent false
1106 1232 Acked Read 1 Done Done Sent false
1107 1233 Acked Read 2 Done Done Sent false
1108 1234 Acked Read 3 Done Done Sent false
1109 1235 Acked Read 2 Done Done Sent false
1110 1236 Acked Read 7 Done Done Sent false
1111 1237 Acked Read 1 Done Done Sent false
1112 1238 Acked Read 8 Done Done Sent false
1113 1239 Acked Write 3 Done Done Sent false
1114 1240 Acked Read 8 Done Done Sent false
1115 1241 Acked Read 2 Done Done Sent false
1116 1242 Acked Read 2 Done Done Sent false
1117 1243 Acked Read 3 Done Done Sent false
1118 1244 Acked Write 10 Done Done Sent false
1119 1245 Acked Flush 0 Done Done Sent false
1120 1246 Acked Write 5 Done Done Sent false
1121 1247 Acked Write 7 Done Done Sent false
1122 1248 Acked Read 6 Done Done Sent false
1123 1249 Acked Read 3 Done Done Sent false
1124 1250 Acked Write 4 Done Done Sent false
1125 1251 Acked Read 2 Done Done Sent false
1126 1252 Acked Read 6 Done Done Sent false
1127 1253 Acked Read 3 Done Done Sent false
1128 1254 Acked Write 2 Done Done Sent false
1129 1255 Acked Read 10 Done Done Sent false
1130 1256 Acked Write 3 Done Done Sent false
1131 1257 Acked Write 1 Done Done Sent false
1132 1258 Acked Write 8 Done Done Sent false
1133 1259 Acked Read 7 Done Done Sent false
1134 1260 Acked Read 4 Done Done Sent false
1135 1261 Acked Write 8 Done Done Sent false
1136 1262 Acked Write 3 Done Done Sent false
1137 1263 Acked Write 10 Done Done Sent false
1138 1264 Acked Write 4 Done Done Sent false
1139 1265 Acked Write 8 Done Done Sent false
1140 1266 Acked Read 10 Done Done Sent false
1141 1267 Acked Write 3 Done Done Sent false
1142 1268 Acked Read 8 Done Done Sent false
1143 1269 Acked Write 9 Done Done Sent false
1144 1270 Acked Flush 0 Done Done Sent false
1145 1271 Acked Write 6 Done Done Sent false
1146 1272 Acked Write 5 Done Done Sent false
1147 1273 Acked Flush 0 Done Done Sent false
1148 1274 Acked Flush 0 Done Done Sent false
1149 1275 Acked Write 1 Done Done Sent false
1150 1276 Acked Read 1 Done Done Sent false
1151 1277 Acked Flush 0 Done Done Sent false
1152 1278 Acked Write 5 Done Done Sent false
1153 1279 Acked Write 8 Done Done Sent false
1154 1280 Acked Write 3 Done Done Sent false
1155 1281 Acked Write 2 Done Done Sent false
1156 1282 Acked Read 4 Done Done Sent false
1157 1283 Acked Read 3 Done Done Sent false
1158 1284 Acked Read 4 Done Done Sent false
1159 1285 Acked Read 3 Done Done Sent false
1160 1286 Acked Write 6 Done Done Sent false
1161 1287 Acked Write 3 Done Done Sent false
1162 1288 Acked Read 2 Done Done Sent false
1163 1289 Acked Read 5 Done Done Sent false
1164 1290 Acked Write 1 Done Done Sent false
1165 1291 Acked Read 5 Done Done Sent false
1166 1292 Acked Flush 0 Done Done Sent false
1167 1293 Acked Read 6 Done Done Sent false
1168 1294 Acked Read 10 Done Done Sent false
1169 1295 Acked Flush 0 Done Done Sent false
1170 1296 Acked Read 10 Done Done Sent false
1171 1297 Acked Write 3 Done Done Sent false
1172 1298 Acked Flush 0 Done Done Sent false
1173 1299 Acked Write 8 Done Done Sent false
1174 1300 Acked Flush 0 Done Done Sent false
1175 STATES DS:0 DS:1 DS:2 TOTAL
1176 Sent 0 0 301 301
1177 Done 301 301 0 602
1178 Skipped 0 0 0 0
1179 Error 0 0 0 0
1180 Last Flush: 1300 1300 0
1181 Downstairs last five completed:
1182 Upstairs last five completed: 1300 1299 1298 1297 1296
1183 CLIENT: Up:0 ds:301 act:2
11842025-01-10T16:35:33.700ZINFOcrucible: connecting to 127.0.0.1:8830 = io task client = 2 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
11852025-01-10T16:35:33.700ZINFOcrucible: ds_connection connected from Ok(127.0.0.1:33378) = io task client = 2 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
11862025-01-10T16:35:33.701ZWARNcrucible: version negotiation from state Offline = downstairs client = 2 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
11872025-01-10T16:35:33.702ZINFOcrucible: downstairs client at Some(127.0.0.1:8830) has region UUID 12345678-0000-0000-0000-000000008830 = downstairs client = 2 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
11882025-01-10T16:35:33.702ZINFOcrucible: Returning UUID:12345678-0000-0000-0000-000000008830 matches = downstairs client = 2 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
11892025-01-10T16:35:33.702ZINFOcrucible: send last flush ID to this DS: 0 = downstairs client = 2 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
11902025-01-10T16:35:33.702ZINFOcrucible: Replied this last flush ID: 0 = downstairs client = 2 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
11912025-01-10T16:35:33.702ZINFOcrucible: ds_transition from Offline to Active = downstairs client = 2 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
11922025-01-10T16:35:33.702ZINFOcrucible: [2] Transition from Offline to Active = downstairs client = 2 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
11932025-01-10T16:35:33.702ZINFOcrucible: [2] client re-new 301 jobs since flush 0 = downstairs session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
11942025-01-10T16:35:33.702ZINFOcrucible: [2] Replayed 301 jobs since flush: 0 = downstairs session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
1195 ----------------------------------------------------------------
1196 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:0
1197 Downstairs last five completed: 1300 1299 1298 1297 1296
1198 Upstairs last five completed: 1300 1299 1298 1297 1296
1199 CLIENT: Up:0 ds:0 act:3
1200 Replay: All jobs finished
1201 Main task has work to do, go find it
1202 got dsc Stop(0)
1203 stop 0
1204 Jan 10 16:35:35.944 INFO request completed, latency_us:[8810] Got stop action so:false kr:false
1205 348, response_code: 204, uri: /stop/cid/0, method: POST, req_id: fadc9fde-a3dd-454b-9f81-8661268daf4d, remote_addr: 127.0.0.1:55917, local_addr: 127.0.0.1:9998
12062025-01-10T16:35:35.945ZWARNcrucible: downstairs disconnected = io task client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
12072025-01-10T16:35:35.945ZWARNcrucible: client task is sending Done(Finished) = io task client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
12082025-01-10T16:35:35.945ZWARNcrucible: downstairs task for 0 stopped due to Finished session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
12092025-01-10T16:35:35.945ZINFOcrucible: ds_transition from Active to Offline = downstairs client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
12102025-01-10T16:35:35.945ZINFOcrucible: [0] Transition from Active to Offline = downstairs client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
1211 Jan 10 16:35:35.945 INFO request completed, latency_us: 170, response_code: 200, uri:{"msg":"client task is exiting","v":0,"name":"crucible","level":30,"time":"2025-01-10T16:35:35.945345809Z","hostname":"w-01JH8H1N3KXZ9F8ZV6CCMP5KTQ","pid":1202,"":"io task","client":"0","":"downstairs","session_id":"1df3ca91-4dc9-42d6-9897-461254b5afe2"}
1212 /state/cid/0, method: GET, req_id: d1f849f4-044c-471e-8c30-432aa59bae0f, remote_addr: 127.0.0.1:55917, local_addr: 127.0.0.1:9998
1213 [8810] Exited with: ExitStatus(unix_wait_status(9))
1214 [8810][0] reports Exit
1215 Jan 10 16:35:39.947 INFO request completed, latency_us: 203, response_code: 200, uri: /state/cid/0, method: GET, req_id: c4ca4e77-2665-41b3-8d82-5519b658e863, remote_addr: 127.0.0.1:55917, local_addr: 127.0.0.1:9998
1216 001/300 Read block 4344 len 36864
1217 002/300 Read block 143 len 36864
1218 003/300 Write block 2842 len 24576 data: 2 2 2 2 2 2
1219 004/300 Write block 3587 len 12288 data: 2 2 2
1220 005/300 Write block 180 len 28672 data: 2 2 2 2 2 2 3
1221 006/300 Read block 4227 len 8192
1222 007/300 Read block 4331 len 40960
1223 008/300 Read block 1400 len 24576
1224 009/300 Read block 2284 len 20480
1225 010/300 Read block 2125 len 32768
1226 011/300 Read block 582 len 36864
1227 012/300 Read block 784 len 40960
1228 013/300 Read block 2875 len 32768
1229 014/300 Read block 191 len 16384
1230 015/300 Write block 394 len 12288 data: 2 2 2
1231 016/300 Read block 4880 len 12288
1232 017/300 Write block 2362 len 12288 data: 2 2 2
1233 018/300 Write block 4021 len 24576 data: 2 2 2 2 2 2
1234 019/300 Read block 2866 len 28672
1235 020/300 Read block 1977 len 32768
1236 021/300 Read block 2905 len 8192
1237 022/300 Read block 3738 len 32768
1238 023/300 Read block 2504 len 8192
1239 024/300 Write block 120 len 8192 data: 2 2
1240 025/300 Write block 1058 len 4096 data: 2
1241 026/300 Write block 1696 len 40960 data: 2 2 2 2 2 2 2 2 2 2
1242 027/300 Read block 2278 len 40960
1243 028/300 Write block 2052 len 16384 data: 2 2 2 2
1244 029/300 Read block 2394 len 36864
1245 030/300 Read block 4229 len 36864
1246 031/300 Write block 1533 len 8192 data: 2 2
1247 032/300 Write block 2117 len 28672 data: 2 2 2 2 2 2 2
1248 033/300 Write block 3778 len 16384 data: 2 2 2 2
1249 034/300 Flush
1250 035/300 Write block 2794 len 40960 data: 2 2 2 2 2 2 2 2 2 2
1251 036/300 Flush
1252 037/300 Read block 2307 len 40960
1253 038/300 Read block 3943 len 12288
1254 039/300 Read block 295 len 20480
1255 040/300 Read block 2487 len 8192
1256 041/300 Read block 1824 len 4096
1257 042/300 Write block 3941 len 24576 data: 2 2 2 2 2 2
1258 043/300 Write block 112 len 24576 data: 2 2 2 2 2 2
1259 044/300 Read block 851 len 4096
1260 045/300 Read block 2191 len 20480
1261 046/300 Read block 2343 len 28672
1262 047/300 Read block 248 len 24576
1263 048/300 Read block 3595 len 8192
1264 049/300 Write block 1555 len 16384 data: 2 2 2 2
1265 050/300 Read block 4996 len 4096
1266 051/300 Read block 3435 len 32768
1267 052/300 Write block 3654 len 20480 data: 4 2 2 2 2
1268 053/300 Read block 2325 len 32768
1269 054/300 Flush
1270 055/300 Read block 2931 len 32768
1271 056/300 Flush
1272 057/300 Read block 4493 len 4096
1273 058/300 Write block 2987 len 24576 data: 2 2 2 2 2 2
1274 059/300 Read block 2402 len 8192
1275 060/300 Write block 3774 len 28672 data: 2 2 2 2 3 3 3
1276 061/300 Write block 4416 len 36864 data: 2 2 2 2 2 2 2 2 2
1277 062/300 Flush
1278 063/300 Read block 764 len 12288
1279 064/300 Write block 2029 len 40960 data: 2 2 2 2 2 2 2 2 2 2
1280 065/300 Read block 1042 len 24576
1281 066/300 Read block 2736 len 40960
1282 067/300 Read block 3255 len 4096
1283 068/300 Flush
1284 069/300 Write block 1125 len 12288 data: 2 2 2
1285 070/300 Flush
1286 071/300 Read block 1821 len 12288
1287 072/300 Read block 3818 len 12288
1288 073/300 Write block 910 len 40960 data: 2 2 2 2 2 2 2 2 2 2
1289 074/300 Read block 2022 len 40960
1290 075/300 Write block 748 len 20480 data: 2 2 2 2 2
1291 076/300 Read block 283 len 12288
1292 077/300 Write block 528 len 40960 data: 2 2 2 2 2 2 2 2 2 2
1293 078/300 Read block 3061 len 12288
1294 079/300 Read block 3258 len 36864
1295 080/300 Read block 306 len 4096
1296 081/300 Write block 1595 len 16384 data: 2 2 2 2
1297 082/300 Read block 4332 len 12288
1298 083/300 Write block 549 len 8192 data: 2 2
1299 084/300 Read block 3859 len 16384
1300 085/300 Read block 338 len 40960
1301 086/300 Read block 1493 len 4096
1302 087/300 Write block 2508 len 28672 data: 3 3 2 2 2 2 2
1303 088/300 Read block 2028 len 24576
1304 089/300 Write block 1295 len 24576 data: 2 2 2 2 2 2
1305 090/300 Read block 1212 len 36864
1306 091/300 Read block 4170 len 36864
1307 092/300 Read block 4835 len 8192
1308 093/300 Read block 1329 len 8192
1309 094/300 Read block 4148 len 4096
1310 095/300 Write block 10 len 28672 data: 3 3 3 4 4 4 4
1311 096/300 Read block 1006 len 20480
1312 097/300 Read block 4427 len 32768
1313 098/300 Write block 3983 len 36864 data: 2 2 2 3 3 3 3 3 3
1314 099/300 Write block 4805 len 36864 data: 2 2 2 2 2 2 2 2 2
1315 100/300 Read block 4341 len 28672
1316 101/300 Write block 1464 len 36864 data: 2 2 2 2 2 2 2 2 2
1317 102/300 Read block 2759 len 28672
1318 103/300 Write block 3016 len 20480 data: 2 2 2 2 2
1319 104/300 Flush
1320 105/300 Read block 397 len 8192
1321 106/300 Read block 2607 len 28672
1322 107/300 Read block 2698 len 8192
1323 108/300 Read block 1264 len 28672
1324 109/300 Read block 1672 len 40960
1325 110/300 Read block 1636 len 28672
1326 111/300 Read block 3877 len 8192
1327 112/300 Write block 1022 len 32768 data: 2 2 2 2 2 2 2 2
1328 113/300 Read block 1527 len 40960
1329 114/300 Read block 1029 len 28672
1330 115/300 Write block 4427 len 36864 data: 2 2 2 2 2 2 2 2 2
1331 116/300 Write block 2510 len 40960 data: 3 3 3 3 3 2 2 2 2 2
1332 117/300 Read block 1159 len 4096
1333 118/300 Read block 4845 len 24576
1334 119/300 Read block 4224 len 40960
1335 120/300 Write block 2994 len 32768 data: 2 2 2 2 2 2 2 3
1336 121/300 Read block 1690 len 28672
1337 122/300 Write block 4295 len 16384 data: 2 2 2 2
1338 123/300 Read block 4755 len 16384
1339 124/300 Read block 2524 len 16384
1340 125/300 Write block 1993 len 16384 data: 2 2 2 2
1341 126/300 Read block 897 len 16384
1342 127/300 Read block 1005 len 40960
1343 128/300 Write block 4552 len 24576 data: 3 3 3 3 3 2
1344 129/300 Read block 1293 len 8192
1345 130/300 Read block 123 len 4096
1346 131/300 Read block 4859 len 36864
1347 132/300 Read block 2524 len 20480
1348 133/300 Write block 1670 len 24576 data: 2 2 2 2 2 2
1349 134/300 Read block 1008 len 8192
1350 135/300 Write block 302 len 36864 data: 2 2 2 2 2 2 2 2 2
1351 136/300 Write block 4556 len 28672 data: 4 3 2 2 2 2 2
1352 137/300 Read block 3760 len 28672
1353 138/300 Read block 161 len 12288
1354 139/300 Read block 1967 len 28672
1355 140/300 Read block 1473 len 20480
1356 141/300 Read block 1009 len 8192
1357 142/300 Write block 4435 len 36864 data: 3 2 2 2 2 2 2 2 2
1358 143/300 Read block 3318 len 28672
1359 144/300 Read block 1389 len 36864
1360 145/300 Write block 2464 len 12288 data: 2 2 2
1361 146/300 Read block 597 len 4096
1362 147/300 Read block 4666 len 24576
1363 148/300 Flush
1364 149/300 Write block 1723 len 8192 data: 2 2
1365 150/300 Write block 4752 len 32768 data: 2 2 2 2 2 2 2 2
1366 151/300 Read block 1453 len 32768
1367 152/300 Read block 2212 len 36864
1368 153/300 Write block 558 len 40960 data: 2 2 2 2 2 2 2 2 2 2
1369 154/300 Read block 613 len 24576
1370 155/300 Write block 679 len 24576 data: 3 3 3 3 3 4
1371 156/300 Read block 4710 len 28672
1372 157/300 Read block 2301 len 36864
1373 158/300 Read block 4921 len 16384
1374 159/300 Write block 3988 len 36864 data: 4 4 4 4 3 3 2 2 2
1375 160/300 Write block 4196 len 40960 data: 2 2 2 2 2 2 2 2 2 2
1376 161/300 Read block 993 len 28672
1377 162/300 Flush
1378 163/300 Write block 1677 len 40960 data: 2 2 2 2 2 2 2 2 2 2
1379 164/300 Write block 2898 len 28672 data: 2 2 2 2 2 2 2
1380 165/300 Read block 4755 len 40960
1381 166/300 Flush
1382 167/300 Write block 1471 len 40960 data: 3 3 2 2 2 2 2 2 2 2
1383 168/300 Read block 235 len 36864
1384 169/300 Write block 923 len 36864 data: 2 2 2 2 2 2 2 2 2
1385 170/300 Read block 2140 len 28672
1386 171/300 Read block 2194 len 40960
1387 172/300 Read block 3969 len 20480
1388 173/300 Read block 4553 len 40960
1389 174/300 Read block 3437 len 20480
1390 175/300 Write block 977 len 36864 data: 3 3 4 4 4 3 3 3 3
1391 176/300 Flush
1392 177/300 Write block 1179 len 16384 data: 2 2 2 2
1393 178/300 Read block 1320 len 36864
1394 179/300 Read block 4206 len 8192
1395 180/300 Read block 269 len 4096
1396 181/300 Write block 1607 len 28672 data: 2 2 2 2 2 2 2
1397 182/300 Flush
1398 183/300 Write block 772 len 28672 data: 3 3 3 3 2 2 2
1399 184/300 Write block 3709 len 32768 data: 2 2 2 2 2 2 2 2
1400 185/300 Read block 805 len 8192
1401 186/300 Read block 532 len 20480
1402 187/300 Write block 4814 len 24576 data: 2 2 2 2 2 2
1403 188/300 Read block 1379 len 8192
1404 189/300 Write block 4370 len 36864 data: 2 2 2 2 2 2 2 2 2
1405 190/300 Write block 1273 len 12288 data: 2 2 2
1406 191/300 Read block 4289 len 40960
1407 192/300 Flush
1408 193/300 Write block 992 len 24576 data: 2 2 2 2 2 2
1409 194/300 Read block 215 len 4096
1410 195/300 Read block 1007 len 24576
1411 196/300 Flush
1412 197/300 Read block 4806 len 20480
1413 198/300 Write block 282 len 8192 data: 2 2
1414 199/300 Read block 2344 len 36864
1415 200/300 Read block 569 len 40960
1416 201/300 Write block 2942 len 24576 data: 2 2 2 2 2 2
1417 202/300 Flush
1418 203/300 Read block 2911 len 16384
1419 204/300 Read block 4284 len 12288
1420 205/300 Read block 2244 len 28672
1421 206/300 Flush
1422 207/300 Flush
1423 208/300 Write block 786 len 36864 data: 2 2 2 2 2 2 2 2 2
1424 209/300 Read block 4815 len 36864
1425 210/300 Flush
1426 211/300 Read block 4537 len 24576
1427 212/300 Write block 2897 len 4096 data: 2
1428 213/300 Read block 4459 len 20480
1429 214/300 Flush
1430 215/300 Read block 1347 len 32768
1431 216/300 Read block 2280 len 40960
1432 217/300 Write block 985 len 16384 data: 4 3 3 2
1433 218/300 Write block 1117 len 40960 data: 2 2 2 2 2 2 2 2 3 3
1434 219/300 Write block 184 len 28672 data: 3 3 4 3 3 2 2
1435 220/300 Flush
1436 221/300 Write block 2243 len 36864 data: 2 2 2 2 3 4 4 3 3
1437 222/300 Read block 3860 len 40960
1438 223/300 Read block 4969 len 12288
1439 224/300 Write block 918 len 20480 data: 3 3 2 2 2
1440 225/300 Read block 3283 len 24576
1441 226/300 Flush
1442 227/300 Read block 1219 len 16384
1443 228/300 Write block 4570 len 12288 data: 2 2 2
1444 229/300 Write block 2889 len 16384 data: 2 2 2 2
1445 230/300 Write block 1221 len 20480 data: 3 2 2 2 2
1446 231/300 Read block 1673 len 12288
1447 232/300 Write block 2944 len 20480 data: 3 3 3 3 2
1448 233/300 Write block 4837 len 36864 data: 2 2 2 2 2 2 2 2 2
1449 234/300 Flush
1450 235/300 Write block 4432 len 12288 data: 3 3 3
1451 236/300 Read block 896 len 36864
1452 237/300 Read block 4031 len 12288
1453 238/300 Write block 701 len 24576 data: 3 3 3 3 4 5
1454 239/300 Read block 3877 len 40960
1455 240/300 Flush
1456 241/300 Write block 3145 len 36864 data: 2 2 2 2 2 2 2 2 2
1457 242/300 Read block 2237 len 32768
1458 243/300 Write block 1227 len 24576 data: 2 2 2 2 3 2
1459 244/300 Read block 1235 len 8192
1460 245/300 Flush
1461 246/300 Write block 764 len 12288 data: 3 3 3
1462 247/300 Read block 737 len 40960
1463 248/300 Write block 3403 len 8192 data: 2 2
1464 249/300 Read block 312 len 4096
1465 250/300 Read block 2269 len 20480
1466 251/300 Write block 362 len 40960 data: 2 2 2 2 2 2 2 2 2 2
1467 252/300 Flush
1468 253/300 Read block 817 len 28672
1469 254/300 Read block 888 len 16384
1470 255/300 Write block 605 len 12288 data: 3 3 3
1471 256/300 Write block 2018 len 20480 data: 2 2 2 2 2
1472 257/300 Read block 1777 len 8192
1473 258/300 Write block 1600 len 12288 data: 2 2 2
1474 259/300 Read block 2169 len 16384
1475 260/300 Read block 714 len 4096
1476 261/300 Read block 4897 len 8192
1477 262/300 Read block 3982 len 20480
1478 263/300 Read block 612 len 20480
1479 264/300 Read block 3361 len 16384
1480 265/300 Read block 670 len 12288
1481 266/300 Write block 4434 len 32768 data: 4 4 3 3 3 3 3 3
1482 267/300 Write block 929 len 24576 data: 3 3 3 2 2 2
1483 268/300 Flush
1484 269/300 Write block 4763 len 8192 data: 3 2
1485 270/300 Read block 4340 len 32768
1486 271/300 Read block 4807 len 32768
1487 272/300 Write block 1547 len 12288 data: 3 2 2
1488 273/300 Read block 236 len 40960
1489 274/300 Read block 380 len 4096
1490 275/300 Read block 3872 len 24576
1491 276/300 Read block 3941 len 8192
1492 277/300 Read block 2397 len 16384
1493 278/300 Write block 1907 len 40960 data: 2 2 2 2 2 2 2 2 2 2
1494 279/300 Write block 4066 len 24576 data: 2 2 2 2 2 2
1495 280/300 Read block 4042 len 4096
1496 281/300 Read block 1720 len 20480
1497 282/300 Write block 2633 len 40960 data: 2 2 3 3 3 3 3 3 3 3
1498 283/300 Read block 4587 len 20480
1499 284/300 Write block 4165 len 4096 data: 2
1500 285/300 Read block 4900 len 40960
1501 286/300 Read block 2286 len 24576
1502 287/300 Read block 1689 len 20480
1503 288/300 Write block 990 len 24576 data: 2 2 3 3 3 3
1504 289/300 Write block 126 len 8192 data: 2 2
1505 290/300 Write block 3265 len 32768 data: 2 2 2 2 2 2 2 2
1506 291/300 Write block 28 len 24576 data: 3 2 2 2 2 2
1507 292/300 Flush
1508 293/300 Read block 408 len 24576
1509 294/300 Read block 3408 len 12288
1510 295/300 Write block 3521 len 40960 data: 2 2 2 2 2 2 2 2 2 2
1511 296/300 Read block 630 len 12288
1512 297/300 Write block 1382 len 16384 data: 2 2 2 2
1513 298/300 Write block 2684 len 16384 data: 2 2 2 2
1514 299/300 Write block 1060 len 32768 data: 2 2 2 2 2 2 2 2
1515 300/300 Flush
1516 301/300 Read block 2591 len 36864
1517 Main task has work to do, go find it
1518 got dsc Start(0)
1519 start 0
1520 Jan 10 16:35:40.201 INFO request completed, latency_us: 203, response_code: 204, uri: /start/cid/0, method: POST, req_id: 0917cb67-601d-4aef-801a-b043dd942edb, remote_addr: 127.0.0.1:55917, local_addr: 127.0.0.1:9998
1521 Replay: started 0, returned:Ok(())
1522 ----------------------------------------------------------------
1523 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:301
1524 States: Offline Active Active
1525 JOBID ACK TYPE BKS/EXT DS:0 DS:1 DS:2 REPLAY
1526 1301 Acked Read 9 Sent Done Done false
1527 1302 Acked Read 9 Sent Done Done false
1528 1303 Acked Write 6 Sent Done Done false
1529 1304 Acked Write 3 Sent Done Done false
1530 1305 Acked Write 7 Sent Done Done false
1531 1306 Acked Read 2 Sent Done Done false
1532 1307 Acked Read 10 Sent Done Done false
1533 1308 Acked Read 6 Sent Done Done false
1534 1309 Acked Read 5 Sent Done Done false
1535 1310 Acked Read 8 Sent Done Done false
1536 1311 Acked Read 9 Sent Done Done false
1537 1312 Acked Read 10 Sent Done Done false
1538 1313 Acked Read 8 Sent Done Done false
1539 1314 Acked Read 4 Sent Done Done false
1540 1315 Acked Write 3 Sent Done Done false
1541 1316 Acked Read 3 Sent Done Done false
1542 1317 Acked Write 3 Sent Done Done false
1543 1318 Acked Write 6 Sent Done Done false
1544 1319 Acked Read 7 Sent Done Done false
1545 1320 Acked Read 8 Sent Done Done false
1546 1321 Acked Read 2 Sent Done Done false
1547 1322 Acked Read 8 Sent Done Done false
1548 1323 Acked Read 2 Sent Done Done false
1549 1324 Acked Write 2 Sent Done Done false
1550 1325 Acked Write 1 Sent Done Done false
1551 1326 Acked Write 10 Sent Done Done false
1552 1327 Acked Read 10 Sent Done Done false
1553 1328 Acked Write 4 Sent Done Done false
1554 1329 Acked Read 9 Sent Done Done false
1555 1330 Acked Read 9 Sent Done Done false
1556 1331 Acked Write 2 Sent Done Done false
1557 1332 Acked Write 7 Sent Done Done false
1558 1333 Acked Write 4 Sent Done Done false
1559 1334 Acked Flush 0 Sent Done Done false
1560 1335 Acked Write 10 Sent Done Done false
1561 1336 Acked Flush 0 Sent Done Done false
1562 1337 Acked Read 10 Sent Done Done false
1563 1338 Acked Read 3 Sent Done Done false
1564 1339 Acked Read 5 Sent Done Done false
1565 1340 Acked Read 2 Sent Done Done false
1566 1341 Acked Read 1 Sent Done Done false
1567 1342 Acked Write 6 Sent Done Done false
1568 1343 Acked Write 6 Sent Done Done false
1569 1344 Acked Read 1 Sent Done Done false
1570 1345 Acked Read 5 Sent Done Done false
1571 1346 Acked Read 7 Sent Done Done false
1572 1347 Acked Read 6 Sent Done Done false
1573 1348 Acked Read 2 Sent Done Done false
1574 1349 Acked Write 4 Sent Done Done false
1575 1350 Acked Read 1 Sent Done Done false
1576 1351 Acked Read 8 Sent Done Done false
1577 1352 Acked Write 5 Sent Done Done false
1578 1353 Acked Read 8 Sent Done Done false
1579 1354 Acked Flush 0 Sent Done Done false
1580 1355 Acked Read 8 Sent Done Done false
1581 1356 Acked Flush 0 Sent Done Done false
1582 1357 Acked Read 1 Sent Done Done false
1583 1358 Acked Write 6 Sent Done Done false
1584 1359 Acked Read 2 Sent Done Done false
1585 1360 Acked Write 7 Sent Done Done false
1586 1361 Acked Write 9 Sent Done Done false
1587 1362 Acked Flush 0 Sent Done Done false
1588 1363 Acked Read 3 Sent Done Done false
1589 1364 Acked Write 10 Sent Done Done false
1590 1365 Acked Read 6 Sent Done Done false
1591 1366 Acked Read 10 Sent Done Done false
1592 1367 Acked Read 1 Sent Done Done false
1593 1368 Acked Flush 0 Sent Done Done false
1594 1369 Acked Write 3 Sent Done Done false
1595 1370 Acked Flush 0 Sent Done Done false
1596 1371 Acked Read 3 Sent Done Done false
1597 1372 Acked Read 3 Sent Done Done false
1598 1373 Acked Write 10 Sent Done Done false
1599 1374 Acked Read 10 Sent Done Done false
1600 1375 Acked Write 5 Sent Done Done false
1601 1376 Acked Read 3 Sent Done Done false
1602 1377 Acked Write 10 Sent Done Done false
1603 1378 Acked Read 3 Sent Done Done false
1604 1379 Acked Read 9 Sent Done Done false
1605 1380 Acked Read 1 Sent Done Done false
1606 1381 Acked Write 4 Sent Done Done false
1607 1382 Acked Read 3 Sent Done Done false
1608 1383 Acked Write 2 Sent Done Done false
1609 1384 Acked Read 4 Sent Done Done false
1610 1385 Acked Read 10 Sent Done Done false
1611 1386 Acked Read 1 Sent Done Done false
1612 1387 Acked Write 7 Sent Done Done false
1613 1388 Acked Read 6 Sent Done Done false
1614 1389 Acked Write 6 Sent Done Done false
1615 1390 Acked Read 9 Sent Done Done false
1616 1391 Acked Read 9 Sent Done Done false
1617 1392 Acked Read 2 Sent Done Done false
1618 1393 Acked Read 2 Sent Done Done false
1619 1394 Acked Read 1 Sent Done Done false
1620 1395 Acked Write 7 Sent Done Done false
1621 1396 Acked Read 5 Sent Done Done false
1622 1397 Acked Read 8 Sent Done Done false
1623 1398 Acked Write 9 Sent Done Done false
1624 1399 Acked Write 9 Sent Done Done false
1625 1400 Acked Read 7 Sent Done Done false
1626 1401 Acked Write 9 Sent Done Done false
1627 1402 Acked Read 7 Sent Done Done false
1628 1403 Acked Write 5 Sent Done Done false
1629 1404 Acked Flush 0 Sent Done Done false
1630 1405 Acked Read 2 Sent Done Done false
1631 1406 Acked Read 7 Sent Done Done false
1632 1407 Acked Read 2 Sent Done Done false
1633 1408 Acked Read 7 Sent Done Done false
1634 1409 Acked Read 10 Sent Done Done false
1635 1410 Acked Read 7 Sent Done Done false
1636 1411 Acked Read 2 Sent Done Done false
1637 1412 Acked Write 8 Sent Done Done false
1638 1413 Acked Read 10 Sent Done Done false
1639 1414 Acked Read 7 Sent Done Done false
1640 1415 Acked Write 9 Sent Done Done false
1641 1416 Acked Write 10 Sent Done Done false
1642 1417 Acked Read 1 Sent Done Done false
1643 1418 Acked Read 6 Sent Done Done false
1644 1419 Acked Read 10 Sent Done Done false
1645 1420 Acked Write 8 Sent Done Done false
1646 1421 Acked Read 7 Sent Done Done false
1647 1422 Acked Write 4 Sent Done Done false
1648 1423 Acked Read 4 Sent Done Done false
1649 1424 Acked Read 4 Sent Done Done false
1650 1425 Acked Write 4 Sent Done Done false
1651 1426 Acked Read 4 Sent Done Done false
1652 1427 Acked Read 10 Sent Done Done false
1653 1428 Acked Write 6 Sent Done Done false
1654 1429 Acked Read 2 Sent Done Done false
1655 1430 Acked Read 1 Sent Done Done false
1656 1431 Acked Read 9 Sent Done Done false
1657 1432 Acked Read 5 Sent Done Done false
1658 1433 Acked Write 6 Sent Done Done false
1659 1434 Acked Read 2 Sent Done Done false
1660 1435 Acked Write 9 Sent Done Done false
1661 1436 Acked Write 7 Sent Done Done false
1662 1437 Acked Read 7 Sent Done Done false
1663 1438 Acked Read 3 Sent Done Done false
1664 1439 Acked Read 7 Sent Done Done false
1665 1440 Acked Read 5 Sent Done Done false
1666 1441 Acked Read 2 Sent Done Done false
1667 1442 Acked Write 9 Sent Done Done false
1668 1443 Acked Read 7 Sent Done Done false
1669 1444 Acked Read 9 Sent Done Done false
1670 1445 Acked Write 3 Sent Done Done false
1671 1446 Acked Read 1 Sent Done Done false
1672 1447 Acked Read 6 Sent Done Done false
1673 1448 Acked Flush 0 Sent Done Done false
1674 1449 Acked Write 2 Sent Done Done false
1675 1450 Acked Write 8 Sent Done Done false
1676 1451 Acked Read 8 Sent Done Done false
1677 1452 Acked Read 9 Sent Done Done false
1678 1453 Acked Write 10 Sent Done Done false
1679 1454 Acked Read 6 Sent Done Done false
1680 1455 Acked Write 6 Sent Done Done false
1681 1456 Acked Read 7 Sent Done Done false
1682 1457 Acked Read 9 Sent Done Done false
1683 1458 Acked Read 4 Sent Done Done false
1684 1459 Acked Write 9 Sent Done Done false
1685 1460 Acked Write 10 Sent Done Done false
1686 1461 Acked Read 7 Sent Done Done false
1687 1462 Acked Flush 0 Sent Done Done false
1688 1463 Acked Write 10 Sent Done Done false
1689 1464 Acked Write 7 Sent Done Done false
1690 1465 Acked Read 10 Sent Done Done false
1691 1466 Acked Flush 0 Sent Done Done false
1692 1467 Acked Write 10 Sent Done Done false
1693 1468 Acked Read 9 Sent Done Done false
1694 1469 Acked Write 9 Sent Done Done false
1695 1470 Acked Read 7 Sent Done Done false
1696 1471 Acked Read 10 Sent Done Done false
1697 1472 Acked Read 5 Sent Done Done false
1698 1473 Acked Read 10 Sent Done Done false
1699 1474 Acked Read 5 Sent Done Done false
1700 1475 Acked Write 9 Sent Done Done false
1701 1476 Acked Flush 0 Sent Done Done false
1702 1477 Acked Write 4 Sent Done Done false
1703 1478 Acked Read 9 Sent Done Done false
1704 1479 Acked Read 2 Sent Done Done false
1705 1480 Acked Read 1 Sent Done Done false
1706 1481 Acked Write 7 Sent Done Done false
1707 1482 Acked Flush 0 Sent Done Done false
1708 1483 Acked Write 7 Sent Done Done false
1709 1484 Acked Write 8 Sent Done Done false
1710 1485 Acked Read 2 Sent Done Done false
1711 1486 Acked Read 5 Sent Done Done false
1712 1487 Acked Write 6 Sent Done Done false
1713 1488 Acked Read 2 Sent Done Done false
1714 1489 Acked Write 9 Sent Done Done false
1715 1490 Acked Write 3 Sent Done Done false
1716 1491 Acked Read 10 Sent Done Done false
1717 1492 Acked Flush 0 Sent Done Done false
1718 1493 Acked Write 6 Sent Done Done false
1719 1494 Acked Read 1 Sent Done Done false
1720 1495 Acked Read 6 Sent Done Done false
1721 1496 Acked Flush 0 Sent Done Done false
1722 1497 Acked Read 5 Sent Done Done false
1723 1498 Acked Write 2 Sent Done Done false
1724 1499 Acked Read 9 Sent Done Done false
1725 1500 Acked Read 10 Sent Done Done false
1726 1501 Acked Write 6 Sent Done Done false
1727 1502 Acked Flush 0 Sent Done Done false
1728 1503 Acked Read 4 Sent Done Done false
1729 1504 Acked Read 3 Sent Done Done false
1730 1505 Acked Read 7 Sent Done Done false
1731 1506 Acked Flush 0 Sent Done Done false
1732 1507 Acked Flush 0 Sent Done Done false
1733 1508 Acked Write 9 Sent Done Done false
1734 1509 Acked Read 9 Sent Done Done false
1735 1510 Acked Flush 0 Sent Done Done false
1736 1511 Acked Read 6 Sent Done Done false
1737 1512 Acked Write 1 Sent Done Done false
1738 1513 Acked Read 5 Sent Done Done false
1739 1514 Acked Flush 0 Sent Done Done false
1740 1515 Acked Read 8 Sent Done Done false
1741 1516 Acked Read 10 Sent Done Done false
1742 1517 Acked Write 4 Sent Done Done false
1743 1518 Acked Write 10 Sent Done Done false
1744 1519 Acked Write 7 Sent Done Done false
1745 1520 Acked Flush 0 Sent Done Done false
1746 1521 Acked Write 9 Sent Done Done false
1747 1522 Acked Read 10 Sent Done Done false
1748 1523 Acked Read 3 Sent Done Done false
1749 1524 Acked Write 5 Sent Done Done false
1750 1525 Acked Read 6 Sent Done Done false
1751 1526 Acked Flush 0 Sent Done Done false
1752 1527 Acked Read 4 Sent Done Done false
1753 1528 Acked Write 3 Sent Done Done false
1754 1529 Acked Write 4 Sent Done Done false
1755 1530 Acked Write 5 Sent Done Done false
1756 1531 Acked Read 3 Sent Done Done false
1757 1532 Acked Write 5 Sent Done Done false
1758 1533 Acked Write 9 Sent Done Done false
1759 1534 Acked Flush 0 Sent Done Done false
1760 1535 Acked Write 3 Sent Done Done false
1761 1536 Acked Read 9 Sent Done Done false
1762 1537 Acked Read 3 Sent Done Done false
1763 1538 Acked Write 6 Sent Done Done false
1764 1539 Acked Read 10 Sent Done Done false
1765 1540 Acked Flush 0 Sent Done Done false
1766 1541 Acked Write 9 Sent Done Done false
1767 1542 Acked Read 8 Sent Done Done false
1768 1543 Acked Write 6 Sent Done Done false
1769 1544 Acked Read 2 Sent Done Done false
1770 1545 Acked Flush 0 Sent Done Done false
1771 1546 Acked Write 3 Sent Done Done false
1772 1547 Acked Read 10 Sent Done Done false
1773 1548 Acked Write 2 Sent Done Done false
1774 1549 Acked Read 1 Sent Done Done false
1775 1550 Acked Read 5 Sent Done Done false
1776 1551 Acked Write 10 Sent Done Done false
1777 1552 Acked Flush 0 Sent Done Done false
1778 1553 Acked Read 7 Sent Done Done false
1779 1554 Acked Read 4 Sent Done Done false
1780 1555 Acked Write 3 Sent Done Done false
1781 1556 Acked Write 5 Sent Done Done false
1782 1557 Acked Read 2 Sent Done Done false
1783 1558 Acked Write 3 Sent Done Done false
1784 1559 Acked Read 4 Sent Done Done false
1785 1560 Acked Read 1 Sent Done Done false
1786 1561 Acked Read 2 Sent Done Done false
1787 1562 Acked Read 5 Sent Done Done false
1788 1563 Acked Read 5 Sent Done Done false
1789 1564 Acked Read 4 Sent Done Done false
1790 1565 Acked Read 3 Sent Done Done false
1791 1566 Acked Write 8 Sent Done Done false
1792 1567 Acked Write 6 Sent Done Done false
1793 1568 Acked Flush 0 Sent Done Done false
1794 1569 Acked Write 2 Sent Done Done false
1795 1570 Acked Read 8 Sent Done Done false
1796 1571 Acked Read 8 Sent Done Done false
1797 1572 Acked Write 3 Sent Done Done false
1798 1573 Acked Read 10 Sent Done Done false
1799 1574 Acked Read 1 Sent Done Done false
1800 1575 Acked Read 6 Sent Done Done false
1801 1576 Acked Read 2 Sent Done Done false
1802 1577 Acked Read 4 Sent Done Done false
1803 1578 Acked Write 10 Sent Done Done false
1804 1579 Acked Write 6 Sent Done Done false
1805 1580 Acked Read 1 Sent Done Done false
1806 1581 Acked Read 5 Sent Done Done false
1807 1582 Acked Write 10 Sent Done Done false
1808 1583 Acked Read 5 Sent Done Done false
1809 1584 Acked Write 1 Sent Done Done false
1810 1585 Acked Read 10 Sent Done Done false
1811 1586 Acked Read 6 Sent Done Done false
1812 1587 Acked Read 5 Sent Done Done false
1813 1588 Acked Write 6 Sent Done Done false
1814 1589 Acked Write 2 Sent Done Done false
1815 1590 Acked Write 8 Sent Done Done false
1816 1591 Acked Write 6 Sent Done Done false
1817 1592 Acked Flush 0 Sent Done Done false
1818 1593 Acked Read 6 Sent Done Done false
1819 1594 Acked Read 3 Sent Done Done false
1820 1595 Acked Write 10 Sent Done Done false
1821 1596 Acked Read 3 Sent Done Done false
1822 1597 Acked Write 4 Sent Done Done false
1823 1598 Acked Write 4 Sent Done Done false
1824 1599 Acked Write 8 Sent Done Done false
1825 1600 Acked Flush 0 Sent Done Done false
1826 1601 Acked Read 9 Sent Done Done false
1827 STATES DS:0 DS:1 DS:2 TOTAL
1828 Sent 301 0 0 301
1829 Done 0 301 301 602
1830 Skipped 0 0 0 0
1831 Error 0 0 0 0
1832 Last Flush: 1300 1600 1600
1833 Downstairs last five completed: 1300 1299 1298 1297 1296
1834 Upstairs last five completed: 1601 1600 1599 1598 1597
1835 CLIENT: Up:0 ds:301 act:2
1836 [8810] got start action
1837 [8810] I am going to restart
1838 Starting downstairs at port 8810
1839 Make output file at "/tmp/dsc/downstairs-8810.txt"
1840 [8810][0] reports Starting
1841 Downstairs /var/tmp/dsc/region/8810 port 8810 PID:Some(1204)
1842 [8810][0] reports Running
1843 ----------------------------------------------------------------
1844 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:302
1845 States: Offline Active Active
1846 JOBID ACK TYPE BKS/EXT DS:0 DS:1 DS:2 REPLAY
1847 1301 Acked Read 9 Sent Done Done false
1848 1302 Acked Read 9 Sent Done Done false
1849 1303 Acked Write 6 Sent Done Done false
1850 1304 Acked Write 3 Sent Done Done false
1851 1305 Acked Write 7 Sent Done Done false
1852 1306 Acked Read 2 Sent Done Done false
1853 1307 Acked Read 10 Sent Done Done false
1854 1308 Acked Read 6 Sent Done Done false
1855 1309 Acked Read 5 Sent Done Done false
1856 1310 Acked Read 8 Sent Done Done false
1857 1311 Acked Read 9 Sent Done Done false
1858 1312 Acked Read 10 Sent Done Done false
1859 1313 Acked Read 8 Sent Done Done false
1860 1314 Acked Read 4 Sent Done Done false
1861 1315 Acked Write 3 Sent Done Done false
1862 1316 Acked Read 3 Sent Done Done false
1863 1317 Acked Write 3 Sent Done Done false
1864 1318 Acked Write 6 Sent Done Done false
1865 1319 Acked Read 7 Sent Done Done false
1866 1320 Acked Read 8 Sent Done Done false
1867 1321 Acked Read 2 Sent Done Done false
1868 1322 Acked Read 8 Sent Done Done false
1869 1323 Acked Read 2 Sent Done Done false
1870 1324 Acked Write 2 Sent Done Done false
1871 1325 Acked Write 1 Sent Done Done false
1872 1326 Acked Write 10 Sent Done Done false
1873 1327 Acked Read 10 Sent Done Done false
1874 1328 Acked Write 4 Sent Done Done false
1875 1329 Acked Read 9 Sent Done Done false
1876 1330 Acked Read 9 Sent Done Done false
1877 1331 Acked Write 2 Sent Done Done false
1878 1332 Acked Write 7 Sent Done Done false
1879 1333 Acked Write 4 Sent Done Done false
1880 1334 Acked Flush 0 Sent Done Done false
1881 1335 Acked Write 10 Sent Done Done false
1882 1336 Acked Flush 0 Sent Done Done false
1883 1337 Acked Read 10 Sent Done Done false
1884 1338 Acked Read 3 Sent Done Done false
1885 1339 Acked Read 5 Sent Done Done false
1886 1340 Acked Read 2 Sent Done Done false
1887 1341 Acked Read 1 Sent Done Done false
1888 1342 Acked Write 6 Sent Done Done false
1889 1343 Acked Write 6 Sent Done Done false
1890 1344 Acked Read 1 Sent Done Done false
1891 1345 Acked Read 5 Sent Done Done false
1892 1346 Acked Read 7 Sent Done Done false
1893 1347 Acked Read 6 Sent Done Done false
1894 1348 Acked Read 2 Sent Done Done false
1895 1349 Acked Write 4 Sent Done Done false
1896 1350 Acked Read 1 Sent Done Done false
1897 1351 Acked Read 8 Sent Done Done false
1898 1352 Acked Write 5 Sent Done Done false
1899 1353 Acked Read 8 Sent Done Done false
1900 1354 Acked Flush 0 Sent Done Done false
1901 1355 Acked Read 8 Sent Done Done false
1902 1356 Acked Flush 0 Sent Done Done false
1903 1357 Acked Read 1 Sent Done Done false
1904 1358 Acked Write 6 Sent Done Done false
1905 1359 Acked Read 2 Sent Done Done false
1906 1360 Acked Write 7 Sent Done Done false
1907 1361 Acked Write 9 Sent Done Done false
1908 1362 Acked Flush 0 Sent Done Done false
1909 1363 Acked Read 3 Sent Done Done false
1910 1364 Acked Write 10 Sent Done Done false
1911 1365 Acked Read 6 Sent Done Done false
1912 1366 Acked Read 10 Sent Done Done false
1913 1367 Acked Read 1 Sent Done Done false
1914 1368 Acked Flush 0 Sent Done Done false
1915 1369 Acked Write 3 Sent Done Done false
1916 1370 Acked Flush 0 Sent Done Done false
1917 1371 Acked Read 3 Sent Done Done false
1918 1372 Acked Read 3 Sent Done Done false
1919 1373 Acked Write 10 Sent Done Done false
1920 1374 Acked Read 10 Sent Done Done false
1921 1375 Acked Write 5 Sent Done Done false
1922 1376 Acked Read 3 Sent Done Done false
1923 1377 Acked Write 10 Sent Done Done false
1924 1378 Acked Read 3 Sent Done Done false
1925 1379 Acked Read 9 Sent Done Done false
1926 1380 Acked Read 1 Sent Done Done false
1927 1381 Acked Write 4 Sent Done Done false
1928 1382 Acked Read 3 Sent Done Done false
1929 1383 Acked Write 2 Sent Done Done false
1930 1384 Acked Read 4 Sent Done Done false
1931 1385 Acked Read 10 Sent Done Done false
1932 1386 Acked Read 1 Sent Done Done false
1933 1387 Acked Write 7 Sent Done Done false
1934 1388 Acked Read 6 Sent Done Done false
1935 1389 Acked Write 6 Sent Done Done false
1936 1390 Acked Read 9 Sent Done Done false
1937 1391 Acked Read 9 Sent Done Done false
1938 1392 Acked Read 2 Sent Done Done false
1939 1393 Acked Read 2 Sent Done Done false
1940 1394 Acked Read 1 Sent Done Done false
1941 1395 Acked Write 7 Sent Done Done false
1942 1396 Acked Read 5 Sent Done Done false
1943 1397 Acked Read 8 Sent Done Done false
1944 1398 Acked Write 9 Sent Done Done false
1945 1399 Acked Write 9 Sent Done Done false
1946 1400 Acked Read 7 Sent Done Done false
1947 1401 Acked Write 9 Sent Done Done false
1948 1402 Acked Read 7 Sent Done Done false
1949 1403 Acked Write 5 Sent Done Done false
1950 1404 Acked Flush 0 Sent Done Done false
1951 1405 Acked Read 2 Sent Done Done false
1952 1406 Acked Read 7 Sent Done Done false
1953 1407 Acked Read 2 Sent Done Done false
1954 1408 Acked Read 7 Sent Done Done false
1955 1409 Acked Read 10 Sent Done Done false
1956 1410 Acked Read 7 Sent Done Done false
1957 1411 Acked Read 2 Sent Done Done false
1958 1412 Acked Write 8 Sent Done Done false
1959 1413 Acked Read 10 Sent Done Done false
1960 1414 Acked Read 7 Sent Done Done false
1961 1415 Acked Write 9 Sent Done Done false
1962 1416 Acked Write 10 Sent Done Done false
1963 1417 Acked Read 1 Sent Done Done false
1964 1418 Acked Read 6 Sent Done Done false
1965 1419 Acked Read 10 Sent Done Done false
1966 1420 Acked Write 8 Sent Done Done false
1967 1421 Acked Read 7 Sent Done Done false
1968 1422 Acked Write 4 Sent Done Done false
1969 1423 Acked Read 4 Sent Done Done false
1970 1424 Acked Read 4 Sent Done Done false
1971 1425 Acked Write 4 Sent Done Done false
1972 1426 Acked Read 4 Sent Done Done false
1973 1427 Acked Read 10 Sent Done Done false
1974 1428 Acked Write 6 Sent Done Done false
1975 1429 Acked Read 2 Sent Done Done false
1976 1430 Acked Read 1 Sent Done Done false
1977 1431 Acked Read 9 Sent Done Done false
1978 1432 Acked Read 5 Sent Done Done false
1979 1433 Acked Write 6 Sent Done Done false
1980 1434 Acked Read 2 Sent Done Done false
1981 1435 Acked Write 9 Sent Done Done false
1982 1436 Acked Write 7 Sent Done Done false
1983 1437 Acked Read 7 Sent Done Done false
1984 1438 Acked Read 3 Sent Done Done false
1985 1439 Acked Read 7 Sent Done Done false
1986 1440 Acked Read 5 Sent Done Done false
1987 1441 Acked Read 2 Sent Done Done false
1988 1442 Acked Write 9 Sent Done Done false
1989 1443 Acked Read 7 Sent Done Done false
1990 1444 Acked Read 9 Sent Done Done false
1991 1445 Acked Write 3 Sent Done Done false
1992 1446 Acked Read 1 Sent Done Done false
1993 1447 Acked Read 6 Sent Done Done false
1994 1448 Acked Flush 0 Sent Done Done false
1995 1449 Acked Write 2 Sent Done Done false
1996 1450 Acked Write 8 Sent Done Done false
1997 1451 Acked Read 8 Sent Done Done false
1998 1452 Acked Read 9 Sent Done Done false
1999 1453 Acked Write 10 Sent Done Done false
2000 1454 Acked Read 6 Sent Done Done false
2001 1455 Acked Write 6 Sent Done Done false
2002 1456 Acked Read 7 Sent Done Done false
2003 1457 Acked Read 9 Sent Done Done false
2004 1458 Acked Read 4 Sent Done Done false
2005 1459 Acked Write 9 Sent Done Done false
2006 1460 Acked Write 10 Sent Done Done false
2007 1461 Acked Read 7 Sent Done Done false
2008 1462 Acked Flush 0 Sent Done Done false
2009 1463 Acked Write 10 Sent Done Done false
2010 1464 Acked Write 7 Sent Done Done false
2011 1465 Acked Read 10 Sent Done Done false
2012 1466 Acked Flush 0 Sent Done Done false
2013 1467 Acked Write 10 Sent Done Done false
2014 1468 Acked Read 9 Sent Done Done false
2015 1469 Acked Write 9 Sent Done Done false
2016 1470 Acked Read 7 Sent Done Done false
2017 1471 Acked Read 10 Sent Done Done false
2018 1472 Acked Read 5 Sent Done Done false
2019 1473 Acked Read 10 Sent Done Done false
2020 1474 Acked Read 5 Sent Done Done false
2021 1475 Acked Write 9 Sent Done Done false
2022 1476 Acked Flush 0 Sent Done Done false
2023 1477 Acked Write 4 Sent Done Done false
2024 1478 Acked Read 9 Sent Done Done false
2025 1479 Acked Read 2 Sent Done Done false
2026 1480 Acked Read 1 Sent Done Done false
2027 1481 Acked Write 7 Sent Done Done false
2028 1482 Acked Flush 0 Sent Done Done false
2029 1483 Acked Write 7 Sent Done Done false
2030 1484 Acked Write 8 Sent Done Done false
2031 1485 Acked Read 2 Sent Done Done false
2032 1486 Acked Read 5 Sent Done Done false
2033 1487 Acked Write 6 Sent Done Done false
2034 1488 Acked Read 2 Sent Done Done false
2035 1489 Acked Write 9 Sent Done Done false
2036 1490 Acked Write 3 Sent Done Done false
2037 1491 Acked Read 10 Sent Done Done false
2038 1492 Acked Flush 0 Sent Done Done false
2039 1493 Acked Write 6 Sent Done Done false
2040 1494 Acked Read 1 Sent Done Done false
2041 1495 Acked Read 6 Sent Done Done false
2042 1496 Acked Flush 0 Sent Done Done false
2043 1497 Acked Read 5 Sent Done Done false
2044 1498 Acked Write 2 Sent Done Done false
2045 1499 Acked Read 9 Sent Done Done false
2046 1500 Acked Read 10 Sent Done Done false
2047 1501 Acked Write 6 Sent Done Done false
2048 1502 Acked Flush 0 Sent Done Done false
2049 1503 Acked Read 4 Sent Done Done false
2050 1504 Acked Read 3 Sent Done Done false
2051 1505 Acked Read 7 Sent Done Done false
2052 1506 Acked Flush 0 Sent Done Done false
2053 1507 Acked Flush 0 Sent Done Done false
2054 1508 Acked Write 9 Sent Done Done false
2055 1509 Acked Read 9 Sent Done Done false
2056 1510 Acked Flush 0 Sent Done Done false
2057 1511 Acked Read 6 Sent Done Done false
2058 1512 Acked Write 1 Sent Done Done false
2059 1513 Acked Read 5 Sent Done Done false
2060 1514 Acked Flush 0 Sent Done Done false
2061 1515 Acked Read 8 Sent Done Done false
2062 1516 Acked Read 10 Sent Done Done false
2063 1517 Acked Write 4 Sent Done Done false
2064 1518 Acked Write 10 Sent Done Done false
2065 1519 Acked Write 7 Sent Done Done false
2066 1520 Acked Flush 0 Sent Done Done false
2067 1521 Acked Write 9 Sent Done Done false
2068 1522 Acked Read 10 Sent Done Done false
2069 1523 Acked Read 3 Sent Done Done false
2070 1524 Acked Write 5 Sent Done Done false
2071 1525 Acked Read 6 Sent Done Done false
2072 1526 Acked Flush 0 Sent Done Done false
2073 1527 Acked Read 4 Sent Done Done false
2074 1528 Acked Write 3 Sent Done Done false
2075 1529 Acked Write 4 Sent Done Done false
2076 1530 Acked Write 5 Sent Done Done false
2077 1531 Acked Read 3 Sent Done Done false
2078 1532 Acked Write 5 Sent Done Done false
2079 1533 Acked Write 9 Sent Done Done false
2080 1534 Acked Flush 0 Sent Done Done false
2081 1535 Acked Write 3 Sent Done Done false
2082 1536 Acked Read 9 Sent Done Done false
2083 1537 Acked Read 3 Sent Done Done false
2084 1538 Acked Write 6 Sent Done Done false
2085 1539 Acked Read 10 Sent Done Done false
2086 1540 Acked Flush 0 Sent Done Done false
2087 1541 Acked Write 9 Sent Done Done false
2088 1542 Acked Read 8 Sent Done Done false
2089 1543 Acked Write 6 Sent Done Done false
2090 1544 Acked Read 2 Sent Done Done false
2091 1545 Acked Flush 0 Sent Done Done false
2092 1546 Acked Write 3 Sent Done Done false
2093 1547 Acked Read 10 Sent Done Done false
2094 1548 Acked Write 2 Sent Done Done false
2095 1549 Acked Read 1 Sent Done Done false
2096 1550 Acked Read 5 Sent Done Done false
2097 1551 Acked Write 10 Sent Done Done false
2098 1552 Acked Flush 0 Sent Done Done false
2099 1553 Acked Read 7 Sent Done Done false
2100 1554 Acked Read 4 Sent Done Done false
2101 1555 Acked Write 3 Sent Done Done false
2102 1556 Acked Write 5 Sent Done Done false
2103 1557 Acked Read 2 Sent Done Done false
2104 1558 Acked Write 3 Sent Done Done false
2105 1559 Acked Read 4 Sent Done Done false
2106 1560 Acked Read 1 Sent Done Done false
2107 1561 Acked Read 2 Sent Done Done false
2108 1562 Acked Read 5 Sent Done Done false
2109 1563 Acked Read 5 Sent Done Done false
2110 1564 Acked Read 4 Sent Done Done false
2111 1565 Acked Read 3 Sent Done Done false
2112 1566 Acked Write 8 Sent Done Done false
2113 1567 Acked Write 6 Sent Done Done false
2114 1568 Acked Flush 0 Sent Done Done false
2115 1569 Acked Write 2 Sent Done Done false
2116 1570 Acked Read 8 Sent Done Done false
2117 1571 Acked Read 8 Sent Done Done false
2118 1572 Acked Write 3 Sent Done Done false
2119 1573 Acked Read 10 Sent Done Done false
2120 1574 Acked Read 1 Sent Done Done false
2121 1575 Acked Read 6 Sent Done Done false
2122 1576 Acked Read 2 Sent Done Done false
2123 1577 Acked Read 4 Sent Done Done false
2124 1578 Acked Write 10 Sent Done Done false
2125 1579 Acked Write 6 Sent Done Done false
2126 1580 Acked Read 1 Sent Done Done false
2127 1581 Acked Read 5 Sent Done Done false
2128 1582 Acked Write 10 Sent Done Done false
2129 1583 Acked Read 5 Sent Done Done false
2130 1584 Acked Write 1 Sent Done Done false
2131 1585 Acked Read 10 Sent Done Done false
2132 1586 Acked Read 6 Sent Done Done false
2133 1587 Acked Read 5 Sent Done Done false
2134 1588 Acked Write 6 Sent Done Done false
2135 1589 Acked Write 2 Sent Done Done false
2136 1590 Acked Write 8 Sent Done Done false
2137 1591 Acked Write 6 Sent Done Done false
2138 1592 Acked Flush 0 Sent Done Done false
2139 1593 Acked Read 6 Sent Done Done false
2140 1594 Acked Read 3 Sent Done Done false
2141 1595 Acked Write 10 Sent Done Done false
2142 1596 Acked Read 3 Sent Done Done false
2143 1597 Acked Write 4 Sent Done Done false
2144 1598 Acked Write 4 Sent Done Done false
2145 1599 Acked Write 8 Sent Done Done false
2146 1600 Acked Flush 0 Sent Done Done false
2147 1601 Acked Read 9 Sent Done Done false
2148 1602 Acked Flush 0 Sent Done Done false
2149 STATES DS:0 DS:1 DS:2 TOTAL
2150 Sent 302 0 0 302
2151 Done 0 302 302 604
2152 Skipped 0 0 0 0
2153 Error 0 0 0 0
2154 Last Flush: 1300 1602 1602
2155 Downstairs last five completed: 1300 1299 1298 1297 1296
2156 Upstairs last five completed: 1602 1601 1600 1599 1598
2157 CLIENT: Up:0 ds:302 act:2
21582025-01-10T16:35:45.947ZINFOcrucible: connecting to 127.0.0.1:8810 = io task client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
21592025-01-10T16:35:45.947ZINFOcrucible: ds_connection connected from Ok(127.0.0.1:40429) = io task client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
21602025-01-10T16:35:45.948ZWARNcrucible: version negotiation from state Offline = downstairs client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
21612025-01-10T16:35:45.949ZINFOcrucible: downstairs client at Some(127.0.0.1:8810) has region UUID 12345678-0000-0000-0000-000000008810 = downstairs client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
21622025-01-10T16:35:45.949ZINFOcrucible: Returning UUID:12345678-0000-0000-0000-000000008810 matches = downstairs client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
21632025-01-10T16:35:45.949ZINFOcrucible: send last flush ID to this DS: 1300 = downstairs client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
21642025-01-10T16:35:45.949ZINFOcrucible: Replied this last flush ID: 1300 = downstairs client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
21652025-01-10T16:35:45.949ZINFOcrucible: ds_transition from Offline to Active = downstairs client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
21662025-01-10T16:35:45.949ZINFOcrucible: [0] Transition from Offline to Active = downstairs client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
21672025-01-10T16:35:45.949ZINFOcrucible: [0] client re-new 302 jobs since flush 1300 = downstairs session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
21682025-01-10T16:35:45.949ZINFOcrucible: [0] Replayed 302 jobs since flush: 1300 = downstairs session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
2169 ----------------------------------------------------------------
2170 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:0
2171 Downstairs last five completed: 1602 1601 1600 1599 1598
2172 Upstairs last five completed: 1602 1601 1600 1599 1598
2173 CLIENT: Up:0 ds:0 act:3
2174 Replay: All jobs finished
2175 Main task has work to do, go find it
2176 got dsc Stop(1)
2177 stop 1
2178 Jan 10 16:35:48.206 INFO request completed, latency_us: 356, response_code: 204, uri: [8820] Got stop action so:false kr:false
2179 /stop/cid/1, method: POST, req_id: 52793763-a3a7-423e-b64c-cbb73dfecb87, remote_addr: 127.0.0.1:55917, local_addr: 127.0.0.1:9998
21802025-01-10T16:35:48.207ZWARNcrucible: downstairs disconnected = io task client = 1 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
21812025-01-10T16:35:48.207ZWARNcrucible: client task is sending Done(Finished) = io task client = 1 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
21822025-01-10T16:35:48.207ZWARNcrucible: downstairs task for 1 stopped due to Finished session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
21832025-01-10T16:35:48.207ZINFOcrucible: ds_transition from Active to Offline = downstairs client = 1 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
2184 Jan 10 16:35:48.207 INFO request completed, latency_us:{"msg":"[1] Transition from Active to Offline","v":0,"name":"crucible","level":30,"time":"2025-01-10T16:35:48.207187927Z","hostname":"w-01JH8H1N3KXZ9F8ZV6CCMP5KTQ","pid":1202,"client":"1","":"downstairs","session_id":"1df3ca91-4dc9-42d6-9897-461254b5afe2"}
2185 120, response_code: 200, uri: /state/cid/1, method: GET, req_id: f6c5d69b-75d1-49b3-bd16-9b67bba451d6, remote_addr: 127.0.0.1:55917, local_addr: 127.0.0.1:9998
21862025-01-10T16:35:48.207ZINFOcrucible: client task is exiting = io task client = 1 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
2187 [8820] Exited with: ExitStatus(unix_wait_status(9))
2188 [8820][1] reports Exit
2189 Jan 10 16:35:52.210 INFO request completed, latency_us: 372, response_code: 200, uri: /state/cid/1, method: GET, req_id: 5e99dc45-e6b1-4540-b90b-5231db83b515, remote_addr: 127.0.0.1:55917, local_addr: 127.0.0.1:9998
2190 001/300 Write block 1138 len 36864 data: 2 2 2 2 2 2 2 2 2
2191 002/300 Flush
2192 003/300 Write block 631 len 32768 data: 2 2 2 2 2 2 2 2
2193 004/300 Write block 1737 len 40960 data: 2 2 2 2 2 2 2 2 2 2
2194 005/300 Write block 1992 len 40960 data: 2 3 3 3 3 2 2 2 2 2
2195 006/300 Read block 574 len 8192
2196 007/300 Read block 628 len 20480
2197 008/300 Write block 1170 len 28672 data: 2 2 2 2 2 2 2
2198 009/300 Read block 2775 len 20480
2199 010/300 Read block 3066 len 16384
2200 011/300 Read block 4554 len 4096
2201 012/300 Read block 4772 len 28672
2202 013/300 Write block 4894 len 12288 data: 2 2 2
2203 014/300 Write block 2080 len 24576 data: 2 2 2 2 2 2
2204 015/300 Read block 1828 len 28672
2205 016/300 Flush
2206 017/300 Write block 1388 len 36864 data: 2 2 2 3 2 2 2 2 2
2207 018/300 Read block 1914 len 16384
2208 019/300 Write block 843 len 16384 data: 2 2 2 2
2209 020/300 Write block 4373 len 28672 data: 3 3 3 3 3 3 2
2210 021/300 Read block 1345 len 12288
2211 022/300 Read block 1590 len 8192
2212 023/300 Write block 1877 len 20480 data: 2 2 2 2 2
2213 024/300 Read block 3702 len 36864
2214 025/300 Write block 4576 len 40960 data: 2 2 2 2 2 2 2 2 2 2
2215 026/300 Read block 3104 len 32768
2216 027/300 Flush
2217 028/300 Read block 2906 len 36864
2218 029/300 Read block 772 len 24576
2219 030/300 Read block 2105 len 36864
2220 031/300 Read block 4872 len 28672
2221 032/300 Write block 2873 len 24576 data: 2 2 2 2 2 2
2222 033/300 Write block 4734 len 12288 data: 2 2 2
2223 034/300 Write block 1112 len 12288 data: 2 2 2
2224 035/300 Write block 152 len 12288 data: 2 2 2
2225 036/300 Read block 4426 len 36864
2226 037/300 Write block 317 len 16384 data: 2 2 2 2
2227 038/300 Write block 72 len 4096 data: 2
2228 039/300 Read block 4751 len 16384
2229 040/300 Flush
2230 041/300 Flush
2231 042/300 Write block 2584 len 24576 data: 2 2 2 2 2 2
2232 043/300 Read block 1215 len 4096
2233 044/300 Read block 2499 len 4096
2234 045/300 Write block 1976 len 4096 data: 2
2235 046/300 Write block 4557 len 12288 data: 4 3 3
2236 047/300 Write block 2362 len 32768 data: 3 3 3 2 2 2 2 2
2237 048/300 Read block 2111 len 32768
2238 049/300 Flush
2239 050/300 Read block 3347 len 12288
2240 051/300 Read block 246 len 32768
2241 052/300 Write block 4342 len 4096 data: 2
2242 053/300 Read block 4504 len 20480
2243 054/300 Flush
2244 055/300 Write block 3224 len 32768 data: 2 2 2 2 2 2 2 2
2245 056/300 Write block 677 len 4096 data: 2
2246 057/300 Write block 1342 len 28672 data: 2 2 2 2 2 2 2
2247 058/300 Write block 1467 len 24576 data: 3 3 3 3 4 4
2248 059/300 Read block 4853 len 40960
2249 060/300 Write block 1097 len 8192 data: 2 2
2250 061/300 Read block 909 len 8192
2251 062/300 Read block 4687 len 32768
2252 063/300 Write block 4048 len 8192 data: 2 2
2253 064/300 Read block 3211 len 32768
2254 065/300 Flush
2255 066/300 Write block 2346 len 20480 data: 2 2 2 2 2
2256 067/300 Read block 2788 len 24576
2257 068/300 Write block 612 len 20480 data: 2 2 2 2 2
2258 069/300 Read block 729 len 8192
2259 070/300 Flush
2260 071/300 Read block 3956 len 28672
2261 072/300 Read block 3752 len 12288
2262 073/300 Read block 4183 len 20480
2263 074/300 Read block 3318 len 4096
2264 075/300 Read block 1606 len 36864
2265 076/300 Read block 970 len 40960
2266 077/300 Flush
2267 078/300 Read block 4905 len 20480
2268 079/300 Flush
2269 080/300 Read block 1188 len 24576
2270 081/300 Write block 4199 len 24576 data: 3 3 3 3 3 3
2271 082/300 Write block 3140 len 20480 data: 2 2 2 2 2
2272 083/300 Read block 1795 len 36864
2273 084/300 Flush
2274 085/300 Read block 1641 len 20480
2275 086/300 Read block 921 len 12288
2276 087/300 Write block 3928 len 28672 data: 2 2 2 2 2 2 2
2277 088/300 Read block 596 len 24576
2278 089/300 Write block 2420 len 20480 data: 2 2 2 2 2
2279 090/300 Read block 130 len 36864
2280 091/300 Write block 3912 len 4096 data: 2
2281 092/300 Read block 2559 len 4096
2282 093/300 Write block 4645 len 36864 data: 2 2 2 2 2 2 2 2 2
2283 094/300 Read block 3420 len 20480
2284 095/300 Read block 2600 len 36864
2285 096/300 Read block 4726 len 20480
2286 097/300 Write block 3983 len 24576 data: 3 3 3 4 4 5
2287 098/300 Read block 2577 len 40960
2288 099/300 Read block 3363 len 28672
2289 100/300 Read block 1906 len 24576
2290 101/300 Read block 1985 len 20480
2291 102/300 Read block 3321 len 20480
2292 103/300 Read block 1812 len 40960
2293 104/300 Write block 3890 len 8192 data: 2 2
2294 105/300 Read block 1344 len 12288
2295 106/300 Read block 230 len 28672
2296 107/300 Write block 4039 len 32768 data: 2 2 2 2 2 2 2 2
2297 108/300 Read block 1129 len 36864
2298 109/300 Read block 4539 len 40960
2299 110/300 Read block 1808 len 8192
2300 111/300 Flush
2301 112/300 Write block 882 len 24576 data: 3 3 3 3 3 2
2302 113/300 Write block 1368 len 4096 data: 2
2303 114/300 Read block 2829 len 28672
2304 115/300 Write block 3681 len 36864 data: 3 3 3 3 3 3 2 2 2
2305 116/300 Write block 219 len 36864 data: 2 2 2 2 2 2 2 2 2
2306 117/300 Read block 4372 len 20480
2307 118/300 Write block 3727 len 40960 data: 3 3 3 2 2 2 2 2 2 2
2308 119/300 Write block 3285 len 8192 data: 2 2
2309 120/300 Read block 3462 len 16384
2310 121/300 Read block 4047 len 4096
2311 122/300 Write block 2062 len 40960 data: 2 2 2 2 2 2 2 2 2 2
2312 123/300 Read block 3687 len 36864
2313 124/300 Read block 4806 len 40960
2314 125/300 Write block 45 len 12288 data: 2 2 2
2315 126/300 Read block 2024 len 24576
2316 127/300 Read block 2085 len 28672
2317 128/300 Read block 3267 len 36864
2318 129/300 Read block 3164 len 12288
2319 130/300 Write block 3106 len 4096 data: 2
2320 131/300 Flush
2321 132/300 Read block 762 len 24576
2322 133/300 Read block 3168 len 20480
2323 134/300 Write block 526 len 36864 data: 2 2 3 3 3 3 3 3 3
2324 135/300 Write block 3224 len 12288 data: 3 3 3
2325 136/300 Write block 3312 len 40960 data: 2 2 2 2 2 2 2 2 2 2
2326 137/300 Flush
2327 138/300 Write block 1034 len 4096 data: 2
2328 139/300 Write block 128 len 12288 data: 2 2 2
2329 140/300 Read block 830 len 4096
2330 141/300 Write block 4339 len 16384 data: 2 2 2 3
2331 142/300 Write block 296 len 12288 data: 2 2 2
2332 143/300 Read block 2665 len 4096
2333 144/300 Write block 1873 len 4096 data: 2
2334 145/300 Read block 624 len 4096
2335 146/300 Write block 1892 len 8192 data: 2 2
2336 147/300 Read block 2522 len 36864
2337 148/300 Write block 2515 len 24576 data: 3 3 3 3 3 2
2338 149/300 Read block 3652 len 36864
2339 150/300 Write block 162 len 4096 data: 2
2340 151/300 Flush
2341 152/300 Write block 572 len 4096 data: 2
2342 153/300 Flush
2343 154/300 Read block 2065 len 32768
2344 155/300 Write block 2446 len 20480 data: 2 2 2 2 2
2345 156/300 Flush
2346 157/300 Write block 2643 len 36864 data: 2 2 2 2 2 2 2 2 2
2347 158/300 Read block 440 len 16384
2348 159/300 Write block 207 len 4096 data: 2
2349 160/300 Read block 985 len 16384
2350 161/300 Read block 2806 len 24576
2351 162/300 Read block 4180 len 40960
2352 163/300 Read block 2274 len 24576
2353 164/300 Read block 3185 len 16384
2354 165/300 Read block 1244 len 16384
2355 166/300 Read block 4656 len 36864
2356 167/300 Write block 2312 len 20480 data: 3 3 3 3 3
2357 168/300 Read block 2593 len 4096
2358 169/300 Flush
2359 170/300 Read block 4917 len 8192
2360 171/300 Flush
2361 172/300 Flush
2362 173/300 Read block 3870 len 36864
2363 174/300 Write block 315 len 8192 data: 2 2
2364 175/300 Write block 941 len 20480 data: 2 2 2 2 2
2365 176/300 Read block 4334 len 16384
2366 177/300 Read block 1964 len 24576
2367 178/300 Flush
2368 179/300 Read block 3660 len 32768
2369 180/300 Write block 1016 len 32768 data: 3 3 2 2 2 2 3 3
2370 181/300 Read block 1855 len 24576
2371 182/300 Read block 1581 len 36864
2372 183/300 Read block 2258 len 36864
2373 184/300 Write block 509 len 36864 data: 2 2 2 2 2 2 2 2 2
2374 185/300 Write block 841 len 20480 data: 2 2 3 3 3
2375 186/300 Write block 3192 len 36864 data: 2 2 2 2 2 2 2 2 2
2376 187/300 Write block 3841 len 32768 data: 2 2 2 2 2 2 2 2
2377 188/300 Write block 27 len 24576 data: 3 4 3 3 3 3
2378 189/300 Write block 443 len 40960 data: 2 2 2 2 2 2 2 2 2 2
2379 190/300 Read block 3675 len 24576
2380 191/300 Read block 2771 len 24576
2381 192/300 Read block 3161 len 12288
2382 193/300 Read block 2513 len 32768
2383 194/300 Read block 2263 len 24576
2384 195/300 Read block 106 len 8192
2385 196/300 Read block 2258 len 24576
2386 197/300 Write block 1631 len 12288 data: 3 3 3
2387 198/300 Read block 1539 len 32768
2388 199/300 Read block 1863 len 4096
2389 200/300 Read block 3742 len 8192
2390 201/300 Read block 1134 len 24576
2391 202/300 Write block 3735 len 28672 data: 3 3 2 2 2 2 2
2392 203/300 Flush
2393 204/300 Read block 1785 len 40960
2394 205/300 Write block 64 len 8192 data: 2 2
2395 206/300 Write block 1854 len 16384 data: 2 2 2 2
2396 207/300 Read block 764 len 24576
2397 208/300 Flush
2398 209/300 Write block 3283 len 24576 data: 2 2 3 3 2 2
2399 210/300 Read block 1725 len 12288
2400 211/300 Write block 1479 len 4096 data: 3
2401 212/300 Flush
2402 213/300 Write block 40 len 36864 data: 2 2 2 2 2 3 3 3 2
2403 214/300 Read block 3878 len 16384
2404 215/300 Read block 3012 len 24576
2405 216/300 Read block 293 len 40960
2406 217/300 Write block 4669 len 4096 data: 2
2407 218/300 Write block 799 len 36864 data: 2 2 2 2 2 2 2 3 3
2408 219/300 Write block 1337 len 36864 data: 2 2 2 2 2 3 3 3 3
2409 220/300 Read block 2780 len 32768
2410 221/300 Read block 811 len 12288
2411 222/300 Read block 1647 len 36864
2412 223/300 Write block 2683 len 24576 data: 2 3 3 3 3 3
2413 224/300 Write block 4524 len 40960 data: 2 2 2 2 2 2 2 3 3 3
2414 225/300 Read block 3956 len 16384
2415 226/300 Read block 656 len 16384
2416 227/300 Read block 714 len 20480
2417 228/300 Read block 2965 len 28672
2418 229/300 Read block 181 len 4096
2419 230/300 Read block 4014 len 36864
2420 231/300 Write block 3543 len 40960 data: 2 2 2 2 2 2 2 2 2 2
2421 232/300 Read block 3608 len 36864
2422 233/300 Write block 3262 len 12288 data: 2 2 2
2423 234/300 Write block 72 len 28672 data: 3 2 2 2 2 2 2
2424 235/300 Read block 3704 len 12288
2425 236/300 Flush
2426 237/300 Read block 1262 len 24576
2427 238/300 Write block 3487 len 32768 data: 2 2 2 2 2 2 2 2
2428 239/300 Read block 3730 len 24576
2429 240/300 Read block 3716 len 28672
2430 241/300 Read block 2938 len 20480
2431 242/300 Write block 2978 len 40960 data: 2 2 2 2 2 2 2 2 2 3
2432 243/300 Write block 2626 len 12288 data: 2 3 3
2433 244/300 Read block 4779 len 20480
2434 245/300 Write block 2344 len 20480 data: 2 2 3 3 3
2435 246/300 Flush
2436 247/300 Read block 490 len 12288
2437 248/300 Write block 76 len 32768 data: 3 3 3 2 2 2 2 2
2438 249/300 Write block 1760 len 20480 data: 2 2 2 2 2
2439 250/300 Read block 1741 len 24576
2440 251/300 Read block 198 len 4096
2441 252/300 Write block 309 len 12288 data: 3 3 2
2442 253/300 Write block 1258 len 16384 data: 2 2 2 2
2443 254/300 Read block 4130 len 36864
2444 255/300 Read block 1788 len 36864
2445 256/300 Read block 3140 len 28672
2446 257/300 Read block 3546 len 32768
2447 258/300 Write block 3711 len 28672 data: 3 3 3 3 3 3 2
2448 259/300 Read block 3674 len 32768
2449 260/300 Flush
2450 261/300 Write block 680 len 16384 data: 4 4 4 4
2451 262/300 Write block 3945 len 16384 data: 3 3 2 2
2452 263/300 Write block 1857 len 40960 data: 3 2 2 2 2 2 2 2 2 2
2453 264/300 Read block 513 len 40960
2454 265/300 Write block 2881 len 8192 data: 2 2
2455 266/300 Read block 3072 len 12288
2456 267/300 Write block 1888 len 36864 data: 2 2 2 2 3 3 2 2 2
2457 268/300 Write block 2551 len 16384 data: 2 2 2 2
2458 269/300 Write block 345 len 28672 data: 2 2 2 2 2 2 2
2459 270/300 Read block 4128 len 16384
2460 271/300 Write block 2276 len 28672 data: 2 2 2 2 2 2 2
2461 272/300 Write block 1313 len 32768 data: 2 2 2 2 2 2 2 2
2462 273/300 Read block 1254 len 24576
2463 274/300 Write block 647 len 8192 data: 2 2
2464 275/300 Flush
2465 276/300 Read block 3546 len 28672
2466 277/300 Flush
2467 278/300 Write block 668 len 24576 data: 3 3 2 2 2 2
2468 279/300 Write block 2068 len 40960 data: 3 3 3 3 2 2 2 2 2 2
2469 280/300 Write block 2743 len 24576 data: 2 2 2 2 2 2
2470 281/300 Read block 1748 len 32768
2471 282/300 Read block 2827 len 32768
2472 283/300 Read block 4149 len 36864
2473 284/300 Read block 856 len 24576
2474 285/300 Read block 1364 len 20480
2475 286/300 Write block 3213 len 32768 data: 3 3 3 3 3 3 3 3
2476 287/300 Write block 3122 len 40960 data: 2 2 2 2 2 2 2 2 3 4
2477 288/300 Read block 1800 len 16384
2478 289/300 Write block 3980 len 40960 data: 2 2 2 4 4 4 5 5 6 5
2479 290/300 Read block 840 len 36864
2480 291/300 Read block 834 len 4096
2481 292/300 Read block 4518 len 32768
2482 293/300 Read block 2932 len 28672
2483 294/300 Write block 276 len 4096 data: 3
2484 295/300 Write block 2985 len 32768 data: 3 3 4 3 3 3 3 3
2485 296/300 Read block 1477 len 32768
2486 297/300 Read block 3280 len 20480
2487 298/300 Write block 1380 len 20480 data: 2 2 3 3 3
2488 299/300 Read block 2776 len 28672
2489 300/300 Write block 1428 len 12288 data: 2 2 2
2490 301/300 Read block 2563 len 12288
2491 Main task has work to do, go find it
2492 got dsc Start(1)
2493 start 1
2494 Jan 10 16:35:52.454 INFO request completed, latency_us: 210, response_code: 204, uri: /start/cid/1, method: POST, req_id: 8bee3f79-54e6-46c3-80f1-32ecb7d9ea40, remote_addr: 127.0.0.1:55917, local_addr: 127.0.0.1:9998
2495 Replay: started 1, returned:Ok(())
2496 ----------------------------------------------------------------
2497 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:301
2498 States: Active Offline Active
2499 JOBID ACK TYPE BKS/EXT DS:0 DS:1 DS:2 REPLAY
2500 1603 Acked Write 9 Done Sent Done false
2501 1604 Acked Flush 0 Done Sent Done false
2502 1605 Acked Write 8 Done Sent Done false
2503 1606 Acked Write 10 Done Sent Done false
2504 1607 Acked Write 10 Done Sent Done false
2505 1608 Acked Read 2 Done Sent Done false
2506 1609 Acked Read 5 Done Sent Done false
2507 1610 Acked Write 7 Done Sent Done false
2508 1611 Acked Read 5 Done Sent Done false
2509 1612 Acked Read 4 Done Sent Done false
2510 1613 Acked Read 1 Done Sent Done false
2511 1614 Acked Read 7 Done Sent Done false
2512 1615 Acked Write 3 Done Sent Done false
2513 1616 Acked Write 6 Done Sent Done false
2514 1617 Acked Read 7 Done Sent Done false
2515 1618 Acked Flush 0 Done Sent Done false
2516 1619 Acked Write 9 Done Sent Done false
2517 1620 Acked Read 4 Done Sent Done false
2518 1621 Acked Write 4 Done Sent Done false
2519 1622 Acked Write 7 Done Sent Done false
2520 1623 Acked Read 3 Done Sent Done false
2521 1624 Acked Read 2 Done Sent Done false
2522 1625 Acked Write 5 Done Sent Done false
2523 1626 Acked Read 9 Done Sent Done false
2524 1627 Acked Write 10 Done Sent Done false
2525 1628 Acked Read 8 Done Sent Done false
2526 1629 Acked Flush 0 Done Sent Done false
2527 1630 Acked Read 9 Done Sent Done false
2528 1631 Acked Read 6 Done Sent Done false
2529 1632 Acked Read 9 Done Sent Done false
2530 1633 Acked Read 7 Done Sent Done false
2531 1634 Acked Write 6 Done Sent Done false
2532 1635 Acked Write 3 Done Sent Done false
2533 1636 Acked Write 3 Done Sent Done false
2534 1637 Acked Write 3 Done Sent Done false
2535 1638 Acked Read 9 Done Sent Done false
2536 1639 Acked Write 4 Done Sent Done false
2537 1640 Acked Write 1 Done Sent Done false
2538 1641 Acked Read 4 Done Sent Done false
2539 1642 Acked Flush 0 Done Sent Done false
2540 1643 Acked Flush 0 Done Sent Done false
2541 1644 Acked Write 6 Done Sent Done false
2542 1645 Acked Read 1 Done Sent Done false
2543 1646 Acked Read 1 Done Sent Done false
2544 1647 Acked Write 1 Done Sent Done false
2545 1648 Acked Write 3 Done Sent Done false
2546 1649 Acked Write 8 Done Sent Done false
2547 1650 Acked Read 8 Done Sent Done false
2548 1651 Acked Flush 0 Done Sent Done false
2549 1652 Acked Read 3 Done Sent Done false
2550 1653 Acked Read 8 Done Sent Done false
2551 1654 Acked Write 1 Done Sent Done false
2552 1655 Acked Read 5 Done Sent Done false
2553 1656 Acked Flush 0 Done Sent Done false
2554 1657 Acked Write 8 Done Sent Done false
2555 1658 Acked Write 1 Done Sent Done false
2556 1659 Acked Write 7 Done Sent Done false
2557 1660 Acked Write 6 Done Sent Done false
2558 1661 Acked Read 10 Done Sent Done false
2559 1662 Acked Write 2 Done Sent Done false
2560 1663 Acked Read 2 Done Sent Done false
2561 1664 Acked Read 8 Done Sent Done false
2562 1665 Acked Write 2 Done Sent Done false
2563 1666 Acked Read 8 Done Sent Done false
2564 1667 Acked Flush 0 Done Sent Done false
2565 1668 Acked Write 5 Done Sent Done false
2566 1669 Acked Read 6 Done Sent Done false
2567 1670 Acked Write 5 Done Sent Done false
2568 1671 Acked Read 2 Done Sent Done false
2569 1672 Acked Flush 0 Done Sent Done false
2570 1673 Acked Read 7 Done Sent Done false
2571 1674 Acked Read 3 Done Sent Done false
2572 1675 Acked Read 5 Done Sent Done false
2573 1676 Acked Read 1 Done Sent Done false
2574 1677 Acked Read 9 Done Sent Done false
2575 1678 Acked Read 10 Done Sent Done false
2576 1679 Acked Flush 0 Done Sent Done false
2577 1680 Acked Read 5 Done Sent Done false
2578 1681 Acked Flush 0 Done Sent Done false
2579 1682 Acked Read 6 Done Sent Done false
2580 1683 Acked Write 6 Done Sent Done false
2581 1684 Acked Write 5 Done Sent Done false
2582 1685 Acked Read 9 Done Sent Done false
2583 1686 Acked Flush 0 Done Sent Done false
2584 1687 Acked Read 5 Done Sent Done false
2585 1688 Acked Read 3 Done Sent Done false
2586 1689 Acked Write 7 Done Sent Done false
2587 1690 Acked Read 6 Done Sent Done false
2588 1691 Acked Write 5 Done Sent Done false
2589 1692 Acked Read 9 Done Sent Done false
2590 1693 Acked Write 1 Done Sent Done false
2591 1694 Acked Read 1 Done Sent Done false
2592 1695 Acked Write 9 Done Sent Done false
2593 1696 Acked Read 5 Done Sent Done false
2594 1697 Acked Read 9 Done Sent Done false
2595 1698 Acked Read 5 Done Sent Done false
2596 1699 Acked Write 6 Done Sent Done false
2597 1700 Acked Read 10 Done Sent Done false
2598 1701 Acked Read 7 Done Sent Done false
2599 1702 Acked Read 6 Done Sent Done false
2600 1703 Acked Read 5 Done Sent Done false
2601 1704 Acked Read 5 Done Sent Done false
2602 1705 Acked Read 10 Done Sent Done false
2603 1706 Acked Write 2 Done Sent Done false
2604 1707 Acked Read 3 Done Sent Done false
2605 1708 Acked Read 7 Done Sent Done false
2606 1709 Acked Write 8 Done Sent Done false
2607 1710 Acked Read 9 Done Sent Done false
2608 1711 Acked Read 10 Done Sent Done false
2609 1712 Acked Read 2 Done Sent Done false
2610 1713 Acked Flush 0 Done Sent Done false
2611 1714 Acked Write 6 Done Sent Done false
2612 1715 Acked Write 1 Done Sent Done false
2613 1716 Acked Read 7 Done Sent Done false
2614 1717 Acked Write 9 Done Sent Done false
2615 1718 Acked Write 9 Done Sent Done false
2616 1719 Acked Read 5 Done Sent Done false
2617 1720 Acked Write 10 Done Sent Done false
2618 1721 Acked Write 2 Done Sent Done false
2619 1722 Acked Read 4 Done Sent Done false
2620 1723 Acked Read 1 Done Sent Done false
2621 1724 Acked Write 10 Done Sent Done false
2622 1725 Acked Read 9 Done Sent Done false
2623 1726 Acked Read 10 Done Sent Done false
2624 1727 Acked Write 3 Done Sent Done false
2625 1728 Acked Read 6 Done Sent Done false
2626 1729 Acked Read 7 Done Sent Done false
2627 1730 Acked Read 9 Done Sent Done false
2628 1731 Acked Read 3 Done Sent Done false
2629 1732 Acked Write 1 Done Sent Done false
2630 1733 Acked Flush 0 Done Sent Done false
2631 1734 Acked Read 6 Done Sent Done false
2632 1735 Acked Read 5 Done Sent Done false
2633 1736 Acked Write 9 Done Sent Done false
2634 1737 Acked Write 3 Done Sent Done false
2635 1738 Acked Write 10 Done Sent Done false
2636 1739 Acked Flush 0 Done Sent Done false
2637 1740 Acked Write 1 Done Sent Done false
2638 1741 Acked Write 3 Done Sent Done false
2639 1742 Acked Read 1 Done Sent Done false
2640 1743 Acked Write 4 Done Sent Done false
2641 1744 Acked Write 3 Done Sent Done false
2642 1745 Acked Read 1 Done Sent Done false
2643 1746 Acked Write 1 Done Sent Done false
2644 1747 Acked Read 1 Done Sent Done false
2645 1748 Acked Write 2 Done Sent Done false
2646 1749 Acked Read 9 Done Sent Done false
2647 1750 Acked Write 6 Done Sent Done false
2648 1751 Acked Read 9 Done Sent Done false
2649 1752 Acked Write 1 Done Sent Done false
2650 1753 Acked Flush 0 Done Sent Done false
2651 1754 Acked Write 1 Done Sent Done false
2652 1755 Acked Flush 0 Done Sent Done false
2653 1756 Acked Read 8 Done Sent Done false
2654 1757 Acked Write 5 Done Sent Done false
2655 1758 Acked Flush 0 Done Sent Done false
2656 1759 Acked Write 9 Done Sent Done false
2657 1760 Acked Read 4 Done Sent Done false
2658 1761 Acked Write 1 Done Sent Done false
2659 1762 Acked Read 4 Done Sent Done false
2660 1763 Acked Read 6 Done Sent Done false
2661 1764 Acked Read 10 Done Sent Done false
2662 1765 Acked Read 6 Done Sent Done false
2663 1766 Acked Read 4 Done Sent Done false
2664 1767 Acked Read 4 Done Sent Done false
2665 1768 Acked Read 9 Done Sent Done false
2666 1769 Acked Write 5 Done Sent Done false
2667 1770 Acked Read 1 Done Sent Done false
2668 1771 Acked Flush 0 Done Sent Done false
2669 1772 Acked Read 2 Done Sent Done false
2670 1773 Acked Flush 0 Done Sent Done false
2671 1774 Acked Flush 0 Done Sent Done false
2672 1775 Acked Read 9 Done Sent Done false
2673 1776 Acked Write 2 Done Sent Done false
2674 1777 Acked Write 5 Done Sent Done false
2675 1778 Acked Read 4 Done Sent Done false
2676 1779 Acked Read 6 Done Sent Done false
2677 1780 Acked Flush 0 Done Sent Done false
2678 1781 Acked Read 8 Done Sent Done false
2679 1782 Acked Write 8 Done Sent Done false
2680 1783 Acked Read 6 Done Sent Done false
2681 1784 Acked Read 9 Done Sent Done false
2682 1785 Acked Read 9 Done Sent Done false
2683 1786 Acked Write 9 Done Sent Done false
2684 1787 Acked Write 5 Done Sent Done false
2685 1788 Acked Write 9 Done Sent Done false
2686 1789 Acked Write 8 Done Sent Done false
2687 1790 Acked Write 6 Done Sent Done false
2688 1791 Acked Write 10 Done Sent Done false
2689 1792 Acked Read 6 Done Sent Done false
2690 1793 Acked Read 6 Done Sent Done false
2691 1794 Acked Read 3 Done Sent Done false
2692 1795 Acked Read 8 Done Sent Done false
2693 1796 Acked Read 6 Done Sent Done false
2694 1797 Acked Read 2 Done Sent Done false
2695 1798 Acked Read 6 Done Sent Done false
2696 1799 Acked Write 3 Done Sent Done false
2697 1800 Acked Read 8 Done Sent Done false
2698 1801 Acked Read 1 Done Sent Done false
2699 1802 Acked Read 2 Done Sent Done false
2700 1803 Acked Read 6 Done Sent Done false
2701 1804 Acked Write 7 Done Sent Done false
2702 1805 Acked Flush 0 Done Sent Done false
2703 1806 Acked Read 10 Done Sent Done false
2704 1807 Acked Write 2 Done Sent Done false
2705 1808 Acked Write 4 Done Sent Done false
2706 1809 Acked Read 6 Done Sent Done false
2707 1810 Acked Flush 0 Done Sent Done false
2708 1811 Acked Write 6 Done Sent Done false
2709 1812 Acked Read 3 Done Sent Done false
2710 1813 Acked Write 1 Done Sent Done false
2711 1814 Acked Flush 0 Done Sent Done false
2712 1815 Acked Write 9 Done Sent Done false
2713 1816 Acked Read 4 Done Sent Done false
2714 1817 Acked Read 6 Done Sent Done false
2715 1818 Acked Read 10 Done Sent Done false
2716 1819 Acked Write 1 Done Sent Done false
2717 1820 Acked Write 9 Done Sent Done false
2718 1821 Acked Write 9 Done Sent Done false
2719 1822 Acked Read 8 Done Sent Done false
2720 1823 Acked Read 3 Done Sent Done false
2721 1824 Acked Read 9 Done Sent Done false
2722 1825 Acked Write 6 Done Sent Done false
2723 1826 Acked Write 10 Done Sent Done false
2724 1827 Acked Read 4 Done Sent Done false
2725 1828 Acked Read 4 Done Sent Done false
2726 1829 Acked Read 5 Done Sent Done false
2727 1830 Acked Read 7 Done Sent Done false
2728 1831 Acked Read 1 Done Sent Done false
2729 1832 Acked Read 9 Done Sent Done false
2730 1833 Acked Write 10 Done Sent Done false
2731 1834 Acked Read 9 Done Sent Done false
2732 1835 Acked Write 3 Done Sent Done false
2733 1836 Acked Write 7 Done Sent Done false
2734 1837 Acked Read 3 Done Sent Done false
2735 1838 Acked Flush 0 Done Sent Done false
2736 1839 Acked Read 6 Done Sent Done false
2737 1840 Acked Write 8 Done Sent Done false
2738 1841 Acked Read 6 Done Sent Done false
2739 1842 Acked Read 7 Done Sent Done false
2740 1843 Acked Read 5 Done Sent Done false
2741 1844 Acked Write 10 Done Sent Done false
2742 1845 Acked Write 3 Done Sent Done false
2743 1846 Acked Read 5 Done Sent Done false
2744 1847 Acked Write 5 Done Sent Done false
2745 1848 Acked Flush 0 Done Sent Done false
2746 1849 Acked Read 3 Done Sent Done false
2747 1850 Acked Write 8 Done Sent Done false
2748 1851 Acked Write 5 Done Sent Done false
2749 1852 Acked Read 6 Done Sent Done false
2750 1853 Acked Read 1 Done Sent Done false
2751 1854 Acked Write 3 Done Sent Done false
2752 1855 Acked Write 4 Done Sent Done false
2753 1856 Acked Read 9 Done Sent Done false
2754 1857 Acked Read 9 Done Sent Done false
2755 1858 Acked Read 7 Done Sent Done false
2756 1859 Acked Read 8 Done Sent Done false
2757 1860 Acked Write 7 Done Sent Done false
2758 1861 Acked Read 8 Done Sent Done false
2759 1862 Acked Flush 0 Done Sent Done false
2760 1863 Acked Write 4 Done Sent Done false
2761 1864 Acked Write 4 Done Sent Done false
2762 1865 Acked Write 10 Done Sent Done false
2763 1866 Acked Read 10 Done Sent Done false
2764 1867 Acked Write 2 Done Sent Done false
2765 1868 Acked Read 3 Done Sent Done false
2766 1869 Acked Write 9 Done Sent Done false
2767 1870 Acked Write 4 Done Sent Done false
2768 1871 Acked Write 7 Done Sent Done false
2769 1872 Acked Read 4 Done Sent Done false
2770 1873 Acked Write 7 Done Sent Done false
2771 1874 Acked Write 8 Done Sent Done false
2772 1875 Acked Read 6 Done Sent Done false
2773 1876 Acked Write 2 Done Sent Done false
2774 1877 Acked Flush 0 Done Sent Done false
2775 1878 Acked Read 7 Done Sent Done false
2776 1879 Acked Flush 0 Done Sent Done false
2777 1880 Acked Write 6 Done Sent Done false
2778 1881 Acked Write 10 Done Sent Done false
2779 1882 Acked Write 6 Done Sent Done false
2780 1883 Acked Read 8 Done Sent Done false
2781 1884 Acked Read 8 Done Sent Done false
2782 1885 Acked Read 9 Done Sent Done false
2783 1886 Acked Read 6 Done Sent Done false
2784 1887 Acked Read 5 Done Sent Done false
2785 1888 Acked Write 8 Done Sent Done false
2786 1889 Acked Write 10 Done Sent Done false
2787 1890 Acked Read 4 Done Sent Done false
2788 1891 Acked Write 10 Done Sent Done false
2789 1892 Acked Read 9 Done Sent Done false
2790 1893 Acked Read 1 Done Sent Done false
2791 1894 Acked Read 8 Done Sent Done false
2792 1895 Acked Read 7 Done Sent Done false
2793 1896 Acked Write 1 Done Sent Done false
2794 1897 Acked Write 8 Done Sent Done false
2795 1898 Acked Read 8 Done Sent Done false
2796 1899 Acked Read 5 Done Sent Done false
2797 1900 Acked Write 5 Done Sent Done false
2798 1901 Acked Read 7 Done Sent Done false
2799 1902 Acked Write 3 Done Sent Done false
2800 1903 Acked Read 3 Done Sent Done false
2801 STATES DS:0 DS:1 DS:2 TOTAL
2802 Sent 0 301 0 301
2803 Done 301 0 301 602
2804 Skipped 0 0 0 0
2805 Error 0 0 0 0
2806 Last Flush: 1879 1602 1879
2807 Downstairs last five completed: 1602 1601 1600 1599 1598
2808 Upstairs last five completed: 1903 1902 1901 1900 1899
2809 CLIENT: Up:0 ds:301 act:2
2810 [8820] got start action
2811 [8820] I am going to restart
2812 Starting downstairs at port 8820
2813 Make output file at "/tmp/dsc/downstairs-8820.txt"
2814 [8820][1] reports Starting
2815 Downstairs /var/tmp/dsc/region/8820 port 8820 PID:Some(1205)
2816 [8820][1] reports Running
2817 ----------------------------------------------------------------
2818 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:302
2819 States: Active Offline Active
2820 JOBID ACK TYPE BKS/EXT DS:0 DS:1 DS:2 REPLAY
2821 1603 Acked Write 9 Done Sent Done false
2822 1604 Acked Flush 0 Done Sent Done false
2823 1605 Acked Write 8 Done Sent Done false
2824 1606 Acked Write 10 Done Sent Done false
2825 1607 Acked Write 10 Done Sent Done false
2826 1608 Acked Read 2 Done Sent Done false
2827 1609 Acked Read 5 Done Sent Done false
2828 1610 Acked Write 7 Done Sent Done false
2829 1611 Acked Read 5 Done Sent Done false
2830 1612 Acked Read 4 Done Sent Done false
2831 1613 Acked Read 1 Done Sent Done false
2832 1614 Acked Read 7 Done Sent Done false
2833 1615 Acked Write 3 Done Sent Done false
2834 1616 Acked Write 6 Done Sent Done false
2835 1617 Acked Read 7 Done Sent Done false
2836 1618 Acked Flush 0 Done Sent Done false
2837 1619 Acked Write 9 Done Sent Done false
2838 1620 Acked Read 4 Done Sent Done false
2839 1621 Acked Write 4 Done Sent Done false
2840 1622 Acked Write 7 Done Sent Done false
2841 1623 Acked Read 3 Done Sent Done false
2842 1624 Acked Read 2 Done Sent Done false
2843 1625 Acked Write 5 Done Sent Done false
2844 1626 Acked Read 9 Done Sent Done false
2845 1627 Acked Write 10 Done Sent Done false
2846 1628 Acked Read 8 Done Sent Done false
2847 1629 Acked Flush 0 Done Sent Done false
2848 1630 Acked Read 9 Done Sent Done false
2849 1631 Acked Read 6 Done Sent Done false
2850 1632 Acked Read 9 Done Sent Done false
2851 1633 Acked Read 7 Done Sent Done false
2852 1634 Acked Write 6 Done Sent Done false
2853 1635 Acked Write 3 Done Sent Done false
2854 1636 Acked Write 3 Done Sent Done false
2855 1637 Acked Write 3 Done Sent Done false
2856 1638 Acked Read 9 Done Sent Done false
2857 1639 Acked Write 4 Done Sent Done false
2858 1640 Acked Write 1 Done Sent Done false
2859 1641 Acked Read 4 Done Sent Done false
2860 1642 Acked Flush 0 Done Sent Done false
2861 1643 Acked Flush 0 Done Sent Done false
2862 1644 Acked Write 6 Done Sent Done false
2863 1645 Acked Read 1 Done Sent Done false
2864 1646 Acked Read 1 Done Sent Done false
2865 1647 Acked Write 1 Done Sent Done false
2866 1648 Acked Write 3 Done Sent Done false
2867 1649 Acked Write 8 Done Sent Done false
2868 1650 Acked Read 8 Done Sent Done false
2869 1651 Acked Flush 0 Done Sent Done false
2870 1652 Acked Read 3 Done Sent Done false
2871 1653 Acked Read 8 Done Sent Done false
2872 1654 Acked Write 1 Done Sent Done false
2873 1655 Acked Read 5 Done Sent Done false
2874 1656 Acked Flush 0 Done Sent Done false
2875 1657 Acked Write 8 Done Sent Done false
2876 1658 Acked Write 1 Done Sent Done false
2877 1659 Acked Write 7 Done Sent Done false
2878 1660 Acked Write 6 Done Sent Done false
2879 1661 Acked Read 10 Done Sent Done false
2880 1662 Acked Write 2 Done Sent Done false
2881 1663 Acked Read 2 Done Sent Done false
2882 1664 Acked Read 8 Done Sent Done false
2883 1665 Acked Write 2 Done Sent Done false
2884 1666 Acked Read 8 Done Sent Done false
2885 1667 Acked Flush 0 Done Sent Done false
2886 1668 Acked Write 5 Done Sent Done false
2887 1669 Acked Read 6 Done Sent Done false
2888 1670 Acked Write 5 Done Sent Done false
2889 1671 Acked Read 2 Done Sent Done false
2890 1672 Acked Flush 0 Done Sent Done false
2891 1673 Acked Read 7 Done Sent Done false
2892 1674 Acked Read 3 Done Sent Done false
2893 1675 Acked Read 5 Done Sent Done false
2894 1676 Acked Read 1 Done Sent Done false
2895 1677 Acked Read 9 Done Sent Done false
2896 1678 Acked Read 10 Done Sent Done false
2897 1679 Acked Flush 0 Done Sent Done false
2898 1680 Acked Read 5 Done Sent Done false
2899 1681 Acked Flush 0 Done Sent Done false
2900 1682 Acked Read 6 Done Sent Done false
2901 1683 Acked Write 6 Done Sent Done false
2902 1684 Acked Write 5 Done Sent Done false
2903 1685 Acked Read 9 Done Sent Done false
2904 1686 Acked Flush 0 Done Sent Done false
2905 1687 Acked Read 5 Done Sent Done false
2906 1688 Acked Read 3 Done Sent Done false
2907 1689 Acked Write 7 Done Sent Done false
2908 1690 Acked Read 6 Done Sent Done false
2909 1691 Acked Write 5 Done Sent Done false
2910 1692 Acked Read 9 Done Sent Done false
2911 1693 Acked Write 1 Done Sent Done false
2912 1694 Acked Read 1 Done Sent Done false
2913 1695 Acked Write 9 Done Sent Done false
2914 1696 Acked Read 5 Done Sent Done false
2915 1697 Acked Read 9 Done Sent Done false
2916 1698 Acked Read 5 Done Sent Done false
2917 1699 Acked Write 6 Done Sent Done false
2918 1700 Acked Read 10 Done Sent Done false
2919 1701 Acked Read 7 Done Sent Done false
2920 1702 Acked Read 6 Done Sent Done false
2921 1703 Acked Read 5 Done Sent Done false
2922 1704 Acked Read 5 Done Sent Done false
2923 1705 Acked Read 10 Done Sent Done false
2924 1706 Acked Write 2 Done Sent Done false
2925 1707 Acked Read 3 Done Sent Done false
2926 1708 Acked Read 7 Done Sent Done false
2927 1709 Acked Write 8 Done Sent Done false
2928 1710 Acked Read 9 Done Sent Done false
2929 1711 Acked Read 10 Done Sent Done false
2930 1712 Acked Read 2 Done Sent Done false
2931 1713 Acked Flush 0 Done Sent Done false
2932 1714 Acked Write 6 Done Sent Done false
2933 1715 Acked Write 1 Done Sent Done false
2934 1716 Acked Read 7 Done Sent Done false
2935 1717 Acked Write 9 Done Sent Done false
2936 1718 Acked Write 9 Done Sent Done false
2937 1719 Acked Read 5 Done Sent Done false
2938 1720 Acked Write 10 Done Sent Done false
2939 1721 Acked Write 2 Done Sent Done false
2940 1722 Acked Read 4 Done Sent Done false
2941 1723 Acked Read 1 Done Sent Done false
2942 1724 Acked Write 10 Done Sent Done false
2943 1725 Acked Read 9 Done Sent Done false
2944 1726 Acked Read 10 Done Sent Done false
2945 1727 Acked Write 3 Done Sent Done false
2946 1728 Acked Read 6 Done Sent Done false
2947 1729 Acked Read 7 Done Sent Done false
2948 1730 Acked Read 9 Done Sent Done false
2949 1731 Acked Read 3 Done Sent Done false
2950 1732 Acked Write 1 Done Sent Done false
2951 1733 Acked Flush 0 Done Sent Done false
2952 1734 Acked Read 6 Done Sent Done false
2953 1735 Acked Read 5 Done Sent Done false
2954 1736 Acked Write 9 Done Sent Done false
2955 1737 Acked Write 3 Done Sent Done false
2956 1738 Acked Write 10 Done Sent Done false
2957 1739 Acked Flush 0 Done Sent Done false
2958 1740 Acked Write 1 Done Sent Done false
2959 1741 Acked Write 3 Done Sent Done false
2960 1742 Acked Read 1 Done Sent Done false
2961 1743 Acked Write 4 Done Sent Done false
2962 1744 Acked Write 3 Done Sent Done false
2963 1745 Acked Read 1 Done Sent Done false
2964 1746 Acked Write 1 Done Sent Done false
2965 1747 Acked Read 1 Done Sent Done false
2966 1748 Acked Write 2 Done Sent Done false
2967 1749 Acked Read 9 Done Sent Done false
2968 1750 Acked Write 6 Done Sent Done false
2969 1751 Acked Read 9 Done Sent Done false
2970 1752 Acked Write 1 Done Sent Done false
2971 1753 Acked Flush 0 Done Sent Done false
2972 1754 Acked Write 1 Done Sent Done false
2973 1755 Acked Flush 0 Done Sent Done false
2974 1756 Acked Read 8 Done Sent Done false
2975 1757 Acked Write 5 Done Sent Done false
2976 1758 Acked Flush 0 Done Sent Done false
2977 1759 Acked Write 9 Done Sent Done false
2978 1760 Acked Read 4 Done Sent Done false
2979 1761 Acked Write 1 Done Sent Done false
2980 1762 Acked Read 4 Done Sent Done false
2981 1763 Acked Read 6 Done Sent Done false
2982 1764 Acked Read 10 Done Sent Done false
2983 1765 Acked Read 6 Done Sent Done false
2984 1766 Acked Read 4 Done Sent Done false
2985 1767 Acked Read 4 Done Sent Done false
2986 1768 Acked Read 9 Done Sent Done false
2987 1769 Acked Write 5 Done Sent Done false
2988 1770 Acked Read 1 Done Sent Done false
2989 1771 Acked Flush 0 Done Sent Done false
2990 1772 Acked Read 2 Done Sent Done false
2991 1773 Acked Flush 0 Done Sent Done false
2992 1774 Acked Flush 0 Done Sent Done false
2993 1775 Acked Read 9 Done Sent Done false
2994 1776 Acked Write 2 Done Sent Done false
2995 1777 Acked Write 5 Done Sent Done false
2996 1778 Acked Read 4 Done Sent Done false
2997 1779 Acked Read 6 Done Sent Done false
2998 1780 Acked Flush 0 Done Sent Done false
2999 1781 Acked Read 8 Done Sent Done false
3000 1782 Acked Write 8 Done Sent Done false
3001 1783 Acked Read 6 Done Sent Done false
3002 1784 Acked Read 9 Done Sent Done false
3003 1785 Acked Read 9 Done Sent Done false
3004 1786 Acked Write 9 Done Sent Done false
3005 1787 Acked Write 5 Done Sent Done false
3006 1788 Acked Write 9 Done Sent Done false
3007 1789 Acked Write 8 Done Sent Done false
3008 1790 Acked Write 6 Done Sent Done false
3009 1791 Acked Write 10 Done Sent Done false
3010 1792 Acked Read 6 Done Sent Done false
3011 1793 Acked Read 6 Done Sent Done false
3012 1794 Acked Read 3 Done Sent Done false
3013 1795 Acked Read 8 Done Sent Done false
3014 1796 Acked Read 6 Done Sent Done false
3015 1797 Acked Read 2 Done Sent Done false
3016 1798 Acked Read 6 Done Sent Done false
3017 1799 Acked Write 3 Done Sent Done false
3018 1800 Acked Read 8 Done Sent Done false
3019 1801 Acked Read 1 Done Sent Done false
3020 1802 Acked Read 2 Done Sent Done false
3021 1803 Acked Read 6 Done Sent Done false
3022 1804 Acked Write 7 Done Sent Done false
3023 1805 Acked Flush 0 Done Sent Done false
3024 1806 Acked Read 10 Done Sent Done false
3025 1807 Acked Write 2 Done Sent Done false
3026 1808 Acked Write 4 Done Sent Done false
3027 1809 Acked Read 6 Done Sent Done false
3028 1810 Acked Flush 0 Done Sent Done false
3029 1811 Acked Write 6 Done Sent Done false
3030 1812 Acked Read 3 Done Sent Done false
3031 1813 Acked Write 1 Done Sent Done false
3032 1814 Acked Flush 0 Done Sent Done false
3033 1815 Acked Write 9 Done Sent Done false
3034 1816 Acked Read 4 Done Sent Done false
3035 1817 Acked Read 6 Done Sent Done false
3036 1818 Acked Read 10 Done Sent Done false
3037 1819 Acked Write 1 Done Sent Done false
3038 1820 Acked Write 9 Done Sent Done false
3039 1821 Acked Write 9 Done Sent Done false
3040 1822 Acked Read 8 Done Sent Done false
3041 1823 Acked Read 3 Done Sent Done false
3042 1824 Acked Read 9 Done Sent Done false
3043 1825 Acked Write 6 Done Sent Done false
3044 1826 Acked Write 10 Done Sent Done false
3045 1827 Acked Read 4 Done Sent Done false
3046 1828 Acked Read 4 Done Sent Done false
3047 1829 Acked Read 5 Done Sent Done false
3048 1830 Acked Read 7 Done Sent Done false
3049 1831 Acked Read 1 Done Sent Done false
3050 1832 Acked Read 9 Done Sent Done false
3051 1833 Acked Write 10 Done Sent Done false
3052 1834 Acked Read 9 Done Sent Done false
3053 1835 Acked Write 3 Done Sent Done false
3054 1836 Acked Write 7 Done Sent Done false
3055 1837 Acked Read 3 Done Sent Done false
3056 1838 Acked Flush 0 Done Sent Done false
3057 1839 Acked Read 6 Done Sent Done false
3058 1840 Acked Write 8 Done Sent Done false
3059 1841 Acked Read 6 Done Sent Done false
3060 1842 Acked Read 7 Done Sent Done false
3061 1843 Acked Read 5 Done Sent Done false
3062 1844 Acked Write 10 Done Sent Done false
3063 1845 Acked Write 3 Done Sent Done false
3064 1846 Acked Read 5 Done Sent Done false
3065 1847 Acked Write 5 Done Sent Done false
3066 1848 Acked Flush 0 Done Sent Done false
3067 1849 Acked Read 3 Done Sent Done false
3068 1850 Acked Write 8 Done Sent Done false
3069 1851 Acked Write 5 Done Sent Done false
3070 1852 Acked Read 6 Done Sent Done false
3071 1853 Acked Read 1 Done Sent Done false
3072 1854 Acked Write 3 Done Sent Done false
3073 1855 Acked Write 4 Done Sent Done false
3074 1856 Acked Read 9 Done Sent Done false
3075 1857 Acked Read 9 Done Sent Done false
3076 1858 Acked Read 7 Done Sent Done false
3077 1859 Acked Read 8 Done Sent Done false
3078 1860 Acked Write 7 Done Sent Done false
3079 1861 Acked Read 8 Done Sent Done false
3080 1862 Acked Flush 0 Done Sent Done false
3081 1863 Acked Write 4 Done Sent Done false
3082 1864 Acked Write 4 Done Sent Done false
3083 1865 Acked Write 10 Done Sent Done false
3084 1866 Acked Read 10 Done Sent Done false
3085 1867 Acked Write 2 Done Sent Done false
3086 1868 Acked Read 3 Done Sent Done false
3087 1869 Acked Write 9 Done Sent Done false
3088 1870 Acked Write 4 Done Sent Done false
3089 1871 Acked Write 7 Done Sent Done false
3090 1872 Acked Read 4 Done Sent Done false
3091 1873 Acked Write 7 Done Sent Done false
3092 1874 Acked Write 8 Done Sent Done false
3093 1875 Acked Read 6 Done Sent Done false
3094 1876 Acked Write 2 Done Sent Done false
3095 1877 Acked Flush 0 Done Sent Done false
3096 1878 Acked Read 7 Done Sent Done false
3097 1879 Acked Flush 0 Done Sent Done false
3098 1880 Acked Write 6 Done Sent Done false
3099 1881 Acked Write 10 Done Sent Done false
3100 1882 Acked Write 6 Done Sent Done false
3101 1883 Acked Read 8 Done Sent Done false
3102 1884 Acked Read 8 Done Sent Done false
3103 1885 Acked Read 9 Done Sent Done false
3104 1886 Acked Read 6 Done Sent Done false
3105 1887 Acked Read 5 Done Sent Done false
3106 1888 Acked Write 8 Done Sent Done false
3107 1889 Acked Write 10 Done Sent Done false
3108 1890 Acked Read 4 Done Sent Done false
3109 1891 Acked Write 10 Done Sent Done false
3110 1892 Acked Read 9 Done Sent Done false
3111 1893 Acked Read 1 Done Sent Done false
3112 1894 Acked Read 8 Done Sent Done false
3113 1895 Acked Read 7 Done Sent Done false
3114 1896 Acked Write 1 Done Sent Done false
3115 1897 Acked Write 8 Done Sent Done false
3116 1898 Acked Read 8 Done Sent Done false
3117 1899 Acked Read 5 Done Sent Done false
3118 1900 Acked Write 5 Done Sent Done false
3119 1901 Acked Read 7 Done Sent Done false
3120 1902 Acked Write 3 Done Sent Done false
3121 1903 Acked Read 3 Done Sent Done false
3122 1904 Acked Flush 0 Done Sent Done false
3123 STATES DS:0 DS:1 DS:2 TOTAL
3124 Sent 0 302 0 302
3125 Done 302 0 302 604
3126 Skipped 0 0 0 0
3127 Error 0 0 0 0
3128 Last Flush: 1904 1602 1904
3129 Downstairs last five completed: 1602 1601 1600 1599 1598
3130 Upstairs last five completed: 1904 1903 1902 1901 1900
3131 CLIENT: Up:0 ds:302 act:2
31322025-01-10T16:35:58.209ZINFOcrucible: connecting to 127.0.0.1:8820 = io task client = 1 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
31332025-01-10T16:35:58.209ZINFOcrucible: ds_connection connected from Ok(127.0.0.1:52529) = io task client = 1 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
31342025-01-10T16:35:58.210ZWARNcrucible: version negotiation from state Offline = downstairs client = 1 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
31352025-01-10T16:35:58.210ZINFOcrucible: downstairs client at Some(127.0.0.1:8820) has region UUID 12345678-0000-0000-0000-000000008820 = downstairs client = 1 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
31362025-01-10T16:35:58.210ZINFOcrucible: Returning UUID:12345678-0000-0000-0000-000000008820 matches = downstairs client = 1 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
31372025-01-10T16:35:58.210ZINFOcrucible: send last flush ID to this DS: 1602 = downstairs client = 1 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
31382025-01-10T16:35:58.211ZINFOcrucible: Replied this last flush ID: 1602 = downstairs client = 1 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
31392025-01-10T16:35:58.211ZINFOcrucible: ds_transition from Offline to Active = downstairs client = 1 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
31402025-01-10T16:35:58.211ZINFOcrucible: [1] Transition from Offline to Active = downstairs client = 1 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
31412025-01-10T16:35:58.211ZINFOcrucible: [1] client re-new 302 jobs since flush 1602 = downstairs session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
31422025-01-10T16:35:58.211ZINFOcrucible: [1] Replayed 302 jobs since flush: 1602 = downstairs session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
3143 ----------------------------------------------------------------
3144 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:0
3145 Downstairs last five completed: 1904 1903 1902 1901 1900
3146 Upstairs last five completed: 1904 1903 1902 1901 1900
3147 CLIENT: Up:0 ds:0 act:3
3148 Replay: All jobs finished
3149 Main task has work to do, go find it
3150 got dsc Stop(1)
3151 stop 1
3152 Jan 10 16:36:00.460 INFO request completed[8820] Got stop action so:false kr:false
3153 , latency_us: 347, response_code: 204, uri: /stop/cid/1, method: POST, req_id: ad3b5f43-3fca-43dd-b91c-b321ee4b409b, remote_addr: 127.0.0.1:55917, local_addr: 127.0.0.1:9998
3154 Jan 10 16:36:00.461 INFO request completed, latency_us: 104, response_code: 200, uri: /state/cid/1, method: GET, req_id: 7a0636a2-5f4a-49aa-968a-b277d9ab1f63, remote_addr: 127.0.0.1:55917, local_addr: 127.0.0.1:9998
31552025-01-10T16:36:00.461ZWARNcrucible: downstairs disconnected = io task client = 1 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
31562025-01-10T16:36:00.461ZWARNcrucible: client task is sending Done(Finished) = io task client = 1 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
31572025-01-10T16:36:00.461ZWARNcrucible: downstairs task for 1 stopped due to Finished session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
31582025-01-10T16:36:00.461ZINFOcrucible: ds_transition from Active to Offline = downstairs client = 1 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
31592025-01-10T16:36:00.461ZINFOcrucible: [1] Transition from Active to Offline = downstairs client = 1 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
31602025-01-10T16:36:00.461ZINFOcrucible: client task is exiting = io task client = 1 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
3161 [8820] Exited with: ExitStatus(unix_wait_status(9))
3162 [8820][1] reports Exit
3163 Jan 10 16:36:04.464 INFO request completed, latency_us: 251, response_code: 200, uri: /state/cid/1, method: GET, req_id: c556b0d8-9fe4-495b-b2ee-80e7b7ec009f, remote_addr: 127.0.0.1:55917, local_addr: 127.0.0.1:9998
3164 001/300 Read block 126 len 12288
3165 002/300 Write block 4853 len 40960 data: 3 3 3 3 3 3 3 3 3 3
3166 003/300 Read block 3937 len 24576
3167 004/300 Write block 4024 len 36864 data: 3 3 3 2 2 2 2 2 2
3168 005/300 Write block 202 len 8192 data: 2 2
3169 006/300 Write block 1521 len 28672 data: 2 2 2 2 2 2 2
3170 007/300 Read block 3716 len 28672
3171 008/300 Read block 585 len 36864
3172 009/300 Write block 744 len 20480 data: 2 2 2 2 3
3173 010/300 Write block 2788 len 4096 data: 2
3174 011/300 Write block 2607 len 40960 data: 2 2 2 2 2 2 2 2 2 2
3175 012/300 Read block 2036 len 16384
3176 013/300 Write block 2757 len 4096 data: 2
3177 014/300 Write block 3164 len 32768 data: 2 2 2 2 2 2 2 2
3178 015/300 Write block 3880 len 20480 data: 2 2 2 2 2
3179 016/300 Read block 1139 len 12288
3180 017/300 Write block 2691 len 28672 data: 2 2 2 2 2 2 2
3181 018/300 Write block 1905 len 36864 data: 2 2 3 3 3 3 3 3 3
3182 019/300 Read block 1065 len 4096
3183 020/300 Flush
3184 021/300 Read block 3257 len 12288
3185 022/300 Read block 788 len 24576
3186 023/300 Read block 418 len 32768
3187 024/300 Write block 40 len 40960 data: 3 3 3 3 3 4 4 4 3 2
3188 025/300 Read block 4366 len 28672
3189 026/300 Read block 4673 len 4096
3190 027/300 Write block 619 len 4096 data: 2
3191 028/300 Read block 199 len 8192
3192 029/300 Flush
3193 030/300 Write block 2831 len 24576 data: 2 2 2 2 2 2
3194 031/300 Write block 1935 len 36864 data: 2 2 2 2 2 2 2 2 2
3195 032/300 Write block 4186 len 8192 data: 2 2
3196 033/300 Write block 3976 len 40960 data: 2 2 2 2 3 3 3 5 5 5
3197 034/300 Write block 1827 len 28672 data: 2 2 2 2 2 2 2
3198 035/300 Read block 2285 len 4096
3199 036/300 Read block 2295 len 4096
3200 037/300 Flush
3201 038/300 Write block 2612 len 8192 data: 3 3
3202 039/300 Read block 3206 len 28672
3203 040/300 Read block 3948 len 16384
3204 041/300 Read block 1177 len 12288
3205 042/300 Read block 74 len 16384
3206 043/300 Read block 4798 len 4096
3207 044/300 Flush
3208 045/300 Read block 2953 len 40960
3209 046/300 Read block 1686 len 4096
3210 047/300 Read block 4600 len 40960
3211 048/300 Read block 2286 len 4096
3212 049/300 Read block 3098 len 12288
3213 050/300 Read block 3842 len 36864
3214 051/300 Write block 4126 len 16384 data: 2 2 2 2
3215 052/300 Read block 4389 len 8192
3216 053/300 Flush
3217 054/300 Write block 706 len 12288 data: 6 4 3
3218 055/300 Write block 228 len 20480 data: 2 2 2 2 2
3219 056/300 Read block 1915 len 4096
3220 057/300 Flush
3221 058/300 Flush
3222 059/300 Read block 3603 len 8192
3223 060/300 Write block 3522 len 20480 data: 3 3 3 3 3
3224 061/300 Read block 497 len 12288
3225 062/300 Read block 4419 len 8192
3226 063/300 Write block 4053 len 40960 data: 2 2 2 2 2 2 2 2 2 2
3227 064/300 Write block 2048 len 40960 data: 2 2 2 2 3 3 3 3 2 2
3228 065/300 Read block 1551 len 36864
3229 066/300 Read block 3721 len 32768
3230 067/300 Read block 1355 len 16384
3231 068/300 Read block 3924 len 40960
3232 069/300 Write block 336 len 20480 data: 2 2 2 2 2
3233 070/300 Write block 633 len 32768 data: 3 3 3 3 3 3 2 2
3234 071/300 Read block 1314 len 32768
3235 072/300 Read block 4819 len 40960
3236 073/300 Write block 623 len 4096 data: 2
3237 074/300 Write block 4565 len 12288 data: 2 2 2
3238 075/300 Read block 2816 len 20480
3239 076/300 Write block 392 len 24576 data: 2 2 3 3 3 2
3240 077/300 Write block 4660 len 8192 data: 2 2
3241 078/300 Write block 839 len 12288 data: 3 3 3
3242 079/300 Write block 1137 len 12288 data: 2 3 3
3243 080/300 Read block 4035 len 28672
3244 081/300 Write block 4119 len 40960 data: 2 2 2 2 2 2 2 3 3 3
3245 082/300 Read block 1341 len 24576
3246 083/300 Write block 2197 len 8192 data: 2 2
3247 084/300 Read block 3738 len 12288
3248 085/300 Read block 4784 len 20480
3249 086/300 Read block 3190 len 12288
3250 087/300 Read block 4104 len 28672
3251 088/300 Read block 4701 len 8192
3252 089/300 Flush
3253 090/300 Read block 2562 len 28672
3254 091/300 Flush
3255 092/300 Read block 266 len 16384
3256 093/300 Read block 478 len 20480
3257 094/300 Read block 1061 len 4096
3258 095/300 Flush
3259 096/300 Read block 4306 len 8192
3260 097/300 Write block 559 len 36864 data: 3 3 3 3 3 3 3 3 3
3261 098/300 Read block 617 len 20480
3262 099/300 Flush
3263 100/300 Read block 887 len 16384
3264 101/300 Read block 3059 len 20480
3265 102/300 Write block 4500 len 28672 data: 2 2 2 2 2 2 2
3266 103/300 Read block 2509 len 4096
3267 104/300 Write block 3226 len 20480 data: 4 3 3 3 3
3268 105/300 Read block 202 len 24576
3269 106/300 Read block 4550 len 20480
3270 107/300 Flush
3271 108/300 Read block 3010 len 28672
3272 109/300 Write block 1511 len 28672 data: 2 2 2 2 2 2 2
3273 110/300 Read block 3322 len 12288
3274 111/300 Write block 1653 len 16384 data: 2 2 2 2
3275 112/300 Read block 4713 len 4096
3276 113/300 Write block 2149 len 16384 data: 3 3 3 2
3277 114/300 Write block 3062 len 32768 data: 2 2 2 2 2 2 2 2
3278 115/300 Read block 4073 len 8192
3279 116/300 Read block 779 len 16384
3280 117/300 Read block 4812 len 24576
3281 118/300 Read block 3234 len 36864
3282 119/300 Read block 3862 len 28672
3283 120/300 Read block 1666 len 28672
3284 121/300 Read block 1498 len 40960
3285 122/300 Read block 2475 len 16384
3286 123/300 Read block 2881 len 24576
3287 124/300 Read block 1580 len 8192
3288 125/300 Read block 4956 len 36864
3289 126/300 Write block 4986 len 20480 data: 3 3 3 3 3
3290 127/300 Write block 721 len 32768 data: 2 2 2 3 3 2 2 2
3291 128/300 Read block 2031 len 4096
3292 129/300 Read block 4700 len 28672
3293 130/300 Write block 2865 len 40960 data: 3 3 3 3 2 2 2 3 3 3
3294 131/300 Write block 666 len 16384 data: 2 3 4 4
3295 132/300 Write block 4621 len 28672 data: 2 2 2 2 2 2 2
3296 133/300 Write block 807 len 20480 data: 4 4 4 4 4
3297 134/300 Read block 2781 len 4096
3298 135/300 Flush
3299 136/300 Read block 118 len 4096
3300 137/300 Write block 4078 len 32768 data: 2 2 2 2 2 2 2 2
3301 138/300 Write block 3368 len 24576 data: 2 2 2 2 2 2
3302 139/300 Read block 2860 len 16384
3303 140/300 Read block 1647 len 4096
3304 141/300 Write block 1777 len 24576 data: 3 3 3 4 4 4
3305 142/300 Write block 4829 len 8192 data: 2 2
3306 143/300 Write block 1144 len 36864 data: 3 3 3 2 2 2 2 2 2
3307 144/300 Write block 2100 len 16384 data: 2 2 2 2
3308 145/300 Read block 1330 len 28672
3309 146/300 Read block 2535 len 40960
3310 147/300 Read block 144 len 32768
3311 148/300 Write block 868 len 32768 data: 2 2 2 2 2 2 2 2
3312 149/300 Write block 861 len 24576 data: 2 2 2 2 2 2
3313 150/300 Read block 99 len 36864
3314 151/300 Write block 2274 len 24576 data: 2 2 3 3 3 3
3315 152/300 Flush
3316 153/300 Read block 2710 len 32768
3317 154/300 Flush
3318 155/300 Write block 731 len 36864 data: 2 3 3 3 2 2 2 2 2
3319 156/300 Read block 1557 len 28672
3320 157/300 Write block 3464 len 20480 data: 2 2 2 2 2
3321 158/300 Flush
3322 159/300 Write block 2239 len 40960 data: 2 2 2 2 3 3 3 3 4 5
3323 160/300 Read block 3326 len 8192
3324 161/300 Read block 1645 len 8192
3325 162/300 Read block 1682 len 36864
3326 163/300 Flush
3327 164/300 Read block 1533 len 20480
3328 165/300 Write block 610 len 36864 data: 2 2 3 3 3 3 3 2 2
3329 166/300 Write block 1936 len 12288 data: 3 3 3
3330 167/300 Write block 672 len 12288 data: 3 3 2
3331 168/300 Flush
3332 169/300 Write block 3057 len 36864 data: 2 2 2 2 2 3 3 3 3
3333 170/300 Write block 2268 len 20480 data: 3 2 2 2 2
3334 171/300 Read block 4379 len 32768
3335 172/300 Read block 1477 len 16384
3336 173/300 Read block 4836 len 16384
3337 174/300 Write block 99 len 36864 data: 2 2 2 2 2 2 2 2 2
3338 175/300 Flush
3339 176/300 Flush
3340 177/300 Read block 4850 len 32768
3341 178/300 Write block 2426 len 4096 data: 2
3342 179/300 Read block 918 len 28672
3343 180/300 Read block 4326 len 32768
3344 181/300 Flush
3345 182/300 Read block 3155 len 8192
3346 183/300 Write block 1661 len 40960 data: 2 2 2 2 2 2 2 2 3 3
3347 184/300 Read block 655 len 12288
3348 185/300 Read block 2433 len 32768
3349 186/300 Read block 500 len 32768
3350 187/300 Read block 633 len 40960
3351 188/300 Read block 4192 len 20480
3352 189/300 Write block 2091 len 16384 data: 2 2 2 2
3353 190/300 Write block 3412 len 28672 data: 2 2 2 2 2 2 2
3354 191/300 Read block 3133 len 20480
3355 192/300 Write block 2258 len 40960 data: 2 2 2 2 2 2 2 2 3 3
3356 193/300 Write block 1908 len 8192 data: 4 4
3357 194/300 Read block 1696 len 24576
3358 195/300 Write block 4684 len 12288 data: 2 2 2
3359 196/300 Read block 2483 len 16384
3360 197/300 Read block 4090 len 12288
3361 198/300 Write block 1387 len 40960 data: 2 3 3 3 4 3 3 3 3 3
3362 199/300 Write block 1561 len 24576 data: 2 2 2 2 2 2
3363 200/300 Write block 1083 len 28672 data: 2 2 2 2 2 2 2
3364 201/300 Read block 658 len 28672
3365 202/300 Write block 1179 len 32768 data: 3 3 3 3 2 2 2 2
3366 203/300 Read block 2464 len 36864
3367 204/300 Write block 1633 len 36864 data: 4 3 2 2 2 2 2 2 2
3368 205/300 Write block 4112 len 40960 data: 2 2 2 2 2 2 2 3 3 3
3369 206/300 Read block 2077 len 20480
3370 207/300 Write block 2947 len 36864 data: 4 3 2 2 2 3 2 2 2
3371 208/300 Write block 4371 len 32768 data: 3 3 4 4 4 4 4 4
3372 209/300 Read block 4306 len 16384
3373 210/300 Read block 2332 len 4096
3374 211/300 Read block 2188 len 12288
3375 212/300 Read block 689 len 16384
3376 213/300 Read block 1970 len 36864
3377 214/300 Write block 1627 len 40960 data: 2 2 2 3 4 4 5 4 3 3
3378 215/300 Write block 2509 len 24576 data: 4 4 4 4 4 4
3379 216/300 Write block 936 len 32768 data: 2 2 2 2 2 3 3 3
3380 217/300 Read block 2165 len 32768
3381 218/300 Read block 1996 len 4096
3382 219/300 Read block 1400 len 16384
3383 220/300 Write block 538 len 28672 data: 2 2 2 2 2 2 2
3384 221/300 Read block 610 len 40960
3385 222/300 Write block 961 len 24576 data: 2 2 2 2 2 3
3386 223/300 Read block 4157 len 8192
3387 224/300 Write block 252 len 20480 data: 2 2 2 2 2
3388 225/300 Write block 4488 len 28672 data: 2 2 2 2 2 2 2
3389 226/300 Read block 3591 len 28672
3390 227/300 Read block 1239 len 12288
3391 228/300 Flush
3392 229/300 Read block 1402 len 40960
3393 230/300 Read block 1283 len 24576
3394 231/300 Read block 965 len 40960
3395 232/300 Write block 4713 len 20480 data: 2 2 2 2 2
3396 233/300 Read block 2921 len 20480
3397 234/300 Write block 4501 len 16384 data: 3 3 3 3
3398 235/300 Read block 416 len 16384
3399 236/300 Read block 3760 len 16384
3400 237/300 Read block 556 len 8192
3401 238/300 Write block 3708 len 40960 data: 2 3 3 4 4 4 4 4 4 3
3402 239/300 Write block 2723 len 28672 data: 2 2 2 2 2 2 2
3403 240/300 Read block 1903 len 12288
3404 241/300 Write block 480 len 12288 data: 2 2 2
3405 242/300 Write block 2282 len 20480 data: 3 2 2 2 2
3406 243/300 Read block 2486 len 12288
3407 244/300 Read block 904 len 8192
3408 245/300 Write block 283 len 36864 data: 3 2 2 2 2 2 2 2 2
3409 246/300 Read block 508 len 24576
3410 247/300 Read block 714 len 4096
3411 248/300 Read block 3147 len 16384
3412 249/300 Read block 4074 len 28672
3413 250/300 Write block 1020 len 12288 data: 3 3 4
3414 251/300 Write block 1287 len 20480 data: 2 2 2 2 2
3415 252/300 Read block 914 len 8192
3416 253/300 Read block 1024 len 8192
3417 254/300 Write block 1673 len 16384 data: 3 3 3 2
3418 255/300 Write block 626 len 40960 data: 2 2 2 2 2 3 3 4 4 4
3419 256/300 Write block 2198 len 4096 data: 3
3420 257/300 Read block 1526 len 40960
3421 258/300 Read block 3016 len 8192
3422 259/300 Write block 2449 len 8192 data: 3 3
3423 260/300 Flush
3424 261/300 Write block 1555 len 32768 data: 3 3 3 3 2 2 3 3
3425 262/300 Flush
3426 263/300 Write block 4384 len 16384 data: 2 2 2 2
3427 264/300 Read block 728 len 4096
3428 265/300 Read block 3562 len 8192
3429 266/300 Flush
3430 267/300 Write block 2588 len 20480 data: 3 3 2 2 2
3431 268/300 Read block 2340 len 4096
3432 269/300 Read block 1521 len 32768
3433 270/300 Write block 2808 len 8192 data: 2 2
3434 271/300 Write block 1309 len 12288 data: 2 2 2
3435 272/300 Read block 4473 len 40960
3436 273/300 Read block 4302 len 4096
3437 274/300 Read block 3882 len 24576
3438 275/300 Flush
3439 276/300 Read block 1290 len 8192
3440 277/300 Write block 3925 len 12288 data: 2 2 2
3441 278/300 Write block 815 len 24576 data: 2 2 2 2 2 2
3442 279/300 Flush
3443 280/300 Read block 2240 len 32768
3444 281/300 Read block 2467 len 36864
3445 282/300 Read block 4759 len 28672
3446 283/300 Flush
3447 284/300 Write block 1349 len 20480 data: 2 2 2 2 2
3448 285/300 Write block 143 len 12288 data: 2 2 2
3449 286/300 Write block 3389 len 24576 data: 2 2 2 2 2 2
3450 287/300 Write block 829 len 4096 data: 2
3451 288/300 Write block 3862 len 16384 data: 2 2 2 2
3452 289/300 Write block 1513 len 16384 data: 3 3 3 3
3453 290/300 Flush
3454 291/300 Read block 4624 len 24576
3455 292/300 Read block 3241 len 24576
3456 293/300 Write block 4551 len 32768 data: 3 4 4 4 4 5 5 4
3457 294/300 Read block 172 len 8192
3458 295/300 Read block 2205 len 40960
3459 296/300 Read block 1425 len 16384
3460 297/300 Write block 4802 len 16384 data: 2 2 2 3
3461 298/300 Write block 1658 len 40960 data: 3 3 2 3 3 3 3 3 3 3
3462 299/300 Read block 3753 len 28672
3463 300/300 Read block 1301 len 24576
3464 301/300 Read block 3268 len 32768
3465 Main task has work to do, go find it
3466 got dsc Start(1)
3467 start 1
3468 Jan 10 16:36:04.695 INFO request completed, latency_us: 201, response_code: 204, uri: /start/cid/1, method: POST, req_id: 4cfebcc8-1c73-4830-b3b2-0e4f20ff2a42, remote_addr: 127.0.0.1:55917, local_addr: 127.0.0.1:9998
3469 Replay: started 1, returned:Ok(())
3470 ----------------------------------------------------------------
3471 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:301
3472 States: Active Offline Active
3473 JOBID ACK TYPE BKS/EXT DS:0 DS:1 DS:2 REPLAY
3474 1905 Acked Read 3 Done Sent Done false
3475 1906 Acked Write 10 Done Sent Done false
3476 1907 Acked Read 6 Done Sent Done false
3477 1908 Acked Write 9 Done Sent Done false
3478 1909 Acked Write 2 Done Sent Done false
3479 1910 Acked Write 7 Done Sent Done false
3480 1911 Acked Read 7 Done Sent Done false
3481 1912 Acked Read 9 Done Sent Done false
3482 1913 Acked Write 5 Done Sent Done false
3483 1914 Acked Write 1 Done Sent Done false
3484 1915 Acked Write 10 Done Sent Done false
3485 1916 Acked Read 4 Done Sent Done false
3486 1917 Acked Write 1 Done Sent Done false
3487 1918 Acked Write 8 Done Sent Done false
3488 1919 Acked Write 5 Done Sent Done false
3489 1920 Acked Read 3 Done Sent Done false
3490 1921 Acked Write 7 Done Sent Done false
3491 1922 Acked Write 9 Done Sent Done false
3492 1923 Acked Read 1 Done Sent Done false
3493 1924 Acked Flush 0 Done Sent Done false
3494 1925 Acked Read 3 Done Sent Done false
3495 1926 Acked Read 6 Done Sent Done false
3496 1927 Acked Read 8 Done Sent Done false
3497 1928 Acked Write 10 Done Sent Done false
3498 1929 Acked Read 7 Done Sent Done false
3499 1930 Acked Read 1 Done Sent Done false
3500 1931 Acked Write 1 Done Sent Done false
3501 1932 Acked Read 2 Done Sent Done false
3502 1933 Acked Flush 0 Done Sent Done false
3503 1934 Acked Write 6 Done Sent Done false
3504 1935 Acked Write 9 Done Sent Done false
3505 1936 Acked Write 2 Done Sent Done false
3506 1937 Acked Write 10 Done Sent Done false
3507 1938 Acked Write 7 Done Sent Done false
3508 1939 Acked Read 1 Done Sent Done false
3509 1940 Acked Read 1 Done Sent Done false
3510 1941 Acked Flush 0 Done Sent Done false
3511 1942 Acked Write 2 Done Sent Done false
3512 1943 Acked Read 7 Done Sent Done false
3513 1944 Acked Read 4 Done Sent Done false
3514 1945 Acked Read 3 Done Sent Done false
3515 1946 Acked Read 4 Done Sent Done false
3516 1947 Acked Read 1 Done Sent Done false
3517 1948 Acked Flush 0 Done Sent Done false
3518 1949 Acked Read 10 Done Sent Done false
3519 1950 Acked Read 1 Done Sent Done false
3520 1951 Acked Read 10 Done Sent Done false
3521 1952 Acked Read 1 Done Sent Done false
3522 1953 Acked Read 3 Done Sent Done false
3523 1954 Acked Read 9 Done Sent Done false
3524 1955 Acked Write 4 Done Sent Done false
3525 1956 Acked Read 2 Done Sent Done false
3526 1957 Acked Flush 0 Done Sent Done false
3527 1958 Acked Write 3 Done Sent Done false
3528 1959 Acked Write 5 Done Sent Done false
3529 1960 Acked Read 1 Done Sent Done false
3530 1961 Acked Flush 0 Done Sent Done false
3531 1962 Acked Flush 0 Done Sent Done false
3532 1963 Acked Read 2 Done Sent Done false
3533 1964 Acked Write 5 Done Sent Done false
3534 1965 Acked Read 3 Done Sent Done false
3535 1966 Acked Read 2 Done Sent Done false
3536 1967 Acked Write 10 Done Sent Done false
3537 1968 Acked Write 10 Done Sent Done false
3538 1969 Acked Read 9 Done Sent Done false
3539 1970 Acked Read 8 Done Sent Done false
3540 1971 Acked Read 4 Done Sent Done false
3541 1972 Acked Read 10 Done Sent Done false
3542 1973 Acked Write 5 Done Sent Done false
3543 1974 Acked Write 8 Done Sent Done false
3544 1975 Acked Read 8 Done Sent Done false
3545 1976 Acked Read 10 Done Sent Done false
3546 1977 Acked Write 1 Done Sent Done false
3547 1978 Acked Write 3 Done Sent Done false
3548 1979 Acked Read 5 Done Sent Done false
3549 1980 Acked Write 6 Done Sent Done false
3550 1981 Acked Write 2 Done Sent Done false
3551 1982 Acked Write 3 Done Sent Done false
3552 1983 Acked Write 3 Done Sent Done false
3553 1984 Acked Read 7 Done Sent Done false
3554 1985 Acked Write 10 Done Sent Done false
3555 1986 Acked Read 6 Done Sent Done false
3556 1987 Acked Write 2 Done Sent Done false
3557 1988 Acked Read 3 Done Sent Done false
3558 1989 Acked Read 5 Done Sent Done false
3559 1990 Acked Read 3 Done Sent Done false
3560 1991 Acked Read 7 Done Sent Done false
3561 1992 Acked Read 2 Done Sent Done false
3562 1993 Acked Flush 0 Done Sent Done false
3563 1994 Acked Read 7 Done Sent Done false
3564 1995 Acked Flush 0 Done Sent Done false
3565 1996 Acked Read 4 Done Sent Done false
3566 1997 Acked Read 5 Done Sent Done false
3567 1998 Acked Read 1 Done Sent Done false
3568 1999 Acked Flush 0 Done Sent Done false
3569 2000 Acked Read 2 Done Sent Done false
3570 2001 Acked Write 9 Done Sent Done false
3571 2002 Acked Read 5 Done Sent Done false
3572 2003 Acked Flush 0 Done Sent Done false
3573 2004 Acked Read 4 Done Sent Done false
3574 2005 Acked Read 5 Done Sent Done false
3575 2006 Acked Write 7 Done Sent Done false
3576 2007 Acked Read 1 Done Sent Done false
3577 2008 Acked Write 5 Done Sent Done false
3578 2009 Acked Read 6 Done Sent Done false
3579 2010 Acked Read 5 Done Sent Done false
3580 2011 Acked Flush 0 Done Sent Done false
3581 2012 Acked Read 7 Done Sent Done false
3582 2013 Acked Write 7 Done Sent Done false
3583 2014 Acked Read 3 Done Sent Done false
3584 2015 Acked Write 4 Done Sent Done false
3585 2016 Acked Read 1 Done Sent Done false
3586 2017 Acked Write 4 Done Sent Done false
3587 2018 Acked Write 8 Done Sent Done false
3588 2019 Acked Read 2 Done Sent Done false
3589 2020 Acked Read 4 Done Sent Done false
3590 2021 Acked Read 6 Done Sent Done false
3591 2022 Acked Read 9 Done Sent Done false
3592 2023 Acked Read 7 Done Sent Done false
3593 2024 Acked Read 7 Done Sent Done false
3594 2025 Acked Read 10 Done Sent Done false
3595 2026 Acked Read 4 Done Sent Done false
3596 2027 Acked Read 6 Done Sent Done false
3597 2028 Acked Read 2 Done Sent Done false
3598 2029 Acked Read 9 Done Sent Done false
3599 2030 Acked Write 5 Done Sent Done false
3600 2031 Acked Write 8 Done Sent Done false
3601 2032 Acked Read 1 Done Sent Done false
3602 2033 Acked Read 7 Done Sent Done false
3603 2034 Acked Write 10 Done Sent Done false
3604 2035 Acked Write 4 Done Sent Done false
3605 2036 Acked Write 7 Done Sent Done false
3606 2037 Acked Write 5 Done Sent Done false
3607 2038 Acked Read 1 Done Sent Done false
3608 2039 Acked Flush 0 Done Sent Done false
3609 2040 Acked Read 1 Done Sent Done false
3610 2041 Acked Write 8 Done Sent Done false
3611 2042 Acked Write 6 Done Sent Done false
3612 2043 Acked Read 4 Done Sent Done false
3613 2044 Acked Read 1 Done Sent Done false
3614 2045 Acked Write 6 Done Sent Done false
3615 2046 Acked Write 2 Done Sent Done false
3616 2047 Acked Write 9 Done Sent Done false
3617 2048 Acked Write 4 Done Sent Done false
3618 2049 Acked Read 7 Done Sent Done false
3619 2050 Acked Read 10 Done Sent Done false
3620 2051 Acked Read 8 Done Sent Done false
3621 2052 Acked Write 8 Done Sent Done false
3622 2053 Acked Write 6 Done Sent Done false
3623 2054 Acked Read 9 Done Sent Done false
3624 2055 Acked Write 6 Done Sent Done false
3625 2056 Acked Flush 0 Done Sent Done false
3626 2057 Acked Read 8 Done Sent Done false
3627 2058 Acked Flush 0 Done Sent Done false
3628 2059 Acked Write 9 Done Sent Done false
3629 2060 Acked Read 7 Done Sent Done false
3630 2061 Acked Write 5 Done Sent Done false
3631 2062 Acked Flush 0 Done Sent Done false
3632 2063 Acked Write 10 Done Sent Done false
3633 2064 Acked Read 2 Done Sent Done false
3634 2065 Acked Read 2 Done Sent Done false
3635 2066 Acked Read 9 Done Sent Done false
3636 2067 Acked Flush 0 Done Sent Done false
3637 2068 Acked Read 5 Done Sent Done false
3638 2069 Acked Write 9 Done Sent Done false
3639 2070 Acked Write 3 Done Sent Done false
3640 2071 Acked Write 3 Done Sent Done false
3641 2072 Acked Flush 0 Done Sent Done false
3642 2073 Acked Write 9 Done Sent Done false
3643 2074 Acked Write 5 Done Sent Done false
3644 2075 Acked Read 8 Done Sent Done false
3645 2076 Acked Read 4 Done Sent Done false
3646 2077 Acked Read 4 Done Sent Done false
3647 2078 Acked Write 9 Done Sent Done false
3648 2079 Acked Flush 0 Done Sent Done false
3649 2080 Acked Flush 0 Done Sent Done false
3650 2081 Acked Read 8 Done Sent Done false
3651 2082 Acked Write 1 Done Sent Done false
3652 2083 Acked Read 7 Done Sent Done false
3653 2084 Acked Read 8 Done Sent Done false
3654 2085 Acked Flush 0 Done Sent Done false
3655 2086 Acked Read 2 Done Sent Done false
3656 2087 Acked Write 10 Done Sent Done false
3657 2088 Acked Read 3 Done Sent Done false
3658 2089 Acked Read 8 Done Sent Done false
3659 2090 Acked Read 8 Done Sent Done false
3660 2091 Acked Read 10 Done Sent Done false
3661 2092 Acked Read 5 Done Sent Done false
3662 2093 Acked Write 4 Done Sent Done false
3663 2094 Acked Write 7 Done Sent Done false
3664 2095 Acked Read 5 Done Sent Done false
3665 2096 Acked Write 10 Done Sent Done false
3666 2097 Acked Write 2 Done Sent Done false
3667 2098 Acked Read 6 Done Sent Done false
3668 2099 Acked Write 3 Done Sent Done false
3669 2100 Acked Read 4 Done Sent Done false
3670 2101 Acked Read 3 Done Sent Done false
3671 2102 Acked Write 10 Done Sent Done false
3672 2103 Acked Write 6 Done Sent Done false
3673 2104 Acked Write 7 Done Sent Done false
3674 2105 Acked Read 7 Done Sent Done false
3675 2106 Acked Write 8 Done Sent Done false
3676 2107 Acked Read 9 Done Sent Done false
3677 2108 Acked Write 9 Done Sent Done false
3678 2109 Acked Write 10 Done Sent Done false
3679 2110 Acked Read 5 Done Sent Done false
3680 2111 Acked Write 9 Done Sent Done false
3681 2112 Acked Write 8 Done Sent Done false
3682 2113 Acked Read 4 Done Sent Done false
3683 2114 Acked Read 1 Done Sent Done false
3684 2115 Acked Read 3 Done Sent Done false
3685 2116 Acked Read 4 Done Sent Done false
3686 2117 Acked Read 9 Done Sent Done false
3687 2118 Acked Write 10 Done Sent Done false
3688 2119 Acked Write 6 Done Sent Done false
3689 2120 Acked Write 8 Done Sent Done false
3690 2121 Acked Read 8 Done Sent Done false
3691 2122 Acked Read 1 Done Sent Done false
3692 2123 Acked Read 4 Done Sent Done false
3693 2124 Acked Write 7 Done Sent Done false
3694 2125 Acked Read 10 Done Sent Done false
3695 2126 Acked Write 6 Done Sent Done false
3696 2127 Acked Read 2 Done Sent Done false
3697 2128 Acked Write 5 Done Sent Done false
3698 2129 Acked Write 7 Done Sent Done false
3699 2130 Acked Read 7 Done Sent Done false
3700 2131 Acked Read 3 Done Sent Done false
3701 2132 Acked Flush 0 Done Sent Done false
3702 2133 Acked Read 10 Done Sent Done false
3703 2134 Acked Read 6 Done Sent Done false
3704 2135 Acked Read 10 Done Sent Done false
3705 2136 Acked Write 5 Done Sent Done false
3706 2137 Acked Read 5 Done Sent Done false
3707 2138 Acked Write 4 Done Sent Done false
3708 2139 Acked Read 4 Done Sent Done false
3709 2140 Acked Read 4 Done Sent Done false
3710 2141 Acked Read 2 Done Sent Done false
3711 2142 Acked Write 10 Done Sent Done false
3712 2143 Acked Write 7 Done Sent Done false
3713 2144 Acked Read 3 Done Sent Done false
3714 2145 Acked Write 3 Done Sent Done false
3715 2146 Acked Write 5 Done Sent Done false
3716 2147 Acked Read 3 Done Sent Done false
3717 2148 Acked Read 2 Done Sent Done false
3718 2149 Acked Write 9 Done Sent Done false
3719 2150 Acked Read 6 Done Sent Done false
3720 2151 Acked Read 1 Done Sent Done false
3721 2152 Acked Read 4 Done Sent Done false
3722 2153 Acked Read 7 Done Sent Done false
3723 2154 Acked Write 3 Done Sent Done false
3724 2155 Acked Write 5 Done Sent Done false
3725 2156 Acked Read 2 Done Sent Done false
3726 2157 Acked Read 2 Done Sent Done false
3727 2158 Acked Write 4 Done Sent Done false
3728 2159 Acked Write 10 Done Sent Done false
3729 2160 Acked Write 1 Done Sent Done false
3730 2161 Acked Read 10 Done Sent Done false
3731 2162 Acked Read 2 Done Sent Done false
3732 2163 Acked Write 2 Done Sent Done false
3733 2164 Acked Flush 0 Done Sent Done false
3734 2165 Acked Write 8 Done Sent Done false
3735 2166 Acked Flush 0 Done Sent Done false
3736 2167 Acked Write 4 Done Sent Done false
3737 2168 Acked Read 1 Done Sent Done false
3738 2169 Acked Read 2 Done Sent Done false
3739 2170 Acked Flush 0 Done Sent Done false
3740 2171 Acked Write 5 Done Sent Done false
3741 2172 Acked Read 1 Done Sent Done false
3742 2173 Acked Read 8 Done Sent Done false
3743 2174 Acked Write 2 Done Sent Done false
3744 2175 Acked Write 3 Done Sent Done false
3745 2176 Acked Read 10 Done Sent Done false
3746 2177 Acked Read 1 Done Sent Done false
3747 2178 Acked Read 6 Done Sent Done false
3748 2179 Acked Flush 0 Done Sent Done false
3749 2180 Acked Read 2 Done Sent Done false
3750 2181 Acked Write 3 Done Sent Done false
3751 2182 Acked Write 6 Done Sent Done false
3752 2183 Acked Flush 0 Done Sent Done false
3753 2184 Acked Read 8 Done Sent Done false
3754 2185 Acked Read 9 Done Sent Done false
3755 2186 Acked Read 7 Done Sent Done false
3756 2187 Acked Flush 0 Done Sent Done false
3757 2188 Acked Write 5 Done Sent Done false
3758 2189 Acked Write 3 Done Sent Done false
3759 2190 Acked Write 6 Done Sent Done false
3760 2191 Acked Write 1 Done Sent Done false
3761 2192 Acked Write 4 Done Sent Done false
3762 2193 Acked Write 4 Done Sent Done false
3763 2194 Acked Flush 0 Done Sent Done false
3764 2195 Acked Read 6 Done Sent Done false
3765 2196 Acked Read 6 Done Sent Done false
3766 2197 Acked Write 8 Done Sent Done false
3767 2198 Acked Read 2 Done Sent Done false
3768 2199 Acked Read 10 Done Sent Done false
3769 2200 Acked Read 4 Done Sent Done false
3770 2201 Acked Write 4 Done Sent Done false
3771 2202 Acked Write 10 Done Sent Done false
3772 2203 Acked Read 7 Done Sent Done false
3773 2204 Acked Read 6 Done Sent Done false
3774 2205 Acked Read 8 Done Sent Done false
3775 STATES DS:0 DS:1 DS:2 TOTAL
3776 Sent 0 301 0 301
3777 Done 301 0 301 602
3778 Skipped 0 0 0 0
3779 Error 0 0 0 0
3780 Last Flush: 2194 1904 2194
3781 Downstairs last five completed: 1904 1903 1902 1901 1900
3782 Upstairs last five completed: 2205 2204 2203 2202 2201
3783 CLIENT: Up:0 ds:301 act:2
3784 [8820] got start action
3785 [8820] I am going to restart
3786 Starting downstairs at port 8820
3787 Make output file at "/tmp/dsc/downstairs-8820.txt"
3788 [8820][1] reports Starting
3789 Downstairs /var/tmp/dsc/region/8820 port 8820 PID:Some(1206)
3790 [8820][1] reports Running
3791 ----------------------------------------------------------------
3792 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:302
3793 States: Active Offline Active
3794 JOBID ACK TYPE BKS/EXT DS:0 DS:1 DS:2 REPLAY
3795 1905 Acked Read 3 Done Sent Done false
3796 1906 Acked Write 10 Done Sent Done false
3797 1907 Acked Read 6 Done Sent Done false
3798 1908 Acked Write 9 Done Sent Done false
3799 1909 Acked Write 2 Done Sent Done false
3800 1910 Acked Write 7 Done Sent Done false
3801 1911 Acked Read 7 Done Sent Done false
3802 1912 Acked Read 9 Done Sent Done false
3803 1913 Acked Write 5 Done Sent Done false
3804 1914 Acked Write 1 Done Sent Done false
3805 1915 Acked Write 10 Done Sent Done false
3806 1916 Acked Read 4 Done Sent Done false
3807 1917 Acked Write 1 Done Sent Done false
3808 1918 Acked Write 8 Done Sent Done false
3809 1919 Acked Write 5 Done Sent Done false
3810 1920 Acked Read 3 Done Sent Done false
3811 1921 Acked Write 7 Done Sent Done false
3812 1922 Acked Write 9 Done Sent Done false
3813 1923 Acked Read 1 Done Sent Done false
3814 1924 Acked Flush 0 Done Sent Done false
3815 1925 Acked Read 3 Done Sent Done false
3816 1926 Acked Read 6 Done Sent Done false
3817 1927 Acked Read 8 Done Sent Done false
3818 1928 Acked Write 10 Done Sent Done false
3819 1929 Acked Read 7 Done Sent Done false
3820 1930 Acked Read 1 Done Sent Done false
3821 1931 Acked Write 1 Done Sent Done false
3822 1932 Acked Read 2 Done Sent Done false
3823 1933 Acked Flush 0 Done Sent Done false
3824 1934 Acked Write 6 Done Sent Done false
3825 1935 Acked Write 9 Done Sent Done false
3826 1936 Acked Write 2 Done Sent Done false
3827 1937 Acked Write 10 Done Sent Done false
3828 1938 Acked Write 7 Done Sent Done false
3829 1939 Acked Read 1 Done Sent Done false
3830 1940 Acked Read 1 Done Sent Done false
3831 1941 Acked Flush 0 Done Sent Done false
3832 1942 Acked Write 2 Done Sent Done false
3833 1943 Acked Read 7 Done Sent Done false
3834 1944 Acked Read 4 Done Sent Done false
3835 1945 Acked Read 3 Done Sent Done false
3836 1946 Acked Read 4 Done Sent Done false
3837 1947 Acked Read 1 Done Sent Done false
3838 1948 Acked Flush 0 Done Sent Done false
3839 1949 Acked Read 10 Done Sent Done false
3840 1950 Acked Read 1 Done Sent Done false
3841 1951 Acked Read 10 Done Sent Done false
3842 1952 Acked Read 1 Done Sent Done false
3843 1953 Acked Read 3 Done Sent Done false
3844 1954 Acked Read 9 Done Sent Done false
3845 1955 Acked Write 4 Done Sent Done false
3846 1956 Acked Read 2 Done Sent Done false
3847 1957 Acked Flush 0 Done Sent Done false
3848 1958 Acked Write 3 Done Sent Done false
3849 1959 Acked Write 5 Done Sent Done false
3850 1960 Acked Read 1 Done Sent Done false
3851 1961 Acked Flush 0 Done Sent Done false
3852 1962 Acked Flush 0 Done Sent Done false
3853 1963 Acked Read 2 Done Sent Done false
3854 1964 Acked Write 5 Done Sent Done false
3855 1965 Acked Read 3 Done Sent Done false
3856 1966 Acked Read 2 Done Sent Done false
3857 1967 Acked Write 10 Done Sent Done false
3858 1968 Acked Write 10 Done Sent Done false
3859 1969 Acked Read 9 Done Sent Done false
3860 1970 Acked Read 8 Done Sent Done false
3861 1971 Acked Read 4 Done Sent Done false
3862 1972 Acked Read 10 Done Sent Done false
3863 1973 Acked Write 5 Done Sent Done false
3864 1974 Acked Write 8 Done Sent Done false
3865 1975 Acked Read 8 Done Sent Done false
3866 1976 Acked Read 10 Done Sent Done false
3867 1977 Acked Write 1 Done Sent Done false
3868 1978 Acked Write 3 Done Sent Done false
3869 1979 Acked Read 5 Done Sent Done false
3870 1980 Acked Write 6 Done Sent Done false
3871 1981 Acked Write 2 Done Sent Done false
3872 1982 Acked Write 3 Done Sent Done false
3873 1983 Acked Write 3 Done Sent Done false
3874 1984 Acked Read 7 Done Sent Done false
3875 1985 Acked Write 10 Done Sent Done false
3876 1986 Acked Read 6 Done Sent Done false
3877 1987 Acked Write 2 Done Sent Done false
3878 1988 Acked Read 3 Done Sent Done false
3879 1989 Acked Read 5 Done Sent Done false
3880 1990 Acked Read 3 Done Sent Done false
3881 1991 Acked Read 7 Done Sent Done false
3882 1992 Acked Read 2 Done Sent Done false
3883 1993 Acked Flush 0 Done Sent Done false
3884 1994 Acked Read 7 Done Sent Done false
3885 1995 Acked Flush 0 Done Sent Done false
3886 1996 Acked Read 4 Done Sent Done false
3887 1997 Acked Read 5 Done Sent Done false
3888 1998 Acked Read 1 Done Sent Done false
3889 1999 Acked Flush 0 Done Sent Done false
3890 2000 Acked Read 2 Done Sent Done false
3891 2001 Acked Write 9 Done Sent Done false
3892 2002 Acked Read 5 Done Sent Done false
3893 2003 Acked Flush 0 Done Sent Done false
3894 2004 Acked Read 4 Done Sent Done false
3895 2005 Acked Read 5 Done Sent Done false
3896 2006 Acked Write 7 Done Sent Done false
3897 2007 Acked Read 1 Done Sent Done false
3898 2008 Acked Write 5 Done Sent Done false
3899 2009 Acked Read 6 Done Sent Done false
3900 2010 Acked Read 5 Done Sent Done false
3901 2011 Acked Flush 0 Done Sent Done false
3902 2012 Acked Read 7 Done Sent Done false
3903 2013 Acked Write 7 Done Sent Done false
3904 2014 Acked Read 3 Done Sent Done false
3905 2015 Acked Write 4 Done Sent Done false
3906 2016 Acked Read 1 Done Sent Done false
3907 2017 Acked Write 4 Done Sent Done false
3908 2018 Acked Write 8 Done Sent Done false
3909 2019 Acked Read 2 Done Sent Done false
3910 2020 Acked Read 4 Done Sent Done false
3911 2021 Acked Read 6 Done Sent Done false
3912 2022 Acked Read 9 Done Sent Done false
3913 2023 Acked Read 7 Done Sent Done false
3914 2024 Acked Read 7 Done Sent Done false
3915 2025 Acked Read 10 Done Sent Done false
3916 2026 Acked Read 4 Done Sent Done false
3917 2027 Acked Read 6 Done Sent Done false
3918 2028 Acked Read 2 Done Sent Done false
3919 2029 Acked Read 9 Done Sent Done false
3920 2030 Acked Write 5 Done Sent Done false
3921 2031 Acked Write 8 Done Sent Done false
3922 2032 Acked Read 1 Done Sent Done false
3923 2033 Acked Read 7 Done Sent Done false
3924 2034 Acked Write 10 Done Sent Done false
3925 2035 Acked Write 4 Done Sent Done false
3926 2036 Acked Write 7 Done Sent Done false
3927 2037 Acked Write 5 Done Sent Done false
3928 2038 Acked Read 1 Done Sent Done false
3929 2039 Acked Flush 0 Done Sent Done false
3930 2040 Acked Read 1 Done Sent Done false
3931 2041 Acked Write 8 Done Sent Done false
3932 2042 Acked Write 6 Done Sent Done false
3933 2043 Acked Read 4 Done Sent Done false
3934 2044 Acked Read 1 Done Sent Done false
3935 2045 Acked Write 6 Done Sent Done false
3936 2046 Acked Write 2 Done Sent Done false
3937 2047 Acked Write 9 Done Sent Done false
3938 2048 Acked Write 4 Done Sent Done false
3939 2049 Acked Read 7 Done Sent Done false
3940 2050 Acked Read 10 Done Sent Done false
3941 2051 Acked Read 8 Done Sent Done false
3942 2052 Acked Write 8 Done Sent Done false
3943 2053 Acked Write 6 Done Sent Done false
3944 2054 Acked Read 9 Done Sent Done false
3945 2055 Acked Write 6 Done Sent Done false
3946 2056 Acked Flush 0 Done Sent Done false
3947 2057 Acked Read 8 Done Sent Done false
3948 2058 Acked Flush 0 Done Sent Done false
3949 2059 Acked Write 9 Done Sent Done false
3950 2060 Acked Read 7 Done Sent Done false
3951 2061 Acked Write 5 Done Sent Done false
3952 2062 Acked Flush 0 Done Sent Done false
3953 2063 Acked Write 10 Done Sent Done false
3954 2064 Acked Read 2 Done Sent Done false
3955 2065 Acked Read 2 Done Sent Done false
3956 2066 Acked Read 9 Done Sent Done false
3957 2067 Acked Flush 0 Done Sent Done false
3958 2068 Acked Read 5 Done Sent Done false
3959 2069 Acked Write 9 Done Sent Done false
3960 2070 Acked Write 3 Done Sent Done false
3961 2071 Acked Write 3 Done Sent Done false
3962 2072 Acked Flush 0 Done Sent Done false
3963 2073 Acked Write 9 Done Sent Done false
3964 2074 Acked Write 5 Done Sent Done false
3965 2075 Acked Read 8 Done Sent Done false
3966 2076 Acked Read 4 Done Sent Done false
3967 2077 Acked Read 4 Done Sent Done false
3968 2078 Acked Write 9 Done Sent Done false
3969 2079 Acked Flush 0 Done Sent Done false
3970 2080 Acked Flush 0 Done Sent Done false
3971 2081 Acked Read 8 Done Sent Done false
3972 2082 Acked Write 1 Done Sent Done false
3973 2083 Acked Read 7 Done Sent Done false
3974 2084 Acked Read 8 Done Sent Done false
3975 2085 Acked Flush 0 Done Sent Done false
3976 2086 Acked Read 2 Done Sent Done false
3977 2087 Acked Write 10 Done Sent Done false
3978 2088 Acked Read 3 Done Sent Done false
3979 2089 Acked Read 8 Done Sent Done false
3980 2090 Acked Read 8 Done Sent Done false
3981 2091 Acked Read 10 Done Sent Done false
3982 2092 Acked Read 5 Done Sent Done false
3983 2093 Acked Write 4 Done Sent Done false
3984 2094 Acked Write 7 Done Sent Done false
3985 2095 Acked Read 5 Done Sent Done false
3986 2096 Acked Write 10 Done Sent Done false
3987 2097 Acked Write 2 Done Sent Done false
3988 2098 Acked Read 6 Done Sent Done false
3989 2099 Acked Write 3 Done Sent Done false
3990 2100 Acked Read 4 Done Sent Done false
3991 2101 Acked Read 3 Done Sent Done false
3992 2102 Acked Write 10 Done Sent Done false
3993 2103 Acked Write 6 Done Sent Done false
3994 2104 Acked Write 7 Done Sent Done false
3995 2105 Acked Read 7 Done Sent Done false
3996 2106 Acked Write 8 Done Sent Done false
3997 2107 Acked Read 9 Done Sent Done false
3998 2108 Acked Write 9 Done Sent Done false
3999 2109 Acked Write 10 Done Sent Done false
4000 2110 Acked Read 5 Done Sent Done false
4001 2111 Acked Write 9 Done Sent Done false
4002 2112 Acked Write 8 Done Sent Done false
4003 2113 Acked Read 4 Done Sent Done false
4004 2114 Acked Read 1 Done Sent Done false
4005 2115 Acked Read 3 Done Sent Done false
4006 2116 Acked Read 4 Done Sent Done false
4007 2117 Acked Read 9 Done Sent Done false
4008 2118 Acked Write 10 Done Sent Done false
4009 2119 Acked Write 6 Done Sent Done false
4010 2120 Acked Write 8 Done Sent Done false
4011 2121 Acked Read 8 Done Sent Done false
4012 2122 Acked Read 1 Done Sent Done false
4013 2123 Acked Read 4 Done Sent Done false
4014 2124 Acked Write 7 Done Sent Done false
4015 2125 Acked Read 10 Done Sent Done false
4016 2126 Acked Write 6 Done Sent Done false
4017 2127 Acked Read 2 Done Sent Done false
4018 2128 Acked Write 5 Done Sent Done false
4019 2129 Acked Write 7 Done Sent Done false
4020 2130 Acked Read 7 Done Sent Done false
4021 2131 Acked Read 3 Done Sent Done false
4022 2132 Acked Flush 0 Done Sent Done false
4023 2133 Acked Read 10 Done Sent Done false
4024 2134 Acked Read 6 Done Sent Done false
4025 2135 Acked Read 10 Done Sent Done false
4026 2136 Acked Write 5 Done Sent Done false
4027 2137 Acked Read 5 Done Sent Done false
4028 2138 Acked Write 4 Done Sent Done false
4029 2139 Acked Read 4 Done Sent Done false
4030 2140 Acked Read 4 Done Sent Done false
4031 2141 Acked Read 2 Done Sent Done false
4032 2142 Acked Write 10 Done Sent Done false
4033 2143 Acked Write 7 Done Sent Done false
4034 2144 Acked Read 3 Done Sent Done false
4035 2145 Acked Write 3 Done Sent Done false
4036 2146 Acked Write 5 Done Sent Done false
4037 2147 Acked Read 3 Done Sent Done false
4038 2148 Acked Read 2 Done Sent Done false
4039 2149 Acked Write 9 Done Sent Done false
4040 2150 Acked Read 6 Done Sent Done false
4041 2151 Acked Read 1 Done Sent Done false
4042 2152 Acked Read 4 Done Sent Done false
4043 2153 Acked Read 7 Done Sent Done false
4044 2154 Acked Write 3 Done Sent Done false
4045 2155 Acked Write 5 Done Sent Done false
4046 2156 Acked Read 2 Done Sent Done false
4047 2157 Acked Read 2 Done Sent Done false
4048 2158 Acked Write 4 Done Sent Done false
4049 2159 Acked Write 10 Done Sent Done false
4050 2160 Acked Write 1 Done Sent Done false
4051 2161 Acked Read 10 Done Sent Done false
4052 2162 Acked Read 2 Done Sent Done false
4053 2163 Acked Write 2 Done Sent Done false
4054 2164 Acked Flush 0 Done Sent Done false
4055 2165 Acked Write 8 Done Sent Done false
4056 2166 Acked Flush 0 Done Sent Done false
4057 2167 Acked Write 4 Done Sent Done false
4058 2168 Acked Read 1 Done Sent Done false
4059 2169 Acked Read 2 Done Sent Done false
4060 2170 Acked Flush 0 Done Sent Done false
4061 2171 Acked Write 5 Done Sent Done false
4062 2172 Acked Read 1 Done Sent Done false
4063 2173 Acked Read 8 Done Sent Done false
4064 2174 Acked Write 2 Done Sent Done false
4065 2175 Acked Write 3 Done Sent Done false
4066 2176 Acked Read 10 Done Sent Done false
4067 2177 Acked Read 1 Done Sent Done false
4068 2178 Acked Read 6 Done Sent Done false
4069 2179 Acked Flush 0 Done Sent Done false
4070 2180 Acked Read 2 Done Sent Done false
4071 2181 Acked Write 3 Done Sent Done false
4072 2182 Acked Write 6 Done Sent Done false
4073 2183 Acked Flush 0 Done Sent Done false
4074 2184 Acked Read 8 Done Sent Done false
4075 2185 Acked Read 9 Done Sent Done false
4076 2186 Acked Read 7 Done Sent Done false
4077 2187 Acked Flush 0 Done Sent Done false
4078 2188 Acked Write 5 Done Sent Done false
4079 2189 Acked Write 3 Done Sent Done false
4080 2190 Acked Write 6 Done Sent Done false
4081 2191 Acked Write 1 Done Sent Done false
4082 2192 Acked Write 4 Done Sent Done false
4083 2193 Acked Write 4 Done Sent Done false
4084 2194 Acked Flush 0 Done Sent Done false
4085 2195 Acked Read 6 Done Sent Done false
4086 2196 Acked Read 6 Done Sent Done false
4087 2197 Acked Write 8 Done Sent Done false
4088 2198 Acked Read 2 Done Sent Done false
4089 2199 Acked Read 10 Done Sent Done false
4090 2200 Acked Read 4 Done Sent Done false
4091 2201 Acked Write 4 Done Sent Done false
4092 2202 Acked Write 10 Done Sent Done false
4093 2203 Acked Read 7 Done Sent Done false
4094 2204 Acked Read 6 Done Sent Done false
4095 2205 Acked Read 8 Done Sent Done false
4096 2206 Acked Flush 0 Done Sent Done false
4097 STATES DS:0 DS:1 DS:2 TOTAL
4098 Sent 0 302 0 302
4099 Done 302 0 302 604
4100 Skipped 0 0 0 0
4101 Error 0 0 0 0
4102 Last Flush: 2206 1904 2206
4103 Downstairs last five completed: 1904 1903 1902 1901 1900
4104 Upstairs last five completed: 2206 2205 2204 2203 2202
4105 CLIENT: Up:0 ds:302 act:2
41062025-01-10T16:36:10.462ZINFOcrucible: connecting to 127.0.0.1:8820 = io task client = 1 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
41072025-01-10T16:36:10.462ZINFOcrucible: ds_connection connected from Ok(127.0.0.1:61369) = io task client = 1 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
41082025-01-10T16:36:10.464ZWARNcrucible: version negotiation from state Offline = downstairs client = 1 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
41092025-01-10T16:36:10.464ZINFOcrucible: downstairs client at Some(127.0.0.1:8820) has region UUID 12345678-0000-0000-0000-000000008820 = downstairs client = 1 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
41102025-01-10T16:36:10.464ZINFOcrucible: Returning UUID:12345678-0000-0000-0000-000000008820 matches = downstairs client = 1 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
41112025-01-10T16:36:10.464ZINFOcrucible: send last flush ID to this DS: 1904 = downstairs client = 1 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
41122025-01-10T16:36:10.464ZINFOcrucible: Replied this last flush ID: 1904 = downstairs client = 1 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
41132025-01-10T16:36:10.464ZINFOcrucible: ds_transition from Offline to Active = downstairs client = 1 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
41142025-01-10T16:36:10.464ZINFOcrucible: [1] Transition from Offline to Active = downstairs client = 1 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
41152025-01-10T16:36:10.464ZINFOcrucible: [1] client re-new 302 jobs since flush 1904 = downstairs session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
41162025-01-10T16:36:10.465ZINFOcrucible: [1] Replayed 302 jobs since flush: 1904 = downstairs session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
4117 ----------------------------------------------------------------
4118 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:0
4119 Downstairs last five completed: 2206 2205 2204 2203 2202
4120 Upstairs last five completed: 2206 2205 2204 2203 2202
4121 CLIENT: Up:0 ds:0 act:3
4122 Replay: All jobs finished
4123 Main task has work to do, go find it
4124 got dsc Stop(2)
4125 stop 2
4126 Jan 10 16:36:12.699 INFO request completed, latency_us: 383, response_code: 204, uri: /stop/cid/2[8830] Got stop action so:false kr:false
4127 , method: POST, req_id: d258d6ee-b88e-4f5f-9388-8a8d6a144126, remote_addr: 127.0.0.1:55917, local_addr: 127.0.0.1:9998
41282025-01-10T16:36:12.700ZWARNcrucible: downstairs disconnected = io task client = 2 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
41292025-01-10T16:36:12.700ZWARNcrucible: client task is sending Done(Finished) = io task client = 2 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
41302025-01-10T16:36:12.700ZWARNcrucible: downstairs task for 2 stopped due to Finished session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
4131 Jan 10 16:36:12.700 INFO request completed, latency_us: 156, response_code: 200, uri: /state/cid/2, method: GET, req_id: 353b2a24-ba12-4383-98e9-69205824553c, remote_addr: 127.0.0.1:55917, local_addr: 127.0.0.1:{"msg":"ds_transition from Active to Offline","v":0,"name":"crucible","level":30,"time":"2025-01-10T16:36:12.700905287Z","hostname":"w-01JH8H1N3KXZ9F8ZV6CCMP5KTQ","pid":1202,"client":"2","":"downstairs","session_id":"1df3ca91-4dc9-42d6-9897-461254b5afe2"}
4132 9998
41332025-01-10T16:36:12.700ZINFOcrucible: [2] Transition from Active to Offline = downstairs client = 2 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
41342025-01-10T16:36:12.701ZINFOcrucible: client task is exiting = io task client = 2 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
4135 [8830] Exited with: ExitStatus(unix_wait_status(9))
4136 [8830][2] reports Exit
4137 Jan 10 16:36:16.702 INFO request completed, latency_us: 538, response_code: 200, uri: /state/cid/2, method: GET, req_id: a2462ec3-d7fe-442a-8ad0-8df6fa6991c9, remote_addr: 127.0.0.1:55917, local_addr: 127.0.0.1:9998
4138 001/300 Read block 509 len 16384
4139 002/300 Read block 2697 len 32768
4140 003/300 Read block 1448 len 8192
4141 004/300 Write block 4901 len 16384 data: 2 2 2 2
4142 005/300 Write block 4579 len 12288 data: 3 3 3
4143 006/300 Write block 1037 len 4096 data: 2
4144 007/300 Write block 3825 len 24576 data: 2 2 2 2 2 2
4145 008/300 Write block 4281 len 16384 data: 2 2 2 2
4146 009/300 Read block 2768 len 40960
4147 010/300 Read block 1225 len 4096
4148 011/300 Read block 3620 len 32768
4149 012/300 Read block 3456 len 20480
4150 013/300 Read block 1982 len 8192
4151 014/300 Write block 1031 len 36864 data: 2 2 2 3 2 2 3 2 2
4152 015/300 Read block 3180 len 4096
4153 016/300 Write block 4920 len 8192 data: 2 2
4154 017/300 Read block 3495 len 16384
4155 018/300 Write block 1072 len 8192 data: 2 2
4156 019/300 Flush
4157 020/300 Write block 2154 len 12288 data: 2 2 2
4158 021/300 Write block 384 len 36864 data: 2 2 2 2 2 2 2 2 3
4159 022/300 Read block 2614 len 36864
4160 023/300 Read block 1302 len 16384
4161 024/300 Write block 3842 len 12288 data: 3 3 3
4162 025/300 Write block 398 len 28672 data: 2 2 2 2 2 2 2
4163 026/300 Read block 2565 len 24576
4164 027/300 Write block 4160 len 28672 data: 2 2 2 2 2 3 3
4165 028/300 Read block 1245 len 36864
4166 029/300 Read block 4242 len 12288
4167 030/300 Write block 2765 len 24576 data: 2 2 2 2 2 2
4168 031/300 Read block 3063 len 28672
4169 032/300 Write block 3692 len 4096 data: 2
4170 033/300 Read block 3174 len 4096
4171 034/300 Read block 4955 len 8192
4172 035/300 Write block 2069 len 4096 data: 4
4173 036/300 Read block 4140 len 28672
4174 037/300 Read block 4813 len 28672
4175 038/300 Read block 4267 len 24576
4176 039/300 Write block 3384 len 20480 data: 3 3 3 3 3
4177 040/300 Write block 447 len 32768 data: 3 3 3 3 3 3 2 2
4178 041/300 Read block 2406 len 28672
4179 042/300 Write block 1128 len 36864 data: 2 2 2 2 2 2 2 2 2
4180 043/300 Write block 2396 len 4096 data: 2
4181 044/300 Read block 4497 len 40960
4182 045/300 Read block 1394 len 4096
4183 046/300 Read block 167 len 16384
4184 047/300 Write block 4219 len 16384 data: 2 2 2 2
4185 048/300 Write block 160 len 16384 data: 2 2 3 2
4186 049/300 Read block 2808 len 40960
4187 050/300 Flush
4188 051/300 Write block 645 len 12288 data: 2 2 3
4189 052/300 Write block 1622 len 4096 data: 2
4190 053/300 Read block 4123 len 20480
4191 054/300 Write block 4201 len 36864 data: 4 4 4 4 3 2 2 3 3
4192 055/300 Flush
4193 056/300 Write block 4325 len 36864 data: 2 2 2 2 2 2 2 2 2
4194 057/300 Read block 1732 len 16384
4195 058/300 Write block 2053 len 16384 data: 4 4 4 3
4196 059/300 Write block 73 len 12288 data: 3 3 3
4197 060/300 Write block 633 len 16384 data: 5 5 5 4
4198 061/300 Read block 3808 len 40960
4199 062/300 Write block 1561 len 16384 data: 4 4 3 3
4200 063/300 Read block 2285 len 8192
4201 064/300 Write block 3943 len 32768 data: 3 3 4 4 3 3 2 2
4202 065/300 Write block 16 len 24576 data: 5 4 3 2 2 2
4203 066/300 Write block 1981 len 4096 data: 2
4204 067/300 Read block 1490 len 12288
4205 068/300 Write block 3218 len 20480 data: 4 4 4 3 2
4206 069/300 Read block 4416 len 20480
4207 070/300 Read block 3255 len 16384
4208 071/300 Write block 2439 len 32768 data: 2 2 2 2 2 2 2 3
4209 072/300 Write block 1170 len 16384 data: 3 3 3 3
4210 073/300 Write block 2758 len 36864 data: 2 2 2 2 2 2 2 3 3
4211 074/300 Read block 3161 len 8192
4212 075/300 Write block 763 len 12288 data: 3 4 4
4213 076/300 Write block 1774 len 28672 data: 2 2 3 4 4 4 5
4214 077/300 Read block 1235 len 32768
4215 078/300 Write block 511 len 12288 data: 3 3 3
4216 079/300 Read block 4875 len 12288
4217 080/300 Write block 2394 len 40960 data: 2 2 3 2 2 2 2 2 2 2
4218 081/300 Write block 3340 len 8192 data: 2 2
4219 082/300 Write block 3864 len 28672 data: 3 3 2 2 2 2 2
4220 083/300 Read block 2840 len 40960
4221 084/300 Write block 1762 len 20480 data: 3 3 3 2 2
4222 085/300 Read block 2297 len 16384
4223 086/300 Flush
4224 087/300 Read block 2530 len 32768
4225 088/300 Read block 14 len 28672
4226 089/300 Read block 3970 len 36864
4227 090/300 Write block 4644 len 12288 data: 2 3 3
4228 091/300 Write block 3959 len 36864 data: 2 2 2 2 2 2 2 2 2
4229 092/300 Read block 4074 len 16384
4230 093/300 Read block 4851 len 36864
4231 094/300 Write block 2428 len 28672 data: 2 2 2 2 2 2 2
4232 095/300 Write block 917 len 16384 data: 3 4 4 3
4233 096/300 Read block 4084 len 4096
4234 097/300 Write block 2306 len 24576 data: 2 2 2 2 3 3
4235 098/300 Flush
4236 099/300 Flush
4237 100/300 Write block 4482 len 24576 data: 2 2 2 2 2 2
4238 101/300 Write block 181 len 24576 data: 3 3 3 4 4 5
4239 102/300 Read block 295 len 12288
4240 103/300 Read block 1687 len 40960
4241 104/300 Flush
4242 105/300 Flush
4243 106/300 Flush
4244 107/300 Write block 4879 len 12288 data: 2 2 2
4245 108/300 Write block 1564 len 8192 data: 4 3
4246 109/300 Flush
4247 110/300 Write block 674 len 40960 data: 3 2 2 3 2 4 5 5 5 5
4248 111/300 Read block 3117 len 40960
4249 112/300 Write block 643 len 12288 data: 2 2 3
4250 113/300 Read block 4610 len 40960
4251 114/300 Write block 3895 len 24576 data: 2 2 2 2 2 2
4252 115/300 Write block 4444 len 8192 data: 2 2
4253 116/300 Read block 113 len 12288
4254 117/300 Write block 2550 len 16384 data: 2 3 3 3
4255 118/300 Read block 158 len 24576
4256 119/300 Read block 2596 len 24576
4257 120/300 Write block 1980 len 12288 data: 2 3 2
4258 121/300 Flush
4259 122/300 Read block 399 len 36864
4260 123/300 Read block 520 len 12288
4261 124/300 Read block 4185 len 4096
4262 125/300 Read block 3511 len 32768
4263 126/300 Write block 1811 len 32768 data: 2 2 2 2 2 2 2 2
4264 127/300 Read block 2890 len 4096
4265 128/300 Write block 268 len 20480 data: 2 2 2 2 2
4266 129/300 Write block 1925 len 28672 data: 2 2 2 2 2 2 2
4267 130/300 Write block 4219 len 16384 data: 3 3 3 3
4268 131/300 Write block 176 len 8192 data: 2 2
4269 132/300 Flush
4270 133/300 Write block 3392 len 40960 data: 3 3 3 2 2 2 2 2 2 2
4271 134/300 Write block 774 len 20480 data: 4 4 3 3 3
4272 135/300 Read block 168 len 32768
4273 136/300 Flush
4274 137/300 Read block 710 len 36864
4275 138/300 Write block 3854 len 8192 data: 2 2
4276 139/300 Read block 3524 len 32768
4277 140/300 Read block 1523 len 8192
4278 141/300 Flush
4279 142/300 Write block 599 len 40960 data: 3 3 3 2 3 3 4 4 4 3
4280 143/300 Read block 244 len 20480
4281 144/300 Flush
4282 145/300 Read block 4278 len 24576
4283 146/300 Read block 1176 len 12288
4284 147/300 Read block 1983 len 24576
4285 148/300 Flush
4286 149/300 Write block 2897 len 36864 data: 3 3 3 3 3 3 3 3 2
4287 150/300 Write block 1646 len 32768 data: 2 2 2 2 2 2 2 3
4288 151/300 Write block 369 len 32768 data: 3 3 3 2 2 2 2 2
4289 152/300 Write block 4047 len 12288 data: 2 3 3
4290 153/300 Read block 2342 len 16384
4291 154/300 Read block 3766 len 32768
4292 155/300 Read block 3851 len 8192
4293 156/300 Write block 3750 len 16384 data: 2 2 2 2
4294 157/300 Write block 1549 len 24576 data: 3 2 2 2 2 2
4295 158/300 Write block 1514 len 8192 data: 4 4
4296 159/300 Read block 2336 len 36864
4297 160/300 Flush
4298 161/300 Write block 1545 len 36864 data: 3 3 4 3 4 3 3 3 3
4299 162/300 Read block 1241 len 4096
4300 163/300 Read block 1428 len 40960
4301 164/300 Read block 1853 len 4096
4302 165/300 Read block 351 len 20480
4303 166/300 Read block 1921 len 24576
4304 167/300 Read block 4058 len 28672
4305 168/300 Write block 143 len 4096 data: 3
4306 169/300 Write block 2152 len 40960 data: 3 2 3 3 3 2 2 3 3 3
4307 170/300 Read block 2863 len 28672
4308 171/300 Write block 3921 len 20480 data: 2 2 2 2 3
4309 172/300 Read block 4201 len 40960
4310 173/300 Read block 3564 len 32768
4311 174/300 Write block 1820 len 16384 data: 2 2 2 2
4312 175/300 Write block 68 len 40960 data: 2 2 2 2 4 4 4 4 4 4
4313 176/300 Flush
4314 177/300 Read block 2577 len 16384
4315 178/300 Read block 3164 len 20480
4316 179/300 Read block 2826 len 28672
4317 180/300 Read block 212 len 24576
4318 181/300 Write block 496 len 12288 data: 2 2 2
4319 182/300 Write block 1372 len 28672 data: 2 2 2 2 2 2 2
4320 183/300 Read block 1847 len 8192
4321 184/300 Flush
4322 185/300 Write block 2372 len 32768 data: 2 2 2 2 2 2 2 2
4323 186/300 Read block 4079 len 24576
4324 187/300 Read block 4239 len 32768
4325 188/300 Flush
4326 189/300 Read block 4113 len 12288
4327 190/300 Write block 3795 len 32768 data: 2 2 2 2 2 2 2 2
4328 191/300 Read block 1455 len 16384
4329 192/300 Write block 2836 len 16384 data: 3 2 2 2
4330 193/300 Read block 1408 len 24576
4331 194/300 Write block 4174 len 40960 data: 2 2 2 2 2 3 3 3 3 3
4332 195/300 Flush
4333 196/300 Write block 557 len 40960 data: 2 3 4 4 4 4 4 4 4 4
4334 197/300 Write block 2849 len 12288 data: 2 2 2
4335 198/300 Write block 3333 len 36864 data: 2 2 2 2 2 2 2 3 3
4336 199/300 Read block 3124 len 36864
4337 200/300 Flush
4338 201/300 Write block 1951 len 4096 data: 2
4339 202/300 Read block 1123 len 28672
4340 203/300 Read block 343 len 12288
4341 204/300 Write block 2193 len 28672 data: 2 2 2 2 3 4 2
4342 205/300 Read block 1426 len 12288
4343 206/300 Read block 344 len 4096
4344 207/300 Read block 57 len 36864
4345 208/300 Write block 122 len 8192 data: 2 2
4346 209/300 Read block 805 len 24576
4347 210/300 Read block 157 len 16384
4348 211/300 Write block 2760 len 16384 data: 3 3 3 3
4349 212/300 Read block 277 len 40960
4350 213/300 Write block 2239 len 32768 data: 3 3 3 3 4 4 4 4
4351 214/300 Write block 1884 len 12288 data: 2 2 2
4352 215/300 Write block 2053 len 32768 data: 5 5 5 4 3 2 2 2
4353 216/300 Read block 3797 len 12288
4354 217/300 Flush
4355 218/300 Write block 4690 len 28672 data: 2 2 2 2 2 2 2
4356 219/300 Write block 3994 len 36864 data: 3 3 3 2 2 2 2 2 2
4357 220/300 Flush
4358 221/300 Write block 249 len 20480 data: 2 2 2 3 3
4359 222/300 Write block 3766 len 16384 data: 2 2 2 2
4360 223/300 Write block 1009 len 16384 data: 2 2 2 3
4361 224/300 Write block 67 len 32768 data: 2 3 3 3 3 5 5 5
4362 225/300 Read block 2581 len 20480
4363 226/300 Read block 1797 len 32768
4364 227/300 Read block 1788 len 16384
4365 228/300 Read block 909 len 4096
4366 229/300 Read block 4622 len 20480
4367 230/300 Write block 2203 len 12288 data: 2 2 2
4368 231/300 Read block 1985 len 4096
4369 232/300 Write block 2362 len 12288 data: 4 4 4
4370 233/300 Read block 3028 len 8192
4371 234/300 Read block 4114 len 4096
4372 235/300 Flush
4373 236/300 Write block 4998 len 4096 data: 2
4374 237/300 Write block 960 len 24576 data: 2 3 3 3 3 3
4375 238/300 Write block 4440 len 32768 data: 4 4 3 3 3 3 2 2
4376 239/300 Write block 705 len 8192 data: 5 7
4377 240/300 Write block 1029 len 36864 data: 3 2 3 3 3 4 3 3 4
4378 241/300 Read block 3437 len 24576
4379 242/300 Read block 2862 len 16384
4380 243/300 Read block 2566 len 4096
4381 244/300 Write block 690 len 36864 data: 3 3 2 2 2 2 2 2 3
4382 245/300 Read block 1347 len 4096
4383 246/300 Write block 3606 len 16384 data: 2 2 2 2
4384 247/300 Read block 1031 len 20480
4385 248/300 Read block 2929 len 4096
4386 249/300 Write block 439 len 24576 data: 2 2 2 2 3 3
4387 250/300 Write block 4622 len 40960 data: 3 3 3 3 3 3 2 2 2 2
4388 251/300 Read block 3707 len 28672
4389 252/300 Read block 2759 len 16384
4390 253/300 Read block 1697 len 28672
4391 254/300 Write block 1359 len 28672 data: 2 2 2 2 2 2 2
4392 255/300 Read block 91 len 36864
4393 256/300 Read block 2949 len 28672
4394 257/300 Read block 2454 len 24576
4395 258/300 Flush
4396 259/300 Flush
4397 260/300 Read block 220 len 28672
4398 261/300 Read block 3067 len 4096
4399 262/300 Read block 4494 len 16384
4400 263/300 Write block 1599 len 24576 data: 2 3 3 3 2 2
4401 264/300 Read block 2171 len 8192
4402 265/300 Write block 2543 len 4096 data: 2
4403 266/300 Read block 205 len 32768
4404 267/300 Flush
4405 268/300 Write block 2069 len 20480 data: 5 4 4 3 3
4406 269/300 Write block 4117 len 24576 data: 3 3 4 4 4 3
4407 270/300 Write block 1641 len 16384 data: 3 2 2 2
4408 271/300 Write block 1447 len 8192 data: 2 2
4409 272/300 Read block 1515 len 40960
4410 273/300 Write block 1260 len 40960 data: 3 3 2 2 2 2 2 2 2 2
4411 274/300 Write block 1691 len 20480 data: 2 2 2 2 2
4412 275/300 Write block 4148 len 40960 data: 2 2 2 2 2 2 2 2 2 2
4413 276/300 Flush
4414 277/300 Write block 4944 len 40960 data: 2 2 2 2 2 2 2 2 2 2
4415 278/300 Read block 4080 len 32768
4416 279/300 Write block 4802 len 28672 data: 3 3 3 4 3 3 3
4417 280/300 Read block 3788 len 40960
4418 281/300 Read block 379 len 36864
4419 282/300 Flush
4420 283/300 Write block 1320 len 36864 data: 3 2 2 2 2 2 3 4 4
4421 284/300 Read block 1750 len 28672
4422 285/300 Write block 4090 len 40960 data: 3 3 3 3 3 3 3 2 2 2
4423 286/300 Write block 4570 len 8192 data: 3 3
4424 287/300 Read block 3739 len 36864
4425 288/300 Read block 4890 len 40960
4426 289/300 Read block 3732 len 20480
4427 290/300 Write block 205 len 40960 data: 2 2 3 2 3 3 3 3 3 3
4428 291/300 Write block 4937 len 4096 data: 2
4429 292/300 Read block 2112 len 20480
4430 293/300 Write block 3673 len 28672 data: 2 2 2 2 2 2 3
4431 294/300 Write block 1339 len 16384 data: 3 3 3 4
4432 295/300 Read block 1586 len 40960
4433 296/300 Read block 1827 len 28672
4434 297/300 Write block 1878 len 24576 data: 3 3 3 3 2 2
4435 298/300 Read block 4374 len 28672
4436 299/300 Read block 641 len 32768
4437 300/300 Read block 3953 len 40960
4438 301/300 Write block 4849 len 12288 data: 2 2 2
4439 Main task has work to do, go find it
4440 got dsc Start(2)
4441 start 2
4442 Jan 10 16:36:16.934 INFO request completed, latency_us: 205, response_code: 204, uri: /start/cid/2, method: POST, req_id: 61e912b6-9105-4273-9722-9ed1f0699e28, remote_addr: 127.0.0.1:55917, local_addr: 127.0.0.1:9998
4443 Replay: started 2, returned:Ok(())
4444 ----------------------------------------------------------------
4445 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:301
4446 States: Active Active Offline
4447 JOBID ACK TYPE BKS/EXT DS:0 DS:1 DS:2 REPLAY
4448 2207 Acked Read 4 Done Done Sent false
4449 2208 Acked Read 8 Done Done Sent false
4450 2209 Acked Read 2 Done Done Sent false
4451 2210 Acked Write 4 Done Done Sent false
4452 2211 Acked Write 3 Done Done Sent false
4453 2212 Acked Write 1 Done Done Sent false
4454 2213 Acked Write 6 Done Done Sent false
4455 2214 Acked Write 4 Done Done Sent false
4456 2215 Acked Read 10 Done Done Sent false
4457 2216 Acked Read 1 Done Done Sent false
4458 2217 Acked Read 8 Done Done Sent false
4459 2218 Acked Read 5 Done Done Sent false
4460 2219 Acked Read 2 Done Done Sent false
4461 2220 Acked Write 9 Done Done Sent false
4462 2221 Acked Read 1 Done Done Sent false
4463 2222 Acked Write 2 Done Done Sent false
4464 2223 Acked Read 4 Done Done Sent false
4465 2224 Acked Write 2 Done Done Sent false
4466 2225 Acked Flush 0 Done Done Sent false
4467 2226 Acked Write 3 Done Done Sent false
4468 2227 Acked Write 9 Done Done Sent false
4469 2228 Acked Read 9 Done Done Sent false
4470 2229 Acked Read 4 Done Done Sent false
4471 2230 Acked Write 3 Done Done Sent false
4472 2231 Acked Write 7 Done Done Sent false
4473 2232 Acked Read 6 Done Done Sent false
4474 2233 Acked Write 7 Done Done Sent false
4475 2234 Acked Read 9 Done Done Sent false
4476 2235 Acked Read 3 Done Done Sent false
4477 2236 Acked Write 6 Done Done Sent false
4478 2237 Acked Read 7 Done Done Sent false
4479 2238 Acked Write 1 Done Done Sent false
4480 2239 Acked Read 1 Done Done Sent false
4481 2240 Acked Read 2 Done Done Sent false
4482 2241 Acked Write 1 Done Done Sent false
4483 2242 Acked Read 7 Done Done Sent false
4484 2243 Acked Read 7 Done Done Sent false
4485 2244 Acked Read 6 Done Done Sent false
4486 2245 Acked Write 5 Done Done Sent false
4487 2246 Acked Write 8 Done Done Sent false
4488 2247 Acked Read 7 Done Done Sent false
4489 2248 Acked Write 9 Done Done Sent false
4490 2249 Acked Write 1 Done Done Sent false
4491 2250 Acked Read 10 Done Done Sent false
4492 2251 Acked Read 1 Done Done Sent false
4493 2252 Acked Read 4 Done Done Sent false
4494 2253 Acked Write 4 Done Done Sent false
4495 2254 Acked Write 4 Done Done Sent false
4496 2255 Acked Read 10 Done Done Sent false
4497 2256 Acked Flush 0 Done Done Sent false
4498 2257 Acked Write 3 Done Done Sent false
4499 2258 Acked Write 1 Done Done Sent false
4500 2259 Acked Read 5 Done Done Sent false
4501 2260 Acked Write 9 Done Done Sent false
4502 2261 Acked Flush 0 Done Done Sent false
4503 2262 Acked Write 9 Done Done Sent false
4504 2263 Acked Read 4 Done Done Sent false
4505 2264 Acked Write 4 Done Done Sent false
4506 2265 Acked Write 3 Done Done Sent false
4507 2266 Acked Write 4 Done Done Sent false
4508 2267 Acked Read 10 Done Done Sent false
4509 2268 Acked Write 4 Done Done Sent false
4510 2269 Acked Read 2 Done Done Sent false
4511 2270 Acked Write 8 Done Done Sent false
4512 2271 Acked Write 6 Done Done Sent false
4513 2272 Acked Write 1 Done Done Sent false
4514 2273 Acked Read 3 Done Done Sent false
4515 2274 Acked Write 5 Done Done Sent false
4516 2275 Acked Read 5 Done Done Sent false
4517 2276 Acked Read 4 Done Done Sent false
4518 2277 Acked Write 8 Done Done Sent false
4519 2278 Acked Write 4 Done Done Sent false
4520 2279 Acked Write 9 Done Done Sent false
4521 2280 Acked Read 2 Done Done Sent false
4522 2281 Acked Write 3 Done Done Sent false
4523 2282 Acked Write 7 Done Done Sent false
4524 2283 Acked Read 8 Done Done Sent false
4525 2284 Acked Write 3 Done Done Sent false
4526 2285 Acked Read 3 Done Done Sent false
4527 2286 Acked Write 10 Done Done Sent false
4528 2287 Acked Write 2 Done Done Sent false
4529 2288 Acked Write 7 Done Done Sent false
4530 2289 Acked Read 10 Done Done Sent false
4531 2290 Acked Write 5 Done Done Sent false
4532 2291 Acked Read 4 Done Done Sent false
4533 2292 Acked Flush 0 Done Done Sent false
4534 2293 Acked Read 8 Done Done Sent false
4535 2294 Acked Read 7 Done Done Sent false
4536 2295 Acked Read 9 Done Done Sent false
4537 2296 Acked Write 3 Done Done Sent false
4538 2297 Acked Write 9 Done Done Sent false
4539 2298 Acked Read 4 Done Done Sent false
4540 2299 Acked Read 9 Done Done Sent false
4541 2300 Acked Write 7 Done Done Sent false
4542 2301 Acked Write 4 Done Done Sent false
4543 2302 Acked Read 1 Done Done Sent false
4544 2303 Acked Write 6 Done Done Sent false
4545 2304 Acked Flush 0 Done Done Sent false
4546 2305 Acked Flush 0 Done Done Sent false
4547 2306 Acked Write 6 Done Done Sent false
4548 2307 Acked Write 6 Done Done Sent false
4549 2308 Acked Read 3 Done Done Sent false
4550 2309 Acked Read 10 Done Done Sent false
4551 2310 Acked Flush 0 Done Done Sent false
4552 2311 Acked Flush 0 Done Done Sent false
4553 2312 Acked Flush 0 Done Done Sent false
4554 2313 Acked Write 3 Done Done Sent false
4555 2314 Acked Write 2 Done Done Sent false
4556 2315 Acked Flush 0 Done Done Sent false
4557 2316 Acked Write 10 Done Done Sent false
4558 2317 Acked Read 10 Done Done Sent false
4559 2318 Acked Write 3 Done Done Sent false
4560 2319 Acked Read 10 Done Done Sent false
4561 2320 Acked Write 6 Done Done Sent false
4562 2321 Acked Write 2 Done Done Sent false
4563 2322 Acked Read 3 Done Done Sent false
4564 2323 Acked Write 4 Done Done Sent false
4565 2324 Acked Read 6 Done Done Sent false
4566 2325 Acked Read 6 Done Done Sent false
4567 2326 Acked Write 3 Done Done Sent false
4568 2327 Acked Flush 0 Done Done Sent false
4569 2328 Acked Read 9 Done Done Sent false
4570 2329 Acked Read 3 Done Done Sent false
4571 2330 Acked Read 1 Done Done Sent false
4572 2331 Acked Read 8 Done Done Sent false
4573 2332 Acked Write 8 Done Done Sent false
4574 2333 Acked Read 1 Done Done Sent false
4575 2334 Acked Write 5 Done Done Sent false
4576 2335 Acked Write 7 Done Done Sent false
4577 2336 Acked Write 4 Done Done Sent false
4578 2337 Acked Write 2 Done Done Sent false
4579 2338 Acked Flush 0 Done Done Sent false
4580 2339 Acked Write 10 Done Done Sent false
4581 2340 Acked Write 5 Done Done Sent false
4582 2341 Acked Read 8 Done Done Sent false
4583 2342 Acked Flush 0 Done Done Sent false
4584 2343 Acked Read 9 Done Done Sent false
4585 2344 Acked Write 2 Done Done Sent false
4586 2345 Acked Read 8 Done Done Sent false
4587 2346 Acked Read 2 Done Done Sent false
4588 2347 Acked Flush 0 Done Done Sent false
4589 2348 Acked Write 10 Done Done Sent false
4590 2349 Acked Read 5 Done Done Sent false
4591 2350 Acked Flush 0 Done Done Sent false
4592 2351 Acked Read 6 Done Done Sent false
4593 2352 Acked Read 3 Done Done Sent false
4594 2353 Acked Read 6 Done Done Sent false
4595 2354 Acked Flush 0 Done Done Sent false
4596 2355 Acked Write 9 Done Done Sent false
4597 2356 Acked Write 8 Done Done Sent false
4598 2357 Acked Write 8 Done Done Sent false
4599 2358 Acked Write 3 Done Done Sent false
4600 2359 Acked Read 4 Done Done Sent false
4601 2360 Acked Read 8 Done Done Sent false
4602 2361 Acked Read 2 Done Done Sent false
4603 2362 Acked Write 4 Done Done Sent false
4604 2363 Acked Write 6 Done Done Sent false
4605 2364 Acked Write 2 Done Done Sent false
4606 2365 Acked Read 9 Done Done Sent false
4607 2366 Acked Flush 0 Done Done Sent false
4608 2367 Acked Write 9 Done Done Sent false
4609 2368 Acked Read 1 Done Done Sent false
4610 2369 Acked Read 10 Done Done Sent false
4611 2370 Acked Read 1 Done Done Sent false
4612 2371 Acked Read 5 Done Done Sent false
4613 2372 Acked Read 6 Done Done Sent false
4614 2373 Acked Read 7 Done Done Sent false
4615 2374 Acked Write 1 Done Done Sent false
4616 2375 Acked Write 10 Done Done Sent false
4617 2376 Acked Read 7 Done Done Sent false
4618 2377 Acked Write 5 Done Done Sent false
4619 2378 Acked Read 10 Done Done Sent false
4620 2379 Acked Read 8 Done Done Sent false
4621 2380 Acked Write 4 Done Done Sent false
4622 2381 Acked Write 10 Done Done Sent false
4623 2382 Acked Flush 0 Done Done Sent false
4624 2383 Acked Read 4 Done Done Sent false
4625 2384 Acked Read 5 Done Done Sent false
4626 2385 Acked Read 7 Done Done Sent false
4627 2386 Acked Read 6 Done Done Sent false
4628 2387 Acked Write 3 Done Done Sent false
4629 2388 Acked Write 7 Done Done Sent false
4630 2389 Acked Read 2 Done Done Sent false
4631 2390 Acked Flush 0 Done Done Sent false
4632 2391 Acked Write 8 Done Done Sent false
4633 2392 Acked Read 6 Done Done Sent false
4634 2393 Acked Read 8 Done Done Sent false
4635 2394 Acked Flush 0 Done Done Sent false
4636 2395 Acked Read 3 Done Done Sent false
4637 2396 Acked Write 8 Done Done Sent false
4638 2397 Acked Read 4 Done Done Sent false
4639 2398 Acked Write 4 Done Done Sent false
4640 2399 Acked Read 6 Done Done Sent false
4641 2400 Acked Write 10 Done Done Sent false
4642 2401 Acked Flush 0 Done Done Sent false
4643 2402 Acked Write 10 Done Done Sent false
4644 2403 Acked Write 3 Done Done Sent false
4645 2404 Acked Write 9 Done Done Sent false
4646 2405 Acked Read 9 Done Done Sent false
4647 2406 Acked Flush 0 Done Done Sent false
4648 2407 Acked Write 1 Done Done Sent false
4649 2408 Acked Read 7 Done Done Sent false
4650 2409 Acked Read 3 Done Done Sent false
4651 2410 Acked Write 7 Done Done Sent false
4652 2411 Acked Read 3 Done Done Sent false
4653 2412 Acked Read 1 Done Done Sent false
4654 2413 Acked Read 9 Done Done Sent false
4655 2414 Acked Write 2 Done Done Sent false
4656 2415 Acked Read 6 Done Done Sent false
4657 2416 Acked Read 4 Done Done Sent false
4658 2417 Acked Write 4 Done Done Sent false
4659 2418 Acked Read 10 Done Done Sent false
4660 2419 Acked Write 8 Done Done Sent false
4661 2420 Acked Write 3 Done Done Sent false
4662 2421 Acked Write 8 Done Done Sent false
4663 2422 Acked Read 3 Done Done Sent false
4664 2423 Acked Flush 0 Done Done Sent false
4665 2424 Acked Write 7 Done Done Sent false
4666 2425 Acked Write 9 Done Done Sent false
4667 2426 Acked Flush 0 Done Done Sent false
4668 2427 Acked Write 5 Done Done Sent false
4669 2428 Acked Write 4 Done Done Sent false
4670 2429 Acked Write 4 Done Done Sent false
4671 2430 Acked Write 8 Done Done Sent false
4672 2431 Acked Read 5 Done Done Sent false
4673 2432 Acked Read 8 Done Done Sent false
4674 2433 Acked Read 4 Done Done Sent false
4675 2434 Acked Read 1 Done Done Sent false
4676 2435 Acked Read 5 Done Done Sent false
4677 2436 Acked Write 3 Done Done Sent false
4678 2437 Acked Read 1 Done Done Sent false
4679 2438 Acked Write 3 Done Done Sent false
4680 2439 Acked Read 2 Done Done Sent false
4681 2440 Acked Read 1 Done Done Sent false
4682 2441 Acked Flush 0 Done Done Sent false
4683 2442 Acked Write 1 Done Done Sent false
4684 2443 Acked Write 6 Done Done Sent false
4685 2444 Acked Write 8 Done Done Sent false
4686 2445 Acked Write 2 Done Done Sent false
4687 2446 Acked Write 9 Done Done Sent false
4688 2447 Acked Read 6 Done Done Sent false
4689 2448 Acked Read 4 Done Done Sent false
4690 2449 Acked Read 1 Done Done Sent false
4691 2450 Acked Write 9 Done Done Sent false
4692 2451 Acked Read 1 Done Done Sent false
4693 2452 Acked Write 4 Done Done Sent false
4694 2453 Acked Read 5 Done Done Sent false
4695 2454 Acked Read 1 Done Done Sent false
4696 2455 Acked Write 6 Done Done Sent false
4697 2456 Acked Write 10 Done Done Sent false
4698 2457 Acked Read 7 Done Done Sent false
4699 2458 Acked Read 4 Done Done Sent false
4700 2459 Acked Read 7 Done Done Sent false
4701 2460 Acked Write 7 Done Done Sent false
4702 2461 Acked Read 9 Done Done Sent false
4703 2462 Acked Read 7 Done Done Sent false
4704 2463 Acked Read 6 Done Done Sent false
4705 2464 Acked Flush 0 Done Done Sent false
4706 2465 Acked Flush 0 Done Done Sent false
4707 2466 Acked Read 7 Done Done Sent false
4708 2467 Acked Read 1 Done Done Sent false
4709 2468 Acked Read 4 Done Done Sent false
4710 2469 Acked Write 6 Done Done Sent false
4711 2470 Acked Read 2 Done Done Sent false
4712 2471 Acked Write 1 Done Done Sent false
4713 2472 Acked Read 8 Done Done Sent false
4714 2473 Acked Flush 0 Done Done Sent false
4715 2474 Acked Write 5 Done Done Sent false
4716 2475 Acked Write 6 Done Done Sent false
4717 2476 Acked Write 4 Done Done Sent false
4718 2477 Acked Write 2 Done Done Sent false
4719 2478 Acked Read 10 Done Done Sent false
4720 2479 Acked Write 10 Done Done Sent false
4721 2480 Acked Write 5 Done Done Sent false
4722 2481 Acked Write 10 Done Done Sent false
4723 2482 Acked Flush 0 Done Done Sent false
4724 2483 Acked Write 10 Done Done Sent false
4725 2484 Acked Read 8 Done Done Sent false
4726 2485 Acked Write 7 Done Done Sent false
4727 2486 Acked Read 10 Done Done Sent false
4728 2487 Acked Read 9 Done Done Sent false
4729 2488 Acked Flush 0 Done Done Sent false
4730 2489 Acked Write 9 Done Done Sent false
4731 2490 Acked Read 7 Done Done Sent false
4732 2491 Acked Write 10 Done Done Sent false
4733 2492 Acked Write 2 Done Done Sent false
4734 2493 Acked Read 9 Done Done Sent false
4735 2494 Acked Read 10 Done Done Sent false
4736 2495 Acked Read 5 Done Done Sent false
4737 2496 Acked Write 10 Done Done Sent false
4738 2497 Acked Write 1 Done Done Sent false
4739 2498 Acked Read 5 Done Done Sent false
4740 2499 Acked Write 7 Done Done Sent false
4741 2500 Acked Write 4 Done Done Sent false
4742 2501 Acked Read 10 Done Done Sent false
4743 2502 Acked Read 7 Done Done Sent false
4744 2503 Acked Write 6 Done Done Sent false
4745 2504 Acked Read 7 Done Done Sent false
4746 2505 Acked Read 8 Done Done Sent false
4747 2506 Acked Read 10 Done Done Sent false
4748 2507 Acked Write 3 Done Done Sent false
4749 STATES DS:0 DS:1 DS:2 TOTAL
4750 Sent 0 0 301 301
4751 Done 301 301 0 602
4752 Skipped 0 0 0 0
4753 Error 0 0 0 0
4754 Last Flush: 2488 2488 2206
4755 Downstairs last five completed: 2206 2205 2204 2203 2202
4756 Upstairs last five completed: 2507 2506 2505 2504 2503
4757 CLIENT: Up:0 ds:301 act:2
4758 [8830] got start action
4759 [8830] I am going to restart
4760 Starting downstairs at port 8830
4761 Make output file at "/tmp/dsc/downstairs-8830.txt"
4762 [8830][2] reports Starting
4763 Downstairs /var/tmp/dsc/region/8830 port 8830 PID:Some(1207)
4764 [8830][2] reports Running
4765 ----------------------------------------------------------------
4766 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:302
4767 States: Active Active Offline
4768 JOBID ACK TYPE BKS/EXT DS:0 DS:1 DS:2 REPLAY
4769 2207 Acked Read 4 Done Done Sent false
4770 2208 Acked Read 8 Done Done Sent false
4771 2209 Acked Read 2 Done Done Sent false
4772 2210 Acked Write 4 Done Done Sent false
4773 2211 Acked Write 3 Done Done Sent false
4774 2212 Acked Write 1 Done Done Sent false
4775 2213 Acked Write 6 Done Done Sent false
4776 2214 Acked Write 4 Done Done Sent false
4777 2215 Acked Read 10 Done Done Sent false
4778 2216 Acked Read 1 Done Done Sent false
4779 2217 Acked Read 8 Done Done Sent false
4780 2218 Acked Read 5 Done Done Sent false
4781 2219 Acked Read 2 Done Done Sent false
4782 2220 Acked Write 9 Done Done Sent false
4783 2221 Acked Read 1 Done Done Sent false
4784 2222 Acked Write 2 Done Done Sent false
4785 2223 Acked Read 4 Done Done Sent false
4786 2224 Acked Write 2 Done Done Sent false
4787 2225 Acked Flush 0 Done Done Sent false
4788 2226 Acked Write 3 Done Done Sent false
4789 2227 Acked Write 9 Done Done Sent false
4790 2228 Acked Read 9 Done Done Sent false
4791 2229 Acked Read 4 Done Done Sent false
4792 2230 Acked Write 3 Done Done Sent false
4793 2231 Acked Write 7 Done Done Sent false
4794 2232 Acked Read 6 Done Done Sent false
4795 2233 Acked Write 7 Done Done Sent false
4796 2234 Acked Read 9 Done Done Sent false
4797 2235 Acked Read 3 Done Done Sent false
4798 2236 Acked Write 6 Done Done Sent false
4799 2237 Acked Read 7 Done Done Sent false
4800 2238 Acked Write 1 Done Done Sent false
4801 2239 Acked Read 1 Done Done Sent false
4802 2240 Acked Read 2 Done Done Sent false
4803 2241 Acked Write 1 Done Done Sent false
4804 2242 Acked Read 7 Done Done Sent false
4805 2243 Acked Read 7 Done Done Sent false
4806 2244 Acked Read 6 Done Done Sent false
4807 2245 Acked Write 5 Done Done Sent false
4808 2246 Acked Write 8 Done Done Sent false
4809 2247 Acked Read 7 Done Done Sent false
4810 2248 Acked Write 9 Done Done Sent false
4811 2249 Acked Write 1 Done Done Sent false
4812 2250 Acked Read 10 Done Done Sent false
4813 2251 Acked Read 1 Done Done Sent false
4814 2252 Acked Read 4 Done Done Sent false
4815 2253 Acked Write 4 Done Done Sent false
4816 2254 Acked Write 4 Done Done Sent false
4817 2255 Acked Read 10 Done Done Sent false
4818 2256 Acked Flush 0 Done Done Sent false
4819 2257 Acked Write 3 Done Done Sent false
4820 2258 Acked Write 1 Done Done Sent false
4821 2259 Acked Read 5 Done Done Sent false
4822 2260 Acked Write 9 Done Done Sent false
4823 2261 Acked Flush 0 Done Done Sent false
4824 2262 Acked Write 9 Done Done Sent false
4825 2263 Acked Read 4 Done Done Sent false
4826 2264 Acked Write 4 Done Done Sent false
4827 2265 Acked Write 3 Done Done Sent false
4828 2266 Acked Write 4 Done Done Sent false
4829 2267 Acked Read 10 Done Done Sent false
4830 2268 Acked Write 4 Done Done Sent false
4831 2269 Acked Read 2 Done Done Sent false
4832 2270 Acked Write 8 Done Done Sent false
4833 2271 Acked Write 6 Done Done Sent false
4834 2272 Acked Write 1 Done Done Sent false
4835 2273 Acked Read 3 Done Done Sent false
4836 2274 Acked Write 5 Done Done Sent false
4837 2275 Acked Read 5 Done Done Sent false
4838 2276 Acked Read 4 Done Done Sent false
4839 2277 Acked Write 8 Done Done Sent false
4840 2278 Acked Write 4 Done Done Sent false
4841 2279 Acked Write 9 Done Done Sent false
4842 2280 Acked Read 2 Done Done Sent false
4843 2281 Acked Write 3 Done Done Sent false
4844 2282 Acked Write 7 Done Done Sent false
4845 2283 Acked Read 8 Done Done Sent false
4846 2284 Acked Write 3 Done Done Sent false
4847 2285 Acked Read 3 Done Done Sent false
4848 2286 Acked Write 10 Done Done Sent false
4849 2287 Acked Write 2 Done Done Sent false
4850 2288 Acked Write 7 Done Done Sent false
4851 2289 Acked Read 10 Done Done Sent false
4852 2290 Acked Write 5 Done Done Sent false
4853 2291 Acked Read 4 Done Done Sent false
4854 2292 Acked Flush 0 Done Done Sent false
4855 2293 Acked Read 8 Done Done Sent false
4856 2294 Acked Read 7 Done Done Sent false
4857 2295 Acked Read 9 Done Done Sent false
4858 2296 Acked Write 3 Done Done Sent false
4859 2297 Acked Write 9 Done Done Sent false
4860 2298 Acked Read 4 Done Done Sent false
4861 2299 Acked Read 9 Done Done Sent false
4862 2300 Acked Write 7 Done Done Sent false
4863 2301 Acked Write 4 Done Done Sent false
4864 2302 Acked Read 1 Done Done Sent false
4865 2303 Acked Write 6 Done Done Sent false
4866 2304 Acked Flush 0 Done Done Sent false
4867 2305 Acked Flush 0 Done Done Sent false
4868 2306 Acked Write 6 Done Done Sent false
4869 2307 Acked Write 6 Done Done Sent false
4870 2308 Acked Read 3 Done Done Sent false
4871 2309 Acked Read 10 Done Done Sent false
4872 2310 Acked Flush 0 Done Done Sent false
4873 2311 Acked Flush 0 Done Done Sent false
4874 2312 Acked Flush 0 Done Done Sent false
4875 2313 Acked Write 3 Done Done Sent false
4876 2314 Acked Write 2 Done Done Sent false
4877 2315 Acked Flush 0 Done Done Sent false
4878 2316 Acked Write 10 Done Done Sent false
4879 2317 Acked Read 10 Done Done Sent false
4880 2318 Acked Write 3 Done Done Sent false
4881 2319 Acked Read 10 Done Done Sent false
4882 2320 Acked Write 6 Done Done Sent false
4883 2321 Acked Write 2 Done Done Sent false
4884 2322 Acked Read 3 Done Done Sent false
4885 2323 Acked Write 4 Done Done Sent false
4886 2324 Acked Read 6 Done Done Sent false
4887 2325 Acked Read 6 Done Done Sent false
4888 2326 Acked Write 3 Done Done Sent false
4889 2327 Acked Flush 0 Done Done Sent false
4890 2328 Acked Read 9 Done Done Sent false
4891 2329 Acked Read 3 Done Done Sent false
4892 2330 Acked Read 1 Done Done Sent false
4893 2331 Acked Read 8 Done Done Sent false
4894 2332 Acked Write 8 Done Done Sent false
4895 2333 Acked Read 1 Done Done Sent false
4896 2334 Acked Write 5 Done Done Sent false
4897 2335 Acked Write 7 Done Done Sent false
4898 2336 Acked Write 4 Done Done Sent false
4899 2337 Acked Write 2 Done Done Sent false
4900 2338 Acked Flush 0 Done Done Sent false
4901 2339 Acked Write 10 Done Done Sent false
4902 2340 Acked Write 5 Done Done Sent false
4903 2341 Acked Read 8 Done Done Sent false
4904 2342 Acked Flush 0 Done Done Sent false
4905 2343 Acked Read 9 Done Done Sent false
4906 2344 Acked Write 2 Done Done Sent false
4907 2345 Acked Read 8 Done Done Sent false
4908 2346 Acked Read 2 Done Done Sent false
4909 2347 Acked Flush 0 Done Done Sent false
4910 2348 Acked Write 10 Done Done Sent false
4911 2349 Acked Read 5 Done Done Sent false
4912 2350 Acked Flush 0 Done Done Sent false
4913 2351 Acked Read 6 Done Done Sent false
4914 2352 Acked Read 3 Done Done Sent false
4915 2353 Acked Read 6 Done Done Sent false
4916 2354 Acked Flush 0 Done Done Sent false
4917 2355 Acked Write 9 Done Done Sent false
4918 2356 Acked Write 8 Done Done Sent false
4919 2357 Acked Write 8 Done Done Sent false
4920 2358 Acked Write 3 Done Done Sent false
4921 2359 Acked Read 4 Done Done Sent false
4922 2360 Acked Read 8 Done Done Sent false
4923 2361 Acked Read 2 Done Done Sent false
4924 2362 Acked Write 4 Done Done Sent false
4925 2363 Acked Write 6 Done Done Sent false
4926 2364 Acked Write 2 Done Done Sent false
4927 2365 Acked Read 9 Done Done Sent false
4928 2366 Acked Flush 0 Done Done Sent false
4929 2367 Acked Write 9 Done Done Sent false
4930 2368 Acked Read 1 Done Done Sent false
4931 2369 Acked Read 10 Done Done Sent false
4932 2370 Acked Read 1 Done Done Sent false
4933 2371 Acked Read 5 Done Done Sent false
4934 2372 Acked Read 6 Done Done Sent false
4935 2373 Acked Read 7 Done Done Sent false
4936 2374 Acked Write 1 Done Done Sent false
4937 2375 Acked Write 10 Done Done Sent false
4938 2376 Acked Read 7 Done Done Sent false
4939 2377 Acked Write 5 Done Done Sent false
4940 2378 Acked Read 10 Done Done Sent false
4941 2379 Acked Read 8 Done Done Sent false
4942 2380 Acked Write 4 Done Done Sent false
4943 2381 Acked Write 10 Done Done Sent false
4944 2382 Acked Flush 0 Done Done Sent false
4945 2383 Acked Read 4 Done Done Sent false
4946 2384 Acked Read 5 Done Done Sent false
4947 2385 Acked Read 7 Done Done Sent false
4948 2386 Acked Read 6 Done Done Sent false
4949 2387 Acked Write 3 Done Done Sent false
4950 2388 Acked Write 7 Done Done Sent false
4951 2389 Acked Read 2 Done Done Sent false
4952 2390 Acked Flush 0 Done Done Sent false
4953 2391 Acked Write 8 Done Done Sent false
4954 2392 Acked Read 6 Done Done Sent false
4955 2393 Acked Read 8 Done Done Sent false
4956 2394 Acked Flush 0 Done Done Sent false
4957 2395 Acked Read 3 Done Done Sent false
4958 2396 Acked Write 8 Done Done Sent false
4959 2397 Acked Read 4 Done Done Sent false
4960 2398 Acked Write 4 Done Done Sent false
4961 2399 Acked Read 6 Done Done Sent false
4962 2400 Acked Write 10 Done Done Sent false
4963 2401 Acked Flush 0 Done Done Sent false
4964 2402 Acked Write 10 Done Done Sent false
4965 2403 Acked Write 3 Done Done Sent false
4966 2404 Acked Write 9 Done Done Sent false
4967 2405 Acked Read 9 Done Done Sent false
4968 2406 Acked Flush 0 Done Done Sent false
4969 2407 Acked Write 1 Done Done Sent false
4970 2408 Acked Read 7 Done Done Sent false
4971 2409 Acked Read 3 Done Done Sent false
4972 2410 Acked Write 7 Done Done Sent false
4973 2411 Acked Read 3 Done Done Sent false
4974 2412 Acked Read 1 Done Done Sent false
4975 2413 Acked Read 9 Done Done Sent false
4976 2414 Acked Write 2 Done Done Sent false
4977 2415 Acked Read 6 Done Done Sent false
4978 2416 Acked Read 4 Done Done Sent false
4979 2417 Acked Write 4 Done Done Sent false
4980 2418 Acked Read 10 Done Done Sent false
4981 2419 Acked Write 8 Done Done Sent false
4982 2420 Acked Write 3 Done Done Sent false
4983 2421 Acked Write 8 Done Done Sent false
4984 2422 Acked Read 3 Done Done Sent false
4985 2423 Acked Flush 0 Done Done Sent false
4986 2424 Acked Write 7 Done Done Sent false
4987 2425 Acked Write 9 Done Done Sent false
4988 2426 Acked Flush 0 Done Done Sent false
4989 2427 Acked Write 5 Done Done Sent false
4990 2428 Acked Write 4 Done Done Sent false
4991 2429 Acked Write 4 Done Done Sent false
4992 2430 Acked Write 8 Done Done Sent false
4993 2431 Acked Read 5 Done Done Sent false
4994 2432 Acked Read 8 Done Done Sent false
4995 2433 Acked Read 4 Done Done Sent false
4996 2434 Acked Read 1 Done Done Sent false
4997 2435 Acked Read 5 Done Done Sent false
4998 2436 Acked Write 3 Done Done Sent false
4999 2437 Acked Read 1 Done Done Sent false
5000 2438 Acked Write 3 Done Done Sent false
5001 2439 Acked Read 2 Done Done Sent false
5002 2440 Acked Read 1 Done Done Sent false
5003 2441 Acked Flush 0 Done Done Sent false
5004 2442 Acked Write 1 Done Done Sent false
5005 2443 Acked Write 6 Done Done Sent false
5006 2444 Acked Write 8 Done Done Sent false
5007 2445 Acked Write 2 Done Done Sent false
5008 2446 Acked Write 9 Done Done Sent false
5009 2447 Acked Read 6 Done Done Sent false
5010 2448 Acked Read 4 Done Done Sent false
5011 2449 Acked Read 1 Done Done Sent false
5012 2450 Acked Write 9 Done Done Sent false
5013 2451 Acked Read 1 Done Done Sent false
5014 2452 Acked Write 4 Done Done Sent false
5015 2453 Acked Read 5 Done Done Sent false
5016 2454 Acked Read 1 Done Done Sent false
5017 2455 Acked Write 6 Done Done Sent false
5018 2456 Acked Write 10 Done Done Sent false
5019 2457 Acked Read 7 Done Done Sent false
5020 2458 Acked Read 4 Done Done Sent false
5021 2459 Acked Read 7 Done Done Sent false
5022 2460 Acked Write 7 Done Done Sent false
5023 2461 Acked Read 9 Done Done Sent false
5024 2462 Acked Read 7 Done Done Sent false
5025 2463 Acked Read 6 Done Done Sent false
5026 2464 Acked Flush 0 Done Done Sent false
5027 2465 Acked Flush 0 Done Done Sent false
5028 2466 Acked Read 7 Done Done Sent false
5029 2467 Acked Read 1 Done Done Sent false
5030 2468 Acked Read 4 Done Done Sent false
5031 2469 Acked Write 6 Done Done Sent false
5032 2470 Acked Read 2 Done Done Sent false
5033 2471 Acked Write 1 Done Done Sent false
5034 2472 Acked Read 8 Done Done Sent false
5035 2473 Acked Flush 0 Done Done Sent false
5036 2474 Acked Write 5 Done Done Sent false
5037 2475 Acked Write 6 Done Done Sent false
5038 2476 Acked Write 4 Done Done Sent false
5039 2477 Acked Write 2 Done Done Sent false
5040 2478 Acked Read 10 Done Done Sent false
5041 2479 Acked Write 10 Done Done Sent false
5042 2480 Acked Write 5 Done Done Sent false
5043 2481 Acked Write 10 Done Done Sent false
5044 2482 Acked Flush 0 Done Done Sent false
5045 2483 Acked Write 10 Done Done Sent false
5046 2484 Acked Read 8 Done Done Sent false
5047 2485 Acked Write 7 Done Done Sent false
5048 2486 Acked Read 10 Done Done Sent false
5049 2487 Acked Read 9 Done Done Sent false
5050 2488 Acked Flush 0 Done Done Sent false
5051 2489 Acked Write 9 Done Done Sent false
5052 2490 Acked Read 7 Done Done Sent false
5053 2491 Acked Write 10 Done Done Sent false
5054 2492 Acked Write 2 Done Done Sent false
5055 2493 Acked Read 9 Done Done Sent false
5056 2494 Acked Read 10 Done Done Sent false
5057 2495 Acked Read 5 Done Done Sent false
5058 2496 Acked Write 10 Done Done Sent false
5059 2497 Acked Write 1 Done Done Sent false
5060 2498 Acked Read 5 Done Done Sent false
5061 2499 Acked Write 7 Done Done Sent false
5062 2500 Acked Write 4 Done Done Sent false
5063 2501 Acked Read 10 Done Done Sent false
5064 2502 Acked Read 7 Done Done Sent false
5065 2503 Acked Write 6 Done Done Sent false
5066 2504 Acked Read 7 Done Done Sent false
5067 2505 Acked Read 8 Done Done Sent false
5068 2506 Acked Read 10 Done Done Sent false
5069 2507 Acked Write 3 Done Done Sent false
5070 2508 Acked Flush 0 Done Done Sent false
5071 STATES DS:0 DS:1 DS:2 TOTAL
5072 Sent 0 0 302 302
5073 Done 302 302 0 604
5074 Skipped 0 0 0 0
5075 Error 0 0 0 0
5076 Last Flush: 2508 2508 2206
5077 Downstairs last five completed: 2206 2205 2204 2203 2202
5078 Upstairs last five completed: 2508 2507 2506 2505 2504
5079 CLIENT: Up:0 ds:302 act:2
50802025-01-10T16:36:22.702ZINFOcrucible: connecting to 127.0.0.1:8830 = io task client = 2 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
50812025-01-10T16:36:22.702ZINFOcrucible: ds_connection connected from Ok(127.0.0.1:39972) = io task client = 2 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
50822025-01-10T16:36:22.703ZWARNcrucible: version negotiation from state Offline = downstairs client = 2 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
50832025-01-10T16:36:22.703ZINFOcrucible: downstairs client at Some(127.0.0.1:8830) has region UUID 12345678-0000-0000-0000-000000008830 = downstairs client = 2 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
50842025-01-10T16:36:22.703ZINFOcrucible: Returning UUID:12345678-0000-0000-0000-000000008830 matches = downstairs client = 2 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
50852025-01-10T16:36:22.703ZINFOcrucible: send last flush ID to this DS: 2206 = downstairs client = 2 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
50862025-01-10T16:36:22.704ZINFOcrucible: Replied this last flush ID: 2206 = downstairs client = 2 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
50872025-01-10T16:36:22.704ZINFOcrucible: ds_transition from Offline to Active = downstairs client = 2 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
50882025-01-10T16:36:22.704ZINFOcrucible: [2] Transition from Offline to Active = downstairs client = 2 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
50892025-01-10T16:36:22.704ZINFOcrucible: [2] client re-new 302 jobs since flush 2206 = downstairs session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
50902025-01-10T16:36:22.704ZINFOcrucible: [2] Replayed 302 jobs since flush: 2206 = downstairs session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
5091 ----------------------------------------------------------------
5092 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:0
5093 Downstairs last five completed: 2508 2507 2506 2505 2504
5094 Upstairs last five completed: 2508 2507 2506 2505 2504
5095 CLIENT: Up:0 ds:0 act:3
5096 Replay: All jobs finished
5097 Main task has work to do, go find it
5098 got dsc Stop(0)
5099 stop 0
5100 Jan 10 16:36:24.939 INFO request completed, [8810] Got stop action so:false kr:false
5101 latency_us: 356, response_code: 204, uri: /stop/cid/0, method: POST, req_id: 57dd6e3f-9c30-4242-af62-176e093545a9, remote_addr: 127.0.0.1:55917, local_addr: 127.0.0.1:9998
5102 Jan 10 16:36:24.940 INFO request completed, latency_us: 99, response_code: 200, uri: /state/cid/0, method: GET, req_id: 2307df84-fead-48a3-9e42-dd8047f3bbb3, remote_addr: 127.0.0.1:55917, local_addr: 127.0.0.1:9998
51032025-01-10T16:36:24.940ZWARNcrucible: downstairs disconnected = io task client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
51042025-01-10T16:36:24.940ZWARNcrucible: client task is sending Done(Finished) = io task client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
51052025-01-10T16:36:24.940ZWARNcrucible: downstairs task for 0 stopped due to Finished session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
51062025-01-10T16:36:24.940ZINFOcrucible: ds_transition from Active to Offline = downstairs client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
51072025-01-10T16:36:24.940ZINFOcrucible: [0] Transition from Active to Offline = downstairs client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
51082025-01-10T16:36:24.940ZINFOcrucible: client task is exiting = io task client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
5109 [8810] Exited with: ExitStatus(unix_wait_status(9))
5110 [8810][0] reports Exit
5111 Jan 10 16:36:28.942 INFO request completed, latency_us: 225, response_code: 200, uri: /state/cid/0, method: GET, req_id: b9e841e1-8cf9-464f-b05f-2062c3d103da, remote_addr: 127.0.0.1:55917, local_addr: 127.0.0.1:9998
5112 001/300 Read block 434 len 20480
5113 002/300 Write block 3419 len 4096 data: 2
5114 003/300 Flush
5115 004/300 Flush
5116 005/300 Read block 2447 len 16384
5117 006/300 Read block 898 len 4096
5118 007/300 Read block 2790 len 20480
5119 008/300 Write block 4165 len 32768 data: 4 4 3 2 2 2 2 2
5120 009/300 Flush
5121 010/300 Read block 3595 len 36864
5122 011/300 Read block 2548 len 40960
5123 012/300 Read block 140 len 32768
5124 013/300 Read block 2722 len 32768
5125 014/300 Write block 1488 len 24576 data: 2 2 2 2 2 2
5126 015/300 Write block 3012 len 8192 data: 2 2
5127 016/300 Write block 2483 len 32768 data: 2 2 2 2 2 2 2 2
5128 017/300 Read block 4772 len 28672
5129 018/300 Read block 1150 len 8192
5130 019/300 Write block 3289 len 16384 data: 2 2 2 2
5131 020/300 Read block 4552 len 24576
5132 021/300 Read block 3727 len 40960
5133 022/300 Write block 1862 len 12288 data: 3 3 3
5134 023/300 Read block 4385 len 32768
5135 024/300 Flush
5136 025/300 Read block 481 len 40960
5137 026/300 Read block 2396 len 20480
5138 027/300 Write block 2318 len 4096 data: 2
5139 028/300 Read block 4680 len 32768
5140 029/300 Read block 4459 len 24576
5141 030/300 Write block 489 len 20480 data: 2 2 2 2 2
5142 031/300 Read block 4119 len 20480
5143 032/300 Read block 2929 len 20480
5144 033/300 Write block 1747 len 28672 data: 2 2 2 2 2 2 2
5145 034/300 Write block 1058 len 28672 data: 3 2 3 3 3 3 3
5146 035/300 Write block 4720 len 16384 data: 2 2 2 2
5147 036/300 Read block 660 len 20480
5148 037/300 Flush
5149 038/300 Read block 4843 len 28672
5150 039/300 Write block 721 len 40960 data: 3 3 3 4 4 3 3 3 2 2
5151 040/300 Read block 2990 len 36864
5152 041/300 Read block 3087 len 28672
5153 042/300 Write block 1989 len 16384 data: 2 2 2 3
5154 043/300 Write block 3107 len 16384 data: 2 2 2 2
5155 044/300 Flush
5156 045/300 Write block 2151 len 20480 data: 4 4 3 4 4
5157 046/300 Write block 4826 len 24576 data: 2 2 2 3 3 2
5158 047/300 Flush
5159 048/300 Read block 4606 len 4096
5160 049/300 Read block 443 len 36864
5161 050/300 Write block 1160 len 16384 data: 2 2 2 2
5162 051/300 Read block 2234 len 8192
5163 052/300 Read block 3800 len 36864
5164 053/300 Read block 1356 len 28672
5165 054/300 Write block 4107 len 40960 data: 2 2 2 2 2 3 3 3 3 3
5166 055/300 Write block 1759 len 20480 data: 2 3 3 4 4
5167 056/300 Write block 1364 len 20480 data: 3 3 2 2 3
5168 057/300 Read block 3390 len 16384
5169 058/300 Write block 4794 len 40960 data: 2 2 2 2 2 2 2 2 4 4
5170 059/300 Write block 631 len 28672 data: 4 4 6 6 6 5 4
5171 060/300 Read block 4514 len 36864
5172 061/300 Write block 3263 len 20480 data: 3 3 3 3 3
5173 062/300 Write block 3855 len 12288 data: 3 2 2
5174 063/300 Write block 535 len 4096 data: 3
5175 064/300 Read block 4922 len 32768
5176 065/300 Read block 3126 len 20480
5177 066/300 Write block 2169 len 16384 data: 2 2 2 2
5178 067/300 Read block 1247 len 40960
5179 068/300 Write block 118 len 32768 data: 2 2 3 3 3 3 2 2
5180 069/300 Write block 2578 len 32768 data: 2 2 2 2 2 2 3 3
5181 070/300 Write block 2923 len 8192 data: 2 2
5182 071/300 Read block 4491 len 16384
5183 072/300 Read block 1932 len 40960
5184 073/300 Write block 723 len 16384 data: 4 5 5 4
5185 074/300 Read block 3691 len 16384
5186 075/300 Write block 2979 len 16384 data: 3 3 3 3
5187 076/300 Write block 69 len 8192 data: 4 4
5188 077/300 Flush
5189 078/300 Flush
5190 079/300 Write block 1832 len 36864 data: 3 3 2 2 2 2 2 2 2
5191 080/300 Read block 4815 len 32768
5192 081/300 Read block 2222 len 24576
5193 082/300 Write block 901 len 4096 data: 2
5194 083/300 Read block 1363 len 8192
5195 084/300 Read block 1308 len 36864
5196 085/300 Read block 1107 len 24576
5197 086/300 Read block 794 len 4096
5198 087/300 Write block 1911 len 32768 data: 4 4 4 3 3 3 2 2
5199 088/300 Write block 193 len 40960 data: 2 2 2 2 2 2 2 2 2 3
5200 089/300 Read block 4124 len 28672
5201 090/300 Write block 2597 len 36864 data: 2 2 2 2 2 2 2 2 2
5202 091/300 Read block 3975 len 12288
5203 092/300 Read block 3415 len 16384
5204 093/300 Read block 1607 len 20480
5205 094/300 Write block 4143 len 8192 data: 2 2
5206 095/300 Flush
5207 096/300 Read block 3307 len 20480
5208 097/300 Write block 4628 len 8192 data: 3 3
5209 098/300 Read block 4667 len 40960
5210 099/300 Flush
5211 100/300 Read block 4846 len 36864
5212 101/300 Write block 4014 len 32768 data: 2 3 3 3 2 2 2 3
5213 102/300 Read block 3819 len 24576
5214 103/300 Read block 3080 len 36864
5215 104/300 Write block 1925 len 16384 data: 3 3 3 3
5216 105/300 Read block 2664 len 32768
5217 106/300 Write block 3588 len 40960 data: 3 3 2 2 2 2 2 2 2 2
5218 107/300 Write block 147 len 28672 data: 2 2 2 2 2 3 3
5219 108/300 Write block 1320 len 20480 data: 4 3 3 3 3
5220 109/300 Write block 2004 len 8192 data: 2 2
5221 110/300 Flush
5222 111/300 Read block 1115 len 12288
5223 112/300 Write block 4568 len 40960 data: 2 2 4 4 3 2 2 2 3 3
5224 113/300 Read block 4432 len 8192
5225 114/300 Read block 2292 len 40960
5226 115/300 Read block 3083 len 16384
5227 116/300 Write block 531 len 20480 data: 4 4 4 4 4
5228 117/300 Read block 476 len 20480
5229 118/300 Write block 1729 len 20480 data: 2 2 2 2 2
5230 119/300 Write block 2884 len 16384 data: 2 2 2 2
5231 120/300 Read block 1820 len 24576
5232 121/300 Read block 2794 len 16384
5233 122/300 Read block 3111 len 40960
5234 123/300 Read block 1280 len 24576
5235 124/300 Read block 864 len 36864
5236 125/300 Flush
5237 126/300 Read block 2081 len 40960
5238 127/300 Read block 1604 len 36864
5239 128/300 Read block 504 len 40960
5240 129/300 Read block 565 len 4096
5241 130/300 Read block 510 len 40960
5242 131/300 Read block 3504 len 16384
5243 132/300 Read block 2352 len 24576
5244 133/300 Read block 1029 len 32768
5245 134/300 Read block 2731 len 40960
5246 135/300 Read block 4307 len 8192
5247 136/300 Write block 3274 len 8192 data: 2 2
5248 137/300 Read block 2499 len 32768
5249 138/300 Read block 1059 len 4096
5250 139/300 Write block 1191 len 4096 data: 2
5251 140/300 Flush
5252 141/300 Read block 553 len 28672
5253 142/300 Write block 2371 len 36864 data: 2 3 3 3 3 3 3 3 3
5254 143/300 Read block 4757 len 32768
5255 144/300 Write block 3539 len 40960 data: 3 3 3 2 3 3 3 3 3 3
5256 145/300 Read block 3920 len 12288
5257 146/300 Flush
5258 147/300 Read block 3978 len 20480
5259 148/300 Write block 3436 len 4096 data: 2
5260 149/300 Write block 4720 len 16384 data: 3 3 3 3
5261 150/300 Read block 432 len 24576
5262 151/300 Flush
5263 152/300 Read block 3674 len 16384
5264 153/300 Read block 4626 len 20480
5265 154/300 Read block 1284 len 32768
5266 155/300 Read block 555 len 20480
5267 156/300 Read block 868 len 24576
5268 157/300 Read block 726 len 8192
5269 158/300 Read block 2169 len 8192
5270 159/300 Write block 2165 len 16384 data: 3 3 2 2
5271 160/300 Write block 4526 len 28672 data: 3 3 3 3 3 4 4
5272 161/300 Write block 2147 len 40960 data: 2 2 4 4 5 5 4 5 5 4
5273 162/300 Write block 2599 len 28672 data: 3 3 3 3 3 3 3
5274 163/300 Flush
5275 164/300 Read block 3887 len 16384
5276 165/300 Read block 3342 len 20480
5277 166/300 Read block 2556 len 28672
5278 167/300 Read block 476 len 8192
5279 168/300 Read block 1676 len 8192
5280 169/300 Write block 4280 len 12288 data: 2 3 3
5281 170/300 Read block 1285 len 32768
5282 171/300 Flush
5283 172/300 Read block 2480 len 16384
5284 173/300 Write block 1732 len 16384 data: 3 3 2 2
5285 174/300 Write block 3639 len 32768 data: 2 2 2 2 2 2 2 2
5286 175/300 Flush
5287 176/300 Read block 34 len 40960
5288 177/300 Flush
5289 178/300 Write block 3004 len 4096 data: 3
5290 179/300 Write block 2212 len 8192 data: 2 2
5291 180/300 Write block 4816 len 32768 data: 3 3 3 3 2 2 2 2
5292 181/300 Flush
5293 182/300 Read block 2486 len 20480
5294 183/300 Flush
5295 184/300 Write block 4134 len 16384 data: 2 2 2 2
5296 185/300 Write block 1788 len 24576 data: 2 2 2 2 2 2
5297 186/300 Read block 4008 len 20480
5298 187/300 Read block 4536 len 40960
5299 188/300 Flush
5300 189/300 Write block 1587 len 40960 data: 3 3 3 3 3 3 2 2 3 3
5301 190/300 Read block 2470 len 8192
5302 191/300 Write block 2676 len 28672 data: 2 2 2 2 2 2 2
5303 192/300 Write block 3448 len 24576 data: 2 2 2 2 2 2
5304 193/300 Read block 2841 len 24576
5305 194/300 Read block 4336 len 16384
5306 195/300 Read block 1987 len 40960
5307 196/300 Read block 454 len 32768
5308 197/300 Read block 3782 len 12288
5309 198/300 Read block 3628 len 40960
5310 199/300 Read block 2057 len 40960
5311 200/300 Flush
5312 201/300 Read block 3034 len 12288
5313 202/300 Read block 1490 len 32768
5314 203/300 Write block 151 len 16384 data: 3 4 4 3
5315 204/300 Write block 1900 len 32768 data: 2 2 2 2 2 3 3 4
5316 205/300 Read block 2684 len 24576
5317 206/300 Read block 33 len 32768
5318 207/300 Read block 751 len 16384
5319 208/300 Write block 4050 len 4096 data: 2
5320 209/300 Write block 4552 len 20480 data: 5 5 5 5 6
5321 210/300 Write block 528 len 8192 data: 4 4
5322 211/300 Write block 4426 len 28672 data: 2 3 3 3 3 3 4
5323 212/300 Read block 2600 len 20480
5324 213/300 Read block 2831 len 36864
5325 214/300 Read block 2405 len 24576
5326 215/300 Write block 490 len 36864 data: 3 3 3 3 2 2 3 3 3
5327 216/300 Flush
5328 217/300 Read block 3230 len 24576
5329 218/300 Write block 1862 len 36864 data: 4 4 4 3 3 2 2 2 2
5330 219/300 Write block 978 len 24576 data: 4 5 5 5 4 4
5331 220/300 Read block 252 len 16384
5332 221/300 Read block 411 len 12288
5333 222/300 Read block 2732 len 28672
5334 223/300 Read block 120 len 32768
5335 224/300 Write block 4675 len 4096 data: 2
5336 225/300 Read block 2171 len 24576
5337 226/300 Flush
5338 227/300 Read block 3974 len 4096
5339 228/300 Write block 1261 len 8192 data: 4 3
5340 229/300 Write block 2633 len 20480 data: 3 3 4 4 4
5341 230/300 Read block 1356 len 40960
5342 231/300 Read block 2875 len 12288
5343 232/300 Read block 2226 len 24576
5344 233/300 Read block 3751 len 8192
5345 234/300 Read block 3688 len 4096
5346 235/300 Write block 2724 len 36864 data: 3 3 3 3 3 3 2 2 2
5347 236/300 Write block 2017 len 28672 data: 2 3 3 3 3 3 2
5348 237/300 Read block 2330 len 20480
5349 238/300 Flush
5350 239/300 Read block 4377 len 32768
5351 240/300 Read block 4117 len 36864
5352 241/300 Read block 81 len 16384
5353 242/300 Write block 2225 len 4096 data: 2
5354 243/300 Read block 2035 len 24576
5355 244/300 Read block 2327 len 12288
5356 245/300 Write block 2128 len 4096 data: 2
5357 246/300 Flush
5358 247/300 Write block 3321 len 4096 data: 3
5359 248/300 Write block 1329 len 40960 data: 4 4 4 4 4 2 2 2 3 3
5360 249/300 Write block 1602 len 28672 data: 4 3 3 2 2 3 3
5361 250/300 Write block 2975 len 24576 data: 2 2 2 3 4 4
5362 251/300 Write block 1648 len 12288 data: 3 3 3
5363 252/300 Write block 764 len 24576 data: 5 5 4 2 2 2
5364 253/300 Write block 3550 len 12288 data: 3 3 3
5365 254/300 Read block 2605 len 32768
5366 255/300 Read block 3839 len 24576
5367 256/300 Write block 4043 len 16384 data: 3 3 3 3
5368 257/300 Write block 4583 len 8192 data: 3 3
5369 258/300 Read block 3077 len 4096
5370 259/300 Write block 3600 len 4096 data: 2
5371 260/300 Write block 2587 len 40960 data: 3 4 4 3 3 3 2 2 2 2
5372 261/300 Write block 34 len 36864 data: 2 2 2 2 2 2 4 4 4
5373 262/300 Read block 2725 len 24576
5374 263/300 Flush
5375 264/300 Write block 3123 len 4096 data: 3
5376 265/300 Flush
5377 266/300 Read block 4776 len 40960
5378 267/300 Write block 1672 len 8192 data: 3 4
5379 268/300 Read block 2352 len 24576
5380 269/300 Read block 2207 len 20480
5381 270/300 Read block 1765 len 20480
5382 271/300 Read block 1732 len 24576
5383 272/300 Write block 877 len 32768 data: 3 3 3 3 3 4 4 4
5384 273/300 Flush
5385 274/300 Read block 534 len 40960
5386 275/300 Read block 953 len 20480
5387 276/300 Write block 1056 len 28672 data: 2 2 4 3 4 4 4
5388 277/300 Flush
5389 278/300 Read block 3663 len 40960
5390 279/300 Read block 4375 len 16384
5391 280/300 Write block 2814 len 4096 data: 2
5392 281/300 Read block 4800 len 16384
5393 282/300 Write block 3753 len 20480 data: 3 2 2 2 2
5394 283/300 Write block 4088 len 4096 data: 2
5395 284/300 Write block 4191 len 40960 data: 2 2 2 2 2 3 3 3 4 4
5396 285/300 Read block 4854 len 16384
5397 286/300 Write block 329 len 32768 data: 2 2 2 2 2 2 2 3
5398 287/300 Read block 282 len 12288
5399 288/300 Write block 1983 len 8192 data: 2 2
5400 289/300 Read block 1006 len 36864
5401 290/300 Write block 3916 len 24576 data: 2 2 2 2 2 3
5402 291/300 Read block 326 len 28672
5403 292/300 Write block 3473 len 4096 data: 2
5404 293/300 Read block 999 len 20480
5405 294/300 Read block 4346 len 4096
5406 295/300 Read block 717 len 28672
5407 296/300 Read block 3908 len 16384
5408 297/300 Flush
5409 298/300 Write block 4983 len 20480 data: 2 2 2 4 4
5410 299/300 Read block 4934 len 8192
5411 300/300 Read block 788 len 36864
5412 301/300 Flush
5413 Main task has work to do, go find it
5414 got dsc Start(0)
5415 start 0
5416 Jan 10 16:36:29.185 INFO request completed, latency_us: 248, response_code: 204, uri: /start/cid/0, method: POST, req_id: 90664199-4481-4a87-a435-a59a871b36d0, remote_addr: 127.0.0.1:55917, local_addr: 127.0.0.1:9998
5417 Replay: started 0, returned:Ok(())
5418 ----------------------------------------------------------------
5419 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:301
5420 States: Offline Active Active
5421 JOBID ACK TYPE BKS/EXT DS:0 DS:1 DS:2 REPLAY
5422 2509 Acked Read 5 Sent Done Done false
5423 2510 Acked Write 1 Sent Done Done false
5424 2511 Acked Flush 0 Sent Done Done false
5425 2512 Acked Flush 0 Sent Done Done false
5426 2513 Acked Read 4 Sent Done Done false
5427 2514 Acked Read 1 Sent Done Done false
5428 2515 Acked Read 5 Sent Done Done false
5429 2516 Acked Write 8 Sent Done Done false
5430 2517 Acked Flush 0 Sent Done Done false
5431 2518 Acked Read 9 Sent Done Done false
5432 2519 Acked Read 10 Sent Done Done false
5433 2520 Acked Read 8 Sent Done Done false
5434 2521 Acked Read 8 Sent Done Done false
5435 2522 Acked Write 6 Sent Done Done false
5436 2523 Acked Write 2 Sent Done Done false
5437 2524 Acked Write 8 Sent Done Done false
5438 2525 Acked Read 7 Sent Done Done false
5439 2526 Acked Read 2 Sent Done Done false
5440 2527 Acked Write 4 Sent Done Done false
5441 2528 Acked Read 6 Sent Done Done false
5442 2529 Acked Read 10 Sent Done Done false
5443 2530 Acked Write 3 Sent Done Done false
5444 2531 Acked Read 8 Sent Done Done false
5445 2532 Acked Flush 0 Sent Done Done false
5446 2533 Acked Read 10 Sent Done Done false
5447 2534 Acked Read 5 Sent Done Done false
5448 2535 Acked Write 1 Sent Done Done false
5449 2536 Acked Read 8 Sent Done Done false
5450 2537 Acked Read 6 Sent Done Done false
5451 2538 Acked Write 5 Sent Done Done false
5452 2539 Acked Read 5 Sent Done Done false
5453 2540 Acked Read 5 Sent Done Done false
5454 2541 Acked Write 7 Sent Done Done false
5455 2542 Acked Write 7 Sent Done Done false
5456 2543 Acked Write 4 Sent Done Done false
5457 2544 Acked Read 5 Sent Done Done false
5458 2545 Acked Flush 0 Sent Done Done false
5459 2546 Acked Read 7 Sent Done Done false
5460 2547 Acked Write 10 Sent Done Done false
5461 2548 Acked Read 9 Sent Done Done false
5462 2549 Acked Read 7 Sent Done Done false
5463 2550 Acked Write 4 Sent Done Done false
5464 2551 Acked Write 4 Sent Done Done false
5465 2552 Acked Flush 0 Sent Done Done false
5466 2553 Acked Write 5 Sent Done Done false
5467 2554 Acked Write 6 Sent Done Done false
5468 2555 Acked Flush 0 Sent Done Done false
5469 2556 Acked Read 1 Sent Done Done false
5470 2557 Acked Read 9 Sent Done Done false
5471 2558 Acked Write 4 Sent Done Done false
5472 2559 Acked Read 2 Sent Done Done false
5473 2560 Acked Read 9 Sent Done Done false
5474 2561 Acked Read 7 Sent Done Done false
5475 2562 Acked Write 10 Sent Done Done false
5476 2563 Acked Write 5 Sent Done Done false
5477 2564 Acked Write 5 Sent Done Done false
5478 2565 Acked Read 4 Sent Done Done false
5479 2566 Acked Write 10 Sent Done Done false
5480 2567 Acked Write 7 Sent Done Done false
5481 2568 Acked Read 9 Sent Done Done false
5482 2569 Acked Write 5 Sent Done Done false
5483 2570 Acked Write 3 Sent Done Done false
5484 2571 Acked Write 1 Sent Done Done false
5485 2572 Acked Read 8 Sent Done Done false
5486 2573 Acked Read 5 Sent Done Done false
5487 2574 Acked Write 4 Sent Done Done false
5488 2575 Acked Read 10 Sent Done Done false
5489 2576 Acked Write 8 Sent Done Done false
5490 2577 Acked Write 8 Sent Done Done false
5491 2578 Acked Write 2 Sent Done Done false
5492 2579 Acked Read 4 Sent Done Done false
5493 2580 Acked Read 10 Sent Done Done false
5494 2581 Acked Write 4 Sent Done Done false
5495 2582 Acked Read 4 Sent Done Done false
5496 2583 Acked Write 4 Sent Done Done false
5497 2584 Acked Write 2 Sent Done Done false
5498 2585 Acked Flush 0 Sent Done Done false
5499 2586 Acked Flush 0 Sent Done Done false
5500 2587 Acked Write 9 Sent Done Done false
5501 2588 Acked Read 8 Sent Done Done false
5502 2589 Acked Read 6 Sent Done Done false
5503 2590 Acked Write 1 Sent Done Done false
5504 2591 Acked Read 2 Sent Done Done false
5505 2592 Acked Read 9 Sent Done Done false
5506 2593 Acked Read 6 Sent Done Done false
5507 2594 Acked Read 1 Sent Done Done false
5508 2595 Acked Write 8 Sent Done Done false
5509 2596 Acked Write 10 Sent Done Done false
5510 2597 Acked Read 7 Sent Done Done false
5511 2598 Acked Write 9 Sent Done Done false
5512 2599 Acked Read 3 Sent Done Done false
5513 2600 Acked Read 4 Sent Done Done false
5514 2601 Acked Read 5 Sent Done Done false
5515 2602 Acked Write 2 Sent Done Done false
5516 2603 Acked Flush 0 Sent Done Done false
5517 2604 Acked Read 5 Sent Done Done false
5518 2605 Acked Write 2 Sent Done Done false
5519 2606 Acked Read 10 Sent Done Done false
5520 2607 Acked Flush 0 Sent Done Done false
5521 2608 Acked Read 9 Sent Done Done false
5522 2609 Acked Write 8 Sent Done Done false
5523 2610 Acked Read 6 Sent Done Done false
5524 2611 Acked Read 9 Sent Done Done false
5525 2612 Acked Write 4 Sent Done Done false
5526 2613 Acked Read 8 Sent Done Done false
5527 2614 Acked Write 10 Sent Done Done false
5528 2615 Acked Write 7 Sent Done Done false
5529 2616 Acked Write 5 Sent Done Done false
5530 2617 Acked Write 2 Sent Done Done false
5531 2618 Acked Flush 0 Sent Done Done false
5532 2619 Acked Read 3 Sent Done Done false
5533 2620 Acked Write 10 Sent Done Done false
5534 2621 Acked Read 2 Sent Done Done false
5535 2622 Acked Read 10 Sent Done Done false
5536 2623 Acked Read 4 Sent Done Done false
5537 2624 Acked Write 5 Sent Done Done false
5538 2625 Acked Read 5 Sent Done Done false
5539 2626 Acked Write 5 Sent Done Done false
5540 2627 Acked Write 4 Sent Done Done false
5541 2628 Acked Read 6 Sent Done Done false
5542 2629 Acked Read 4 Sent Done Done false
5543 2630 Acked Read 10 Sent Done Done false
5544 2631 Acked Read 6 Sent Done Done false
5545 2632 Acked Read 9 Sent Done Done false
5546 2633 Acked Flush 0 Sent Done Done false
5547 2634 Acked Read 10 Sent Done Done false
5548 2635 Acked Read 9 Sent Done Done false
5549 2636 Acked Read 10 Sent Done Done false
5550 2637 Acked Read 1 Sent Done Done false
5551 2638 Acked Read 10 Sent Done Done false
5552 2639 Acked Read 4 Sent Done Done false
5553 2640 Acked Read 6 Sent Done Done false
5554 2641 Acked Read 8 Sent Done Done false
5555 2642 Acked Read 10 Sent Done Done false
5556 2643 Acked Read 2 Sent Done Done false
5557 2644 Acked Write 2 Sent Done Done false
5558 2645 Acked Read 8 Sent Done Done false
5559 2646 Acked Read 1 Sent Done Done false
5560 2647 Acked Write 1 Sent Done Done false
5561 2648 Acked Flush 0 Sent Done Done false
5562 2649 Acked Read 7 Sent Done Done false
5563 2650 Acked Write 9 Sent Done Done false
5564 2651 Acked Read 8 Sent Done Done false
5565 2652 Acked Write 10 Sent Done Done false
5566 2653 Acked Read 3 Sent Done Done false
5567 2654 Acked Flush 0 Sent Done Done false
5568 2655 Acked Read 5 Sent Done Done false
5569 2656 Acked Write 1 Sent Done Done false
5570 2657 Acked Write 4 Sent Done Done false
5571 2658 Acked Read 6 Sent Done Done false
5572 2659 Acked Flush 0 Sent Done Done false
5573 2660 Acked Read 4 Sent Done Done false
5574 2661 Acked Read 5 Sent Done Done false
5575 2662 Acked Read 8 Sent Done Done false
5576 2663 Acked Read 5 Sent Done Done false
5577 2664 Acked Read 6 Sent Done Done false
5578 2665 Acked Read 2 Sent Done Done false
5579 2666 Acked Read 2 Sent Done Done false
5580 2667 Acked Write 4 Sent Done Done false
5581 2668 Acked Write 7 Sent Done Done false
5582 2669 Acked Write 10 Sent Done Done false
5583 2670 Acked Write 7 Sent Done Done false
5584 2671 Acked Flush 0 Sent Done Done false
5585 2672 Acked Read 4 Sent Done Done false
5586 2673 Acked Read 5 Sent Done Done false
5587 2674 Acked Read 7 Sent Done Done false
5588 2675 Acked Read 2 Sent Done Done false
5589 2676 Acked Read 2 Sent Done Done false
5590 2677 Acked Write 3 Sent Done Done false
5591 2678 Acked Read 8 Sent Done Done false
5592 2679 Acked Flush 0 Sent Done Done false
5593 2680 Acked Read 4 Sent Done Done false
5594 2681 Acked Write 4 Sent Done Done false
5595 2682 Acked Write 8 Sent Done Done false
5596 2683 Acked Flush 0 Sent Done Done false
5597 2684 Acked Read 10 Sent Done Done false
5598 2685 Acked Flush 0 Sent Done Done false
5599 2686 Acked Write 1 Sent Done Done false
5600 2687 Acked Write 2 Sent Done Done false
5601 2688 Acked Write 8 Sent Done Done false
5602 2689 Acked Flush 0 Sent Done Done false
5603 2690 Acked Read 5 Sent Done Done false
5604 2691 Acked Flush 0 Sent Done Done false
5605 2692 Acked Write 4 Sent Done Done false
5606 2693 Acked Write 6 Sent Done Done false
5607 2694 Acked Read 5 Sent Done Done false
5608 2695 Acked Read 10 Sent Done Done false
5609 2696 Acked Flush 0 Sent Done Done false
5610 2697 Acked Write 10 Sent Done Done false
5611 2698 Acked Read 2 Sent Done Done false
5612 2699 Acked Write 7 Sent Done Done false
5613 2700 Acked Write 6 Sent Done Done false
5614 2701 Acked Read 6 Sent Done Done false
5615 2702 Acked Read 4 Sent Done Done false
5616 2703 Acked Read 10 Sent Done Done false
5617 2704 Acked Read 8 Sent Done Done false
5618 2705 Acked Read 3 Sent Done Done false
5619 2706 Acked Read 10 Sent Done Done false
5620 2707 Acked Read 10 Sent Done Done false
5621 2708 Acked Flush 0 Sent Done Done false
5622 2709 Acked Read 3 Sent Done Done false
5623 2710 Acked Read 8 Sent Done Done false
5624 2711 Acked Write 4 Sent Done Done false
5625 2712 Acked Write 8 Sent Done Done false
5626 2713 Acked Read 6 Sent Done Done false
5627 2714 Acked Read 8 Sent Done Done false
5628 2715 Acked Read 4 Sent Done Done false
5629 2716 Acked Write 1 Sent Done Done false
5630 2717 Acked Write 5 Sent Done Done false
5631 2718 Acked Write 2 Sent Done Done false
5632 2719 Acked Write 7 Sent Done Done false
5633 2720 Acked Read 5 Sent Done Done false
5634 2721 Acked Read 9 Sent Done Done false
5635 2722 Acked Read 6 Sent Done Done false
5636 2723 Acked Write 9 Sent Done Done false
5637 2724 Acked Flush 0 Sent Done Done false
5638 2725 Acked Read 6 Sent Done Done false
5639 2726 Acked Write 9 Sent Done Done false
5640 2727 Acked Write 6 Sent Done Done false
5641 2728 Acked Read 4 Sent Done Done false
5642 2729 Acked Read 3 Sent Done Done false
5643 2730 Acked Read 7 Sent Done Done false
5644 2731 Acked Read 8 Sent Done Done false
5645 2732 Acked Write 1 Sent Done Done false
5646 2733 Acked Read 6 Sent Done Done false
5647 2734 Acked Flush 0 Sent Done Done false
5648 2735 Acked Read 1 Sent Done Done false
5649 2736 Acked Write 2 Sent Done Done false
5650 2737 Acked Write 5 Sent Done Done false
5651 2738 Acked Read 10 Sent Done Done false
5652 2739 Acked Read 3 Sent Done Done false
5653 2740 Acked Read 6 Sent Done Done false
5654 2741 Acked Read 2 Sent Done Done false
5655 2742 Acked Read 1 Sent Done Done false
5656 2743 Acked Write 9 Sent Done Done false
5657 2744 Acked Write 7 Sent Done Done false
5658 2745 Acked Read 5 Sent Done Done false
5659 2746 Acked Flush 0 Sent Done Done false
5660 2747 Acked Read 8 Sent Done Done false
5661 2748 Acked Read 9 Sent Done Done false
5662 2749 Acked Read 4 Sent Done Done false
5663 2750 Acked Write 1 Sent Done Done false
5664 2751 Acked Read 6 Sent Done Done false
5665 2752 Acked Read 3 Sent Done Done false
5666 2753 Acked Write 1 Sent Done Done false
5667 2754 Acked Flush 0 Sent Done Done false
5668 2755 Acked Write 1 Sent Done Done false
5669 2756 Acked Write 10 Sent Done Done false
5670 2757 Acked Write 7 Sent Done Done false
5671 2758 Acked Write 6 Sent Done Done false
5672 2759 Acked Write 3 Sent Done Done false
5673 2760 Acked Write 6 Sent Done Done false
5674 2761 Acked Write 3 Sent Done Done false
5675 2762 Acked Read 8 Sent Done Done false
5676 2763 Acked Read 6 Sent Done Done false
5677 2764 Acked Write 4 Sent Done Done false
5678 2765 Acked Write 2 Sent Done Done false
5679 2766 Acked Read 1 Sent Done Done false
5680 2767 Acked Write 1 Sent Done Done false
5681 2768 Acked Write 10 Sent Done Done false
5682 2769 Acked Write 9 Sent Done Done false
5683 2770 Acked Read 6 Sent Done Done false
5684 2771 Acked Flush 0 Sent Done Done false
5685 2772 Acked Write 1 Sent Done Done false
5686 2773 Acked Flush 0 Sent Done Done false
5687 2774 Acked Read 10 Sent Done Done false
5688 2775 Acked Write 2 Sent Done Done false
5689 2776 Acked Read 6 Sent Done Done false
5690 2777 Acked Read 5 Sent Done Done false
5691 2778 Acked Read 5 Sent Done Done false
5692 2779 Acked Read 6 Sent Done Done false
5693 2780 Acked Write 8 Sent Done Done false
5694 2781 Acked Flush 0 Sent Done Done false
5695 2782 Acked Read 10 Sent Done Done false
5696 2783 Acked Read 5 Sent Done Done false
5697 2784 Acked Write 7 Sent Done Done false
5698 2785 Acked Flush 0 Sent Done Done false
5699 2786 Acked Read 10 Sent Done Done false
5700 2787 Acked Read 4 Sent Done Done false
5701 2788 Acked Write 1 Sent Done Done false
5702 2789 Acked Read 4 Sent Done Done false
5703 2790 Acked Write 5 Sent Done Done false
5704 2791 Acked Write 1 Sent Done Done false
5705 2792 Acked Write 10 Sent Done Done false
5706 2793 Acked Read 4 Sent Done Done false
5707 2794 Acked Write 8 Sent Done Done false
5708 2795 Acked Read 3 Sent Done Done false
5709 2796 Acked Write 2 Sent Done Done false
5710 2797 Acked Read 9 Sent Done Done false
5711 2798 Acked Write 6 Sent Done Done false
5712 2799 Acked Read 7 Sent Done Done false
5713 2800 Acked Write 1 Sent Done Done false
5714 2801 Acked Read 5 Sent Done Done false
5715 2802 Acked Read 1 Sent Done Done false
5716 2803 Acked Read 7 Sent Done Done false
5717 2804 Acked Read 4 Sent Done Done false
5718 2805 Acked Flush 0 Sent Done Done false
5719 2806 Acked Write 5 Sent Done Done false
5720 2807 Acked Read 2 Sent Done Done false
5721 2808 Acked Read 9 Sent Done Done false
5722 2809 Acked Flush 0 Sent Done Done false
5723 STATES DS:0 DS:1 DS:2 TOTAL
5724 Sent 301 0 0 301
5725 Done 0 301 301 602
5726 Skipped 0 0 0 0
5727 Error 0 0 0 0
5728 Last Flush: 2508 2809 2809
5729 Downstairs last five completed: 2508 2507 2506 2505 2504
5730 Upstairs last five completed: 2809 2808 2807 2806 2805
5731 CLIENT: Up:0 ds:301 act:2
5732 ----------------------------------------------------------------
5733 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:301
5734 States: Offline Active Active
5735 JOBID ACK TYPE BKS/EXT DS:0 DS:1 DS:2 REPLAY
5736 2509 Acked Read 5 Sent Done Done false
5737 2510 Acked Write 1 Sent Done Done false
5738 2511 Acked Flush 0 Sent Done Done false
5739 2512 Acked Flush 0 Sent Done Done false
5740 2513 Acked Read 4 Sent Done Done false
5741 2514 Acked Read 1 Sent Done Done false
5742 2515 Acked Read 5 Sent Done Done false
5743 2516 Acked Write 8 Sent Done Done false
5744 2517 Acked Flush 0 Sent Done Done false
5745 2518 Acked Read 9 Sent Done Done false
5746 2519 Acked Read 10 Sent Done Done false
5747 2520 Acked Read 8 Sent Done Done false
5748 2521 Acked Read 8 Sent Done Done false
5749 2522 Acked Write 6 Sent Done Done false
5750 2523 Acked Write 2 Sent Done Done false
5751 2524 Acked Write 8 Sent Done Done false
5752 2525 Acked Read 7 Sent Done Done false
5753 2526 Acked Read 2 Sent Done Done false
5754 2527 Acked Write 4 Sent Done Done false
5755 2528 Acked Read 6 Sent Done Done false
5756 2529 Acked Read 10 Sent Done Done false
5757 2530 Acked Write 3 Sent Done Done false
5758 2531 Acked Read 8 Sent Done Done false
5759 2532 Acked Flush 0 Sent Done Done false
5760 2533 Acked Read 10 Sent Done Done false
5761 2534 Acked Read 5 Sent Done Done false
5762 2535 Acked Write 1 Sent Done Done false
5763 2536 Acked Read 8 Sent Done Done false
5764 2537 Acked Read 6 Sent Done Done false
5765 2538 Acked Write 5 Sent Done Done false
5766 2539 Acked Read 5 Sent Done Done false
5767 2540 Acked Read 5 Sent Done Done false
5768 2541 Acked Write 7 Sent Done Done false
5769 2542 Acked Write 7 Sent Done Done false
5770 2543 Acked Write 4 Sent Done Done false
5771 2544 Acked Read 5 Sent Done Done false
5772 2545 Acked Flush 0 Sent Done Done false
5773 2546 Acked Read 7 Sent Done Done false
5774 2547 Acked Write 10 Sent Done Done false
5775 2548 Acked Read 9 Sent Done Done false
5776 2549 Acked Read 7 Sent Done Done false
5777 2550 Acked Write 4 Sent Done Done false
5778 2551 Acked Write 4 Sent Done Done false
5779 2552 Acked Flush 0 Sent Done Done false
5780 2553 Acked Write 5 Sent Done Done false
5781 2554 Acked Write 6 Sent Done Done false
5782 2555 Acked Flush 0 Sent Done Done false
5783 2556 Acked Read 1 Sent Done Done false
5784 2557 Acked Read 9 Sent Done Done false
5785 2558 Acked Write 4 Sent Done Done false
5786 2559 Acked Read 2 Sent Done Done false
5787 2560 Acked Read 9 Sent Done Done false
5788 2561 Acked Read 7 Sent Done Done false
5789 2562 Acked Write 10 Sent Done Done false
5790 2563 Acked Write 5 Sent Done Done false
5791 2564 Acked Write 5 Sent Done Done false
5792 2565 Acked Read 4 Sent Done Done false
5793 2566 Acked Write 10 Sent Done Done false
5794 2567 Acked Write 7 Sent Done Done false
5795 2568 Acked Read 9 Sent Done Done false
5796 2569 Acked Write 5 Sent Done Done false
5797 2570 Acked Write 3 Sent Done Done false
5798 2571 Acked Write 1 Sent Done Done false
5799 2572 Acked Read 8 Sent Done Done false
5800 2573 Acked Read 5 Sent Done Done false
5801 2574 Acked Write 4 Sent Done Done false
5802 2575 Acked Read 10 Sent Done Done false
5803 2576 Acked Write 8 Sent Done Done false
5804 2577 Acked Write 8 Sent Done Done false
5805 2578 Acked Write 2 Sent Done Done false
5806 2579 Acked Read 4 Sent Done Done false
5807 2580 Acked Read 10 Sent Done Done false
5808 2581 Acked Write 4 Sent Done Done false
5809 2582 Acked Read 4 Sent Done Done false
5810 2583 Acked Write 4 Sent Done Done false
5811 2584 Acked Write 2 Sent Done Done false
5812 2585 Acked Flush 0 Sent Done Done false
5813 2586 Acked Flush 0 Sent Done Done false
5814 2587 Acked Write 9 Sent Done Done false
5815 2588 Acked Read 8 Sent Done Done false
5816 2589 Acked Read 6 Sent Done Done false
5817 2590 Acked Write 1 Sent Done Done false
5818 2591 Acked Read 2 Sent Done Done false
5819 2592 Acked Read 9 Sent Done Done false
5820 2593 Acked Read 6 Sent Done Done false
5821 2594 Acked Read 1 Sent Done Done false
5822 2595 Acked Write 8 Sent Done Done false
5823 2596 Acked Write 10 Sent Done Done false
5824 2597 Acked Read 7 Sent Done Done false
5825 2598 Acked Write 9 Sent Done Done false
5826 2599 Acked Read 3 Sent Done Done false
5827 2600 Acked Read 4 Sent Done Done false
5828 2601 Acked Read 5 Sent Done Done false
5829 2602 Acked Write 2 Sent Done Done false
5830 2603 Acked Flush 0 Sent Done Done false
5831 2604 Acked Read 5 Sent Done Done false
5832 2605 Acked Write 2 Sent Done Done false
5833 2606 Acked Read 10 Sent Done Done false
5834 2607 Acked Flush 0 Sent Done Done false
5835 2608 Acked Read 9 Sent Done Done false
5836 2609 Acked Write 8 Sent Done Done false
5837 2610 Acked Read 6 Sent Done Done false
5838 2611 Acked Read 9 Sent Done Done false
5839 2612 Acked Write 4 Sent Done Done false
5840 2613 Acked Read 8 Sent Done Done false
5841 2614 Acked Write 10 Sent Done Done false
5842 2615 Acked Write 7 Sent Done Done false
5843 2616 Acked Write 5 Sent Done Done false
5844 2617 Acked Write 2 Sent Done Done false
5845 2618 Acked Flush 0 Sent Done Done false
5846 2619 Acked Read 3 Sent Done Done false
5847 2620 Acked Write 10 Sent Done Done false
5848 2621 Acked Read 2 Sent Done Done false
5849 2622 Acked Read 10 Sent Done Done false
5850 2623 Acked Read 4 Sent Done Done false
5851 2624 Acked Write 5 Sent Done Done false
5852 2625 Acked Read 5 Sent Done Done false
5853 2626 Acked Write 5 Sent Done Done false
5854 2627 Acked Write 4 Sent Done Done false
5855 2628 Acked Read 6 Sent Done Done false
5856 2629 Acked Read 4 Sent Done Done false
5857 2630 Acked Read 10 Sent Done Done false
5858 2631 Acked Read 6 Sent Done Done false
5859 2632 Acked Read 9 Sent Done Done false
5860 2633 Acked Flush 0 Sent Done Done false
5861 2634 Acked Read 10 Sent Done Done false
5862 2635 Acked Read 9 Sent Done Done false
5863 2636 Acked Read 10 Sent Done Done false
5864 2637 Acked Read 1 Sent Done Done false
5865 2638 Acked Read 10 Sent Done Done false
5866 2639 Acked Read 4 Sent Done Done false
5867 2640 Acked Read 6 Sent Done Done false
5868 2641 Acked Read 8 Sent Done Done false
5869 2642 Acked Read 10 Sent Done Done false
5870 2643 Acked Read 2 Sent Done Done false
5871 2644 Acked Write 2 Sent Done Done false
5872 2645 Acked Read 8 Sent Done Done false
5873 2646 Acked Read 1 Sent Done Done false
5874 2647 Acked Write 1 Sent Done Done false
5875 2648 Acked Flush 0 Sent Done Done false
5876 2649 Acked Read 7 Sent Done Done false
5877 2650 Acked Write 9 Sent Done Done false
5878 2651 Acked Read 8 Sent Done Done false
5879 2652 Acked Write 10 Sent Done Done false
5880 2653 Acked Read 3 Sent Done Done false
5881 2654 Acked Flush 0 Sent Done Done false
5882 2655 Acked Read 5 Sent Done Done false
5883 2656 Acked Write 1 Sent Done Done false
5884 2657 Acked Write 4 Sent Done Done false
5885 2658 Acked Read 6 Sent Done Done false
5886 2659 Acked Flush 0 Sent Done Done false
5887 2660 Acked Read 4 Sent Done Done false
5888 2661 Acked Read 5 Sent Done Done false
5889 2662 Acked Read 8 Sent Done Done false
5890 2663 Acked Read 5 Sent Done Done false
5891 2664 Acked Read 6 Sent Done Done false
5892 2665 Acked Read 2 Sent Done Done false
5893 2666 Acked Read 2 Sent Done Done false
5894 2667 Acked Write 4 Sent Done Done false
5895 2668 Acked Write 7 Sent Done Done false
5896 2669 Acked Write 10 Sent Done Done false
5897 2670 Acked Write 7 Sent Done Done false
5898 2671 Acked Flush 0 Sent Done Done false
5899 2672 Acked Read 4 Sent Done Done false
5900 2673 Acked Read 5 Sent Done Done false
5901 2674 Acked Read 7 Sent Done Done false
5902 2675 Acked Read 2 Sent Done Done false
5903 2676 Acked Read 2 Sent Done Done false
5904 2677 Acked Write 3 Sent Done Done false
5905 2678 Acked Read 8 Sent Done Done false
5906 2679 Acked Flush 0 Sent Done Done false
5907 2680 Acked Read 4 Sent Done Done false
5908 2681 Acked Write 4 Sent Done Done false
5909 2682 Acked Write 8 Sent Done Done false
5910 2683 Acked Flush 0 Sent Done Done false
5911 2684 Acked Read 10 Sent Done Done false
5912 2685 Acked Flush 0 Sent Done Done false
5913 2686 Acked Write 1 Sent Done Done false
5914 2687 Acked Write 2 Sent Done Done false
5915 2688 Acked Write 8 Sent Done Done false
5916 2689 Acked Flush 0 Sent Done Done false
5917 2690 Acked Read 5 Sent Done Done false
5918 2691 Acked Flush 0 Sent Done Done false
5919 2692 Acked Write 4 Sent Done Done false
5920 2693 Acked Write 6 Sent Done Done false
5921 2694 Acked Read 5 Sent Done Done false
5922 2695 Acked Read 10 Sent Done Done false
5923 2696 Acked Flush 0 Sent Done Done false
5924 2697 Acked Write 10 Sent Done Done false
5925 2698 Acked Read 2 Sent Done Done false
5926 2699 Acked Write 7 Sent Done Done false
5927 2700 Acked Write 6 Sent Done Done false
5928 2701 Acked Read 6 Sent Done Done false
5929 2702 Acked Read 4 Sent Done Done false
5930 2703 Acked Read 10 Sent Done Done false
5931 2704 Acked Read 8 Sent Done Done false
5932 2705 Acked Read 3 Sent Done Done false
5933 2706 Acked Read 10 Sent Done Done false
5934 2707 Acked Read 10 Sent Done Done false
5935 2708 Acked Flush 0 Sent Done Done false
5936 2709 Acked Read 3 Sent Done Done false
5937 2710 Acked Read 8 Sent Done Done false
5938 2711 Acked Write 4 Sent Done Done false
5939 2712 Acked Write 8 Sent Done Done false
5940 2713 Acked Read 6 Sent Done Done false
5941 2714 Acked Read 8 Sent Done Done false
5942 2715 Acked Read 4 Sent Done Done false
5943 2716 Acked Write 1 Sent Done Done false
5944 2717 Acked Write 5 Sent Done Done false
5945 2718 Acked Write 2 Sent Done Done false
5946 2719 Acked Write 7 Sent Done Done false
5947 2720 Acked Read 5 Sent Done Done false
5948 2721 Acked Read 9 Sent Done Done false
5949 2722 Acked Read 6 Sent Done Done false
5950 2723 Acked Write 9 Sent Done Done false
5951 2724 Acked Flush 0 Sent Done Done false
5952 2725 Acked Read 6 Sent Done Done false
5953 2726 Acked Write 9 Sent Done Done false
5954 2727 Acked Write 6 Sent Done Done false
5955 2728 Acked Read 4 Sent Done Done false
5956 2729 Acked Read 3 Sent Done Done false
5957 2730 Acked Read 7 Sent Done Done false
5958 2731 Acked Read 8 Sent Done Done false
5959 2732 Acked Write 1 Sent Done Done false
5960 2733 Acked Read 6 Sent Done Done false
5961 2734 Acked Flush 0 Sent Done Done false
5962 2735 Acked Read 1 Sent Done Done false
5963 2736 Acked Write 2 Sent Done Done false
5964 2737 Acked Write 5 Sent Done Done false
5965 2738 Acked Read 10 Sent Done Done false
5966 2739 Acked Read 3 Sent Done Done false
5967 2740 Acked Read 6 Sent Done Done false
5968 2741 Acked Read 2 Sent Done Done false
5969 2742 Acked Read 1 Sent Done Done false
5970 2743 Acked Write 9 Sent Done Done false
5971 2744 Acked Write 7 Sent Done Done false
5972 2745 Acked Read 5 Sent Done Done false
5973 2746 Acked Flush 0 Sent Done Done false
5974 2747 Acked Read 8 Sent Done Done false
5975 2748 Acked Read 9 Sent Done Done false
5976 2749 Acked Read 4 Sent Done Done false
5977 2750 Acked Write 1 Sent Done Done false
5978 2751 Acked Read 6 Sent Done Done false
5979 2752 Acked Read 3 Sent Done Done false
5980 2753 Acked Write 1 Sent Done Done false
5981 2754 Acked Flush 0 Sent Done Done false
5982 2755 Acked Write 1 Sent Done Done false
5983 2756 Acked Write 10 Sent Done Done false
5984 2757 Acked Write 7 Sent Done Done false
5985 2758 Acked Write 6 Sent Done Done false
5986 2759 Acked Write 3 Sent Done Done false
5987 2760 Acked Write 6 Sent Done Done false
5988 2761 Acked Write 3 Sent Done Done false
5989 2762 Acked Read 8 Sent Done Done false
5990 2763 Acked Read 6 Sent Done Done false
5991 2764 Acked Write 4 Sent Done Done false
5992 2765 Acked Write 2 Sent Done Done false
5993 2766 Acked Read 1 Sent Done Done false
5994 2767 Acked Write 1 Sent Done Done false
5995 2768 Acked Write 10 Sent Done Done false
5996 2769 Acked Write 9 Sent Done Done false
5997 2770 Acked Read 6 Sent Done Done false
5998 2771 Acked Flush 0 Sent Done Done false
5999 2772 Acked Write 1 Sent Done Done false
6000 2773 Acked Flush 0 Sent Done Done false
6001 2774 Acked Read 10 Sent Done Done false
6002 2775 Acked Write 2 Sent Done Done false
6003 2776 Acked Read 6 Sent Done Done false
6004 2777 Acked Read 5 Sent Done Done false
6005 2778 Acked Read 5 Sent Done Done false
6006 2779 Acked Read 6 Sent Done Done false
6007 2780 Acked Write 8 Sent Done Done false
6008 2781 Acked Flush 0 Sent Done Done false
6009 2782 Acked Read 10 Sent Done Done false
6010 2783 Acked Read 5 Sent Done Done false
6011 2784 Acked Write 7 Sent Done Done false
6012 2785 Acked Flush 0 Sent Done Done false
6013 2786 Acked Read 10 Sent Done Done false
6014 2787 Acked Read 4 Sent Done Done false
6015 2788 Acked Write 1 Sent Done Done false
6016 2789 Acked Read 4 Sent Done Done false
6017 2790 Acked Write 5 Sent Done Done false
6018 2791 Acked Write 1 Sent Done Done false
6019 2792 Acked Write 10 Sent Done Done false
6020 2793 Acked Read 4 Sent Done Done false
6021 2794 Acked Write 8 Sent Done Done false
6022 2795 Acked Read 3 Sent Done Done false
6023 2796 Acked Write 2 Sent Done Done false
6024 2797 Acked Read 9 Sent Done Done false
6025 2798 Acked Write 6 Sent Done Done false
6026 2799 Acked Read 7 Sent Done Done false
6027 2800 Acked Write 1 Sent Done Done false
6028 2801 Acked Read 5 Sent Done Done false
6029 2802 Acked Read 1 Sent Done Done false
6030 2803 Acked Read 7 Sent Done Done false
6031 2804 Acked Read 4 Sent Done Done false
6032 2805 Acked Flush 0 Sent Done Done false
6033 2806 Acked Write 5 Sent Done Done false
6034 2807 Acked Read 2 Sent Done Done false
6035 2808 Acked Read 9 Sent Done Done false
6036 2809 Acked Flush 0 Sent Done Done false
6037 STATES DS:0 DS:1 DS:2 TOTAL
6038 Sent 301 0 0 301
6039 Done 0 301 301 602
6040 Skipped 0 0 0 0
6041 Error 0 0 0 0
6042 Last Flush: 2508 2809 2809
6043 Downstairs last five completed: 2508 2507 2506 2505 2504
6044 Upstairs last five completed: 2809 2808 2807 2806 2805
6045 CLIENT: Up:0 ds:301 act:2
60462025-01-10T16:36:34.941ZINFOcrucible: connecting to 127.0.0.1:8810 = io task client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
60472025-01-10T16:36:34.942ZWARNcrucible: ds_connection connect to 127.0.0.1:8810 failure: Os { code: 146, kind: ConnectionRefused, message: "Connection refused" } = io task client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
60482025-01-10T16:36:34.942ZWARNcrucible: client task is sending Done(ConnectionFailed(Os { code: 146, kind: ConnectionRefused, message: "Connection refused" })) = io task client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
60492025-01-10T16:36:34.942ZWARNcrucible: downstairs task for 0 stopped due to ConnectionFailed(Os { code: 146, kind: ConnectionRefused, message: "Connection refused" }) session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
60502025-01-10T16:36:34.942ZINFOcrucible: client task is exiting = io task client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
6051 ----------------------------------------------------------------
6052 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:301
6053 States: Offline Active Active
6054 JOBID ACK TYPE BKS/EXT DS:0 DS:1 DS:2 REPLAY
6055 2509 Acked Read 5 Sent Done Done false
6056 2510 Acked Write 1 Sent Done Done false
6057 2511 Acked Flush 0 Sent Done Done false
6058 2512 Acked Flush 0 Sent Done Done false
6059 2513 Acked Read 4 Sent Done Done false
6060 2514 Acked Read 1 Sent Done Done false
6061 2515 Acked Read 5 Sent Done Done false
6062 2516 Acked Write 8 Sent Done Done false
6063 2517 Acked Flush 0 Sent Done Done false
6064 2518 Acked Read 9 Sent Done Done false
6065 2519 Acked Read 10 Sent Done Done false
6066 2520 Acked Read 8 Sent Done Done false
6067 2521 Acked Read 8 Sent Done Done false
6068 2522 Acked Write 6 Sent Done Done false
6069 2523 Acked Write 2 Sent Done Done false
6070 2524 Acked Write 8 Sent Done Done false
6071 2525 Acked Read 7 Sent Done Done false
6072 2526 Acked Read 2 Sent Done Done false
6073 2527 Acked Write 4 Sent Done Done false
6074 2528 Acked Read 6 Sent Done Done false
6075 2529 Acked Read 10 Sent Done Done false
6076 2530 Acked Write 3 Sent Done Done false
6077 2531 Acked Read 8 Sent Done Done false
6078 2532 Acked Flush 0 Sent Done Done false
6079 2533 Acked Read 10 Sent Done Done false
6080 2534 Acked Read 5 Sent Done Done false
6081 2535 Acked Write 1 Sent Done Done false
6082 2536 Acked Read 8 Sent Done Done false
6083 2537 Acked Read 6 Sent Done Done false
6084 2538 Acked Write 5 Sent Done Done false
6085 2539 Acked Read 5 Sent Done Done false
6086 2540 Acked Read 5 Sent Done Done false
6087 2541 Acked Write 7 Sent Done Done false
6088 2542 Acked Write 7 Sent Done Done false
6089 2543 Acked Write 4 Sent Done Done false
6090 2544 Acked Read 5 Sent Done Done false
6091 2545 Acked Flush 0 Sent Done Done false
6092 2546 Acked Read 7 Sent Done Done false
6093 2547 Acked Write 10 Sent Done Done false
6094 2548 Acked Read 9 Sent Done Done false
6095 2549 Acked Read 7 Sent Done Done false
6096 2550 Acked Write 4 Sent Done Done false
6097 2551 Acked Write 4 Sent Done Done false
6098 2552 Acked Flush 0 Sent Done Done false
6099 2553 Acked Write 5 Sent Done Done false
6100 2554 Acked Write 6 Sent Done Done false
6101 2555 Acked Flush 0 Sent Done Done false
6102 2556 Acked Read 1 Sent Done Done false
6103 2557 Acked Read 9 Sent Done Done false
6104 2558 Acked Write 4 Sent Done Done false
6105 2559 Acked Read 2 Sent Done Done false
6106 2560 Acked Read 9 Sent Done Done false
6107 2561 Acked Read 7 Sent Done Done false
6108 2562 Acked Write 10 Sent Done Done false
6109 2563 Acked Write 5 Sent Done Done false
6110 2564 Acked Write 5 Sent Done Done false
6111 2565 Acked Read 4 Sent Done Done false
6112 2566 Acked Write 10 Sent Done Done false
6113 2567 Acked Write 7 Sent Done Done false
6114 2568 Acked Read 9 Sent Done Done false
6115 2569 Acked Write 5 Sent Done Done false
6116 2570 Acked Write 3 Sent Done Done false
6117 2571 Acked Write 1 Sent Done Done false
6118 2572 Acked Read 8 Sent Done Done false
6119 2573 Acked Read 5 Sent Done Done false
6120 2574 Acked Write 4 Sent Done Done false
6121 2575 Acked Read 10 Sent Done Done false
6122 2576 Acked Write 8 Sent Done Done false
6123 2577 Acked Write 8 Sent Done Done false
6124 2578 Acked Write 2 Sent Done Done false
6125 2579 Acked Read 4 Sent Done Done false
6126 2580 Acked Read 10 Sent Done Done false
6127 2581 Acked Write 4 Sent Done Done false
6128 2582 Acked Read 4 Sent Done Done false
6129 2583 Acked Write 4 Sent Done Done false
6130 2584 Acked Write 2 Sent Done Done false
6131 2585 Acked Flush 0 Sent Done Done false
6132 2586 Acked Flush 0 Sent Done Done false
6133 2587 Acked Write 9 Sent Done Done false
6134 2588 Acked Read 8 Sent Done Done false
6135 2589 Acked Read 6 Sent Done Done false
6136 2590 Acked Write 1 Sent Done Done false
6137 2591 Acked Read 2 Sent Done Done false
6138 2592 Acked Read 9 Sent Done Done false
6139 2593 Acked Read 6 Sent Done Done false
6140 2594 Acked Read 1 Sent Done Done false
6141 2595 Acked Write 8 Sent Done Done false
6142 2596 Acked Write 10 Sent Done Done false
6143 2597 Acked Read 7 Sent Done Done false
6144 2598 Acked Write 9 Sent Done Done false
6145 2599 Acked Read 3 Sent Done Done false
6146 2600 Acked Read 4 Sent Done Done false
6147 2601 Acked Read 5 Sent Done Done false
6148 2602 Acked Write 2 Sent Done Done false
6149 2603 Acked Flush 0 Sent Done Done false
6150 2604 Acked Read 5 Sent Done Done false
6151 2605 Acked Write 2 Sent Done Done false
6152 2606 Acked Read 10 Sent Done Done false
6153 2607 Acked Flush 0 Sent Done Done false
6154 2608 Acked Read 9 Sent Done Done false
6155 2609 Acked Write 8 Sent Done Done false
6156 2610 Acked Read 6 Sent Done Done false
6157 2611 Acked Read 9 Sent Done Done false
6158 2612 Acked Write 4 Sent Done Done false
6159 2613 Acked Read 8 Sent Done Done false
6160 2614 Acked Write 10 Sent Done Done false
6161 2615 Acked Write 7 Sent Done Done false
6162 2616 Acked Write 5 Sent Done Done false
6163 2617 Acked Write 2 Sent Done Done false
6164 2618 Acked Flush 0 Sent Done Done false
6165 2619 Acked Read 3 Sent Done Done false
6166 2620 Acked Write 10 Sent Done Done false
6167 2621 Acked Read 2 Sent Done Done false
6168 2622 Acked Read 10 Sent Done Done false
6169 2623 Acked Read 4 Sent Done Done false
6170 2624 Acked Write 5 Sent Done Done false
6171 2625 Acked Read 5 Sent Done Done false
6172 2626 Acked Write 5 Sent Done Done false
6173 2627 Acked Write 4 Sent Done Done false
6174 2628 Acked Read 6 Sent Done Done false
6175 2629 Acked Read 4 Sent Done Done false
6176 2630 Acked Read 10 Sent Done Done false
6177 2631 Acked Read 6 Sent Done Done false
6178 2632 Acked Read 9 Sent Done Done false
6179 2633 Acked Flush 0 Sent Done Done false
6180 2634 Acked Read 10 Sent Done Done false
6181 2635 Acked Read 9 Sent Done Done false
6182 2636 Acked Read 10 Sent Done Done false
6183 2637 Acked Read 1 Sent Done Done false
6184 2638 Acked Read 10 Sent Done Done false
6185 2639 Acked Read 4 Sent Done Done false
6186 2640 Acked Read 6 Sent Done Done false
6187 2641 Acked Read 8 Sent Done Done false
6188 2642 Acked Read 10 Sent Done Done false
6189 2643 Acked Read 2 Sent Done Done false
6190 2644 Acked Write 2 Sent Done Done false
6191 2645 Acked Read 8 Sent Done Done false
6192 2646 Acked Read 1 Sent Done Done false
6193 2647 Acked Write 1 Sent Done Done false
6194 2648 Acked Flush 0 Sent Done Done false
6195 2649 Acked Read 7 Sent Done Done false
6196 2650 Acked Write 9 Sent Done Done false
6197 2651 Acked Read 8 Sent Done Done false
6198 2652 Acked Write 10 Sent Done Done false
6199 2653 Acked Read 3 Sent Done Done false
6200 2654 Acked Flush 0 Sent Done Done false
6201 2655 Acked Read 5 Sent Done Done false
6202 2656 Acked Write 1 Sent Done Done false
6203 2657 Acked Write 4 Sent Done Done false
6204 2658 Acked Read 6 Sent Done Done false
6205 2659 Acked Flush 0 Sent Done Done false
6206 2660 Acked Read 4 Sent Done Done false
6207 2661 Acked Read 5 Sent Done Done false
6208 2662 Acked Read 8 Sent Done Done false
6209 2663 Acked Read 5 Sent Done Done false
6210 2664 Acked Read 6 Sent Done Done false
6211 2665 Acked Read 2 Sent Done Done false
6212 2666 Acked Read 2 Sent Done Done false
6213 2667 Acked Write 4 Sent Done Done false
6214 2668 Acked Write 7 Sent Done Done false
6215 2669 Acked Write 10 Sent Done Done false
6216 2670 Acked Write 7 Sent Done Done false
6217 2671 Acked Flush 0 Sent Done Done false
6218 2672 Acked Read 4 Sent Done Done false
6219 2673 Acked Read 5 Sent Done Done false
6220 2674 Acked Read 7 Sent Done Done false
6221 2675 Acked Read 2 Sent Done Done false
6222 2676 Acked Read 2 Sent Done Done false
6223 2677 Acked Write 3 Sent Done Done false
6224 2678 Acked Read 8 Sent Done Done false
6225 2679 Acked Flush 0 Sent Done Done false
6226 2680 Acked Read 4 Sent Done Done false
6227 2681 Acked Write 4 Sent Done Done false
6228 2682 Acked Write 8 Sent Done Done false
6229 2683 Acked Flush 0 Sent Done Done false
6230 2684 Acked Read 10 Sent Done Done false
6231 2685 Acked Flush 0 Sent Done Done false
6232 2686 Acked Write 1 Sent Done Done false
6233 2687 Acked Write 2 Sent Done Done false
6234 2688 Acked Write 8 Sent Done Done false
6235 2689 Acked Flush 0 Sent Done Done false
6236 2690 Acked Read 5 Sent Done Done false
6237 2691 Acked Flush 0 Sent Done Done false
6238 2692 Acked Write 4 Sent Done Done false
6239 2693 Acked Write 6 Sent Done Done false
6240 2694 Acked Read 5 Sent Done Done false
6241 2695 Acked Read 10 Sent Done Done false
6242 2696 Acked Flush 0 Sent Done Done false
6243 2697 Acked Write 10 Sent Done Done false
6244 2698 Acked Read 2 Sent Done Done false
6245 2699 Acked Write 7 Sent Done Done false
6246 2700 Acked Write 6 Sent Done Done false
6247 2701 Acked Read 6 Sent Done Done false
6248 2702 Acked Read 4 Sent Done Done false
6249 2703 Acked Read 10 Sent Done Done false
6250 2704 Acked Read 8 Sent Done Done false
6251 2705 Acked Read 3 Sent Done Done false
6252 2706 Acked Read 10 Sent Done Done false
6253 2707 Acked Read 10 Sent Done Done false
6254 2708 Acked Flush 0 Sent Done Done false
6255 2709 Acked Read 3 Sent Done Done false
6256 2710 Acked Read 8 Sent Done Done false
6257 2711 Acked Write 4 Sent Done Done false
6258 2712 Acked Write 8 Sent Done Done false
6259 2713 Acked Read 6 Sent Done Done false
6260 2714 Acked Read 8 Sent Done Done false
6261 2715 Acked Read 4 Sent Done Done false
6262 2716 Acked Write 1 Sent Done Done false
6263 2717 Acked Write 5 Sent Done Done false
6264 2718 Acked Write 2 Sent Done Done false
6265 2719 Acked Write 7 Sent Done Done false
6266 2720 Acked Read 5 Sent Done Done false
6267 2721 Acked Read 9 Sent Done Done false
6268 2722 Acked Read 6 Sent Done Done false
6269 2723 Acked Write 9 Sent Done Done false
6270 2724 Acked Flush 0 Sent Done Done false
6271 2725 Acked Read 6 Sent Done Done false
6272 2726 Acked Write 9 Sent Done Done false
6273 2727 Acked Write 6 Sent Done Done false
6274 2728 Acked Read 4 Sent Done Done false
6275 2729 Acked Read 3 Sent Done Done false
6276 2730 Acked Read 7 Sent Done Done false
6277 2731 Acked Read 8 Sent Done Done false
6278 2732 Acked Write 1 Sent Done Done false
6279 2733 Acked Read 6 Sent Done Done false
6280 2734 Acked Flush 0 Sent Done Done false
6281 2735 Acked Read 1 Sent Done Done false
6282 2736 Acked Write 2 Sent Done Done false
6283 2737 Acked Write 5 Sent Done Done false
6284 2738 Acked Read 10 Sent Done Done false
6285 2739 Acked Read 3 Sent Done Done false
6286 2740 Acked Read 6 Sent Done Done false
6287 2741 Acked Read 2 Sent Done Done false
6288 2742 Acked Read 1 Sent Done Done false
6289 2743 Acked Write 9 Sent Done Done false
6290 2744 Acked Write 7 Sent Done Done false
6291 2745 Acked Read 5 Sent Done Done false
6292 2746 Acked Flush 0 Sent Done Done false
6293 2747 Acked Read 8 Sent Done Done false
6294 2748 Acked Read 9 Sent Done Done false
6295 2749 Acked Read 4 Sent Done Done false
6296 2750 Acked Write 1 Sent Done Done false
6297 2751 Acked Read 6 Sent Done Done false
6298 2752 Acked Read 3 Sent Done Done false
6299 2753 Acked Write 1 Sent Done Done false
6300 2754 Acked Flush 0 Sent Done Done false
6301 2755 Acked Write 1 Sent Done Done false
6302 2756 Acked Write 10 Sent Done Done false
6303 2757 Acked Write 7 Sent Done Done false
6304 2758 Acked Write 6 Sent Done Done false
6305 2759 Acked Write 3 Sent Done Done false
6306 2760 Acked Write 6 Sent Done Done false
6307 2761 Acked Write 3 Sent Done Done false
6308 2762 Acked Read 8 Sent Done Done false
6309 2763 Acked Read 6 Sent Done Done false
6310 2764 Acked Write 4 Sent Done Done false
6311 2765 Acked Write 2 Sent Done Done false
6312 2766 Acked Read 1 Sent Done Done false
6313 2767 Acked Write 1 Sent Done Done false
6314 2768 Acked Write 10 Sent Done Done false
6315 2769 Acked Write 9 Sent Done Done false
6316 2770 Acked Read 6 Sent Done Done false
6317 2771 Acked Flush 0 Sent Done Done false
6318 2772 Acked Write 1 Sent Done Done false
6319 2773 Acked Flush 0 Sent Done Done false
6320 2774 Acked Read 10 Sent Done Done false
6321 2775 Acked Write 2 Sent Done Done false
6322 2776 Acked Read 6 Sent Done Done false
6323 2777 Acked Read 5 Sent Done Done false
6324 2778 Acked Read 5 Sent Done Done false
6325 2779 Acked Read 6 Sent Done Done false
6326 2780 Acked Write 8 Sent Done Done false
6327 2781 Acked Flush 0 Sent Done Done false
6328 2782 Acked Read 10 Sent Done Done false
6329 2783 Acked Read 5 Sent Done Done false
6330 2784 Acked Write 7 Sent Done Done false
6331 2785 Acked Flush 0 Sent Done Done false
6332 2786 Acked Read 10 Sent Done Done false
6333 2787 Acked Read 4 Sent Done Done false
6334 2788 Acked Write 1 Sent Done Done false
6335 2789 Acked Read 4 Sent Done Done false
6336 2790 Acked Write 5 Sent Done Done false
6337 2791 Acked Write 1 Sent Done Done false
6338 2792 Acked Write 10 Sent Done Done false
6339 2793 Acked Read 4 Sent Done Done false
6340 2794 Acked Write 8 Sent Done Done false
6341 2795 Acked Read 3 Sent Done Done false
6342 2796 Acked Write 2 Sent Done Done false
6343 2797 Acked Read 9 Sent Done Done false
6344 2798 Acked Write 6 Sent Done Done false
6345 2799 Acked Read 7 Sent Done Done false
6346 2800 Acked Write 1 Sent Done Done false
6347 2801 Acked Read 5 Sent Done Done false
6348 2802 Acked Read 1 Sent Done Done false
6349 2803 Acked Read 7 Sent Done Done false
6350 2804 Acked Read 4 Sent Done Done false
6351 2805 Acked Flush 0 Sent Done Done false
6352 2806 Acked Write 5 Sent Done Done false
6353 2807 Acked Read 2 Sent Done Done false
6354 2808 Acked Read 9 Sent Done Done false
6355 2809 Acked Flush 0 Sent Done Done false
6356 STATES DS:0 DS:1 DS:2 TOTAL
6357 Sent 301 0 0 301
6358 Done 0 301 301 602
6359 Skipped 0 0 0 0
6360 Error 0 0 0 0
6361 Last Flush: 2508 2809 2809
6362 Downstairs last five completed: 2508 2507 2506 2505 2504
6363 Upstairs last five completed: 2809 2808 2807 2806 2805
6364 CLIENT: Up:0 ds:301 act:2
6365 [8810] got start action
6366 [8810] I am going to restart
6367 Starting downstairs at port 8810
6368 Make output file at "/tmp/dsc/downstairs-8810.txt"
6369 [8810][0] reports Starting
6370 Downstairs /var/tmp/dsc/region/8810 port 8810 PID:Some(1208)
6371 [8810][0] reports Running
6372 ----------------------------------------------------------------
6373 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:301
6374 States: Offline Active Active
6375 JOBID ACK TYPE BKS/EXT DS:0 DS:1 DS:2 REPLAY
6376 2509 Acked Read 5 Sent Done Done false
6377 2510 Acked Write 1 Sent Done Done false
6378 2511 Acked Flush 0 Sent Done Done false
6379 2512 Acked Flush 0 Sent Done Done false
6380 2513 Acked Read 4 Sent Done Done false
6381 2514 Acked Read 1 Sent Done Done false
6382 2515 Acked Read 5 Sent Done Done false
6383 2516 Acked Write 8 Sent Done Done false
6384 2517 Acked Flush 0 Sent Done Done false
6385 2518 Acked Read 9 Sent Done Done false
6386 2519 Acked Read 10 Sent Done Done false
6387 2520 Acked Read 8 Sent Done Done false
6388 2521 Acked Read 8 Sent Done Done false
6389 2522 Acked Write 6 Sent Done Done false
6390 2523 Acked Write 2 Sent Done Done false
6391 2524 Acked Write 8 Sent Done Done false
6392 2525 Acked Read 7 Sent Done Done false
6393 2526 Acked Read 2 Sent Done Done false
6394 2527 Acked Write 4 Sent Done Done false
6395 2528 Acked Read 6 Sent Done Done false
6396 2529 Acked Read 10 Sent Done Done false
6397 2530 Acked Write 3 Sent Done Done false
6398 2531 Acked Read 8 Sent Done Done false
6399 2532 Acked Flush 0 Sent Done Done false
6400 2533 Acked Read 10 Sent Done Done false
6401 2534 Acked Read 5 Sent Done Done false
6402 2535 Acked Write 1 Sent Done Done false
6403 2536 Acked Read 8 Sent Done Done false
6404 2537 Acked Read 6 Sent Done Done false
6405 2538 Acked Write 5 Sent Done Done false
6406 2539 Acked Read 5 Sent Done Done false
6407 2540 Acked Read 5 Sent Done Done false
6408 2541 Acked Write 7 Sent Done Done false
6409 2542 Acked Write 7 Sent Done Done false
6410 2543 Acked Write 4 Sent Done Done false
6411 2544 Acked Read 5 Sent Done Done false
6412 2545 Acked Flush 0 Sent Done Done false
6413 2546 Acked Read 7 Sent Done Done false
6414 2547 Acked Write 10 Sent Done Done false
6415 2548 Acked Read 9 Sent Done Done false
6416 2549 Acked Read 7 Sent Done Done false
6417 2550 Acked Write 4 Sent Done Done false
6418 2551 Acked Write 4 Sent Done Done false
6419 2552 Acked Flush 0 Sent Done Done false
6420 2553 Acked Write 5 Sent Done Done false
6421 2554 Acked Write 6 Sent Done Done false
6422 2555 Acked Flush 0 Sent Done Done false
6423 2556 Acked Read 1 Sent Done Done false
6424 2557 Acked Read 9 Sent Done Done false
6425 2558 Acked Write 4 Sent Done Done false
6426 2559 Acked Read 2 Sent Done Done false
6427 2560 Acked Read 9 Sent Done Done false
6428 2561 Acked Read 7 Sent Done Done false
6429 2562 Acked Write 10 Sent Done Done false
6430 2563 Acked Write 5 Sent Done Done false
6431 2564 Acked Write 5 Sent Done Done false
6432 2565 Acked Read 4 Sent Done Done false
6433 2566 Acked Write 10 Sent Done Done false
6434 2567 Acked Write 7 Sent Done Done false
6435 2568 Acked Read 9 Sent Done Done false
6436 2569 Acked Write 5 Sent Done Done false
6437 2570 Acked Write 3 Sent Done Done false
6438 2571 Acked Write 1 Sent Done Done false
6439 2572 Acked Read 8 Sent Done Done false
6440 2573 Acked Read 5 Sent Done Done false
6441 2574 Acked Write 4 Sent Done Done false
6442 2575 Acked Read 10 Sent Done Done false
6443 2576 Acked Write 8 Sent Done Done false
6444 2577 Acked Write 8 Sent Done Done false
6445 2578 Acked Write 2 Sent Done Done false
6446 2579 Acked Read 4 Sent Done Done false
6447 2580 Acked Read 10 Sent Done Done false
6448 2581 Acked Write 4 Sent Done Done false
6449 2582 Acked Read 4 Sent Done Done false
6450 2583 Acked Write 4 Sent Done Done false
6451 2584 Acked Write 2 Sent Done Done false
6452 2585 Acked Flush 0 Sent Done Done false
6453 2586 Acked Flush 0 Sent Done Done false
6454 2587 Acked Write 9 Sent Done Done false
6455 2588 Acked Read 8 Sent Done Done false
6456 2589 Acked Read 6 Sent Done Done false
6457 2590 Acked Write 1 Sent Done Done false
6458 2591 Acked Read 2 Sent Done Done false
6459 2592 Acked Read 9 Sent Done Done false
6460 2593 Acked Read 6 Sent Done Done false
6461 2594 Acked Read 1 Sent Done Done false
6462 2595 Acked Write 8 Sent Done Done false
6463 2596 Acked Write 10 Sent Done Done false
6464 2597 Acked Read 7 Sent Done Done false
6465 2598 Acked Write 9 Sent Done Done false
6466 2599 Acked Read 3 Sent Done Done false
6467 2600 Acked Read 4 Sent Done Done false
6468 2601 Acked Read 5 Sent Done Done false
6469 2602 Acked Write 2 Sent Done Done false
6470 2603 Acked Flush 0 Sent Done Done false
6471 2604 Acked Read 5 Sent Done Done false
6472 2605 Acked Write 2 Sent Done Done false
6473 2606 Acked Read 10 Sent Done Done false
6474 2607 Acked Flush 0 Sent Done Done false
6475 2608 Acked Read 9 Sent Done Done false
6476 2609 Acked Write 8 Sent Done Done false
6477 2610 Acked Read 6 Sent Done Done false
6478 2611 Acked Read 9 Sent Done Done false
6479 2612 Acked Write 4 Sent Done Done false
6480 2613 Acked Read 8 Sent Done Done false
6481 2614 Acked Write 10 Sent Done Done false
6482 2615 Acked Write 7 Sent Done Done false
6483 2616 Acked Write 5 Sent Done Done false
6484 2617 Acked Write 2 Sent Done Done false
6485 2618 Acked Flush 0 Sent Done Done false
6486 2619 Acked Read 3 Sent Done Done false
6487 2620 Acked Write 10 Sent Done Done false
6488 2621 Acked Read 2 Sent Done Done false
6489 2622 Acked Read 10 Sent Done Done false
6490 2623 Acked Read 4 Sent Done Done false
6491 2624 Acked Write 5 Sent Done Done false
6492 2625 Acked Read 5 Sent Done Done false
6493 2626 Acked Write 5 Sent Done Done false
6494 2627 Acked Write 4 Sent Done Done false
6495 2628 Acked Read 6 Sent Done Done false
6496 2629 Acked Read 4 Sent Done Done false
6497 2630 Acked Read 10 Sent Done Done false
6498 2631 Acked Read 6 Sent Done Done false
6499 2632 Acked Read 9 Sent Done Done false
6500 2633 Acked Flush 0 Sent Done Done false
6501 2634 Acked Read 10 Sent Done Done false
6502 2635 Acked Read 9 Sent Done Done false
6503 2636 Acked Read 10 Sent Done Done false
6504 2637 Acked Read 1 Sent Done Done false
6505 2638 Acked Read 10 Sent Done Done false
6506 2639 Acked Read 4 Sent Done Done false
6507 2640 Acked Read 6 Sent Done Done false
6508 2641 Acked Read 8 Sent Done Done false
6509 2642 Acked Read 10 Sent Done Done false
6510 2643 Acked Read 2 Sent Done Done false
6511 2644 Acked Write 2 Sent Done Done false
6512 2645 Acked Read 8 Sent Done Done false
6513 2646 Acked Read 1 Sent Done Done false
6514 2647 Acked Write 1 Sent Done Done false
6515 2648 Acked Flush 0 Sent Done Done false
6516 2649 Acked Read 7 Sent Done Done false
6517 2650 Acked Write 9 Sent Done Done false
6518 2651 Acked Read 8 Sent Done Done false
6519 2652 Acked Write 10 Sent Done Done false
6520 2653 Acked Read 3 Sent Done Done false
6521 2654 Acked Flush 0 Sent Done Done false
6522 2655 Acked Read 5 Sent Done Done false
6523 2656 Acked Write 1 Sent Done Done false
6524 2657 Acked Write 4 Sent Done Done false
6525 2658 Acked Read 6 Sent Done Done false
6526 2659 Acked Flush 0 Sent Done Done false
6527 2660 Acked Read 4 Sent Done Done false
6528 2661 Acked Read 5 Sent Done Done false
6529 2662 Acked Read 8 Sent Done Done false
6530 2663 Acked Read 5 Sent Done Done false
6531 2664 Acked Read 6 Sent Done Done false
6532 2665 Acked Read 2 Sent Done Done false
6533 2666 Acked Read 2 Sent Done Done false
6534 2667 Acked Write 4 Sent Done Done false
6535 2668 Acked Write 7 Sent Done Done false
6536 2669 Acked Write 10 Sent Done Done false
6537 2670 Acked Write 7 Sent Done Done false
6538 2671 Acked Flush 0 Sent Done Done false
6539 2672 Acked Read 4 Sent Done Done false
6540 2673 Acked Read 5 Sent Done Done false
6541 2674 Acked Read 7 Sent Done Done false
6542 2675 Acked Read 2 Sent Done Done false
6543 2676 Acked Read 2 Sent Done Done false
6544 2677 Acked Write 3 Sent Done Done false
6545 2678 Acked Read 8 Sent Done Done false
6546 2679 Acked Flush 0 Sent Done Done false
6547 2680 Acked Read 4 Sent Done Done false
6548 2681 Acked Write 4 Sent Done Done false
6549 2682 Acked Write 8 Sent Done Done false
6550 2683 Acked Flush 0 Sent Done Done false
6551 2684 Acked Read 10 Sent Done Done false
6552 2685 Acked Flush 0 Sent Done Done false
6553 2686 Acked Write 1 Sent Done Done false
6554 2687 Acked Write 2 Sent Done Done false
6555 2688 Acked Write 8 Sent Done Done false
6556 2689 Acked Flush 0 Sent Done Done false
6557 2690 Acked Read 5 Sent Done Done false
6558 2691 Acked Flush 0 Sent Done Done false
6559 2692 Acked Write 4 Sent Done Done false
6560 2693 Acked Write 6 Sent Done Done false
6561 2694 Acked Read 5 Sent Done Done false
6562 2695 Acked Read 10 Sent Done Done false
6563 2696 Acked Flush 0 Sent Done Done false
6564 2697 Acked Write 10 Sent Done Done false
6565 2698 Acked Read 2 Sent Done Done false
6566 2699 Acked Write 7 Sent Done Done false
6567 2700 Acked Write 6 Sent Done Done false
6568 2701 Acked Read 6 Sent Done Done false
6569 2702 Acked Read 4 Sent Done Done false
6570 2703 Acked Read 10 Sent Done Done false
6571 2704 Acked Read 8 Sent Done Done false
6572 2705 Acked Read 3 Sent Done Done false
6573 2706 Acked Read 10 Sent Done Done false
6574 2707 Acked Read 10 Sent Done Done false
6575 2708 Acked Flush 0 Sent Done Done false
6576 2709 Acked Read 3 Sent Done Done false
6577 2710 Acked Read 8 Sent Done Done false
6578 2711 Acked Write 4 Sent Done Done false
6579 2712 Acked Write 8 Sent Done Done false
6580 2713 Acked Read 6 Sent Done Done false
6581 2714 Acked Read 8 Sent Done Done false
6582 2715 Acked Read 4 Sent Done Done false
6583 2716 Acked Write 1 Sent Done Done false
6584 2717 Acked Write 5 Sent Done Done false
6585 2718 Acked Write 2 Sent Done Done false
6586 2719 Acked Write 7 Sent Done Done false
6587 2720 Acked Read 5 Sent Done Done false
6588 2721 Acked Read 9 Sent Done Done false
6589 2722 Acked Read 6 Sent Done Done false
6590 2723 Acked Write 9 Sent Done Done false
6591 2724 Acked Flush 0 Sent Done Done false
6592 2725 Acked Read 6 Sent Done Done false
6593 2726 Acked Write 9 Sent Done Done false
6594 2727 Acked Write 6 Sent Done Done false
6595 2728 Acked Read 4 Sent Done Done false
6596 2729 Acked Read 3 Sent Done Done false
6597 2730 Acked Read 7 Sent Done Done false
6598 2731 Acked Read 8 Sent Done Done false
6599 2732 Acked Write 1 Sent Done Done false
6600 2733 Acked Read 6 Sent Done Done false
6601 2734 Acked Flush 0 Sent Done Done false
6602 2735 Acked Read 1 Sent Done Done false
6603 2736 Acked Write 2 Sent Done Done false
6604 2737 Acked Write 5 Sent Done Done false
6605 2738 Acked Read 10 Sent Done Done false
6606 2739 Acked Read 3 Sent Done Done false
6607 2740 Acked Read 6 Sent Done Done false
6608 2741 Acked Read 2 Sent Done Done false
6609 2742 Acked Read 1 Sent Done Done false
6610 2743 Acked Write 9 Sent Done Done false
6611 2744 Acked Write 7 Sent Done Done false
6612 2745 Acked Read 5 Sent Done Done false
6613 2746 Acked Flush 0 Sent Done Done false
6614 2747 Acked Read 8 Sent Done Done false
6615 2748 Acked Read 9 Sent Done Done false
6616 2749 Acked Read 4 Sent Done Done false
6617 2750 Acked Write 1 Sent Done Done false
6618 2751 Acked Read 6 Sent Done Done false
6619 2752 Acked Read 3 Sent Done Done false
6620 2753 Acked Write 1 Sent Done Done false
6621 2754 Acked Flush 0 Sent Done Done false
6622 2755 Acked Write 1 Sent Done Done false
6623 2756 Acked Write 10 Sent Done Done false
6624 2757 Acked Write 7 Sent Done Done false
6625 2758 Acked Write 6 Sent Done Done false
6626 2759 Acked Write 3 Sent Done Done false
6627 2760 Acked Write 6 Sent Done Done false
6628 2761 Acked Write 3 Sent Done Done false
6629 2762 Acked Read 8 Sent Done Done false
6630 2763 Acked Read 6 Sent Done Done false
6631 2764 Acked Write 4 Sent Done Done false
6632 2765 Acked Write 2 Sent Done Done false
6633 2766 Acked Read 1 Sent Done Done false
6634 2767 Acked Write 1 Sent Done Done false
6635 2768 Acked Write 10 Sent Done Done false
6636 2769 Acked Write 9 Sent Done Done false
6637 2770 Acked Read 6 Sent Done Done false
6638 2771 Acked Flush 0 Sent Done Done false
6639 2772 Acked Write 1 Sent Done Done false
6640 2773 Acked Flush 0 Sent Done Done false
6641 2774 Acked Read 10 Sent Done Done false
6642 2775 Acked Write 2 Sent Done Done false
6643 2776 Acked Read 6 Sent Done Done false
6644 2777 Acked Read 5 Sent Done Done false
6645 2778 Acked Read 5 Sent Done Done false
6646 2779 Acked Read 6 Sent Done Done false
6647 2780 Acked Write 8 Sent Done Done false
6648 2781 Acked Flush 0 Sent Done Done false
6649 2782 Acked Read 10 Sent Done Done false
6650 2783 Acked Read 5 Sent Done Done false
6651 2784 Acked Write 7 Sent Done Done false
6652 2785 Acked Flush 0 Sent Done Done false
6653 2786 Acked Read 10 Sent Done Done false
6654 2787 Acked Read 4 Sent Done Done false
6655 2788 Acked Write 1 Sent Done Done false
6656 2789 Acked Read 4 Sent Done Done false
6657 2790 Acked Write 5 Sent Done Done false
6658 2791 Acked Write 1 Sent Done Done false
6659 2792 Acked Write 10 Sent Done Done false
6660 2793 Acked Read 4 Sent Done Done false
6661 2794 Acked Write 8 Sent Done Done false
6662 2795 Acked Read 3 Sent Done Done false
6663 2796 Acked Write 2 Sent Done Done false
6664 2797 Acked Read 9 Sent Done Done false
6665 2798 Acked Write 6 Sent Done Done false
6666 2799 Acked Read 7 Sent Done Done false
6667 2800 Acked Write 1 Sent Done Done false
6668 2801 Acked Read 5 Sent Done Done false
6669 2802 Acked Read 1 Sent Done Done false
6670 2803 Acked Read 7 Sent Done Done false
6671 2804 Acked Read 4 Sent Done Done false
6672 2805 Acked Flush 0 Sent Done Done false
6673 2806 Acked Write 5 Sent Done Done false
6674 2807 Acked Read 2 Sent Done Done false
6675 2808 Acked Read 9 Sent Done Done false
6676 2809 Acked Flush 0 Sent Done Done false
6677 STATES DS:0 DS:1 DS:2 TOTAL
6678 Sent 301 0 0 301
6679 Done 0 301 301 602
6680 Skipped 0 0 0 0
6681 Error 0 0 0 0
6682 Last Flush: 2508 2809 2809
6683 Downstairs last five completed: 2508 2507 2506 2505 2504
6684 Upstairs last five completed: 2809 2808 2807 2806 2805
6685 CLIENT: Up:0 ds:301 act:2
66862025-01-10T16:36:44.942ZINFOcrucible: connecting to 127.0.0.1:8810 = io task client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
66872025-01-10T16:36:44.942ZINFOcrucible: ds_connection connected from Ok(127.0.0.1:41477) = io task client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
66882025-01-10T16:36:44.943ZWARNcrucible: version negotiation from state Offline = downstairs client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
66892025-01-10T16:36:44.944ZINFOcrucible: downstairs client at Some(127.0.0.1:8810) has region UUID 12345678-0000-0000-0000-000000008810 = downstairs client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
66902025-01-10T16:36:44.944ZINFOcrucible: Returning UUID:12345678-0000-0000-0000-000000008810 matches = downstairs client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
66912025-01-10T16:36:44.944ZINFOcrucible: send last flush ID to this DS: 2508 = downstairs client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
66922025-01-10T16:36:44.944ZINFOcrucible: Replied this last flush ID: 2508 = downstairs client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
66932025-01-10T16:36:44.944ZINFOcrucible: ds_transition from Offline to Active = downstairs client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
66942025-01-10T16:36:44.944ZINFOcrucible: [0] Transition from Offline to Active = downstairs client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
66952025-01-10T16:36:44.944ZINFOcrucible: [0] client re-new 301 jobs since flush 2508 = downstairs session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
66962025-01-10T16:36:44.944ZINFOcrucible: [0] Replayed 301 jobs since flush: 2508 = downstairs session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
6697 ----------------------------------------------------------------
6698 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:0
6699 Downstairs last five completed: 2809 2808 2807 2806 2805
6700 Upstairs last five completed: 2809 2808 2807 2806 2805
6701 CLIENT: Up:0 ds:0 act:3
6702 Replay: All jobs finished
6703 Main task has work to do, go find it
6704 got dsc Stop(1)
6705 stop 1
6706 Jan 10 16:36:45.194 INFO[8820] Got stop action so:false kr:false
6707 request completed, latency_us: 343, response_code: 204, uri: /stop/cid/1, method: POST, req_id: 43066ab2-6c81-4cd5-bf35-30f87470eb3d, remote_addr: 127.0.0.1:55917, local_addr: 127.0.0.1:9998
6708 Jan 10 16:36:45.195 INFO request completed, latency_us: 123, response_code: 200, uri: /state/cid/1, method: GET, req_id: 99b61a70-4c1e-41a1-88aa-32b7177a6362, remote_addr: 127.{"msg":"downstairs disconnected","v":0,"name":"crucible","level":40,"time":"2025-01-10T16:36:45.195696664Z","hostname":"w-01JH8H1N3KXZ9F8ZV6CCMP5KTQ","pid":1202,"":"io task","client":"1","":"downstairs","session_id":"1df3ca91-4dc9-42d6-9897-461254b5afe2"}
6709 0.0.1:55917, local_addr: 127.0.0.1:9998
67102025-01-10T16:36:45.195ZWARNcrucible: client task is sending Done(Finished) = io task client = 1 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
67112025-01-10T16:36:45.195ZWARNcrucible: downstairs task for 1 stopped due to Finished session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
67122025-01-10T16:36:45.195ZINFOcrucible: ds_transition from Active to Offline = downstairs client = 1 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
67132025-01-10T16:36:45.195ZINFOcrucible: [1] Transition from Active to Offline = downstairs client = 1 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
67142025-01-10T16:36:45.195ZINFOcrucible: client task is exiting = io task client = 1 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
6715 [8820] Exited with: ExitStatus(unix_wait_status(9))
6716 [8820][1] reports Exit
6717 Jan 10 16:36:49.197 INFO request completed, latency_us: 214, response_code: 200, uri: /state/cid/1, method: GET, req_id: 56b1c275-f26c-4ca2-942b-d90bc5fe9bb3, remote_addr: 127.0.0.1:55917, local_addr: 127.0.0.1:9998
6718 001/300 Flush
6719 002/300 Read block 627 len 12288
6720 003/300 Write block 2751 len 40960 data: 2 2 2 2 2 2 3 3 3 4
6721 004/300 Write block 507 len 20480 data: 2 2 3 3 4
6722 005/300 Write block 4345 len 28672 data: 3 2 2 2 2 2 2
6723 006/300 Write block 4194 len 24576 data: 3 3 4 4 4 5
6724 007/300 Write block 937 len 4096 data: 3
6725 008/300 Write block 3380 len 20480 data: 3 3 3 3 4
6726 009/300 Read block 1555 len 8192
6727 010/300 Read block 665 len 40960
6728 011/300 Read block 1780 len 20480
6729 012/300 Read block 327 len 24576
6730 013/300 Read block 257 len 40960
6731 014/300 Read block 3156 len 12288
6732 015/300 Read block 632 len 12288
6733 016/300 Flush
6734 017/300 Read block 2495 len 36864
6735 018/300 Read block 2741 len 4096
6736 019/300 Read block 464 len 20480
6737 020/300 Read block 1219 len 24576
6738 021/300 Write block 1548 len 32768 data: 4 5 4 4 4 4 3 4
6739 022/300 Read block 2636 len 28672
6740 023/300 Write block 3865 len 36864 data: 4 3 3 3 3 3 2 2 2
6741 024/300 Read block 3080 len 8192
6742 025/300 Read block 3828 len 4096
6743 026/300 Write block 1160 len 4096 data: 3
6744 027/300 Write block 1276 len 40960 data: 2 2 2 2 2 2 2 2 2 2
6745 028/300 Write block 2100 len 4096 data: 3
6746 029/300 Write block 2910 len 4096 data: 2
6747 030/300 Read block 780 len 36864
6748 031/300 Read block 3580 len 40960
6749 032/300 Write block 3059 len 40960 data: 3 3 3 4 4 4 4 3 3 3
6750 033/300 Read block 4712 len 16384
6751 034/300 Read block 3412 len 16384
6752 035/300 Read block 4399 len 36864
6753 036/300 Flush
6754 037/300 Read block 4010 len 12288
6755 038/300 Write block 3503 len 4096 data: 2
6756 039/300 Write block 4027 len 8192 data: 3 3
6757 040/300 Flush
6758 041/300 Flush
6759 042/300 Read block 1862 len 24576
6760 043/300 Write block 4838 len 40960 data: 3 3 3 3 3 3 3 3 2 2
6761 044/300 Write block 4627 len 40960 data: 4 4 4 3 3 2 2 2 2 2
6762 045/300 Write block 2676 len 16384 data: 3 3 3 3
6763 046/300 Write block 2022 len 8192 data: 4 3
6764 047/300 Write block 3743 len 40960 data: 2 2 2 2 2 2 2 3 3 3
6765 048/300 Read block 3113 len 12288
6766 049/300 Flush
6767 050/300 Write block 2947 len 12288 data: 5 4 3
6768 051/300 Read block 3863 len 24576
6769 052/300 Write block 4170 len 8192 data: 3 3
6770 053/300 Read block 2432 len 20480
6771 054/300 Flush
6772 055/300 Read block 351 len 20480
6773 056/300 Write block 2807 len 36864 data: 2 3 3 2 2 2 2 3 2
6774 057/300 Read block 164 len 16384
6775 058/300 Write block 3138 len 12288 data: 3 2 3
6776 059/300 Read block 614 len 12288
6777 060/300 Write block 4654 len 40960 data: 2 2 2 2 2 2 3 3 2 2
6778 061/300 Write block 2862 len 32768 data: 3 3 3 4 4 4 4 3
6779 062/300 Read block 1338 len 32768
6780 063/300 Write block 914 len 8192 data: 3 3
6781 064/300 Read block 1978 len 32768
6782 065/300 Write block 3534 len 12288 data: 2 2 3
6783 066/300 Read block 3737 len 12288
6784 067/300 Read block 4666 len 36864
6785 068/300 Write block 1024 len 28672 data: 3 3 3 3 3 4 3
6786 069/300 Read block 494 len 28672
6787 070/300 Write block 3726 len 36864 data: 3 4 4 4 3 3 3 3 3
6788 071/300 Read block 1587 len 16384
6789 072/300 Read block 1892 len 40960
6790 073/300 Write block 146 len 4096 data: 2
6791 074/300 Write block 4878 len 8192 data: 2 3
6792 075/300 Write block 3716 len 20480 data: 5 4 2 2 2
6793 076/300 Read block 2610 len 4096
6794 077/300 Write block 3089 len 24576 data: 3 3 2 2 2 2
6795 078/300 Read block 1125 len 32768
6796 079/300 Flush
6797 080/300 Read block 218 len 24576
6798 081/300 Read block 3615 len 28672
6799 082/300 Write block 643 len 28672 data: 3 3 4 3 4 3 2
6800 083/300 Read block 3432 len 32768
6801 084/300 Read block 2771 len 36864
6802 085/300 Flush
6803 086/300 Write block 1659 len 8192 data: 4 3
6804 087/300 Read block 3309 len 4096
6805 088/300 Read block 379 len 40960
6806 089/300 Flush
6807 090/300 Flush
6808 091/300 Write block 416 len 20480 data: 2 2 2 2 2
6809 092/300 Read block 4342 len 8192
6810 093/300 Read block 1049 len 24576
6811 094/300 Read block 4825 len 8192
6812 095/300 Read block 607 len 16384
6813 096/300 Read block 906 len 16384
6814 097/300 Write block 4262 len 12288 data: 2 2 2
6815 098/300 Read block 1587 len 16384
6816 099/300 Flush
6817 100/300 Read block 2775 len 32768
6818 101/300 Write block 3919 len 4096 data: 3
6819 102/300 Read block 3848 len 32768
6820 103/300 Write block 1635 len 36864 data: 4 4 3 3 3 3 4 3 3
6821 104/300 Write block 3387 len 20480 data: 4 4 3 3 3
6822 105/300 Write block 3261 len 20480 data: 2 3 4 4 4
6823 106/300 Read block 625 len 36864
6824 107/300 Write block 4741 len 20480 data: 2 2 2 2 2
6825 108/300 Read block 3766 len 20480
6826 109/300 Read block 1000 len 4096
6827 110/300 Write block 1087 len 20480 data: 3 3 3 2 2
6828 111/300 Write block 2237 len 12288 data: 2 2 4
6829 112/300 Write block 2675 len 4096 data: 2
6830 113/300 Read block 1170 len 28672
6831 114/300 Write block 4019 len 40960 data: 3 3 4 3 3 4 4 4 4 4
6832 115/300 Write block 88 len 24576 data: 2 2 2 2 2 2
6833 116/300 Write block 2477 len 36864 data: 2 2 2 2 2 2 3 3 3
6834 117/300 Read block 1438 len 24576
6835 118/300 Write block 48 len 20480 data: 4 3 2 2 2
6836 119/300 Read block 2351 len 20480
6837 120/300 Write block 1107 len 28672 data: 2 2 2 2 2 3 3
6838 121/300 Write block 4766 len 36864 data: 2 2 2 2 2 2 2 2 2
6839 122/300 Read block 236 len 20480
6840 123/300 Read block 523 len 40960
6841 124/300 Read block 3341 len 16384
6842 125/300 Write block 1351 len 36864 data: 3 3 3 2 2 2 2 2 3
6843 126/300 Read block 2971 len 20480
6844 127/300 Read block 781 len 8192
6845 128/300 Write block 4064 len 40960 data: 2 2 3 3 3 3 3 3 2 2
6846 129/300 Write block 3061 len 8192 data: 4 5
6847 130/300 Read block 4677 len 36864
6848 131/300 Read block 2535 len 12288
6849 132/300 Write block 2564 len 20480 data: 2 2 2 2 2
6850 133/300 Read block 4839 len 40960
6851 134/300 Read block 3904 len 4096
6852 135/300 Write block 2949 len 28672 data: 4 3 3 4 3 3 3
6853 136/300 Flush
6854 137/300 Read block 1081 len 24576
6855 138/300 Write block 4919 len 8192 data: 2 3
6856 139/300 Write block 2883 len 32768 data: 2 3 3 3 3 2 3 3
6857 140/300 Read block 2817 len 24576
6858 141/300 Read block 3996 len 40960
6859 142/300 Flush
6860 143/300 Read block 3537 len 12288
6861 144/300 Read block 1619 len 4096
6862 145/300 Write block 4895 len 4096 data: 3
6863 146/300 Read block 3419 len 32768
6864 147/300 Flush
6865 148/300 Read block 4339 len 40960
6866 149/300 Read block 2454 len 24576
6867 150/300 Write block 2695 len 28672 data: 3 3 3 2 2 2 2
6868 151/300 Read block 4239 len 4096
6869 152/300 Write block 3017 len 40960 data: 3 3 3 3 2 2 2 2 2 2
6870 153/300 Read block 554 len 36864
6871 154/300 Write block 507 len 16384 data: 3 3 4 4
6872 155/300 Write block 3755 len 32768 data: 3 3 3 2 2 2 2 2
6873 156/300 Read block 197 len 32768
6874 157/300 Read block 4691 len 36864
6875 158/300 Read block 4554 len 36864
6876 159/300 Read block 4989 len 4096
6877 160/300 Read block 2559 len 8192
6878 161/300 Read block 2047 len 32768
6879 162/300 Read block 1186 len 4096
6880 163/300 Flush
6881 164/300 Write block 4235 len 32768 data: 2 2 2 2 2 2 2 2
6882 165/300 Read block 4762 len 32768
6883 166/300 Read block 2164 len 4096
6884 167/300 Write block 3664 len 8192 data: 2 2
6885 168/300 Read block 3390 len 8192
6886 169/300 Read block 2086 len 24576
6887 170/300 Read block 4628 len 36864
6888 171/300 Read block 580 len 36864
6889 172/300 Write block 2339 len 32768 data: 2 2 2 2 2 3 3 4
6890 173/300 Write block 1013 len 40960 data: 3 3 3 4 4 3 3 4 4 5
6891 174/300 Write block 3913 len 28672 data: 2 2 2 3 3 3 4
6892 175/300 Write block 775 len 36864 data: 5 4 4 4 2 2 2 2 2
6893 176/300 Write block 2038 len 8192 data: 3 2
6894 177/300 Write block 1727 len 16384 data: 2 2 3 3
6895 178/300 Read block 4280 len 32768
6896 179/300 Flush
6897 180/300 Read block 2061 len 8192
6898 181/300 Flush
6899 182/300 Read block 4821 len 36864
6900 183/300 Read block 3588 len 24576
6901 184/300 Read block 3239 len 32768
6902 185/300 Read block 2999 len 20480
6903 186/300 Write block 617 len 40960 data: 3 3 3 2 2 2 3 2 2 3
6904 187/300 Write block 1369 len 8192 data: 2 2
6905 188/300 Write block 4187 len 24576 data: 3 2 2 2 3 3
6906 189/300 Read block 403 len 24576
6907 190/300 Read block 1727 len 8192
6908 191/300 Write block 3868 len 4096 data: 4
6909 192/300 Read block 764 len 32768
6910 193/300 Flush
6911 194/300 Read block 3711 len 24576
6912 195/300 Read block 2865 len 32768
6913 196/300 Flush
6914 197/300 Write block 3829 len 32768 data: 3 3 2 3 3 3 3 2
6915 198/300 Write block 2344 len 8192 data: 4 4
6916 199/300 Read block 1156 len 16384
6917 200/300 Flush
6918 201/300 Read block 3358 len 4096
6919 202/300 Flush
6920 203/300 Read block 2438 len 24576
6921 204/300 Write block 3055 len 4096 data: 2
6922 205/300 Write block 1571 len 24576 data: 2 2 2 2 2 2
6923 206/300 Write block 4168 len 8192 data: 3 3
6924 207/300 Flush
6925 208/300 Write block 1334 len 36864 data: 3 3 3 4 4 4 4 4 5
6926 209/300 Read block 1579 len 4096
6927 210/300 Write block 3605 len 16384 data: 2 3 3 3
6928 211/300 Read block 718 len 20480
6929 212/300 Flush
6930 213/300 Write block 4333 len 8192 data: 3 2
6931 214/300 Write block 1481 len 20480 data: 2 2 2 2 3
6932 215/300 Write block 928 len 28672 data: 3 4 4 4 3 3 3
6933 216/300 Read block 3930 len 16384
6934 217/300 Write block 3378 len 28672 data: 2 2 4 4 4 4 5
6935 218/300 Read block 4877 len 20480
6936 219/300 Write block 2936 len 36864 data: 3 3 3 2 2 2 3 3 4
6937 220/300 Write block 2188 len 4096 data: 2
6938 221/300 Read block 3344 len 28672
6939 222/300 Flush
6940 223/300 Read block 1340 len 32768
6941 224/300 Write block 1441 len 36864 data: 2 2 2 2 2 2 3 3 2
6942 225/300 Read block 480 len 20480
6943 226/300 Write block 1655 len 32768 data: 3 3 3 4 5 4 4 4
6944 227/300 Write block 4670 len 40960 data: 2 2 2 2 2 3 2 2 2 2
6945 228/300 Write block 4026 len 32768 data: 5 5 5 3 3 3 3 2
6946 229/300 Read block 3683 len 36864
6947 230/300 Write block 12 len 8192 data: 4 5
6948 231/300 Flush
6949 232/300 Write block 1226 len 24576 data: 2 3 3 3 3 4
6950 233/300 Read block 778 len 36864
6951 234/300 Write block 4395 len 24576 data: 2 2 2 2 2 2
6952 235/300 Read block 4230 len 16384
6953 236/300 Read block 3854 len 40960
6954 237/300 Flush
6955 238/300 Write block 2193 len 20480 data: 3 3 3 3 4
6956 239/300 Write block 2190 len 40960 data: 2 2 2 4 4 4 4 5 5 3
6957 240/300 Read block 779 len 4096
6958 241/300 Read block 853 len 36864
6959 242/300 Flush
6960 243/300 Write block 2471 len 20480 data: 2 2 2 2 2
6961 244/300 Read block 421 len 32768
6962 245/300 Write block 3937 len 36864 data: 2 2 2 2 3 3 4 4 5
6963 246/300 Write block 2654 len 12288 data: 2 3 3
6964 247/300 Read block 4773 len 40960
6965 248/300 Read block 4408 len 28672
6966 249/300 Read block 1981 len 12288
6967 250/300 Write block 587 len 8192 data: 2 2
6968 251/300 Read block 3277 len 36864
6969 252/300 Read block 2144 len 12288
6970 253/300 Write block 4337 len 40960 data: 2 2 3 3 3 4 3 3 4 3
6971 254/300 Read block 3437 len 20480
6972 255/300 Write block 3196 len 8192 data: 3 3
6973 256/300 Read block 3155 len 36864
6974 257/300 Read block 1322 len 12288
6975 258/300 Read block 1416 len 36864
6976 259/300 Read block 1028 len 28672
6977 260/300 Read block 752 len 12288
6978 261/300 Read block 4680 len 36864
6979 262/300 Read block 4123 len 28672
6980 263/300 Read block 3025 len 24576
6981 264/300 Read block 1194 len 28672
6982 265/300 Flush
6983 266/300 Write block 2616 len 32768 data: 3 2 2 2 2 2 2 2
6984 267/300 Write block 4399 len 8192 data: 3 3
6985 268/300 Write block 4155 len 8192 data: 3 3
6986 269/300 Read block 4596 len 28672
6987 270/300 Read block 4063 len 36864
6988 271/300 Read block 3789 len 12288
6989 272/300 Write block 4217 len 12288 data: 2 2 4
6990 273/300 Read block 2132 len 32768
6991 274/300 Write block 1622 len 28672 data: 3 2 2 2 2 3 3
6992 275/300 Read block 821 len 12288
6993 276/300 Write block 2439 len 32768 data: 3 3 3 3 3 3 3 4
6994 277/300 Write block 2291 len 8192 data: 4 4
6995 278/300 Read block 4319 len 32768
6996 279/300 Read block 3911 len 16384
6997 280/300 Write block 3301 len 20480 data: 2 2 2 2 2
6998 281/300 Read block 4798 len 32768
6999 282/300 Read block 4152 len 28672
7000 283/300 Write block 4428 len 32768 data: 4 4 4 4 5 4 5 5
7001 284/300 Read block 2382 len 24576
7002 285/300 Write block 3239 len 12288 data: 2 2 3
7003 286/300 Write block 687 len 40960 data: 3 3 3 4 4 3 3 3 3 3
7004 287/300 Read block 1910 len 32768
7005 288/300 Read block 4149 len 32768
7006 289/300 Write block 2279 len 20480 data: 4 3 3 4 3
7007 290/300 Read block 3070 len 28672
7008 291/300 Write block 4294 len 32768 data: 2 3 3 3 3 3 3 3
7009 292/300 Read block 908 len 40960
7010 293/300 Write block 1408 len 20480 data: 2 2 2 2 2
7011 294/300 Write block 2040 len 8192 data: 2 2
7012 295/300 Read block 30 len 8192
7013 296/300 Write block 4671 len 24576 data: 3 3 3 3 4 3
7014 297/300 Read block 4805 len 20480
7015 298/300 Read block 11 len 32768
7016 299/300 Read block 3473 len 4096
7017 300/300 Read block 3476 len 40960
7018 301/300 Write block 3424 len 8192 data: 2 2
7019 Main task has work to do, go find it
7020 got dsc Start(1)
7021 start 1
7022 Jan 10 16:36:49.440 INFO request completed, latency_us: 194, response_code: 204, uri: /start/cid/1, method: POST, req_id: 5666ea61-d273-4bd3-aebc-f371d0671f71, remote_addr: 127.0.0.1:55917, local_addr: 127.0.0.1:9998
7023 Replay: started 1, returned:Ok(())
7024 ----------------------------------------------------------------
7025 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:301
7026 States: Active Offline Active
7027 JOBID ACK TYPE BKS/EXT DS:0 DS:1 DS:2 REPLAY
7028 2810 Acked Flush 0 Done Sent Done false
7029 2811 Acked Read 3 Done Sent Done false
7030 2812 Acked Write 10 Done Sent Done false
7031 2813 Acked Write 5 Done Sent Done false
7032 2814 Acked Write 7 Done Sent Done false
7033 2815 Acked Write 6 Done Sent Done false
7034 2816 Acked Write 1 Done Sent Done false
7035 2817 Acked Write 5 Done Sent Done false
7036 2818 Acked Read 2 Done Sent Done false
7037 2819 Acked Read 10 Done Sent Done false
7038 2820 Acked Read 5 Done Sent Done false
7039 2821 Acked Read 6 Done Sent Done false
7040 2822 Acked Read 10 Done Sent Done false
7041 2823 Acked Read 3 Done Sent Done false
7042 2824 Acked Read 3 Done Sent Done false
7043 2825 Acked Flush 0 Done Sent Done false
7044 2826 Acked Read 9 Done Sent Done false
7045 2827 Acked Read 1 Done Sent Done false
7046 2828 Acked Read 5 Done Sent Done false
7047 2829 Acked Read 6 Done Sent Done false
7048 2830 Acked Write 8 Done Sent Done false
7049 2831 Acked Read 7 Done Sent Done false
7050 2832 Acked Write 9 Done Sent Done false
7051 2833 Acked Read 2 Done Sent Done false
7052 2834 Acked Read 1 Done Sent Done false
7053 2835 Acked Write 1 Done Sent Done false
7054 2836 Acked Write 10 Done Sent Done false
7055 2837 Acked Write 1 Done Sent Done false
7056 2838 Acked Write 1 Done Sent Done false
7057 2839 Acked Read 9 Done Sent Done false
7058 2840 Acked Read 10 Done Sent Done false
7059 2841 Acked Write 10 Done Sent Done false
7060 2842 Acked Read 4 Done Sent Done false
7061 2843 Acked Read 4 Done Sent Done false
7062 2844 Acked Read 9 Done Sent Done false
7063 2845 Acked Flush 0 Done Sent Done false
7064 2846 Acked Read 3 Done Sent Done false
7065 2847 Acked Write 1 Done Sent Done false
7066 2848 Acked Write 2 Done Sent Done false
7067 2849 Acked Flush 0 Done Sent Done false
7068 2850 Acked Flush 0 Done Sent Done false
7069 2851 Acked Read 6 Done Sent Done false
7070 2852 Acked Write 10 Done Sent Done false
7071 2853 Acked Write 10 Done Sent Done false
7072 2854 Acked Write 4 Done Sent Done false
7073 2855 Acked Write 2 Done Sent Done false
7074 2856 Acked Write 10 Done Sent Done false
7075 2857 Acked Read 3 Done Sent Done false
7076 2858 Acked Flush 0 Done Sent Done false
7077 2859 Acked Write 3 Done Sent Done false
7078 2860 Acked Read 6 Done Sent Done false
7079 2861 Acked Write 2 Done Sent Done false
7080 2862 Acked Read 5 Done Sent Done false
7081 2863 Acked Flush 0 Done Sent Done false
7082 2864 Acked Read 5 Done Sent Done false
7083 2865 Acked Write 9 Done Sent Done false
7084 2866 Acked Read 4 Done Sent Done false
7085 2867 Acked Write 3 Done Sent Done false
7086 2868 Acked Read 3 Done Sent Done false
7087 2869 Acked Write 10 Done Sent Done false
7088 2870 Acked Write 8 Done Sent Done false
7089 2871 Acked Read 8 Done Sent Done false
7090 2872 Acked Write 2 Done Sent Done false
7091 2873 Acked Read 8 Done Sent Done false
7092 2874 Acked Write 3 Done Sent Done false
7093 2875 Acked Read 3 Done Sent Done false
7094 2876 Acked Read 9 Done Sent Done false
7095 2877 Acked Write 7 Done Sent Done false
7096 2878 Acked Read 7 Done Sent Done false
7097 2879 Acked Write 9 Done Sent Done false
7098 2880 Acked Read 4 Done Sent Done false
7099 2881 Acked Read 10 Done Sent Done false
7100 2882 Acked Write 1 Done Sent Done false
7101 2883 Acked Write 2 Done Sent Done false
7102 2884 Acked Write 5 Done Sent Done false
7103 2885 Acked Read 1 Done Sent Done false
7104 2886 Acked Write 6 Done Sent Done false
7105 2887 Acked Read 8 Done Sent Done false
7106 2888 Acked Flush 0 Done Sent Done false
7107 2889 Acked Read 6 Done Sent Done false
7108 2890 Acked Read 7 Done Sent Done false
7109 2891 Acked Write 7 Done Sent Done false
7110 2892 Acked Read 8 Done Sent Done false
7111 2893 Acked Read 9 Done Sent Done false
7112 2894 Acked Flush 0 Done Sent Done false
7113 2895 Acked Write 2 Done Sent Done false
7114 2896 Acked Read 1 Done Sent Done false
7115 2897 Acked Read 10 Done Sent Done false
7116 2898 Acked Flush 0 Done Sent Done false
7117 2899 Acked Flush 0 Done Sent Done false
7118 2900 Acked Write 5 Done Sent Done false
7119 2901 Acked Read 2 Done Sent Done false
7120 2902 Acked Read 6 Done Sent Done false
7121 2903 Acked Read 2 Done Sent Done false
7122 2904 Acked Read 4 Done Sent Done false
7123 2905 Acked Read 4 Done Sent Done false
7124 2906 Acked Write 3 Done Sent Done false
7125 2907 Acked Read 4 Done Sent Done false
7126 2908 Acked Flush 0 Done Sent Done false
7127 2909 Acked Read 8 Done Sent Done false
7128 2910 Acked Write 1 Done Sent Done false
7129 2911 Acked Read 8 Done Sent Done false
7130 2912 Acked Write 9 Done Sent Done false
7131 2913 Acked Write 5 Done Sent Done false
7132 2914 Acked Write 5 Done Sent Done false
7133 2915 Acked Read 9 Done Sent Done false
7134 2916 Acked Write 5 Done Sent Done false
7135 2917 Acked Read 5 Done Sent Done false
7136 2918 Acked Read 1 Done Sent Done false
7137 2919 Acked Write 5 Done Sent Done false
7138 2920 Acked Write 3 Done Sent Done false
7139 2921 Acked Write 1 Done Sent Done false
7140 2922 Acked Read 7 Done Sent Done false
7141 2923 Acked Write 10 Done Sent Done false
7142 2924 Acked Write 6 Done Sent Done false
7143 2925 Acked Write 9 Done Sent Done false
7144 2926 Acked Read 6 Done Sent Done false
7145 2927 Acked Write 5 Done Sent Done false
7146 2928 Acked Read 5 Done Sent Done false
7147 2929 Acked Write 7 Done Sent Done false
7148 2930 Acked Write 9 Done Sent Done false
7149 2931 Acked Read 5 Done Sent Done false
7150 2932 Acked Read 10 Done Sent Done false
7151 2933 Acked Read 4 Done Sent Done false
7152 2934 Acked Write 9 Done Sent Done false
7153 2935 Acked Read 5 Done Sent Done false
7154 2936 Acked Read 2 Done Sent Done false
7155 2937 Acked Write 10 Done Sent Done false
7156 2938 Acked Write 2 Done Sent Done false
7157 2939 Acked Read 9 Done Sent Done false
7158 2940 Acked Read 3 Done Sent Done false
7159 2941 Acked Write 5 Done Sent Done false
7160 2942 Acked Read 10 Done Sent Done false
7161 2943 Acked Read 1 Done Sent Done false
7162 2944 Acked Write 7 Done Sent Done false
7163 2945 Acked Flush 0 Done Sent Done false
7164 2946 Acked Read 6 Done Sent Done false
7165 2947 Acked Write 2 Done Sent Done false
7166 2948 Acked Write 8 Done Sent Done false
7167 2949 Acked Read 6 Done Sent Done false
7168 2950 Acked Read 10 Done Sent Done false
7169 2951 Acked Flush 0 Done Sent Done false
7170 2952 Acked Read 3 Done Sent Done false
7171 2953 Acked Read 1 Done Sent Done false
7172 2954 Acked Write 1 Done Sent Done false
7173 2955 Acked Read 8 Done Sent Done false
7174 2956 Acked Flush 0 Done Sent Done false
7175 2957 Acked Read 10 Done Sent Done false
7176 2958 Acked Read 6 Done Sent Done false
7177 2959 Acked Write 7 Done Sent Done false
7178 2960 Acked Read 1 Done Sent Done false
7179 2961 Acked Write 10 Done Sent Done false
7180 2962 Acked Read 9 Done Sent Done false
7181 2963 Acked Write 4 Done Sent Done false
7182 2964 Acked Write 8 Done Sent Done false
7183 2965 Acked Read 8 Done Sent Done false
7184 2966 Acked Read 9 Done Sent Done false
7185 2967 Acked Read 9 Done Sent Done false
7186 2968 Acked Read 1 Done Sent Done false
7187 2969 Acked Read 2 Done Sent Done false
7188 2970 Acked Read 8 Done Sent Done false
7189 2971 Acked Read 1 Done Sent Done false
7190 2972 Acked Flush 0 Done Sent Done false
7191 2973 Acked Write 8 Done Sent Done false
7192 2974 Acked Read 8 Done Sent Done false
7193 2975 Acked Read 1 Done Sent Done false
7194 2976 Acked Write 2 Done Sent Done false
7195 2977 Acked Read 2 Done Sent Done false
7196 2978 Acked Read 6 Done Sent Done false
7197 2979 Acked Read 9 Done Sent Done false
7198 2980 Acked Read 9 Done Sent Done false
7199 2981 Acked Write 8 Done Sent Done false
7200 2982 Acked Write 10 Done Sent Done false
7201 2983 Acked Write 7 Done Sent Done false
7202 2984 Acked Write 9 Done Sent Done false
7203 2985 Acked Write 2 Done Sent Done false
7204 2986 Acked Write 4 Done Sent Done false
7205 2987 Acked Read 8 Done Sent Done false
7206 2988 Acked Flush 0 Done Sent Done false
7207 2989 Acked Read 2 Done Sent Done false
7208 2990 Acked Flush 0 Done Sent Done false
7209 2991 Acked Read 9 Done Sent Done false
7210 2992 Acked Read 6 Done Sent Done false
7211 2993 Acked Read 8 Done Sent Done false
7212 2994 Acked Read 5 Done Sent Done false
7213 2995 Acked Write 10 Done Sent Done false
7214 2996 Acked Write 2 Done Sent Done false
7215 2997 Acked Write 6 Done Sent Done false
7216 2998 Acked Read 6 Done Sent Done false
7217 2999 Acked Read 2 Done Sent Done false
7218 3000 Acked Write 1 Done Sent Done false
7219 3001 Acked Read 8 Done Sent Done false
7220 3002 Acked Flush 0 Done Sent Done false
7221 3003 Acked Read 6 Done Sent Done false
7222 3004 Acked Read 8 Done Sent Done false
7223 3005 Acked Flush 0 Done Sent Done false
7224 3006 Acked Write 8 Done Sent Done false
7225 3007 Acked Write 2 Done Sent Done false
7226 3008 Acked Read 4 Done Sent Done false
7227 3009 Acked Flush 0 Done Sent Done false
7228 3010 Acked Read 1 Done Sent Done false
7229 3011 Acked Flush 0 Done Sent Done false
7230 3012 Acked Read 6 Done Sent Done false
7231 3013 Acked Write 1 Done Sent Done false
7232 3014 Acked Write 6 Done Sent Done false
7233 3015 Acked Write 2 Done Sent Done false
7234 3016 Acked Flush 0 Done Sent Done false
7235 3017 Acked Write 9 Done Sent Done false
7236 3018 Acked Read 1 Done Sent Done false
7237 3019 Acked Write 4 Done Sent Done false
7238 3020 Acked Read 5 Done Sent Done false
7239 3021 Acked Flush 0 Done Sent Done false
7240 3022 Acked Write 2 Done Sent Done false
7241 3023 Acked Write 5 Done Sent Done false
7242 3024 Acked Write 7 Done Sent Done false
7243 3025 Acked Read 4 Done Sent Done false
7244 3026 Acked Write 7 Done Sent Done false
7245 3027 Acked Read 5 Done Sent Done false
7246 3028 Acked Write 9 Done Sent Done false
7247 3029 Acked Write 1 Done Sent Done false
7248 3030 Acked Read 7 Done Sent Done false
7249 3031 Acked Flush 0 Done Sent Done false
7250 3032 Acked Read 8 Done Sent Done false
7251 3033 Acked Write 9 Done Sent Done false
7252 3034 Acked Read 5 Done Sent Done false
7253 3035 Acked Write 8 Done Sent Done false
7254 3036 Acked Write 10 Done Sent Done false
7255 3037 Acked Write 8 Done Sent Done false
7256 3038 Acked Read 9 Done Sent Done false
7257 3039 Acked Write 2 Done Sent Done false
7258 3040 Acked Flush 0 Done Sent Done false
7259 3041 Acked Write 6 Done Sent Done false
7260 3042 Acked Read 9 Done Sent Done false
7261 3043 Acked Write 6 Done Sent Done false
7262 3044 Acked Read 4 Done Sent Done false
7263 3045 Acked Read 10 Done Sent Done false
7264 3046 Acked Flush 0 Done Sent Done false
7265 3047 Acked Write 5 Done Sent Done false
7266 3048 Acked Write 10 Done Sent Done false
7267 3049 Acked Read 1 Done Sent Done false
7268 3050 Acked Read 9 Done Sent Done false
7269 3051 Acked Flush 0 Done Sent Done false
7270 3052 Acked Write 5 Done Sent Done false
7271 3053 Acked Read 8 Done Sent Done false
7272 3054 Acked Write 9 Done Sent Done false
7273 3055 Acked Write 3 Done Sent Done false
7274 3056 Acked Read 10 Done Sent Done false
7275 3057 Acked Read 7 Done Sent Done false
7276 3058 Acked Read 3 Done Sent Done false
7277 3059 Acked Write 2 Done Sent Done false
7278 3060 Acked Read 9 Done Sent Done false
7279 3061 Acked Read 3 Done Sent Done false
7280 3062 Acked Write 10 Done Sent Done false
7281 3063 Acked Read 5 Done Sent Done false
7282 3064 Acked Write 2 Done Sent Done false
7283 3065 Acked Read 9 Done Sent Done false
7284 3066 Acked Read 3 Done Sent Done false
7285 3067 Acked Read 9 Done Sent Done false
7286 3068 Acked Read 7 Done Sent Done false
7287 3069 Acked Read 3 Done Sent Done false
7288 3070 Acked Read 9 Done Sent Done false
7289 3071 Acked Read 7 Done Sent Done false
7290 3072 Acked Read 6 Done Sent Done false
7291 3073 Acked Read 7 Done Sent Done false
7292 3074 Acked Flush 0 Done Sent Done false
7293 3075 Acked Write 8 Done Sent Done false
7294 3076 Acked Write 2 Done Sent Done false
7295 3077 Acked Write 2 Done Sent Done false
7296 3078 Acked Read 7 Done Sent Done false
7297 3079 Acked Read 9 Done Sent Done false
7298 3080 Acked Read 3 Done Sent Done false
7299 3081 Acked Write 3 Done Sent Done false
7300 3082 Acked Read 8 Done Sent Done false
7301 3083 Acked Write 7 Done Sent Done false
7302 3084 Acked Read 3 Done Sent Done false
7303 3085 Acked Write 8 Done Sent Done false
7304 3086 Acked Write 2 Done Sent Done false
7305 3087 Acked Read 8 Done Sent Done false
7306 3088 Acked Read 4 Done Sent Done false
7307 3089 Acked Write 5 Done Sent Done false
7308 3090 Acked Read 8 Done Sent Done false
7309 3091 Acked Read 7 Done Sent Done false
7310 3092 Acked Write 8 Done Sent Done false
7311 3093 Acked Read 6 Done Sent Done false
7312 3094 Acked Write 3 Done Sent Done false
7313 3095 Acked Write 10 Done Sent Done false
7314 3096 Acked Read 8 Done Sent Done false
7315 3097 Acked Read 8 Done Sent Done false
7316 3098 Acked Write 5 Done Sent Done false
7317 3099 Acked Read 7 Done Sent Done false
7318 3100 Acked Write 8 Done Sent Done false
7319 3101 Acked Read 10 Done Sent Done false
7320 3102 Acked Write 5 Done Sent Done false
7321 3103 Acked Write 2 Done Sent Done false
7322 3104 Acked Read 2 Done Sent Done false
7323 3105 Acked Write 6 Done Sent Done false
7324 3106 Acked Read 5 Done Sent Done false
7325 3107 Acked Read 8 Done Sent Done false
7326 3108 Acked Read 1 Done Sent Done false
7327 3109 Acked Read 10 Done Sent Done false
7328 3110 Acked Write 2 Done Sent Done false
7329 STATES DS:0 DS:1 DS:2 TOTAL
7330 Sent 0 301 0 301
7331 Done 301 0 301 602
7332 Skipped 0 0 0 0
7333 Error 0 0 0 0
7334 Last Flush: 3074 2809 3074
7335 Downstairs last five completed: 2809 2808 2807 2806 2805
7336 Upstairs last five completed: 3110 3109 3108 3107 3106
7337 CLIENT: Up:0 ds:301 act:2
7338 ----------------------------------------------------------------
7339 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:302
7340 States: Active Offline Active
7341 JOBID ACK TYPE BKS/EXT DS:0 DS:1 DS:2 REPLAY
7342 2810 Acked Flush 0 Done Sent Done false
7343 2811 Acked Read 3 Done Sent Done false
7344 2812 Acked Write 10 Done Sent Done false
7345 2813 Acked Write 5 Done Sent Done false
7346 2814 Acked Write 7 Done Sent Done false
7347 2815 Acked Write 6 Done Sent Done false
7348 2816 Acked Write 1 Done Sent Done false
7349 2817 Acked Write 5 Done Sent Done false
7350 2818 Acked Read 2 Done Sent Done false
7351 2819 Acked Read 10 Done Sent Done false
7352 2820 Acked Read 5 Done Sent Done false
7353 2821 Acked Read 6 Done Sent Done false
7354 2822 Acked Read 10 Done Sent Done false
7355 2823 Acked Read 3 Done Sent Done false
7356 2824 Acked Read 3 Done Sent Done false
7357 2825 Acked Flush 0 Done Sent Done false
7358 2826 Acked Read 9 Done Sent Done false
7359 2827 Acked Read 1 Done Sent Done false
7360 2828 Acked Read 5 Done Sent Done false
7361 2829 Acked Read 6 Done Sent Done false
7362 2830 Acked Write 8 Done Sent Done false
7363 2831 Acked Read 7 Done Sent Done false
7364 2832 Acked Write 9 Done Sent Done false
7365 2833 Acked Read 2 Done Sent Done false
7366 2834 Acked Read 1 Done Sent Done false
7367 2835 Acked Write 1 Done Sent Done false
7368 2836 Acked Write 10 Done Sent Done false
7369 2837 Acked Write 1 Done Sent Done false
7370 2838 Acked Write 1 Done Sent Done false
7371 2839 Acked Read 9 Done Sent Done false
7372 2840 Acked Read 10 Done Sent Done false
7373 2841 Acked Write 10 Done Sent Done false
7374 2842 Acked Read 4 Done Sent Done false
7375 2843 Acked Read 4 Done Sent Done false
7376 2844 Acked Read 9 Done Sent Done false
7377 2845 Acked Flush 0 Done Sent Done false
7378 2846 Acked Read 3 Done Sent Done false
7379 2847 Acked Write 1 Done Sent Done false
7380 2848 Acked Write 2 Done Sent Done false
7381 2849 Acked Flush 0 Done Sent Done false
7382 2850 Acked Flush 0 Done Sent Done false
7383 2851 Acked Read 6 Done Sent Done false
7384 2852 Acked Write 10 Done Sent Done false
7385 2853 Acked Write 10 Done Sent Done false
7386 2854 Acked Write 4 Done Sent Done false
7387 2855 Acked Write 2 Done Sent Done false
7388 2856 Acked Write 10 Done Sent Done false
7389 2857 Acked Read 3 Done Sent Done false
7390 2858 Acked Flush 0 Done Sent Done false
7391 2859 Acked Write 3 Done Sent Done false
7392 2860 Acked Read 6 Done Sent Done false
7393 2861 Acked Write 2 Done Sent Done false
7394 2862 Acked Read 5 Done Sent Done false
7395 2863 Acked Flush 0 Done Sent Done false
7396 2864 Acked Read 5 Done Sent Done false
7397 2865 Acked Write 9 Done Sent Done false
7398 2866 Acked Read 4 Done Sent Done false
7399 2867 Acked Write 3 Done Sent Done false
7400 2868 Acked Read 3 Done Sent Done false
7401 2869 Acked Write 10 Done Sent Done false
7402 2870 Acked Write 8 Done Sent Done false
7403 2871 Acked Read 8 Done Sent Done false
7404 2872 Acked Write 2 Done Sent Done false
7405 2873 Acked Read 8 Done Sent Done false
7406 2874 Acked Write 3 Done Sent Done false
7407 2875 Acked Read 3 Done Sent Done false
7408 2876 Acked Read 9 Done Sent Done false
7409 2877 Acked Write 7 Done Sent Done false
7410 2878 Acked Read 7 Done Sent Done false
7411 2879 Acked Write 9 Done Sent Done false
7412 2880 Acked Read 4 Done Sent Done false
7413 2881 Acked Read 10 Done Sent Done false
7414 2882 Acked Write 1 Done Sent Done false
7415 2883 Acked Write 2 Done Sent Done false
7416 2884 Acked Write 5 Done Sent Done false
7417 2885 Acked Read 1 Done Sent Done false
7418 2886 Acked Write 6 Done Sent Done false
7419 2887 Acked Read 8 Done Sent Done false
7420 2888 Acked Flush 0 Done Sent Done false
7421 2889 Acked Read 6 Done Sent Done false
7422 2890 Acked Read 7 Done Sent Done false
7423 2891 Acked Write 7 Done Sent Done false
7424 2892 Acked Read 8 Done Sent Done false
7425 2893 Acked Read 9 Done Sent Done false
7426 2894 Acked Flush 0 Done Sent Done false
7427 2895 Acked Write 2 Done Sent Done false
7428 2896 Acked Read 1 Done Sent Done false
7429 2897 Acked Read 10 Done Sent Done false
7430 2898 Acked Flush 0 Done Sent Done false
7431 2899 Acked Flush 0 Done Sent Done false
7432 2900 Acked Write 5 Done Sent Done false
7433 2901 Acked Read 2 Done Sent Done false
7434 2902 Acked Read 6 Done Sent Done false
7435 2903 Acked Read 2 Done Sent Done false
7436 2904 Acked Read 4 Done Sent Done false
7437 2905 Acked Read 4 Done Sent Done false
7438 2906 Acked Write 3 Done Sent Done false
7439 2907 Acked Read 4 Done Sent Done false
7440 2908 Acked Flush 0 Done Sent Done false
7441 2909 Acked Read 8 Done Sent Done false
7442 2910 Acked Write 1 Done Sent Done false
7443 2911 Acked Read 8 Done Sent Done false
7444 2912 Acked Write 9 Done Sent Done false
7445 2913 Acked Write 5 Done Sent Done false
7446 2914 Acked Write 5 Done Sent Done false
7447 2915 Acked Read 9 Done Sent Done false
7448 2916 Acked Write 5 Done Sent Done false
7449 2917 Acked Read 5 Done Sent Done false
7450 2918 Acked Read 1 Done Sent Done false
7451 2919 Acked Write 5 Done Sent Done false
7452 2920 Acked Write 3 Done Sent Done false
7453 2921 Acked Write 1 Done Sent Done false
7454 2922 Acked Read 7 Done Sent Done false
7455 2923 Acked Write 10 Done Sent Done false
7456 2924 Acked Write 6 Done Sent Done false
7457 2925 Acked Write 9 Done Sent Done false
7458 2926 Acked Read 6 Done Sent Done false
7459 2927 Acked Write 5 Done Sent Done false
7460 2928 Acked Read 5 Done Sent Done false
7461 2929 Acked Write 7 Done Sent Done false
7462 2930 Acked Write 9 Done Sent Done false
7463 2931 Acked Read 5 Done Sent Done false
7464 2932 Acked Read 10 Done Sent Done false
7465 2933 Acked Read 4 Done Sent Done false
7466 2934 Acked Write 9 Done Sent Done false
7467 2935 Acked Read 5 Done Sent Done false
7468 2936 Acked Read 2 Done Sent Done false
7469 2937 Acked Write 10 Done Sent Done false
7470 2938 Acked Write 2 Done Sent Done false
7471 2939 Acked Read 9 Done Sent Done false
7472 2940 Acked Read 3 Done Sent Done false
7473 2941 Acked Write 5 Done Sent Done false
7474 2942 Acked Read 10 Done Sent Done false
7475 2943 Acked Read 1 Done Sent Done false
7476 2944 Acked Write 7 Done Sent Done false
7477 2945 Acked Flush 0 Done Sent Done false
7478 2946 Acked Read 6 Done Sent Done false
7479 2947 Acked Write 2 Done Sent Done false
7480 2948 Acked Write 8 Done Sent Done false
7481 2949 Acked Read 6 Done Sent Done false
7482 2950 Acked Read 10 Done Sent Done false
7483 2951 Acked Flush 0 Done Sent Done false
7484 2952 Acked Read 3 Done Sent Done false
7485 2953 Acked Read 1 Done Sent Done false
7486 2954 Acked Write 1 Done Sent Done false
7487 2955 Acked Read 8 Done Sent Done false
7488 2956 Acked Flush 0 Done Sent Done false
7489 2957 Acked Read 10 Done Sent Done false
7490 2958 Acked Read 6 Done Sent Done false
7491 2959 Acked Write 7 Done Sent Done false
7492 2960 Acked Read 1 Done Sent Done false
7493 2961 Acked Write 10 Done Sent Done false
7494 2962 Acked Read 9 Done Sent Done false
7495 2963 Acked Write 4 Done Sent Done false
7496 2964 Acked Write 8 Done Sent Done false
7497 2965 Acked Read 8 Done Sent Done false
7498 2966 Acked Read 9 Done Sent Done false
7499 2967 Acked Read 9 Done Sent Done false
7500 2968 Acked Read 1 Done Sent Done false
7501 2969 Acked Read 2 Done Sent Done false
7502 2970 Acked Read 8 Done Sent Done false
7503 2971 Acked Read 1 Done Sent Done false
7504 2972 Acked Flush 0 Done Sent Done false
7505 2973 Acked Write 8 Done Sent Done false
7506 2974 Acked Read 8 Done Sent Done false
7507 2975 Acked Read 1 Done Sent Done false
7508 2976 Acked Write 2 Done Sent Done false
7509 2977 Acked Read 2 Done Sent Done false
7510 2978 Acked Read 6 Done Sent Done false
7511 2979 Acked Read 9 Done Sent Done false
7512 2980 Acked Read 9 Done Sent Done false
7513 2981 Acked Write 8 Done Sent Done false
7514 2982 Acked Write 10 Done Sent Done false
7515 2983 Acked Write 7 Done Sent Done false
7516 2984 Acked Write 9 Done Sent Done false
7517 2985 Acked Write 2 Done Sent Done false
7518 2986 Acked Write 4 Done Sent Done false
7519 2987 Acked Read 8 Done Sent Done false
7520 2988 Acked Flush 0 Done Sent Done false
7521 2989 Acked Read 2 Done Sent Done false
7522 2990 Acked Flush 0 Done Sent Done false
7523 2991 Acked Read 9 Done Sent Done false
7524 2992 Acked Read 6 Done Sent Done false
7525 2993 Acked Read 8 Done Sent Done false
7526 2994 Acked Read 5 Done Sent Done false
7527 2995 Acked Write 10 Done Sent Done false
7528 2996 Acked Write 2 Done Sent Done false
7529 2997 Acked Write 6 Done Sent Done false
7530 2998 Acked Read 6 Done Sent Done false
7531 2999 Acked Read 2 Done Sent Done false
7532 3000 Acked Write 1 Done Sent Done false
7533 3001 Acked Read 8 Done Sent Done false
7534 3002 Acked Flush 0 Done Sent Done false
7535 3003 Acked Read 6 Done Sent Done false
7536 3004 Acked Read 8 Done Sent Done false
7537 3005 Acked Flush 0 Done Sent Done false
7538 3006 Acked Write 8 Done Sent Done false
7539 3007 Acked Write 2 Done Sent Done false
7540 3008 Acked Read 4 Done Sent Done false
7541 3009 Acked Flush 0 Done Sent Done false
7542 3010 Acked Read 1 Done Sent Done false
7543 3011 Acked Flush 0 Done Sent Done false
7544 3012 Acked Read 6 Done Sent Done false
7545 3013 Acked Write 1 Done Sent Done false
7546 3014 Acked Write 6 Done Sent Done false
7547 3015 Acked Write 2 Done Sent Done false
7548 3016 Acked Flush 0 Done Sent Done false
7549 3017 Acked Write 9 Done Sent Done false
7550 3018 Acked Read 1 Done Sent Done false
7551 3019 Acked Write 4 Done Sent Done false
7552 3020 Acked Read 5 Done Sent Done false
7553 3021 Acked Flush 0 Done Sent Done false
7554 3022 Acked Write 2 Done Sent Done false
7555 3023 Acked Write 5 Done Sent Done false
7556 3024 Acked Write 7 Done Sent Done false
7557 3025 Acked Read 4 Done Sent Done false
7558 3026 Acked Write 7 Done Sent Done false
7559 3027 Acked Read 5 Done Sent Done false
7560 3028 Acked Write 9 Done Sent Done false
7561 3029 Acked Write 1 Done Sent Done false
7562 3030 Acked Read 7 Done Sent Done false
7563 3031 Acked Flush 0 Done Sent Done false
7564 3032 Acked Read 8 Done Sent Done false
7565 3033 Acked Write 9 Done Sent Done false
7566 3034 Acked Read 5 Done Sent Done false
7567 3035 Acked Write 8 Done Sent Done false
7568 3036 Acked Write 10 Done Sent Done false
7569 3037 Acked Write 8 Done Sent Done false
7570 3038 Acked Read 9 Done Sent Done false
7571 3039 Acked Write 2 Done Sent Done false
7572 3040 Acked Flush 0 Done Sent Done false
7573 3041 Acked Write 6 Done Sent Done false
7574 3042 Acked Read 9 Done Sent Done false
7575 3043 Acked Write 6 Done Sent Done false
7576 3044 Acked Read 4 Done Sent Done false
7577 3045 Acked Read 10 Done Sent Done false
7578 3046 Acked Flush 0 Done Sent Done false
7579 3047 Acked Write 5 Done Sent Done false
7580 3048 Acked Write 10 Done Sent Done false
7581 3049 Acked Read 1 Done Sent Done false
7582 3050 Acked Read 9 Done Sent Done false
7583 3051 Acked Flush 0 Done Sent Done false
7584 3052 Acked Write 5 Done Sent Done false
7585 3053 Acked Read 8 Done Sent Done false
7586 3054 Acked Write 9 Done Sent Done false
7587 3055 Acked Write 3 Done Sent Done false
7588 3056 Acked Read 10 Done Sent Done false
7589 3057 Acked Read 7 Done Sent Done false
7590 3058 Acked Read 3 Done Sent Done false
7591 3059 Acked Write 2 Done Sent Done false
7592 3060 Acked Read 9 Done Sent Done false
7593 3061 Acked Read 3 Done Sent Done false
7594 3062 Acked Write 10 Done Sent Done false
7595 3063 Acked Read 5 Done Sent Done false
7596 3064 Acked Write 2 Done Sent Done false
7597 3065 Acked Read 9 Done Sent Done false
7598 3066 Acked Read 3 Done Sent Done false
7599 3067 Acked Read 9 Done Sent Done false
7600 3068 Acked Read 7 Done Sent Done false
7601 3069 Acked Read 3 Done Sent Done false
7602 3070 Acked Read 9 Done Sent Done false
7603 3071 Acked Read 7 Done Sent Done false
7604 3072 Acked Read 6 Done Sent Done false
7605 3073 Acked Read 7 Done Sent Done false
7606 3074 Acked Flush 0 Done Sent Done false
7607 3075 Acked Write 8 Done Sent Done false
7608 3076 Acked Write 2 Done Sent Done false
7609 3077 Acked Write 2 Done Sent Done false
7610 3078 Acked Read 7 Done Sent Done false
7611 3079 Acked Read 9 Done Sent Done false
7612 3080 Acked Read 3 Done Sent Done false
7613 3081 Acked Write 3 Done Sent Done false
7614 3082 Acked Read 8 Done Sent Done false
7615 3083 Acked Write 7 Done Sent Done false
7616 3084 Acked Read 3 Done Sent Done false
7617 3085 Acked Write 8 Done Sent Done false
7618 3086 Acked Write 2 Done Sent Done false
7619 3087 Acked Read 8 Done Sent Done false
7620 3088 Acked Read 4 Done Sent Done false
7621 3089 Acked Write 5 Done Sent Done false
7622 3090 Acked Read 8 Done Sent Done false
7623 3091 Acked Read 7 Done Sent Done false
7624 3092 Acked Write 8 Done Sent Done false
7625 3093 Acked Read 6 Done Sent Done false
7626 3094 Acked Write 3 Done Sent Done false
7627 3095 Acked Write 10 Done Sent Done false
7628 3096 Acked Read 8 Done Sent Done false
7629 3097 Acked Read 8 Done Sent Done false
7630 3098 Acked Write 5 Done Sent Done false
7631 3099 Acked Read 7 Done Sent Done false
7632 3100 Acked Write 8 Done Sent Done false
7633 3101 Acked Read 10 Done Sent Done false
7634 3102 Acked Write 5 Done Sent Done false
7635 3103 Acked Write 2 Done Sent Done false
7636 3104 Acked Read 2 Done Sent Done false
7637 3105 Acked Write 6 Done Sent Done false
7638 3106 Acked Read 5 Done Sent Done false
7639 3107 Acked Read 8 Done Sent Done false
7640 3108 Acked Read 1 Done Sent Done false
7641 3109 Acked Read 10 Done Sent Done false
7642 3110 Acked Write 2 Done Sent Done false
7643 3111 Acked Flush 0 Done Sent Done false
7644 STATES DS:0 DS:1 DS:2 TOTAL
7645 Sent 0 302 0 302
7646 Done 302 0 302 604
7647 Skipped 0 0 0 0
7648 Error 0 0 0 0
7649 Last Flush: 3111 2809 3111
7650 Downstairs last five completed: 2809 2808 2807 2806 2805
7651 Upstairs last five completed: 3111 3110 3109 3108 3107
7652 CLIENT: Up:0 ds:302 act:2
76532025-01-10T16:36:55.197ZINFOcrucible: connecting to 127.0.0.1:8820 = io task client = 1 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
76542025-01-10T16:36:55.197ZWARNcrucible: ds_connection connect to 127.0.0.1:8820 failure: Os { code: 146, kind: ConnectionRefused, message: "Connection refused" } = io task client = 1 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
76552025-01-10T16:36:55.197ZWARNcrucible: client task is sending Done(ConnectionFailed(Os { code: 146, kind: ConnectionRefused, message: "Connection refused" })) = io task client = 1 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
76562025-01-10T16:36:55.197ZWARNcrucible: downstairs task for 1 stopped due to ConnectionFailed(Os { code: 146, kind: ConnectionRefused, message: "Connection refused" }) session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
76572025-01-10T16:36:55.197ZINFOcrucible: client task is exiting = io task client = 1 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
7658 [8820] got start action
7659 [8820] I am going to restart
7660 Starting downstairs at port 8820
7661 Make output file at "/tmp/dsc/downstairs-8820.txt"
7662 [8820][1] reports Starting
7663 Downstairs /var/tmp/dsc/region/8820 port 8820 PID:Some(1209)
7664 [8820][1] reports Running
7665 ----------------------------------------------------------------
7666 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:302
7667 States: Active Offline Active
7668 JOBID ACK TYPE BKS/EXT DS:0 DS:1 DS:2 REPLAY
7669 2810 Acked Flush 0 Done Sent Done false
7670 2811 Acked Read 3 Done Sent Done false
7671 2812 Acked Write 10 Done Sent Done false
7672 2813 Acked Write 5 Done Sent Done false
7673 2814 Acked Write 7 Done Sent Done false
7674 2815 Acked Write 6 Done Sent Done false
7675 2816 Acked Write 1 Done Sent Done false
7676 2817 Acked Write 5 Done Sent Done false
7677 2818 Acked Read 2 Done Sent Done false
7678 2819 Acked Read 10 Done Sent Done false
7679 2820 Acked Read 5 Done Sent Done false
7680 2821 Acked Read 6 Done Sent Done false
7681 2822 Acked Read 10 Done Sent Done false
7682 2823 Acked Read 3 Done Sent Done false
7683 2824 Acked Read 3 Done Sent Done false
7684 2825 Acked Flush 0 Done Sent Done false
7685 2826 Acked Read 9 Done Sent Done false
7686 2827 Acked Read 1 Done Sent Done false
7687 2828 Acked Read 5 Done Sent Done false
7688 2829 Acked Read 6 Done Sent Done false
7689 2830 Acked Write 8 Done Sent Done false
7690 2831 Acked Read 7 Done Sent Done false
7691 2832 Acked Write 9 Done Sent Done false
7692 2833 Acked Read 2 Done Sent Done false
7693 2834 Acked Read 1 Done Sent Done false
7694 2835 Acked Write 1 Done Sent Done false
7695 2836 Acked Write 10 Done Sent Done false
7696 2837 Acked Write 1 Done Sent Done false
7697 2838 Acked Write 1 Done Sent Done false
7698 2839 Acked Read 9 Done Sent Done false
7699 2840 Acked Read 10 Done Sent Done false
7700 2841 Acked Write 10 Done Sent Done false
7701 2842 Acked Read 4 Done Sent Done false
7702 2843 Acked Read 4 Done Sent Done false
7703 2844 Acked Read 9 Done Sent Done false
7704 2845 Acked Flush 0 Done Sent Done false
7705 2846 Acked Read 3 Done Sent Done false
7706 2847 Acked Write 1 Done Sent Done false
7707 2848 Acked Write 2 Done Sent Done false
7708 2849 Acked Flush 0 Done Sent Done false
7709 2850 Acked Flush 0 Done Sent Done false
7710 2851 Acked Read 6 Done Sent Done false
7711 2852 Acked Write 10 Done Sent Done false
7712 2853 Acked Write 10 Done Sent Done false
7713 2854 Acked Write 4 Done Sent Done false
7714 2855 Acked Write 2 Done Sent Done false
7715 2856 Acked Write 10 Done Sent Done false
7716 2857 Acked Read 3 Done Sent Done false
7717 2858 Acked Flush 0 Done Sent Done false
7718 2859 Acked Write 3 Done Sent Done false
7719 2860 Acked Read 6 Done Sent Done false
7720 2861 Acked Write 2 Done Sent Done false
7721 2862 Acked Read 5 Done Sent Done false
7722 2863 Acked Flush 0 Done Sent Done false
7723 2864 Acked Read 5 Done Sent Done false
7724 2865 Acked Write 9 Done Sent Done false
7725 2866 Acked Read 4 Done Sent Done false
7726 2867 Acked Write 3 Done Sent Done false
7727 2868 Acked Read 3 Done Sent Done false
7728 2869 Acked Write 10 Done Sent Done false
7729 2870 Acked Write 8 Done Sent Done false
7730 2871 Acked Read 8 Done Sent Done false
7731 2872 Acked Write 2 Done Sent Done false
7732 2873 Acked Read 8 Done Sent Done false
7733 2874 Acked Write 3 Done Sent Done false
7734 2875 Acked Read 3 Done Sent Done false
7735 2876 Acked Read 9 Done Sent Done false
7736 2877 Acked Write 7 Done Sent Done false
7737 2878 Acked Read 7 Done Sent Done false
7738 2879 Acked Write 9 Done Sent Done false
7739 2880 Acked Read 4 Done Sent Done false
7740 2881 Acked Read 10 Done Sent Done false
7741 2882 Acked Write 1 Done Sent Done false
7742 2883 Acked Write 2 Done Sent Done false
7743 2884 Acked Write 5 Done Sent Done false
7744 2885 Acked Read 1 Done Sent Done false
7745 2886 Acked Write 6 Done Sent Done false
7746 2887 Acked Read 8 Done Sent Done false
7747 2888 Acked Flush 0 Done Sent Done false
7748 2889 Acked Read 6 Done Sent Done false
7749 2890 Acked Read 7 Done Sent Done false
7750 2891 Acked Write 7 Done Sent Done false
7751 2892 Acked Read 8 Done Sent Done false
7752 2893 Acked Read 9 Done Sent Done false
7753 2894 Acked Flush 0 Done Sent Done false
7754 2895 Acked Write 2 Done Sent Done false
7755 2896 Acked Read 1 Done Sent Done false
7756 2897 Acked Read 10 Done Sent Done false
7757 2898 Acked Flush 0 Done Sent Done false
7758 2899 Acked Flush 0 Done Sent Done false
7759 2900 Acked Write 5 Done Sent Done false
7760 2901 Acked Read 2 Done Sent Done false
7761 2902 Acked Read 6 Done Sent Done false
7762 2903 Acked Read 2 Done Sent Done false
7763 2904 Acked Read 4 Done Sent Done false
7764 2905 Acked Read 4 Done Sent Done false
7765 2906 Acked Write 3 Done Sent Done false
7766 2907 Acked Read 4 Done Sent Done false
7767 2908 Acked Flush 0 Done Sent Done false
7768 2909 Acked Read 8 Done Sent Done false
7769 2910 Acked Write 1 Done Sent Done false
7770 2911 Acked Read 8 Done Sent Done false
7771 2912 Acked Write 9 Done Sent Done false
7772 2913 Acked Write 5 Done Sent Done false
7773 2914 Acked Write 5 Done Sent Done false
7774 2915 Acked Read 9 Done Sent Done false
7775 2916 Acked Write 5 Done Sent Done false
7776 2917 Acked Read 5 Done Sent Done false
7777 2918 Acked Read 1 Done Sent Done false
7778 2919 Acked Write 5 Done Sent Done false
7779 2920 Acked Write 3 Done Sent Done false
7780 2921 Acked Write 1 Done Sent Done false
7781 2922 Acked Read 7 Done Sent Done false
7782 2923 Acked Write 10 Done Sent Done false
7783 2924 Acked Write 6 Done Sent Done false
7784 2925 Acked Write 9 Done Sent Done false
7785 2926 Acked Read 6 Done Sent Done false
7786 2927 Acked Write 5 Done Sent Done false
7787 2928 Acked Read 5 Done Sent Done false
7788 2929 Acked Write 7 Done Sent Done false
7789 2930 Acked Write 9 Done Sent Done false
7790 2931 Acked Read 5 Done Sent Done false
7791 2932 Acked Read 10 Done Sent Done false
7792 2933 Acked Read 4 Done Sent Done false
7793 2934 Acked Write 9 Done Sent Done false
7794 2935 Acked Read 5 Done Sent Done false
7795 2936 Acked Read 2 Done Sent Done false
7796 2937 Acked Write 10 Done Sent Done false
7797 2938 Acked Write 2 Done Sent Done false
7798 2939 Acked Read 9 Done Sent Done false
7799 2940 Acked Read 3 Done Sent Done false
7800 2941 Acked Write 5 Done Sent Done false
7801 2942 Acked Read 10 Done Sent Done false
7802 2943 Acked Read 1 Done Sent Done false
7803 2944 Acked Write 7 Done Sent Done false
7804 2945 Acked Flush 0 Done Sent Done false
7805 2946 Acked Read 6 Done Sent Done false
7806 2947 Acked Write 2 Done Sent Done false
7807 2948 Acked Write 8 Done Sent Done false
7808 2949 Acked Read 6 Done Sent Done false
7809 2950 Acked Read 10 Done Sent Done false
7810 2951 Acked Flush 0 Done Sent Done false
7811 2952 Acked Read 3 Done Sent Done false
7812 2953 Acked Read 1 Done Sent Done false
7813 2954 Acked Write 1 Done Sent Done false
7814 2955 Acked Read 8 Done Sent Done false
7815 2956 Acked Flush 0 Done Sent Done false
7816 2957 Acked Read 10 Done Sent Done false
7817 2958 Acked Read 6 Done Sent Done false
7818 2959 Acked Write 7 Done Sent Done false
7819 2960 Acked Read 1 Done Sent Done false
7820 2961 Acked Write 10 Done Sent Done false
7821 2962 Acked Read 9 Done Sent Done false
7822 2963 Acked Write 4 Done Sent Done false
7823 2964 Acked Write 8 Done Sent Done false
7824 2965 Acked Read 8 Done Sent Done false
7825 2966 Acked Read 9 Done Sent Done false
7826 2967 Acked Read 9 Done Sent Done false
7827 2968 Acked Read 1 Done Sent Done false
7828 2969 Acked Read 2 Done Sent Done false
7829 2970 Acked Read 8 Done Sent Done false
7830 2971 Acked Read 1 Done Sent Done false
7831 2972 Acked Flush 0 Done Sent Done false
7832 2973 Acked Write 8 Done Sent Done false
7833 2974 Acked Read 8 Done Sent Done false
7834 2975 Acked Read 1 Done Sent Done false
7835 2976 Acked Write 2 Done Sent Done false
7836 2977 Acked Read 2 Done Sent Done false
7837 2978 Acked Read 6 Done Sent Done false
7838 2979 Acked Read 9 Done Sent Done false
7839 2980 Acked Read 9 Done Sent Done false
7840 2981 Acked Write 8 Done Sent Done false
7841 2982 Acked Write 10 Done Sent Done false
7842 2983 Acked Write 7 Done Sent Done false
7843 2984 Acked Write 9 Done Sent Done false
7844 2985 Acked Write 2 Done Sent Done false
7845 2986 Acked Write 4 Done Sent Done false
7846 2987 Acked Read 8 Done Sent Done false
7847 2988 Acked Flush 0 Done Sent Done false
7848 2989 Acked Read 2 Done Sent Done false
7849 2990 Acked Flush 0 Done Sent Done false
7850 2991 Acked Read 9 Done Sent Done false
7851 2992 Acked Read 6 Done Sent Done false
7852 2993 Acked Read 8 Done Sent Done false
7853 2994 Acked Read 5 Done Sent Done false
7854 2995 Acked Write 10 Done Sent Done false
7855 2996 Acked Write 2 Done Sent Done false
7856 2997 Acked Write 6 Done Sent Done false
7857 2998 Acked Read 6 Done Sent Done false
7858 2999 Acked Read 2 Done Sent Done false
7859 3000 Acked Write 1 Done Sent Done false
7860 3001 Acked Read 8 Done Sent Done false
7861 3002 Acked Flush 0 Done Sent Done false
7862 3003 Acked Read 6 Done Sent Done false
7863 3004 Acked Read 8 Done Sent Done false
7864 3005 Acked Flush 0 Done Sent Done false
7865 3006 Acked Write 8 Done Sent Done false
7866 3007 Acked Write 2 Done Sent Done false
7867 3008 Acked Read 4 Done Sent Done false
7868 3009 Acked Flush 0 Done Sent Done false
7869 3010 Acked Read 1 Done Sent Done false
7870 3011 Acked Flush 0 Done Sent Done false
7871 3012 Acked Read 6 Done Sent Done false
7872 3013 Acked Write 1 Done Sent Done false
7873 3014 Acked Write 6 Done Sent Done false
7874 3015 Acked Write 2 Done Sent Done false
7875 3016 Acked Flush 0 Done Sent Done false
7876 3017 Acked Write 9 Done Sent Done false
7877 3018 Acked Read 1 Done Sent Done false
7878 3019 Acked Write 4 Done Sent Done false
7879 3020 Acked Read 5 Done Sent Done false
7880 3021 Acked Flush 0 Done Sent Done false
7881 3022 Acked Write 2 Done Sent Done false
7882 3023 Acked Write 5 Done Sent Done false
7883 3024 Acked Write 7 Done Sent Done false
7884 3025 Acked Read 4 Done Sent Done false
7885 3026 Acked Write 7 Done Sent Done false
7886 3027 Acked Read 5 Done Sent Done false
7887 3028 Acked Write 9 Done Sent Done false
7888 3029 Acked Write 1 Done Sent Done false
7889 3030 Acked Read 7 Done Sent Done false
7890 3031 Acked Flush 0 Done Sent Done false
7891 3032 Acked Read 8 Done Sent Done false
7892 3033 Acked Write 9 Done Sent Done false
7893 3034 Acked Read 5 Done Sent Done false
7894 3035 Acked Write 8 Done Sent Done false
7895 3036 Acked Write 10 Done Sent Done false
7896 3037 Acked Write 8 Done Sent Done false
7897 3038 Acked Read 9 Done Sent Done false
7898 3039 Acked Write 2 Done Sent Done false
7899 3040 Acked Flush 0 Done Sent Done false
7900 3041 Acked Write 6 Done Sent Done false
7901 3042 Acked Read 9 Done Sent Done false
7902 3043 Acked Write 6 Done Sent Done false
7903 3044 Acked Read 4 Done Sent Done false
7904 3045 Acked Read 10 Done Sent Done false
7905 3046 Acked Flush 0 Done Sent Done false
7906 3047 Acked Write 5 Done Sent Done false
7907 3048 Acked Write 10 Done Sent Done false
7908 3049 Acked Read 1 Done Sent Done false
7909 3050 Acked Read 9 Done Sent Done false
7910 3051 Acked Flush 0 Done Sent Done false
7911 3052 Acked Write 5 Done Sent Done false
7912 3053 Acked Read 8 Done Sent Done false
7913 3054 Acked Write 9 Done Sent Done false
7914 3055 Acked Write 3 Done Sent Done false
7915 3056 Acked Read 10 Done Sent Done false
7916 3057 Acked Read 7 Done Sent Done false
7917 3058 Acked Read 3 Done Sent Done false
7918 3059 Acked Write 2 Done Sent Done false
7919 3060 Acked Read 9 Done Sent Done false
7920 3061 Acked Read 3 Done Sent Done false
7921 3062 Acked Write 10 Done Sent Done false
7922 3063 Acked Read 5 Done Sent Done false
7923 3064 Acked Write 2 Done Sent Done false
7924 3065 Acked Read 9 Done Sent Done false
7925 3066 Acked Read 3 Done Sent Done false
7926 3067 Acked Read 9 Done Sent Done false
7927 3068 Acked Read 7 Done Sent Done false
7928 3069 Acked Read 3 Done Sent Done false
7929 3070 Acked Read 9 Done Sent Done false
7930 3071 Acked Read 7 Done Sent Done false
7931 3072 Acked Read 6 Done Sent Done false
7932 3073 Acked Read 7 Done Sent Done false
7933 3074 Acked Flush 0 Done Sent Done false
7934 3075 Acked Write 8 Done Sent Done false
7935 3076 Acked Write 2 Done Sent Done false
7936 3077 Acked Write 2 Done Sent Done false
7937 3078 Acked Read 7 Done Sent Done false
7938 3079 Acked Read 9 Done Sent Done false
7939 3080 Acked Read 3 Done Sent Done false
7940 3081 Acked Write 3 Done Sent Done false
7941 3082 Acked Read 8 Done Sent Done false
7942 3083 Acked Write 7 Done Sent Done false
7943 3084 Acked Read 3 Done Sent Done false
7944 3085 Acked Write 8 Done Sent Done false
7945 3086 Acked Write 2 Done Sent Done false
7946 3087 Acked Read 8 Done Sent Done false
7947 3088 Acked Read 4 Done Sent Done false
7948 3089 Acked Write 5 Done Sent Done false
7949 3090 Acked Read 8 Done Sent Done false
7950 3091 Acked Read 7 Done Sent Done false
7951 3092 Acked Write 8 Done Sent Done false
7952 3093 Acked Read 6 Done Sent Done false
7953 3094 Acked Write 3 Done Sent Done false
7954 3095 Acked Write 10 Done Sent Done false
7955 3096 Acked Read 8 Done Sent Done false
7956 3097 Acked Read 8 Done Sent Done false
7957 3098 Acked Write 5 Done Sent Done false
7958 3099 Acked Read 7 Done Sent Done false
7959 3100 Acked Write 8 Done Sent Done false
7960 3101 Acked Read 10 Done Sent Done false
7961 3102 Acked Write 5 Done Sent Done false
7962 3103 Acked Write 2 Done Sent Done false
7963 3104 Acked Read 2 Done Sent Done false
7964 3105 Acked Write 6 Done Sent Done false
7965 3106 Acked Read 5 Done Sent Done false
7966 3107 Acked Read 8 Done Sent Done false
7967 3108 Acked Read 1 Done Sent Done false
7968 3109 Acked Read 10 Done Sent Done false
7969 3110 Acked Write 2 Done Sent Done false
7970 3111 Acked Flush 0 Done Sent Done false
7971 STATES DS:0 DS:1 DS:2 TOTAL
7972 Sent 0 302 0 302
7973 Done 302 0 302 604
7974 Skipped 0 0 0 0
7975 Error 0 0 0 0
7976 Last Flush: 3111 2809 3111
7977 Downstairs last five completed: 2809 2808 2807 2806 2805
7978 Upstairs last five completed: 3111 3110 3109 3108 3107
7979 CLIENT: Up:0 ds:302 act:2
7980 ----------------------------------------------------------------
7981 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:302
7982 States: Active Offline Active
7983 JOBID ACK TYPE BKS/EXT DS:0 DS:1 DS:2 REPLAY
7984 2810 Acked Flush 0 Done Sent Done false
7985 2811 Acked Read 3 Done Sent Done false
7986 2812 Acked Write 10 Done Sent Done false
7987 2813 Acked Write 5 Done Sent Done false
7988 2814 Acked Write 7 Done Sent Done false
7989 2815 Acked Write 6 Done Sent Done false
7990 2816 Acked Write 1 Done Sent Done false
7991 2817 Acked Write 5 Done Sent Done false
7992 2818 Acked Read 2 Done Sent Done false
7993 2819 Acked Read 10 Done Sent Done false
7994 2820 Acked Read 5 Done Sent Done false
7995 2821 Acked Read 6 Done Sent Done false
7996 2822 Acked Read 10 Done Sent Done false
7997 2823 Acked Read 3 Done Sent Done false
7998 2824 Acked Read 3 Done Sent Done false
7999 2825 Acked Flush 0 Done Sent Done false
8000 2826 Acked Read 9 Done Sent Done false
8001 2827 Acked Read 1 Done Sent Done false
8002 2828 Acked Read 5 Done Sent Done false
8003 2829 Acked Read 6 Done Sent Done false
8004 2830 Acked Write 8 Done Sent Done false
8005 2831 Acked Read 7 Done Sent Done false
8006 2832 Acked Write 9 Done Sent Done false
8007 2833 Acked Read 2 Done Sent Done false
8008 2834 Acked Read 1 Done Sent Done false
8009 2835 Acked Write 1 Done Sent Done false
8010 2836 Acked Write 10 Done Sent Done false
8011 2837 Acked Write 1 Done Sent Done false
8012 2838 Acked Write 1 Done Sent Done false
8013 2839 Acked Read 9 Done Sent Done false
8014 2840 Acked Read 10 Done Sent Done false
8015 2841 Acked Write 10 Done Sent Done false
8016 2842 Acked Read 4 Done Sent Done false
8017 2843 Acked Read 4 Done Sent Done false
8018 2844 Acked Read 9 Done Sent Done false
8019 2845 Acked Flush 0 Done Sent Done false
8020 2846 Acked Read 3 Done Sent Done false
8021 2847 Acked Write 1 Done Sent Done false
8022 2848 Acked Write 2 Done Sent Done false
8023 2849 Acked Flush 0 Done Sent Done false
8024 2850 Acked Flush 0 Done Sent Done false
8025 2851 Acked Read 6 Done Sent Done false
8026 2852 Acked Write 10 Done Sent Done false
8027 2853 Acked Write 10 Done Sent Done false
8028 2854 Acked Write 4 Done Sent Done false
8029 2855 Acked Write 2 Done Sent Done false
8030 2856 Acked Write 10 Done Sent Done false
8031 2857 Acked Read 3 Done Sent Done false
8032 2858 Acked Flush 0 Done Sent Done false
8033 2859 Acked Write 3 Done Sent Done false
8034 2860 Acked Read 6 Done Sent Done false
8035 2861 Acked Write 2 Done Sent Done false
8036 2862 Acked Read 5 Done Sent Done false
8037 2863 Acked Flush 0 Done Sent Done false
8038 2864 Acked Read 5 Done Sent Done false
8039 2865 Acked Write 9 Done Sent Done false
8040 2866 Acked Read 4 Done Sent Done false
8041 2867 Acked Write 3 Done Sent Done false
8042 2868 Acked Read 3 Done Sent Done false
8043 2869 Acked Write 10 Done Sent Done false
8044 2870 Acked Write 8 Done Sent Done false
8045 2871 Acked Read 8 Done Sent Done false
8046 2872 Acked Write 2 Done Sent Done false
8047 2873 Acked Read 8 Done Sent Done false
8048 2874 Acked Write 3 Done Sent Done false
8049 2875 Acked Read 3 Done Sent Done false
8050 2876 Acked Read 9 Done Sent Done false
8051 2877 Acked Write 7 Done Sent Done false
8052 2878 Acked Read 7 Done Sent Done false
8053 2879 Acked Write 9 Done Sent Done false
8054 2880 Acked Read 4 Done Sent Done false
8055 2881 Acked Read 10 Done Sent Done false
8056 2882 Acked Write 1 Done Sent Done false
8057 2883 Acked Write 2 Done Sent Done false
8058 2884 Acked Write 5 Done Sent Done false
8059 2885 Acked Read 1 Done Sent Done false
8060 2886 Acked Write 6 Done Sent Done false
8061 2887 Acked Read 8 Done Sent Done false
8062 2888 Acked Flush 0 Done Sent Done false
8063 2889 Acked Read 6 Done Sent Done false
8064 2890 Acked Read 7 Done Sent Done false
8065 2891 Acked Write 7 Done Sent Done false
8066 2892 Acked Read 8 Done Sent Done false
8067 2893 Acked Read 9 Done Sent Done false
8068 2894 Acked Flush 0 Done Sent Done false
8069 2895 Acked Write 2 Done Sent Done false
8070 2896 Acked Read 1 Done Sent Done false
8071 2897 Acked Read 10 Done Sent Done false
8072 2898 Acked Flush 0 Done Sent Done false
8073 2899 Acked Flush 0 Done Sent Done false
8074 2900 Acked Write 5 Done Sent Done false
8075 2901 Acked Read 2 Done Sent Done false
8076 2902 Acked Read 6 Done Sent Done false
8077 2903 Acked Read 2 Done Sent Done false
8078 2904 Acked Read 4 Done Sent Done false
8079 2905 Acked Read 4 Done Sent Done false
8080 2906 Acked Write 3 Done Sent Done false
8081 2907 Acked Read 4 Done Sent Done false
8082 2908 Acked Flush 0 Done Sent Done false
8083 2909 Acked Read 8 Done Sent Done false
8084 2910 Acked Write 1 Done Sent Done false
8085 2911 Acked Read 8 Done Sent Done false
8086 2912 Acked Write 9 Done Sent Done false
8087 2913 Acked Write 5 Done Sent Done false
8088 2914 Acked Write 5 Done Sent Done false
8089 2915 Acked Read 9 Done Sent Done false
8090 2916 Acked Write 5 Done Sent Done false
8091 2917 Acked Read 5 Done Sent Done false
8092 2918 Acked Read 1 Done Sent Done false
8093 2919 Acked Write 5 Done Sent Done false
8094 2920 Acked Write 3 Done Sent Done false
8095 2921 Acked Write 1 Done Sent Done false
8096 2922 Acked Read 7 Done Sent Done false
8097 2923 Acked Write 10 Done Sent Done false
8098 2924 Acked Write 6 Done Sent Done false
8099 2925 Acked Write 9 Done Sent Done false
8100 2926 Acked Read 6 Done Sent Done false
8101 2927 Acked Write 5 Done Sent Done false
8102 2928 Acked Read 5 Done Sent Done false
8103 2929 Acked Write 7 Done Sent Done false
8104 2930 Acked Write 9 Done Sent Done false
8105 2931 Acked Read 5 Done Sent Done false
8106 2932 Acked Read 10 Done Sent Done false
8107 2933 Acked Read 4 Done Sent Done false
8108 2934 Acked Write 9 Done Sent Done false
8109 2935 Acked Read 5 Done Sent Done false
8110 2936 Acked Read 2 Done Sent Done false
8111 2937 Acked Write 10 Done Sent Done false
8112 2938 Acked Write 2 Done Sent Done false
8113 2939 Acked Read 9 Done Sent Done false
8114 2940 Acked Read 3 Done Sent Done false
8115 2941 Acked Write 5 Done Sent Done false
8116 2942 Acked Read 10 Done Sent Done false
8117 2943 Acked Read 1 Done Sent Done false
8118 2944 Acked Write 7 Done Sent Done false
8119 2945 Acked Flush 0 Done Sent Done false
8120 2946 Acked Read 6 Done Sent Done false
8121 2947 Acked Write 2 Done Sent Done false
8122 2948 Acked Write 8 Done Sent Done false
8123 2949 Acked Read 6 Done Sent Done false
8124 2950 Acked Read 10 Done Sent Done false
8125 2951 Acked Flush 0 Done Sent Done false
8126 2952 Acked Read 3 Done Sent Done false
8127 2953 Acked Read 1 Done Sent Done false
8128 2954 Acked Write 1 Done Sent Done false
8129 2955 Acked Read 8 Done Sent Done false
8130 2956 Acked Flush 0 Done Sent Done false
8131 2957 Acked Read 10 Done Sent Done false
8132 2958 Acked Read 6 Done Sent Done false
8133 2959 Acked Write 7 Done Sent Done false
8134 2960 Acked Read 1 Done Sent Done false
8135 2961 Acked Write 10 Done Sent Done false
8136 2962 Acked Read 9 Done Sent Done false
8137 2963 Acked Write 4 Done Sent Done false
8138 2964 Acked Write 8 Done Sent Done false
8139 2965 Acked Read 8 Done Sent Done false
8140 2966 Acked Read 9 Done Sent Done false
8141 2967 Acked Read 9 Done Sent Done false
8142 2968 Acked Read 1 Done Sent Done false
8143 2969 Acked Read 2 Done Sent Done false
8144 2970 Acked Read 8 Done Sent Done false
8145 2971 Acked Read 1 Done Sent Done false
8146 2972 Acked Flush 0 Done Sent Done false
8147 2973 Acked Write 8 Done Sent Done false
8148 2974 Acked Read 8 Done Sent Done false
8149 2975 Acked Read 1 Done Sent Done false
8150 2976 Acked Write 2 Done Sent Done false
8151 2977 Acked Read 2 Done Sent Done false
8152 2978 Acked Read 6 Done Sent Done false
8153 2979 Acked Read 9 Done Sent Done false
8154 2980 Acked Read 9 Done Sent Done false
8155 2981 Acked Write 8 Done Sent Done false
8156 2982 Acked Write 10 Done Sent Done false
8157 2983 Acked Write 7 Done Sent Done false
8158 2984 Acked Write 9 Done Sent Done false
8159 2985 Acked Write 2 Done Sent Done false
8160 2986 Acked Write 4 Done Sent Done false
8161 2987 Acked Read 8 Done Sent Done false
8162 2988 Acked Flush 0 Done Sent Done false
8163 2989 Acked Read 2 Done Sent Done false
8164 2990 Acked Flush 0 Done Sent Done false
8165 2991 Acked Read 9 Done Sent Done false
8166 2992 Acked Read 6 Done Sent Done false
8167 2993 Acked Read 8 Done Sent Done false
8168 2994 Acked Read 5 Done Sent Done false
8169 2995 Acked Write 10 Done Sent Done false
8170 2996 Acked Write 2 Done Sent Done false
8171 2997 Acked Write 6 Done Sent Done false
8172 2998 Acked Read 6 Done Sent Done false
8173 2999 Acked Read 2 Done Sent Done false
8174 3000 Acked Write 1 Done Sent Done false
8175 3001 Acked Read 8 Done Sent Done false
8176 3002 Acked Flush 0 Done Sent Done false
8177 3003 Acked Read 6 Done Sent Done false
8178 3004 Acked Read 8 Done Sent Done false
8179 3005 Acked Flush 0 Done Sent Done false
8180 3006 Acked Write 8 Done Sent Done false
8181 3007 Acked Write 2 Done Sent Done false
8182 3008 Acked Read 4 Done Sent Done false
8183 3009 Acked Flush 0 Done Sent Done false
8184 3010 Acked Read 1 Done Sent Done false
8185 3011 Acked Flush 0 Done Sent Done false
8186 3012 Acked Read 6 Done Sent Done false
8187 3013 Acked Write 1 Done Sent Done false
8188 3014 Acked Write 6 Done Sent Done false
8189 3015 Acked Write 2 Done Sent Done false
8190 3016 Acked Flush 0 Done Sent Done false
8191 3017 Acked Write 9 Done Sent Done false
8192 3018 Acked Read 1 Done Sent Done false
8193 3019 Acked Write 4 Done Sent Done false
8194 3020 Acked Read 5 Done Sent Done false
8195 3021 Acked Flush 0 Done Sent Done false
8196 3022 Acked Write 2 Done Sent Done false
8197 3023 Acked Write 5 Done Sent Done false
8198 3024 Acked Write 7 Done Sent Done false
8199 3025 Acked Read 4 Done Sent Done false
8200 3026 Acked Write 7 Done Sent Done false
8201 3027 Acked Read 5 Done Sent Done false
8202 3028 Acked Write 9 Done Sent Done false
8203 3029 Acked Write 1 Done Sent Done false
8204 3030 Acked Read 7 Done Sent Done false
8205 3031 Acked Flush 0 Done Sent Done false
8206 3032 Acked Read 8 Done Sent Done false
8207 3033 Acked Write 9 Done Sent Done false
8208 3034 Acked Read 5 Done Sent Done false
8209 3035 Acked Write 8 Done Sent Done false
8210 3036 Acked Write 10 Done Sent Done false
8211 3037 Acked Write 8 Done Sent Done false
8212 3038 Acked Read 9 Done Sent Done false
8213 3039 Acked Write 2 Done Sent Done false
8214 3040 Acked Flush 0 Done Sent Done false
8215 3041 Acked Write 6 Done Sent Done false
8216 3042 Acked Read 9 Done Sent Done false
8217 3043 Acked Write 6 Done Sent Done false
8218 3044 Acked Read 4 Done Sent Done false
8219 3045 Acked Read 10 Done Sent Done false
8220 3046 Acked Flush 0 Done Sent Done false
8221 3047 Acked Write 5 Done Sent Done false
8222 3048 Acked Write 10 Done Sent Done false
8223 3049 Acked Read 1 Done Sent Done false
8224 3050 Acked Read 9 Done Sent Done false
8225 3051 Acked Flush 0 Done Sent Done false
8226 3052 Acked Write 5 Done Sent Done false
8227 3053 Acked Read 8 Done Sent Done false
8228 3054 Acked Write 9 Done Sent Done false
8229 3055 Acked Write 3 Done Sent Done false
8230 3056 Acked Read 10 Done Sent Done false
8231 3057 Acked Read 7 Done Sent Done false
8232 3058 Acked Read 3 Done Sent Done false
8233 3059 Acked Write 2 Done Sent Done false
8234 3060 Acked Read 9 Done Sent Done false
8235 3061 Acked Read 3 Done Sent Done false
8236 3062 Acked Write 10 Done Sent Done false
8237 3063 Acked Read 5 Done Sent Done false
8238 3064 Acked Write 2 Done Sent Done false
8239 3065 Acked Read 9 Done Sent Done false
8240 3066 Acked Read 3 Done Sent Done false
8241 3067 Acked Read 9 Done Sent Done false
8242 3068 Acked Read 7 Done Sent Done false
8243 3069 Acked Read 3 Done Sent Done false
8244 3070 Acked Read 9 Done Sent Done false
8245 3071 Acked Read 7 Done Sent Done false
8246 3072 Acked Read 6 Done Sent Done false
8247 3073 Acked Read 7 Done Sent Done false
8248 3074 Acked Flush 0 Done Sent Done false
8249 3075 Acked Write 8 Done Sent Done false
8250 3076 Acked Write 2 Done Sent Done false
8251 3077 Acked Write 2 Done Sent Done false
8252 3078 Acked Read 7 Done Sent Done false
8253 3079 Acked Read 9 Done Sent Done false
8254 3080 Acked Read 3 Done Sent Done false
8255 3081 Acked Write 3 Done Sent Done false
8256 3082 Acked Read 8 Done Sent Done false
8257 3083 Acked Write 7 Done Sent Done false
8258 3084 Acked Read 3 Done Sent Done false
8259 3085 Acked Write 8 Done Sent Done false
8260 3086 Acked Write 2 Done Sent Done false
8261 3087 Acked Read 8 Done Sent Done false
8262 3088 Acked Read 4 Done Sent Done false
8263 3089 Acked Write 5 Done Sent Done false
8264 3090 Acked Read 8 Done Sent Done false
8265 3091 Acked Read 7 Done Sent Done false
8266 3092 Acked Write 8 Done Sent Done false
8267 3093 Acked Read 6 Done Sent Done false
8268 3094 Acked Write 3 Done Sent Done false
8269 3095 Acked Write 10 Done Sent Done false
8270 3096 Acked Read 8 Done Sent Done false
8271 3097 Acked Read 8 Done Sent Done false
8272 3098 Acked Write 5 Done Sent Done false
8273 3099 Acked Read 7 Done Sent Done false
8274 3100 Acked Write 8 Done Sent Done false
8275 3101 Acked Read 10 Done Sent Done false
8276 3102 Acked Write 5 Done Sent Done false
8277 3103 Acked Write 2 Done Sent Done false
8278 3104 Acked Read 2 Done Sent Done false
8279 3105 Acked Write 6 Done Sent Done false
8280 3106 Acked Read 5 Done Sent Done false
8281 3107 Acked Read 8 Done Sent Done false
8282 3108 Acked Read 1 Done Sent Done false
8283 3109 Acked Read 10 Done Sent Done false
8284 3110 Acked Write 2 Done Sent Done false
8285 3111 Acked Flush 0 Done Sent Done false
8286 STATES DS:0 DS:1 DS:2 TOTAL
8287 Sent 0 302 0 302
8288 Done 302 0 302 604
8289 Skipped 0 0 0 0
8290 Error 0 0 0 0
8291 Last Flush: 3111 2809 3111
8292 Downstairs last five completed: 2809 2808 2807 2806 2805
8293 Upstairs last five completed: 3111 3110 3109 3108 3107
8294 CLIENT: Up:0 ds:302 act:2
82952025-01-10T16:37:05.198ZINFOcrucible: connecting to 127.0.0.1:8820 = io task client = 1 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
82962025-01-10T16:37:05.199ZINFOcrucible: ds_connection connected from Ok(127.0.0.1:40354) = io task client = 1 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
82972025-01-10T16:37:05.200ZWARNcrucible: version negotiation from state Offline = downstairs client = 1 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
82982025-01-10T16:37:05.200ZINFOcrucible: downstairs client at Some(127.0.0.1:8820) has region UUID 12345678-0000-0000-0000-000000008820 = downstairs client = 1 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
82992025-01-10T16:37:05.200ZINFOcrucible: Returning UUID:12345678-0000-0000-0000-000000008820 matches = downstairs client = 1 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
83002025-01-10T16:37:05.200ZINFOcrucible: send last flush ID to this DS: 2809 = downstairs client = 1 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
83012025-01-10T16:37:05.201ZINFOcrucible: Replied this last flush ID: 2809 = downstairs client = 1 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
83022025-01-10T16:37:05.201ZINFOcrucible: ds_transition from Offline to Active = downstairs client = 1 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
83032025-01-10T16:37:05.201ZINFOcrucible: [1] Transition from Offline to Active = downstairs client = 1 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
83042025-01-10T16:37:05.201ZINFOcrucible: [1] client re-new 302 jobs since flush 2809 = downstairs session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
83052025-01-10T16:37:05.201ZINFOcrucible: [1] Replayed 302 jobs since flush: 2809 = downstairs session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
8306 ----------------------------------------------------------------
8307 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:0
8308 Downstairs last five completed: 3111 3110 3109 3108 3107
8309 Upstairs last five completed: 3111 3110 3109 3108 3107
8310 CLIENT: Up:0 ds:0 act:3
8311 Replay: All jobs finished
8312 Main task has work to do, go find it
8313 got dsc Stop(0)
8314 stop 0
8315 Jan 10 16:37:05.449[8810] Got stop action so:false kr:false
8316 INFO request completed, latency_us: 340, response_code: 204, uri: /stop/cid/0, method: POST, req_id: a8ce2e0b-6844-4399-86fe-ddf2860cd732, remote_addr: 127.0.0.1:55917, local_addr: 127.0.0.1:9998
83172025-01-10T16:37:05.449ZWARNcrucible: downstairs disconnected = io task client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
83182025-01-10T16:37:05.449ZWARNcrucible: client task is sending Done(Finished) = io task client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
83192025-01-10T16:37:05.449ZWARNcrucible: downstairs task for 0 stopped due to Finished session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
83202025-01-10T16:37:05.449ZINFOcrucible: ds_transition from Active to Offline = downstairs client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
83212025-01-10T16:37:05.449ZINFOcrucible: [0] Transition from Active to Offline = downstairs client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
8322 Jan 10 16:37:05.449{"msg":"client task is exiting","v":0,"name":"crucible","level":30,"time":"2025-01-10T16:37:05.449808888Z","hostname":"w-01JH8H1N3KXZ9F8ZV6CCMP5KTQ","pid":1202,"":"io task","client":"0","":"downstairs","session_id":"1df3ca91-4dc9-42d6-9897-461254b5afe2"}
8323 INFO request completed, latency_us: 121, response_code: 200, uri: /state/cid/0, method: GET, req_id: 4a342298-61ef-43cf-943f-7ab5af5360db, remote_addr: 127.0.0.1:55917, local_addr: 127.0.0.1:9998
8324 [8810] Exited with: ExitStatus(unix_wait_status(9))
8325 [8810][0] reports Exit
8326 Jan 10 16:37:09.451 INFO request completed, latency_us: 316, response_code: 200, uri: /state/cid/0, method: GET, req_id: 198219df-650c-443e-b6da-08327e290a3b, remote_addr: 127.0.0.1:55917, local_addr: 127.0.0.1:9998
8327 001/300 Read block 263 len 4096
8328 002/300 Write block 3981 len 8192 data: 4 4
8329 003/300 Write block 3982 len 16384 data: 5 6 6 6
8330 004/300 Flush
8331 005/300 Flush
8332 006/300 Read block 33 len 20480
8333 007/300 Write block 1560 len 20480 data: 3 5 5 4 5
8334 008/300 Read block 3503 len 4096
8335 009/300 Write block 4598 len 4096 data: 2
8336 010/300 Read block 1826 len 20480
8337 011/300 Write block 2070 len 4096 data: 5
8338 012/300 Write block 210 len 24576 data: 4 4 4 4 4 3
8339 013/300 Read block 4533 len 40960
8340 014/300 Read block 3799 len 36864
8341 015/300 Write block 1763 len 32768 data: 5 4 3 3 2 2 2 2
8342 016/300 Read block 3762 len 40960
8343 017/300 Write block 2730 len 32768 data: 3 3 3 2 2 2 2 2
8344 018/300 Write block 78 len 28672 data: 4 3 3 3 3 3 2
8345 019/300 Read block 2150 len 12288
8346 020/300 Write block 2886 len 4096 data: 4
8347 021/300 Write block 4084 len 8192 data: 3 3
8348 022/300 Write block 6 len 16384 data: 2 2 2 3
8349 023/300 Write block 820 len 24576 data: 3 2 2 2 2 2
8350 024/300 Read block 575 len 12288
8351 025/300 Read block 2566 len 40960
8352 026/300 Read block 1168 len 8192
8353 027/300 Read block 3325 len 40960
8354 028/300 Write block 2438 len 16384 data: 2 4 4 4
8355 029/300 Read block 3395 len 8192
8356 030/300 Read block 586 len 4096
8357 031/300 Write block 193 len 40960 data: 3 3 3 3 3 3 3 3 3 4
8358 032/300 Read block 4850 len 28672
8359 033/300 Read block 2817 len 16384
8360 034/300 Write block 3190 len 36864 data: 2 2 3 3 3 3 4 4 3
8361 035/300 Write block 3774 len 32768 data: 3 3 3 3 4 4 4 3
8362 036/300 Write block 3395 len 4096 data: 3
8363 037/300 Read block 3882 len 4096
8364 038/300 Read block 3312 len 12288
8365 039/300 Write block 2892 len 40960 data: 3 2 2 2 2 4 4 4 4 4
8366 040/300 Read block 2879 len 8192
8367 041/300 Read block 1069 len 8192
8368 042/300 Write block 494 len 12288 data: 3 3 4
8369 043/300 Write block 3149 len 12288 data: 3 3 3
8370 044/300 Read block 1165 len 28672
8371 045/300 Write block 3783 len 16384 data: 2 2 3 3
8372 046/300 Read block 4568 len 8192
8373 047/300 Write block 2780 len 40960 data: 2 2 2 2 2 2 2 2 3 2
8374 048/300 Read block 1803 len 12288
8375 049/300 Write block 2447 len 32768 data: 3 3 4 4 2 2 2 2
8376 050/300 Write block 762 len 4096 data: 3
8377 051/300 Write block 4340 len 24576 data: 4 4 5 4 4 5
8378 052/300 Read block 3681 len 24576
8379 053/300 Write block 3200 len 16384 data: 3 2 2 2
8380 054/300 Flush
8381 055/300 Read block 4979 len 4096
8382 056/300 Write block 2832 len 4096 data: 3
8383 057/300 Read block 4714 len 28672
8384 058/300 Read block 4440 len 16384
8385 059/300 Read block 3135 len 40960
8386 060/300 Write block 2331 len 20480 data: 2 3 3 3 3
8387 061/300 Flush
8388 062/300 Write block 3460 len 40960 data: 2 2 2 2 3 3 3 3 3 2
8389 063/300 Write block 3732 len 16384 data: 4 4 4 4
8390 064/300 Read block 1693 len 40960
8391 065/300 Read block 2967 len 36864
8392 066/300 Read block 2492 len 32768
8393 067/300 Write block 3698 len 24576 data: 2 2 2 2 2 2
8394 068/300 Read block 2937 len 12288
8395 069/300 Write block 1759 len 40960 data: 3 4 4 5 6 5 4 4 3 3
8396 070/300 Write block 4239 len 36864 data: 3 3 3 3 2 2 2 2 2
8397 071/300 Read block 527 len 32768
8398 072/300 Read block 3737 len 24576
8399 073/300 Flush
8400 074/300 Flush
8401 075/300 Write block 3983 len 40960 data: 7 7 7 6 6 7 6 5 5 4
8402 076/300 Read block 1953 len 20480
8403 077/300 Read block 3127 len 16384
8404 078/300 Read block 1133 len 8192
8405 079/300 Flush
8406 080/300 Write block 1787 len 20480 data: 3 3 3 3 3
8407 081/300 Write block 1784 len 8192 data: 4 4
8408 082/300 Read block 626 len 4096
8409 083/300 Read block 2971 len 28672
8410 084/300 Read block 105 len 40960
8411 085/300 Read block 4314 len 8192
8412 086/300 Write block 597 len 20480 data: 2 3 4 4 4
8413 087/300 Write block 1189 len 20480 data: 2 2 3 2 2
8414 088/300 Read block 2824 len 40960
8415 089/300 Write block 4945 len 12288 data: 3 3 3
8416 090/300 Read block 728 len 16384
8417 091/300 Read block 3915 len 32768
8418 092/300 Read block 2893 len 36864
8419 093/300 Read block 713 len 24576
8420 094/300 Read block 2672 len 36864
8421 095/300 Flush
8422 096/300 Read block 140 len 8192
8423 097/300 Read block 4243 len 4096
8424 098/300 Write block 1803 len 16384 data: 2 2 2 2
8425 099/300 Write block 1557 len 4096 data: 4
8426 100/300 Read block 3439 len 24576
8427 101/300 Read block 720 len 28672
8428 102/300 Write block 4576 len 16384 data: 4 4 3 4
8429 103/300 Write block 1279 len 4096 data: 3
8430 104/300 Flush
8431 105/300 Read block 1852 len 20480
8432 106/300 Read block 790 len 8192
8433 107/300 Flush
8434 108/300 Write block 1680 len 20480 data: 3 3 3 3 3
8435 109/300 Read block 3825 len 36864
8436 110/300 Read block 1595 len 40960
8437 111/300 Read block 493 len 40960
8438 112/300 Write block 634 len 12288 data: 7 7 6
8439 113/300 Read block 796 len 12288
8440 114/300 Read block 1627 len 8192
8441 115/300 Read block 1098 len 16384
8442 116/300 Read block 1655 len 16384
8443 117/300 Flush
8444 118/300 Write block 2095 len 12288 data: 2 2 2
8445 119/300 Write block 3951 len 8192 data: 2 2
8446 120/300 Write block 1453 len 28672 data: 2 2 2 2 3 3 3
8447 121/300 Write block 2061 len 16384 data: 2 3 3 3
8448 122/300 Write block 4217 len 8192 data: 3 3
8449 123/300 Read block 114 len 24576
8450 124/300 Read block 1156 len 4096
8451 125/300 Flush
8452 126/300 Read block 2243 len 40960
8453 127/300 Read block 730 len 28672
8454 128/300 Flush
8455 129/300 Write block 2307 len 32768 data: 3 3 3 4 4 4 4 4
8456 130/300 Read block 3432 len 24576
8457 131/300 Read block 3169 len 8192
8458 132/300 Read block 2426 len 8192
8459 133/300 Write block 931 len 24576 data: 5 4 4 4 2 3
8460 134/300 Read block 1231 len 20480
8461 135/300 Read block 699 len 8192
8462 136/300 Read block 1505 len 40960
8463 137/300 Read block 2855 len 20480
8464 138/300 Read block 3076 len 24576
8465 139/300 Read block 718 len 36864
8466 140/300 Read block 2757 len 32768
8467 141/300 Read block 219 len 16384
8468 142/300 Read block 2550 len 12288
8469 143/300 Read block 4530 len 36864
8470 144/300 Write block 3151 len 40960 data: 4 3 3 2 2 2 2 2 2 2
8471 145/300 Flush
8472 146/300 Read block 4731 len 32768
8473 147/300 Write block 3762 len 24576 data: 3 2 2 2 3 3
8474 148/300 Read block 1051 len 4096
8475 149/300 Flush
8476 150/300 Write block 1779 len 20480 data: 5 6 5 5 4
8477 151/300 Write block 3758 len 8192 data: 3 3
8478 152/300 Read block 1549 len 20480
8479 153/300 Flush
8480 154/300 Flush
8481 155/300 Write block 3641 len 32768 data: 3 3 3 3 3 3 2 2
8482 156/300 Write block 2157 len 16384 data: 3 3 4 4
8483 157/300 Read block 2819 len 20480
8484 158/300 Read block 495 len 4096
8485 159/300 Read block 1883 len 32768
8486 160/300 Read block 2805 len 4096
8487 161/300 Read block 3872 len 4096
8488 162/300 Write block 3723 len 12288 data: 2 2 3
8489 163/300 Read block 699 len 20480
8490 164/300 Read block 1595 len 28672
8491 165/300 Read block 2841 len 36864
8492 166/300 Write block 4703 len 16384 data: 3 3 3 3
8493 167/300 Read block 4122 len 28672
8494 168/300 Read block 3284 len 40960
8495 169/300 Flush
8496 170/300 Read block 613 len 4096
8497 171/300 Read block 2229 len 12288
8498 172/300 Write block 1335 len 16384 data: 4 4 5 5
8499 173/300 Read block 2068 len 28672
8500 174/300 Write block 237 len 40960 data: 2 2 2 2 2 2 2 2 2 2
8501 175/300 Write block 1680 len 24576 data: 4 4 4 4 4 3
8502 176/300 Read block 2045 len 32768
8503 177/300 Read block 3582 len 40960
8504 178/300 Flush
8505 179/300 Read block 2613 len 40960
8506 180/300 Write block 3943 len 24576 data: 5 5 6 5 4 4
8507 181/300 Write block 3324 len 24576 data: 2 2 2 2 2 2
8508 182/300 Read block 2465 len 28672
8509 183/300 Write block 2932 len 8192 data: 3 3
8510 184/300 Write block 3413 len 28672 data: 3 3 3 3 3 3 3
8511 185/300 Flush
8512 186/300 Write block 4530 len 24576 data: 4 5 5 4 2 2
8513 187/300 Write block 3085 len 40960 data: 2 3 3 3 4 4 3 3 3 3
8514 188/300 Read block 4446 len 24576
8515 189/300 Read block 761 len 16384
8516 190/300 Write block 2354 len 24576 data: 2 2 2 2 2 2
8517 191/300 Write block 2015 len 24576 data: 2 2 3 4 4 4
8518 192/300 Read block 2878 len 8192
8519 193/300 Read block 1367 len 8192
8520 194/300 Write block 4877 len 36864 data: 2 3 4 3 3 2 2 2 2
8521 195/300 Read block 949 len 28672
8522 196/300 Read block 2438 len 12288
8523 197/300 Write block 4413 len 4096 data: 2
8524 198/300 Read block 2099 len 20480
8525 199/300 Read block 1176 len 36864
8526 200/300 Read block 3895 len 36864
8527 201/300 Read block 2412 len 36864
8528 202/300 Write block 1480 len 28672 data: 3 3 3 3 3 4 3
8529 203/300 Flush
8530 204/300 Write block 1695 len 8192 data: 3 3
8531 205/300 Read block 2831 len 4096
8532 206/300 Write block 3164 len 32768 data: 3 3 3 3 3 3 3 3
8533 207/300 Write block 3711 len 8192 data: 5 5
8534 208/300 Write block 1277 len 28672 data: 3 3 4 3 3 3 3
8535 209/300 Flush
8536 210/300 Write block 2128 len 28672 data: 3 2 2 2 2 2 2
8537 211/300 Read block 179 len 36864
8538 212/300 Read block 1154 len 20480
8539 213/300 Read block 4533 len 4096
8540 214/300 Read block 4193 len 16384
8541 215/300 Read block 4495 len 20480
8542 216/300 Write block 732 len 8192 data: 4 4
8543 217/300 Flush
8544 218/300 Flush
8545 219/300 Write block 4733 len 36864 data: 2 3 3 3 2 2 2 2 3
8546 220/300 Write block 3596 len 24576 data: 3 3 2 2 3 2
8547 221/300 Read block 4190 len 16384
8548 222/300 Read block 1540 len 12288
8549 223/300 Read block 4500 len 16384
8550 224/300 Write block 2170 len 28672 data: 3 3 3 2 2 2 2
8551 225/300 Write block 3898 len 40960 data: 3 3 3 2 2 2 2 2 2 2
8552 226/300 Read block 4369 len 4096
8553 227/300 Write block 2802 len 40960 data: 3 3 2 2 2 3 4 4 3 3
8554 228/300 Write block 4326 len 4096 data: 3
8555 229/300 Read block 2560 len 28672
8556 230/300 Write block 2994 len 20480 data: 3 3 3 3 3
8557 231/300 Write block 1171 len 28672 data: 4 4 4 3 3 3 2
8558 232/300 Read block 211 len 20480
8559 233/300 Write block 2170 len 28672 data: 4 4 4 3 3 3 3
8560 234/300 Write block 2951 len 28672 data: 4 5 4 4 4 2 2
8561 235/300 Read block 1136 len 40960
8562 236/300 Write block 293 len 12288 data: 2 2 2
8563 237/300 Write block 1614 len 24576 data: 2 2 2 2 2 2
8564 238/300 Read block 3700 len 8192
8565 239/300 Read block 2583 len 36864
8566 240/300 Read block 2882 len 12288
8567 241/300 Read block 4046 len 20480
8568 242/300 Read block 2580 len 20480
8569 243/300 Read block 2059 len 4096
8570 244/300 Read block 3513 len 16384
8571 245/300 Read block 2634 len 16384
8572 246/300 Flush
8573 247/300 Write block 1929 len 20480 data: 3 3 3 2 2
8574 248/300 Write block 1984 len 24576 data: 3 2 2 2 2 3
8575 249/300 Write block 950 len 24576 data: 3 4 4 4 4 4
8576 250/300 Read block 3371 len 32768
8577 251/300 Write block 4942 len 20480 data: 2 2 3 4 4
8578 252/300 Flush
8579 253/300 Write block 4452 len 4096 data: 2
8580 254/300 Read block 1686 len 16384
8581 255/300 Read block 3853 len 20480
8582 256/300 Write block 673 len 40960 data: 4 4 3 3 4 3 5 6 6 6
8583 257/300 Read block 509 len 36864
8584 258/300 Flush
8585 259/300 Read block 907 len 4096
8586 260/300 Read block 948 len 32768
8587 261/300 Flush
8588 262/300 Read block 3047 len 32768
8589 263/300 Read block 2806 len 32768
8590 264/300 Write block 2034 len 40960 data: 3 3 3 3 4 3 3 3 2 2
8591 265/300 Write block 613 len 32768 data: 4 4 4 4 4 4 4 3
8592 266/300 Read block 4639 len 28672
8593 267/300 Read block 4811 len 24576
8594 268/300 Write block 574 len 20480 data: 3 3 3 2 2
8595 269/300 Read block 3145 len 4096
8596 270/300 Write block 3213 len 12288 data: 4 4 4
8597 271/300 Write block 221 len 8192 data: 3 3
8598 272/300 Read block 2297 len 4096
8599 273/300 Flush
8600 274/300 Read block 4487 len 16384
8601 275/300 Read block 1048 len 20480
8602 276/300 Read block 427 len 28672
8603 277/300 Read block 212 len 12288
8604 278/300 Read block 2339 len 24576
8605 279/300 Read block 1266 len 36864
8606 280/300 Read block 4586 len 12288
8607 281/300 Flush
8608 282/300 Read block 1224 len 16384
8609 283/300 Read block 1766 len 32768
8610 284/300 Read block 4144 len 32768
8611 285/300 Write block 4334 len 24576 data: 3 2 2 3 3 4
8612 286/300 Write block 3860 len 40960 data: 2 2 3 3 4 5 4 4 5 4
8613 287/300 Write block 2114 len 40960 data: 2 2 2 3 3 3 3 3 3 3
8614 288/300 Write block 2349 len 40960 data: 3 3 2 2 2 3 3 3 3 3
8615 289/300 Read block 922 len 12288
8616 290/300 Read block 918 len 20480
8617 291/300 Read block 635 len 12288
8618 292/300 Read block 3607 len 20480
8619 293/300 Read block 4297 len 36864
8620 294/300 Read block 449 len 28672
8621 295/300 Read block 438 len 20480
8622 296/300 Read block 899 len 24576
8623 297/300 Write block 3751 len 32768 data: 4 4 4 3 4 4 4 4
8624 298/300 Read block 3144 len 40960
8625 299/300 Read block 2257 len 4096
8626 300/300 Read block 2267 len 24576
8627 301/300 Read block 1262 len 20480
8628 Main task has work to do, go find it
8629 got dsc Start(0)
8630 start 0
8631 Jan 10 16:37:09.692 INFO request completed, latency_us: 211, response_code: 204, uri: /start/cid/0, method: POST, req_id: ab741adf-4cab-4eec-a852-50011b0e2b5f, remote_addr: 127.0.0.1:55917, local_addr: 127.0.0.1:9998
8632 Replay: started 0, returned:Ok(())
8633 ----------------------------------------------------------------
8634 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:301
8635 States: Offline Active Active
8636 JOBID ACK TYPE BKS/EXT DS:0 DS:1 DS:2 REPLAY
8637 3112 Acked Read 1 Sent Done Done false
8638 3113 Acked Write 2 Sent Done Done false
8639 3114 Acked Write 4 Sent Done Done false
8640 3115 Acked Flush 0 Sent Done Done false
8641 3116 Acked Flush 0 Sent Done Done false
8642 3117 Acked Read 5 Sent Done Done false
8643 3118 Acked Write 5 Sent Done Done false
8644 3119 Acked Read 1 Sent Done Done false
8645 3120 Acked Write 1 Sent Done Done false
8646 3121 Acked Read 5 Sent Done Done false
8647 3122 Acked Write 1 Sent Done Done false
8648 3123 Acked Write 6 Sent Done Done false
8649 3124 Acked Read 10 Sent Done Done false
8650 3125 Acked Read 9 Sent Done Done false
8651 3126 Acked Write 8 Sent Done Done false
8652 3127 Acked Read 10 Sent Done Done false
8653 3128 Acked Write 8 Sent Done Done false
8654 3129 Acked Write 7 Sent Done Done false
8655 3130 Acked Read 3 Sent Done Done false
8656 3131 Acked Write 1 Sent Done Done false
8657 3132 Acked Write 2 Sent Done Done false
8658 3133 Acked Write 4 Sent Done Done false
8659 3134 Acked Write 6 Sent Done Done false
8660 3135 Acked Read 3 Sent Done Done false
8661 3136 Acked Read 10 Sent Done Done false
8662 3137 Acked Read 2 Sent Done Done false
8663 3138 Acked Read 10 Sent Done Done false
8664 3139 Acked Write 4 Sent Done Done false
8665 3140 Acked Read 2 Sent Done Done false
8666 3141 Acked Read 1 Sent Done Done false
8667 3142 Acked Write 10 Sent Done Done false
8668 3143 Acked Read 7 Sent Done Done false
8669 3144 Acked Read 4 Sent Done Done false
8670 3145 Acked Write 9 Sent Done Done false
8671 3146 Acked Write 8 Sent Done Done false
8672 3147 Acked Write 1 Sent Done Done false
8673 3148 Acked Read 1 Sent Done Done false
8674 3149 Acked Read 3 Sent Done Done false
8675 3150 Acked Write 10 Sent Done Done false
8676 3151 Acked Read 2 Sent Done Done false
8677 3152 Acked Read 2 Sent Done Done false
8678 3153 Acked Write 3 Sent Done Done false
8679 3154 Acked Write 3 Sent Done Done false
8680 3155 Acked Read 7 Sent Done Done false
8681 3156 Acked Write 4 Sent Done Done false
8682 3157 Acked Read 2 Sent Done Done false
8683 3158 Acked Write 10 Sent Done Done false
8684 3159 Acked Read 3 Sent Done Done false
8685 3160 Acked Write 8 Sent Done Done false
8686 3161 Acked Write 1 Sent Done Done false
8687 3162 Acked Write 6 Sent Done Done false
8688 3163 Acked Read 6 Sent Done Done false
8689 3164 Acked Write 4 Sent Done Done false
8690 3165 Acked Flush 0 Sent Done Done false
8691 3166 Acked Read 1 Sent Done Done false
8692 3167 Acked Write 1 Sent Done Done false
8693 3168 Acked Read 7 Sent Done Done false
8694 3169 Acked Read 4 Sent Done Done false
8695 3170 Acked Read 10 Sent Done Done false
8696 3171 Acked Write 5 Sent Done Done false
8697 3172 Acked Flush 0 Sent Done Done false
8698 3173 Acked Write 10 Sent Done Done false
8699 3174 Acked Write 4 Sent Done Done false
8700 3175 Acked Read 10 Sent Done Done false
8701 3176 Acked Read 9 Sent Done Done false
8702 3177 Acked Read 8 Sent Done Done false
8703 3178 Acked Write 6 Sent Done Done false
8704 3179 Acked Read 3 Sent Done Done false
8705 3180 Acked Write 10 Sent Done Done false
8706 3181 Acked Write 9 Sent Done Done false
8707 3182 Acked Read 8 Sent Done Done false
8708 3183 Acked Read 6 Sent Done Done false
8709 3184 Acked Flush 0 Sent Done Done false
8710 3185 Acked Flush 0 Sent Done Done false
8711 3186 Acked Write 10 Sent Done Done false
8712 3187 Acked Read 5 Sent Done Done false
8713 3188 Acked Read 4 Sent Done Done false
8714 3189 Acked Read 2 Sent Done Done false
8715 3190 Acked Flush 0 Sent Done Done false
8716 3191 Acked Write 5 Sent Done Done false
8717 3192 Acked Write 2 Sent Done Done false
8718 3193 Acked Read 1 Sent Done Done false
8719 3194 Acked Read 7 Sent Done Done false
8720 3195 Acked Read 10 Sent Done Done false
8721 3196 Acked Read 2 Sent Done Done false
8722 3197 Acked Write 5 Sent Done Done false
8723 3198 Acked Write 5 Sent Done Done false
8724 3199 Acked Read 10 Sent Done Done false
8725 3200 Acked Write 3 Sent Done Done false
8726 3201 Acked Read 4 Sent Done Done false
8727 3202 Acked Read 8 Sent Done Done false
8728 3203 Acked Read 9 Sent Done Done false
8729 3204 Acked Read 6 Sent Done Done false
8730 3205 Acked Read 9 Sent Done Done false
8731 3206 Acked Flush 0 Sent Done Done false
8732 3207 Acked Read 2 Sent Done Done false
8733 3208 Acked Read 1 Sent Done Done false
8734 3209 Acked Write 4 Sent Done Done false
8735 3210 Acked Write 1 Sent Done Done false
8736 3211 Acked Read 6 Sent Done Done false
8737 3212 Acked Read 7 Sent Done Done false
8738 3213 Acked Write 4 Sent Done Done false
8739 3214 Acked Write 1 Sent Done Done false
8740 3215 Acked Flush 0 Sent Done Done false
8741 3216 Acked Read 5 Sent Done Done false
8742 3217 Acked Read 2 Sent Done Done false
8743 3218 Acked Flush 0 Sent Done Done false
8744 3219 Acked Write 5 Sent Done Done false
8745 3220 Acked Read 9 Sent Done Done false
8746 3221 Acked Read 10 Sent Done Done false
8747 3222 Acked Read 10 Sent Done Done false
8748 3223 Acked Write 3 Sent Done Done false
8749 3224 Acked Read 3 Sent Done Done false
8750 3225 Acked Read 2 Sent Done Done false
8751 3226 Acked Read 4 Sent Done Done false
8752 3227 Acked Read 4 Sent Done Done false
8753 3228 Acked Flush 0 Sent Done Done false
8754 3229 Acked Write 3 Sent Done Done false
8755 3230 Acked Write 2 Sent Done Done false
8756 3231 Acked Write 7 Sent Done Done false
8757 3232 Acked Write 4 Sent Done Done false
8758 3233 Acked Write 2 Sent Done Done false
8759 3234 Acked Read 6 Sent Done Done false
8760 3235 Acked Read 1 Sent Done Done false
8761 3236 Acked Flush 0 Sent Done Done false
8762 3237 Acked Read 10 Sent Done Done false
8763 3238 Acked Read 7 Sent Done Done false
8764 3239 Acked Flush 0 Sent Done Done false
8765 3240 Acked Write 8 Sent Done Done false
8766 3241 Acked Read 6 Sent Done Done false
8767 3242 Acked Read 2 Sent Done Done false
8768 3243 Acked Read 2 Sent Done Done false
8769 3244 Acked Write 6 Sent Done Done false
8770 3245 Acked Read 5 Sent Done Done false
8771 3246 Acked Read 2 Sent Done Done false
8772 3247 Acked Read 10 Sent Done Done false
8773 3248 Acked Read 5 Sent Done Done false
8774 3249 Acked Read 6 Sent Done Done false
8775 3250 Acked Read 9 Sent Done Done false
8776 3251 Acked Read 8 Sent Done Done false
8777 3252 Acked Read 4 Sent Done Done false
8778 3253 Acked Read 3 Sent Done Done false
8779 3254 Acked Read 9 Sent Done Done false
8780 3255 Acked Write 10 Sent Done Done false
8781 3256 Acked Flush 0 Sent Done Done false
8782 3257 Acked Read 8 Sent Done Done false
8783 3258 Acked Write 6 Sent Done Done false
8784 3259 Acked Read 1 Sent Done Done false
8785 3260 Acked Flush 0 Sent Done Done false
8786 3261 Acked Write 5 Sent Done Done false
8787 3262 Acked Write 2 Sent Done Done false
8788 3263 Acked Read 5 Sent Done Done false
8789 3264 Acked Flush 0 Sent Done Done false
8790 3265 Acked Flush 0 Sent Done Done false
8791 3266 Acked Write 8 Sent Done Done false
8792 3267 Acked Write 4 Sent Done Done false
8793 3268 Acked Read 5 Sent Done Done false
8794 3269 Acked Read 1 Sent Done Done false
8795 3270 Acked Read 8 Sent Done Done false
8796 3271 Acked Read 1 Sent Done Done false
8797 3272 Acked Read 1 Sent Done Done false
8798 3273 Acked Write 3 Sent Done Done false
8799 3274 Acked Read 5 Sent Done Done false
8800 3275 Acked Read 7 Sent Done Done false
8801 3276 Acked Read 9 Sent Done Done false
8802 3277 Acked Write 4 Sent Done Done false
8803 3278 Acked Read 7 Sent Done Done false
8804 3279 Acked Read 10 Sent Done Done false
8805 3280 Acked Flush 0 Sent Done Done false
8806 3281 Acked Read 1 Sent Done Done false
8807 3282 Acked Read 3 Sent Done Done false
8808 3283 Acked Write 4 Sent Done Done false
8809 3284 Acked Read 7 Sent Done Done false
8810 3285 Acked Write 10 Sent Done Done false
8811 3286 Acked Write 6 Sent Done Done false
8812 3287 Acked Read 8 Sent Done Done false
8813 3288 Acked Read 10 Sent Done Done false
8814 3289 Acked Flush 0 Sent Done Done false
8815 3290 Acked Read 10 Sent Done Done false
8816 3291 Acked Write 6 Sent Done Done false
8817 3292 Acked Write 6 Sent Done Done false
8818 3293 Acked Read 7 Sent Done Done false
8819 3294 Acked Write 2 Sent Done Done false
8820 3295 Acked Write 7 Sent Done Done false
8821 3296 Acked Flush 0 Sent Done Done false
8822 3297 Acked Write 6 Sent Done Done false
8823 3298 Acked Write 10 Sent Done Done false
8824 3299 Acked Read 6 Sent Done Done false
8825 3300 Acked Read 4 Sent Done Done false
8826 3301 Acked Write 6 Sent Done Done false
8827 3302 Acked Write 6 Sent Done Done false
8828 3303 Acked Read 2 Sent Done Done false
8829 3304 Acked Read 2 Sent Done Done false
8830 3305 Acked Write 9 Sent Done Done false
8831 3306 Acked Read 7 Sent Done Done false
8832 3307 Acked Read 3 Sent Done Done false
8833 3308 Acked Write 1 Sent Done Done false
8834 3309 Acked Read 5 Sent Done Done false
8835 3310 Acked Read 9 Sent Done Done false
8836 3311 Acked Read 9 Sent Done Done false
8837 3312 Acked Read 9 Sent Done Done false
8838 3313 Acked Write 7 Sent Done Done false
8839 3314 Acked Flush 0 Sent Done Done false
8840 3315 Acked Write 2 Sent Done Done false
8841 3316 Acked Read 1 Sent Done Done false
8842 3317 Acked Write 8 Sent Done Done false
8843 3318 Acked Write 2 Sent Done Done false
8844 3319 Acked Write 7 Sent Done Done false
8845 3320 Acked Flush 0 Sent Done Done false
8846 3321 Acked Write 7 Sent Done Done false
8847 3322 Acked Read 9 Sent Done Done false
8848 3323 Acked Read 5 Sent Done Done false
8849 3324 Acked Read 1 Sent Done Done false
8850 3325 Acked Read 4 Sent Done Done false
8851 3326 Acked Read 5 Sent Done Done false
8852 3327 Acked Write 2 Sent Done Done false
8853 3328 Acked Flush 0 Sent Done Done false
8854 3329 Acked Flush 0 Sent Done Done false
8855 3330 Acked Write 9 Sent Done Done false
8856 3331 Acked Write 6 Sent Done Done false
8857 3332 Acked Read 4 Sent Done Done false
8858 3333 Acked Read 3 Sent Done Done false
8859 3334 Acked Read 4 Sent Done Done false
8860 3335 Acked Write 7 Sent Done Done false
8861 3336 Acked Write 10 Sent Done Done false
8862 3337 Acked Read 1 Sent Done Done false
8863 3338 Acked Write 10 Sent Done Done false
8864 3339 Acked Write 1 Sent Done Done false
8865 3340 Acked Read 7 Sent Done Done false
8866 3341 Acked Write 5 Sent Done Done false
8867 3342 Acked Write 7 Sent Done Done false
8868 3343 Acked Read 5 Sent Done Done false
8869 3344 Acked Write 7 Sent Done Done false
8870 3345 Acked Write 7 Sent Done Done false
8871 3346 Acked Read 10 Sent Done Done false
8872 3347 Acked Write 3 Sent Done Done false
8873 3348 Acked Write 6 Sent Done Done false
8874 3349 Acked Read 2 Sent Done Done false
8875 3350 Acked Read 9 Sent Done Done false
8876 3351 Acked Read 3 Sent Done Done false
8877 3352 Acked Read 5 Sent Done Done false
8878 3353 Acked Read 5 Sent Done Done false
8879 3354 Acked Read 1 Sent Done Done false
8880 3355 Acked Read 4 Sent Done Done false
8881 3356 Acked Read 4 Sent Done Done false
8882 3357 Acked Flush 0 Sent Done Done false
8883 3358 Acked Write 5 Sent Done Done false
8884 3359 Acked Write 6 Sent Done Done false
8885 3360 Acked Write 6 Sent Done Done false
8886 3361 Acked Read 8 Sent Done Done false
8887 3362 Acked Write 5 Sent Done Done false
8888 3363 Acked Flush 0 Sent Done Done false
8889 3364 Acked Write 1 Sent Done Done false
8890 3365 Acked Read 4 Sent Done Done false
8891 3366 Acked Read 5 Sent Done Done false
8892 3367 Acked Write 10 Sent Done Done false
8893 3368 Acked Read 9 Sent Done Done false
8894 3369 Acked Flush 0 Sent Done Done false
8895 3370 Acked Read 1 Sent Done Done false
8896 3371 Acked Read 8 Sent Done Done false
8897 3372 Acked Flush 0 Sent Done Done false
8898 3373 Acked Read 8 Sent Done Done false
8899 3374 Acked Read 8 Sent Done Done false
8900 3375 Acked Write 10 Sent Done Done false
8901 3376 Acked Write 8 Sent Done Done false
8902 3377 Acked Read 7 Sent Done Done false
8903 3378 Acked Read 6 Sent Done Done false
8904 3379 Acked Write 5 Sent Done Done false
8905 3380 Acked Read 1 Sent Done Done false
8906 3381 Acked Write 3 Sent Done Done false
8907 3382 Acked Write 2 Sent Done Done false
8908 3383 Acked Read 1 Sent Done Done false
8909 3384 Acked Flush 0 Sent Done Done false
8910 3385 Acked Read 4 Sent Done Done false
8911 3386 Acked Read 5 Sent Done Done false
8912 3387 Acked Read 7 Sent Done Done false
8913 3388 Acked Read 3 Sent Done Done false
8914 3389 Acked Read 6 Sent Done Done false
8915 3390 Acked Read 9 Sent Done Done false
8916 3391 Acked Read 3 Sent Done Done false
8917 3392 Acked Flush 0 Sent Done Done false
8918 3393 Acked Read 4 Sent Done Done false
8919 3394 Acked Read 8 Sent Done Done false
8920 3395 Acked Read 8 Sent Done Done false
8921 3396 Acked Write 6 Sent Done Done false
8922 3397 Acked Write 10 Sent Done Done false
8923 3398 Acked Write 10 Sent Done Done false
8924 3399 Acked Write 10 Sent Done Done false
8925 3400 Acked Read 3 Sent Done Done false
8926 3401 Acked Read 5 Sent Done Done false
8927 3402 Acked Read 3 Sent Done Done false
8928 3403 Acked Read 5 Sent Done Done false
8929 3404 Acked Read 9 Sent Done Done false
8930 3405 Acked Read 7 Sent Done Done false
8931 3406 Acked Read 5 Sent Done Done false
8932 3407 Acked Read 6 Sent Done Done false
8933 3408 Acked Write 8 Sent Done Done false
8934 3409 Acked Read 10 Sent Done Done false
8935 3410 Acked Read 1 Sent Done Done false
8936 3411 Acked Read 6 Sent Done Done false
8937 3412 Acked Read 5 Sent Done Done false
8938 STATES DS:0 DS:1 DS:2 TOTAL
8939 Sent 301 0 0 301
8940 Done 0 301 301 602
8941 Skipped 0 0 0 0
8942 Error 0 0 0 0
8943 Last Flush: 3111 3392 3392
8944 Downstairs last five completed: 3111 3110 3109 3108 3107
8945 Upstairs last five completed: 3412 3411 3410 3409 3408
8946 CLIENT: Up:0 ds:301 act:2
8947 ----------------------------------------------------------------
8948 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:302
8949 States: Offline Active Active
8950 JOBID ACK TYPE BKS/EXT DS:0 DS:1 DS:2 REPLAY
8951 3112 Acked Read 1 Sent Done Done false
8952 3113 Acked Write 2 Sent Done Done false
8953 3114 Acked Write 4 Sent Done Done false
8954 3115 Acked Flush 0 Sent Done Done false
8955 3116 Acked Flush 0 Sent Done Done false
8956 3117 Acked Read 5 Sent Done Done false
8957 3118 Acked Write 5 Sent Done Done false
8958 3119 Acked Read 1 Sent Done Done false
8959 3120 Acked Write 1 Sent Done Done false
8960 3121 Acked Read 5 Sent Done Done false
8961 3122 Acked Write 1 Sent Done Done false
8962 3123 Acked Write 6 Sent Done Done false
8963 3124 Acked Read 10 Sent Done Done false
8964 3125 Acked Read 9 Sent Done Done false
8965 3126 Acked Write 8 Sent Done Done false
8966 3127 Acked Read 10 Sent Done Done false
8967 3128 Acked Write 8 Sent Done Done false
8968 3129 Acked Write 7 Sent Done Done false
8969 3130 Acked Read 3 Sent Done Done false
8970 3131 Acked Write 1 Sent Done Done false
8971 3132 Acked Write 2 Sent Done Done false
8972 3133 Acked Write 4 Sent Done Done false
8973 3134 Acked Write 6 Sent Done Done false
8974 3135 Acked Read 3 Sent Done Done false
8975 3136 Acked Read 10 Sent Done Done false
8976 3137 Acked Read 2 Sent Done Done false
8977 3138 Acked Read 10 Sent Done Done false
8978 3139 Acked Write 4 Sent Done Done false
8979 3140 Acked Read 2 Sent Done Done false
8980 3141 Acked Read 1 Sent Done Done false
8981 3142 Acked Write 10 Sent Done Done false
8982 3143 Acked Read 7 Sent Done Done false
8983 3144 Acked Read 4 Sent Done Done false
8984 3145 Acked Write 9 Sent Done Done false
8985 3146 Acked Write 8 Sent Done Done false
8986 3147 Acked Write 1 Sent Done Done false
8987 3148 Acked Read 1 Sent Done Done false
8988 3149 Acked Read 3 Sent Done Done false
8989 3150 Acked Write 10 Sent Done Done false
8990 3151 Acked Read 2 Sent Done Done false
8991 3152 Acked Read 2 Sent Done Done false
8992 3153 Acked Write 3 Sent Done Done false
8993 3154 Acked Write 3 Sent Done Done false
8994 3155 Acked Read 7 Sent Done Done false
8995 3156 Acked Write 4 Sent Done Done false
8996 3157 Acked Read 2 Sent Done Done false
8997 3158 Acked Write 10 Sent Done Done false
8998 3159 Acked Read 3 Sent Done Done false
8999 3160 Acked Write 8 Sent Done Done false
9000 3161 Acked Write 1 Sent Done Done false
9001 3162 Acked Write 6 Sent Done Done false
9002 3163 Acked Read 6 Sent Done Done false
9003 3164 Acked Write 4 Sent Done Done false
9004 3165 Acked Flush 0 Sent Done Done false
9005 3166 Acked Read 1 Sent Done Done false
9006 3167 Acked Write 1 Sent Done Done false
9007 3168 Acked Read 7 Sent Done Done false
9008 3169 Acked Read 4 Sent Done Done false
9009 3170 Acked Read 10 Sent Done Done false
9010 3171 Acked Write 5 Sent Done Done false
9011 3172 Acked Flush 0 Sent Done Done false
9012 3173 Acked Write 10 Sent Done Done false
9013 3174 Acked Write 4 Sent Done Done false
9014 3175 Acked Read 10 Sent Done Done false
9015 3176 Acked Read 9 Sent Done Done false
9016 3177 Acked Read 8 Sent Done Done false
9017 3178 Acked Write 6 Sent Done Done false
9018 3179 Acked Read 3 Sent Done Done false
9019 3180 Acked Write 10 Sent Done Done false
9020 3181 Acked Write 9 Sent Done Done false
9021 3182 Acked Read 8 Sent Done Done false
9022 3183 Acked Read 6 Sent Done Done false
9023 3184 Acked Flush 0 Sent Done Done false
9024 3185 Acked Flush 0 Sent Done Done false
9025 3186 Acked Write 10 Sent Done Done false
9026 3187 Acked Read 5 Sent Done Done false
9027 3188 Acked Read 4 Sent Done Done false
9028 3189 Acked Read 2 Sent Done Done false
9029 3190 Acked Flush 0 Sent Done Done false
9030 3191 Acked Write 5 Sent Done Done false
9031 3192 Acked Write 2 Sent Done Done false
9032 3193 Acked Read 1 Sent Done Done false
9033 3194 Acked Read 7 Sent Done Done false
9034 3195 Acked Read 10 Sent Done Done false
9035 3196 Acked Read 2 Sent Done Done false
9036 3197 Acked Write 5 Sent Done Done false
9037 3198 Acked Write 5 Sent Done Done false
9038 3199 Acked Read 10 Sent Done Done false
9039 3200 Acked Write 3 Sent Done Done false
9040 3201 Acked Read 4 Sent Done Done false
9041 3202 Acked Read 8 Sent Done Done false
9042 3203 Acked Read 9 Sent Done Done false
9043 3204 Acked Read 6 Sent Done Done false
9044 3205 Acked Read 9 Sent Done Done false
9045 3206 Acked Flush 0 Sent Done Done false
9046 3207 Acked Read 2 Sent Done Done false
9047 3208 Acked Read 1 Sent Done Done false
9048 3209 Acked Write 4 Sent Done Done false
9049 3210 Acked Write 1 Sent Done Done false
9050 3211 Acked Read 6 Sent Done Done false
9051 3212 Acked Read 7 Sent Done Done false
9052 3213 Acked Write 4 Sent Done Done false
9053 3214 Acked Write 1 Sent Done Done false
9054 3215 Acked Flush 0 Sent Done Done false
9055 3216 Acked Read 5 Sent Done Done false
9056 3217 Acked Read 2 Sent Done Done false
9057 3218 Acked Flush 0 Sent Done Done false
9058 3219 Acked Write 5 Sent Done Done false
9059 3220 Acked Read 9 Sent Done Done false
9060 3221 Acked Read 10 Sent Done Done false
9061 3222 Acked Read 10 Sent Done Done false
9062 3223 Acked Write 3 Sent Done Done false
9063 3224 Acked Read 3 Sent Done Done false
9064 3225 Acked Read 2 Sent Done Done false
9065 3226 Acked Read 4 Sent Done Done false
9066 3227 Acked Read 4 Sent Done Done false
9067 3228 Acked Flush 0 Sent Done Done false
9068 3229 Acked Write 3 Sent Done Done false
9069 3230 Acked Write 2 Sent Done Done false
9070 3231 Acked Write 7 Sent Done Done false
9071 3232 Acked Write 4 Sent Done Done false
9072 3233 Acked Write 2 Sent Done Done false
9073 3234 Acked Read 6 Sent Done Done false
9074 3235 Acked Read 1 Sent Done Done false
9075 3236 Acked Flush 0 Sent Done Done false
9076 3237 Acked Read 10 Sent Done Done false
9077 3238 Acked Read 7 Sent Done Done false
9078 3239 Acked Flush 0 Sent Done Done false
9079 3240 Acked Write 8 Sent Done Done false
9080 3241 Acked Read 6 Sent Done Done false
9081 3242 Acked Read 2 Sent Done Done false
9082 3243 Acked Read 2 Sent Done Done false
9083 3244 Acked Write 6 Sent Done Done false
9084 3245 Acked Read 5 Sent Done Done false
9085 3246 Acked Read 2 Sent Done Done false
9086 3247 Acked Read 10 Sent Done Done false
9087 3248 Acked Read 5 Sent Done Done false
9088 3249 Acked Read 6 Sent Done Done false
9089 3250 Acked Read 9 Sent Done Done false
9090 3251 Acked Read 8 Sent Done Done false
9091 3252 Acked Read 4 Sent Done Done false
9092 3253 Acked Read 3 Sent Done Done false
9093 3254 Acked Read 9 Sent Done Done false
9094 3255 Acked Write 10 Sent Done Done false
9095 3256 Acked Flush 0 Sent Done Done false
9096 3257 Acked Read 8 Sent Done Done false
9097 3258 Acked Write 6 Sent Done Done false
9098 3259 Acked Read 1 Sent Done Done false
9099 3260 Acked Flush 0 Sent Done Done false
9100 3261 Acked Write 5 Sent Done Done false
9101 3262 Acked Write 2 Sent Done Done false
9102 3263 Acked Read 5 Sent Done Done false
9103 3264 Acked Flush 0 Sent Done Done false
9104 3265 Acked Flush 0 Sent Done Done false
9105 3266 Acked Write 8 Sent Done Done false
9106 3267 Acked Write 4 Sent Done Done false
9107 3268 Acked Read 5 Sent Done Done false
9108 3269 Acked Read 1 Sent Done Done false
9109 3270 Acked Read 8 Sent Done Done false
9110 3271 Acked Read 1 Sent Done Done false
9111 3272 Acked Read 1 Sent Done Done false
9112 3273 Acked Write 3 Sent Done Done false
9113 3274 Acked Read 5 Sent Done Done false
9114 3275 Acked Read 7 Sent Done Done false
9115 3276 Acked Read 9 Sent Done Done false
9116 3277 Acked Write 4 Sent Done Done false
9117 3278 Acked Read 7 Sent Done Done false
9118 3279 Acked Read 10 Sent Done Done false
9119 3280 Acked Flush 0 Sent Done Done false
9120 3281 Acked Read 1 Sent Done Done false
9121 3282 Acked Read 3 Sent Done Done false
9122 3283 Acked Write 4 Sent Done Done false
9123 3284 Acked Read 7 Sent Done Done false
9124 3285 Acked Write 10 Sent Done Done false
9125 3286 Acked Write 6 Sent Done Done false
9126 3287 Acked Read 8 Sent Done Done false
9127 3288 Acked Read 10 Sent Done Done false
9128 3289 Acked Flush 0 Sent Done Done false
9129 3290 Acked Read 10 Sent Done Done false
9130 3291 Acked Write 6 Sent Done Done false
9131 3292 Acked Write 6 Sent Done Done false
9132 3293 Acked Read 7 Sent Done Done false
9133 3294 Acked Write 2 Sent Done Done false
9134 3295 Acked Write 7 Sent Done Done false
9135 3296 Acked Flush 0 Sent Done Done false
9136 3297 Acked Write 6 Sent Done Done false
9137 3298 Acked Write 10 Sent Done Done false
9138 3299 Acked Read 6 Sent Done Done false
9139 3300 Acked Read 4 Sent Done Done false
9140 3301 Acked Write 6 Sent Done Done false
9141 3302 Acked Write 6 Sent Done Done false
9142 3303 Acked Read 2 Sent Done Done false
9143 3304 Acked Read 2 Sent Done Done false
9144 3305 Acked Write 9 Sent Done Done false
9145 3306 Acked Read 7 Sent Done Done false
9146 3307 Acked Read 3 Sent Done Done false
9147 3308 Acked Write 1 Sent Done Done false
9148 3309 Acked Read 5 Sent Done Done false
9149 3310 Acked Read 9 Sent Done Done false
9150 3311 Acked Read 9 Sent Done Done false
9151 3312 Acked Read 9 Sent Done Done false
9152 3313 Acked Write 7 Sent Done Done false
9153 3314 Acked Flush 0 Sent Done Done false
9154 3315 Acked Write 2 Sent Done Done false
9155 3316 Acked Read 1 Sent Done Done false
9156 3317 Acked Write 8 Sent Done Done false
9157 3318 Acked Write 2 Sent Done Done false
9158 3319 Acked Write 7 Sent Done Done false
9159 3320 Acked Flush 0 Sent Done Done false
9160 3321 Acked Write 7 Sent Done Done false
9161 3322 Acked Read 9 Sent Done Done false
9162 3323 Acked Read 5 Sent Done Done false
9163 3324 Acked Read 1 Sent Done Done false
9164 3325 Acked Read 4 Sent Done Done false
9165 3326 Acked Read 5 Sent Done Done false
9166 3327 Acked Write 2 Sent Done Done false
9167 3328 Acked Flush 0 Sent Done Done false
9168 3329 Acked Flush 0 Sent Done Done false
9169 3330 Acked Write 9 Sent Done Done false
9170 3331 Acked Write 6 Sent Done Done false
9171 3332 Acked Read 4 Sent Done Done false
9172 3333 Acked Read 3 Sent Done Done false
9173 3334 Acked Read 4 Sent Done Done false
9174 3335 Acked Write 7 Sent Done Done false
9175 3336 Acked Write 10 Sent Done Done false
9176 3337 Acked Read 1 Sent Done Done false
9177 3338 Acked Write 10 Sent Done Done false
9178 3339 Acked Write 1 Sent Done Done false
9179 3340 Acked Read 7 Sent Done Done false
9180 3341 Acked Write 5 Sent Done Done false
9181 3342 Acked Write 7 Sent Done Done false
9182 3343 Acked Read 5 Sent Done Done false
9183 3344 Acked Write 7 Sent Done Done false
9184 3345 Acked Write 7 Sent Done Done false
9185 3346 Acked Read 10 Sent Done Done false
9186 3347 Acked Write 3 Sent Done Done false
9187 3348 Acked Write 6 Sent Done Done false
9188 3349 Acked Read 2 Sent Done Done false
9189 3350 Acked Read 9 Sent Done Done false
9190 3351 Acked Read 3 Sent Done Done false
9191 3352 Acked Read 5 Sent Done Done false
9192 3353 Acked Read 5 Sent Done Done false
9193 3354 Acked Read 1 Sent Done Done false
9194 3355 Acked Read 4 Sent Done Done false
9195 3356 Acked Read 4 Sent Done Done false
9196 3357 Acked Flush 0 Sent Done Done false
9197 3358 Acked Write 5 Sent Done Done false
9198 3359 Acked Write 6 Sent Done Done false
9199 3360 Acked Write 6 Sent Done Done false
9200 3361 Acked Read 8 Sent Done Done false
9201 3362 Acked Write 5 Sent Done Done false
9202 3363 Acked Flush 0 Sent Done Done false
9203 3364 Acked Write 1 Sent Done Done false
9204 3365 Acked Read 4 Sent Done Done false
9205 3366 Acked Read 5 Sent Done Done false
9206 3367 Acked Write 10 Sent Done Done false
9207 3368 Acked Read 9 Sent Done Done false
9208 3369 Acked Flush 0 Sent Done Done false
9209 3370 Acked Read 1 Sent Done Done false
9210 3371 Acked Read 8 Sent Done Done false
9211 3372 Acked Flush 0 Sent Done Done false
9212 3373 Acked Read 8 Sent Done Done false
9213 3374 Acked Read 8 Sent Done Done false
9214 3375 Acked Write 10 Sent Done Done false
9215 3376 Acked Write 8 Sent Done Done false
9216 3377 Acked Read 7 Sent Done Done false
9217 3378 Acked Read 6 Sent Done Done false
9218 3379 Acked Write 5 Sent Done Done false
9219 3380 Acked Read 1 Sent Done Done false
9220 3381 Acked Write 3 Sent Done Done false
9221 3382 Acked Write 2 Sent Done Done false
9222 3383 Acked Read 1 Sent Done Done false
9223 3384 Acked Flush 0 Sent Done Done false
9224 3385 Acked Read 4 Sent Done Done false
9225 3386 Acked Read 5 Sent Done Done false
9226 3387 Acked Read 7 Sent Done Done false
9227 3388 Acked Read 3 Sent Done Done false
9228 3389 Acked Read 6 Sent Done Done false
9229 3390 Acked Read 9 Sent Done Done false
9230 3391 Acked Read 3 Sent Done Done false
9231 3392 Acked Flush 0 Sent Done Done false
9232 3393 Acked Read 4 Sent Done Done false
9233 3394 Acked Read 8 Sent Done Done false
9234 3395 Acked Read 8 Sent Done Done false
9235 3396 Acked Write 6 Sent Done Done false
9236 3397 Acked Write 10 Sent Done Done false
9237 3398 Acked Write 10 Sent Done Done false
9238 3399 Acked Write 10 Sent Done Done false
9239 3400 Acked Read 3 Sent Done Done false
9240 3401 Acked Read 5 Sent Done Done false
9241 3402 Acked Read 3 Sent Done Done false
9242 3403 Acked Read 5 Sent Done Done false
9243 3404 Acked Read 9 Sent Done Done false
9244 3405 Acked Read 7 Sent Done Done false
9245 3406 Acked Read 5 Sent Done Done false
9246 3407 Acked Read 6 Sent Done Done false
9247 3408 Acked Write 8 Sent Done Done false
9248 3409 Acked Read 10 Sent Done Done false
9249 3410 Acked Read 1 Sent Done Done false
9250 3411 Acked Read 6 Sent Done Done false
9251 3412 Acked Read 5 Sent Done Done false
9252 3413 Acked Flush 0 Sent Done Done false
9253 STATES DS:0 DS:1 DS:2 TOTAL
9254 Sent 302 0 0 302
9255 Done 0 302 302 604
9256 Skipped 0 0 0 0
9257 Error 0 0 0 0
9258 Last Flush: 3111 3413 3413
9259 Downstairs last five completed: 3111 3110 3109 3108 3107
9260 Upstairs last five completed: 3413 3412 3411 3410 3409
9261 CLIENT: Up:0 ds:302 act:2
92622025-01-10T16:37:15.450ZINFOcrucible: connecting to 127.0.0.1:8810 = io task client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
92632025-01-10T16:37:15.451ZWARNcrucible: ds_connection connect to 127.0.0.1:8810 failure: Os { code: 146, kind: ConnectionRefused, message: "Connection refused" } = io task client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
92642025-01-10T16:37:15.451ZWARNcrucible: client task is sending Done(ConnectionFailed(Os { code: 146, kind: ConnectionRefused, message: "Connection refused" })) = io task client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
92652025-01-10T16:37:15.451ZWARNcrucible: downstairs task for 0 stopped due to ConnectionFailed(Os { code: 146, kind: ConnectionRefused, message: "Connection refused" }) session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
92662025-01-10T16:37:15.451ZINFOcrucible: client task is exiting = io task client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
9267 [8810] got start action
9268 [8810] I am going to restart
9269 Starting downstairs at port 8810
9270 Make output file at "/tmp/dsc/downstairs-8810.txt"
9271 [8810][0] reports Starting
9272 Downstairs /var/tmp/dsc/region/8810 port 8810 PID:Some(1210)
9273 [8810][0] reports Running
9274 ----------------------------------------------------------------
9275 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:302
9276 States: Offline Active Active
9277 JOBID ACK TYPE BKS/EXT DS:0 DS:1 DS:2 REPLAY
9278 3112 Acked Read 1 Sent Done Done false
9279 3113 Acked Write 2 Sent Done Done false
9280 3114 Acked Write 4 Sent Done Done false
9281 3115 Acked Flush 0 Sent Done Done false
9282 3116 Acked Flush 0 Sent Done Done false
9283 3117 Acked Read 5 Sent Done Done false
9284 3118 Acked Write 5 Sent Done Done false
9285 3119 Acked Read 1 Sent Done Done false
9286 3120 Acked Write 1 Sent Done Done false
9287 3121 Acked Read 5 Sent Done Done false
9288 3122 Acked Write 1 Sent Done Done false
9289 3123 Acked Write 6 Sent Done Done false
9290 3124 Acked Read 10 Sent Done Done false
9291 3125 Acked Read 9 Sent Done Done false
9292 3126 Acked Write 8 Sent Done Done false
9293 3127 Acked Read 10 Sent Done Done false
9294 3128 Acked Write 8 Sent Done Done false
9295 3129 Acked Write 7 Sent Done Done false
9296 3130 Acked Read 3 Sent Done Done false
9297 3131 Acked Write 1 Sent Done Done false
9298 3132 Acked Write 2 Sent Done Done false
9299 3133 Acked Write 4 Sent Done Done false
9300 3134 Acked Write 6 Sent Done Done false
9301 3135 Acked Read 3 Sent Done Done false
9302 3136 Acked Read 10 Sent Done Done false
9303 3137 Acked Read 2 Sent Done Done false
9304 3138 Acked Read 10 Sent Done Done false
9305 3139 Acked Write 4 Sent Done Done false
9306 3140 Acked Read 2 Sent Done Done false
9307 3141 Acked Read 1 Sent Done Done false
9308 3142 Acked Write 10 Sent Done Done false
9309 3143 Acked Read 7 Sent Done Done false
9310 3144 Acked Read 4 Sent Done Done false
9311 3145 Acked Write 9 Sent Done Done false
9312 3146 Acked Write 8 Sent Done Done false
9313 3147 Acked Write 1 Sent Done Done false
9314 3148 Acked Read 1 Sent Done Done false
9315 3149 Acked Read 3 Sent Done Done false
9316 3150 Acked Write 10 Sent Done Done false
9317 3151 Acked Read 2 Sent Done Done false
9318 3152 Acked Read 2 Sent Done Done false
9319 3153 Acked Write 3 Sent Done Done false
9320 3154 Acked Write 3 Sent Done Done false
9321 3155 Acked Read 7 Sent Done Done false
9322 3156 Acked Write 4 Sent Done Done false
9323 3157 Acked Read 2 Sent Done Done false
9324 3158 Acked Write 10 Sent Done Done false
9325 3159 Acked Read 3 Sent Done Done false
9326 3160 Acked Write 8 Sent Done Done false
9327 3161 Acked Write 1 Sent Done Done false
9328 3162 Acked Write 6 Sent Done Done false
9329 3163 Acked Read 6 Sent Done Done false
9330 3164 Acked Write 4 Sent Done Done false
9331 3165 Acked Flush 0 Sent Done Done false
9332 3166 Acked Read 1 Sent Done Done false
9333 3167 Acked Write 1 Sent Done Done false
9334 3168 Acked Read 7 Sent Done Done false
9335 3169 Acked Read 4 Sent Done Done false
9336 3170 Acked Read 10 Sent Done Done false
9337 3171 Acked Write 5 Sent Done Done false
9338 3172 Acked Flush 0 Sent Done Done false
9339 3173 Acked Write 10 Sent Done Done false
9340 3174 Acked Write 4 Sent Done Done false
9341 3175 Acked Read 10 Sent Done Done false
9342 3176 Acked Read 9 Sent Done Done false
9343 3177 Acked Read 8 Sent Done Done false
9344 3178 Acked Write 6 Sent Done Done false
9345 3179 Acked Read 3 Sent Done Done false
9346 3180 Acked Write 10 Sent Done Done false
9347 3181 Acked Write 9 Sent Done Done false
9348 3182 Acked Read 8 Sent Done Done false
9349 3183 Acked Read 6 Sent Done Done false
9350 3184 Acked Flush 0 Sent Done Done false
9351 3185 Acked Flush 0 Sent Done Done false
9352 3186 Acked Write 10 Sent Done Done false
9353 3187 Acked Read 5 Sent Done Done false
9354 3188 Acked Read 4 Sent Done Done false
9355 3189 Acked Read 2 Sent Done Done false
9356 3190 Acked Flush 0 Sent Done Done false
9357 3191 Acked Write 5 Sent Done Done false
9358 3192 Acked Write 2 Sent Done Done false
9359 3193 Acked Read 1 Sent Done Done false
9360 3194 Acked Read 7 Sent Done Done false
9361 3195 Acked Read 10 Sent Done Done false
9362 3196 Acked Read 2 Sent Done Done false
9363 3197 Acked Write 5 Sent Done Done false
9364 3198 Acked Write 5 Sent Done Done false
9365 3199 Acked Read 10 Sent Done Done false
9366 3200 Acked Write 3 Sent Done Done false
9367 3201 Acked Read 4 Sent Done Done false
9368 3202 Acked Read 8 Sent Done Done false
9369 3203 Acked Read 9 Sent Done Done false
9370 3204 Acked Read 6 Sent Done Done false
9371 3205 Acked Read 9 Sent Done Done false
9372 3206 Acked Flush 0 Sent Done Done false
9373 3207 Acked Read 2 Sent Done Done false
9374 3208 Acked Read 1 Sent Done Done false
9375 3209 Acked Write 4 Sent Done Done false
9376 3210 Acked Write 1 Sent Done Done false
9377 3211 Acked Read 6 Sent Done Done false
9378 3212 Acked Read 7 Sent Done Done false
9379 3213 Acked Write 4 Sent Done Done false
9380 3214 Acked Write 1 Sent Done Done false
9381 3215 Acked Flush 0 Sent Done Done false
9382 3216 Acked Read 5 Sent Done Done false
9383 3217 Acked Read 2 Sent Done Done false
9384 3218 Acked Flush 0 Sent Done Done false
9385 3219 Acked Write 5 Sent Done Done false
9386 3220 Acked Read 9 Sent Done Done false
9387 3221 Acked Read 10 Sent Done Done false
9388 3222 Acked Read 10 Sent Done Done false
9389 3223 Acked Write 3 Sent Done Done false
9390 3224 Acked Read 3 Sent Done Done false
9391 3225 Acked Read 2 Sent Done Done false
9392 3226 Acked Read 4 Sent Done Done false
9393 3227 Acked Read 4 Sent Done Done false
9394 3228 Acked Flush 0 Sent Done Done false
9395 3229 Acked Write 3 Sent Done Done false
9396 3230 Acked Write 2 Sent Done Done false
9397 3231 Acked Write 7 Sent Done Done false
9398 3232 Acked Write 4 Sent Done Done false
9399 3233 Acked Write 2 Sent Done Done false
9400 3234 Acked Read 6 Sent Done Done false
9401 3235 Acked Read 1 Sent Done Done false
9402 3236 Acked Flush 0 Sent Done Done false
9403 3237 Acked Read 10 Sent Done Done false
9404 3238 Acked Read 7 Sent Done Done false
9405 3239 Acked Flush 0 Sent Done Done false
9406 3240 Acked Write 8 Sent Done Done false
9407 3241 Acked Read 6 Sent Done Done false
9408 3242 Acked Read 2 Sent Done Done false
9409 3243 Acked Read 2 Sent Done Done false
9410 3244 Acked Write 6 Sent Done Done false
9411 3245 Acked Read 5 Sent Done Done false
9412 3246 Acked Read 2 Sent Done Done false
9413 3247 Acked Read 10 Sent Done Done false
9414 3248 Acked Read 5 Sent Done Done false
9415 3249 Acked Read 6 Sent Done Done false
9416 3250 Acked Read 9 Sent Done Done false
9417 3251 Acked Read 8 Sent Done Done false
9418 3252 Acked Read 4 Sent Done Done false
9419 3253 Acked Read 3 Sent Done Done false
9420 3254 Acked Read 9 Sent Done Done false
9421 3255 Acked Write 10 Sent Done Done false
9422 3256 Acked Flush 0 Sent Done Done false
9423 3257 Acked Read 8 Sent Done Done false
9424 3258 Acked Write 6 Sent Done Done false
9425 3259 Acked Read 1 Sent Done Done false
9426 3260 Acked Flush 0 Sent Done Done false
9427 3261 Acked Write 5 Sent Done Done false
9428 3262 Acked Write 2 Sent Done Done false
9429 3263 Acked Read 5 Sent Done Done false
9430 3264 Acked Flush 0 Sent Done Done false
9431 3265 Acked Flush 0 Sent Done Done false
9432 3266 Acked Write 8 Sent Done Done false
9433 3267 Acked Write 4 Sent Done Done false
9434 3268 Acked Read 5 Sent Done Done false
9435 3269 Acked Read 1 Sent Done Done false
9436 3270 Acked Read 8 Sent Done Done false
9437 3271 Acked Read 1 Sent Done Done false
9438 3272 Acked Read 1 Sent Done Done false
9439 3273 Acked Write 3 Sent Done Done false
9440 3274 Acked Read 5 Sent Done Done false
9441 3275 Acked Read 7 Sent Done Done false
9442 3276 Acked Read 9 Sent Done Done false
9443 3277 Acked Write 4 Sent Done Done false
9444 3278 Acked Read 7 Sent Done Done false
9445 3279 Acked Read 10 Sent Done Done false
9446 3280 Acked Flush 0 Sent Done Done false
9447 3281 Acked Read 1 Sent Done Done false
9448 3282 Acked Read 3 Sent Done Done false
9449 3283 Acked Write 4 Sent Done Done false
9450 3284 Acked Read 7 Sent Done Done false
9451 3285 Acked Write 10 Sent Done Done false
9452 3286 Acked Write 6 Sent Done Done false
9453 3287 Acked Read 8 Sent Done Done false
9454 3288 Acked Read 10 Sent Done Done false
9455 3289 Acked Flush 0 Sent Done Done false
9456 3290 Acked Read 10 Sent Done Done false
9457 3291 Acked Write 6 Sent Done Done false
9458 3292 Acked Write 6 Sent Done Done false
9459 3293 Acked Read 7 Sent Done Done false
9460 3294 Acked Write 2 Sent Done Done false
9461 3295 Acked Write 7 Sent Done Done false
9462 3296 Acked Flush 0 Sent Done Done false
9463 3297 Acked Write 6 Sent Done Done false
9464 3298 Acked Write 10 Sent Done Done false
9465 3299 Acked Read 6 Sent Done Done false
9466 3300 Acked Read 4 Sent Done Done false
9467 3301 Acked Write 6 Sent Done Done false
9468 3302 Acked Write 6 Sent Done Done false
9469 3303 Acked Read 2 Sent Done Done false
9470 3304 Acked Read 2 Sent Done Done false
9471 3305 Acked Write 9 Sent Done Done false
9472 3306 Acked Read 7 Sent Done Done false
9473 3307 Acked Read 3 Sent Done Done false
9474 3308 Acked Write 1 Sent Done Done false
9475 3309 Acked Read 5 Sent Done Done false
9476 3310 Acked Read 9 Sent Done Done false
9477 3311 Acked Read 9 Sent Done Done false
9478 3312 Acked Read 9 Sent Done Done false
9479 3313 Acked Write 7 Sent Done Done false
9480 3314 Acked Flush 0 Sent Done Done false
9481 3315 Acked Write 2 Sent Done Done false
9482 3316 Acked Read 1 Sent Done Done false
9483 3317 Acked Write 8 Sent Done Done false
9484 3318 Acked Write 2 Sent Done Done false
9485 3319 Acked Write 7 Sent Done Done false
9486 3320 Acked Flush 0 Sent Done Done false
9487 3321 Acked Write 7 Sent Done Done false
9488 3322 Acked Read 9 Sent Done Done false
9489 3323 Acked Read 5 Sent Done Done false
9490 3324 Acked Read 1 Sent Done Done false
9491 3325 Acked Read 4 Sent Done Done false
9492 3326 Acked Read 5 Sent Done Done false
9493 3327 Acked Write 2 Sent Done Done false
9494 3328 Acked Flush 0 Sent Done Done false
9495 3329 Acked Flush 0 Sent Done Done false
9496 3330 Acked Write 9 Sent Done Done false
9497 3331 Acked Write 6 Sent Done Done false
9498 3332 Acked Read 4 Sent Done Done false
9499 3333 Acked Read 3 Sent Done Done false
9500 3334 Acked Read 4 Sent Done Done false
9501 3335 Acked Write 7 Sent Done Done false
9502 3336 Acked Write 10 Sent Done Done false
9503 3337 Acked Read 1 Sent Done Done false
9504 3338 Acked Write 10 Sent Done Done false
9505 3339 Acked Write 1 Sent Done Done false
9506 3340 Acked Read 7 Sent Done Done false
9507 3341 Acked Write 5 Sent Done Done false
9508 3342 Acked Write 7 Sent Done Done false
9509 3343 Acked Read 5 Sent Done Done false
9510 3344 Acked Write 7 Sent Done Done false
9511 3345 Acked Write 7 Sent Done Done false
9512 3346 Acked Read 10 Sent Done Done false
9513 3347 Acked Write 3 Sent Done Done false
9514 3348 Acked Write 6 Sent Done Done false
9515 3349 Acked Read 2 Sent Done Done false
9516 3350 Acked Read 9 Sent Done Done false
9517 3351 Acked Read 3 Sent Done Done false
9518 3352 Acked Read 5 Sent Done Done false
9519 3353 Acked Read 5 Sent Done Done false
9520 3354 Acked Read 1 Sent Done Done false
9521 3355 Acked Read 4 Sent Done Done false
9522 3356 Acked Read 4 Sent Done Done false
9523 3357 Acked Flush 0 Sent Done Done false
9524 3358 Acked Write 5 Sent Done Done false
9525 3359 Acked Write 6 Sent Done Done false
9526 3360 Acked Write 6 Sent Done Done false
9527 3361 Acked Read 8 Sent Done Done false
9528 3362 Acked Write 5 Sent Done Done false
9529 3363 Acked Flush 0 Sent Done Done false
9530 3364 Acked Write 1 Sent Done Done false
9531 3365 Acked Read 4 Sent Done Done false
9532 3366 Acked Read 5 Sent Done Done false
9533 3367 Acked Write 10 Sent Done Done false
9534 3368 Acked Read 9 Sent Done Done false
9535 3369 Acked Flush 0 Sent Done Done false
9536 3370 Acked Read 1 Sent Done Done false
9537 3371 Acked Read 8 Sent Done Done false
9538 3372 Acked Flush 0 Sent Done Done false
9539 3373 Acked Read 8 Sent Done Done false
9540 3374 Acked Read 8 Sent Done Done false
9541 3375 Acked Write 10 Sent Done Done false
9542 3376 Acked Write 8 Sent Done Done false
9543 3377 Acked Read 7 Sent Done Done false
9544 3378 Acked Read 6 Sent Done Done false
9545 3379 Acked Write 5 Sent Done Done false
9546 3380 Acked Read 1 Sent Done Done false
9547 3381 Acked Write 3 Sent Done Done false
9548 3382 Acked Write 2 Sent Done Done false
9549 3383 Acked Read 1 Sent Done Done false
9550 3384 Acked Flush 0 Sent Done Done false
9551 3385 Acked Read 4 Sent Done Done false
9552 3386 Acked Read 5 Sent Done Done false
9553 3387 Acked Read 7 Sent Done Done false
9554 3388 Acked Read 3 Sent Done Done false
9555 3389 Acked Read 6 Sent Done Done false
9556 3390 Acked Read 9 Sent Done Done false
9557 3391 Acked Read 3 Sent Done Done false
9558 3392 Acked Flush 0 Sent Done Done false
9559 3393 Acked Read 4 Sent Done Done false
9560 3394 Acked Read 8 Sent Done Done false
9561 3395 Acked Read 8 Sent Done Done false
9562 3396 Acked Write 6 Sent Done Done false
9563 3397 Acked Write 10 Sent Done Done false
9564 3398 Acked Write 10 Sent Done Done false
9565 3399 Acked Write 10 Sent Done Done false
9566 3400 Acked Read 3 Sent Done Done false
9567 3401 Acked Read 5 Sent Done Done false
9568 3402 Acked Read 3 Sent Done Done false
9569 3403 Acked Read 5 Sent Done Done false
9570 3404 Acked Read 9 Sent Done Done false
9571 3405 Acked Read 7 Sent Done Done false
9572 3406 Acked Read 5 Sent Done Done false
9573 3407 Acked Read 6 Sent Done Done false
9574 3408 Acked Write 8 Sent Done Done false
9575 3409 Acked Read 10 Sent Done Done false
9576 3410 Acked Read 1 Sent Done Done false
9577 3411 Acked Read 6 Sent Done Done false
9578 3412 Acked Read 5 Sent Done Done false
9579 3413 Acked Flush 0 Sent Done Done false
9580 STATES DS:0 DS:1 DS:2 TOTAL
9581 Sent 302 0 0 302
9582 Done 0 302 302 604
9583 Skipped 0 0 0 0
9584 Error 0 0 0 0
9585 Last Flush: 3111 3413 3413
9586 Downstairs last five completed: 3111 3110 3109 3108 3107
9587 Upstairs last five completed: 3413 3412 3411 3410 3409
9588 CLIENT: Up:0 ds:302 act:2
9589 ----------------------------------------------------------------
9590 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:302
9591 States: Offline Active Active
9592 JOBID ACK TYPE BKS/EXT DS:0 DS:1 DS:2 REPLAY
9593 3112 Acked Read 1 Sent Done Done false
9594 3113 Acked Write 2 Sent Done Done false
9595 3114 Acked Write 4 Sent Done Done false
9596 3115 Acked Flush 0 Sent Done Done false
9597 3116 Acked Flush 0 Sent Done Done false
9598 3117 Acked Read 5 Sent Done Done false
9599 3118 Acked Write 5 Sent Done Done false
9600 3119 Acked Read 1 Sent Done Done false
9601 3120 Acked Write 1 Sent Done Done false
9602 3121 Acked Read 5 Sent Done Done false
9603 3122 Acked Write 1 Sent Done Done false
9604 3123 Acked Write 6 Sent Done Done false
9605 3124 Acked Read 10 Sent Done Done false
9606 3125 Acked Read 9 Sent Done Done false
9607 3126 Acked Write 8 Sent Done Done false
9608 3127 Acked Read 10 Sent Done Done false
9609 3128 Acked Write 8 Sent Done Done false
9610 3129 Acked Write 7 Sent Done Done false
9611 3130 Acked Read 3 Sent Done Done false
9612 3131 Acked Write 1 Sent Done Done false
9613 3132 Acked Write 2 Sent Done Done false
9614 3133 Acked Write 4 Sent Done Done false
9615 3134 Acked Write 6 Sent Done Done false
9616 3135 Acked Read 3 Sent Done Done false
9617 3136 Acked Read 10 Sent Done Done false
9618 3137 Acked Read 2 Sent Done Done false
9619 3138 Acked Read 10 Sent Done Done false
9620 3139 Acked Write 4 Sent Done Done false
9621 3140 Acked Read 2 Sent Done Done false
9622 3141 Acked Read 1 Sent Done Done false
9623 3142 Acked Write 10 Sent Done Done false
9624 3143 Acked Read 7 Sent Done Done false
9625 3144 Acked Read 4 Sent Done Done false
9626 3145 Acked Write 9 Sent Done Done false
9627 3146 Acked Write 8 Sent Done Done false
9628 3147 Acked Write 1 Sent Done Done false
9629 3148 Acked Read 1 Sent Done Done false
9630 3149 Acked Read 3 Sent Done Done false
9631 3150 Acked Write 10 Sent Done Done false
9632 3151 Acked Read 2 Sent Done Done false
9633 3152 Acked Read 2 Sent Done Done false
9634 3153 Acked Write 3 Sent Done Done false
9635 3154 Acked Write 3 Sent Done Done false
9636 3155 Acked Read 7 Sent Done Done false
9637 3156 Acked Write 4 Sent Done Done false
9638 3157 Acked Read 2 Sent Done Done false
9639 3158 Acked Write 10 Sent Done Done false
9640 3159 Acked Read 3 Sent Done Done false
9641 3160 Acked Write 8 Sent Done Done false
9642 3161 Acked Write 1 Sent Done Done false
9643 3162 Acked Write 6 Sent Done Done false
9644 3163 Acked Read 6 Sent Done Done false
9645 3164 Acked Write 4 Sent Done Done false
9646 3165 Acked Flush 0 Sent Done Done false
9647 3166 Acked Read 1 Sent Done Done false
9648 3167 Acked Write 1 Sent Done Done false
9649 3168 Acked Read 7 Sent Done Done false
9650 3169 Acked Read 4 Sent Done Done false
9651 3170 Acked Read 10 Sent Done Done false
9652 3171 Acked Write 5 Sent Done Done false
9653 3172 Acked Flush 0 Sent Done Done false
9654 3173 Acked Write 10 Sent Done Done false
9655 3174 Acked Write 4 Sent Done Done false
9656 3175 Acked Read 10 Sent Done Done false
9657 3176 Acked Read 9 Sent Done Done false
9658 3177 Acked Read 8 Sent Done Done false
9659 3178 Acked Write 6 Sent Done Done false
9660 3179 Acked Read 3 Sent Done Done false
9661 3180 Acked Write 10 Sent Done Done false
9662 3181 Acked Write 9 Sent Done Done false
9663 3182 Acked Read 8 Sent Done Done false
9664 3183 Acked Read 6 Sent Done Done false
9665 3184 Acked Flush 0 Sent Done Done false
9666 3185 Acked Flush 0 Sent Done Done false
9667 3186 Acked Write 10 Sent Done Done false
9668 3187 Acked Read 5 Sent Done Done false
9669 3188 Acked Read 4 Sent Done Done false
9670 3189 Acked Read 2 Sent Done Done false
9671 3190 Acked Flush 0 Sent Done Done false
9672 3191 Acked Write 5 Sent Done Done false
9673 3192 Acked Write 2 Sent Done Done false
9674 3193 Acked Read 1 Sent Done Done false
9675 3194 Acked Read 7 Sent Done Done false
9676 3195 Acked Read 10 Sent Done Done false
9677 3196 Acked Read 2 Sent Done Done false
9678 3197 Acked Write 5 Sent Done Done false
9679 3198 Acked Write 5 Sent Done Done false
9680 3199 Acked Read 10 Sent Done Done false
9681 3200 Acked Write 3 Sent Done Done false
9682 3201 Acked Read 4 Sent Done Done false
9683 3202 Acked Read 8 Sent Done Done false
9684 3203 Acked Read 9 Sent Done Done false
9685 3204 Acked Read 6 Sent Done Done false
9686 3205 Acked Read 9 Sent Done Done false
9687 3206 Acked Flush 0 Sent Done Done false
9688 3207 Acked Read 2 Sent Done Done false
9689 3208 Acked Read 1 Sent Done Done false
9690 3209 Acked Write 4 Sent Done Done false
9691 3210 Acked Write 1 Sent Done Done false
9692 3211 Acked Read 6 Sent Done Done false
9693 3212 Acked Read 7 Sent Done Done false
9694 3213 Acked Write 4 Sent Done Done false
9695 3214 Acked Write 1 Sent Done Done false
9696 3215 Acked Flush 0 Sent Done Done false
9697 3216 Acked Read 5 Sent Done Done false
9698 3217 Acked Read 2 Sent Done Done false
9699 3218 Acked Flush 0 Sent Done Done false
9700 3219 Acked Write 5 Sent Done Done false
9701 3220 Acked Read 9 Sent Done Done false
9702 3221 Acked Read 10 Sent Done Done false
9703 3222 Acked Read 10 Sent Done Done false
9704 3223 Acked Write 3 Sent Done Done false
9705 3224 Acked Read 3 Sent Done Done false
9706 3225 Acked Read 2 Sent Done Done false
9707 3226 Acked Read 4 Sent Done Done false
9708 3227 Acked Read 4 Sent Done Done false
9709 3228 Acked Flush 0 Sent Done Done false
9710 3229 Acked Write 3 Sent Done Done false
9711 3230 Acked Write 2 Sent Done Done false
9712 3231 Acked Write 7 Sent Done Done false
9713 3232 Acked Write 4 Sent Done Done false
9714 3233 Acked Write 2 Sent Done Done false
9715 3234 Acked Read 6 Sent Done Done false
9716 3235 Acked Read 1 Sent Done Done false
9717 3236 Acked Flush 0 Sent Done Done false
9718 3237 Acked Read 10 Sent Done Done false
9719 3238 Acked Read 7 Sent Done Done false
9720 3239 Acked Flush 0 Sent Done Done false
9721 3240 Acked Write 8 Sent Done Done false
9722 3241 Acked Read 6 Sent Done Done false
9723 3242 Acked Read 2 Sent Done Done false
9724 3243 Acked Read 2 Sent Done Done false
9725 3244 Acked Write 6 Sent Done Done false
9726 3245 Acked Read 5 Sent Done Done false
9727 3246 Acked Read 2 Sent Done Done false
9728 3247 Acked Read 10 Sent Done Done false
9729 3248 Acked Read 5 Sent Done Done false
9730 3249 Acked Read 6 Sent Done Done false
9731 3250 Acked Read 9 Sent Done Done false
9732 3251 Acked Read 8 Sent Done Done false
9733 3252 Acked Read 4 Sent Done Done false
9734 3253 Acked Read 3 Sent Done Done false
9735 3254 Acked Read 9 Sent Done Done false
9736 3255 Acked Write 10 Sent Done Done false
9737 3256 Acked Flush 0 Sent Done Done false
9738 3257 Acked Read 8 Sent Done Done false
9739 3258 Acked Write 6 Sent Done Done false
9740 3259 Acked Read 1 Sent Done Done false
9741 3260 Acked Flush 0 Sent Done Done false
9742 3261 Acked Write 5 Sent Done Done false
9743 3262 Acked Write 2 Sent Done Done false
9744 3263 Acked Read 5 Sent Done Done false
9745 3264 Acked Flush 0 Sent Done Done false
9746 3265 Acked Flush 0 Sent Done Done false
9747 3266 Acked Write 8 Sent Done Done false
9748 3267 Acked Write 4 Sent Done Done false
9749 3268 Acked Read 5 Sent Done Done false
9750 3269 Acked Read 1 Sent Done Done false
9751 3270 Acked Read 8 Sent Done Done false
9752 3271 Acked Read 1 Sent Done Done false
9753 3272 Acked Read 1 Sent Done Done false
9754 3273 Acked Write 3 Sent Done Done false
9755 3274 Acked Read 5 Sent Done Done false
9756 3275 Acked Read 7 Sent Done Done false
9757 3276 Acked Read 9 Sent Done Done false
9758 3277 Acked Write 4 Sent Done Done false
9759 3278 Acked Read 7 Sent Done Done false
9760 3279 Acked Read 10 Sent Done Done false
9761 3280 Acked Flush 0 Sent Done Done false
9762 3281 Acked Read 1 Sent Done Done false
9763 3282 Acked Read 3 Sent Done Done false
9764 3283 Acked Write 4 Sent Done Done false
9765 3284 Acked Read 7 Sent Done Done false
9766 3285 Acked Write 10 Sent Done Done false
9767 3286 Acked Write 6 Sent Done Done false
9768 3287 Acked Read 8 Sent Done Done false
9769 3288 Acked Read 10 Sent Done Done false
9770 3289 Acked Flush 0 Sent Done Done false
9771 3290 Acked Read 10 Sent Done Done false
9772 3291 Acked Write 6 Sent Done Done false
9773 3292 Acked Write 6 Sent Done Done false
9774 3293 Acked Read 7 Sent Done Done false
9775 3294 Acked Write 2 Sent Done Done false
9776 3295 Acked Write 7 Sent Done Done false
9777 3296 Acked Flush 0 Sent Done Done false
9778 3297 Acked Write 6 Sent Done Done false
9779 3298 Acked Write 10 Sent Done Done false
9780 3299 Acked Read 6 Sent Done Done false
9781 3300 Acked Read 4 Sent Done Done false
9782 3301 Acked Write 6 Sent Done Done false
9783 3302 Acked Write 6 Sent Done Done false
9784 3303 Acked Read 2 Sent Done Done false
9785 3304 Acked Read 2 Sent Done Done false
9786 3305 Acked Write 9 Sent Done Done false
9787 3306 Acked Read 7 Sent Done Done false
9788 3307 Acked Read 3 Sent Done Done false
9789 3308 Acked Write 1 Sent Done Done false
9790 3309 Acked Read 5 Sent Done Done false
9791 3310 Acked Read 9 Sent Done Done false
9792 3311 Acked Read 9 Sent Done Done false
9793 3312 Acked Read 9 Sent Done Done false
9794 3313 Acked Write 7 Sent Done Done false
9795 3314 Acked Flush 0 Sent Done Done false
9796 3315 Acked Write 2 Sent Done Done false
9797 3316 Acked Read 1 Sent Done Done false
9798 3317 Acked Write 8 Sent Done Done false
9799 3318 Acked Write 2 Sent Done Done false
9800 3319 Acked Write 7 Sent Done Done false
9801 3320 Acked Flush 0 Sent Done Done false
9802 3321 Acked Write 7 Sent Done Done false
9803 3322 Acked Read 9 Sent Done Done false
9804 3323 Acked Read 5 Sent Done Done false
9805 3324 Acked Read 1 Sent Done Done false
9806 3325 Acked Read 4 Sent Done Done false
9807 3326 Acked Read 5 Sent Done Done false
9808 3327 Acked Write 2 Sent Done Done false
9809 3328 Acked Flush 0 Sent Done Done false
9810 3329 Acked Flush 0 Sent Done Done false
9811 3330 Acked Write 9 Sent Done Done false
9812 3331 Acked Write 6 Sent Done Done false
9813 3332 Acked Read 4 Sent Done Done false
9814 3333 Acked Read 3 Sent Done Done false
9815 3334 Acked Read 4 Sent Done Done false
9816 3335 Acked Write 7 Sent Done Done false
9817 3336 Acked Write 10 Sent Done Done false
9818 3337 Acked Read 1 Sent Done Done false
9819 3338 Acked Write 10 Sent Done Done false
9820 3339 Acked Write 1 Sent Done Done false
9821 3340 Acked Read 7 Sent Done Done false
9822 3341 Acked Write 5 Sent Done Done false
9823 3342 Acked Write 7 Sent Done Done false
9824 3343 Acked Read 5 Sent Done Done false
9825 3344 Acked Write 7 Sent Done Done false
9826 3345 Acked Write 7 Sent Done Done false
9827 3346 Acked Read 10 Sent Done Done false
9828 3347 Acked Write 3 Sent Done Done false
9829 3348 Acked Write 6 Sent Done Done false
9830 3349 Acked Read 2 Sent Done Done false
9831 3350 Acked Read 9 Sent Done Done false
9832 3351 Acked Read 3 Sent Done Done false
9833 3352 Acked Read 5 Sent Done Done false
9834 3353 Acked Read 5 Sent Done Done false
9835 3354 Acked Read 1 Sent Done Done false
9836 3355 Acked Read 4 Sent Done Done false
9837 3356 Acked Read 4 Sent Done Done false
9838 3357 Acked Flush 0 Sent Done Done false
9839 3358 Acked Write 5 Sent Done Done false
9840 3359 Acked Write 6 Sent Done Done false
9841 3360 Acked Write 6 Sent Done Done false
9842 3361 Acked Read 8 Sent Done Done false
9843 3362 Acked Write 5 Sent Done Done false
9844 3363 Acked Flush 0 Sent Done Done false
9845 3364 Acked Write 1 Sent Done Done false
9846 3365 Acked Read 4 Sent Done Done false
9847 3366 Acked Read 5 Sent Done Done false
9848 3367 Acked Write 10 Sent Done Done false
9849 3368 Acked Read 9 Sent Done Done false
9850 3369 Acked Flush 0 Sent Done Done false
9851 3370 Acked Read 1 Sent Done Done false
9852 3371 Acked Read 8 Sent Done Done false
9853 3372 Acked Flush 0 Sent Done Done false
9854 3373 Acked Read 8 Sent Done Done false
9855 3374 Acked Read 8 Sent Done Done false
9856 3375 Acked Write 10 Sent Done Done false
9857 3376 Acked Write 8 Sent Done Done false
9858 3377 Acked Read 7 Sent Done Done false
9859 3378 Acked Read 6 Sent Done Done false
9860 3379 Acked Write 5 Sent Done Done false
9861 3380 Acked Read 1 Sent Done Done false
9862 3381 Acked Write 3 Sent Done Done false
9863 3382 Acked Write 2 Sent Done Done false
9864 3383 Acked Read 1 Sent Done Done false
9865 3384 Acked Flush 0 Sent Done Done false
9866 3385 Acked Read 4 Sent Done Done false
9867 3386 Acked Read 5 Sent Done Done false
9868 3387 Acked Read 7 Sent Done Done false
9869 3388 Acked Read 3 Sent Done Done false
9870 3389 Acked Read 6 Sent Done Done false
9871 3390 Acked Read 9 Sent Done Done false
9872 3391 Acked Read 3 Sent Done Done false
9873 3392 Acked Flush 0 Sent Done Done false
9874 3393 Acked Read 4 Sent Done Done false
9875 3394 Acked Read 8 Sent Done Done false
9876 3395 Acked Read 8 Sent Done Done false
9877 3396 Acked Write 6 Sent Done Done false
9878 3397 Acked Write 10 Sent Done Done false
9879 3398 Acked Write 10 Sent Done Done false
9880 3399 Acked Write 10 Sent Done Done false
9881 3400 Acked Read 3 Sent Done Done false
9882 3401 Acked Read 5 Sent Done Done false
9883 3402 Acked Read 3 Sent Done Done false
9884 3403 Acked Read 5 Sent Done Done false
9885 3404 Acked Read 9 Sent Done Done false
9886 3405 Acked Read 7 Sent Done Done false
9887 3406 Acked Read 5 Sent Done Done false
9888 3407 Acked Read 6 Sent Done Done false
9889 3408 Acked Write 8 Sent Done Done false
9890 3409 Acked Read 10 Sent Done Done false
9891 3410 Acked Read 1 Sent Done Done false
9892 3411 Acked Read 6 Sent Done Done false
9893 3412 Acked Read 5 Sent Done Done false
9894 3413 Acked Flush 0 Sent Done Done false
9895 STATES DS:0 DS:1 DS:2 TOTAL
9896 Sent 302 0 0 302
9897 Done 0 302 302 604
9898 Skipped 0 0 0 0
9899 Error 0 0 0 0
9900 Last Flush: 3111 3413 3413
9901 Downstairs last five completed: 3111 3110 3109 3108 3107
9902 Upstairs last five completed: 3413 3412 3411 3410 3409
9903 CLIENT: Up:0 ds:302 act:2
99042025-01-10T16:37:25.452ZINFOcrucible: connecting to 127.0.0.1:8810 = io task client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
99052025-01-10T16:37:25.452ZINFOcrucible: ds_connection connected from Ok(127.0.0.1:55036) = io task client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
99062025-01-10T16:37:25.453ZWARNcrucible: version negotiation from state Offline = downstairs client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
99072025-01-10T16:37:25.454ZINFOcrucible: downstairs client at Some(127.0.0.1:8810) has region UUID 12345678-0000-0000-0000-000000008810 = downstairs client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
99082025-01-10T16:37:25.454ZINFOcrucible: Returning UUID:12345678-0000-0000-0000-000000008810 matches = downstairs client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
99092025-01-10T16:37:25.454ZINFOcrucible: send last flush ID to this DS: 3111 = downstairs client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
99102025-01-10T16:37:25.454ZINFOcrucible: Replied this last flush ID: 3111 = downstairs client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
99112025-01-10T16:37:25.454ZINFOcrucible: ds_transition from Offline to Active = downstairs client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
99122025-01-10T16:37:25.454ZINFOcrucible: [0] Transition from Offline to Active = downstairs client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
99132025-01-10T16:37:25.454ZINFOcrucible: [0] client re-new 302 jobs since flush 3111 = downstairs session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
99142025-01-10T16:37:25.454ZINFOcrucible: [0] Replayed 302 jobs since flush: 3111 = downstairs session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
9915 ----------------------------------------------------------------
9916 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:0
9917 Downstairs last five completed: 3413 3412 3411 3410 3409
9918 Upstairs last five completed: 3413 3412 3411 3410 3409
9919 CLIENT: Up:0 ds:0 act:3
9920 Replay: All jobs finished
9921 Main task has work to do, go find it
9922 got dsc Stop(2)
9923 stop 2
9924 Jan 10 16:37:25.702 INFO request completed, latency_us: 342, response_code: 204, uri: /stop/cid/2, method: POST, [8830] Got stop action so:false kr:false
9925 req_id: ceaf49dc-2c21-4ada-9528-45d7191300d6, remote_addr: 127.0.0.1:55917, local_addr: 127.0.0.1:9998
9926 Jan 10 16:37:25.703 INFO request completed, latency_us: 131, response_code: 200, uri: /state/cid/2, method: GET, req_id: f8176e64-6567-4c3e-a8da-3e4530664183, remote_addr: 127.0.0.{"msg":"downstairs disconnected","v":0,"name":"crucible","level":40,"time":"2025-01-10T16:37:25.703268266Z","hostname":"w-01JH8H1N3KXZ9F8ZV6CCMP5KTQ","pid":1202,"":"io task","client":"2","":"downstairs","session_id":"1df3ca91-4dc9-42d6-9897-461254b5afe2"}
9927 1:55917, local_addr: 127.0.0.1:9998
99282025-01-10T16:37:25.703ZWARNcrucible: client task is sending Done(Finished) = io task client = 2 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
99292025-01-10T16:37:25.703ZWARNcrucible: downstairs task for 2 stopped due to Finished session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
99302025-01-10T16:37:25.703ZINFOcrucible: ds_transition from Active to Offline = downstairs client = 2 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
99312025-01-10T16:37:25.703ZINFOcrucible: [2] Transition from Active to Offline = downstairs client = 2 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
99322025-01-10T16:37:25.703ZINFOcrucible: client task is exiting = io task client = 2 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
9933 [8830] Exited with: ExitStatus(unix_wait_status(9))
9934 [8830][2] reports Exit
9935 Jan 10 16:37:29.705 INFO request completed, latency_us: 324, response_code: 200, uri: /state/cid/2, method: GET, req_id: 3daf670d-58ef-40ae-ae28-03fb413e6a6b, remote_addr: 127.0.0.1:55917, local_addr: 127.0.0.1:9998
9936 001/300 Read block 521 len 4096
9937 002/300 Read block 2577 len 36864
9938 003/300 Read block 890 len 20480
9939 004/300 Read block 3124 len 32768
9940 005/300 Flush
9941 006/300 Write block 4831 len 24576 data: 3 2 2 2 2 2
9942 007/300 Write block 2135 len 20480 data: 2 2 2 2 2
9943 008/300 Write block 3897 len 16384 data: 3 4 4 4
9944 009/300 Write block 3319 len 20480 data: 3 3 4 2 2
9945 010/300 Read block 898 len 20480
9946 011/300 Read block 1408 len 16384
9947 012/300 Read block 4767 len 32768
9948 013/300 Write block 4293 len 4096 data: 2
9949 014/300 Read block 365 len 20480
9950 015/300 Write block 4631 len 4096 data: 4
9951 016/300 Write block 1597 len 40960 data: 3 3 3 4 4 5 4 4 3 3
9952 017/300 Read block 2629 len 16384
9953 018/300 Flush
9954 019/300 Read block 960 len 8192
9955 020/300 Write block 2961 len 20480 data: 2 2 2 2 2
9956 021/300 Read block 2693 len 8192
9957 022/300 Write block 4331 len 24576 data: 3 3 4 4 3 3
9958 023/300 Write block 2195 len 24576 data: 5 5 6 6 4 2
9959 024/300 Read block 287 len 24576
9960 025/300 Read block 301 len 4096
9961 026/300 Read block 684 len 12288
9962 027/300 Write block 3052 len 16384 data: 2 2 2 3
9963 028/300 Read block 2662 len 24576
9964 029/300 Flush
9965 030/300 Write block 1236 len 16384 data: 2 2 2 2
9966 031/300 Flush
9967 032/300 Read block 3163 len 36864
9968 033/300 Write block 4961 len 16384 data: 2 3 3 3
9969 034/300 Flush
9970 035/300 Flush
9971 036/300 Read block 2202 len 36864
9972 037/300 Write block 1607 len 8192 data: 4 4
9973 038/300 Write block 1176 len 40960 data: 4 3 2 4 4 4 4 3 3 3
9974 039/300 Read block 3959 len 20480
9975 040/300 Read block 3407 len 20480
9976 041/300 Read block 1423 len 12288
9977 042/300 Read block 2615 len 8192
9978 043/300 Read block 4161 len 40960
9979 044/300 Write block 4938 len 32768 data: 2 2 2 2 3 3 4 5
9980 045/300 Write block 2985 len 16384 data: 4 4 5 4
9981 046/300 Read block 1902 len 8192
9982 047/300 Flush
9983 048/300 Write block 1743 len 8192 data: 3 3
9984 049/300 Write block 452 len 28672 data: 4 3 3 2 2 2 2
9985 050/300 Write block 2387 len 12288 data: 2 2 2
9986 051/300 Write block 1282 len 20480 data: 4 4 3 3 2
9987 052/300 Write block 3384 len 8192 data: 6 4
9988 053/300 Read block 912 len 32768
9989 054/300 Write block 2999 len 36864 data: 3 3 4 3 3 4 3 3 3
9990 055/300 Read block 2022 len 32768
9991 056/300 Write block 537 len 12288 data: 3 3 3
9992 057/300 Write block 828 len 20480 data: 2 3 2 2 2
9993 058/300 Read block 3475 len 24576
9994 059/300 Read block 3267 len 16384
9995 060/300 Read block 4808 len 36864
9996 061/300 Read block 3178 len 36864
9997 062/300 Flush
9998 063/300 Write block 1546 len 28672 data: 4 5 5 6 5 5 5
9999 064/300 Read block 1758 len 12288
10000 065/300 Read block 1100 len 36864
10001 066/300 Read block 4548 len 20480
10002 067/300 Read block 3773 len 40960
10003 068/300 Write block 748 len 40960 data: 4 3 3 3 3 2 2 2 2 2
10004 069/300 Write block 3755 len 20480 data: 5 5 5 5 4
10005 070/300 Write block 3286 len 28672 data: 4 3 3 3 3 3 3
10006 071/300 Write block 1602 len 12288 data: 6 5 5
10007 072/300 Flush
10008 073/300 Read block 825 len 4096
10009 074/300 Read block 4124 len 36864
10010 075/300 Write block 2179 len 24576 data: 2 2 2 2 2 2
10011 076/300 Read block 2840 len 40960
10012 077/300 Flush
10013 078/300 Write block 4553 len 16384 data: 6 6 6 7
10014 079/300 Read block 952 len 4096
10015 080/300 Read block 479 len 40960
10016 081/300 Read block 4307 len 36864
10017 082/300 Write block 212 len 8192 data: 5 5
10018 083/300 Write block 3004 len 4096 data: 5
10019 084/300 Read block 4866 len 36864
10020 085/300 Read block 1473 len 28672
10021 086/300 Read block 1110 len 24576
10022 087/300 Write block 119 len 36864 data: 3 4 4 4 4 3 3 3 3
10023 088/300 Write block 4423 len 12288 data: 3 3 2
10024 089/300 Write block 1781 len 32768 data: 6 6 5 5 5 3 4 4
10025 090/300 Read block 261 len 4096
10026 091/300 Write block 1573 len 28672 data: 3 3 3 3 2 2 2
10027 092/300 Read block 2856 len 24576
10028 093/300 Write block 2618 len 16384 data: 3 3 3 3
10029 094/300 Read block 3688 len 32768
10030 095/300 Flush
10031 096/300 Write block 2826 len 12288 data: 2 2 2
10032 097/300 Read block 3401 len 36864
10033 098/300 Write block 4154 len 36864 data: 3 4 4 3 2 2 3 3 3
10034 099/300 Read block 2574 len 8192
10035 100/300 Read block 4739 len 12288
10036 101/300 Write block 1851 len 4096 data: 2
10037 102/300 Read block 2571 len 16384
10038 103/300 Read block 905 len 36864
10039 104/300 Write block 3398 len 12288 data: 3 3 3
10040 105/300 Read block 2847 len 12288
10041 106/300 Read block 2720 len 20480
10042 107/300 Write block 3957 len 16384 data: 2 2 3 3
10043 108/300 Read block 1981 len 12288
10044 109/300 Read block 554 len 4096
10045 110/300 Read block 1707 len 16384
10046 111/300 Read block 4352 len 28672
10047 112/300 Read block 3259 len 36864
10048 113/300 Read block 4491 len 40960
10049 114/300 Read block 1291 len 12288
10050 115/300 Read block 77 len 4096
10051 116/300 Read block 3153 len 36864
10052 117/300 Read block 1830 len 16384
10053 118/300 Write block 1176 len 20480 data: 5 4 3 5 5
10054 119/300 Write block 4374 len 12288 data: 5 5 5
10055 120/300 Write block 4062 len 8192 data: 3 2
10056 121/300 Write block 4128 len 12288 data: 4 3 2
10057 122/300 Read block 3130 len 36864
10058 123/300 Write block 4138 len 36864 data: 2 2 2 2 2 3 3 2 2
10059 124/300 Read block 1313 len 28672
10060 125/300 Read block 2066 len 4096
10061 126/300 Write block 1427 len 20480 data: 2 3 3 3 2
10062 127/300 Read block 1956 len 20480
10063 128/300 Read block 1539 len 32768
10064 129/300 Read block 1204 len 12288
10065 130/300 Read block 4807 len 24576
10066 131/300 Read block 3711 len 20480
10067 132/300 Write block 2481 len 4096 data: 3
10068 133/300 Read block 2187 len 12288
10069 134/300 Read block 2769 len 20480
10070 135/300 Read block 2688 len 28672
10071 136/300 Read block 478 len 32768
10072 137/300 Read block 4718 len 32768
10073 138/300 Read block 4004 len 4096
10074 139/300 Read block 124 len 28672
10075 140/300 Write block 4286 len 8192 data: 2 3
10076 141/300 Read block 2589 len 28672
10077 142/300 Read block 4838 len 8192
10078 143/300 Read block 4802 len 28672
10079 144/300 Read block 1537 len 24576
10080 145/300 Write block 1794 len 20480 data: 2 2 2 2 2
10081 146/300 Read block 1475 len 28672
10082 147/300 Read block 175 len 12288
10083 148/300 Write block 75 len 28672 data: 5 5 5 5 4 4 4
10084 149/300 Write block 1939 len 24576 data: 3 3 3 3 3 2
10085 150/300 Write block 1531 len 20480 data: 2 2 3 3 2
10086 151/300 Write block 2483 len 40960 data: 4 4 4 3 3 3 3 3 2 2
10087 152/300 Read block 2463 len 28672
10088 153/300 Write block 270 len 28672 data: 3 3 3 2 2 2 4
10089 154/300 Write block 4468 len 20480 data: 2 2 2 2 2
10090 155/300 Write block 2810 len 16384 data: 4 4 3 3
10091 156/300 Write block 4520 len 8192 data: 2 2
10092 157/300 Read block 2675 len 24576
10093 158/300 Read block 56 len 28672
10094 159/300 Read block 1694 len 36864
10095 160/300 Write block 3971 len 4096 data: 2
10096 161/300 Read block 3769 len 20480
10097 162/300 Read block 2721 len 4096
10098 163/300 Write block 480 len 12288 data: 3 3 3
10099 164/300 Write block 517 len 20480 data: 3 2 2 2 2
10100 165/300 Read block 2934 len 24576
10101 166/300 Read block 3316 len 28672
10102 167/300 Write block 1185 len 28672 data: 4 3 2 2 3 3 4
10103 168/300 Write block 2935 len 36864 data: 3 4 4 4 3 3 3 4 4
10104 169/300 Read block 3864 len 28672
10105 170/300 Read block 1801 len 16384
10106 171/300 Read block 349 len 12288
10107 172/300 Read block 3638 len 40960
10108 173/300 Read block 596 len 28672
10109 174/300 Read block 4289 len 40960
10110 175/300 Read block 1196 len 36864
10111 176/300 Write block 4487 len 28672 data: 3 3 3 3 3 3 3
10112 177/300 Write block 733 len 12288 data: 5 4 3
10113 178/300 Read block 198 len 12288
10114 179/300 Write block 1919 len 28672 data: 2 2 2 2 2 2 4
10115 180/300 Read block 624 len 28672
10116 181/300 Read block 2778 len 36864
10117 182/300 Write block 2051 len 40960 data: 3 4 6 6 6 5 4 3 3 3
10118 183/300 Read block 3776 len 28672
10119 184/300 Write block 1186 len 40960 data: 4 3 3 4 4 5 3 3 2 2
10120 185/300 Read block 3327 len 16384
10121 186/300 Read block 33 len 16384
10122 187/300 Read block 4762 len 32768
10123 188/300 Write block 1820 len 40960 data: 3 3 3 3 2 2 2 3 3 3
10124 189/300 Write block 2009 len 12288 data: 2 2 2
10125 190/300 Write block 3653 len 32768 data: 4 5 3 3 3 3 2 2
10126 191/300 Write block 2735 len 28672 data: 3 3 3 2 2 2 2
10127 192/300 Write block 1320 len 8192 data: 5 4
10128 193/300 Flush
10129 194/300 Read block 560 len 36864
10130 195/300 Write block 4255 len 40960 data: 2 2 2 2 2 2 2 3 3 3
10131 196/300 Read block 2384 len 28672
10132 197/300 Write block 4747 len 40960 data: 2 2 2 2 2 3 3 3 3 3
10133 198/300 Read block 2924 len 40960
10134 199/300 Read block 2291 len 16384
10135 200/300 Read block 1274 len 16384
10136 201/300 Write block 914 len 16384 data: 4 4 3 4
10137 202/300 Write block 2984 len 32768 data: 3 5 5 6 5 4 4 4
10138 203/300 Write block 4170 len 36864 data: 4 4 3 2 3 3 3 3 3
10139 204/300 Write block 3670 len 4096 data: 2
10140 205/300 Write block 1159 len 32768 data: 2 4 3 3 3 2 2 2
10141 206/300 Read block 539 len 36864
10142 207/300 Write block 4772 len 40960 data: 3 3 3 2 2 2 2 2 2 2
10143 208/300 Read block 2744 len 4096
10144 209/300 Write block 533 len 32768 data: 5 5 5 3 4 4 4 3
10145 210/300 Write block 4709 len 36864 data: 2 2 2 2 3 3 3 3 3
10146 211/300 Write block 4564 len 32768 data: 2 3 3 3 3 3 5 5
10147 212/300 Read block 2559 len 36864
10148 213/300 Read block 819 len 8192
10149 214/300 Flush
10150 215/300 Read block 2104 len 32768
10151 216/300 Write block 971 len 32768 data: 3 2 3 3 3 3 4 5
10152 217/300 Read block 2510 len 12288
10153 218/300 Write block 3112 len 24576 data: 2 2 2 2 2 2
10154 219/300 Read block 4583 len 28672
10155 220/300 Read block 3236 len 36864
10156 221/300 Read block 738 len 40960
10157 222/300 Read block 4098 len 12288
10158 223/300 Read block 2426 len 32768
10159 224/300 Flush
10160 225/300 Read block 2381 len 40960
10161 226/300 Read block 3437 len 16384
10162 227/300 Read block 3467 len 4096
10163 228/300 Read block 1928 len 16384
10164 229/300 Read block 651 len 4096
10165 230/300 Write block 4984 len 24576 data: 3 3 5 5 4 4
10166 231/300 Write block 2880 len 20480 data: 2 3 3 3 4
10167 232/300 Write block 1039 len 12288 data: 3 2 2
10168 233/300 Flush
10169 234/300 Flush
10170 235/300 Write block 1453 len 28672 data: 3 3 3 3 4 4 4
10171 236/300 Read block 2104 len 36864
10172 237/300 Read block 2411 len 40960
10173 238/300 Read block 4692 len 32768
10174 239/300 Read block 3744 len 40960
10175 240/300 Read block 2454 len 20480
10176 241/300 Write block 4859 len 12288 data: 4 4 4
10177 242/300 Write block 3588 len 20480 data: 4 4 3 3 3
10178 243/300 Write block 786 len 12288 data: 3 3 3
10179 244/300 Write block 3496 len 8192 data: 2 2
10180 245/300 Write block 649 len 4096 data: 3
10181 246/300 Write block 2037 len 24576 data: 4 5 4 4 4 3
10182 247/300 Write block 4902 len 8192 data: 3 3
10183 248/300 Read block 3938 len 16384
10184 249/300 Write block 4539 len 32768 data: 2 2 2 2 2 2 2 2
10185 250/300 Write block 582 len 16384 data: 2 2 2 2
10186 251/300 Flush
10187 252/300 Read block 4863 len 20480
10188 253/300 Read block 57 len 32768
10189 254/300 Read block 4293 len 4096
10190 255/300 Write block 3014 len 40960 data: 2 2 3 4 4 4 4 3 3 3
10191 256/300 Write block 2132 len 16384 data: 3 3 3 3
10192 257/300 Write block 727 len 28672 data: 4 4 3 3 3 5 6
10193 258/300 Read block 2940 len 12288
10194 259/300 Write block 170 len 40960 data: 2 2 2 2 2 2 3 3 2 2
10195 260/300 Write block 1150 len 16384 data: 3 3 3 2
10196 261/300 Read block 4921 len 12288
10197 262/300 Flush
10198 263/300 Flush
10199 264/300 Read block 2494 len 28672
10200 265/300 Read block 3905 len 4096
10201 266/300 Write block 1750 len 40960 data: 3 3 3 3 2 2 2 2 2 4
10202 267/300 Flush
10203 268/300 Read block 4853 len 36864
10204 269/300 Read block 2904 len 16384
10205 270/300 Read block 1519 len 28672
10206 271/300 Read block 310 len 32768
10207 272/300 Read block 4913 len 40960
10208 273/300 Write block 3850 len 24576 data: 2 2 2 2 3 4
10209 274/300 Write block 341 len 24576 data: 2 2 2 2 3 3
10210 275/300 Read block 2754 len 40960
10211 276/300 Read block 1901 len 28672
10212 277/300 Write block 2880 len 32768 data: 3 4 4 4 5 4 5 4
10213 278/300 Read block 2879 len 4096
10214 279/300 Write block 2649 len 12288 data: 3 3 3
10215 280/300 Read block 4217 len 12288
10216 281/300 Write block 1706 len 16384 data: 2 2 3 3
10217 282/300 Read block 1807 len 40960
10218 283/300 Write block 4378 len 28672 data: 5 3 2 2 2 2 3
10219 284/300 Write block 1614 len 8192 data: 3 3
10220 285/300 Read block 1329 len 36864
10221 286/300 Read block 1718 len 40960
10222 287/300 Write block 1151 len 24576 data: 4 4 3 2 2 2
10223 288/300 Write block 2297 len 12288 data: 2 2 2
10224 289/300 Read block 3499 len 36864
10225 290/300 Flush
10226 291/300 Write block 243 len 20480 data: 3 3 3 3 2
10227 292/300 Read block 1329 len 8192
10228 293/300 Read block 4781 len 16384
10229 294/300 Write block 3727 len 36864 data: 5 5 5 4 4 5 5 5 5
10230 295/300 Read block 2622 len 12288
10231 296/300 Flush
10232 297/300 Write block 4850 len 4096 data: 3
10233 298/300 Read block 2994 len 28672
10234 299/300 Write block 2834 len 12288 data: 3 3 4
10235 300/300 Write block 1294 len 12288 data: 2 3 3
10236 301/300 Read block 2830 len 32768
10237 Main task has work to do, go find it
10238 got dsc Start(2)
10239 start 2
10240 Jan 10 16:37:29.953 INFO request completed, latency_us: 225, response_code: 204, uri: /start/cid/2, method: POST, req_id: 6adbd5ae-94c2-4807-a7bf-7b3d6f7f0096, remote_addr: 127.0.0.1:55917, local_addr: 127.0.0.1:9998
10241 Replay: started 2, returned:Ok(())
10242 ----------------------------------------------------------------
10243 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:301
10244 States: Active Active Offline
10245 JOBID ACK TYPE BKS/EXT DS:0 DS:1 DS:2 REPLAY
10246 3414 Acked Read 1 Done Done Sent false
10247 3415 Acked Read 9 Done Done Sent false
10248 3416 Acked Read 5 Done Done Sent false
10249 3417 Acked Read 8 Done Done Sent false
10250 3418 Acked Flush 0 Done Done Sent false
10251 3419 Acked Write 6 Done Done Sent false
10252 3420 Acked Write 5 Done Done Sent false
10253 3421 Acked Write 4 Done Done Sent false
10254 3422 Acked Write 5 Done Done Sent false
10255 3423 Acked Read 5 Done Done Sent false
10256 3424 Acked Read 4 Done Done Sent false
10257 3425 Acked Read 8 Done Done Sent false
10258 3426 Acked Write 1 Done Done Sent false
10259 3427 Acked Read 5 Done Done Sent false
10260 3428 Acked Write 1 Done Done Sent false
10261 3429 Acked Write 10 Done Done Sent false
10262 3430 Acked Read 4 Done Done Sent false
10263 3431 Acked Flush 0 Done Done Sent false
10264 3432 Acked Read 2 Done Done Sent false
10265 3433 Acked Write 5 Done Done Sent false
10266 3434 Acked Read 2 Done Done Sent false
10267 3435 Acked Write 6 Done Done Sent false
10268 3436 Acked Write 6 Done Done Sent false
10269 3437 Acked Read 6 Done Done Sent false
10270 3438 Acked Read 1 Done Done Sent false
10271 3439 Acked Read 3 Done Done Sent false
10272 3440 Acked Write 4 Done Done Sent false
10273 3441 Acked Read 6 Done Done Sent false
10274 3442 Acked Flush 0 Done Done Sent false
10275 3443 Acked Write 4 Done Done Sent false
10276 3444 Acked Flush 0 Done Done Sent false
10277 3445 Acked Read 9 Done Done Sent false
10278 3446 Acked Write 4 Done Done Sent false
10279 3447 Acked Flush 0 Done Done Sent false
10280 3448 Acked Flush 0 Done Done Sent false
10281 3449 Acked Read 9 Done Done Sent false
10282 3450 Acked Write 2 Done Done Sent false
10283 3451 Acked Write 10 Done Done Sent false
10284 3452 Acked Read 5 Done Done Sent false
10285 3453 Acked Read 5 Done Done Sent false
10286 3454 Acked Read 3 Done Done Sent false
10287 3455 Acked Read 2 Done Done Sent false
10288 3456 Acked Read 10 Done Done Sent false
10289 3457 Acked Write 8 Done Done Sent false
10290 3458 Acked Write 4 Done Done Sent false
10291 3459 Acked Read 2 Done Done Sent false
10292 3460 Acked Flush 0 Done Done Sent false
10293 3461 Acked Write 2 Done Done Sent false
10294 3462 Acked Write 7 Done Done Sent false
10295 3463 Acked Write 3 Done Done Sent false
10296 3464 Acked Write 5 Done Done Sent false
10297 3465 Acked Write 2 Done Done Sent false
10298 3466 Acked Read 8 Done Done Sent false
10299 3467 Acked Write 9 Done Done Sent false
10300 3468 Acked Read 8 Done Done Sent false
10301 3469 Acked Write 3 Done Done Sent false
10302 3470 Acked Write 5 Done Done Sent false
10303 3471 Acked Read 6 Done Done Sent false
10304 3472 Acked Read 4 Done Done Sent false
10305 3473 Acked Read 9 Done Done Sent false
10306 3474 Acked Read 9 Done Done Sent false
10307 3475 Acked Flush 0 Done Done Sent false
10308 3476 Acked Write 7 Done Done Sent false
10309 3477 Acked Read 3 Done Done Sent false
10310 3478 Acked Read 9 Done Done Sent false
10311 3479 Acked Read 5 Done Done Sent false
10312 3480 Acked Read 10 Done Done Sent false
10313 3481 Acked Write 10 Done Done Sent false
10314 3482 Acked Write 5 Done Done Sent false
10315 3483 Acked Write 7 Done Done Sent false
10316 3484 Acked Write 3 Done Done Sent false
10317 3485 Acked Flush 0 Done Done Sent false
10318 3486 Acked Read 1 Done Done Sent false
10319 3487 Acked Read 9 Done Done Sent false
10320 3488 Acked Write 6 Done Done Sent false
10321 3489 Acked Read 10 Done Done Sent false
10322 3490 Acked Flush 0 Done Done Sent false
10323 3491 Acked Write 4 Done Done Sent false
10324 3492 Acked Read 1 Done Done Sent false
10325 3493 Acked Read 10 Done Done Sent false
10326 3494 Acked Read 9 Done Done Sent false
10327 3495 Acked Write 2 Done Done Sent false
10328 3496 Acked Write 1 Done Done Sent false
10329 3497 Acked Read 9 Done Done Sent false
10330 3498 Acked Read 7 Done Done Sent false
10331 3499 Acked Read 6 Done Done Sent false
10332 3500 Acked Write 9 Done Done Sent false
10333 3501 Acked Write 3 Done Done Sent false
10334 3502 Acked Write 8 Done Done Sent false
10335 3503 Acked Read 1 Done Done Sent false
10336 3504 Acked Write 7 Done Done Sent false
10337 3505 Acked Read 6 Done Done Sent false
10338 3506 Acked Write 4 Done Done Sent false
10339 3507 Acked Read 8 Done Done Sent false
10340 3508 Acked Flush 0 Done Done Sent false
10341 3509 Acked Write 3 Done Done Sent false
10342 3510 Acked Read 9 Done Done Sent false
10343 3511 Acked Write 9 Done Done Sent false
10344 3512 Acked Read 2 Done Done Sent false
10345 3513 Acked Read 3 Done Done Sent false
10346 3514 Acked Write 1 Done Done Sent false
10347 3515 Acked Read 4 Done Done Sent false
10348 3516 Acked Read 9 Done Done Sent false
10349 3517 Acked Write 3 Done Done Sent false
10350 3518 Acked Read 3 Done Done Sent false
10351 3519 Acked Read 5 Done Done Sent false
10352 3520 Acked Write 4 Done Done Sent false
10353 3521 Acked Read 3 Done Done Sent false
10354 3522 Acked Read 1 Done Done Sent false
10355 3523 Acked Read 4 Done Done Sent false
10356 3524 Acked Read 7 Done Done Sent false
10357 3525 Acked Read 9 Done Done Sent false
10358 3526 Acked Read 10 Done Done Sent false
10359 3527 Acked Read 3 Done Done Sent false
10360 3528 Acked Read 1 Done Done Sent false
10361 3529 Acked Read 9 Done Done Sent false
10362 3530 Acked Read 4 Done Done Sent false
10363 3531 Acked Write 5 Done Done Sent false
10364 3532 Acked Write 3 Done Done Sent false
10365 3533 Acked Write 2 Done Done Sent false
10366 3534 Acked Write 3 Done Done Sent false
10367 3535 Acked Read 9 Done Done Sent false
10368 3536 Acked Write 9 Done Done Sent false
10369 3537 Acked Read 7 Done Done Sent false
10370 3538 Acked Read 1 Done Done Sent false
10371 3539 Acked Write 5 Done Done Sent false
10372 3540 Acked Read 5 Done Done Sent false
10373 3541 Acked Read 8 Done Done Sent false
10374 3542 Acked Read 3 Done Done Sent false
10375 3543 Acked Read 6 Done Done Sent false
10376 3544 Acked Read 5 Done Done Sent false
10377 3545 Acked Write 1 Done Done Sent false
10378 3546 Acked Read 3 Done Done Sent false
10379 3547 Acked Read 5 Done Done Sent false
10380 3548 Acked Read 7 Done Done Sent false
10381 3549 Acked Read 8 Done Done Sent false
10382 3550 Acked Read 8 Done Done Sent false
10383 3551 Acked Read 1 Done Done Sent false
10384 3552 Acked Read 7 Done Done Sent false
10385 3553 Acked Write 2 Done Done Sent false
10386 3554 Acked Read 7 Done Done Sent false
10387 3555 Acked Read 2 Done Done Sent false
10388 3556 Acked Read 7 Done Done Sent false
10389 3557 Acked Read 6 Done Done Sent false
10390 3558 Acked Write 5 Done Done Sent false
10391 3559 Acked Read 7 Done Done Sent false
10392 3560 Acked Read 3 Done Done Sent false
10393 3561 Acked Write 7 Done Done Sent false
10394 3562 Acked Write 6 Done Done Sent false
10395 3563 Acked Write 5 Done Done Sent false
10396 3564 Acked Write 10 Done Done Sent false
10397 3565 Acked Read 7 Done Done Sent false
10398 3566 Acked Write 7 Done Done Sent false
10399 3567 Acked Write 5 Done Done Sent false
10400 3568 Acked Write 4 Done Done Sent false
10401 3569 Acked Write 2 Done Done Sent false
10402 3570 Acked Read 6 Done Done Sent false
10403 3571 Acked Read 7 Done Done Sent false
10404 3572 Acked Read 9 Done Done Sent false
10405 3573 Acked Write 1 Done Done Sent false
10406 3574 Acked Read 5 Done Done Sent false
10407 3575 Acked Read 1 Done Done Sent false
10408 3576 Acked Write 3 Done Done Sent false
10409 3577 Acked Write 5 Done Done Sent false
10410 3578 Acked Read 6 Done Done Sent false
10411 3579 Acked Read 7 Done Done Sent false
10412 3580 Acked Write 7 Done Done Sent false
10413 3581 Acked Write 9 Done Done Sent false
10414 3582 Acked Read 7 Done Done Sent false
10415 3583 Acked Read 4 Done Done Sent false
10416 3584 Acked Read 3 Done Done Sent false
10417 3585 Acked Read 10 Done Done Sent false
10418 3586 Acked Read 7 Done Done Sent false
10419 3587 Acked Read 10 Done Done Sent false
10420 3588 Acked Read 9 Done Done Sent false
10421 3589 Acked Write 7 Done Done Sent false
10422 3590 Acked Write 3 Done Done Sent false
10423 3591 Acked Read 3 Done Done Sent false
10424 3592 Acked Write 7 Done Done Sent false
10425 3593 Acked Read 7 Done Done Sent false
10426 3594 Acked Read 9 Done Done Sent false
10427 3595 Acked Write 10 Done Done Sent false
10428 3596 Acked Read 7 Done Done Sent false
10429 3597 Acked Write 10 Done Done Sent false
10430 3598 Acked Read 4 Done Done Sent false
10431 3599 Acked Read 4 Done Done Sent false
10432 3600 Acked Read 8 Done Done Sent false
10433 3601 Acked Write 10 Done Done Sent false
10434 3602 Acked Write 3 Done Done Sent false
10435 3603 Acked Write 8 Done Done Sent false
10436 3604 Acked Write 7 Done Done Sent false
10437 3605 Acked Write 2 Done Done Sent false
10438 3606 Acked Flush 0 Done Done Sent false
10439 3607 Acked Read 9 Done Done Sent false
10440 3608 Acked Write 10 Done Done Sent false
10441 3609 Acked Read 7 Done Done Sent false
10442 3610 Acked Write 10 Done Done Sent false
10443 3611 Acked Read 10 Done Done Sent false
10444 3612 Acked Read 4 Done Done Sent false
10445 3613 Acked Read 4 Done Done Sent false
10446 3614 Acked Write 4 Done Done Sent false
10447 3615 Acked Write 8 Done Done Sent false
10448 3616 Acked Write 9 Done Done Sent false
10449 3617 Acked Write 1 Done Done Sent false
10450 3618 Acked Write 8 Done Done Sent false
10451 3619 Acked Read 9 Done Done Sent false
10452 3620 Acked Write 10 Done Done Sent false
10453 3621 Acked Read 1 Done Done Sent false
10454 3622 Acked Write 8 Done Done Sent false
10455 3623 Acked Write 9 Done Done Sent false
10456 3624 Acked Write 8 Done Done Sent false
10457 3625 Acked Read 9 Done Done Sent false
10458 3626 Acked Read 2 Done Done Sent false
10459 3627 Acked Flush 0 Done Done Sent false
10460 3628 Acked Read 8 Done Done Sent false
10461 3629 Acked Write 8 Done Done Sent false
10462 3630 Acked Read 3 Done Done Sent false
10463 3631 Acked Write 6 Done Done Sent false
10464 3632 Acked Read 7 Done Done Sent false
10465 3633 Acked Read 9 Done Done Sent false
10466 3634 Acked Read 10 Done Done Sent false
10467 3635 Acked Read 3 Done Done Sent false
10468 3636 Acked Read 8 Done Done Sent false
10469 3637 Acked Flush 0 Done Done Sent false
10470 3638 Acked Read 10 Done Done Sent false
10471 3639 Acked Read 4 Done Done Sent false
10472 3640 Acked Read 1 Done Done Sent false
10473 3641 Acked Read 4 Done Done Sent false
10474 3642 Acked Read 1 Done Done Sent false
10475 3643 Acked Write 6 Done Done Sent false
10476 3644 Acked Write 5 Done Done Sent false
10477 3645 Acked Write 3 Done Done Sent false
10478 3646 Acked Flush 0 Done Done Sent false
10479 3647 Acked Flush 0 Done Done Sent false
10480 3648 Acked Write 7 Done Done Sent false
10481 3649 Acked Read 9 Done Done Sent false
10482 3650 Acked Read 10 Done Done Sent false
10483 3651 Acked Read 8 Done Done Sent false
10484 3652 Acked Read 10 Done Done Sent false
10485 3653 Acked Read 5 Done Done Sent false
10486 3654 Acked Write 3 Done Done Sent false
10487 3655 Acked Write 5 Done Done Sent false
10488 3656 Acked Write 3 Done Done Sent false
10489 3657 Acked Write 2 Done Done Sent false
10490 3658 Acked Write 1 Done Done Sent false
10491 3659 Acked Write 6 Done Done Sent false
10492 3660 Acked Write 2 Done Done Sent false
10493 3661 Acked Read 4 Done Done Sent false
10494 3662 Acked Write 8 Done Done Sent false
10495 3663 Acked Write 4 Done Done Sent false
10496 3664 Acked Flush 0 Done Done Sent false
10497 3665 Acked Read 5 Done Done Sent false
10498 3666 Acked Read 8 Done Done Sent false
10499 3667 Acked Read 1 Done Done Sent false
10500 3668 Acked Write 10 Done Done Sent false
10501 3669 Acked Write 4 Done Done Sent false
10502 3670 Acked Write 7 Done Done Sent false
10503 3671 Acked Read 3 Done Done Sent false
10504 3672 Acked Write 10 Done Done Sent false
10505 3673 Acked Write 4 Done Done Sent false
10506 3674 Acked Read 3 Done Done Sent false
10507 3675 Acked Flush 0 Done Done Sent false
10508 3676 Acked Flush 0 Done Done Sent false
10509 3677 Acked Read 7 Done Done Sent false
10510 3678 Acked Read 1 Done Done Sent false
10511 3679 Acked Write 10 Done Done Sent false
10512 3680 Acked Flush 0 Done Done Sent false
10513 3681 Acked Read 9 Done Done Sent false
10514 3682 Acked Read 4 Done Done Sent false
10515 3683 Acked Read 7 Done Done Sent false
10516 3684 Acked Read 8 Done Done Sent false
10517 3685 Acked Read 10 Done Done Sent false
10518 3686 Acked Write 6 Done Done Sent false
10519 3687 Acked Write 6 Done Done Sent false
10520 3688 Acked Read 10 Done Done Sent false
10521 3689 Acked Read 7 Done Done Sent false
10522 3690 Acked Write 8 Done Done Sent false
10523 3691 Acked Read 1 Done Done Sent false
10524 3692 Acked Write 3 Done Done Sent false
10525 3693 Acked Read 3 Done Done Sent false
10526 3694 Acked Write 4 Done Done Sent false
10527 3695 Acked Read 10 Done Done Sent false
10528 3696 Acked Write 7 Done Done Sent false
10529 3697 Acked Write 2 Done Done Sent false
10530 3698 Acked Read 9 Done Done Sent false
10531 3699 Acked Read 10 Done Done Sent false
10532 3700 Acked Write 6 Done Done Sent false
10533 3701 Acked Write 3 Done Done Sent false
10534 3702 Acked Read 9 Done Done Sent false
10535 3703 Acked Flush 0 Done Done Sent false
10536 3704 Acked Write 5 Done Done Sent false
10537 3705 Acked Read 2 Done Done Sent false
10538 3706 Acked Read 4 Done Done Sent false
10539 3707 Acked Write 9 Done Done Sent false
10540 3708 Acked Read 3 Done Done Sent false
10541 3709 Acked Flush 0 Done Done Sent false
10542 3710 Acked Write 1 Done Done Sent false
10543 3711 Acked Read 7 Done Done Sent false
10544 3712 Acked Write 3 Done Done Sent false
10545 3713 Acked Write 3 Done Done Sent false
10546 3714 Acked Read 8 Done Done Sent false
10547 STATES DS:0 DS:1 DS:2 TOTAL
10548 Sent 0 0 301 301
10549 Done 301 301 0 602
10550 Skipped 0 0 0 0
10551 Error 0 0 0 0
10552 Last Flush: 3709 3709 3413
10553 Downstairs last five completed: 3413 3412 3411 3410 3409
10554 Upstairs last five completed: 3714 3713 3712 3711 3710
10555 CLIENT: Up:0 ds:301 act:2
10556 [8830] got start action
10557 [8830] I am going to restart
10558 Starting downstairs at port 8830
10559 Make output file at "/tmp/dsc/downstairs-8830.txt"
10560 [8830][2] reports Starting
10561 Downstairs /var/tmp/dsc/region/8830 port 8830 PID:Some(1211)
10562 [8830][2] reports Running
10563 ----------------------------------------------------------------
10564 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:302
10565 States: Active Active Offline
10566 JOBID ACK TYPE BKS/EXT DS:0 DS:1 DS:2 REPLAY
10567 3414 Acked Read 1 Done Done Sent false
10568 3415 Acked Read 9 Done Done Sent false
10569 3416 Acked Read 5 Done Done Sent false
10570 3417 Acked Read 8 Done Done Sent false
10571 3418 Acked Flush 0 Done Done Sent false
10572 3419 Acked Write 6 Done Done Sent false
10573 3420 Acked Write 5 Done Done Sent false
10574 3421 Acked Write 4 Done Done Sent false
10575 3422 Acked Write 5 Done Done Sent false
10576 3423 Acked Read 5 Done Done Sent false
10577 3424 Acked Read 4 Done Done Sent false
10578 3425 Acked Read 8 Done Done Sent false
10579 3426 Acked Write 1 Done Done Sent false
10580 3427 Acked Read 5 Done Done Sent false
10581 3428 Acked Write 1 Done Done Sent false
10582 3429 Acked Write 10 Done Done Sent false
10583 3430 Acked Read 4 Done Done Sent false
10584 3431 Acked Flush 0 Done Done Sent false
10585 3432 Acked Read 2 Done Done Sent false
10586 3433 Acked Write 5 Done Done Sent false
10587 3434 Acked Read 2 Done Done Sent false
10588 3435 Acked Write 6 Done Done Sent false
10589 3436 Acked Write 6 Done Done Sent false
10590 3437 Acked Read 6 Done Done Sent false
10591 3438 Acked Read 1 Done Done Sent false
10592 3439 Acked Read 3 Done Done Sent false
10593 3440 Acked Write 4 Done Done Sent false
10594 3441 Acked Read 6 Done Done Sent false
10595 3442 Acked Flush 0 Done Done Sent false
10596 3443 Acked Write 4 Done Done Sent false
10597 3444 Acked Flush 0 Done Done Sent false
10598 3445 Acked Read 9 Done Done Sent false
10599 3446 Acked Write 4 Done Done Sent false
10600 3447 Acked Flush 0 Done Done Sent false
10601 3448 Acked Flush 0 Done Done Sent false
10602 3449 Acked Read 9 Done Done Sent false
10603 3450 Acked Write 2 Done Done Sent false
10604 3451 Acked Write 10 Done Done Sent false
10605 3452 Acked Read 5 Done Done Sent false
10606 3453 Acked Read 5 Done Done Sent false
10607 3454 Acked Read 3 Done Done Sent false
10608 3455 Acked Read 2 Done Done Sent false
10609 3456 Acked Read 10 Done Done Sent false
10610 3457 Acked Write 8 Done Done Sent false
10611 3458 Acked Write 4 Done Done Sent false
10612 3459 Acked Read 2 Done Done Sent false
10613 3460 Acked Flush 0 Done Done Sent false
10614 3461 Acked Write 2 Done Done Sent false
10615 3462 Acked Write 7 Done Done Sent false
10616 3463 Acked Write 3 Done Done Sent false
10617 3464 Acked Write 5 Done Done Sent false
10618 3465 Acked Write 2 Done Done Sent false
10619 3466 Acked Read 8 Done Done Sent false
10620 3467 Acked Write 9 Done Done Sent false
10621 3468 Acked Read 8 Done Done Sent false
10622 3469 Acked Write 3 Done Done Sent false
10623 3470 Acked Write 5 Done Done Sent false
10624 3471 Acked Read 6 Done Done Sent false
10625 3472 Acked Read 4 Done Done Sent false
10626 3473 Acked Read 9 Done Done Sent false
10627 3474 Acked Read 9 Done Done Sent false
10628 3475 Acked Flush 0 Done Done Sent false
10629 3476 Acked Write 7 Done Done Sent false
10630 3477 Acked Read 3 Done Done Sent false
10631 3478 Acked Read 9 Done Done Sent false
10632 3479 Acked Read 5 Done Done Sent false
10633 3480 Acked Read 10 Done Done Sent false
10634 3481 Acked Write 10 Done Done Sent false
10635 3482 Acked Write 5 Done Done Sent false
10636 3483 Acked Write 7 Done Done Sent false
10637 3484 Acked Write 3 Done Done Sent false
10638 3485 Acked Flush 0 Done Done Sent false
10639 3486 Acked Read 1 Done Done Sent false
10640 3487 Acked Read 9 Done Done Sent false
10641 3488 Acked Write 6 Done Done Sent false
10642 3489 Acked Read 10 Done Done Sent false
10643 3490 Acked Flush 0 Done Done Sent false
10644 3491 Acked Write 4 Done Done Sent false
10645 3492 Acked Read 1 Done Done Sent false
10646 3493 Acked Read 10 Done Done Sent false
10647 3494 Acked Read 9 Done Done Sent false
10648 3495 Acked Write 2 Done Done Sent false
10649 3496 Acked Write 1 Done Done Sent false
10650 3497 Acked Read 9 Done Done Sent false
10651 3498 Acked Read 7 Done Done Sent false
10652 3499 Acked Read 6 Done Done Sent false
10653 3500 Acked Write 9 Done Done Sent false
10654 3501 Acked Write 3 Done Done Sent false
10655 3502 Acked Write 8 Done Done Sent false
10656 3503 Acked Read 1 Done Done Sent false
10657 3504 Acked Write 7 Done Done Sent false
10658 3505 Acked Read 6 Done Done Sent false
10659 3506 Acked Write 4 Done Done Sent false
10660 3507 Acked Read 8 Done Done Sent false
10661 3508 Acked Flush 0 Done Done Sent false
10662 3509 Acked Write 3 Done Done Sent false
10663 3510 Acked Read 9 Done Done Sent false
10664 3511 Acked Write 9 Done Done Sent false
10665 3512 Acked Read 2 Done Done Sent false
10666 3513 Acked Read 3 Done Done Sent false
10667 3514 Acked Write 1 Done Done Sent false
10668 3515 Acked Read 4 Done Done Sent false
10669 3516 Acked Read 9 Done Done Sent false
10670 3517 Acked Write 3 Done Done Sent false
10671 3518 Acked Read 3 Done Done Sent false
10672 3519 Acked Read 5 Done Done Sent false
10673 3520 Acked Write 4 Done Done Sent false
10674 3521 Acked Read 3 Done Done Sent false
10675 3522 Acked Read 1 Done Done Sent false
10676 3523 Acked Read 4 Done Done Sent false
10677 3524 Acked Read 7 Done Done Sent false
10678 3525 Acked Read 9 Done Done Sent false
10679 3526 Acked Read 10 Done Done Sent false
10680 3527 Acked Read 3 Done Done Sent false
10681 3528 Acked Read 1 Done Done Sent false
10682 3529 Acked Read 9 Done Done Sent false
10683 3530 Acked Read 4 Done Done Sent false
10684 3531 Acked Write 5 Done Done Sent false
10685 3532 Acked Write 3 Done Done Sent false
10686 3533 Acked Write 2 Done Done Sent false
10687 3534 Acked Write 3 Done Done Sent false
10688 3535 Acked Read 9 Done Done Sent false
10689 3536 Acked Write 9 Done Done Sent false
10690 3537 Acked Read 7 Done Done Sent false
10691 3538 Acked Read 1 Done Done Sent false
10692 3539 Acked Write 5 Done Done Sent false
10693 3540 Acked Read 5 Done Done Sent false
10694 3541 Acked Read 8 Done Done Sent false
10695 3542 Acked Read 3 Done Done Sent false
10696 3543 Acked Read 6 Done Done Sent false
10697 3544 Acked Read 5 Done Done Sent false
10698 3545 Acked Write 1 Done Done Sent false
10699 3546 Acked Read 3 Done Done Sent false
10700 3547 Acked Read 5 Done Done Sent false
10701 3548 Acked Read 7 Done Done Sent false
10702 3549 Acked Read 8 Done Done Sent false
10703 3550 Acked Read 8 Done Done Sent false
10704 3551 Acked Read 1 Done Done Sent false
10705 3552 Acked Read 7 Done Done Sent false
10706 3553 Acked Write 2 Done Done Sent false
10707 3554 Acked Read 7 Done Done Sent false
10708 3555 Acked Read 2 Done Done Sent false
10709 3556 Acked Read 7 Done Done Sent false
10710 3557 Acked Read 6 Done Done Sent false
10711 3558 Acked Write 5 Done Done Sent false
10712 3559 Acked Read 7 Done Done Sent false
10713 3560 Acked Read 3 Done Done Sent false
10714 3561 Acked Write 7 Done Done Sent false
10715 3562 Acked Write 6 Done Done Sent false
10716 3563 Acked Write 5 Done Done Sent false
10717 3564 Acked Write 10 Done Done Sent false
10718 3565 Acked Read 7 Done Done Sent false
10719 3566 Acked Write 7 Done Done Sent false
10720 3567 Acked Write 5 Done Done Sent false
10721 3568 Acked Write 4 Done Done Sent false
10722 3569 Acked Write 2 Done Done Sent false
10723 3570 Acked Read 6 Done Done Sent false
10724 3571 Acked Read 7 Done Done Sent false
10725 3572 Acked Read 9 Done Done Sent false
10726 3573 Acked Write 1 Done Done Sent false
10727 3574 Acked Read 5 Done Done Sent false
10728 3575 Acked Read 1 Done Done Sent false
10729 3576 Acked Write 3 Done Done Sent false
10730 3577 Acked Write 5 Done Done Sent false
10731 3578 Acked Read 6 Done Done Sent false
10732 3579 Acked Read 7 Done Done Sent false
10733 3580 Acked Write 7 Done Done Sent false
10734 3581 Acked Write 9 Done Done Sent false
10735 3582 Acked Read 7 Done Done Sent false
10736 3583 Acked Read 4 Done Done Sent false
10737 3584 Acked Read 3 Done Done Sent false
10738 3585 Acked Read 10 Done Done Sent false
10739 3586 Acked Read 7 Done Done Sent false
10740 3587 Acked Read 10 Done Done Sent false
10741 3588 Acked Read 9 Done Done Sent false
10742 3589 Acked Write 7 Done Done Sent false
10743 3590 Acked Write 3 Done Done Sent false
10744 3591 Acked Read 3 Done Done Sent false
10745 3592 Acked Write 7 Done Done Sent false
10746 3593 Acked Read 7 Done Done Sent false
10747 3594 Acked Read 9 Done Done Sent false
10748 3595 Acked Write 10 Done Done Sent false
10749 3596 Acked Read 7 Done Done Sent false
10750 3597 Acked Write 10 Done Done Sent false
10751 3598 Acked Read 4 Done Done Sent false
10752 3599 Acked Read 4 Done Done Sent false
10753 3600 Acked Read 8 Done Done Sent false
10754 3601 Acked Write 10 Done Done Sent false
10755 3602 Acked Write 3 Done Done Sent false
10756 3603 Acked Write 8 Done Done Sent false
10757 3604 Acked Write 7 Done Done Sent false
10758 3605 Acked Write 2 Done Done Sent false
10759 3606 Acked Flush 0 Done Done Sent false
10760 3607 Acked Read 9 Done Done Sent false
10761 3608 Acked Write 10 Done Done Sent false
10762 3609 Acked Read 7 Done Done Sent false
10763 3610 Acked Write 10 Done Done Sent false
10764 3611 Acked Read 10 Done Done Sent false
10765 3612 Acked Read 4 Done Done Sent false
10766 3613 Acked Read 4 Done Done Sent false
10767 3614 Acked Write 4 Done Done Sent false
10768 3615 Acked Write 8 Done Done Sent false
10769 3616 Acked Write 9 Done Done Sent false
10770 3617 Acked Write 1 Done Done Sent false
10771 3618 Acked Write 8 Done Done Sent false
10772 3619 Acked Read 9 Done Done Sent false
10773 3620 Acked Write 10 Done Done Sent false
10774 3621 Acked Read 1 Done Done Sent false
10775 3622 Acked Write 8 Done Done Sent false
10776 3623 Acked Write 9 Done Done Sent false
10777 3624 Acked Write 8 Done Done Sent false
10778 3625 Acked Read 9 Done Done Sent false
10779 3626 Acked Read 2 Done Done Sent false
10780 3627 Acked Flush 0 Done Done Sent false
10781 3628 Acked Read 8 Done Done Sent false
10782 3629 Acked Write 8 Done Done Sent false
10783 3630 Acked Read 3 Done Done Sent false
10784 3631 Acked Write 6 Done Done Sent false
10785 3632 Acked Read 7 Done Done Sent false
10786 3633 Acked Read 9 Done Done Sent false
10787 3634 Acked Read 10 Done Done Sent false
10788 3635 Acked Read 3 Done Done Sent false
10789 3636 Acked Read 8 Done Done Sent false
10790 3637 Acked Flush 0 Done Done Sent false
10791 3638 Acked Read 10 Done Done Sent false
10792 3639 Acked Read 4 Done Done Sent false
10793 3640 Acked Read 1 Done Done Sent false
10794 3641 Acked Read 4 Done Done Sent false
10795 3642 Acked Read 1 Done Done Sent false
10796 3643 Acked Write 6 Done Done Sent false
10797 3644 Acked Write 5 Done Done Sent false
10798 3645 Acked Write 3 Done Done Sent false
10799 3646 Acked Flush 0 Done Done Sent false
10800 3647 Acked Flush 0 Done Done Sent false
10801 3648 Acked Write 7 Done Done Sent false
10802 3649 Acked Read 9 Done Done Sent false
10803 3650 Acked Read 10 Done Done Sent false
10804 3651 Acked Read 8 Done Done Sent false
10805 3652 Acked Read 10 Done Done Sent false
10806 3653 Acked Read 5 Done Done Sent false
10807 3654 Acked Write 3 Done Done Sent false
10808 3655 Acked Write 5 Done Done Sent false
10809 3656 Acked Write 3 Done Done Sent false
10810 3657 Acked Write 2 Done Done Sent false
10811 3658 Acked Write 1 Done Done Sent false
10812 3659 Acked Write 6 Done Done Sent false
10813 3660 Acked Write 2 Done Done Sent false
10814 3661 Acked Read 4 Done Done Sent false
10815 3662 Acked Write 8 Done Done Sent false
10816 3663 Acked Write 4 Done Done Sent false
10817 3664 Acked Flush 0 Done Done Sent false
10818 3665 Acked Read 5 Done Done Sent false
10819 3666 Acked Read 8 Done Done Sent false
10820 3667 Acked Read 1 Done Done Sent false
10821 3668 Acked Write 10 Done Done Sent false
10822 3669 Acked Write 4 Done Done Sent false
10823 3670 Acked Write 7 Done Done Sent false
10824 3671 Acked Read 3 Done Done Sent false
10825 3672 Acked Write 10 Done Done Sent false
10826 3673 Acked Write 4 Done Done Sent false
10827 3674 Acked Read 3 Done Done Sent false
10828 3675 Acked Flush 0 Done Done Sent false
10829 3676 Acked Flush 0 Done Done Sent false
10830 3677 Acked Read 7 Done Done Sent false
10831 3678 Acked Read 1 Done Done Sent false
10832 3679 Acked Write 10 Done Done Sent false
10833 3680 Acked Flush 0 Done Done Sent false
10834 3681 Acked Read 9 Done Done Sent false
10835 3682 Acked Read 4 Done Done Sent false
10836 3683 Acked Read 7 Done Done Sent false
10837 3684 Acked Read 8 Done Done Sent false
10838 3685 Acked Read 10 Done Done Sent false
10839 3686 Acked Write 6 Done Done Sent false
10840 3687 Acked Write 6 Done Done Sent false
10841 3688 Acked Read 10 Done Done Sent false
10842 3689 Acked Read 7 Done Done Sent false
10843 3690 Acked Write 8 Done Done Sent false
10844 3691 Acked Read 1 Done Done Sent false
10845 3692 Acked Write 3 Done Done Sent false
10846 3693 Acked Read 3 Done Done Sent false
10847 3694 Acked Write 4 Done Done Sent false
10848 3695 Acked Read 10 Done Done Sent false
10849 3696 Acked Write 7 Done Done Sent false
10850 3697 Acked Write 2 Done Done Sent false
10851 3698 Acked Read 9 Done Done Sent false
10852 3699 Acked Read 10 Done Done Sent false
10853 3700 Acked Write 6 Done Done Sent false
10854 3701 Acked Write 3 Done Done Sent false
10855 3702 Acked Read 9 Done Done Sent false
10856 3703 Acked Flush 0 Done Done Sent false
10857 3704 Acked Write 5 Done Done Sent false
10858 3705 Acked Read 2 Done Done Sent false
10859 3706 Acked Read 4 Done Done Sent false
10860 3707 Acked Write 9 Done Done Sent false
10861 3708 Acked Read 3 Done Done Sent false
10862 3709 Acked Flush 0 Done Done Sent false
10863 3710 Acked Write 1 Done Done Sent false
10864 3711 Acked Read 7 Done Done Sent false
10865 3712 Acked Write 3 Done Done Sent false
10866 3713 Acked Write 3 Done Done Sent false
10867 3714 Acked Read 8 Done Done Sent false
10868 3715 Acked Flush 0 Done Done Sent false
10869 STATES DS:0 DS:1 DS:2 TOTAL
10870 Sent 0 0 302 302
10871 Done 302 302 0 604
10872 Skipped 0 0 0 0
10873 Error 0 0 0 0
10874 Last Flush: 3715 3715 3413
10875 Downstairs last five completed: 3413 3412 3411 3410 3409
10876 Upstairs last five completed: 3715 3714 3713 3712 3711
10877 CLIENT: Up:0 ds:302 act:2
108782025-01-10T16:37:35.705ZINFOcrucible: connecting to 127.0.0.1:8830 = io task client = 2 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
108792025-01-10T16:37:35.705ZINFOcrucible: ds_connection connected from Ok(127.0.0.1:55030) = io task client = 2 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
108802025-01-10T16:37:35.706ZWARNcrucible: version negotiation from state Offline = downstairs client = 2 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
108812025-01-10T16:37:35.707ZINFOcrucible: downstairs client at Some(127.0.0.1:8830) has region UUID 12345678-0000-0000-0000-000000008830 = downstairs client = 2 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
108822025-01-10T16:37:35.707ZINFOcrucible: Returning UUID:12345678-0000-0000-0000-000000008830 matches = downstairs client = 2 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
108832025-01-10T16:37:35.707ZINFOcrucible: send last flush ID to this DS: 3413 = downstairs client = 2 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
108842025-01-10T16:37:35.707ZINFOcrucible: Replied this last flush ID: 3413 = downstairs client = 2 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
108852025-01-10T16:37:35.707ZINFOcrucible: ds_transition from Offline to Active = downstairs client = 2 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
108862025-01-10T16:37:35.707ZINFOcrucible: [2] Transition from Offline to Active = downstairs client = 2 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
108872025-01-10T16:37:35.707ZINFOcrucible: [2] client re-new 302 jobs since flush 3413 = downstairs session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
108882025-01-10T16:37:35.707ZINFOcrucible: [2] Replayed 302 jobs since flush: 3413 = downstairs session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
10889 ----------------------------------------------------------------
10890 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:0
10891 Downstairs last five completed: 3715 3714 3713 3712 3711
10892 Upstairs last five completed: 3715 3714 3713 3712 3711
10893 CLIENT: Up:0 ds:0 act:3
10894 Replay: All jobs finished
10895 Main task has work to do, go find it
10896 got dsc Stop(2)
10897 stop 2
10898 [8830] Got stop action so:false kr:false
10899 Jan 10 16:37:37.959 INFO request completed, latency_us: 332, response_code: 204, uri: /stop/cid/2, method: POST, req_id: 0ed283f7-21f7-4efd-a112-91b2ebc8d9f9, remote_addr: 127.0.0.1:55917, local_addr: 127.0.0.1:9998
109002025-01-10T16:37:37.960ZWARNcrucible: downstairs disconnected = io task client = 2 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
109012025-01-10T16:37:37.960ZWARNcrucible: client task is sending Done(Finished) = io task client = 2 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
109022025-01-10T16:37:37.960ZWARNcrucible: downstairs task for 2 stopped due to Finished session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
109032025-01-10T16:37:37.960ZINFOcrucible: ds_transition from Active to Offline = downstairs client = 2 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
109042025-01-10T16:37:37.960ZINFOcrucible: [2] Transition from Active to Offline = downstairs client = 2 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
10905 Jan 10 16:37:37.960 INFO request completed, latency_us: 147, response_code: 200, uri: /state/cid/2, method: GET, req_id: 32d4483d-1961-4bc2-8adf-3998815cd633, remote_addr: 127.0.0.1:55917, local_addr: 127.0.0.1:9998
109062025-01-10T16:37:37.960ZINFOcrucible: client task is exiting = io task client = 2 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
10907 [8830] Exited with: ExitStatus(unix_wait_status(9))
10908 [8830][2] reports Exit
10909 Jan 10 16:37:41.962 INFO request completed, latency_us: 225, response_code: 200, uri: /state/cid/2, method: GET, req_id: eff16831-439c-404c-a882-177d83654ed4, remote_addr: 127.0.0.1:55917, local_addr: 127.0.0.1:9998
10910 001/300 Write block 3965 len 4096 data: 3
10911 002/300 Read block 181 len 28672
10912 003/300 Read block 492 len 12288
10913 004/300 Write block 842 len 20480 data: 3 4 4 4 3
10914 005/300 Write block 987 len 4096 data: 4
10915 006/300 Read block 735 len 28672
10916 007/300 Read block 2793 len 8192
10917 008/300 Write block 2158 len 4096 data: 4
10918 009/300 Read block 2098 len 28672
10919 010/300 Read block 2184 len 12288
10920 011/300 Read block 1364 len 12288
10921 012/300 Read block 1355 len 16384
10922 013/300 Read block 586 len 20480
10923 014/300 Read block 2389 len 24576
10924 015/300 Read block 4982 len 12288
10925 016/300 Write block 3338 len 28672 data: 3 3 4 4 2 2 2
10926 017/300 Read block 353 len 20480
10927 018/300 Write block 4049 len 20480 data: 4 3 2 2 3
10928 019/300 Write block 4570 len 12288 data: 6 6 4
10929 020/300 Read block 731 len 4096
10930 021/300 Read block 3924 len 16384
10931 022/300 Flush
10932 023/300 Read block 4477 len 32768
10933 024/300 Write block 1337 len 4096 data: 6
10934 025/300 Write block 263 len 20480 data: 2 2 2 2 2
10935 026/300 Write block 369 len 12288 data: 4 4 4
10936 027/300 Write block 4800 len 12288 data: 3 3 5
10937 028/300 Read block 345 len 36864
10938 029/300 Write block 252 len 24576 data: 4 4 3 3 3 2
10939 030/300 Write block 875 len 28672 data: 3 2 4 4 4 4 4
10940 031/300 Read block 1690 len 20480
10941 032/300 Read block 1600 len 16384
10942 033/300 Read block 3011 len 20480
10943 034/300 Read block 3177 len 20480
10944 035/300 Read block 4880 len 8192
10945 036/300 Read block 4161 len 32768
10946 037/300 Read block 1905 len 36864
10947 038/300 Write block 3968 len 4096 data: 2
10948 039/300 Read block 3786 len 20480
10949 040/300 Write block 2139 len 16384 data: 3 2 2 2
10950 041/300 Read block 604 len 12288
10951 042/300 Read block 1301 len 24576
10952 043/300 Read block 4569 len 28672
10953 044/300 Write block 2866 len 36864 data: 5 5 5 4 3 3 4 4 4
10954 045/300 Read block 2803 len 32768
10955 046/300 Flush
10956 047/300 Read block 4910 len 32768
10957 048/300 Read block 4479 len 4096
10958 049/300 Write block 950 len 36864 data: 4 5 5 5 5 5 4 3 2
10959 050/300 Read block 3194 len 24576
10960 051/300 Read block 4924 len 12288
10961 052/300 Write block 2919 len 28672 data: 2 2 2 2 3 3 2
10962 053/300 Read block 385 len 36864
10963 054/300 Read block 2679 len 28672
10964 055/300 Read block 1297 len 20480
10965 056/300 Read block 1562 len 16384
10966 057/300 Write block 471 len 40960 data: 2 2 2 2 2 2 2 2 2 4
10967 058/300 Read block 2416 len 40960
10968 059/300 Read block 1229 len 16384
10969 060/300 Read block 4640 len 16384
10970 061/300 Write block 2938 len 16384 data: 5 4 4 4
10971 062/300 Read block 453 len 24576
10972 063/300 Read block 133 len 40960
10973 064/300 Read block 3141 len 40960
10974 065/300 Write block 2332 len 36864 data: 4 4 4 4 3 3 2 3 3
10975 066/300 Write block 625 len 12288 data: 3 4 3
10976 067/300 Read block 2627 len 24576
10977 068/300 Read block 4459 len 16384
10978 069/300 Write block 2384 len 36864 data: 2 2 2 3 3 3 2 2 2
10979 070/300 Write block 1185 len 4096 data: 5
10980 071/300 Read block 2810 len 12288
10981 072/300 Write block 1808 len 28672 data: 2 2 2 3 3 3 3
10982 073/300 Flush
10983 074/300 Read block 3211 len 20480
10984 075/300 Read block 380 len 8192
10985 076/300 Write block 4903 len 28672 data: 4 3 2 2 2 2 2
10986 077/300 Write block 679 len 32768 data: 6 7 7 7 6 5 4 3
10987 078/300 Write block 4395 len 36864 data: 3 3 3 3 4 4 2 2 2
10988 079/300 Read block 931 len 32768
10989 080/300 Read block 253 len 4096
10990 081/300 Read block 2722 len 36864
10991 082/300 Write block 3794 len 4096 data: 2
10992 083/300 Read block 1628 len 4096
10993 084/300 Flush
10994 085/300 Write block 1404 len 4096 data: 2
10995 086/300 Read block 1217 len 12288
10996 087/300 Read block 2633 len 12288
10997 088/300 Write block 310 len 28672 data: 4 3 2 2 2 3 3
10998 089/300 Flush
10999 090/300 Read block 2113 len 12288
11000 091/300 Read block 4956 len 16384
11001 092/300 Read block 2841 len 24576
11002 093/300 Flush
11003 094/300 Read block 3777 len 8192
11004 095/300 Flush
11005 096/300 Read block 596 len 32768
11006 097/300 Read block 2230 len 40960
11007 098/300 Write block 4822 len 24576 data: 3 3 2 2 3 3
11008 099/300 Read block 465 len 16384
11009 100/300 Read block 1357 len 40960
11010 101/300 Read block 4827 len 20480
11011 102/300 Read block 2816 len 16384
11012 103/300 Read block 112 len 36864
11013 104/300 Write block 497 len 4096 data: 4
11014 105/300 Write block 3024 len 20480 data: 3 3 3 2 2
11015 106/300 Read block 836 len 28672
11016 107/300 Write block 4295 len 4096 data: 4
11017 108/300 Read block 1548 len 24576
11018 109/300 Write block 582 len 12288 data: 3 3 3
11019 110/300 Read block 3706 len 16384
11020 111/300 Write block 211 len 12288 data: 5 6 6
11021 112/300 Read block 4192 len 24576
11022 113/300 Read block 2534 len 36864
11023 114/300 Flush
11024 115/300 Write block 4356 len 28672 data: 2 2 2 2 2 2 2
11025 116/300 Flush
11026 117/300 Read block 2234 len 16384
11027 118/300 Write block 3561 len 8192 data: 2 2
11028 119/300 Write block 3302 len 8192 data: 3 3
11029 120/300 Read block 3908 len 8192
11030 121/300 Write block 2545 len 4096 data: 2
11031 122/300 Write block 1063 len 20480 data: 4 4 3 3 3
11032 123/300 Write block 117 len 16384 data: 3 3 4 5
11033 124/300 Read block 152 len 24576
11034 125/300 Read block 4429 len 12288
11035 126/300 Read block 3374 len 36864
11036 127/300 Read block 201 len 20480
11037 128/300 Read block 275 len 40960
11038 129/300 Write block 2835 len 32768 data: 4 5 3 3 3 2 2 3
11039 130/300 Write block 2839 len 8192 data: 4 3
11040 131/300 Read block 777 len 24576
11041 132/300 Flush
11042 133/300 Flush
11043 134/300 Read block 4374 len 20480
11044 135/300 Read block 207 len 40960
11045 136/300 Write block 3167 len 36864 data: 4 4 4 4 4 2 2 2 2
11046 137/300 Read block 3836 len 12288
11047 138/300 Read block 872 len 12288
11048 139/300 Write block 3351 len 20480 data: 2 3 3 2 2
11049 140/300 Read block 1199 len 40960
11050 141/300 Read block 4778 len 36864
11051 142/300 Write block 1331 len 28672 data: 5 5 5 4 5 5 7
11052 143/300 Read block 4117 len 8192
11053 144/300 Flush
11054 145/300 Write block 3196 len 12288 data: 5 5 4
11055 146/300 Read block 47 len 4096
11056 147/300 Write block 3620 len 8192 data: 2 2
11057 148/300 Read block 2224 len 24576
11058 149/300 Read block 796 len 8192
11059 150/300 Write block 3877 len 20480 data: 2 2 2 3 3
11060 151/300 Write block 2031 len 36864 data: 3 3 3 4 4 4 5 6 5
11061 152/300 Read block 3537 len 24576
11062 153/300 Read block 2038 len 24576
11063 154/300 Read block 4887 len 20480
11064 155/300 Write block 1181 len 32768 data: 5 5 4 4 6 5 4 4
11065 156/300 Read block 2430 len 36864
11066 157/300 Read block 4945 len 40960
11067 158/300 Write block 4140 len 4096 data: 3
11068 159/300 Write block 4309 len 32768 data: 3 3 2 2 2 2 2 2
11069 160/300 Read block 982 len 36864
11070 161/300 Read block 669 len 12288
11071 162/300 Write block 4708 len 20480 data: 3 3 3 3 3
11072 163/300 Read block 2346 len 4096
11073 164/300 Read block 1243 len 12288
11074 165/300 Read block 4016 len 28672
11075 166/300 Read block 4766 len 32768
11076 167/300 Read block 3777 len 32768
11077 168/300 Read block 140 len 4096
11078 169/300 Write block 18 len 36864 data: 4 3 3 3 2 2 3 3 3
11079 170/300 Read block 426 len 36864
11080 171/300 Read block 1939 len 12288
11081 172/300 Read block 149 len 20480
11082 173/300 Write block 2200 len 8192 data: 3 2
11083 174/300 Write block 4915 len 12288 data: 2 2 2
11084 175/300 Read block 3652 len 24576
11085 176/300 Write block 2381 len 40960 data: 2 2 2 3 3 3 4 4 4 3
11086 177/300 Write block 3077 len 36864 data: 2 2 2 2 2 2 2 2 3
11087 178/300 Write block 421 len 24576 data: 2 2 2 2 2 2
11088 179/300 Flush
11089 180/300 Flush
11090 181/300 Read block 948 len 28672
11091 182/300 Write block 1686 len 36864 data: 3 2 2 2 2 3 3 3 3
11092 183/300 Read block 601 len 24576
11093 184/300 Write block 4248 len 28672 data: 2 2 2 2 2 2 2
11094 185/300 Read block 1980 len 36864
11095 186/300 Read block 2072 len 8192
11096 187/300 Read block 3707 len 40960
11097 188/300 Read block 2169 len 32768
11098 189/300 Write block 325 len 8192 data: 2 2
11099 190/300 Write block 3080 len 28672 data: 3 3 3 3 3 4 4
11100 191/300 Read block 3791 len 28672
11101 192/300 Read block 4483 len 28672
11102 193/300 Read block 1017 len 4096
11103 194/300 Read block 2427 len 4096
11104 195/300 Write block 3047 len 20480 data: 2 2 2 2 2
11105 196/300 Write block 3407 len 12288 data: 2 2 2
11106 197/300 Flush
11107 198/300 Write block 641 len 28672 data: 2 2 4 4 5 4 5
11108 199/300 Write block 3398 len 40960 data: 4 4 4 3 2 3 3 2 2 3
11109 200/300 Read block 3821 len 8192
11110 201/300 Read block 698 len 16384
11111 202/300 Write block 877 len 40960 data: 5 5 5 5 5 5 5 5 4 4
11112 203/300 Write block 485 len 16384 data: 2 2 2 2
11113 204/300 Read block 1082 len 32768
11114 205/300 Read block 1759 len 20480
11115 206/300 Read block 2687 len 32768
11116 207/300 Write block 4087 len 36864 data: 2 3 3 4 4 4 4 4 4
11117 208/300 Read block 2166 len 12288
11118 209/300 Write block 3092 len 40960 data: 4 4 4 2 2 2 2 2 2 2
11119 210/300 Write block 4162 len 32768 data: 4 3 3 5 5 4 4 4
11120 211/300 Flush
11121 212/300 Read block 1664 len 8192
11122 213/300 Write block 1961 len 12288 data: 2 2 2
11123 214/300 Read block 2963 len 4096
11124 215/300 Write block 3814 len 4096 data: 2
11125 216/300 Write block 4575 len 28672 data: 3 5 5 4 5 4 4
11126 217/300 Read block 4127 len 40960
11127 218/300 Write block 3967 len 36864 data: 3 3 2 2 3 2 2 2 2
11128 219/300 Write block 1825 len 36864 data: 3 3 4 4 4 3 3 4 4
11129 220/300 Write block 2128 len 28672 data: 4 3 3 3 4 4 4
11130 221/300 Flush
11131 222/300 Read block 1472 len 20480
11132 223/300 Read block 2710 len 28672
11133 224/300 Write block 165 len 4096 data: 2
11134 225/300 Read block 4652 len 28672
11135 226/300 Flush
11136 227/300 Read block 2996 len 20480
11137 228/300 Read block 3307 len 16384
11138 229/300 Flush
11139 230/300 Flush
11140 231/300 Write block 1933 len 12288 data: 3 2 3
11141 232/300 Write block 3821 len 20480 data: 2 2 2 2 3
11142 233/300 Read block 1265 len 20480
11143 234/300 Read block 28 len 24576
11144 235/300 Flush
11145 236/300 Read block 3290 len 12288
11146 237/300 Write block 4311 len 28672 data: 3 3 3 3 3 3 2
11147 238/300 Write block 3605 len 36864 data: 3 4 4 4 3 2 2 2 2
11148 239/300 Read block 4856 len 4096
11149 240/300 Write block 3501 len 32768 data: 2 2 3 2 2 2 2 2
11150 241/300 Read block 4969 len 24576
11151 242/300 Read block 520 len 24576
11152 243/300 Write block 1743 len 32768 data: 4 4 3 3 3 3 3 4
11153 244/300 Write block 3669 len 36864 data: 2 3 2 2 3 3 3 3 3
11154 245/300 Flush
11155 246/300 Write block 1471 len 24576 data: 5 5 3 3 3 3
11156 247/300 Write block 2037 len 24576 data: 6 7 6 5 5 4
11157 248/300 Write block 3031 len 36864 data: 2 2 2 2 2 2 2 2 2
11158 249/300 Read block 2897 len 36864
11159 250/300 Read block 204 len 24576
11160 251/300 Write block 4826 len 20480 data: 4 4 3 4 4
11161 252/300 Read block 2403 len 24576
11162 253/300 Read block 2347 len 4096
11163 254/300 Write block 1384 len 28672 data: 4 3 2 3 4 4 4
11164 255/300 Read block 3609 len 36864
11165 256/300 Flush
11166 257/300 Write block 2121 len 28672 data: 4 4 4 2 2 2 2
11167 258/300 Write block 3861 len 12288 data: 3 4 4
11168 259/300 Read block 2175 len 16384
11169 260/300 Read block 468 len 16384
11170 261/300 Read block 1496 len 8192
11171 262/300 Write block 2963 len 4096 data: 3
11172 263/300 Write block 4528 len 28672 data: 4 4 5 6 6 5 3
11173 264/300 Read block 1568 len 28672
11174 265/300 Write block 1332 len 32768 data: 6 6 5 6 6 8 6 5
11175 266/300 Read block 2656 len 40960
11176 267/300 Read block 1676 len 20480
11177 268/300 Read block 1958 len 20480
11178 269/300 Read block 2583 len 20480
11179 270/300 Write block 1352 len 8192 data: 4 4
11180 271/300 Read block 3766 len 20480
11181 272/300 Read block 3774 len 16384
11182 273/300 Read block 3779 len 8192
11183 274/300 Flush
11184 275/300 Write block 4629 len 40960 data: 5 4 5 3 3 3 3 3 2 2
11185 276/300 Read block 1807 len 12288
11186 277/300 Read block 4723 len 36864
11187 278/300 Flush
11188 279/300 Read block 4669 len 16384
11189 280/300 Write block 2114 len 4096 data: 3
11190 281/300 Read block 1458 len 4096
11191 282/300 Flush
11192 283/300 Read block 1424 len 36864
11193 284/300 Read block 3826 len 32768
11194 285/300 Write block 195 len 36864 data: 4 4 4 4 4 4 4 5 3
11195 286/300 Read block 4246 len 8192
11196 287/300 Read block 1552 len 28672
11197 288/300 Write block 4781 len 40960 data: 3 2 2 2 2 2 2 2 2 2
11198 289/300 Flush
11199 290/300 Write block 4896 len 12288 data: 3 2 2
11200 291/300 Write block 2954 len 28672 data: 5 5 3 3 2 2 2
11201 292/300 Write block 158 len 40960 data: 2 2 3 3 4 3 2 3 2 2
11202 293/300 Flush
11203 294/300 Flush
11204 295/300 Read block 1348 len 40960
11205 296/300 Write block 102 len 32768 data: 3 3 3 3 3 3 2 2
11206 297/300 Write block 3361 len 8192 data: 2 2
11207 298/300 Write block 1439 len 12288 data: 2 2 3
11208 299/300 Write block 2831 len 36864 data: 3 4 3 4 5 6 4 4 5
11209 300/300 Write block 1885 len 16384 data: 3 3 2 3
11210 301/300 Read block 2331 len 8192
11211 Main task has work to do, go find it
11212 got dsc Start(2)
11213 start 2
11214 Jan 10 16:37:42.204 INFO request completed, latency_us: 207, response_code: 204, uri: /start/cid/2, method: POST, req_id: 8b2d7664-b486-4132-b7a9-7c6cb0e99ed7, remote_addr: 127.0.0.1:55917, local_addr: 127.0.0.1:9998
11215 Replay: started 2, returned:Ok(())
11216 ----------------------------------------------------------------
11217 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:301
11218 States: Active Active Offline
11219 JOBID ACK TYPE BKS/EXT DS:0 DS:1 DS:2 REPLAY
11220 3716 Acked Write 1 Done Done Sent false
11221 3717 Acked Read 7 Done Done Sent false
11222 3718 Acked Read 3 Done Done Sent false
11223 3719 Acked Write 5 Done Done Sent false
11224 3720 Acked Write 1 Done Done Sent false
11225 3721 Acked Read 7 Done Done Sent false
11226 3722 Acked Read 2 Done Done Sent false
11227 3723 Acked Write 1 Done Done Sent false
11228 3724 Acked Read 7 Done Done Sent false
11229 3725 Acked Read 3 Done Done Sent false
11230 3726 Acked Read 3 Done Done Sent false
11231 3727 Acked Read 4 Done Done Sent false
11232 3728 Acked Read 5 Done Done Sent false
11233 3729 Acked Read 6 Done Done Sent false
11234 3730 Acked Read 3 Done Done Sent false
11235 3731 Acked Write 7 Done Done Sent false
11236 3732 Acked Read 5 Done Done Sent false
11237 3733 Acked Write 5 Done Done Sent false
11238 3734 Acked Write 3 Done Done Sent false
11239 3735 Acked Read 1 Done Done Sent false
11240 3736 Acked Read 4 Done Done Sent false
11241 3737 Acked Flush 0 Done Done Sent false
11242 3738 Acked Read 8 Done Done Sent false
11243 3739 Acked Write 1 Done Done Sent false
11244 3740 Acked Write 5 Done Done Sent false
11245 3741 Acked Write 3 Done Done Sent false
11246 3742 Acked Write 3 Done Done Sent false
11247 3743 Acked Read 9 Done Done Sent false
11248 3744 Acked Write 6 Done Done Sent false
11249 3745 Acked Write 7 Done Done Sent false
11250 3746 Acked Read 5 Done Done Sent false
11251 3747 Acked Read 4 Done Done Sent false
11252 3748 Acked Read 5 Done Done Sent false
11253 3749 Acked Read 5 Done Done Sent false
11254 3750 Acked Read 2 Done Done Sent false
11255 3751 Acked Read 8 Done Done Sent false
11256 3752 Acked Read 9 Done Done Sent false
11257 3753 Acked Write 1 Done Done Sent false
11258 3754 Acked Read 5 Done Done Sent false
11259 3755 Acked Write 4 Done Done Sent false
11260 3756 Acked Read 3 Done Done Sent false
11261 3757 Acked Read 6 Done Done Sent false
11262 3758 Acked Read 7 Done Done Sent false
11263 3759 Acked Write 9 Done Done Sent false
11264 3760 Acked Read 8 Done Done Sent false
11265 3761 Acked Flush 0 Done Done Sent false
11266 3762 Acked Read 8 Done Done Sent false
11267 3763 Acked Read 1 Done Done Sent false
11268 3764 Acked Write 9 Done Done Sent false
11269 3765 Acked Read 6 Done Done Sent false
11270 3766 Acked Read 3 Done Done Sent false
11271 3767 Acked Write 7 Done Done Sent false
11272 3768 Acked Read 9 Done Done Sent false
11273 3769 Acked Read 7 Done Done Sent false
11274 3770 Acked Read 5 Done Done Sent false
11275 3771 Acked Read 4 Done Done Sent false
11276 3772 Acked Write 10 Done Done Sent false
11277 3773 Acked Read 10 Done Done Sent false
11278 3774 Acked Read 4 Done Done Sent false
11279 3775 Acked Read 4 Done Done Sent false
11280 3776 Acked Write 4 Done Done Sent false
11281 3777 Acked Read 6 Done Done Sent false
11282 3778 Acked Read 10 Done Done Sent false
11283 3779 Acked Read 10 Done Done Sent false
11284 3780 Acked Write 9 Done Done Sent false
11285 3781 Acked Write 3 Done Done Sent false
11286 3782 Acked Read 6 Done Done Sent false
11287 3783 Acked Read 4 Done Done Sent false
11288 3784 Acked Write 9 Done Done Sent false
11289 3785 Acked Write 1 Done Done Sent false
11290 3786 Acked Read 3 Done Done Sent false
11291 3787 Acked Write 7 Done Done Sent false
11292 3788 Acked Flush 0 Done Done Sent false
11293 3789 Acked Read 5 Done Done Sent false
11294 3790 Acked Read 2 Done Done Sent false
11295 3791 Acked Write 7 Done Done Sent false
11296 3792 Acked Write 8 Done Done Sent false
11297 3793 Acked Write 9 Done Done Sent false
11298 3794 Acked Read 8 Done Done Sent false
11299 3795 Acked Read 1 Done Done Sent false
11300 3796 Acked Read 9 Done Done Sent false
11301 3797 Acked Write 1 Done Done Sent false
11302 3798 Acked Read 1 Done Done Sent false
11303 3799 Acked Flush 0 Done Done Sent false
11304 3800 Acked Write 1 Done Done Sent false
11305 3801 Acked Read 3 Done Done Sent false
11306 3802 Acked Read 3 Done Done Sent false
11307 3803 Acked Write 7 Done Done Sent false
11308 3804 Acked Flush 0 Done Done Sent false
11309 3805 Acked Read 3 Done Done Sent false
11310 3806 Acked Read 4 Done Done Sent false
11311 3807 Acked Read 6 Done Done Sent false
11312 3808 Acked Flush 0 Done Done Sent false
11313 3809 Acked Read 2 Done Done Sent false
11314 3810 Acked Flush 0 Done Done Sent false
11315 3811 Acked Read 8 Done Done Sent false
11316 3812 Acked Read 10 Done Done Sent false
11317 3813 Acked Write 6 Done Done Sent false
11318 3814 Acked Read 4 Done Done Sent false
11319 3815 Acked Read 10 Done Done Sent false
11320 3816 Acked Read 5 Done Done Sent false
11321 3817 Acked Read 4 Done Done Sent false
11322 3818 Acked Read 9 Done Done Sent false
11323 3819 Acked Write 1 Done Done Sent false
11324 3820 Acked Write 5 Done Done Sent false
11325 3821 Acked Read 7 Done Done Sent false
11326 3822 Acked Write 1 Done Done Sent false
11327 3823 Acked Read 6 Done Done Sent false
11328 3824 Acked Write 3 Done Done Sent false
11329 3825 Acked Read 4 Done Done Sent false
11330 3826 Acked Write 3 Done Done Sent false
11331 3827 Acked Read 6 Done Done Sent false
11332 3828 Acked Read 9 Done Done Sent false
11333 3829 Acked Flush 0 Done Done Sent false
11334 3830 Acked Write 7 Done Done Sent false
11335 3831 Acked Flush 0 Done Done Sent false
11336 3832 Acked Read 4 Done Done Sent false
11337 3833 Acked Write 2 Done Done Sent false
11338 3834 Acked Write 2 Done Done Sent false
11339 3835 Acked Read 2 Done Done Sent false
11340 3836 Acked Write 1 Done Done Sent false
11341 3837 Acked Write 5 Done Done Sent false
11342 3838 Acked Write 4 Done Done Sent false
11343 3839 Acked Read 6 Done Done Sent false
11344 3840 Acked Read 3 Done Done Sent false
11345 3841 Acked Read 9 Done Done Sent false
11346 3842 Acked Read 5 Done Done Sent false
11347 3843 Acked Read 10 Done Done Sent false
11348 3844 Acked Write 8 Done Done Sent false
11349 3845 Acked Write 2 Done Done Sent false
11350 3846 Acked Read 6 Done Done Sent false
11351 3847 Acked Flush 0 Done Done Sent false
11352 3848 Acked Flush 0 Done Done Sent false
11353 3849 Acked Read 5 Done Done Sent false
11354 3850 Acked Read 10 Done Done Sent false
11355 3851 Acked Write 9 Done Done Sent false
11356 3852 Acked Read 3 Done Done Sent false
11357 3853 Acked Read 3 Done Done Sent false
11358 3854 Acked Write 5 Done Done Sent false
11359 3855 Acked Read 10 Done Done Sent false
11360 3856 Acked Read 9 Done Done Sent false
11361 3857 Acked Write 7 Done Done Sent false
11362 3858 Acked Read 2 Done Done Sent false
11363 3859 Acked Flush 0 Done Done Sent false
11364 3860 Acked Write 3 Done Done Sent false
11365 3861 Acked Read 1 Done Done Sent false
11366 3862 Acked Write 2 Done Done Sent false
11367 3863 Acked Read 6 Done Done Sent false
11368 3864 Acked Read 2 Done Done Sent false
11369 3865 Acked Write 5 Done Done Sent false
11370 3866 Acked Write 9 Done Done Sent false
11371 3867 Acked Read 6 Done Done Sent false
11372 3868 Acked Read 6 Done Done Sent false
11373 3869 Acked Read 5 Done Done Sent false
11374 3870 Acked Write 8 Done Done Sent false
11375 3871 Acked Read 9 Done Done Sent false
11376 3872 Acked Read 10 Done Done Sent false
11377 3873 Acked Write 1 Done Done Sent false
11378 3874 Acked Write 8 Done Done Sent false
11379 3875 Acked Read 9 Done Done Sent false
11380 3876 Acked Read 3 Done Done Sent false
11381 3877 Acked Write 5 Done Done Sent false
11382 3878 Acked Read 1 Done Done Sent false
11383 3879 Acked Read 3 Done Done Sent false
11384 3880 Acked Read 7 Done Done Sent false
11385 3881 Acked Read 8 Done Done Sent false
11386 3882 Acked Read 8 Done Done Sent false
11387 3883 Acked Read 1 Done Done Sent false
11388 3884 Acked Write 9 Done Done Sent false
11389 3885 Acked Read 9 Done Done Sent false
11390 3886 Acked Read 3 Done Done Sent false
11391 3887 Acked Read 5 Done Done Sent false
11392 3888 Acked Write 2 Done Done Sent false
11393 3889 Acked Write 3 Done Done Sent false
11394 3890 Acked Read 6 Done Done Sent false
11395 3891 Acked Write 10 Done Done Sent false
11396 3892 Acked Write 9 Done Done Sent false
11397 3893 Acked Write 6 Done Done Sent false
11398 3894 Acked Flush 0 Done Done Sent false
11399 3895 Acked Flush 0 Done Done Sent false
11400 3896 Acked Read 7 Done Done Sent false
11401 3897 Acked Write 9 Done Done Sent false
11402 3898 Acked Read 6 Done Done Sent false
11403 3899 Acked Write 7 Done Done Sent false
11404 3900 Acked Read 9 Done Done Sent false
11405 3901 Acked Read 2 Done Done Sent false
11406 3902 Acked Read 10 Done Done Sent false
11407 3903 Acked Read 8 Done Done Sent false
11408 3904 Acked Write 2 Done Done Sent false
11409 3905 Acked Write 7 Done Done Sent false
11410 3906 Acked Read 7 Done Done Sent false
11411 3907 Acked Read 7 Done Done Sent false
11412 3908 Acked Read 1 Done Done Sent false
11413 3909 Acked Read 1 Done Done Sent false
11414 3910 Acked Write 5 Done Done Sent false
11415 3911 Acked Write 3 Done Done Sent false
11416 3912 Acked Flush 0 Done Done Sent false
11417 3913 Acked Write 7 Done Done Sent false
11418 3914 Acked Write 10 Done Done Sent false
11419 3915 Acked Read 2 Done Done Sent false
11420 3916 Acked Read 4 Done Done Sent false
11421 3917 Acked Write 10 Done Done Sent false
11422 3918 Acked Write 4 Done Done Sent false
11423 3919 Acked Read 8 Done Done Sent false
11424 3920 Acked Read 5 Done Done Sent false
11425 3921 Acked Read 8 Done Done Sent false
11426 3922 Acked Write 9 Done Done Sent false
11427 3923 Acked Read 3 Done Done Sent false
11428 3924 Acked Write 10 Done Done Sent false
11429 3925 Acked Write 8 Done Done Sent false
11430 3926 Acked Flush 0 Done Done Sent false
11431 3927 Acked Read 2 Done Done Sent false
11432 3928 Acked Write 3 Done Done Sent false
11433 3929 Acked Read 1 Done Done Sent false
11434 3930 Acked Write 1 Done Done Sent false
11435 3931 Acked Write 7 Done Done Sent false
11436 3932 Acked Read 10 Done Done Sent false
11437 3933 Acked Write 9 Done Done Sent false
11438 3934 Acked Write 9 Done Done Sent false
11439 3935 Acked Write 7 Done Done Sent false
11440 3936 Acked Flush 0 Done Done Sent false
11441 3937 Acked Read 5 Done Done Sent false
11442 3938 Acked Read 7 Done Done Sent false
11443 3939 Acked Write 1 Done Done Sent false
11444 3940 Acked Read 7 Done Done Sent false
11445 3941 Acked Flush 0 Done Done Sent false
11446 3942 Acked Read 5 Done Done Sent false
11447 3943 Acked Read 4 Done Done Sent false
11448 3944 Acked Flush 0 Done Done Sent false
11449 3945 Acked Flush 0 Done Done Sent false
11450 3946 Acked Write 3 Done Done Sent false
11451 3947 Acked Write 5 Done Done Sent false
11452 3948 Acked Read 5 Done Done Sent false
11453 3949 Acked Read 6 Done Done Sent false
11454 3950 Acked Flush 0 Done Done Sent false
11455 3951 Acked Read 3 Done Done Sent false
11456 3952 Acked Write 7 Done Done Sent false
11457 3953 Acked Write 9 Done Done Sent false
11458 3954 Acked Read 1 Done Done Sent false
11459 3955 Acked Write 8 Done Done Sent false
11460 3956 Acked Read 6 Done Done Sent false
11461 3957 Acked Read 6 Done Done Sent false
11462 3958 Acked Write 8 Done Done Sent false
11463 3959 Acked Write 9 Done Done Sent false
11464 3960 Acked Flush 0 Done Done Sent false
11465 3961 Acked Write 6 Done Done Sent false
11466 3962 Acked Write 6 Done Done Sent false
11467 3963 Acked Write 9 Done Done Sent false
11468 3964 Acked Read 9 Done Done Sent false
11469 3965 Acked Read 6 Done Done Sent false
11470 3966 Acked Write 5 Done Done Sent false
11471 3967 Acked Read 6 Done Done Sent false
11472 3968 Acked Read 1 Done Done Sent false
11473 3969 Acked Write 7 Done Done Sent false
11474 3970 Acked Read 9 Done Done Sent false
11475 3971 Acked Flush 0 Done Done Sent false
11476 3972 Acked Write 7 Done Done Sent false
11477 3973 Acked Write 3 Done Done Sent false
11478 3974 Acked Read 4 Done Done Sent false
11479 3975 Acked Read 4 Done Done Sent false
11480 3976 Acked Read 2 Done Done Sent false
11481 3977 Acked Write 1 Done Done Sent false
11482 3978 Acked Write 7 Done Done Sent false
11483 3979 Acked Read 7 Done Done Sent false
11484 3980 Acked Write 8 Done Done Sent false
11485 3981 Acked Read 10 Done Done Sent false
11486 3982 Acked Read 5 Done Done Sent false
11487 3983 Acked Read 5 Done Done Sent false
11488 3984 Acked Read 5 Done Done Sent false
11489 3985 Acked Write 2 Done Done Sent false
11490 3986 Acked Read 5 Done Done Sent false
11491 3987 Acked Read 4 Done Done Sent false
11492 3988 Acked Read 2 Done Done Sent false
11493 3989 Acked Flush 0 Done Done Sent false
11494 3990 Acked Write 10 Done Done Sent false
11495 3991 Acked Read 3 Done Done Sent false
11496 3992 Acked Read 9 Done Done Sent false
11497 3993 Acked Flush 0 Done Done Sent false
11498 3994 Acked Read 4 Done Done Sent false
11499 3995 Acked Write 1 Done Done Sent false
11500 3996 Acked Read 1 Done Done Sent false
11501 3997 Acked Flush 0 Done Done Sent false
11502 3998 Acked Read 9 Done Done Sent false
11503 3999 Acked Read 8 Done Done Sent false
11504 4000 Acked Write 9 Done Done Sent false
11505 4001 Acked Read 2 Done Done Sent false
11506 4002 Acked Read 7 Done Done Sent false
11507 4003 Acked Write 10 Done Done Sent false
11508 4004 Acked Flush 0 Done Done Sent false
11509 4005 Acked Write 3 Done Done Sent false
11510 4006 Acked Write 7 Done Done Sent false
11511 4007 Acked Write 10 Done Done Sent false
11512 4008 Acked Flush 0 Done Done Sent false
11513 4009 Acked Flush 0 Done Done Sent false
11514 4010 Acked Read 10 Done Done Sent false
11515 4011 Acked Write 8 Done Done Sent false
11516 4012 Acked Write 2 Done Done Sent false
11517 4013 Acked Write 3 Done Done Sent false
11518 4014 Acked Write 9 Done Done Sent false
11519 4015 Acked Write 4 Done Done Sent false
11520 4016 Acked Read 2 Done Done Sent false
11521 STATES DS:0 DS:1 DS:2 TOTAL
11522 Sent 0 0 301 301
11523 Done 301 301 0 602
11524 Skipped 0 0 0 0
11525 Error 0 0 0 0
11526 Last Flush: 4009 4009 3715
11527 Downstairs last five completed: 3715 3714 3713 3712 3711
11528 Upstairs last five completed: 4016 4015 4014 4013 4012
11529 CLIENT: Up:0 ds:301 act:2
11530 [8830] got start action
11531 [8830] I am going to restart
11532 Starting downstairs at port 8830
11533 Make output file at "/tmp/dsc/downstairs-8830.txt"
11534 [8830][2] reports Starting
11535 Downstairs /var/tmp/dsc/region/8830 port 8830 PID:Some(1212)
11536 [8830][2] reports Running
11537 ----------------------------------------------------------------
11538 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:302
11539 States: Active Active Offline
11540 JOBID ACK TYPE BKS/EXT DS:0 DS:1 DS:2 REPLAY
11541 3716 Acked Write 1 Done Done Sent false
11542 3717 Acked Read 7 Done Done Sent false
11543 3718 Acked Read 3 Done Done Sent false
11544 3719 Acked Write 5 Done Done Sent false
11545 3720 Acked Write 1 Done Done Sent false
11546 3721 Acked Read 7 Done Done Sent false
11547 3722 Acked Read 2 Done Done Sent false
11548 3723 Acked Write 1 Done Done Sent false
11549 3724 Acked Read 7 Done Done Sent false
11550 3725 Acked Read 3 Done Done Sent false
11551 3726 Acked Read 3 Done Done Sent false
11552 3727 Acked Read 4 Done Done Sent false
11553 3728 Acked Read 5 Done Done Sent false
11554 3729 Acked Read 6 Done Done Sent false
11555 3730 Acked Read 3 Done Done Sent false
11556 3731 Acked Write 7 Done Done Sent false
11557 3732 Acked Read 5 Done Done Sent false
11558 3733 Acked Write 5 Done Done Sent false
11559 3734 Acked Write 3 Done Done Sent false
11560 3735 Acked Read 1 Done Done Sent false
11561 3736 Acked Read 4 Done Done Sent false
11562 3737 Acked Flush 0 Done Done Sent false
11563 3738 Acked Read 8 Done Done Sent false
11564 3739 Acked Write 1 Done Done Sent false
11565 3740 Acked Write 5 Done Done Sent false
11566 3741 Acked Write 3 Done Done Sent false
11567 3742 Acked Write 3 Done Done Sent false
11568 3743 Acked Read 9 Done Done Sent false
11569 3744 Acked Write 6 Done Done Sent false
11570 3745 Acked Write 7 Done Done Sent false
11571 3746 Acked Read 5 Done Done Sent false
11572 3747 Acked Read 4 Done Done Sent false
11573 3748 Acked Read 5 Done Done Sent false
11574 3749 Acked Read 5 Done Done Sent false
11575 3750 Acked Read 2 Done Done Sent false
11576 3751 Acked Read 8 Done Done Sent false
11577 3752 Acked Read 9 Done Done Sent false
11578 3753 Acked Write 1 Done Done Sent false
11579 3754 Acked Read 5 Done Done Sent false
11580 3755 Acked Write 4 Done Done Sent false
11581 3756 Acked Read 3 Done Done Sent false
11582 3757 Acked Read 6 Done Done Sent false
11583 3758 Acked Read 7 Done Done Sent false
11584 3759 Acked Write 9 Done Done Sent false
11585 3760 Acked Read 8 Done Done Sent false
11586 3761 Acked Flush 0 Done Done Sent false
11587 3762 Acked Read 8 Done Done Sent false
11588 3763 Acked Read 1 Done Done Sent false
11589 3764 Acked Write 9 Done Done Sent false
11590 3765 Acked Read 6 Done Done Sent false
11591 3766 Acked Read 3 Done Done Sent false
11592 3767 Acked Write 7 Done Done Sent false
11593 3768 Acked Read 9 Done Done Sent false
11594 3769 Acked Read 7 Done Done Sent false
11595 3770 Acked Read 5 Done Done Sent false
11596 3771 Acked Read 4 Done Done Sent false
11597 3772 Acked Write 10 Done Done Sent false
11598 3773 Acked Read 10 Done Done Sent false
11599 3774 Acked Read 4 Done Done Sent false
11600 3775 Acked Read 4 Done Done Sent false
11601 3776 Acked Write 4 Done Done Sent false
11602 3777 Acked Read 6 Done Done Sent false
11603 3778 Acked Read 10 Done Done Sent false
11604 3779 Acked Read 10 Done Done Sent false
11605 3780 Acked Write 9 Done Done Sent false
11606 3781 Acked Write 3 Done Done Sent false
11607 3782 Acked Read 6 Done Done Sent false
11608 3783 Acked Read 4 Done Done Sent false
11609 3784 Acked Write 9 Done Done Sent false
11610 3785 Acked Write 1 Done Done Sent false
11611 3786 Acked Read 3 Done Done Sent false
11612 3787 Acked Write 7 Done Done Sent false
11613 3788 Acked Flush 0 Done Done Sent false
11614 3789 Acked Read 5 Done Done Sent false
11615 3790 Acked Read 2 Done Done Sent false
11616 3791 Acked Write 7 Done Done Sent false
11617 3792 Acked Write 8 Done Done Sent false
11618 3793 Acked Write 9 Done Done Sent false
11619 3794 Acked Read 8 Done Done Sent false
11620 3795 Acked Read 1 Done Done Sent false
11621 3796 Acked Read 9 Done Done Sent false
11622 3797 Acked Write 1 Done Done Sent false
11623 3798 Acked Read 1 Done Done Sent false
11624 3799 Acked Flush 0 Done Done Sent false
11625 3800 Acked Write 1 Done Done Sent false
11626 3801 Acked Read 3 Done Done Sent false
11627 3802 Acked Read 3 Done Done Sent false
11628 3803 Acked Write 7 Done Done Sent false
11629 3804 Acked Flush 0 Done Done Sent false
11630 3805 Acked Read 3 Done Done Sent false
11631 3806 Acked Read 4 Done Done Sent false
11632 3807 Acked Read 6 Done Done Sent false
11633 3808 Acked Flush 0 Done Done Sent false
11634 3809 Acked Read 2 Done Done Sent false
11635 3810 Acked Flush 0 Done Done Sent false
11636 3811 Acked Read 8 Done Done Sent false
11637 3812 Acked Read 10 Done Done Sent false
11638 3813 Acked Write 6 Done Done Sent false
11639 3814 Acked Read 4 Done Done Sent false
11640 3815 Acked Read 10 Done Done Sent false
11641 3816 Acked Read 5 Done Done Sent false
11642 3817 Acked Read 4 Done Done Sent false
11643 3818 Acked Read 9 Done Done Sent false
11644 3819 Acked Write 1 Done Done Sent false
11645 3820 Acked Write 5 Done Done Sent false
11646 3821 Acked Read 7 Done Done Sent false
11647 3822 Acked Write 1 Done Done Sent false
11648 3823 Acked Read 6 Done Done Sent false
11649 3824 Acked Write 3 Done Done Sent false
11650 3825 Acked Read 4 Done Done Sent false
11651 3826 Acked Write 3 Done Done Sent false
11652 3827 Acked Read 6 Done Done Sent false
11653 3828 Acked Read 9 Done Done Sent false
11654 3829 Acked Flush 0 Done Done Sent false
11655 3830 Acked Write 7 Done Done Sent false
11656 3831 Acked Flush 0 Done Done Sent false
11657 3832 Acked Read 4 Done Done Sent false
11658 3833 Acked Write 2 Done Done Sent false
11659 3834 Acked Write 2 Done Done Sent false
11660 3835 Acked Read 2 Done Done Sent false
11661 3836 Acked Write 1 Done Done Sent false
11662 3837 Acked Write 5 Done Done Sent false
11663 3838 Acked Write 4 Done Done Sent false
11664 3839 Acked Read 6 Done Done Sent false
11665 3840 Acked Read 3 Done Done Sent false
11666 3841 Acked Read 9 Done Done Sent false
11667 3842 Acked Read 5 Done Done Sent false
11668 3843 Acked Read 10 Done Done Sent false
11669 3844 Acked Write 8 Done Done Sent false
11670 3845 Acked Write 2 Done Done Sent false
11671 3846 Acked Read 6 Done Done Sent false
11672 3847 Acked Flush 0 Done Done Sent false
11673 3848 Acked Flush 0 Done Done Sent false
11674 3849 Acked Read 5 Done Done Sent false
11675 3850 Acked Read 10 Done Done Sent false
11676 3851 Acked Write 9 Done Done Sent false
11677 3852 Acked Read 3 Done Done Sent false
11678 3853 Acked Read 3 Done Done Sent false
11679 3854 Acked Write 5 Done Done Sent false
11680 3855 Acked Read 10 Done Done Sent false
11681 3856 Acked Read 9 Done Done Sent false
11682 3857 Acked Write 7 Done Done Sent false
11683 3858 Acked Read 2 Done Done Sent false
11684 3859 Acked Flush 0 Done Done Sent false
11685 3860 Acked Write 3 Done Done Sent false
11686 3861 Acked Read 1 Done Done Sent false
11687 3862 Acked Write 2 Done Done Sent false
11688 3863 Acked Read 6 Done Done Sent false
11689 3864 Acked Read 2 Done Done Sent false
11690 3865 Acked Write 5 Done Done Sent false
11691 3866 Acked Write 9 Done Done Sent false
11692 3867 Acked Read 6 Done Done Sent false
11693 3868 Acked Read 6 Done Done Sent false
11694 3869 Acked Read 5 Done Done Sent false
11695 3870 Acked Write 8 Done Done Sent false
11696 3871 Acked Read 9 Done Done Sent false
11697 3872 Acked Read 10 Done Done Sent false
11698 3873 Acked Write 1 Done Done Sent false
11699 3874 Acked Write 8 Done Done Sent false
11700 3875 Acked Read 9 Done Done Sent false
11701 3876 Acked Read 3 Done Done Sent false
11702 3877 Acked Write 5 Done Done Sent false
11703 3878 Acked Read 1 Done Done Sent false
11704 3879 Acked Read 3 Done Done Sent false
11705 3880 Acked Read 7 Done Done Sent false
11706 3881 Acked Read 8 Done Done Sent false
11707 3882 Acked Read 8 Done Done Sent false
11708 3883 Acked Read 1 Done Done Sent false
11709 3884 Acked Write 9 Done Done Sent false
11710 3885 Acked Read 9 Done Done Sent false
11711 3886 Acked Read 3 Done Done Sent false
11712 3887 Acked Read 5 Done Done Sent false
11713 3888 Acked Write 2 Done Done Sent false
11714 3889 Acked Write 3 Done Done Sent false
11715 3890 Acked Read 6 Done Done Sent false
11716 3891 Acked Write 10 Done Done Sent false
11717 3892 Acked Write 9 Done Done Sent false
11718 3893 Acked Write 6 Done Done Sent false
11719 3894 Acked Flush 0 Done Done Sent false
11720 3895 Acked Flush 0 Done Done Sent false
11721 3896 Acked Read 7 Done Done Sent false
11722 3897 Acked Write 9 Done Done Sent false
11723 3898 Acked Read 6 Done Done Sent false
11724 3899 Acked Write 7 Done Done Sent false
11725 3900 Acked Read 9 Done Done Sent false
11726 3901 Acked Read 2 Done Done Sent false
11727 3902 Acked Read 10 Done Done Sent false
11728 3903 Acked Read 8 Done Done Sent false
11729 3904 Acked Write 2 Done Done Sent false
11730 3905 Acked Write 7 Done Done Sent false
11731 3906 Acked Read 7 Done Done Sent false
11732 3907 Acked Read 7 Done Done Sent false
11733 3908 Acked Read 1 Done Done Sent false
11734 3909 Acked Read 1 Done Done Sent false
11735 3910 Acked Write 5 Done Done Sent false
11736 3911 Acked Write 3 Done Done Sent false
11737 3912 Acked Flush 0 Done Done Sent false
11738 3913 Acked Write 7 Done Done Sent false
11739 3914 Acked Write 10 Done Done Sent false
11740 3915 Acked Read 2 Done Done Sent false
11741 3916 Acked Read 4 Done Done Sent false
11742 3917 Acked Write 10 Done Done Sent false
11743 3918 Acked Write 4 Done Done Sent false
11744 3919 Acked Read 8 Done Done Sent false
11745 3920 Acked Read 5 Done Done Sent false
11746 3921 Acked Read 8 Done Done Sent false
11747 3922 Acked Write 9 Done Done Sent false
11748 3923 Acked Read 3 Done Done Sent false
11749 3924 Acked Write 10 Done Done Sent false
11750 3925 Acked Write 8 Done Done Sent false
11751 3926 Acked Flush 0 Done Done Sent false
11752 3927 Acked Read 2 Done Done Sent false
11753 3928 Acked Write 3 Done Done Sent false
11754 3929 Acked Read 1 Done Done Sent false
11755 3930 Acked Write 1 Done Done Sent false
11756 3931 Acked Write 7 Done Done Sent false
11757 3932 Acked Read 10 Done Done Sent false
11758 3933 Acked Write 9 Done Done Sent false
11759 3934 Acked Write 9 Done Done Sent false
11760 3935 Acked Write 7 Done Done Sent false
11761 3936 Acked Flush 0 Done Done Sent false
11762 3937 Acked Read 5 Done Done Sent false
11763 3938 Acked Read 7 Done Done Sent false
11764 3939 Acked Write 1 Done Done Sent false
11765 3940 Acked Read 7 Done Done Sent false
11766 3941 Acked Flush 0 Done Done Sent false
11767 3942 Acked Read 5 Done Done Sent false
11768 3943 Acked Read 4 Done Done Sent false
11769 3944 Acked Flush 0 Done Done Sent false
11770 3945 Acked Flush 0 Done Done Sent false
11771 3946 Acked Write 3 Done Done Sent false
11772 3947 Acked Write 5 Done Done Sent false
11773 3948 Acked Read 5 Done Done Sent false
11774 3949 Acked Read 6 Done Done Sent false
11775 3950 Acked Flush 0 Done Done Sent false
11776 3951 Acked Read 3 Done Done Sent false
11777 3952 Acked Write 7 Done Done Sent false
11778 3953 Acked Write 9 Done Done Sent false
11779 3954 Acked Read 1 Done Done Sent false
11780 3955 Acked Write 8 Done Done Sent false
11781 3956 Acked Read 6 Done Done Sent false
11782 3957 Acked Read 6 Done Done Sent false
11783 3958 Acked Write 8 Done Done Sent false
11784 3959 Acked Write 9 Done Done Sent false
11785 3960 Acked Flush 0 Done Done Sent false
11786 3961 Acked Write 6 Done Done Sent false
11787 3962 Acked Write 6 Done Done Sent false
11788 3963 Acked Write 9 Done Done Sent false
11789 3964 Acked Read 9 Done Done Sent false
11790 3965 Acked Read 6 Done Done Sent false
11791 3966 Acked Write 5 Done Done Sent false
11792 3967 Acked Read 6 Done Done Sent false
11793 3968 Acked Read 1 Done Done Sent false
11794 3969 Acked Write 7 Done Done Sent false
11795 3970 Acked Read 9 Done Done Sent false
11796 3971 Acked Flush 0 Done Done Sent false
11797 3972 Acked Write 7 Done Done Sent false
11798 3973 Acked Write 3 Done Done Sent false
11799 3974 Acked Read 4 Done Done Sent false
11800 3975 Acked Read 4 Done Done Sent false
11801 3976 Acked Read 2 Done Done Sent false
11802 3977 Acked Write 1 Done Done Sent false
11803 3978 Acked Write 7 Done Done Sent false
11804 3979 Acked Read 7 Done Done Sent false
11805 3980 Acked Write 8 Done Done Sent false
11806 3981 Acked Read 10 Done Done Sent false
11807 3982 Acked Read 5 Done Done Sent false
11808 3983 Acked Read 5 Done Done Sent false
11809 3984 Acked Read 5 Done Done Sent false
11810 3985 Acked Write 2 Done Done Sent false
11811 3986 Acked Read 5 Done Done Sent false
11812 3987 Acked Read 4 Done Done Sent false
11813 3988 Acked Read 2 Done Done Sent false
11814 3989 Acked Flush 0 Done Done Sent false
11815 3990 Acked Write 10 Done Done Sent false
11816 3991 Acked Read 3 Done Done Sent false
11817 3992 Acked Read 9 Done Done Sent false
11818 3993 Acked Flush 0 Done Done Sent false
11819 3994 Acked Read 4 Done Done Sent false
11820 3995 Acked Write 1 Done Done Sent false
11821 3996 Acked Read 1 Done Done Sent false
11822 3997 Acked Flush 0 Done Done Sent false
11823 3998 Acked Read 9 Done Done Sent false
11824 3999 Acked Read 8 Done Done Sent false
11825 4000 Acked Write 9 Done Done Sent false
11826 4001 Acked Read 2 Done Done Sent false
11827 4002 Acked Read 7 Done Done Sent false
11828 4003 Acked Write 10 Done Done Sent false
11829 4004 Acked Flush 0 Done Done Sent false
11830 4005 Acked Write 3 Done Done Sent false
11831 4006 Acked Write 7 Done Done Sent false
11832 4007 Acked Write 10 Done Done Sent false
11833 4008 Acked Flush 0 Done Done Sent false
11834 4009 Acked Flush 0 Done Done Sent false
11835 4010 Acked Read 10 Done Done Sent false
11836 4011 Acked Write 8 Done Done Sent false
11837 4012 Acked Write 2 Done Done Sent false
11838 4013 Acked Write 3 Done Done Sent false
11839 4014 Acked Write 9 Done Done Sent false
11840 4015 Acked Write 4 Done Done Sent false
11841 4016 Acked Read 2 Done Done Sent false
11842 4017 Acked Flush 0 Done Done Sent false
11843 STATES DS:0 DS:1 DS:2 TOTAL
11844 Sent 0 0 302 302
11845 Done 302 302 0 604
11846 Skipped 0 0 0 0
11847 Error 0 0 0 0
11848 Last Flush: 4017 4017 3715
11849 Downstairs last five completed: 3715 3714 3713 3712 3711
11850 Upstairs last five completed: 4017 4016 4015 4014 4013
11851 CLIENT: Up:0 ds:302 act:2
118522025-01-10T16:37:47.962ZINFOcrucible: connecting to 127.0.0.1:8830 = io task client = 2 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
118532025-01-10T16:37:47.962ZINFOcrucible: ds_connection connected from Ok(127.0.0.1:37531) = io task client = 2 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
118542025-01-10T16:37:47.963ZWARNcrucible: version negotiation from state Offline = downstairs client = 2 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
118552025-01-10T16:37:47.963ZINFOcrucible: downstairs client at Some(127.0.0.1:8830) has region UUID 12345678-0000-0000-0000-000000008830 = downstairs client = 2 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
118562025-01-10T16:37:47.964ZINFOcrucible: Returning UUID:12345678-0000-0000-0000-000000008830 matches = downstairs client = 2 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
118572025-01-10T16:37:47.964ZINFOcrucible: send last flush ID to this DS: 3715 = downstairs client = 2 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
118582025-01-10T16:37:47.964ZINFOcrucible: Replied this last flush ID: 3715 = downstairs client = 2 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
118592025-01-10T16:37:47.964ZINFOcrucible: ds_transition from Offline to Active = downstairs client = 2 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
118602025-01-10T16:37:47.964ZINFOcrucible: [2] Transition from Offline to Active = downstairs client = 2 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
118612025-01-10T16:37:47.964ZINFOcrucible: [2] client re-new 302 jobs since flush 3715 = downstairs session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
118622025-01-10T16:37:47.964ZINFOcrucible: [2] Replayed 302 jobs since flush: 3715 = downstairs session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
11863 ----------------------------------------------------------------
11864 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:0
11865 Downstairs last five completed: 4017 4016 4015 4014 4013
11866 Upstairs last five completed: 4017 4016 4015 4014 4013
11867 CLIENT: Up:0 ds:0 act:3
11868 Replay: All jobs finished
11869 Main task has work to do, go find it
11870 got dsc Stop(0)
11871 stop 0
11872 Jan 10 16:37:50.209[8810] Got stop action so:false kr:false
11873 INFO request completed, latency_us: 357, response_code: 204, uri: /stop/cid/0, method: POST, req_id: 0aeedeaf-f5cf-407c-9140-ccd0be396347, remote_addr: 127.0.0.1:55917, local_addr: 127.0.0.1:9998
118742025-01-10T16:37:50.210ZWARNcrucible: downstairs disconnected = io task client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
118752025-01-10T16:37:50.210ZWARNcrucible: client task is sending Done(Finished) = io task client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
118762025-01-10T16:37:50.210ZWARNcrucible: downstairs task for 0 stopped due to Finished session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
118772025-01-10T16:37:50.210ZINFOcrucible: ds_transition from Active to Offline = downstairs client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
118782025-01-10T16:37:50.210ZINFOcrucible: [0] Transition from Active to Offline = downstairs client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
118792025-01-10T16:37:50.210ZINFOcrucible: client task is exiting = io task client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
11880 Jan 10 16:37:50.210 INFO request completed, latency_us: 204, response_code: 200, uri: /state/cid/0, method: GET, req_id: 1cb1fa5e-ad02-4132-b388-49267695945f, remote_addr: 127.0.0.1:55917, local_addr: 127.0.0.1:9998
11881 [8810] Exited with: ExitStatus(unix_wait_status(9))
11882 [8810][0] reports Exit
11883 Jan 10 16:37:54.212 INFO request completed, latency_us: 304, response_code: 200, uri: /state/cid/0, method: GET, req_id: 0bb79c6d-15b5-44c4-beb1-781cbac94cd4, remote_addr: 127.0.0.1:55917, local_addr: 127.0.0.1:9998
11884 001/300 Read block 4468 len 4096
11885 002/300 Write block 2506 len 32768 data: 3 3 4 5 5 5 5 5
11886 003/300 Read block 3019 len 36864
11887 004/300 Flush
11888 005/300 Write block 1082 len 12288 data: 2 3 3
11889 006/300 Write block 3835 len 32768 data: 4 3 2 2 2 2 3 4
11890 007/300 Read block 4712 len 20480
11891 008/300 Write block 335 len 8192 data: 3 4
11892 009/300 Write block 379 len 12288 data: 2 2 2
11893 010/300 Write block 943 len 24576 data: 4 3 3 2 3 3
11894 011/300 Write block 3708 len 28672 data: 3 4 4 6 6 5 5
11895 012/300 Write block 2993 len 24576 data: 2 4 4 4 4 4
11896 013/300 Flush
11897 014/300 Write block 236 len 36864 data: 2 3 3 3 3 3 3 4 4
11898 015/300 Write block 3192 len 28672 data: 4 4 4 4 6 6 5
11899 016/300 Read block 1777 len 40960
11900 017/300 Write block 4634 len 8192 data: 4 4
11901 018/300 Read block 2656 len 8192
11902 019/300 Write block 970 len 12288 data: 3 4 3
11903 020/300 Read block 3362 len 28672
11904 021/300 Write block 2718 len 4096 data: 2
11905 022/300 Write block 3474 len 24576 data: 2 2 2 2 2 2
11906 023/300 Read block 740 len 16384
11907 024/300 Flush
11908 025/300 Read block 1115 len 20480
11909 026/300 Write block 229 len 40960 data: 3 3 3 3 2 2 2 3 4 4
11910 027/300 Read block 2837 len 16384
11911 028/300 Write block 3379 len 32768 data: 3 5 5 5 5 7 5 4
11912 029/300 Write block 1973 len 12288 data: 2 2 2
11913 030/300 Read block 4252 len 28672
11914 031/300 Flush
11915 032/300 Write block 2687 len 12288 data: 4 4 3
11916 033/300 Read block 397 len 16384
11917 034/300 Read block 3459 len 24576
11918 035/300 Write block 254 len 16384 data: 4 4 4 3
11919 036/300 Write block 3837 len 12288 data: 3 3 3
11920 037/300 Read block 2431 len 8192
11921 038/300 Write block 3366 len 32768 data: 2 2 3 3 3 3 3 3
11922 039/300 Write block 2932 len 16384 data: 4 4 3 4
11923 040/300 Write block 2601 len 12288 data: 4 4 4
11924 041/300 Read block 1143 len 4096
11925 042/300 Write block 2395 len 32768 data: 3 4 3 3 3 3 3 3
11926 043/300 Write block 1658 len 12288 data: 5 6 5
11927 044/300 Read block 4861 len 4096
11928 045/300 Flush
11929 046/300 Write block 4731 len 16384 data: 2 2 3 4
11930 047/300 Write block 2131 len 20480 data: 4 5 5 5 4
11931 048/300 Read block 630 len 8192
11932 049/300 Read block 2354 len 8192
11933 050/300 Write block 3133 len 40960 data: 4 4 4 4 4 4 3 4 3 3
11934 051/300 Flush
11935 052/300 Write block 4864 len 4096 data: 3
11936 053/300 Read block 4454 len 24576
11937 054/300 Write block 1274 len 28672 data: 3 3 3 4 4 5 4
11938 055/300 Read block 1555 len 28672
11939 056/300 Flush
11940 057/300 Read block 3093 len 28672
11941 058/300 Write block 4356 len 8192 data: 3 3
11942 059/300 Write block 3798 len 12288 data: 3 3 3
11943 060/300 Read block 4859 len 36864
11944 061/300 Write block 1991 len 40960 data: 3 4 4 4 4 4 3 3 3 3
11945 062/300 Read block 3954 len 32768
11946 063/300 Write block 1157 len 40960 data: 2 2 3 5 4 4 4 3 3 3
11947 064/300 Read block 2112 len 16384
11948 065/300 Read block 4647 len 28672
11949 066/300 Read block 3249 len 4096
11950 067/300 Read block 2433 len 8192
11951 068/300 Write block 3790 len 36864 data: 2 2 2 2 3 3 3 3 4
11952 069/300 Write block 1877 len 4096 data: 3
11953 070/300 Flush
11954 071/300 Read block 431 len 28672
11955 072/300 Read block 1145 len 36864
11956 073/300 Read block 2588 len 12288
11957 074/300 Read block 2647 len 40960
11958 075/300 Flush
11959 076/300 Write block 3611 len 28672 data: 3 3 3 2 2 2 2
11960 077/300 Write block 3064 len 28672 data: 5 5 4 4 4 3 2
11961 078/300 Read block 712 len 36864
11962 079/300 Read block 3096 len 12288
11963 080/300 Read block 1574 len 28672
11964 081/300 Read block 4131 len 12288
11965 082/300 Read block 4538 len 8192
11966 083/300 Write block 4016 len 4096 data: 4
11967 084/300 Read block 2944 len 16384
11968 085/300 Read block 561 len 24576
11969 086/300 Write block 1183 len 24576 data: 5 5 7 6 5 5
11970 087/300 Write block 3246 len 4096 data: 3
11971 088/300 Write block 4148 len 32768 data: 3 3 3 3 3 3 4 5
11972 089/300 Write block 1293 len 40960 data: 2 3 4 4 3 3 3 3 2 2
11973 090/300 Flush
11974 091/300 Write block 1748 len 4096 data: 4
11975 092/300 Write block 256 len 8192 data: 5 4
11976 093/300 Read block 793 len 28672
11977 094/300 Flush
11978 095/300 Read block 2245 len 8192
11979 096/300 Read block 3793 len 16384
11980 097/300 Read block 1041 len 32768
11981 098/300 Read block 3013 len 12288
11982 099/300 Write block 4029 len 12288 data: 4 4 4
11983 100/300 Flush
11984 101/300 Write block 3335 len 36864 data: 3 3 3 4 4 5 5 3 3
11985 102/300 Write block 4147 len 12288 data: 2 4 4
11986 103/300 Read block 3396 len 32768
11987 104/300 Write block 1459 len 4096 data: 5
11988 105/300 Read block 1554 len 4096
11989 106/300 Write block 2393 len 24576 data: 2 3 4 5 4 4
11990 107/300 Read block 4458 len 32768
11991 108/300 Write block 3551 len 36864 data: 4 4 2 2 2 2 2 2 2
11992 109/300 Read block 3527 len 28672
11993 110/300 Write block 4488 len 20480 data: 4 4 4 4 4
11994 111/300 Write block 4904 len 32768 data: 4 3 3 3 3 3 2 2
11995 112/300 Read block 1784 len 4096
11996 113/300 Write block 669 len 20480 data: 5 3 3 4 5
11997 114/300 Write block 3119 len 36864 data: 2 2 2 3 4 3 3 3 3
11998 115/300 Read block 102 len 32768
11999 116/300 Write block 3567 len 8192 data: 2 2
12000 117/300 Flush
12001 118/300 Read block 4189 len 40960
12002 119/300 Write block 3348 len 4096 data: 2
12003 120/300 Read block 2281 len 36864
12004 121/300 Write block 1163 len 4096 data: 5
12005 122/300 Write block 1235 len 12288 data: 2 3 3
12006 123/300 Read block 1220 len 32768
12007 124/300 Read block 4943 len 20480
12008 125/300 Flush
12009 126/300 Write block 2369 len 20480 data: 3 2 3 4 4
12010 127/300 Read block 3668 len 8192
12011 128/300 Write block 3845 len 24576 data: 3 3 3 3 2 3
12012 129/300 Read block 2632 len 4096
12013 130/300 Write block 2365 len 24576 data: 3 3 3 3 4 3
12014 131/300 Write block 408 len 36864 data: 2 2 2 2 2 2 2 2 3
12015 132/300 Write block 1474 len 4096 data: 4
12016 133/300 Read block 3426 len 24576
12017 134/300 Read block 650 len 12288
12018 135/300 Read block 2645 len 4096
12019 136/300 Read block 1813 len 16384
12020 137/300 Flush
12021 138/300 Read block 4685 len 40960
12022 139/300 Read block 3518 len 8192
12023 140/300 Read block 1639 len 24576
12024 141/300 Read block 2566 len 20480
12025 142/300 Read block 384 len 8192
12026 143/300 Write block 3142 len 36864 data: 4 3 3 3 3 3 3 4 4
12027 144/300 Read block 2380 len 24576
12028 145/300 Read block 893 len 40960
12029 146/300 Write block 218 len 16384 data: 3 3 3 4
12030 147/300 Write block 3935 len 24576 data: 2 2 3 3 3 3
12031 148/300 Read block 3154 len 36864
12032 149/300 Read block 2753 len 28672
12033 150/300 Write block 2568 len 16384 data: 3 2 2 2
12034 151/300 Read block 3580 len 12288
12035 152/300 Write block 2804 len 36864 data: 3 3 3 4 5 5 5 5 4
12036 153/300 Write block 47 len 8192 data: 5 5
12037 154/300 Write block 4974 len 28672 data: 2 2 2 2 2 2 2
12038 155/300 Write block 445 len 36864 data: 3 3 4 4 4 4 4 5 4
12039 156/300 Read block 27 len 8192
12040 157/300 Write block 4948 len 16384 data: 3 3 3 3
12041 158/300 Read block 4290 len 8192
12042 159/300 Write block 4247 len 4096 data: 3
12043 160/300 Write block 2127 len 40960 data: 3 5 4 4 5 6 6 6 5 3
12044 161/300 Write block 509 len 20480 data: 5 5 5 4 4
12045 162/300 Write block 3720 len 40960 data: 3 2 2 3 3 4 4 6 6 6
12046 163/300 Read block 1253 len 36864
12047 164/300 Read block 2551 len 12288
12048 165/300 Read block 200 len 24576
12049 166/300 Read block 1973 len 24576
12050 167/300 Write block 3745 len 24576 data: 3 3 3 3 3 4
12051 168/300 Write block 1918 len 4096 data: 3
12052 169/300 Read block 2530 len 4096
12053 170/300 Write block 3014 len 20480 data: 3 3 4 5 5
12054 171/300 Write block 231 len 4096 data: 4
12055 172/300 Read block 3410 len 36864
12056 173/300 Write block 4821 len 28672 data: 3 4 4 3 3 5 5
12057 174/300 Write block 2679 len 32768 data: 4 3 3 3 3 4 4 4
12058 175/300 Read block 4041 len 36864
12059 176/300 Flush
12060 177/300 Write block 1152 len 28672 data: 5 4 3 3 3 3 3
12061 178/300 Write block 500 len 36864 data: 2 2 2 2 2 2 2 4 4
12062 179/300 Flush
12063 180/300 Write block 4069 len 20480 data: 4 4 4 3 3
12064 181/300 Write block 1761 len 32768 data: 5 6 7 6 5 5 4 4
12065 182/300 Write block 2863 len 32768 data: 4 4 5 6 6 6 5 4
12066 183/300 Write block 1458 len 36864 data: 5 6 3 3 3 2 3 3 3
12067 184/300 Flush
12068 185/300 Flush
12069 186/300 Write block 339 len 36864 data: 3 3 3 3 3 3 4 4 3
12070 187/300 Read block 4880 len 16384
12071 188/300 Read block 3482 len 24576
12072 189/300 Write block 2910 len 32768 data: 3 2 2 2 2 2 2 2
12073 190/300 Read block 1714 len 12288
12074 191/300 Read block 3448 len 4096
12075 192/300 Read block 3164 len 32768
12076 193/300 Write block 2007 len 4096 data: 2
12077 194/300 Read block 2536 len 24576
12078 195/300 Write block 1858 len 8192 data: 3 3
12079 196/300 Write block 520 len 28672 data: 3 3 2 2 2 2 3
12080 197/300 Read block 344 len 8192
12081 198/300 Read block 700 len 8192
12082 199/300 Read block 1326 len 36864
12083 200/300 Read block 4438 len 28672
12084 201/300 Read block 372 len 36864
12085 202/300 Write block 2330 len 8192 data: 2 3
12086 203/300 Read block 3051 len 40960
12087 204/300 Write block 873 len 8192 data: 3 3
12088 205/300 Read block 1070 len 12288
12089 206/300 Read block 3326 len 24576
12090 207/300 Flush
12091 208/300 Write block 2585 len 36864 data: 4 3 4 5 5 4 4 4 3
12092 209/300 Read block 1551 len 12288
12093 210/300 Write block 4293 len 32768 data: 3 3 5 4 4 4 4 4
12094 211/300 Read block 4280 len 12288
12095 212/300 Write block 2313 len 12288 data: 5 5 4
12096 213/300 Write block 1820 len 8192 data: 4 4
12097 214/300 Read block 4927 len 32768
12098 215/300 Write block 19 len 24576 data: 4 4 4 3 3 4
12099 216/300 Read block 967 len 24576
12100 217/300 Write block 89 len 40960 data: 3 3 3 3 3 2 2 2 2 2
12101 218/300 Read block 3733 len 12288
12102 219/300 Read block 3828 len 32768
12103 220/300 Write block 4172 len 20480 data: 4 3 4 4 4
12104 221/300 Read block 1290 len 4096
12105 222/300 Write block 478 len 40960 data: 3 3 5 4 4 2 2 3 3 3
12106 223/300 Read block 119 len 36864
12107 224/300 Read block 4233 len 16384
12108 225/300 Flush
12109 226/300 Write block 4957 len 20480 data: 2 2 2 2 3
12110 227/300 Write block 2356 len 16384 data: 4 4 4 3
12111 228/300 Read block 4552 len 20480
12112 229/300 Write block 2457 len 32768 data: 2 2 2 2 2 2 2 3
12113 230/300 Read block 1483 len 8192
12114 231/300 Flush
12115 232/300 Read block 3743 len 16384
12116 233/300 Flush
12117 234/300 Read block 978 len 16384
12118 235/300 Write block 3393 len 28672 data: 4 4 4 3 3 5 5
12119 236/300 Flush
12120 237/300 Write block 936 len 12288 data: 4 4 3
12121 238/300 Write block 1823 len 16384 data: 4 3 4 4
12122 239/300 Flush
12123 240/300 Write block 3815 len 12288 data: 2 2 2
12124 241/300 Read block 2025 len 36864
12125 242/300 Read block 278 len 36864
12126 243/300 Read block 3206 len 20480
12127 244/300 Read block 1635 len 16384
12128 245/300 Read block 2560 len 24576
12129 246/300 Write block 3726 len 28672 data: 5 7 7 7 5 5 6
12130 247/300 Read block 1508 len 32768
12131 248/300 Read block 4757 len 32768
12132 249/300 Write block 1452 len 16384 data: 2 4 4 4
12133 250/300 Read block 3201 len 4096
12134 251/300 Read block 2525 len 20480
12135 252/300 Read block 1103 len 4096
12136 253/300 Read block 2580 len 4096
12137 254/300 Read block 3258 len 20480
12138 255/300 Flush
12139 256/300 Write block 494 len 20480 data: 4 4 5 5 4
12140 257/300 Write block 946 len 8192 data: 3 4
12141 258/300 Read block 1851 len 20480
12142 259/300 Read block 543 len 32768
12143 260/300 Write block 2117 len 24576 data: 4 4 4 4 5 5
12144 261/300 Read block 612 len 4096
12145 262/300 Read block 4869 len 12288
12146 263/300 Read block 2407 len 20480
12147 264/300 Write block 4612 len 4096 data: 2
12148 265/300 Write block 627 len 36864 data: 4 3 3 3 5 5 7 8 8
12149 266/300 Read block 3354 len 20480
12150 267/300 Write block 4893 len 28672 data: 2 3 4 4 3 3 2
12151 268/300 Read block 1570 len 4096
12152 269/300 Read block 3857 len 16384
12153 270/300 Read block 3775 len 16384
12154 271/300 Write block 4307 len 20480 data: 3 2 4 4 4
12155 272/300 Read block 3145 len 20480
12156 273/300 Read block 2460 len 12288
12157 274/300 Read block 808 len 36864
12158 275/300 Read block 1619 len 4096
12159 276/300 Flush
12160 277/300 Write block 2636 len 36864 data: 5 5 4 4 4 4 4 3 3
12161 278/300 Read block 2011 len 36864
12162 279/300 Read block 1163 len 28672
12163 280/300 Read block 1766 len 16384
12164 281/300 Write block 3872 len 32768 data: 3 3 2 2 2 3 3 3
12165 282/300 Read block 1120 len 12288
12166 283/300 Read block 3620 len 16384
12167 284/300 Read block 584 len 4096
12168 285/300 Read block 3317 len 32768
12169 286/300 Write block 3819 len 8192 data: 2 2
12170 287/300 Read block 1224 len 40960
12171 288/300 Read block 2077 len 40960
12172 289/300 Read block 1938 len 24576
12173 290/300 Read block 1075 len 20480
12174 291/300 Read block 1715 len 36864
12175 292/300 Write block 2804 len 8192 data: 4 4
12176 293/300 Read block 1453 len 16384
12177 294/300 Read block 4945 len 12288
12178 295/300 Write block 3205 len 40960 data: 2 2 2 2 2 2 2 3 5 5
12179 296/300 Flush
12180 297/300 Write block 1976 len 12288 data: 3 2 2
12181 298/300 Read block 1447 len 32768
12182 299/300 Read block 1717 len 12288
12183 300/300 Flush
12184 301/300 Write block 255 len 40960 data: 5 6 5 2 2 2 2 2 3 3
12185 Main task has work to do, go find it
12186 got dsc Start(0)
12187 start 0
12188 Jan 10 16:37:54.442 INFO request completed, latency_us: 211, response_code: 204, uri: /start/cid/0, method: POST, req_id: 0777ecdc-57c0-4cf2-b80f-81bd234a7a5d, remote_addr: 127.0.0.1:55917, local_addr: 127.0.0.1:9998
12189 Replay: started 0, returned:Ok(())
12190 ----------------------------------------------------------------
12191 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:301
12192 States: Offline Active Active
12193 JOBID ACK TYPE BKS/EXT DS:0 DS:1 DS:2 REPLAY
12194 4018 Acked Read 1 Sent Done Done false
12195 4019 Acked Write 8 Sent Done Done false
12196 4020 Acked Read 9 Sent Done Done false
12197 4021 Acked Flush 0 Sent Done Done false
12198 4022 Acked Write 3 Sent Done Done false
12199 4023 Acked Write 8 Sent Done Done false
12200 4024 Acked Read 5 Sent Done Done false
12201 4025 Acked Write 2 Sent Done Done false
12202 4026 Acked Write 3 Sent Done Done false
12203 4027 Acked Write 6 Sent Done Done false
12204 4028 Acked Write 7 Sent Done Done false
12205 4029 Acked Write 6 Sent Done Done false
12206 4030 Acked Flush 0 Sent Done Done false
12207 4031 Acked Write 9 Sent Done Done false
12208 4032 Acked Write 7 Sent Done Done false
12209 4033 Acked Read 10 Sent Done Done false
12210 4034 Acked Write 2 Sent Done Done false
12211 4035 Acked Read 2 Sent Done Done false
12212 4036 Acked Write 3 Sent Done Done false
12213 4037 Acked Read 7 Sent Done Done false
12214 4038 Acked Write 1 Sent Done Done false
12215 4039 Acked Write 6 Sent Done Done false
12216 4040 Acked Read 4 Sent Done Done false
12217 4041 Acked Flush 0 Sent Done Done false
12218 4042 Acked Read 5 Sent Done Done false
12219 4043 Acked Write 10 Sent Done Done false
12220 4044 Acked Read 4 Sent Done Done false
12221 4045 Acked Write 8 Sent Done Done false
12222 4046 Acked Write 3 Sent Done Done false
12223 4047 Acked Read 7 Sent Done Done false
12224 4048 Acked Flush 0 Sent Done Done false
12225 4049 Acked Write 3 Sent Done Done false
12226 4050 Acked Read 4 Sent Done Done false
12227 4051 Acked Read 6 Sent Done Done false
12228 4052 Acked Write 4 Sent Done Done false
12229 4053 Acked Write 3 Sent Done Done false
12230 4054 Acked Read 2 Sent Done Done false
12231 4055 Acked Write 8 Sent Done Done false
12232 4056 Acked Write 4 Sent Done Done false
12233 4057 Acked Write 3 Sent Done Done false
12234 4058 Acked Read 1 Sent Done Done false
12235 4059 Acked Write 8 Sent Done Done false
12236 4060 Acked Write 3 Sent Done Done false
12237 4061 Acked Read 1 Sent Done Done false
12238 4062 Acked Flush 0 Sent Done Done false
12239 4063 Acked Write 4 Sent Done Done false
12240 4064 Acked Write 5 Sent Done Done false
12241 4065 Acked Read 2 Sent Done Done false
12242 4066 Acked Read 2 Sent Done Done false
12243 4067 Acked Write 10 Sent Done Done false
12244 4068 Acked Flush 0 Sent Done Done false
12245 4069 Acked Write 1 Sent Done Done false
12246 4070 Acked Read 6 Sent Done Done false
12247 4071 Acked Write 7 Sent Done Done false
12248 4072 Acked Read 7 Sent Done Done false
12249 4073 Acked Flush 0 Sent Done Done false
12250 4074 Acked Read 7 Sent Done Done false
12251 4075 Acked Write 2 Sent Done Done false
12252 4076 Acked Write 3 Sent Done Done false
12253 4077 Acked Read 9 Sent Done Done false
12254 4078 Acked Write 10 Sent Done Done false
12255 4079 Acked Read 8 Sent Done Done false
12256 4080 Acked Write 10 Sent Done Done false
12257 4081 Acked Read 4 Sent Done Done false
12258 4082 Acked Read 7 Sent Done Done false
12259 4083 Acked Read 1 Sent Done Done false
12260 4084 Acked Read 2 Sent Done Done false
12261 4085 Acked Write 9 Sent Done Done false
12262 4086 Acked Write 1 Sent Done Done false
12263 4087 Acked Flush 0 Sent Done Done false
12264 4088 Acked Read 7 Sent Done Done false
12265 4089 Acked Read 9 Sent Done Done false
12266 4090 Acked Read 3 Sent Done Done false
12267 4091 Acked Read 10 Sent Done Done false
12268 4092 Acked Flush 0 Sent Done Done false
12269 4093 Acked Write 7 Sent Done Done false
12270 4094 Acked Write 7 Sent Done Done false
12271 4095 Acked Read 9 Sent Done Done false
12272 4096 Acked Read 3 Sent Done Done false
12273 4097 Acked Read 7 Sent Done Done false
12274 4098 Acked Read 3 Sent Done Done false
12275 4099 Acked Read 2 Sent Done Done false
12276 4100 Acked Write 1 Sent Done Done false
12277 4101 Acked Read 4 Sent Done Done false
12278 4102 Acked Read 6 Sent Done Done false
12279 4103 Acked Write 6 Sent Done Done false
12280 4104 Acked Write 1 Sent Done Done false
12281 4105 Acked Write 8 Sent Done Done false
12282 4106 Acked Write 10 Sent Done Done false
12283 4107 Acked Flush 0 Sent Done Done false
12284 4108 Acked Write 1 Sent Done Done false
12285 4109 Acked Write 2 Sent Done Done false
12286 4110 Acked Read 7 Sent Done Done false
12287 4111 Acked Flush 0 Sent Done Done false
12288 4112 Acked Read 2 Sent Done Done false
12289 4113 Acked Read 4 Sent Done Done false
12290 4114 Acked Read 8 Sent Done Done false
12291 4115 Acked Read 3 Sent Done Done false
12292 4116 Acked Write 3 Sent Done Done false
12293 4117 Acked Flush 0 Sent Done Done false
12294 4118 Acked Write 9 Sent Done Done false
12295 4119 Acked Write 3 Sent Done Done false
12296 4120 Acked Read 8 Sent Done Done false
12297 4121 Acked Write 1 Sent Done Done false
12298 4122 Acked Read 1 Sent Done Done false
12299 4123 Acked Write 6 Sent Done Done false
12300 4124 Acked Read 8 Sent Done Done false
12301 4125 Acked Write 9 Sent Done Done false
12302 4126 Acked Read 7 Sent Done Done false
12303 4127 Acked Write 5 Sent Done Done false
12304 4128 Acked Write 8 Sent Done Done false
12305 4129 Acked Read 1 Sent Done Done false
12306 4130 Acked Write 5 Sent Done Done false
12307 4131 Acked Write 9 Sent Done Done false
12308 4132 Acked Read 8 Sent Done Done false
12309 4133 Acked Write 2 Sent Done Done false
12310 4134 Acked Flush 0 Sent Done Done false
12311 4135 Acked Read 10 Sent Done Done false
12312 4136 Acked Write 1 Sent Done Done false
12313 4137 Acked Read 9 Sent Done Done false
12314 4138 Acked Write 1 Sent Done Done false
12315 4139 Acked Write 3 Sent Done Done false
12316 4140 Acked Read 8 Sent Done Done false
12317 4141 Acked Read 5 Sent Done Done false
12318 4142 Acked Flush 0 Sent Done Done false
12319 4143 Acked Write 5 Sent Done Done false
12320 4144 Acked Read 2 Sent Done Done false
12321 4145 Acked Write 6 Sent Done Done false
12322 4146 Acked Read 1 Sent Done Done false
12323 4147 Acked Write 6 Sent Done Done false
12324 4148 Acked Write 9 Sent Done Done false
12325 4149 Acked Write 1 Sent Done Done false
12326 4150 Acked Read 6 Sent Done Done false
12327 4151 Acked Read 3 Sent Done Done false
12328 4152 Acked Read 1 Sent Done Done false
12329 4153 Acked Read 4 Sent Done Done false
12330 4154 Acked Flush 0 Sent Done Done false
12331 4155 Acked Read 10 Sent Done Done false
12332 4156 Acked Read 2 Sent Done Done false
12333 4157 Acked Read 6 Sent Done Done false
12334 4158 Acked Read 5 Sent Done Done false
12335 4159 Acked Read 2 Sent Done Done false
12336 4160 Acked Write 9 Sent Done Done false
12337 4161 Acked Read 6 Sent Done Done false
12338 4162 Acked Read 10 Sent Done Done false
12339 4163 Acked Write 4 Sent Done Done false
12340 4164 Acked Write 6 Sent Done Done false
12341 4165 Acked Read 9 Sent Done Done false
12342 4166 Acked Read 7 Sent Done Done false
12343 4167 Acked Write 4 Sent Done Done false
12344 4168 Acked Read 3 Sent Done Done false
12345 4169 Acked Write 9 Sent Done Done false
12346 4170 Acked Write 2 Sent Done Done false
12347 4171 Acked Write 7 Sent Done Done false
12348 4172 Acked Write 9 Sent Done Done false
12349 4173 Acked Read 2 Sent Done Done false
12350 4174 Acked Write 4 Sent Done Done false
12351 4175 Acked Read 2 Sent Done Done false
12352 4176 Acked Write 1 Sent Done Done false
12353 4177 Acked Write 10 Sent Done Done false
12354 4178 Acked Write 5 Sent Done Done false
12355 4179 Acked Write 10 Sent Done Done false
12356 4180 Acked Read 9 Sent Done Done false
12357 4181 Acked Read 3 Sent Done Done false
12358 4182 Acked Read 6 Sent Done Done false
12359 4183 Acked Read 6 Sent Done Done false
12360 4184 Acked Write 6 Sent Done Done false
12361 4185 Acked Write 1 Sent Done Done false
12362 4186 Acked Read 1 Sent Done Done false
12363 4187 Acked Write 5 Sent Done Done false
12364 4188 Acked Write 1 Sent Done Done false
12365 4189 Acked Read 9 Sent Done Done false
12366 4190 Acked Write 7 Sent Done Done false
12367 4191 Acked Write 8 Sent Done Done false
12368 4192 Acked Read 9 Sent Done Done false
12369 4193 Acked Flush 0 Sent Done Done false
12370 4194 Acked Write 7 Sent Done Done false
12371 4195 Acked Write 9 Sent Done Done false
12372 4196 Acked Flush 0 Sent Done Done false
12373 4197 Acked Write 5 Sent Done Done false
12374 4198 Acked Write 8 Sent Done Done false
12375 4199 Acked Write 8 Sent Done Done false
12376 4200 Acked Write 9 Sent Done Done false
12377 4201 Acked Flush 0 Sent Done Done false
12378 4202 Acked Flush 0 Sent Done Done false
12379 4203 Acked Write 9 Sent Done Done false
12380 4204 Acked Read 4 Sent Done Done false
12381 4205 Acked Read 6 Sent Done Done false
12382 4206 Acked Write 8 Sent Done Done false
12383 4207 Acked Read 3 Sent Done Done false
12384 4208 Acked Read 1 Sent Done Done false
12385 4209 Acked Read 8 Sent Done Done false
12386 4210 Acked Write 1 Sent Done Done false
12387 4211 Acked Read 6 Sent Done Done false
12388 4212 Acked Write 2 Sent Done Done false
12389 4213 Acked Write 7 Sent Done Done false
12390 4214 Acked Read 2 Sent Done Done false
12391 4215 Acked Read 2 Sent Done Done false
12392 4216 Acked Read 9 Sent Done Done false
12393 4217 Acked Read 7 Sent Done Done false
12394 4218 Acked Read 9 Sent Done Done false
12395 4219 Acked Write 2 Sent Done Done false
12396 4220 Acked Read 10 Sent Done Done false
12397 4221 Acked Write 2 Sent Done Done false
12398 4222 Acked Read 3 Sent Done Done false
12399 4223 Acked Read 6 Sent Done Done false
12400 4224 Acked Flush 0 Sent Done Done false
12401 4225 Acked Write 9 Sent Done Done false
12402 4226 Acked Read 3 Sent Done Done false
12403 4227 Acked Write 8 Sent Done Done false
12404 4228 Acked Read 3 Sent Done Done false
12405 4229 Acked Write 3 Sent Done Done false
12406 4230 Acked Write 2 Sent Done Done false
12407 4231 Acked Read 8 Sent Done Done false
12408 4232 Acked Write 6 Sent Done Done false
12409 4233 Acked Read 6 Sent Done Done false
12410 4234 Acked Write 10 Sent Done Done false
12411 4235 Acked Read 3 Sent Done Done false
12412 4236 Acked Read 8 Sent Done Done false
12413 4237 Acked Write 5 Sent Done Done false
12414 4238 Acked Read 1 Sent Done Done false
12415 4239 Acked Write 10 Sent Done Done false
12416 4240 Acked Read 9 Sent Done Done false
12417 4241 Acked Read 4 Sent Done Done false
12418 4242 Acked Flush 0 Sent Done Done false
12419 4243 Acked Write 5 Sent Done Done false
12420 4244 Acked Write 4 Sent Done Done false
12421 4245 Acked Read 5 Sent Done Done false
12422 4246 Acked Write 8 Sent Done Done false
12423 4247 Acked Read 2 Sent Done Done false
12424 4248 Acked Flush 0 Sent Done Done false
12425 4249 Acked Read 4 Sent Done Done false
12426 4250 Acked Flush 0 Sent Done Done false
12427 4251 Acked Read 4 Sent Done Done false
12428 4252 Acked Write 7 Sent Done Done false
12429 4253 Acked Flush 0 Sent Done Done false
12430 4254 Acked Write 3 Sent Done Done false
12431 4255 Acked Write 4 Sent Done Done false
12432 4256 Acked Flush 0 Sent Done Done false
12433 4257 Acked Write 3 Sent Done Done false
12434 4258 Acked Read 9 Sent Done Done false
12435 4259 Acked Read 9 Sent Done Done false
12436 4260 Acked Read 5 Sent Done Done false
12437 4261 Acked Read 4 Sent Done Done false
12438 4262 Acked Read 6 Sent Done Done false
12439 4263 Acked Write 7 Sent Done Done false
12440 4264 Acked Read 8 Sent Done Done false
12441 4265 Acked Read 8 Sent Done Done false
12442 4266 Acked Write 4 Sent Done Done false
12443 4267 Acked Read 1 Sent Done Done false
12444 4268 Acked Read 5 Sent Done Done false
12445 4269 Acked Read 1 Sent Done Done false
12446 4270 Acked Read 1 Sent Done Done false
12447 4271 Acked Read 5 Sent Done Done false
12448 4272 Acked Flush 0 Sent Done Done false
12449 4273 Acked Write 5 Sent Done Done false
12450 4274 Acked Write 2 Sent Done Done false
12451 4275 Acked Read 5 Sent Done Done false
12452 4276 Acked Read 8 Sent Done Done false
12453 4277 Acked Write 6 Sent Done Done false
12454 4278 Acked Read 1 Sent Done Done false
12455 4279 Acked Read 3 Sent Done Done false
12456 4280 Acked Read 5 Sent Done Done false
12457 4281 Acked Write 1 Sent Done Done false
12458 4282 Acked Write 9 Sent Done Done false
12459 4283 Acked Read 5 Sent Done Done false
12460 4284 Acked Write 7 Sent Done Done false
12461 4285 Acked Read 1 Sent Done Done false
12462 4286 Acked Read 4 Sent Done Done false
12463 4287 Acked Read 4 Sent Done Done false
12464 4288 Acked Write 5 Sent Done Done false
12465 4289 Acked Read 5 Sent Done Done false
12466 4290 Acked Read 3 Sent Done Done false
12467 4291 Acked Read 9 Sent Done Done false
12468 4292 Acked Read 1 Sent Done Done false
12469 4293 Acked Flush 0 Sent Done Done false
12470 4294 Acked Write 9 Sent Done Done false
12471 4295 Acked Read 9 Sent Done Done false
12472 4296 Acked Read 7 Sent Done Done false
12473 4297 Acked Read 4 Sent Done Done false
12474 4298 Acked Write 8 Sent Done Done false
12475 4299 Acked Read 3 Sent Done Done false
12476 4300 Acked Read 4 Sent Done Done false
12477 4301 Acked Read 1 Sent Done Done false
12478 4302 Acked Read 8 Sent Done Done false
12479 4303 Acked Write 2 Sent Done Done false
12480 4304 Acked Read 10 Sent Done Done false
12481 4305 Acked Read 10 Sent Done Done false
12482 4306 Acked Read 6 Sent Done Done false
12483 4307 Acked Read 5 Sent Done Done false
12484 4308 Acked Read 9 Sent Done Done false
12485 4309 Acked Write 2 Sent Done Done false
12486 4310 Acked Read 4 Sent Done Done false
12487 4311 Acked Read 3 Sent Done Done false
12488 4312 Acked Write 10 Sent Done Done false
12489 4313 Acked Flush 0 Sent Done Done false
12490 4314 Acked Write 3 Sent Done Done false
12491 4315 Acked Read 8 Sent Done Done false
12492 4316 Acked Read 3 Sent Done Done false
12493 4317 Acked Flush 0 Sent Done Done false
12494 4318 Acked Write 10 Sent Done Done false
12495 STATES DS:0 DS:1 DS:2 TOTAL
12496 Sent 301 0 0 301
12497 Done 0 301 301 602
12498 Skipped 0 0 0 0
12499 Error 0 0 0 0
12500 Last Flush: 4017 4317 4317
12501 Downstairs last five completed: 4017 4016 4015 4014 4013
12502 Upstairs last five completed: 4318 4317 4316 4315 4314
12503 CLIENT: Up:0 ds:301 act:2
12504 [8810] got start action
12505 [8810] I am going to restart
12506 Starting downstairs at port 8810
12507 Make output file at "/tmp/dsc/downstairs-8810.txt"
12508 [8810][0] reports Starting
12509 Downstairs /var/tmp/dsc/region/8810 port 8810 PID:Some(1213)
12510 [8810][0] reports Running
12511 ----------------------------------------------------------------
12512 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:302
12513 States: Offline Active Active
12514 JOBID ACK TYPE BKS/EXT DS:0 DS:1 DS:2 REPLAY
12515 4018 Acked Read 1 Sent Done Done false
12516 4019 Acked Write 8 Sent Done Done false
12517 4020 Acked Read 9 Sent Done Done false
12518 4021 Acked Flush 0 Sent Done Done false
12519 4022 Acked Write 3 Sent Done Done false
12520 4023 Acked Write 8 Sent Done Done false
12521 4024 Acked Read 5 Sent Done Done false
12522 4025 Acked Write 2 Sent Done Done false
12523 4026 Acked Write 3 Sent Done Done false
12524 4027 Acked Write 6 Sent Done Done false
12525 4028 Acked Write 7 Sent Done Done false
12526 4029 Acked Write 6 Sent Done Done false
12527 4030 Acked Flush 0 Sent Done Done false
12528 4031 Acked Write 9 Sent Done Done false
12529 4032 Acked Write 7 Sent Done Done false
12530 4033 Acked Read 10 Sent Done Done false
12531 4034 Acked Write 2 Sent Done Done false
12532 4035 Acked Read 2 Sent Done Done false
12533 4036 Acked Write 3 Sent Done Done false
12534 4037 Acked Read 7 Sent Done Done false
12535 4038 Acked Write 1 Sent Done Done false
12536 4039 Acked Write 6 Sent Done Done false
12537 4040 Acked Read 4 Sent Done Done false
12538 4041 Acked Flush 0 Sent Done Done false
12539 4042 Acked Read 5 Sent Done Done false
12540 4043 Acked Write 10 Sent Done Done false
12541 4044 Acked Read 4 Sent Done Done false
12542 4045 Acked Write 8 Sent Done Done false
12543 4046 Acked Write 3 Sent Done Done false
12544 4047 Acked Read 7 Sent Done Done false
12545 4048 Acked Flush 0 Sent Done Done false
12546 4049 Acked Write 3 Sent Done Done false
12547 4050 Acked Read 4 Sent Done Done false
12548 4051 Acked Read 6 Sent Done Done false
12549 4052 Acked Write 4 Sent Done Done false
12550 4053 Acked Write 3 Sent Done Done false
12551 4054 Acked Read 2 Sent Done Done false
12552 4055 Acked Write 8 Sent Done Done false
12553 4056 Acked Write 4 Sent Done Done false
12554 4057 Acked Write 3 Sent Done Done false
12555 4058 Acked Read 1 Sent Done Done false
12556 4059 Acked Write 8 Sent Done Done false
12557 4060 Acked Write 3 Sent Done Done false
12558 4061 Acked Read 1 Sent Done Done false
12559 4062 Acked Flush 0 Sent Done Done false
12560 4063 Acked Write 4 Sent Done Done false
12561 4064 Acked Write 5 Sent Done Done false
12562 4065 Acked Read 2 Sent Done Done false
12563 4066 Acked Read 2 Sent Done Done false
12564 4067 Acked Write 10 Sent Done Done false
12565 4068 Acked Flush 0 Sent Done Done false
12566 4069 Acked Write 1 Sent Done Done false
12567 4070 Acked Read 6 Sent Done Done false
12568 4071 Acked Write 7 Sent Done Done false
12569 4072 Acked Read 7 Sent Done Done false
12570 4073 Acked Flush 0 Sent Done Done false
12571 4074 Acked Read 7 Sent Done Done false
12572 4075 Acked Write 2 Sent Done Done false
12573 4076 Acked Write 3 Sent Done Done false
12574 4077 Acked Read 9 Sent Done Done false
12575 4078 Acked Write 10 Sent Done Done false
12576 4079 Acked Read 8 Sent Done Done false
12577 4080 Acked Write 10 Sent Done Done false
12578 4081 Acked Read 4 Sent Done Done false
12579 4082 Acked Read 7 Sent Done Done false
12580 4083 Acked Read 1 Sent Done Done false
12581 4084 Acked Read 2 Sent Done Done false
12582 4085 Acked Write 9 Sent Done Done false
12583 4086 Acked Write 1 Sent Done Done false
12584 4087 Acked Flush 0 Sent Done Done false
12585 4088 Acked Read 7 Sent Done Done false
12586 4089 Acked Read 9 Sent Done Done false
12587 4090 Acked Read 3 Sent Done Done false
12588 4091 Acked Read 10 Sent Done Done false
12589 4092 Acked Flush 0 Sent Done Done false
12590 4093 Acked Write 7 Sent Done Done false
12591 4094 Acked Write 7 Sent Done Done false
12592 4095 Acked Read 9 Sent Done Done false
12593 4096 Acked Read 3 Sent Done Done false
12594 4097 Acked Read 7 Sent Done Done false
12595 4098 Acked Read 3 Sent Done Done false
12596 4099 Acked Read 2 Sent Done Done false
12597 4100 Acked Write 1 Sent Done Done false
12598 4101 Acked Read 4 Sent Done Done false
12599 4102 Acked Read 6 Sent Done Done false
12600 4103 Acked Write 6 Sent Done Done false
12601 4104 Acked Write 1 Sent Done Done false
12602 4105 Acked Write 8 Sent Done Done false
12603 4106 Acked Write 10 Sent Done Done false
12604 4107 Acked Flush 0 Sent Done Done false
12605 4108 Acked Write 1 Sent Done Done false
12606 4109 Acked Write 2 Sent Done Done false
12607 4110 Acked Read 7 Sent Done Done false
12608 4111 Acked Flush 0 Sent Done Done false
12609 4112 Acked Read 2 Sent Done Done false
12610 4113 Acked Read 4 Sent Done Done false
12611 4114 Acked Read 8 Sent Done Done false
12612 4115 Acked Read 3 Sent Done Done false
12613 4116 Acked Write 3 Sent Done Done false
12614 4117 Acked Flush 0 Sent Done Done false
12615 4118 Acked Write 9 Sent Done Done false
12616 4119 Acked Write 3 Sent Done Done false
12617 4120 Acked Read 8 Sent Done Done false
12618 4121 Acked Write 1 Sent Done Done false
12619 4122 Acked Read 1 Sent Done Done false
12620 4123 Acked Write 6 Sent Done Done false
12621 4124 Acked Read 8 Sent Done Done false
12622 4125 Acked Write 9 Sent Done Done false
12623 4126 Acked Read 7 Sent Done Done false
12624 4127 Acked Write 5 Sent Done Done false
12625 4128 Acked Write 8 Sent Done Done false
12626 4129 Acked Read 1 Sent Done Done false
12627 4130 Acked Write 5 Sent Done Done false
12628 4131 Acked Write 9 Sent Done Done false
12629 4132 Acked Read 8 Sent Done Done false
12630 4133 Acked Write 2 Sent Done Done false
12631 4134 Acked Flush 0 Sent Done Done false
12632 4135 Acked Read 10 Sent Done Done false
12633 4136 Acked Write 1 Sent Done Done false
12634 4137 Acked Read 9 Sent Done Done false
12635 4138 Acked Write 1 Sent Done Done false
12636 4139 Acked Write 3 Sent Done Done false
12637 4140 Acked Read 8 Sent Done Done false
12638 4141 Acked Read 5 Sent Done Done false
12639 4142 Acked Flush 0 Sent Done Done false
12640 4143 Acked Write 5 Sent Done Done false
12641 4144 Acked Read 2 Sent Done Done false
12642 4145 Acked Write 6 Sent Done Done false
12643 4146 Acked Read 1 Sent Done Done false
12644 4147 Acked Write 6 Sent Done Done false
12645 4148 Acked Write 9 Sent Done Done false
12646 4149 Acked Write 1 Sent Done Done false
12647 4150 Acked Read 6 Sent Done Done false
12648 4151 Acked Read 3 Sent Done Done false
12649 4152 Acked Read 1 Sent Done Done false
12650 4153 Acked Read 4 Sent Done Done false
12651 4154 Acked Flush 0 Sent Done Done false
12652 4155 Acked Read 10 Sent Done Done false
12653 4156 Acked Read 2 Sent Done Done false
12654 4157 Acked Read 6 Sent Done Done false
12655 4158 Acked Read 5 Sent Done Done false
12656 4159 Acked Read 2 Sent Done Done false
12657 4160 Acked Write 9 Sent Done Done false
12658 4161 Acked Read 6 Sent Done Done false
12659 4162 Acked Read 10 Sent Done Done false
12660 4163 Acked Write 4 Sent Done Done false
12661 4164 Acked Write 6 Sent Done Done false
12662 4165 Acked Read 9 Sent Done Done false
12663 4166 Acked Read 7 Sent Done Done false
12664 4167 Acked Write 4 Sent Done Done false
12665 4168 Acked Read 3 Sent Done Done false
12666 4169 Acked Write 9 Sent Done Done false
12667 4170 Acked Write 2 Sent Done Done false
12668 4171 Acked Write 7 Sent Done Done false
12669 4172 Acked Write 9 Sent Done Done false
12670 4173 Acked Read 2 Sent Done Done false
12671 4174 Acked Write 4 Sent Done Done false
12672 4175 Acked Read 2 Sent Done Done false
12673 4176 Acked Write 1 Sent Done Done false
12674 4177 Acked Write 10 Sent Done Done false
12675 4178 Acked Write 5 Sent Done Done false
12676 4179 Acked Write 10 Sent Done Done false
12677 4180 Acked Read 9 Sent Done Done false
12678 4181 Acked Read 3 Sent Done Done false
12679 4182 Acked Read 6 Sent Done Done false
12680 4183 Acked Read 6 Sent Done Done false
12681 4184 Acked Write 6 Sent Done Done false
12682 4185 Acked Write 1 Sent Done Done false
12683 4186 Acked Read 1 Sent Done Done false
12684 4187 Acked Write 5 Sent Done Done false
12685 4188 Acked Write 1 Sent Done Done false
12686 4189 Acked Read 9 Sent Done Done false
12687 4190 Acked Write 7 Sent Done Done false
12688 4191 Acked Write 8 Sent Done Done false
12689 4192 Acked Read 9 Sent Done Done false
12690 4193 Acked Flush 0 Sent Done Done false
12691 4194 Acked Write 7 Sent Done Done false
12692 4195 Acked Write 9 Sent Done Done false
12693 4196 Acked Flush 0 Sent Done Done false
12694 4197 Acked Write 5 Sent Done Done false
12695 4198 Acked Write 8 Sent Done Done false
12696 4199 Acked Write 8 Sent Done Done false
12697 4200 Acked Write 9 Sent Done Done false
12698 4201 Acked Flush 0 Sent Done Done false
12699 4202 Acked Flush 0 Sent Done Done false
12700 4203 Acked Write 9 Sent Done Done false
12701 4204 Acked Read 4 Sent Done Done false
12702 4205 Acked Read 6 Sent Done Done false
12703 4206 Acked Write 8 Sent Done Done false
12704 4207 Acked Read 3 Sent Done Done false
12705 4208 Acked Read 1 Sent Done Done false
12706 4209 Acked Read 8 Sent Done Done false
12707 4210 Acked Write 1 Sent Done Done false
12708 4211 Acked Read 6 Sent Done Done false
12709 4212 Acked Write 2 Sent Done Done false
12710 4213 Acked Write 7 Sent Done Done false
12711 4214 Acked Read 2 Sent Done Done false
12712 4215 Acked Read 2 Sent Done Done false
12713 4216 Acked Read 9 Sent Done Done false
12714 4217 Acked Read 7 Sent Done Done false
12715 4218 Acked Read 9 Sent Done Done false
12716 4219 Acked Write 2 Sent Done Done false
12717 4220 Acked Read 10 Sent Done Done false
12718 4221 Acked Write 2 Sent Done Done false
12719 4222 Acked Read 3 Sent Done Done false
12720 4223 Acked Read 6 Sent Done Done false
12721 4224 Acked Flush 0 Sent Done Done false
12722 4225 Acked Write 9 Sent Done Done false
12723 4226 Acked Read 3 Sent Done Done false
12724 4227 Acked Write 8 Sent Done Done false
12725 4228 Acked Read 3 Sent Done Done false
12726 4229 Acked Write 3 Sent Done Done false
12727 4230 Acked Write 2 Sent Done Done false
12728 4231 Acked Read 8 Sent Done Done false
12729 4232 Acked Write 6 Sent Done Done false
12730 4233 Acked Read 6 Sent Done Done false
12731 4234 Acked Write 10 Sent Done Done false
12732 4235 Acked Read 3 Sent Done Done false
12733 4236 Acked Read 8 Sent Done Done false
12734 4237 Acked Write 5 Sent Done Done false
12735 4238 Acked Read 1 Sent Done Done false
12736 4239 Acked Write 10 Sent Done Done false
12737 4240 Acked Read 9 Sent Done Done false
12738 4241 Acked Read 4 Sent Done Done false
12739 4242 Acked Flush 0 Sent Done Done false
12740 4243 Acked Write 5 Sent Done Done false
12741 4244 Acked Write 4 Sent Done Done false
12742 4245 Acked Read 5 Sent Done Done false
12743 4246 Acked Write 8 Sent Done Done false
12744 4247 Acked Read 2 Sent Done Done false
12745 4248 Acked Flush 0 Sent Done Done false
12746 4249 Acked Read 4 Sent Done Done false
12747 4250 Acked Flush 0 Sent Done Done false
12748 4251 Acked Read 4 Sent Done Done false
12749 4252 Acked Write 7 Sent Done Done false
12750 4253 Acked Flush 0 Sent Done Done false
12751 4254 Acked Write 3 Sent Done Done false
12752 4255 Acked Write 4 Sent Done Done false
12753 4256 Acked Flush 0 Sent Done Done false
12754 4257 Acked Write 3 Sent Done Done false
12755 4258 Acked Read 9 Sent Done Done false
12756 4259 Acked Read 9 Sent Done Done false
12757 4260 Acked Read 5 Sent Done Done false
12758 4261 Acked Read 4 Sent Done Done false
12759 4262 Acked Read 6 Sent Done Done false
12760 4263 Acked Write 7 Sent Done Done false
12761 4264 Acked Read 8 Sent Done Done false
12762 4265 Acked Read 8 Sent Done Done false
12763 4266 Acked Write 4 Sent Done Done false
12764 4267 Acked Read 1 Sent Done Done false
12765 4268 Acked Read 5 Sent Done Done false
12766 4269 Acked Read 1 Sent Done Done false
12767 4270 Acked Read 1 Sent Done Done false
12768 4271 Acked Read 5 Sent Done Done false
12769 4272 Acked Flush 0 Sent Done Done false
12770 4273 Acked Write 5 Sent Done Done false
12771 4274 Acked Write 2 Sent Done Done false
12772 4275 Acked Read 5 Sent Done Done false
12773 4276 Acked Read 8 Sent Done Done false
12774 4277 Acked Write 6 Sent Done Done false
12775 4278 Acked Read 1 Sent Done Done false
12776 4279 Acked Read 3 Sent Done Done false
12777 4280 Acked Read 5 Sent Done Done false
12778 4281 Acked Write 1 Sent Done Done false
12779 4282 Acked Write 9 Sent Done Done false
12780 4283 Acked Read 5 Sent Done Done false
12781 4284 Acked Write 7 Sent Done Done false
12782 4285 Acked Read 1 Sent Done Done false
12783 4286 Acked Read 4 Sent Done Done false
12784 4287 Acked Read 4 Sent Done Done false
12785 4288 Acked Write 5 Sent Done Done false
12786 4289 Acked Read 5 Sent Done Done false
12787 4290 Acked Read 3 Sent Done Done false
12788 4291 Acked Read 9 Sent Done Done false
12789 4292 Acked Read 1 Sent Done Done false
12790 4293 Acked Flush 0 Sent Done Done false
12791 4294 Acked Write 9 Sent Done Done false
12792 4295 Acked Read 9 Sent Done Done false
12793 4296 Acked Read 7 Sent Done Done false
12794 4297 Acked Read 4 Sent Done Done false
12795 4298 Acked Write 8 Sent Done Done false
12796 4299 Acked Read 3 Sent Done Done false
12797 4300 Acked Read 4 Sent Done Done false
12798 4301 Acked Read 1 Sent Done Done false
12799 4302 Acked Read 8 Sent Done Done false
12800 4303 Acked Write 2 Sent Done Done false
12801 4304 Acked Read 10 Sent Done Done false
12802 4305 Acked Read 10 Sent Done Done false
12803 4306 Acked Read 6 Sent Done Done false
12804 4307 Acked Read 5 Sent Done Done false
12805 4308 Acked Read 9 Sent Done Done false
12806 4309 Acked Write 2 Sent Done Done false
12807 4310 Acked Read 4 Sent Done Done false
12808 4311 Acked Read 3 Sent Done Done false
12809 4312 Acked Write 10 Sent Done Done false
12810 4313 Acked Flush 0 Sent Done Done false
12811 4314 Acked Write 3 Sent Done Done false
12812 4315 Acked Read 8 Sent Done Done false
12813 4316 Acked Read 3 Sent Done Done false
12814 4317 Acked Flush 0 Sent Done Done false
12815 4318 Acked Write 10 Sent Done Done false
12816 4319 Acked Flush 0 Sent Done Done false
12817 STATES DS:0 DS:1 DS:2 TOTAL
12818 Sent 302 0 0 302
12819 Done 0 302 302 604
12820 Skipped 0 0 0 0
12821 Error 0 0 0 0
12822 Last Flush: 4017 4319 4319
12823 Downstairs last five completed: 4017 4016 4015 4014 4013
12824 Upstairs last five completed: 4319 4318 4317 4316 4315
12825 CLIENT: Up:0 ds:302 act:2
128262025-01-10T16:38:00.211ZINFOcrucible: connecting to 127.0.0.1:8810 = io task client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
128272025-01-10T16:38:00.211ZINFOcrucible: ds_connection connected from Ok(127.0.0.1:33082) = io task client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
128282025-01-10T16:38:00.212ZWARNcrucible: version negotiation from state Offline = downstairs client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
128292025-01-10T16:38:00.213ZINFOcrucible: downstairs client at Some(127.0.0.1:8810) has region UUID 12345678-0000-0000-0000-000000008810 = downstairs client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
128302025-01-10T16:38:00.213ZINFOcrucible: Returning UUID:12345678-0000-0000-0000-000000008810 matches = downstairs client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
128312025-01-10T16:38:00.213ZINFOcrucible: send last flush ID to this DS: 4017 = downstairs client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
128322025-01-10T16:38:00.213ZINFOcrucible: Replied this last flush ID: 4017 = downstairs client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
128332025-01-10T16:38:00.213ZINFOcrucible: ds_transition from Offline to Active = downstairs client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
128342025-01-10T16:38:00.213ZINFOcrucible: [0] Transition from Offline to Active = downstairs client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
128352025-01-10T16:38:00.213ZINFOcrucible: [0] client re-new 302 jobs since flush 4017 = downstairs session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
128362025-01-10T16:38:00.213ZINFOcrucible: [0] Replayed 302 jobs since flush: 4017 = downstairs session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
12837 ----------------------------------------------------------------
12838 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:0
12839 Downstairs last five completed: 4319 4318 4317 4316 4315
12840 Upstairs last five completed: 4319 4318 4317 4316 4315
12841 CLIENT: Up:0 ds:0 act:3
12842 Replay: All jobs finished
12843 Main task has work to do, go find it
12844 got dsc Stop(1)
12845 stop 1
12846 [8820] Got stop action so:false kr:false
12847 Jan 10 16:38:02.447 INFO request completed, latency_us: 416, response_code: 204, uri: /stop/cid/1, method: POST, req_id: 66b74983-1cdd-47e4-9de0-470ce8721cc2, remote_addr: 127.0.0.1:55917, local_addr: 127.0.0.1:9998
128482025-01-10T16:38:02.448ZWARNcrucible: downstairs disconnected = io task client = 1 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
128492025-01-10T16:38:02.448ZWARNcrucible: client task is sending Done(Finished) = io task client = 1 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
128502025-01-10T16:38:02.448ZWARNcrucible: downstairs task for 1 stopped due to Finished session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
128512025-01-10T16:38:02.448ZINFOcrucible: ds_transition from Active to Offline = downstairs client = 1 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
128522025-01-10T16:38:02.448ZINFOcrucible: [1] Transition from Active to Offline = downstairs client = 1 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
12853 Jan 10 16:38:02.448 INFO request completed, latency_us: 125, response_code: 200, uri: /state/cid/1, method: GET, req_id: c7113983-a177-45ae-bde6-4ec3c8af35c2, remote_addr: 127.0.0.1:55917, local_addr: 127.0.0.1:9998
128542025-01-10T16:38:02.448ZINFOcrucible: client task is exiting = io task client = 1 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
12855 [8820] Exited with: ExitStatus(unix_wait_status(9))
12856 [8820][1] reports Exit
12857 Jan 10 16:38:06.450 INFO request completed, latency_us: 211, response_code: 200, uri: /state/cid/1, method: GET, req_id: bf39ecc7-6f31-450e-962c-8891bfc9dea8, remote_addr: 127.0.0.1:55917, local_addr: 127.0.0.1:9998
12858 001/300 Write block 2382 len 8192 data: 3 3
12859 002/300 Write block 3284 len 36864 data: 3 4 5 4 4 4 4 4 4
12860 003/300 Read block 917 len 4096
12861 004/300 Write block 4911 len 40960 data: 3 2 2 2 3 3 3 2 3 4
12862 005/300 Write block 3767 len 32768 data: 4 3 3 2 2 2 2 4
12863 006/300 Write block 1413 len 20480 data: 2 2 2 2 2
12864 007/300 Read block 2673 len 28672
12865 008/300 Flush
12866 009/300 Read block 4494 len 28672
12867 010/300 Flush
12868 011/300 Read block 3141 len 36864
12869 012/300 Write block 3018 len 4096 data: 6
12870 013/300 Read block 4028 len 36864
12871 014/300 Write block 475 len 28672 data: 3 3 3 4 4 6 5
12872 015/300 Write block 2877 len 20480 data: 3 3 2 4 5
12873 016/300 Read block 1952 len 12288
12874 017/300 Write block 873 len 28672 data: 4 4 4 3 6 6 6
12875 018/300 Write block 2407 len 32768 data: 2 2 2 2 3 3 3 3
12876 019/300 Write block 3879 len 20480 data: 4 4 4 3 3
12877 020/300 Flush
12878 021/300 Read block 3152 len 28672
12879 022/300 Write block 3957 len 8192 data: 3 3
12880 023/300 Read block 4900 len 40960
12881 024/300 Read block 744 len 16384
12882 025/300 Write block 2866 len 4096 data: 7
12883 026/300 Read block 739 len 28672
12884 027/300 Read block 1276 len 32768
12885 028/300 Flush
12886 029/300 Write block 4809 len 16384 data: 3 3 3 3
12887 030/300 Read block 63 len 4096
12888 031/300 Read block 4038 len 12288
12889 032/300 Read block 1515 len 4096
12890 033/300 Read block 1062 len 32768
12891 034/300 Read block 3311 len 4096
12892 035/300 Read block 3387 len 32768
12893 036/300 Write block 1199 len 4096 data: 2
12894 037/300 Write block 763 len 16384 data: 4 6 6 5
12895 038/300 Flush
12896 039/300 Write block 4811 len 4096 data: 4
12897 040/300 Write block 1876 len 8192 data: 2 4
12898 041/300 Read block 2107 len 32768
12899 042/300 Write block 1786 len 16384 data: 4 5 5 4
12900 043/300 Write block 1346 len 8192 data: 3 3
12901 044/300 Read block 3021 len 24576
12902 045/300 Read block 2963 len 24576
12903 046/300 Read block 4654 len 12288
12904 047/300 Read block 3345 len 36864
12905 048/300 Read block 406 len 8192
12906 049/300 Write block 4369 len 36864 data: 2 3 4 4 5 6 6 6 5
12907 050/300 Write block 2887 len 36864 data: 5 3 4 4 3 4 3 3 3
12908 051/300 Write block 4620 len 32768 data: 2 3 4 4 4 4 4 5
12909 052/300 Read block 2194 len 28672
12910 053/300 Flush
12911 054/300 Read block 3719 len 20480
12912 055/300 Read block 4482 len 36864
12913 056/300 Read block 2663 len 20480
12914 057/300 Read block 2877 len 40960
12915 058/300 Write block 317 len 20480 data: 3 3 3 3 2
12916 059/300 Read block 3982 len 4096
12917 060/300 Write block 3398 len 32768 data: 6 6 5 4 3 4 4 3
12918 061/300 Write block 4568 len 20480 data: 4 4 7 7 5
12919 062/300 Write block 1096 len 24576 data: 2 3 3 2 2 2
12920 063/300 Flush
12921 064/300 Write block 4678 len 40960 data: 3 3 2 2 2 2 3 3 3 2
12922 065/300 Read block 2293 len 20480
12923 066/300 Write block 2706 len 4096 data: 2
12924 067/300 Read block 3349 len 36864
12925 068/300 Flush
12926 069/300 Write block 4841 len 12288 data: 4 4 4
12927 070/300 Write block 1172 len 4096 data: 5
12928 071/300 Read block 1858 len 8192
12929 072/300 Read block 4801 len 12288
12930 073/300 Write block 1504 len 32768 data: 2 2 2 2 3 3 3 3
12931 074/300 Write block 1141 len 16384 data: 3 3 3 4
12932 075/300 Read block 555 len 16384
12933 076/300 Flush
12934 077/300 Write block 831 len 40960 data: 3 3 2 2 2 2 3 3 4 4
12935 078/300 Read block 4940 len 20480
12936 079/300 Read block 2661 len 32768
12937 080/300 Write block 889 len 4096 data: 2
12938 081/300 Read block 2628 len 12288
12939 082/300 Write block 3437 len 16384 data: 2 2 2 2
12940 083/300 Write block 3560 len 40960 data: 2 3 3 2 2 2 2 3 3 2
12941 084/300 Read block 3711 len 32768
12942 085/300 Write block 791 len 36864 data: 3 3 3 3 2 2 2 2 3
12943 086/300 Flush
12944 087/300 Read block 627 len 28672
12945 088/300 Read block 263 len 28672
12946 089/300 Write block 1146 len 28672 data: 4 3 3 3 4 5 6
12947 090/300 Write block 4800 len 36864 data: 4 4 6 5 4 5 4 4 4
12948 091/300 Write block 2547 len 12288 data: 2 2 2
12949 092/300 Write block 909 len 20480 data: 2 3 3 3 3
12950 093/300 Write block 1223 len 12288 data: 3 3 3
12951 094/300 Write block 2484 len 16384 data: 5 5 4 4
12952 095/300 Flush
12953 096/300 Write block 2599 len 8192 data: 4 4
12954 097/300 Read block 2414 len 32768
12955 098/300 Write block 2235 len 8192 data: 2 2
12956 099/300 Read block 337 len 16384
12957 100/300 Read block 470 len 12288
12958 101/300 Flush
12959 102/300 Write block 2205 len 36864 data: 3 2 2 2 2 2 2 3 3
12960 103/300 Write block 2769 len 24576 data: 3 3 2 2 2 2
12961 104/300 Read block 4961 len 20480
12962 105/300 Read block 50 len 20480
12963 106/300 Read block 1384 len 36864
12964 107/300 Write block 3033 len 20480 data: 3 3 3 3 3
12965 108/300 Read block 560 len 8192
12966 109/300 Read block 4952 len 12288
12967 110/300 Read block 120 len 24576
12968 111/300 Write block 3656 len 12288 data: 4 4 4
12969 112/300 Read block 297 len 8192
12970 113/300 Read block 245 len 4096
12971 114/300 Write block 4528 len 20480 data: 5 5 6 7 7
12972 115/300 Write block 1665 len 24576 data: 4 4 4 3 4 4
12973 116/300 Flush
12974 117/300 Flush
12975 118/300 Read block 4016 len 12288
12976 119/300 Read block 544 len 36864
12977 120/300 Write block 4428 len 28672 data: 5 5 5 5 6 5 6
12978 121/300 Read block 4296 len 8192
12979 122/300 Write block 4152 len 12288 data: 4 4 5
12980 123/300 Write block 1411 len 24576 data: 3 3 3 3 3 3
12981 124/300 Read block 2744 len 28672
12982 125/300 Read block 2790 len 16384
12983 126/300 Read block 3360 len 4096
12984 127/300 Write block 4438 len 28672 data: 4 4 5 5 4 4 4
12985 128/300 Write block 2164 len 40960 data: 3 4 4 3 3 3 5 5 5 4
12986 129/300 Write block 3012 len 32768 data: 3 3 4 4 5 6 7 5
12987 130/300 Flush
12988 131/300 Write block 182 len 36864 data: 4 4 5 5 6 4 4 3 3
12989 132/300 Write block 4081 len 4096 data: 3
12990 133/300 Read block 4897 len 4096
12991 134/300 Read block 2694 len 32768
12992 135/300 Flush
12993 136/300 Read block 61 len 8192
12994 137/300 Read block 2256 len 12288
12995 138/300 Read block 4449 len 32768
12996 139/300 Write block 448 len 12288 data: 5 5 5
12997 140/300 Write block 2278 len 12288 data: 4 5 4
12998 141/300 Read block 1924 len 12288
12999 142/300 Write block 1311 len 32768 data: 3 2 3 3 3 3 3 3
13000 143/300 Flush
13001 144/300 Read block 3581 len 24576
13002 145/300 Read block 2234 len 12288
13003 146/300 Write block 2000 len 40960 data: 4 3 2 2 3 3 2 3 2 3
13004 147/300 Read block 2470 len 8192
13005 148/300 Read block 559 len 36864
13006 149/300 Flush
13007 150/300 Write block 830 len 40960 data: 3 4 4 3 3 3 3 4 4 5
13008 151/300 Flush
13009 152/300 Read block 3956 len 20480
13010 153/300 Flush
13011 154/300 Read block 3344 len 12288
13012 155/300 Write block 1323 len 12288 data: 4 4 3
13013 156/300 Write block 3609 len 32768 data: 4 3 4 4 4 3 3 3
13014 157/300 Write block 1193 len 36864 data: 4 3 3 2 2 2 3 2 2
13015 158/300 Write block 4188 len 36864 data: 3 3 3 4 4 3 4 4 5
13016 159/300 Flush
13017 160/300 Write block 4530 len 28672 data: 7 8 8 6 4 3 2
13018 161/300 Read block 1034 len 24576
13019 162/300 Write block 2539 len 24576 data: 2 2 2 2 3 2
13020 163/300 Read block 1232 len 16384
13021 164/300 Write block 4261 len 4096 data: 3
13022 165/300 Flush
13023 166/300 Flush
13024 167/300 Read block 3872 len 36864
13025 168/300 Read block 4222 len 8192
13026 169/300 Read block 2260 len 20480
13027 170/300 Write block 4130 len 12288 data: 3 2 2
13028 171/300 Read block 2147 len 12288
13029 172/300 Read block 3123 len 28672
13030 173/300 Write block 1281 len 20480 data: 4 5 5 4 4
13031 174/300 Read block 1330 len 4096
13032 175/300 Read block 454 len 12288
13033 176/300 Write block 2272 len 28672 data: 3 2 3 3 4 4 5
13034 177/300 Read block 3895 len 4096
13035 178/300 Read block 2669 len 8192
13036 179/300 Write block 2895 len 40960 data: 4 3 5 5 5 5 5 4 4 4
13037 180/300 Read block 1960 len 12288
13038 181/300 Read block 3940 len 20480
13039 182/300 Read block 4092 len 28672
13040 183/300 Write block 4224 len 36864 data: 2 2 2 2 2 2 2 2 2
13041 184/300 Write block 2590 len 12288 data: 5 5 5
13042 185/300 Write block 4080 len 28672 data: 3 4 3 3 4 4 2
13043 186/300 Read block 3733 len 20480
13044 187/300 Write block 3643 len 20480 data: 4 4 4 4 3
13045 188/300 Write block 4413 len 12288 data: 3 2 2
13046 189/300 Write block 2960 len 12288 data: 3 3 3
13047 190/300 Read block 4658 len 40960
13048 191/300 Write block 2582 len 12288 data: 3 3 4
13049 192/300 Write block 3061 len 32768 data: 5 6 5 6 6 5 5 5
13050 193/300 Write block 916 len 40960 data: 4 5 5 5 4 3 3 3 3 3
13051 194/300 Write block 3379 len 40960 data: 4 6 6 6 6 8 6 5 5 5
13052 195/300 Read block 615 len 8192
13053 196/300 Write block 1700 len 40960 data: 3 3 3 3 3 3 3 3 4 4
13054 197/300 Write block 3279 len 24576 data: 2 2 2 2 3 4
13055 198/300 Write block 3029 len 40960 data: 2 2 3 3 4 4 4 4 4 3
13056 199/300 Write block 4663 len 28672 data: 3 2 2 2 2 2 3
13057 200/300 Read block 4137 len 20480
13058 201/300 Read block 2454 len 4096
13059 202/300 Write block 528 len 20480 data: 5 5 4 5 5
13060 203/300 Write block 2504 len 8192 data: 3 3
13061 204/300 Read block 4405 len 12288
13062 205/300 Write block 2552 len 40960 data: 4 4 3 2 2 2 2 2 2 2
13063 206/300 Write block 4932 len 28672 data: 2 2 2 2 2 3 3
13064 207/300 Read block 3354 len 40960
13065 208/300 Write block 321 len 24576 data: 3 2 2 2 3 3
13066 209/300 Write block 1661 len 20480 data: 5 5 4 4 5
13067 210/300 Write block 2969 len 28672 data: 2 2 2 2 2 2 3
13068 211/300 Read block 1475 len 8192
13069 212/300 Read block 324 len 28672
13070 213/300 Write block 2140 len 32768 data: 3 3 3 2 2 2 2 3
13071 214/300 Read block 4292 len 16384
13072 215/300 Write block 3099 len 36864 data: 3 3 3 2 2 2 2 3 3
13073 216/300 Write block 1112 len 12288 data: 4 4 3
13074 217/300 Read block 3996 len 40960
13075 218/300 Read block 2981 len 16384
13076 219/300 Write block 1224 len 32768 data: 4 4 3 4 4 4 4 5
13077 220/300 Write block 4894 len 24576 data: 4 5 5 4 4 3
13078 221/300 Read block 559 len 24576
13079 222/300 Write block 601 len 16384 data: 5 3 4 4
13080 223/300 Write block 1331 len 16384 data: 6 7 7 6
13081 224/300 Read block 3252 len 40960
13082 225/300 Read block 1955 len 20480
13083 226/300 Read block 3472 len 4096
13084 227/300 Write block 3189 len 12288 data: 2 3 3
13085 228/300 Write block 1175 len 4096 data: 4
13086 229/300 Write block 1109 len 40960 data: 3 3 3 5 5 4 2 2 3 3
13087 230/300 Write block 364 len 20480 data: 3 3 3 3 3
13088 231/300 Write block 3793 len 28672 data: 3 4 4 4 4 5 4
13089 232/300 Read block 3580 len 8192
13090 233/300 Write block 4808 len 20480 data: 5 4 4 5 4
13091 234/300 Read block 1533 len 12288
13092 235/300 Read block 2190 len 40960
13093 236/300 Read block 4583 len 32768
13094 237/300 Write block 4869 len 32768 data: 2 2 2 2 2 2 2 2
13095 238/300 Read block 825 len 24576
13096 239/300 Flush
13097 240/300 Write block 1387 len 12288 data: 4 5 5
13098 241/300 Read block 4246 len 4096
13099 242/300 Read block 1566 len 16384
13100 243/300 Write block 2304 len 24576 data: 2 2 3 4 4 4
13101 244/300 Read block 1010 len 12288
13102 245/300 Read block 2242 len 4096
13103 246/300 Read block 3923 len 12288
13104 247/300 Read block 835 len 16384
13105 248/300 Write block 2717 len 20480 data: 2 3 2 2 2
13106 249/300 Write block 1139 len 8192 data: 4 3
13107 250/300 Write block 845 len 40960 data: 5 4 2 2 3 2 2 2 2 2
13108 251/300 Write block 1329 len 12288 data: 5 5 7
13109 252/300 Read block 2841 len 16384
13110 253/300 Read block 2917 len 28672
13111 254/300 Read block 1586 len 28672
13112 255/300 Write block 2627 len 4096 data: 4
13113 256/300 Write block 2871 len 20480 data: 4 5 5 5 3
13114 257/300 Write block 1612 len 28672 data: 3 3 4 4 3 3 3
13115 258/300 Write block 3232 len 12288 data: 2 2 2
13116 259/300 Flush
13117 260/300 Write block 964 len 36864 data: 4 4 4 3 3 3 4 5 4
13118 261/300 Write block 3321 len 16384 data: 5 3 3 3
13119 262/300 Read block 2041 len 12288
13120 263/300 Write block 519 len 24576 data: 3 4 4 3 3 3
13121 264/300 Read block 2178 len 24576
13122 265/300 Read block 1103 len 12288
13123 266/300 Write block 1986 len 24576 data: 3 3 3 4 3 4
13124 267/300 Read block 2127 len 16384
13125 268/300 Read block 1865 len 36864
13126 269/300 Flush
13127 270/300 Write block 875 len 4096 data: 5
13128 271/300 Write block 149 len 20480 data: 3 3 4 5 5
13129 272/300 Write block 1295 len 20480 data: 5 5 4 4 4
13130 273/300 Write block 4753 len 4096 data: 4
13131 274/300 Flush
13132 275/300 Read block 4004 len 4096
13133 276/300 Read block 4703 len 40960
13134 277/300 Flush
13135 278/300 Read block 4325 len 32768
13136 279/300 Write block 3946 len 8192 data: 6 5
13137 280/300 Read block 4052 len 28672
13138 281/300 Write block 4208 len 40960 data: 4 4 3 3 3 3 3 3 2 4
13139 282/300 Write block 2728 len 8192 data: 4 4
13140 283/300 Flush
13141 284/300 Read block 1399 len 20480
13142 285/300 Read block 997 len 20480
13143 286/300 Read block 1688 len 28672
13144 287/300 Write block 1713 len 4096 data: 2
13145 288/300 Write block 3942 len 4096 data: 4
13146 289/300 Flush
13147 290/300 Write block 1664 len 24576 data: 5 6 5 5 4 5
13148 291/300 Write block 4512 len 40960 data: 2 2 2 2 2 2 2 2 3 3
13149 292/300 Write block 2254 len 12288 data: 2 2 2
13150 293/300 Write block 460 len 20480 data: 2 2 2 2 2
13151 294/300 Read block 3068 len 12288
13152 295/300 Read block 2555 len 28672
13153 296/300 Read block 3459 len 24576
13154 297/300 Flush
13155 298/300 Flush
13156 299/300 Read block 4190 len 8192
13157 300/300 Write block 322 len 16384 data: 3 3 3 4
13158 301/300 Flush
13159 Main task has work to do, go find it
13160 got dsc Start(1)
13161 start 1
13162 Jan 10 16:38:06.669 INFO request completed, latency_us: 216, response_code: 204, uri: /start/cid/1, method: POST, req_id: a6ae5c45-1d98-4c8f-890f-e3d2911172b3, remote_addr: 127.0.0.1:55917, local_addr: 127.0.0.1:9998
13163 Replay: started 1, returned:Ok(())
13164 ----------------------------------------------------------------
13165 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:301
13166 States: Active Offline Active
13167 JOBID ACK TYPE BKS/EXT DS:0 DS:1 DS:2 REPLAY
13168 4320 Acked Write 2 Done Sent Done false
13169 4321 Acked Write 9 Done Sent Done false
13170 4322 Acked Read 1 Done Sent Done false
13171 4323 Acked Write 10 Done Sent Done false
13172 4324 Acked Write 8 Done Sent Done false
13173 4325 Acked Write 5 Done Sent Done false
13174 4326 Acked Read 7 Done Sent Done false
13175 4327 Acked Flush 0 Done Sent Done false
13176 4328 Acked Read 7 Done Sent Done false
13177 4329 Acked Flush 0 Done Sent Done false
13178 4330 Acked Read 9 Done Sent Done false
13179 4331 Acked Write 1 Done Sent Done false
13180 4332 Acked Read 9 Done Sent Done false
13181 4333 Acked Write 7 Done Sent Done false
13182 4334 Acked Write 5 Done Sent Done false
13183 4335 Acked Read 3 Done Sent Done false
13184 4336 Acked Write 7 Done Sent Done false
13185 4337 Acked Write 8 Done Sent Done false
13186 4338 Acked Write 5 Done Sent Done false
13187 4339 Acked Flush 0 Done Sent Done false
13188 4340 Acked Read 7 Done Sent Done false
13189 4341 Acked Write 2 Done Sent Done false
13190 4342 Acked Read 10 Done Sent Done false
13191 4343 Acked Read 4 Done Sent Done false
13192 4344 Acked Write 1 Done Sent Done false
13193 4345 Acked Read 7 Done Sent Done false
13194 4346 Acked Read 8 Done Sent Done false
13195 4347 Acked Flush 0 Done Sent Done false
13196 4348 Acked Write 4 Done Sent Done false
13197 4349 Acked Read 1 Done Sent Done false
13198 4350 Acked Read 3 Done Sent Done false
13199 4351 Acked Read 1 Done Sent Done false
13200 4352 Acked Read 8 Done Sent Done false
13201 4353 Acked Read 1 Done Sent Done false
13202 4354 Acked Read 8 Done Sent Done false
13203 4355 Acked Write 1 Done Sent Done false
13204 4356 Acked Write 4 Done Sent Done false
13205 4357 Acked Flush 0 Done Sent Done false
13206 4358 Acked Write 1 Done Sent Done false
13207 4359 Acked Write 2 Done Sent Done false
13208 4360 Acked Read 8 Done Sent Done false
13209 4361 Acked Write 4 Done Sent Done false
13210 4362 Acked Write 2 Done Sent Done false
13211 4363 Acked Read 6 Done Sent Done false
13212 4364 Acked Read 6 Done Sent Done false
13213 4365 Acked Read 3 Done Sent Done false
13214 4366 Acked Read 9 Done Sent Done false
13215 4367 Acked Read 2 Done Sent Done false
13216 4368 Acked Write 9 Done Sent Done false
13217 4369 Acked Write 9 Done Sent Done false
13218 4370 Acked Write 8 Done Sent Done false
13219 4371 Acked Read 7 Done Sent Done false
13220 4372 Acked Flush 0 Done Sent Done false
13221 4373 Acked Read 5 Done Sent Done false
13222 4374 Acked Read 9 Done Sent Done false
13223 4375 Acked Read 5 Done Sent Done false
13224 4376 Acked Read 10 Done Sent Done false
13225 4377 Acked Write 5 Done Sent Done false
13226 4378 Acked Read 1 Done Sent Done false
13227 4379 Acked Write 8 Done Sent Done false
13228 4380 Acked Write 5 Done Sent Done false
13229 4381 Acked Write 6 Done Sent Done false
13230 4382 Acked Flush 0 Done Sent Done false
13231 4383 Acked Write 10 Done Sent Done false
13232 4384 Acked Read 5 Done Sent Done false
13233 4385 Acked Write 1 Done Sent Done false
13234 4386 Acked Read 9 Done Sent Done false
13235 4387 Acked Flush 0 Done Sent Done false
13236 4388 Acked Write 3 Done Sent Done false
13237 4389 Acked Write 1 Done Sent Done false
13238 4390 Acked Read 2 Done Sent Done false
13239 4391 Acked Read 3 Done Sent Done false
13240 4392 Acked Write 8 Done Sent Done false
13241 4393 Acked Write 4 Done Sent Done false
13242 4394 Acked Read 4 Done Sent Done false
13243 4395 Acked Flush 0 Done Sent Done false
13244 4396 Acked Write 10 Done Sent Done false
13245 4397 Acked Read 5 Done Sent Done false
13246 4398 Acked Read 8 Done Sent Done false
13247 4399 Acked Write 1 Done Sent Done false
13248 4400 Acked Read 3 Done Sent Done false
13249 4401 Acked Write 4 Done Sent Done false
13250 4402 Acked Write 10 Done Sent Done false
13251 4403 Acked Read 8 Done Sent Done false
13252 4404 Acked Write 9 Done Sent Done false
13253 4405 Acked Flush 0 Done Sent Done false
13254 4406 Acked Read 7 Done Sent Done false
13255 4407 Acked Read 7 Done Sent Done false
13256 4408 Acked Write 7 Done Sent Done false
13257 4409 Acked Write 9 Done Sent Done false
13258 4410 Acked Write 3 Done Sent Done false
13259 4411 Acked Write 5 Done Sent Done false
13260 4412 Acked Write 3 Done Sent Done false
13261 4413 Acked Write 4 Done Sent Done false
13262 4414 Acked Flush 0 Done Sent Done false
13263 4415 Acked Write 2 Done Sent Done false
13264 4416 Acked Read 8 Done Sent Done false
13265 4417 Acked Write 2 Done Sent Done false
13266 4418 Acked Read 4 Done Sent Done false
13267 4419 Acked Read 3 Done Sent Done false
13268 4420 Acked Flush 0 Done Sent Done false
13269 4421 Acked Write 9 Done Sent Done false
13270 4422 Acked Write 6 Done Sent Done false
13271 4423 Acked Read 5 Done Sent Done false
13272 4424 Acked Read 5 Done Sent Done false
13273 4425 Acked Read 9 Done Sent Done false
13274 4426 Acked Write 5 Done Sent Done false
13275 4427 Acked Read 2 Done Sent Done false
13276 4428 Acked Read 3 Done Sent Done false
13277 4429 Acked Read 6 Done Sent Done false
13278 4430 Acked Write 3 Done Sent Done false
13279 4431 Acked Read 2 Done Sent Done false
13280 4432 Acked Read 1 Done Sent Done false
13281 4433 Acked Write 5 Done Sent Done false
13282 4434 Acked Write 6 Done Sent Done false
13283 4435 Acked Flush 0 Done Sent Done false
13284 4436 Acked Flush 0 Done Sent Done false
13285 4437 Acked Read 3 Done Sent Done false
13286 4438 Acked Read 9 Done Sent Done false
13287 4439 Acked Write 7 Done Sent Done false
13288 4440 Acked Read 2 Done Sent Done false
13289 4441 Acked Write 3 Done Sent Done false
13290 4442 Acked Write 6 Done Sent Done false
13291 4443 Acked Read 7 Done Sent Done false
13292 4444 Acked Read 4 Done Sent Done false
13293 4445 Acked Read 1 Done Sent Done false
13294 4446 Acked Write 7 Done Sent Done false
13295 4447 Acked Write 10 Done Sent Done false
13296 4448 Acked Write 8 Done Sent Done false
13297 4449 Acked Flush 0 Done Sent Done false
13298 4450 Acked Write 9 Done Sent Done false
13299 4451 Acked Write 1 Done Sent Done false
13300 4452 Acked Read 1 Done Sent Done false
13301 4453 Acked Read 8 Done Sent Done false
13302 4454 Acked Flush 0 Done Sent Done false
13303 4455 Acked Read 2 Done Sent Done false
13304 4456 Acked Read 3 Done Sent Done false
13305 4457 Acked Read 8 Done Sent Done false
13306 4458 Acked Write 3 Done Sent Done false
13307 4459 Acked Write 3 Done Sent Done false
13308 4460 Acked Read 3 Done Sent Done false
13309 4461 Acked Write 8 Done Sent Done false
13310 4462 Acked Flush 0 Done Sent Done false
13311 4463 Acked Read 6 Done Sent Done false
13312 4464 Acked Read 3 Done Sent Done false
13313 4465 Acked Write 10 Done Sent Done false
13314 4466 Acked Read 2 Done Sent Done false
13315 4467 Acked Read 9 Done Sent Done false
13316 4468 Acked Flush 0 Done Sent Done false
13317 4469 Acked Write 10 Done Sent Done false
13318 4470 Acked Flush 0 Done Sent Done false
13319 4471 Acked Read 5 Done Sent Done false
13320 4472 Acked Flush 0 Done Sent Done false
13321 4473 Acked Read 3 Done Sent Done false
13322 4474 Acked Write 3 Done Sent Done false
13323 4475 Acked Write 8 Done Sent Done false
13324 4476 Acked Write 9 Done Sent Done false
13325 4477 Acked Write 9 Done Sent Done false
13326 4478 Acked Flush 0 Done Sent Done false
13327 4479 Acked Write 7 Done Sent Done false
13328 4480 Acked Read 6 Done Sent Done false
13329 4481 Acked Write 6 Done Sent Done false
13330 4482 Acked Read 4 Done Sent Done false
13331 4483 Acked Write 1 Done Sent Done false
13332 4484 Acked Flush 0 Done Sent Done false
13333 4485 Acked Flush 0 Done Sent Done false
13334 4486 Acked Read 9 Done Sent Done false
13335 4487 Acked Read 2 Done Sent Done false
13336 4488 Acked Read 5 Done Sent Done false
13337 4489 Acked Write 3 Done Sent Done false
13338 4490 Acked Read 3 Done Sent Done false
13339 4491 Acked Read 7 Done Sent Done false
13340 4492 Acked Write 5 Done Sent Done false
13341 4493 Acked Read 1 Done Sent Done false
13342 4494 Acked Read 3 Done Sent Done false
13343 4495 Acked Write 7 Done Sent Done false
13344 4496 Acked Read 1 Done Sent Done false
13345 4497 Acked Read 2 Done Sent Done false
13346 4498 Acked Write 10 Done Sent Done false
13347 4499 Acked Read 3 Done Sent Done false
13348 4500 Acked Read 5 Done Sent Done false
13349 4501 Acked Read 7 Done Sent Done false
13350 4502 Acked Write 9 Done Sent Done false
13351 4503 Acked Write 3 Done Sent Done false
13352 4504 Acked Write 7 Done Sent Done false
13353 4505 Acked Read 5 Done Sent Done false
13354 4506 Acked Write 5 Done Sent Done false
13355 4507 Acked Write 3 Done Sent Done false
13356 4508 Acked Write 3 Done Sent Done false
13357 4509 Acked Read 10 Done Sent Done false
13358 4510 Acked Write 3 Done Sent Done false
13359 4511 Acked Write 8 Done Sent Done false
13360 4512 Acked Write 10 Done Sent Done false
13361 4513 Acked Write 10 Done Sent Done false
13362 4514 Acked Read 2 Done Sent Done false
13363 4515 Acked Write 10 Done Sent Done false
13364 4516 Acked Write 6 Done Sent Done false
13365 4517 Acked Write 10 Done Sent Done false
13366 4518 Acked Write 7 Done Sent Done false
13367 4519 Acked Read 5 Done Sent Done false
13368 4520 Acked Read 1 Done Sent Done false
13369 4521 Acked Write 5 Done Sent Done false
13370 4522 Acked Write 2 Done Sent Done false
13371 4523 Acked Read 3 Done Sent Done false
13372 4524 Acked Write 10 Done Sent Done false
13373 4525 Acked Write 7 Done Sent Done false
13374 4526 Acked Read 10 Done Sent Done false
13375 4527 Acked Write 6 Done Sent Done false
13376 4528 Acked Write 5 Done Sent Done false
13377 4529 Acked Write 7 Done Sent Done false
13378 4530 Acked Read 2 Done Sent Done false
13379 4531 Acked Read 7 Done Sent Done false
13380 4532 Acked Write 8 Done Sent Done false
13381 4533 Acked Read 4 Done Sent Done false
13382 4534 Acked Write 9 Done Sent Done false
13383 4535 Acked Write 3 Done Sent Done false
13384 4536 Acked Read 10 Done Sent Done false
13385 4537 Acked Read 4 Done Sent Done false
13386 4538 Acked Write 8 Done Sent Done false
13387 4539 Acked Write 6 Done Sent Done false
13388 4540 Acked Read 6 Done Sent Done false
13389 4541 Acked Write 4 Done Sent Done false
13390 4542 Acked Write 4 Done Sent Done false
13391 4543 Acked Read 10 Done Sent Done false
13392 4544 Acked Read 5 Done Sent Done false
13393 4545 Acked Read 1 Done Sent Done false
13394 4546 Acked Write 3 Done Sent Done false
13395 4547 Acked Write 1 Done Sent Done false
13396 4548 Acked Write 10 Done Sent Done false
13397 4549 Acked Write 5 Done Sent Done false
13398 4550 Acked Write 7 Done Sent Done false
13399 4551 Acked Read 2 Done Sent Done false
13400 4552 Acked Write 5 Done Sent Done false
13401 4553 Acked Read 3 Done Sent Done false
13402 4554 Acked Read 10 Done Sent Done false
13403 4555 Acked Read 8 Done Sent Done false
13404 4556 Acked Write 8 Done Sent Done false
13405 4557 Acked Read 6 Done Sent Done false
13406 4558 Acked Flush 0 Done Sent Done false
13407 4559 Acked Write 3 Done Sent Done false
13408 4560 Acked Read 1 Done Sent Done false
13409 4561 Acked Read 4 Done Sent Done false
13410 4562 Acked Write 6 Done Sent Done false
13411 4563 Acked Read 3 Done Sent Done false
13412 4564 Acked Read 1 Done Sent Done false
13413 4565 Acked Read 3 Done Sent Done false
13414 4566 Acked Read 4 Done Sent Done false
13415 4567 Acked Write 5 Done Sent Done false
13416 4568 Acked Write 2 Done Sent Done false
13417 4569 Acked Write 10 Done Sent Done false
13418 4570 Acked Write 3 Done Sent Done false
13419 4571 Acked Read 4 Done Sent Done false
13420 4572 Acked Read 7 Done Sent Done false
13421 4573 Acked Read 7 Done Sent Done false
13422 4574 Acked Write 1 Done Sent Done false
13423 4575 Acked Write 5 Done Sent Done false
13424 4576 Acked Write 7 Done Sent Done false
13425 4577 Acked Write 3 Done Sent Done false
13426 4578 Acked Flush 0 Done Sent Done false
13427 4579 Acked Write 9 Done Sent Done false
13428 4580 Acked Write 4 Done Sent Done false
13429 4581 Acked Read 3 Done Sent Done false
13430 4582 Acked Write 6 Done Sent Done false
13431 4583 Acked Read 6 Done Sent Done false
13432 4584 Acked Read 3 Done Sent Done false
13433 4585 Acked Write 6 Done Sent Done false
13434 4586 Acked Read 4 Done Sent Done false
13435 4587 Acked Read 9 Done Sent Done false
13436 4588 Acked Flush 0 Done Sent Done false
13437 4589 Acked Write 1 Done Sent Done false
13438 4590 Acked Write 5 Done Sent Done false
13439 4591 Acked Write 5 Done Sent Done false
13440 4592 Acked Write 1 Done Sent Done false
13441 4593 Acked Flush 0 Done Sent Done false
13442 4594 Acked Read 1 Done Sent Done false
13443 4595 Acked Read 10 Done Sent Done false
13444 4596 Acked Flush 0 Done Sent Done false
13445 4597 Acked Read 8 Done Sent Done false
13446 4598 Acked Write 2 Done Sent Done false
13447 4599 Acked Read 7 Done Sent Done false
13448 4600 Acked Write 10 Done Sent Done false
13449 4601 Acked Write 2 Done Sent Done false
13450 4602 Acked Flush 0 Done Sent Done false
13451 4603 Acked Read 5 Done Sent Done false
13452 4604 Acked Read 5 Done Sent Done false
13453 4605 Acked Read 7 Done Sent Done false
13454 4606 Acked Write 1 Done Sent Done false
13455 4607 Acked Write 1 Done Sent Done false
13456 4608 Acked Flush 0 Done Sent Done false
13457 4609 Acked Write 6 Done Sent Done false
13458 4610 Acked Write 10 Done Sent Done false
13459 4611 Acked Write 3 Done Sent Done false
13460 4612 Acked Write 5 Done Sent Done false
13461 4613 Acked Read 3 Done Sent Done false
13462 4614 Acked Read 7 Done Sent Done false
13463 4615 Acked Read 6 Done Sent Done false
13464 4616 Acked Flush 0 Done Sent Done false
13465 4617 Acked Flush 0 Done Sent Done false
13466 4618 Acked Read 2 Done Sent Done false
13467 4619 Acked Write 4 Done Sent Done false
13468 4620 Acked Flush 0 Done Sent Done false
13469 STATES DS:0 DS:1 DS:2 TOTAL
13470 Sent 0 301 0 301
13471 Done 301 0 301 602
13472 Skipped 0 0 0 0
13473 Error 0 0 0 0
13474 Last Flush: 4620 4319 4620
13475 Downstairs last five completed: 4319 4318 4317 4316 4315
13476 Upstairs last five completed: 4620 4619 4618 4617 4616
13477 CLIENT: Up:0 ds:301 act:2
13478 ----------------------------------------------------------------
13479 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:301
13480 States: Active Offline Active
13481 JOBID ACK TYPE BKS/EXT DS:0 DS:1 DS:2 REPLAY
13482 4320 Acked Write 2 Done Sent Done false
13483 4321 Acked Write 9 Done Sent Done false
13484 4322 Acked Read 1 Done Sent Done false
13485 4323 Acked Write 10 Done Sent Done false
13486 4324 Acked Write 8 Done Sent Done false
13487 4325 Acked Write 5 Done Sent Done false
13488 4326 Acked Read 7 Done Sent Done false
13489 4327 Acked Flush 0 Done Sent Done false
13490 4328 Acked Read 7 Done Sent Done false
13491 4329 Acked Flush 0 Done Sent Done false
13492 4330 Acked Read 9 Done Sent Done false
13493 4331 Acked Write 1 Done Sent Done false
13494 4332 Acked Read 9 Done Sent Done false
13495 4333 Acked Write 7 Done Sent Done false
13496 4334 Acked Write 5 Done Sent Done false
13497 4335 Acked Read 3 Done Sent Done false
13498 4336 Acked Write 7 Done Sent Done false
13499 4337 Acked Write 8 Done Sent Done false
13500 4338 Acked Write 5 Done Sent Done false
13501 4339 Acked Flush 0 Done Sent Done false
13502 4340 Acked Read 7 Done Sent Done false
13503 4341 Acked Write 2 Done Sent Done false
13504 4342 Acked Read 10 Done Sent Done false
13505 4343 Acked Read 4 Done Sent Done false
13506 4344 Acked Write 1 Done Sent Done false
13507 4345 Acked Read 7 Done Sent Done false
13508 4346 Acked Read 8 Done Sent Done false
13509 4347 Acked Flush 0 Done Sent Done false
13510 4348 Acked Write 4 Done Sent Done false
13511 4349 Acked Read 1 Done Sent Done false
13512 4350 Acked Read 3 Done Sent Done false
13513 4351 Acked Read 1 Done Sent Done false
13514 4352 Acked Read 8 Done Sent Done false
13515 4353 Acked Read 1 Done Sent Done false
13516 4354 Acked Read 8 Done Sent Done false
13517 4355 Acked Write 1 Done Sent Done false
13518 4356 Acked Write 4 Done Sent Done false
13519 4357 Acked Flush 0 Done Sent Done false
13520 4358 Acked Write 1 Done Sent Done false
13521 4359 Acked Write 2 Done Sent Done false
13522 4360 Acked Read 8 Done Sent Done false
13523 4361 Acked Write 4 Done Sent Done false
13524 4362 Acked Write 2 Done Sent Done false
13525 4363 Acked Read 6 Done Sent Done false
13526 4364 Acked Read 6 Done Sent Done false
13527 4365 Acked Read 3 Done Sent Done false
13528 4366 Acked Read 9 Done Sent Done false
13529 4367 Acked Read 2 Done Sent Done false
13530 4368 Acked Write 9 Done Sent Done false
13531 4369 Acked Write 9 Done Sent Done false
13532 4370 Acked Write 8 Done Sent Done false
13533 4371 Acked Read 7 Done Sent Done false
13534 4372 Acked Flush 0 Done Sent Done false
13535 4373 Acked Read 5 Done Sent Done false
13536 4374 Acked Read 9 Done Sent Done false
13537 4375 Acked Read 5 Done Sent Done false
13538 4376 Acked Read 10 Done Sent Done false
13539 4377 Acked Write 5 Done Sent Done false
13540 4378 Acked Read 1 Done Sent Done false
13541 4379 Acked Write 8 Done Sent Done false
13542 4380 Acked Write 5 Done Sent Done false
13543 4381 Acked Write 6 Done Sent Done false
13544 4382 Acked Flush 0 Done Sent Done false
13545 4383 Acked Write 10 Done Sent Done false
13546 4384 Acked Read 5 Done Sent Done false
13547 4385 Acked Write 1 Done Sent Done false
13548 4386 Acked Read 9 Done Sent Done false
13549 4387 Acked Flush 0 Done Sent Done false
13550 4388 Acked Write 3 Done Sent Done false
13551 4389 Acked Write 1 Done Sent Done false
13552 4390 Acked Read 2 Done Sent Done false
13553 4391 Acked Read 3 Done Sent Done false
13554 4392 Acked Write 8 Done Sent Done false
13555 4393 Acked Write 4 Done Sent Done false
13556 4394 Acked Read 4 Done Sent Done false
13557 4395 Acked Flush 0 Done Sent Done false
13558 4396 Acked Write 10 Done Sent Done false
13559 4397 Acked Read 5 Done Sent Done false
13560 4398 Acked Read 8 Done Sent Done false
13561 4399 Acked Write 1 Done Sent Done false
13562 4400 Acked Read 3 Done Sent Done false
13563 4401 Acked Write 4 Done Sent Done false
13564 4402 Acked Write 10 Done Sent Done false
13565 4403 Acked Read 8 Done Sent Done false
13566 4404 Acked Write 9 Done Sent Done false
13567 4405 Acked Flush 0 Done Sent Done false
13568 4406 Acked Read 7 Done Sent Done false
13569 4407 Acked Read 7 Done Sent Done false
13570 4408 Acked Write 7 Done Sent Done false
13571 4409 Acked Write 9 Done Sent Done false
13572 4410 Acked Write 3 Done Sent Done false
13573 4411 Acked Write 5 Done Sent Done false
13574 4412 Acked Write 3 Done Sent Done false
13575 4413 Acked Write 4 Done Sent Done false
13576 4414 Acked Flush 0 Done Sent Done false
13577 4415 Acked Write 2 Done Sent Done false
13578 4416 Acked Read 8 Done Sent Done false
13579 4417 Acked Write 2 Done Sent Done false
13580 4418 Acked Read 4 Done Sent Done false
13581 4419 Acked Read 3 Done Sent Done false
13582 4420 Acked Flush 0 Done Sent Done false
13583 4421 Acked Write 9 Done Sent Done false
13584 4422 Acked Write 6 Done Sent Done false
13585 4423 Acked Read 5 Done Sent Done false
13586 4424 Acked Read 5 Done Sent Done false
13587 4425 Acked Read 9 Done Sent Done false
13588 4426 Acked Write 5 Done Sent Done false
13589 4427 Acked Read 2 Done Sent Done false
13590 4428 Acked Read 3 Done Sent Done false
13591 4429 Acked Read 6 Done Sent Done false
13592 4430 Acked Write 3 Done Sent Done false
13593 4431 Acked Read 2 Done Sent Done false
13594 4432 Acked Read 1 Done Sent Done false
13595 4433 Acked Write 5 Done Sent Done false
13596 4434 Acked Write 6 Done Sent Done false
13597 4435 Acked Flush 0 Done Sent Done false
13598 4436 Acked Flush 0 Done Sent Done false
13599 4437 Acked Read 3 Done Sent Done false
13600 4438 Acked Read 9 Done Sent Done false
13601 4439 Acked Write 7 Done Sent Done false
13602 4440 Acked Read 2 Done Sent Done false
13603 4441 Acked Write 3 Done Sent Done false
13604 4442 Acked Write 6 Done Sent Done false
13605 4443 Acked Read 7 Done Sent Done false
13606 4444 Acked Read 4 Done Sent Done false
13607 4445 Acked Read 1 Done Sent Done false
13608 4446 Acked Write 7 Done Sent Done false
13609 4447 Acked Write 10 Done Sent Done false
13610 4448 Acked Write 8 Done Sent Done false
13611 4449 Acked Flush 0 Done Sent Done false
13612 4450 Acked Write 9 Done Sent Done false
13613 4451 Acked Write 1 Done Sent Done false
13614 4452 Acked Read 1 Done Sent Done false
13615 4453 Acked Read 8 Done Sent Done false
13616 4454 Acked Flush 0 Done Sent Done false
13617 4455 Acked Read 2 Done Sent Done false
13618 4456 Acked Read 3 Done Sent Done false
13619 4457 Acked Read 8 Done Sent Done false
13620 4458 Acked Write 3 Done Sent Done false
13621 4459 Acked Write 3 Done Sent Done false
13622 4460 Acked Read 3 Done Sent Done false
13623 4461 Acked Write 8 Done Sent Done false
13624 4462 Acked Flush 0 Done Sent Done false
13625 4463 Acked Read 6 Done Sent Done false
13626 4464 Acked Read 3 Done Sent Done false
13627 4465 Acked Write 10 Done Sent Done false
13628 4466 Acked Read 2 Done Sent Done false
13629 4467 Acked Read 9 Done Sent Done false
13630 4468 Acked Flush 0 Done Sent Done false
13631 4469 Acked Write 10 Done Sent Done false
13632 4470 Acked Flush 0 Done Sent Done false
13633 4471 Acked Read 5 Done Sent Done false
13634 4472 Acked Flush 0 Done Sent Done false
13635 4473 Acked Read 3 Done Sent Done false
13636 4474 Acked Write 3 Done Sent Done false
13637 4475 Acked Write 8 Done Sent Done false
13638 4476 Acked Write 9 Done Sent Done false
13639 4477 Acked Write 9 Done Sent Done false
13640 4478 Acked Flush 0 Done Sent Done false
13641 4479 Acked Write 7 Done Sent Done false
13642 4480 Acked Read 6 Done Sent Done false
13643 4481 Acked Write 6 Done Sent Done false
13644 4482 Acked Read 4 Done Sent Done false
13645 4483 Acked Write 1 Done Sent Done false
13646 4484 Acked Flush 0 Done Sent Done false
13647 4485 Acked Flush 0 Done Sent Done false
13648 4486 Acked Read 9 Done Sent Done false
13649 4487 Acked Read 2 Done Sent Done false
13650 4488 Acked Read 5 Done Sent Done false
13651 4489 Acked Write 3 Done Sent Done false
13652 4490 Acked Read 3 Done Sent Done false
13653 4491 Acked Read 7 Done Sent Done false
13654 4492 Acked Write 5 Done Sent Done false
13655 4493 Acked Read 1 Done Sent Done false
13656 4494 Acked Read 3 Done Sent Done false
13657 4495 Acked Write 7 Done Sent Done false
13658 4496 Acked Read 1 Done Sent Done false
13659 4497 Acked Read 2 Done Sent Done false
13660 4498 Acked Write 10 Done Sent Done false
13661 4499 Acked Read 3 Done Sent Done false
13662 4500 Acked Read 5 Done Sent Done false
13663 4501 Acked Read 7 Done Sent Done false
13664 4502 Acked Write 9 Done Sent Done false
13665 4503 Acked Write 3 Done Sent Done false
13666 4504 Acked Write 7 Done Sent Done false
13667 4505 Acked Read 5 Done Sent Done false
13668 4506 Acked Write 5 Done Sent Done false
13669 4507 Acked Write 3 Done Sent Done false
13670 4508 Acked Write 3 Done Sent Done false
13671 4509 Acked Read 10 Done Sent Done false
13672 4510 Acked Write 3 Done Sent Done false
13673 4511 Acked Write 8 Done Sent Done false
13674 4512 Acked Write 10 Done Sent Done false
13675 4513 Acked Write 10 Done Sent Done false
13676 4514 Acked Read 2 Done Sent Done false
13677 4515 Acked Write 10 Done Sent Done false
13678 4516 Acked Write 6 Done Sent Done false
13679 4517 Acked Write 10 Done Sent Done false
13680 4518 Acked Write 7 Done Sent Done false
13681 4519 Acked Read 5 Done Sent Done false
13682 4520 Acked Read 1 Done Sent Done false
13683 4521 Acked Write 5 Done Sent Done false
13684 4522 Acked Write 2 Done Sent Done false
13685 4523 Acked Read 3 Done Sent Done false
13686 4524 Acked Write 10 Done Sent Done false
13687 4525 Acked Write 7 Done Sent Done false
13688 4526 Acked Read 10 Done Sent Done false
13689 4527 Acked Write 6 Done Sent Done false
13690 4528 Acked Write 5 Done Sent Done false
13691 4529 Acked Write 7 Done Sent Done false
13692 4530 Acked Read 2 Done Sent Done false
13693 4531 Acked Read 7 Done Sent Done false
13694 4532 Acked Write 8 Done Sent Done false
13695 4533 Acked Read 4 Done Sent Done false
13696 4534 Acked Write 9 Done Sent Done false
13697 4535 Acked Write 3 Done Sent Done false
13698 4536 Acked Read 10 Done Sent Done false
13699 4537 Acked Read 4 Done Sent Done false
13700 4538 Acked Write 8 Done Sent Done false
13701 4539 Acked Write 6 Done Sent Done false
13702 4540 Acked Read 6 Done Sent Done false
13703 4541 Acked Write 4 Done Sent Done false
13704 4542 Acked Write 4 Done Sent Done false
13705 4543 Acked Read 10 Done Sent Done false
13706 4544 Acked Read 5 Done Sent Done false
13707 4545 Acked Read 1 Done Sent Done false
13708 4546 Acked Write 3 Done Sent Done false
13709 4547 Acked Write 1 Done Sent Done false
13710 4548 Acked Write 10 Done Sent Done false
13711 4549 Acked Write 5 Done Sent Done false
13712 4550 Acked Write 7 Done Sent Done false
13713 4551 Acked Read 2 Done Sent Done false
13714 4552 Acked Write 5 Done Sent Done false
13715 4553 Acked Read 3 Done Sent Done false
13716 4554 Acked Read 10 Done Sent Done false
13717 4555 Acked Read 8 Done Sent Done false
13718 4556 Acked Write 8 Done Sent Done false
13719 4557 Acked Read 6 Done Sent Done false
13720 4558 Acked Flush 0 Done Sent Done false
13721 4559 Acked Write 3 Done Sent Done false
13722 4560 Acked Read 1 Done Sent Done false
13723 4561 Acked Read 4 Done Sent Done false
13724 4562 Acked Write 6 Done Sent Done false
13725 4563 Acked Read 3 Done Sent Done false
13726 4564 Acked Read 1 Done Sent Done false
13727 4565 Acked Read 3 Done Sent Done false
13728 4566 Acked Read 4 Done Sent Done false
13729 4567 Acked Write 5 Done Sent Done false
13730 4568 Acked Write 2 Done Sent Done false
13731 4569 Acked Write 10 Done Sent Done false
13732 4570 Acked Write 3 Done Sent Done false
13733 4571 Acked Read 4 Done Sent Done false
13734 4572 Acked Read 7 Done Sent Done false
13735 4573 Acked Read 7 Done Sent Done false
13736 4574 Acked Write 1 Done Sent Done false
13737 4575 Acked Write 5 Done Sent Done false
13738 4576 Acked Write 7 Done Sent Done false
13739 4577 Acked Write 3 Done Sent Done false
13740 4578 Acked Flush 0 Done Sent Done false
13741 4579 Acked Write 9 Done Sent Done false
13742 4580 Acked Write 4 Done Sent Done false
13743 4581 Acked Read 3 Done Sent Done false
13744 4582 Acked Write 6 Done Sent Done false
13745 4583 Acked Read 6 Done Sent Done false
13746 4584 Acked Read 3 Done Sent Done false
13747 4585 Acked Write 6 Done Sent Done false
13748 4586 Acked Read 4 Done Sent Done false
13749 4587 Acked Read 9 Done Sent Done false
13750 4588 Acked Flush 0 Done Sent Done false
13751 4589 Acked Write 1 Done Sent Done false
13752 4590 Acked Write 5 Done Sent Done false
13753 4591 Acked Write 5 Done Sent Done false
13754 4592 Acked Write 1 Done Sent Done false
13755 4593 Acked Flush 0 Done Sent Done false
13756 4594 Acked Read 1 Done Sent Done false
13757 4595 Acked Read 10 Done Sent Done false
13758 4596 Acked Flush 0 Done Sent Done false
13759 4597 Acked Read 8 Done Sent Done false
13760 4598 Acked Write 2 Done Sent Done false
13761 4599 Acked Read 7 Done Sent Done false
13762 4600 Acked Write 10 Done Sent Done false
13763 4601 Acked Write 2 Done Sent Done false
13764 4602 Acked Flush 0 Done Sent Done false
13765 4603 Acked Read 5 Done Sent Done false
13766 4604 Acked Read 5 Done Sent Done false
13767 4605 Acked Read 7 Done Sent Done false
13768 4606 Acked Write 1 Done Sent Done false
13769 4607 Acked Write 1 Done Sent Done false
13770 4608 Acked Flush 0 Done Sent Done false
13771 4609 Acked Write 6 Done Sent Done false
13772 4610 Acked Write 10 Done Sent Done false
13773 4611 Acked Write 3 Done Sent Done false
13774 4612 Acked Write 5 Done Sent Done false
13775 4613 Acked Read 3 Done Sent Done false
13776 4614 Acked Read 7 Done Sent Done false
13777 4615 Acked Read 6 Done Sent Done false
13778 4616 Acked Flush 0 Done Sent Done false
13779 4617 Acked Flush 0 Done Sent Done false
13780 4618 Acked Read 2 Done Sent Done false
13781 4619 Acked Write 4 Done Sent Done false
13782 4620 Acked Flush 0 Done Sent Done false
13783 STATES DS:0 DS:1 DS:2 TOTAL
13784 Sent 0 301 0 301
13785 Done 301 0 301 602
13786 Skipped 0 0 0 0
13787 Error 0 0 0 0
13788 Last Flush: 4620 4319 4620
13789 Downstairs last five completed: 4319 4318 4317 4316 4315
13790 Upstairs last five completed: 4620 4619 4618 4617 4616
13791 CLIENT: Up:0 ds:301 act:2
137922025-01-10T16:38:12.450ZINFOcrucible: connecting to 127.0.0.1:8820 = io task client = 1 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
137932025-01-10T16:38:12.450ZWARNcrucible: ds_connection connect to 127.0.0.1:8820 failure: Os { code: 146, kind: ConnectionRefused, message: "Connection refused" } = io task client = 1 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
137942025-01-10T16:38:12.450ZWARNcrucible: client task is sending Done(ConnectionFailed(Os { code: 146, kind: ConnectionRefused, message: "Connection refused" })) = io task client = 1 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
137952025-01-10T16:38:12.450ZWARNcrucible: downstairs task for 1 stopped due to ConnectionFailed(Os { code: 146, kind: ConnectionRefused, message: "Connection refused" }) session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
137962025-01-10T16:38:12.450ZINFOcrucible: client task is exiting = io task client = 1 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
13797 ----------------------------------------------------------------
13798 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:301
13799 States: Active Offline Active
13800 JOBID ACK TYPE BKS/EXT DS:0 DS:1 DS:2 REPLAY
13801 4320 Acked Write 2 Done Sent Done false
13802 4321 Acked Write 9 Done Sent Done false
13803 4322 Acked Read 1 Done Sent Done false
13804 4323 Acked Write 10 Done Sent Done false
13805 4324 Acked Write 8 Done Sent Done false
13806 4325 Acked Write 5 Done Sent Done false
13807 4326 Acked Read 7 Done Sent Done false
13808 4327 Acked Flush 0 Done Sent Done false
13809 4328 Acked Read 7 Done Sent Done false
13810 4329 Acked Flush 0 Done Sent Done false
13811 4330 Acked Read 9 Done Sent Done false
13812 4331 Acked Write 1 Done Sent Done false
13813 4332 Acked Read 9 Done Sent Done false
13814 4333 Acked Write 7 Done Sent Done false
13815 4334 Acked Write 5 Done Sent Done false
13816 4335 Acked Read 3 Done Sent Done false
13817 4336 Acked Write 7 Done Sent Done false
13818 4337 Acked Write 8 Done Sent Done false
13819 4338 Acked Write 5 Done Sent Done false
13820 4339 Acked Flush 0 Done Sent Done false
13821 4340 Acked Read 7 Done Sent Done false
13822 4341 Acked Write 2 Done Sent Done false
13823 4342 Acked Read 10 Done Sent Done false
13824 4343 Acked Read 4 Done Sent Done false
13825 4344 Acked Write 1 Done Sent Done false
13826 4345 Acked Read 7 Done Sent Done false
13827 4346 Acked Read 8 Done Sent Done false
13828 4347 Acked Flush 0 Done Sent Done false
13829 4348 Acked Write 4 Done Sent Done false
13830 4349 Acked Read 1 Done Sent Done false
13831 4350 Acked Read 3 Done Sent Done false
13832 4351 Acked Read 1 Done Sent Done false
13833 4352 Acked Read 8 Done Sent Done false
13834 4353 Acked Read 1 Done Sent Done false
13835 4354 Acked Read 8 Done Sent Done false
13836 4355 Acked Write 1 Done Sent Done false
13837 4356 Acked Write 4 Done Sent Done false
13838 4357 Acked Flush 0 Done Sent Done false
13839 4358 Acked Write 1 Done Sent Done false
13840 4359 Acked Write 2 Done Sent Done false
13841 4360 Acked Read 8 Done Sent Done false
13842 4361 Acked Write 4 Done Sent Done false
13843 4362 Acked Write 2 Done Sent Done false
13844 4363 Acked Read 6 Done Sent Done false
13845 4364 Acked Read 6 Done Sent Done false
13846 4365 Acked Read 3 Done Sent Done false
13847 4366 Acked Read 9 Done Sent Done false
13848 4367 Acked Read 2 Done Sent Done false
13849 4368 Acked Write 9 Done Sent Done false
13850 4369 Acked Write 9 Done Sent Done false
13851 4370 Acked Write 8 Done Sent Done false
13852 4371 Acked Read 7 Done Sent Done false
13853 4372 Acked Flush 0 Done Sent Done false
13854 4373 Acked Read 5 Done Sent Done false
13855 4374 Acked Read 9 Done Sent Done false
13856 4375 Acked Read 5 Done Sent Done false
13857 4376 Acked Read 10 Done Sent Done false
13858 4377 Acked Write 5 Done Sent Done false
13859 4378 Acked Read 1 Done Sent Done false
13860 4379 Acked Write 8 Done Sent Done false
13861 4380 Acked Write 5 Done Sent Done false
13862 4381 Acked Write 6 Done Sent Done false
13863 4382 Acked Flush 0 Done Sent Done false
13864 4383 Acked Write 10 Done Sent Done false
13865 4384 Acked Read 5 Done Sent Done false
13866 4385 Acked Write 1 Done Sent Done false
13867 4386 Acked Read 9 Done Sent Done false
13868 4387 Acked Flush 0 Done Sent Done false
13869 4388 Acked Write 3 Done Sent Done false
13870 4389 Acked Write 1 Done Sent Done false
13871 4390 Acked Read 2 Done Sent Done false
13872 4391 Acked Read 3 Done Sent Done false
13873 4392 Acked Write 8 Done Sent Done false
13874 4393 Acked Write 4 Done Sent Done false
13875 4394 Acked Read 4 Done Sent Done false
13876 4395 Acked Flush 0 Done Sent Done false
13877 4396 Acked Write 10 Done Sent Done false
13878 4397 Acked Read 5 Done Sent Done false
13879 4398 Acked Read 8 Done Sent Done false
13880 4399 Acked Write 1 Done Sent Done false
13881 4400 Acked Read 3 Done Sent Done false
13882 4401 Acked Write 4 Done Sent Done false
13883 4402 Acked Write 10 Done Sent Done false
13884 4403 Acked Read 8 Done Sent Done false
13885 4404 Acked Write 9 Done Sent Done false
13886 4405 Acked Flush 0 Done Sent Done false
13887 4406 Acked Read 7 Done Sent Done false
13888 4407 Acked Read 7 Done Sent Done false
13889 4408 Acked Write 7 Done Sent Done false
13890 4409 Acked Write 9 Done Sent Done false
13891 4410 Acked Write 3 Done Sent Done false
13892 4411 Acked Write 5 Done Sent Done false
13893 4412 Acked Write 3 Done Sent Done false
13894 4413 Acked Write 4 Done Sent Done false
13895 4414 Acked Flush 0 Done Sent Done false
13896 4415 Acked Write 2 Done Sent Done false
13897 4416 Acked Read 8 Done Sent Done false
13898 4417 Acked Write 2 Done Sent Done false
13899 4418 Acked Read 4 Done Sent Done false
13900 4419 Acked Read 3 Done Sent Done false
13901 4420 Acked Flush 0 Done Sent Done false
13902 4421 Acked Write 9 Done Sent Done false
13903 4422 Acked Write 6 Done Sent Done false
13904 4423 Acked Read 5 Done Sent Done false
13905 4424 Acked Read 5 Done Sent Done false
13906 4425 Acked Read 9 Done Sent Done false
13907 4426 Acked Write 5 Done Sent Done false
13908 4427 Acked Read 2 Done Sent Done false
13909 4428 Acked Read 3 Done Sent Done false
13910 4429 Acked Read 6 Done Sent Done false
13911 4430 Acked Write 3 Done Sent Done false
13912 4431 Acked Read 2 Done Sent Done false
13913 4432 Acked Read 1 Done Sent Done false
13914 4433 Acked Write 5 Done Sent Done false
13915 4434 Acked Write 6 Done Sent Done false
13916 4435 Acked Flush 0 Done Sent Done false
13917 4436 Acked Flush 0 Done Sent Done false
13918 4437 Acked Read 3 Done Sent Done false
13919 4438 Acked Read 9 Done Sent Done false
13920 4439 Acked Write 7 Done Sent Done false
13921 4440 Acked Read 2 Done Sent Done false
13922 4441 Acked Write 3 Done Sent Done false
13923 4442 Acked Write 6 Done Sent Done false
13924 4443 Acked Read 7 Done Sent Done false
13925 4444 Acked Read 4 Done Sent Done false
13926 4445 Acked Read 1 Done Sent Done false
13927 4446 Acked Write 7 Done Sent Done false
13928 4447 Acked Write 10 Done Sent Done false
13929 4448 Acked Write 8 Done Sent Done false
13930 4449 Acked Flush 0 Done Sent Done false
13931 4450 Acked Write 9 Done Sent Done false
13932 4451 Acked Write 1 Done Sent Done false
13933 4452 Acked Read 1 Done Sent Done false
13934 4453 Acked Read 8 Done Sent Done false
13935 4454 Acked Flush 0 Done Sent Done false
13936 4455 Acked Read 2 Done Sent Done false
13937 4456 Acked Read 3 Done Sent Done false
13938 4457 Acked Read 8 Done Sent Done false
13939 4458 Acked Write 3 Done Sent Done false
13940 4459 Acked Write 3 Done Sent Done false
13941 4460 Acked Read 3 Done Sent Done false
13942 4461 Acked Write 8 Done Sent Done false
13943 4462 Acked Flush 0 Done Sent Done false
13944 4463 Acked Read 6 Done Sent Done false
13945 4464 Acked Read 3 Done Sent Done false
13946 4465 Acked Write 10 Done Sent Done false
13947 4466 Acked Read 2 Done Sent Done false
13948 4467 Acked Read 9 Done Sent Done false
13949 4468 Acked Flush 0 Done Sent Done false
13950 4469 Acked Write 10 Done Sent Done false
13951 4470 Acked Flush 0 Done Sent Done false
13952 4471 Acked Read 5 Done Sent Done false
13953 4472 Acked Flush 0 Done Sent Done false
13954 4473 Acked Read 3 Done Sent Done false
13955 4474 Acked Write 3 Done Sent Done false
13956 4475 Acked Write 8 Done Sent Done false
13957 4476 Acked Write 9 Done Sent Done false
13958 4477 Acked Write 9 Done Sent Done false
13959 4478 Acked Flush 0 Done Sent Done false
13960 4479 Acked Write 7 Done Sent Done false
13961 4480 Acked Read 6 Done Sent Done false
13962 4481 Acked Write 6 Done Sent Done false
13963 4482 Acked Read 4 Done Sent Done false
13964 4483 Acked Write 1 Done Sent Done false
13965 4484 Acked Flush 0 Done Sent Done false
13966 4485 Acked Flush 0 Done Sent Done false
13967 4486 Acked Read 9 Done Sent Done false
13968 4487 Acked Read 2 Done Sent Done false
13969 4488 Acked Read 5 Done Sent Done false
13970 4489 Acked Write 3 Done Sent Done false
13971 4490 Acked Read 3 Done Sent Done false
13972 4491 Acked Read 7 Done Sent Done false
13973 4492 Acked Write 5 Done Sent Done false
13974 4493 Acked Read 1 Done Sent Done false
13975 4494 Acked Read 3 Done Sent Done false
13976 4495 Acked Write 7 Done Sent Done false
13977 4496 Acked Read 1 Done Sent Done false
13978 4497 Acked Read 2 Done Sent Done false
13979 4498 Acked Write 10 Done Sent Done false
13980 4499 Acked Read 3 Done Sent Done false
13981 4500 Acked Read 5 Done Sent Done false
13982 4501 Acked Read 7 Done Sent Done false
13983 4502 Acked Write 9 Done Sent Done false
13984 4503 Acked Write 3 Done Sent Done false
13985 4504 Acked Write 7 Done Sent Done false
13986 4505 Acked Read 5 Done Sent Done false
13987 4506 Acked Write 5 Done Sent Done false
13988 4507 Acked Write 3 Done Sent Done false
13989 4508 Acked Write 3 Done Sent Done false
13990 4509 Acked Read 10 Done Sent Done false
13991 4510 Acked Write 3 Done Sent Done false
13992 4511 Acked Write 8 Done Sent Done false
13993 4512 Acked Write 10 Done Sent Done false
13994 4513 Acked Write 10 Done Sent Done false
13995 4514 Acked Read 2 Done Sent Done false
13996 4515 Acked Write 10 Done Sent Done false
13997 4516 Acked Write 6 Done Sent Done false
13998 4517 Acked Write 10 Done Sent Done false
13999 4518 Acked Write 7 Done Sent Done false
14000 4519 Acked Read 5 Done Sent Done false
14001 4520 Acked Read 1 Done Sent Done false
14002 4521 Acked Write 5 Done Sent Done false
14003 4522 Acked Write 2 Done Sent Done false
14004 4523 Acked Read 3 Done Sent Done false
14005 4524 Acked Write 10 Done Sent Done false
14006 4525 Acked Write 7 Done Sent Done false
14007 4526 Acked Read 10 Done Sent Done false
14008 4527 Acked Write 6 Done Sent Done false
14009 4528 Acked Write 5 Done Sent Done false
14010 4529 Acked Write 7 Done Sent Done false
14011 4530 Acked Read 2 Done Sent Done false
14012 4531 Acked Read 7 Done Sent Done false
14013 4532 Acked Write 8 Done Sent Done false
14014 4533 Acked Read 4 Done Sent Done false
14015 4534 Acked Write 9 Done Sent Done false
14016 4535 Acked Write 3 Done Sent Done false
14017 4536 Acked Read 10 Done Sent Done false
14018 4537 Acked Read 4 Done Sent Done false
14019 4538 Acked Write 8 Done Sent Done false
14020 4539 Acked Write 6 Done Sent Done false
14021 4540 Acked Read 6 Done Sent Done false
14022 4541 Acked Write 4 Done Sent Done false
14023 4542 Acked Write 4 Done Sent Done false
14024 4543 Acked Read 10 Done Sent Done false
14025 4544 Acked Read 5 Done Sent Done false
14026 4545 Acked Read 1 Done Sent Done false
14027 4546 Acked Write 3 Done Sent Done false
14028 4547 Acked Write 1 Done Sent Done false
14029 4548 Acked Write 10 Done Sent Done false
14030 4549 Acked Write 5 Done Sent Done false
14031 4550 Acked Write 7 Done Sent Done false
14032 4551 Acked Read 2 Done Sent Done false
14033 4552 Acked Write 5 Done Sent Done false
14034 4553 Acked Read 3 Done Sent Done false
14035 4554 Acked Read 10 Done Sent Done false
14036 4555 Acked Read 8 Done Sent Done false
14037 4556 Acked Write 8 Done Sent Done false
14038 4557 Acked Read 6 Done Sent Done false
14039 4558 Acked Flush 0 Done Sent Done false
14040 4559 Acked Write 3 Done Sent Done false
14041 4560 Acked Read 1 Done Sent Done false
14042 4561 Acked Read 4 Done Sent Done false
14043 4562 Acked Write 6 Done Sent Done false
14044 4563 Acked Read 3 Done Sent Done false
14045 4564 Acked Read 1 Done Sent Done false
14046 4565 Acked Read 3 Done Sent Done false
14047 4566 Acked Read 4 Done Sent Done false
14048 4567 Acked Write 5 Done Sent Done false
14049 4568 Acked Write 2 Done Sent Done false
14050 4569 Acked Write 10 Done Sent Done false
14051 4570 Acked Write 3 Done Sent Done false
14052 4571 Acked Read 4 Done Sent Done false
14053 4572 Acked Read 7 Done Sent Done false
14054 4573 Acked Read 7 Done Sent Done false
14055 4574 Acked Write 1 Done Sent Done false
14056 4575 Acked Write 5 Done Sent Done false
14057 4576 Acked Write 7 Done Sent Done false
14058 4577 Acked Write 3 Done Sent Done false
14059 4578 Acked Flush 0 Done Sent Done false
14060 4579 Acked Write 9 Done Sent Done false
14061 4580 Acked Write 4 Done Sent Done false
14062 4581 Acked Read 3 Done Sent Done false
14063 4582 Acked Write 6 Done Sent Done false
14064 4583 Acked Read 6 Done Sent Done false
14065 4584 Acked Read 3 Done Sent Done false
14066 4585 Acked Write 6 Done Sent Done false
14067 4586 Acked Read 4 Done Sent Done false
14068 4587 Acked Read 9 Done Sent Done false
14069 4588 Acked Flush 0 Done Sent Done false
14070 4589 Acked Write 1 Done Sent Done false
14071 4590 Acked Write 5 Done Sent Done false
14072 4591 Acked Write 5 Done Sent Done false
14073 4592 Acked Write 1 Done Sent Done false
14074 4593 Acked Flush 0 Done Sent Done false
14075 4594 Acked Read 1 Done Sent Done false
14076 4595 Acked Read 10 Done Sent Done false
14077 4596 Acked Flush 0 Done Sent Done false
14078 4597 Acked Read 8 Done Sent Done false
14079 4598 Acked Write 2 Done Sent Done false
14080 4599 Acked Read 7 Done Sent Done false
14081 4600 Acked Write 10 Done Sent Done false
14082 4601 Acked Write 2 Done Sent Done false
14083 4602 Acked Flush 0 Done Sent Done false
14084 4603 Acked Read 5 Done Sent Done false
14085 4604 Acked Read 5 Done Sent Done false
14086 4605 Acked Read 7 Done Sent Done false
14087 4606 Acked Write 1 Done Sent Done false
14088 4607 Acked Write 1 Done Sent Done false
14089 4608 Acked Flush 0 Done Sent Done false
14090 4609 Acked Write 6 Done Sent Done false
14091 4610 Acked Write 10 Done Sent Done false
14092 4611 Acked Write 3 Done Sent Done false
14093 4612 Acked Write 5 Done Sent Done false
14094 4613 Acked Read 3 Done Sent Done false
14095 4614 Acked Read 7 Done Sent Done false
14096 4615 Acked Read 6 Done Sent Done false
14097 4616 Acked Flush 0 Done Sent Done false
14098 4617 Acked Flush 0 Done Sent Done false
14099 4618 Acked Read 2 Done Sent Done false
14100 4619 Acked Write 4 Done Sent Done false
14101 4620 Acked Flush 0 Done Sent Done false
14102 STATES DS:0 DS:1 DS:2 TOTAL
14103 Sent 0 301 0 301
14104 Done 301 0 301 602
14105 Skipped 0 0 0 0
14106 Error 0 0 0 0
14107 Last Flush: 4620 4319 4620
14108 Downstairs last five completed: 4319 4318 4317 4316 4315
14109 Upstairs last five completed: 4620 4619 4618 4617 4616
14110 CLIENT: Up:0 ds:301 act:2
14111 [8820] got start action
14112 [8820] I am going to restart
14113 Starting downstairs at port 8820
14114 Make output file at "/tmp/dsc/downstairs-8820.txt"
14115 [8820][1] reports Starting
14116 Downstairs /var/tmp/dsc/region/8820 port 8820 PID:Some(1214)
14117 [8820][1] reports Running
14118 ----------------------------------------------------------------
14119 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:301
14120 States: Active Offline Active
14121 JOBID ACK TYPE BKS/EXT DS:0 DS:1 DS:2 REPLAY
14122 4320 Acked Write 2 Done Sent Done false
14123 4321 Acked Write 9 Done Sent Done false
14124 4322 Acked Read 1 Done Sent Done false
14125 4323 Acked Write 10 Done Sent Done false
14126 4324 Acked Write 8 Done Sent Done false
14127 4325 Acked Write 5 Done Sent Done false
14128 4326 Acked Read 7 Done Sent Done false
14129 4327 Acked Flush 0 Done Sent Done false
14130 4328 Acked Read 7 Done Sent Done false
14131 4329 Acked Flush 0 Done Sent Done false
14132 4330 Acked Read 9 Done Sent Done false
14133 4331 Acked Write 1 Done Sent Done false
14134 4332 Acked Read 9 Done Sent Done false
14135 4333 Acked Write 7 Done Sent Done false
14136 4334 Acked Write 5 Done Sent Done false
14137 4335 Acked Read 3 Done Sent Done false
14138 4336 Acked Write 7 Done Sent Done false
14139 4337 Acked Write 8 Done Sent Done false
14140 4338 Acked Write 5 Done Sent Done false
14141 4339 Acked Flush 0 Done Sent Done false
14142 4340 Acked Read 7 Done Sent Done false
14143 4341 Acked Write 2 Done Sent Done false
14144 4342 Acked Read 10 Done Sent Done false
14145 4343 Acked Read 4 Done Sent Done false
14146 4344 Acked Write 1 Done Sent Done false
14147 4345 Acked Read 7 Done Sent Done false
14148 4346 Acked Read 8 Done Sent Done false
14149 4347 Acked Flush 0 Done Sent Done false
14150 4348 Acked Write 4 Done Sent Done false
14151 4349 Acked Read 1 Done Sent Done false
14152 4350 Acked Read 3 Done Sent Done false
14153 4351 Acked Read 1 Done Sent Done false
14154 4352 Acked Read 8 Done Sent Done false
14155 4353 Acked Read 1 Done Sent Done false
14156 4354 Acked Read 8 Done Sent Done false
14157 4355 Acked Write 1 Done Sent Done false
14158 4356 Acked Write 4 Done Sent Done false
14159 4357 Acked Flush 0 Done Sent Done false
14160 4358 Acked Write 1 Done Sent Done false
14161 4359 Acked Write 2 Done Sent Done false
14162 4360 Acked Read 8 Done Sent Done false
14163 4361 Acked Write 4 Done Sent Done false
14164 4362 Acked Write 2 Done Sent Done false
14165 4363 Acked Read 6 Done Sent Done false
14166 4364 Acked Read 6 Done Sent Done false
14167 4365 Acked Read 3 Done Sent Done false
14168 4366 Acked Read 9 Done Sent Done false
14169 4367 Acked Read 2 Done Sent Done false
14170 4368 Acked Write 9 Done Sent Done false
14171 4369 Acked Write 9 Done Sent Done false
14172 4370 Acked Write 8 Done Sent Done false
14173 4371 Acked Read 7 Done Sent Done false
14174 4372 Acked Flush 0 Done Sent Done false
14175 4373 Acked Read 5 Done Sent Done false
14176 4374 Acked Read 9 Done Sent Done false
14177 4375 Acked Read 5 Done Sent Done false
14178 4376 Acked Read 10 Done Sent Done false
14179 4377 Acked Write 5 Done Sent Done false
14180 4378 Acked Read 1 Done Sent Done false
14181 4379 Acked Write 8 Done Sent Done false
14182 4380 Acked Write 5 Done Sent Done false
14183 4381 Acked Write 6 Done Sent Done false
14184 4382 Acked Flush 0 Done Sent Done false
14185 4383 Acked Write 10 Done Sent Done false
14186 4384 Acked Read 5 Done Sent Done false
14187 4385 Acked Write 1 Done Sent Done false
14188 4386 Acked Read 9 Done Sent Done false
14189 4387 Acked Flush 0 Done Sent Done false
14190 4388 Acked Write 3 Done Sent Done false
14191 4389 Acked Write 1 Done Sent Done false
14192 4390 Acked Read 2 Done Sent Done false
14193 4391 Acked Read 3 Done Sent Done false
14194 4392 Acked Write 8 Done Sent Done false
14195 4393 Acked Write 4 Done Sent Done false
14196 4394 Acked Read 4 Done Sent Done false
14197 4395 Acked Flush 0 Done Sent Done false
14198 4396 Acked Write 10 Done Sent Done false
14199 4397 Acked Read 5 Done Sent Done false
14200 4398 Acked Read 8 Done Sent Done false
14201 4399 Acked Write 1 Done Sent Done false
14202 4400 Acked Read 3 Done Sent Done false
14203 4401 Acked Write 4 Done Sent Done false
14204 4402 Acked Write 10 Done Sent Done false
14205 4403 Acked Read 8 Done Sent Done false
14206 4404 Acked Write 9 Done Sent Done false
14207 4405 Acked Flush 0 Done Sent Done false
14208 4406 Acked Read 7 Done Sent Done false
14209 4407 Acked Read 7 Done Sent Done false
14210 4408 Acked Write 7 Done Sent Done false
14211 4409 Acked Write 9 Done Sent Done false
14212 4410 Acked Write 3 Done Sent Done false
14213 4411 Acked Write 5 Done Sent Done false
14214 4412 Acked Write 3 Done Sent Done false
14215 4413 Acked Write 4 Done Sent Done false
14216 4414 Acked Flush 0 Done Sent Done false
14217 4415 Acked Write 2 Done Sent Done false
14218 4416 Acked Read 8 Done Sent Done false
14219 4417 Acked Write 2 Done Sent Done false
14220 4418 Acked Read 4 Done Sent Done false
14221 4419 Acked Read 3 Done Sent Done false
14222 4420 Acked Flush 0 Done Sent Done false
14223 4421 Acked Write 9 Done Sent Done false
14224 4422 Acked Write 6 Done Sent Done false
14225 4423 Acked Read 5 Done Sent Done false
14226 4424 Acked Read 5 Done Sent Done false
14227 4425 Acked Read 9 Done Sent Done false
14228 4426 Acked Write 5 Done Sent Done false
14229 4427 Acked Read 2 Done Sent Done false
14230 4428 Acked Read 3 Done Sent Done false
14231 4429 Acked Read 6 Done Sent Done false
14232 4430 Acked Write 3 Done Sent Done false
14233 4431 Acked Read 2 Done Sent Done false
14234 4432 Acked Read 1 Done Sent Done false
14235 4433 Acked Write 5 Done Sent Done false
14236 4434 Acked Write 6 Done Sent Done false
14237 4435 Acked Flush 0 Done Sent Done false
14238 4436 Acked Flush 0 Done Sent Done false
14239 4437 Acked Read 3 Done Sent Done false
14240 4438 Acked Read 9 Done Sent Done false
14241 4439 Acked Write 7 Done Sent Done false
14242 4440 Acked Read 2 Done Sent Done false
14243 4441 Acked Write 3 Done Sent Done false
14244 4442 Acked Write 6 Done Sent Done false
14245 4443 Acked Read 7 Done Sent Done false
14246 4444 Acked Read 4 Done Sent Done false
14247 4445 Acked Read 1 Done Sent Done false
14248 4446 Acked Write 7 Done Sent Done false
14249 4447 Acked Write 10 Done Sent Done false
14250 4448 Acked Write 8 Done Sent Done false
14251 4449 Acked Flush 0 Done Sent Done false
14252 4450 Acked Write 9 Done Sent Done false
14253 4451 Acked Write 1 Done Sent Done false
14254 4452 Acked Read 1 Done Sent Done false
14255 4453 Acked Read 8 Done Sent Done false
14256 4454 Acked Flush 0 Done Sent Done false
14257 4455 Acked Read 2 Done Sent Done false
14258 4456 Acked Read 3 Done Sent Done false
14259 4457 Acked Read 8 Done Sent Done false
14260 4458 Acked Write 3 Done Sent Done false
14261 4459 Acked Write 3 Done Sent Done false
14262 4460 Acked Read 3 Done Sent Done false
14263 4461 Acked Write 8 Done Sent Done false
14264 4462 Acked Flush 0 Done Sent Done false
14265 4463 Acked Read 6 Done Sent Done false
14266 4464 Acked Read 3 Done Sent Done false
14267 4465 Acked Write 10 Done Sent Done false
14268 4466 Acked Read 2 Done Sent Done false
14269 4467 Acked Read 9 Done Sent Done false
14270 4468 Acked Flush 0 Done Sent Done false
14271 4469 Acked Write 10 Done Sent Done false
14272 4470 Acked Flush 0 Done Sent Done false
14273 4471 Acked Read 5 Done Sent Done false
14274 4472 Acked Flush 0 Done Sent Done false
14275 4473 Acked Read 3 Done Sent Done false
14276 4474 Acked Write 3 Done Sent Done false
14277 4475 Acked Write 8 Done Sent Done false
14278 4476 Acked Write 9 Done Sent Done false
14279 4477 Acked Write 9 Done Sent Done false
14280 4478 Acked Flush 0 Done Sent Done false
14281 4479 Acked Write 7 Done Sent Done false
14282 4480 Acked Read 6 Done Sent Done false
14283 4481 Acked Write 6 Done Sent Done false
14284 4482 Acked Read 4 Done Sent Done false
14285 4483 Acked Write 1 Done Sent Done false
14286 4484 Acked Flush 0 Done Sent Done false
14287 4485 Acked Flush 0 Done Sent Done false
14288 4486 Acked Read 9 Done Sent Done false
14289 4487 Acked Read 2 Done Sent Done false
14290 4488 Acked Read 5 Done Sent Done false
14291 4489 Acked Write 3 Done Sent Done false
14292 4490 Acked Read 3 Done Sent Done false
14293 4491 Acked Read 7 Done Sent Done false
14294 4492 Acked Write 5 Done Sent Done false
14295 4493 Acked Read 1 Done Sent Done false
14296 4494 Acked Read 3 Done Sent Done false
14297 4495 Acked Write 7 Done Sent Done false
14298 4496 Acked Read 1 Done Sent Done false
14299 4497 Acked Read 2 Done Sent Done false
14300 4498 Acked Write 10 Done Sent Done false
14301 4499 Acked Read 3 Done Sent Done false
14302 4500 Acked Read 5 Done Sent Done false
14303 4501 Acked Read 7 Done Sent Done false
14304 4502 Acked Write 9 Done Sent Done false
14305 4503 Acked Write 3 Done Sent Done false
14306 4504 Acked Write 7 Done Sent Done false
14307 4505 Acked Read 5 Done Sent Done false
14308 4506 Acked Write 5 Done Sent Done false
14309 4507 Acked Write 3 Done Sent Done false
14310 4508 Acked Write 3 Done Sent Done false
14311 4509 Acked Read 10 Done Sent Done false
14312 4510 Acked Write 3 Done Sent Done false
14313 4511 Acked Write 8 Done Sent Done false
14314 4512 Acked Write 10 Done Sent Done false
14315 4513 Acked Write 10 Done Sent Done false
14316 4514 Acked Read 2 Done Sent Done false
14317 4515 Acked Write 10 Done Sent Done false
14318 4516 Acked Write 6 Done Sent Done false
14319 4517 Acked Write 10 Done Sent Done false
14320 4518 Acked Write 7 Done Sent Done false
14321 4519 Acked Read 5 Done Sent Done false
14322 4520 Acked Read 1 Done Sent Done false
14323 4521 Acked Write 5 Done Sent Done false
14324 4522 Acked Write 2 Done Sent Done false
14325 4523 Acked Read 3 Done Sent Done false
14326 4524 Acked Write 10 Done Sent Done false
14327 4525 Acked Write 7 Done Sent Done false
14328 4526 Acked Read 10 Done Sent Done false
14329 4527 Acked Write 6 Done Sent Done false
14330 4528 Acked Write 5 Done Sent Done false
14331 4529 Acked Write 7 Done Sent Done false
14332 4530 Acked Read 2 Done Sent Done false
14333 4531 Acked Read 7 Done Sent Done false
14334 4532 Acked Write 8 Done Sent Done false
14335 4533 Acked Read 4 Done Sent Done false
14336 4534 Acked Write 9 Done Sent Done false
14337 4535 Acked Write 3 Done Sent Done false
14338 4536 Acked Read 10 Done Sent Done false
14339 4537 Acked Read 4 Done Sent Done false
14340 4538 Acked Write 8 Done Sent Done false
14341 4539 Acked Write 6 Done Sent Done false
14342 4540 Acked Read 6 Done Sent Done false
14343 4541 Acked Write 4 Done Sent Done false
14344 4542 Acked Write 4 Done Sent Done false
14345 4543 Acked Read 10 Done Sent Done false
14346 4544 Acked Read 5 Done Sent Done false
14347 4545 Acked Read 1 Done Sent Done false
14348 4546 Acked Write 3 Done Sent Done false
14349 4547 Acked Write 1 Done Sent Done false
14350 4548 Acked Write 10 Done Sent Done false
14351 4549 Acked Write 5 Done Sent Done false
14352 4550 Acked Write 7 Done Sent Done false
14353 4551 Acked Read 2 Done Sent Done false
14354 4552 Acked Write 5 Done Sent Done false
14355 4553 Acked Read 3 Done Sent Done false
14356 4554 Acked Read 10 Done Sent Done false
14357 4555 Acked Read 8 Done Sent Done false
14358 4556 Acked Write 8 Done Sent Done false
14359 4557 Acked Read 6 Done Sent Done false
14360 4558 Acked Flush 0 Done Sent Done false
14361 4559 Acked Write 3 Done Sent Done false
14362 4560 Acked Read 1 Done Sent Done false
14363 4561 Acked Read 4 Done Sent Done false
14364 4562 Acked Write 6 Done Sent Done false
14365 4563 Acked Read 3 Done Sent Done false
14366 4564 Acked Read 1 Done Sent Done false
14367 4565 Acked Read 3 Done Sent Done false
14368 4566 Acked Read 4 Done Sent Done false
14369 4567 Acked Write 5 Done Sent Done false
14370 4568 Acked Write 2 Done Sent Done false
14371 4569 Acked Write 10 Done Sent Done false
14372 4570 Acked Write 3 Done Sent Done false
14373 4571 Acked Read 4 Done Sent Done false
14374 4572 Acked Read 7 Done Sent Done false
14375 4573 Acked Read 7 Done Sent Done false
14376 4574 Acked Write 1 Done Sent Done false
14377 4575 Acked Write 5 Done Sent Done false
14378 4576 Acked Write 7 Done Sent Done false
14379 4577 Acked Write 3 Done Sent Done false
14380 4578 Acked Flush 0 Done Sent Done false
14381 4579 Acked Write 9 Done Sent Done false
14382 4580 Acked Write 4 Done Sent Done false
14383 4581 Acked Read 3 Done Sent Done false
14384 4582 Acked Write 6 Done Sent Done false
14385 4583 Acked Read 6 Done Sent Done false
14386 4584 Acked Read 3 Done Sent Done false
14387 4585 Acked Write 6 Done Sent Done false
14388 4586 Acked Read 4 Done Sent Done false
14389 4587 Acked Read 9 Done Sent Done false
14390 4588 Acked Flush 0 Done Sent Done false
14391 4589 Acked Write 1 Done Sent Done false
14392 4590 Acked Write 5 Done Sent Done false
14393 4591 Acked Write 5 Done Sent Done false
14394 4592 Acked Write 1 Done Sent Done false
14395 4593 Acked Flush 0 Done Sent Done false
14396 4594 Acked Read 1 Done Sent Done false
14397 4595 Acked Read 10 Done Sent Done false
14398 4596 Acked Flush 0 Done Sent Done false
14399 4597 Acked Read 8 Done Sent Done false
14400 4598 Acked Write 2 Done Sent Done false
14401 4599 Acked Read 7 Done Sent Done false
14402 4600 Acked Write 10 Done Sent Done false
14403 4601 Acked Write 2 Done Sent Done false
14404 4602 Acked Flush 0 Done Sent Done false
14405 4603 Acked Read 5 Done Sent Done false
14406 4604 Acked Read 5 Done Sent Done false
14407 4605 Acked Read 7 Done Sent Done false
14408 4606 Acked Write 1 Done Sent Done false
14409 4607 Acked Write 1 Done Sent Done false
14410 4608 Acked Flush 0 Done Sent Done false
14411 4609 Acked Write 6 Done Sent Done false
14412 4610 Acked Write 10 Done Sent Done false
14413 4611 Acked Write 3 Done Sent Done false
14414 4612 Acked Write 5 Done Sent Done false
14415 4613 Acked Read 3 Done Sent Done false
14416 4614 Acked Read 7 Done Sent Done false
14417 4615 Acked Read 6 Done Sent Done false
14418 4616 Acked Flush 0 Done Sent Done false
14419 4617 Acked Flush 0 Done Sent Done false
14420 4618 Acked Read 2 Done Sent Done false
14421 4619 Acked Write 4 Done Sent Done false
14422 4620 Acked Flush 0 Done Sent Done false
14423 STATES DS:0 DS:1 DS:2 TOTAL
14424 Sent 0 301 0 301
14425 Done 301 0 301 602
14426 Skipped 0 0 0 0
14427 Error 0 0 0 0
14428 Last Flush: 4620 4319 4620
14429 Downstairs last five completed: 4319 4318 4317 4316 4315
14430 Upstairs last five completed: 4620 4619 4618 4617 4616
14431 CLIENT: Up:0 ds:301 act:2
144322025-01-10T16:38:22.452ZINFOcrucible: connecting to 127.0.0.1:8820 = io task client = 1 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
144332025-01-10T16:38:22.452ZINFOcrucible: ds_connection connected from Ok(127.0.0.1:56773) = io task client = 1 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
144342025-01-10T16:38:22.453ZWARNcrucible: version negotiation from state Offline = downstairs client = 1 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
144352025-01-10T16:38:22.454ZINFOcrucible: downstairs client at Some(127.0.0.1:8820) has region UUID 12345678-0000-0000-0000-000000008820 = downstairs client = 1 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
144362025-01-10T16:38:22.454ZINFOcrucible: Returning UUID:12345678-0000-0000-0000-000000008820 matches = downstairs client = 1 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
144372025-01-10T16:38:22.454ZINFOcrucible: send last flush ID to this DS: 4319 = downstairs client = 1 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
144382025-01-10T16:38:22.454ZINFOcrucible: Replied this last flush ID: 4319 = downstairs client = 1 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
144392025-01-10T16:38:22.454ZINFOcrucible: ds_transition from Offline to Active = downstairs client = 1 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
144402025-01-10T16:38:22.454ZINFOcrucible: [1] Transition from Offline to Active = downstairs client = 1 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
144412025-01-10T16:38:22.454ZINFOcrucible: [1] client re-new 301 jobs since flush 4319 = downstairs session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
144422025-01-10T16:38:22.454ZINFOcrucible: [1] Replayed 301 jobs since flush: 4319 = downstairs session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
14443 ----------------------------------------------------------------
14444 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:0
14445 Downstairs last five completed: 4620 4619 4618 4617 4616
14446 Upstairs last five completed: 4620 4619 4618 4617 4616
14447 CLIENT: Up:0 ds:0 act:3
14448 Replay: All jobs finished
14449 Main task has work to do, go find it
14450 got dsc Stop(0)
14451 stop 0
14452 [8810] Got stop action so:false kr:false
14453 Jan 10 16:38:22.678 INFO request completed, latency_us: 329, response_code: 204, uri: /stop/cid/0, method: POST, req_id: 13e9c05a-bbcf-4592-a5a8-41183b123780, remote_addr: 127.0.0.1:55917, local_addr: 127.0.0.1:9998
144542025-01-10T16:38:22.678ZWARNcrucible: downstairs disconnected = io task client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
144552025-01-10T16:38:22.679ZWARNcrucible: client task is sending Done(Finished) = io task client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
144562025-01-10T16:38:22.679ZWARNcrucible: downstairs task for 0 stopped due to Finished session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
144572025-01-10T16:38:22.679ZINFOcrucible: ds_transition from Active to Offline = downstairs client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
144582025-01-10T16:38:22.679ZINFOcrucible: [0] Transition from Active to Offline = downstairs client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
144592025-01-10T16:38:22.679ZINFOcrucible: client task is exiting = io task client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
14460 Jan 10 16:38:22.679 INFO request completed, latency_us: 183, response_code: 200, uri: /state/cid/0, method: GET, req_id: 9affc7ab-6296-456c-8cad-5074e07d9416, remote_addr: 127.0.0.1:55917, local_addr: 127.0.0.1:9998
14461 [8810] Exited with: ExitStatus(unix_wait_status(9))
14462 [8810][0] reports Exit
14463 Jan 10 16:38:26.681 INFO request completed, latency_us: 218, response_code: 200, uri: /state/cid/0, method: GET, req_id: 2b1bf160-8eb8-4ae2-b88f-b71786d1a301, remote_addr: 127.0.0.1:55917, local_addr: 127.0.0.1:9998
14464 001/300 Read block 1789 len 28672
14465 002/300 Write block 1625 len 40960 data: 3 3 4 4 3 4 5 5 6 5
14466 003/300 Read block 3915 len 12288
14467 004/300 Read block 3915 len 12288
14468 005/300 Flush
14469 006/300 Read block 2532 len 16384
14470 007/300 Read block 4782 len 20480
14471 008/300 Write block 36 len 36864 data: 3 3 3 3 5 5 5 4 4
14472 009/300 Read block 3118 len 24576
14473 010/300 Read block 2160 len 4096
14474 011/300 Write block 1671 len 4096 data: 3
14475 012/300 Read block 2044 len 16384
14476 013/300 Read block 1414 len 20480
14477 014/300 Read block 431 len 20480
14478 015/300 Write block 4726 len 12288 data: 2 2 2
14479 016/300 Read block 2637 len 8192
14480 017/300 Read block 33 len 16384
14481 018/300 Flush
14482 019/300 Write block 1313 len 20480 data: 4 4 4 4 4
14483 020/300 Write block 3799 len 28672 data: 5 4 3 3 2 2 2
14484 021/300 Read block 4178 len 20480
14485 022/300 Flush
14486 023/300 Write block 762 len 4096 data: 4
14487 024/300 Read block 1045 len 24576
14488 025/300 Read block 1317 len 28672
14489 026/300 Write block 2752 len 20480 data: 3 3 3 3 3
14490 027/300 Read block 4816 len 32768
14491 028/300 Write block 1898 len 16384 data: 2 2 3 3
14492 029/300 Read block 3355 len 28672
14493 030/300 Write block 3759 len 40960 data: 5 3 3 4 3 3 3 4 5 4
14494 031/300 Read block 677 len 28672
14495 032/300 Read block 3029 len 28672
14496 033/300 Read block 1991 len 28672
14497 034/300 Read block 2840 len 40960
14498 035/300 Write block 1983 len 24576 data: 3 4 3 4 4 4
14499 036/300 Write block 2124 len 24576 data: 3 3 3 4 6 5
14500 037/300 Read block 42 len 32768
14501 038/300 Write block 3653 len 32768 data: 5 6 4 5 5 5 3 3
14502 039/300 Read block 2976 len 16384
14503 040/300 Write block 4511 len 24576 data: 2 3 3 3 3 3
14504 041/300 Write block 3205 len 12288 data: 3 3 3
14505 042/300 Write block 2043 len 24576 data: 3 2 2 2 2 3
14506 043/300 Flush
14507 044/300 Write block 1482 len 20480 data: 4 4 4 5 4
14508 045/300 Write block 3455 len 24576 data: 2 2 2 2 2 3
14509 046/300 Read block 66 len 32768
14510 047/300 Read block 3717 len 32768
14511 048/300 Read block 4411 len 4096
14512 049/300 Read block 2929 len 20480
14513 050/300 Read block 2006 len 24576
14514 051/300 Write block 4820 len 4096 data: 3
14515 052/300 Write block 1500 len 4096 data: 2
14516 053/300 Read block 4082 len 28672
14517 054/300 Flush
14518 055/300 Write block 447 len 36864 data: 5 6 6 6 5 6 5 4 3
14519 056/300 Read block 2255 len 40960
14520 057/300 Read block 74 len 16384
14521 058/300 Read block 730 len 4096
14522 059/300 Write block 4062 len 40960 data: 4 3 3 3 4 4 4 5 5 5
14523 060/300 Read block 4098 len 16384
14524 061/300 Write block 311 len 36864 data: 4 3 3 3 4 4 4 4 4
14525 062/300 Write block 404 len 16384 data: 3 2 2 2
14526 063/300 Read block 2629 len 28672
14527 064/300 Write block 1030 len 4096 data: 4
14528 065/300 Write block 2506 len 8192 data: 4 4
14529 066/300 Write block 1995 len 16384 data: 5 5 4 4
14530 067/300 Read block 1003 len 40960
14531 068/300 Write block 1946 len 24576 data: 2 2 2 2 2 3
14532 069/300 Read block 660 len 12288
14533 070/300 Write block 579 len 40960 data: 2 2 2 4 4 4 3 2 3 3
14534 071/300 Flush
14535 072/300 Flush
14536 073/300 Read block 4924 len 40960
14537 074/300 Write block 3853 len 12288 data: 3 4 5
14538 075/300 Flush
14539 076/300 Write block 4203 len 8192 data: 5 5
14540 077/300 Write block 560 len 12288 data: 5 5 5
14541 078/300 Read block 3764 len 36864
14542 079/300 Write block 2836 len 4096 data: 7
14543 080/300 Write block 3886 len 28672 data: 2 2 2 2 3 3 2
14544 081/300 Write block 2321 len 8192 data: 2 2
14545 082/300 Read block 99 len 8192
14546 083/300 Write block 597 len 40960 data: 3 4 5 5 6 4 5 5 5 5
14547 084/300 Write block 943 len 32768 data: 5 4 4 4 5 4 3 5
14548 085/300 Read block 3845 len 12288
14549 086/300 Read block 3832 len 20480
14550 087/300 Read block 1941 len 20480
14551 088/300 Write block 2583 len 32768 data: 4 5 5 4 5 6 6 6
14552 089/300 Write block 2672 len 36864 data: 2 2 2 3 4 4 4 5 4
14553 090/300 Read block 1487 len 12288
14554 091/300 Read block 123 len 8192
14555 092/300 Flush
14556 093/300 Read block 2667 len 16384
14557 094/300 Read block 1743 len 40960
14558 095/300 Write block 1919 len 8192 data: 3 3
14559 096/300 Write block 4414 len 20480 data: 3 3 3 3 3
14560 097/300 Write block 4850 len 20480 data: 4 3 3 4 4
14561 098/300 Read block 670 len 16384
14562 099/300 Write block 3429 len 24576 data: 2 2 2 2 2 2
14563 100/300 Read block 206 len 32768
14564 101/300 Read block 521 len 28672
14565 102/300 Flush
14566 103/300 Write block 3971 len 40960 data: 4 3 3 3 3 3 3 3 3 4
14567 104/300 Write block 1338 len 20480 data: 7 6 5 5 6
14568 105/300 Read block 4086 len 20480
14569 106/300 Write block 3924 len 4096 data: 3
14570 107/300 Read block 539 len 20480
14571 108/300 Read block 164 len 4096
14572 109/300 Write block 1350 len 36864 data: 3 4 5 5 3 3 3 3 3
14573 110/300 Read block 3631 len 40960
14574 111/300 Read block 1119 len 16384
14575 112/300 Write block 2250 len 16384 data: 4 4 2 2
14576 113/300 Flush
14577 114/300 Write block 1197 len 24576 data: 3 3 4 3 3 2
14578 115/300 Write block 2778 len 24576 data: 2 2 3 3 3 3
14579 116/300 Read block 1984 len 24576
14580 117/300 Write block 1519 len 24576 data: 2 2 3 3 3 3
14581 118/300 Read block 3785 len 24576
14582 119/300 Read block 1151 len 24576
14583 120/300 Read block 4078 len 12288
14584 121/300 Read block 4168 len 12288
14585 122/300 Write block 2976 len 24576 data: 3 3 4 5 5 4
14586 123/300 Write block 4587 len 8192 data: 2 2
14587 124/300 Write block 1387 len 28672 data: 5 6 6 5 5 4 4
14588 125/300 Write block 2512 len 8192 data: 6 6
14589 126/300 Write block 2681 len 24576 data: 4 4 4 5 5 5
14590 127/300 Flush
14591 128/300 Write block 76 len 8192 data: 6 6
14592 129/300 Read block 3480 len 40960
14593 130/300 Read block 1282 len 20480
14594 131/300 Write block 4884 len 16384 data: 3 3 2 2
14595 132/300 Write block 3625 len 4096 data: 2
14596 133/300 Write block 710 len 32768 data: 3 2 2 2 2 2 2 2
14597 134/300 Read block 919 len 16384
14598 135/300 Read block 899 len 40960
14599 136/300 Write block 2592 len 40960 data: 6 4 3 3 3 3 3 5 5 5
14600 137/300 Read block 432 len 20480
14601 138/300 Flush
14602 139/300 Read block 3020 len 24576
14603 140/300 Read block 2485 len 20480
14604 141/300 Write block 895 len 4096 data: 2
14605 142/300 Read block 1164 len 16384
14606 143/300 Read block 4443 len 24576
14607 144/300 Write block 1575 len 28672 data: 4 4 3 3 3 2 2
14608 145/300 Write block 2207 len 28672 data: 3 3 3 3 3 4 4
14609 146/300 Write block 4194 len 4096 data: 5
14610 147/300 Flush
14611 148/300 Read block 229 len 8192
14612 149/300 Read block 1159 len 28672
14613 150/300 Write block 4861 len 28672 data: 5 4 3 4 2 2 2
14614 151/300 Read block 1103 len 12288
14615 152/300 Write block 139 len 32768 data: 2 2 2 2 4 3 3 3
14616 153/300 Write block 2392 len 32768 data: 3 3 4 5 6 5 5 4
14617 154/300 Flush
14618 155/300 Read block 247 len 24576
14619 156/300 Write block 1279 len 20480 data: 6 5 5 6 6
14620 157/300 Read block 2479 len 20480
14621 158/300 Write block 1224 len 32768 data: 5 5 4 5 5 5 5 6
14622 159/300 Read block 1464 len 28672
14623 160/300 Write block 2611 len 36864 data: 3 4 4 3 3 4 3 4 4
14624 161/300 Read block 2787 len 12288
14625 162/300 Read block 510 len 20480
14626 163/300 Write block 2731 len 8192 data: 4 4
14627 164/300 Write block 2785 len 16384 data: 3 3 3 4
14628 165/300 Write block 4147 len 40960 data: 3 5 5 4 4 5 5 6 6 5
14629 166/300 Read block 4406 len 36864
14630 167/300 Write block 4804 len 4096 data: 5
14631 168/300 Read block 1530 len 16384
14632 169/300 Write block 1509 len 12288 data: 4 4 4
14633 170/300 Read block 4630 len 40960
14634 171/300 Write block 4487 len 16384 data: 4 5 5 5
14635 172/300 Read block 1216 len 40960
14636 173/300 Read block 4002 len 4096
14637 174/300 Read block 2876 len 4096
14638 175/300 Read block 1221 len 36864
14639 176/300 Read block 2369 len 16384
14640 177/300 Flush
14641 178/300 Flush
14642 179/300 Flush
14643 180/300 Read block 1435 len 20480
14644 181/300 Read block 1239 len 16384
14645 182/300 Write block 3046 len 36864 data: 2 3 3 3 3 3 3 3 3
14646 183/300 Read block 1452 len 12288
14647 184/300 Read block 3777 len 24576
14648 185/300 Write block 643 len 36864 data: 5 5 6 5 6 4 4 2 2
14649 186/300 Read block 3690 len 40960
14650 187/300 Write block 4430 len 8192 data: 6 6
14651 188/300 Flush
14652 189/300 Write block 2356 len 4096 data: 5
14653 190/300 Write block 3662 len 24576 data: 2 2 3 3 2 2
14654 191/300 Read block 4388 len 8192
14655 192/300 Write block 2915 len 40960 data: 3 3 3 2 3 3 3 3 4 4
14656 193/300 Read block 1523 len 12288
14657 194/300 Write block 3322 len 8192 data: 4 4
14658 195/300 Read block 4114 len 28672
14659 196/300 Read block 787 len 32768
14660 197/300 Read block 418 len 8192
14661 198/300 Read block 3455 len 28672
14662 199/300 Write block 3792 len 16384 data: 3 4 5 5
14663 200/300 Read block 1961 len 36864
14664 201/300 Read block 2825 len 20480
14665 202/300 Write block 4170 len 8192 data: 5 5
14666 203/300 Flush
14667 204/300 Read block 3148 len 32768
14668 205/300 Read block 4265 len 36864
14669 206/300 Write block 2404 len 32768 data: 2 2 2 3 3 3 3 4
14670 207/300 Read block 2231 len 36864
14671 208/300 Write block 2922 len 36864 data: 4 5 5 3 2 2 2 2 2
14672 209/300 Flush
14673 210/300 Read block 2943 len 8192
14674 211/300 Write block 3114 len 8192 data: 3 3
14675 212/300 Read block 4427 len 40960
14676 213/300 Read block 4705 len 4096
14677 214/300 Write block 3670 len 36864 data: 4 3 3 4 4 4 4 4 3
14678 215/300 Read block 3222 len 8192
14679 216/300 Write block 2156 len 32768 data: 5 4 5 5 5 4 3 3
14680 217/300 Flush
14681 218/300 Flush
14682 219/300 Read block 2544 len 12288
14683 220/300 Read block 2711 len 4096
14684 221/300 Write block 4159 len 40960 data: 3 4 4 5 4 4 6 6 5 5
14685 222/300 Write block 2188 len 36864 data: 3 2 3 3 3 5 5 6 6
14686 223/300 Write block 4086 len 4096 data: 3
14687 224/300 Read block 3403 len 40960
14688 225/300 Write block 4391 len 32768 data: 2 2 2 2 4 4 4 4
14689 226/300 Write block 3038 len 4096 data: 4
14690 227/300 Write block 3974 len 20480 data: 4 4 4 4 4
14691 228/300 Flush
14692 229/300 Read block 23 len 40960
14693 230/300 Read block 707 len 4096
14694 231/300 Flush
14695 232/300 Write block 605 len 8192 data: 6 6
14696 233/300 Write block 4127 len 32768 data: 4 5 4 4 3 3 2 3
14697 234/300 Read block 1969 len 28672
14698 235/300 Write block 1726 len 32768 data: 2 3 3 4 4 3 4 4
14699 236/300 Read block 4234 len 4096
14700 237/300 Write block 1208 len 12288 data: 2 2 2
14701 238/300 Flush
14702 239/300 Write block 4561 len 8192 data: 3 3
14703 240/300 Read block 181 len 36864
14704 241/300 Read block 815 len 24576
14705 242/300 Read block 2359 len 20480
14706 243/300 Read block 850 len 16384
14707 244/300 Read block 260 len 28672
14708 245/300 Read block 3578 len 12288
14709 246/300 Read block 2688 len 40960
14710 247/300 Write block 4445 len 16384 data: 4 3 3 2
14711 248/300 Write block 4582 len 12288 data: 3 4 4
14712 249/300 Read block 1852 len 40960
14713 250/300 Read block 2745 len 28672
14714 251/300 Write block 2772 len 28672 data: 3 3 3 2 2 2 3
14715 252/300 Read block 443 len 8192
14716 253/300 Write block 1224 len 28672 data: 6 6 5 6 6 6 6
14717 254/300 Write block 4238 len 16384 data: 3 4 4 4
14718 255/300 Write block 4917 len 32768 data: 4 3 4 5 3 2 2 2
14719 256/300 Read block 1644 len 28672
14720 257/300 Read block 1036 len 40960
14721 258/300 Write block 2897 len 24576 data: 6 6 6 6 6 5
14722 259/300 Read block 1324 len 16384
14723 260/300 Write block 1091 len 40960 data: 3 2 2 2 2 3 4 4 3 3
14724 261/300 Write block 2443 len 28672 data: 4 4 4 5 4 4 5
14725 262/300 Read block 4108 len 32768
14726 263/300 Read block 1829 len 32768
14727 264/300 Write block 2207 len 4096 data: 4
14728 265/300 Flush
14729 266/300 Write block 1138 len 32768 data: 4 5 4 4 4 4 5 4
14730 267/300 Write block 628 len 20480 data: 4 4 4 6 6
14731 268/300 Write block 4560 len 8192 data: 3 4
14732 269/300 Read block 2512 len 40960
14733 270/300 Flush
14734 271/300 Read block 3456 len 36864
14735 272/300 Write block 4959 len 32768 data: 3 3 4 4 4 4 3 3
14736 273/300 Write block 3942 len 32768 data: 5 6 6 7 7 6 5 3
14737 274/300 Read block 996 len 24576
14738 275/300 Flush
14739 276/300 Read block 2670 len 40960
14740 277/300 Write block 543 len 32768 data: 3 3 2 2 2 2 3 3
14741 278/300 Read block 4847 len 32768
14742 279/300 Write block 1320 len 36864 data: 6 5 4 5 5 4 4 5 5
14743 280/300 Read block 4149 len 12288
14744 281/300 Write block 4836 len 4096 data: 3
14745 282/300 Read block 3386 len 28672
14746 283/300 Read block 671 len 36864
14747 284/300 Write block 4844 len 12288 data: 4 4 3
14748 285/300 Flush
14749 286/300 Flush
14750 287/300 Read block 2335 len 36864
14751 288/300 Write block 3870 len 16384 data: 4 3 4 4
14752 289/300 Write block 2181 len 16384 data: 3 3 3 3
14753 290/300 Write block 4649 len 4096 data: 3
14754 291/300 Write block 2874 len 12288 data: 6 4 3
14755 292/300 Write block 1685 len 28672 data: 4 4 3 3 3 3 4
14756 293/300 Write block 4426 len 32768 data: 3 4 6 6 7 7 7 6
14757 294/300 Read block 41 len 40960
14758 295/300 Write block 1367 len 16384 data: 3 4 3 3
14759 296/300 Read block 4736 len 12288
14760 297/300 Read block 2508 len 40960
14761 298/300 Read block 1663 len 8192
14762 299/300 Write block 2706 len 20480 data: 3 2 2 2 2
14763 300/300 Read block 1880 len 8192
14764 301/300 Write block 4340 len 28672 data: 5 5 6 5 5 6 4
14765 Main task has work to do, go find it
14766 got dsc Start(0)
14767 start 0
14768 Jan 10 16:38:26.917 INFO request completed, latency_us: 193, response_code: 204, uri: /start/cid/0, method: POST, req_id: ac2802ef-24a6-4bc9-b440-bbc0c4f0cd55, remote_addr: 127.0.0.1:55917, local_addr: 127.0.0.1:9998
14769 Replay: started 0, returned:Ok(())
14770 ----------------------------------------------------------------
14771 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:301
14772 States: Offline Active Active
14773 JOBID ACK TYPE BKS/EXT DS:0 DS:1 DS:2 REPLAY
14774 4621 Acked Read 7 Sent Done Done false
14775 4622 Acked Write 10 Sent Done Done false
14776 4623 Acked Read 3 Sent Done Done false
14777 4624 Acked Read 3 Sent Done Done false
14778 4625 Acked Flush 0 Sent Done Done false
14779 4626 Acked Read 4 Sent Done Done false
14780 4627 Acked Read 5 Sent Done Done false
14781 4628 Acked Write 9 Sent Done Done false
14782 4629 Acked Read 6 Sent Done Done false
14783 4630 Acked Read 1 Sent Done Done false
14784 4631 Acked Write 1 Sent Done Done false
14785 4632 Acked Read 4 Sent Done Done false
14786 4633 Acked Read 5 Sent Done Done false
14787 4634 Acked Read 5 Sent Done Done false
14788 4635 Acked Write 3 Sent Done Done false
14789 4636 Acked Read 2 Sent Done Done false
14790 4637 Acked Read 4 Sent Done Done false
14791 4638 Acked Flush 0 Sent Done Done false
14792 4639 Acked Write 5 Sent Done Done false
14793 4640 Acked Write 7 Sent Done Done false
14794 4641 Acked Read 5 Sent Done Done false
14795 4642 Acked Flush 0 Sent Done Done false
14796 4643 Acked Write 1 Sent Done Done false
14797 4644 Acked Read 6 Sent Done Done false
14798 4645 Acked Read 7 Sent Done Done false
14799 4646 Acked Write 5 Sent Done Done false
14800 4647 Acked Read 8 Sent Done Done false
14801 4648 Acked Write 4 Sent Done Done false
14802 4649 Acked Read 7 Sent Done Done false
14803 4650 Acked Write 10 Sent Done Done false
14804 4651 Acked Read 7 Sent Done Done false
14805 4652 Acked Read 7 Sent Done Done false
14806 4653 Acked Read 7 Sent Done Done false
14807 4654 Acked Read 10 Sent Done Done false
14808 4655 Acked Write 6 Sent Done Done false
14809 4656 Acked Write 6 Sent Done Done false
14810 4657 Acked Read 8 Sent Done Done false
14811 4658 Acked Write 8 Sent Done Done false
14812 4659 Acked Read 4 Sent Done Done false
14813 4660 Acked Write 6 Sent Done Done false
14814 4661 Acked Write 3 Sent Done Done false
14815 4662 Acked Write 6 Sent Done Done false
14816 4663 Acked Flush 0 Sent Done Done false
14817 4664 Acked Write 5 Sent Done Done false
14818 4665 Acked Write 6 Sent Done Done false
14819 4666 Acked Read 8 Sent Done Done false
14820 4667 Acked Read 8 Sent Done Done false
14821 4668 Acked Read 1 Sent Done Done false
14822 4669 Acked Read 5 Sent Done Done false
14823 4670 Acked Read 6 Sent Done Done false
14824 4671 Acked Write 1 Sent Done Done false
14825 4672 Acked Write 1 Sent Done Done false
14826 4673 Acked Read 7 Sent Done Done false
14827 4674 Acked Flush 0 Sent Done Done false
14828 4675 Acked Write 9 Sent Done Done false
14829 4676 Acked Read 10 Sent Done Done false
14830 4677 Acked Read 4 Sent Done Done false
14831 4678 Acked Read 1 Sent Done Done false
14832 4679 Acked Write 10 Sent Done Done false
14833 4680 Acked Read 4 Sent Done Done false
14834 4681 Acked Write 9 Sent Done Done false
14835 4682 Acked Write 4 Sent Done Done false
14836 4683 Acked Read 7 Sent Done Done false
14837 4684 Acked Write 1 Sent Done Done false
14838 4685 Acked Write 2 Sent Done Done false
14839 4686 Acked Write 4 Sent Done Done false
14840 4687 Acked Read 10 Sent Done Done false
14841 4688 Acked Write 6 Sent Done Done false
14842 4689 Acked Read 3 Sent Done Done false
14843 4690 Acked Write 10 Sent Done Done false
14844 4691 Acked Flush 0 Sent Done Done false
14845 4692 Acked Flush 0 Sent Done Done false
14846 4693 Acked Read 10 Sent Done Done false
14847 4694 Acked Write 3 Sent Done Done false
14848 4695 Acked Flush 0 Sent Done Done false
14849 4696 Acked Write 2 Sent Done Done false
14850 4697 Acked Write 3 Sent Done Done false
14851 4698 Acked Read 9 Sent Done Done false
14852 4699 Acked Write 1 Sent Done Done false
14853 4700 Acked Write 7 Sent Done Done false
14854 4701 Acked Write 2 Sent Done Done false
14855 4702 Acked Read 2 Sent Done Done false
14856 4703 Acked Write 10 Sent Done Done false
14857 4704 Acked Write 8 Sent Done Done false
14858 4705 Acked Read 3 Sent Done Done false
14859 4706 Acked Read 5 Sent Done Done false
14860 4707 Acked Read 5 Sent Done Done false
14861 4708 Acked Write 8 Sent Done Done false
14862 4709 Acked Write 9 Sent Done Done false
14863 4710 Acked Read 3 Sent Done Done false
14864 4711 Acked Read 2 Sent Done Done false
14865 4712 Acked Flush 0 Sent Done Done false
14866 4713 Acked Read 4 Sent Done Done false
14867 4714 Acked Read 10 Sent Done Done false
14868 4715 Acked Write 2 Sent Done Done false
14869 4716 Acked Write 5 Sent Done Done false
14870 4717 Acked Write 5 Sent Done Done false
14871 4718 Acked Read 4 Sent Done Done false
14872 4719 Acked Write 6 Sent Done Done false
14873 4720 Acked Read 8 Sent Done Done false
14874 4721 Acked Read 7 Sent Done Done false
14875 4722 Acked Flush 0 Sent Done Done false
14876 4723 Acked Write 10 Sent Done Done false
14877 4724 Acked Write 5 Sent Done Done false
14878 4725 Acked Read 5 Sent Done Done false
14879 4726 Acked Write 1 Sent Done Done false
14880 4727 Acked Read 5 Sent Done Done false
14881 4728 Acked Read 1 Sent Done Done false
14882 4729 Acked Write 9 Sent Done Done false
14883 4730 Acked Read 10 Sent Done Done false
14884 4731 Acked Read 4 Sent Done Done false
14885 4732 Acked Write 4 Sent Done Done false
14886 4733 Acked Flush 0 Sent Done Done false
14887 4734 Acked Write 6 Sent Done Done false
14888 4735 Acked Write 6 Sent Done Done false
14889 4736 Acked Read 6 Sent Done Done false
14890 4737 Acked Write 6 Sent Done Done false
14891 4738 Acked Read 6 Sent Done Done false
14892 4739 Acked Read 6 Sent Done Done false
14893 4740 Acked Read 3 Sent Done Done false
14894 4741 Acked Read 3 Sent Done Done false
14895 4742 Acked Write 6 Sent Done Done false
14896 4743 Acked Write 2 Sent Done Done false
14897 4744 Acked Write 7 Sent Done Done false
14898 4745 Acked Write 2 Sent Done Done false
14899 4746 Acked Write 6 Sent Done Done false
14900 4747 Acked Flush 0 Sent Done Done false
14901 4748 Acked Write 2 Sent Done Done false
14902 4749 Acked Read 10 Sent Done Done false
14903 4750 Acked Read 5 Sent Done Done false
14904 4751 Acked Write 4 Sent Done Done false
14905 4752 Acked Write 1 Sent Done Done false
14906 4753 Acked Write 8 Sent Done Done false
14907 4754 Acked Read 4 Sent Done Done false
14908 4755 Acked Read 10 Sent Done Done false
14909 4756 Acked Write 10 Sent Done Done false
14910 4757 Acked Read 5 Sent Done Done false
14911 4758 Acked Flush 0 Sent Done Done false
14912 4759 Acked Read 6 Sent Done Done false
14913 4760 Acked Read 5 Sent Done Done false
14914 4761 Acked Write 1 Sent Done Done false
14915 4762 Acked Read 4 Sent Done Done false
14916 4763 Acked Read 6 Sent Done Done false
14917 4764 Acked Write 7 Sent Done Done false
14918 4765 Acked Write 7 Sent Done Done false
14919 4766 Acked Write 1 Sent Done Done false
14920 4767 Acked Flush 0 Sent Done Done false
14921 4768 Acked Read 2 Sent Done Done false
14922 4769 Acked Read 7 Sent Done Done false
14923 4770 Acked Write 7 Sent Done Done false
14924 4771 Acked Read 3 Sent Done Done false
14925 4772 Acked Write 8 Sent Done Done false
14926 4773 Acked Write 8 Sent Done Done false
14927 4774 Acked Flush 0 Sent Done Done false
14928 4775 Acked Read 6 Sent Done Done false
14929 4776 Acked Write 5 Sent Done Done false
14930 4777 Acked Read 5 Sent Done Done false
14931 4778 Acked Write 8 Sent Done Done false
14932 4779 Acked Read 7 Sent Done Done false
14933 4780 Acked Write 9 Sent Done Done false
14934 4781 Acked Read 3 Sent Done Done false
14935 4782 Acked Read 5 Sent Done Done false
14936 4783 Acked Write 2 Sent Done Done false
14937 4784 Acked Write 4 Sent Done Done false
14938 4785 Acked Write 10 Sent Done Done false
14939 4786 Acked Read 9 Sent Done Done false
14940 4787 Acked Write 1 Sent Done Done false
14941 4788 Acked Read 4 Sent Done Done false
14942 4789 Acked Write 3 Sent Done Done false
14943 4790 Acked Read 10 Sent Done Done false
14944 4791 Acked Write 4 Sent Done Done false
14945 4792 Acked Read 10 Sent Done Done false
14946 4793 Acked Read 1 Sent Done Done false
14947 4794 Acked Read 1 Sent Done Done false
14948 4795 Acked Read 9 Sent Done Done false
14949 4796 Acked Read 4 Sent Done Done false
14950 4797 Acked Flush 0 Sent Done Done false
14951 4798 Acked Flush 0 Sent Done Done false
14952 4799 Acked Flush 0 Sent Done Done false
14953 4800 Acked Read 5 Sent Done Done false
14954 4801 Acked Read 4 Sent Done Done false
14955 4802 Acked Write 9 Sent Done Done false
14956 4803 Acked Read 3 Sent Done Done false
14957 4804 Acked Read 6 Sent Done Done false
14958 4805 Acked Write 9 Sent Done Done false
14959 4806 Acked Read 10 Sent Done Done false
14960 4807 Acked Write 2 Sent Done Done false
14961 4808 Acked Flush 0 Sent Done Done false
14962 4809 Acked Write 1 Sent Done Done false
14963 4810 Acked Write 6 Sent Done Done false
14964 4811 Acked Read 2 Sent Done Done false
14965 4812 Acked Write 10 Sent Done Done false
14966 4813 Acked Read 3 Sent Done Done false
14967 4814 Acked Write 2 Sent Done Done false
14968 4815 Acked Read 7 Sent Done Done false
14969 4816 Acked Read 8 Sent Done Done false
14970 4817 Acked Read 2 Sent Done Done false
14971 4818 Acked Read 7 Sent Done Done false
14972 4819 Acked Write 4 Sent Done Done false
14973 4820 Acked Read 9 Sent Done Done false
14974 4821 Acked Read 5 Sent Done Done false
14975 4822 Acked Write 2 Sent Done Done false
14976 4823 Acked Flush 0 Sent Done Done false
14977 4824 Acked Read 8 Sent Done Done false
14978 4825 Acked Read 9 Sent Done Done false
14979 4826 Acked Write 8 Sent Done Done false
14980 4827 Acked Read 9 Sent Done Done false
14981 4828 Acked Write 9 Sent Done Done false
14982 4829 Acked Flush 0 Sent Done Done false
14983 4830 Acked Read 2 Sent Done Done false
14984 4831 Acked Write 2 Sent Done Done false
14985 4832 Acked Read 10 Sent Done Done false
14986 4833 Acked Read 1 Sent Done Done false
14987 4834 Acked Write 9 Sent Done Done false
14988 4835 Acked Read 2 Sent Done Done false
14989 4836 Acked Write 8 Sent Done Done false
14990 4837 Acked Flush 0 Sent Done Done false
14991 4838 Acked Flush 0 Sent Done Done false
14992 4839 Acked Read 3 Sent Done Done false
14993 4840 Acked Read 1 Sent Done Done false
14994 4841 Acked Write 10 Sent Done Done false
14995 4842 Acked Write 9 Sent Done Done false
14996 4843 Acked Write 1 Sent Done Done false
14997 4844 Acked Read 10 Sent Done Done false
14998 4845 Acked Write 8 Sent Done Done false
14999 4846 Acked Write 1 Sent Done Done false
15000 4847 Acked Write 5 Sent Done Done false
15001 4848 Acked Flush 0 Sent Done Done false
15002 4849 Acked Read 10 Sent Done Done false
15003 4850 Acked Read 1 Sent Done Done false
15004 4851 Acked Flush 0 Sent Done Done false
15005 4852 Acked Write 2 Sent Done Done false
15006 4853 Acked Write 8 Sent Done Done false
15007 4854 Acked Read 7 Sent Done Done false
15008 4855 Acked Write 8 Sent Done Done false
15009 4856 Acked Read 1 Sent Done Done false
15010 4857 Acked Write 3 Sent Done Done false
15011 4858 Acked Flush 0 Sent Done Done false
15012 4859 Acked Write 2 Sent Done Done false
15013 4860 Acked Read 9 Sent Done Done false
15014 4861 Acked Read 6 Sent Done Done false
15015 4862 Acked Read 5 Sent Done Done false
15016 4863 Acked Read 4 Sent Done Done false
15017 4864 Acked Read 7 Sent Done Done false
15018 4865 Acked Read 3 Sent Done Done false
15019 4866 Acked Read 10 Sent Done Done false
15020 4867 Acked Write 4 Sent Done Done false
15021 4868 Acked Write 3 Sent Done Done false
15022 4869 Acked Read 10 Sent Done Done false
15023 4870 Acked Read 7 Sent Done Done false
15024 4871 Acked Write 7 Sent Done Done false
15025 4872 Acked Read 2 Sent Done Done false
15026 4873 Acked Write 7 Sent Done Done false
15027 4874 Acked Write 4 Sent Done Done false
15028 4875 Acked Write 8 Sent Done Done false
15029 4876 Acked Read 7 Sent Done Done false
15030 4877 Acked Read 10 Sent Done Done false
15031 4878 Acked Write 6 Sent Done Done false
15032 4879 Acked Read 4 Sent Done Done false
15033 4880 Acked Write 10 Sent Done Done false
15034 4881 Acked Write 7 Sent Done Done false
15035 4882 Acked Read 8 Sent Done Done false
15036 4883 Acked Read 8 Sent Done Done false
15037 4884 Acked Write 1 Sent Done Done false
15038 4885 Acked Flush 0 Sent Done Done false
15039 4886 Acked Write 8 Sent Done Done false
15040 4887 Acked Write 5 Sent Done Done false
15041 4888 Acked Write 2 Sent Done Done false
15042 4889 Acked Read 10 Sent Done Done false
15043 4890 Acked Flush 0 Sent Done Done false
15044 4891 Acked Read 9 Sent Done Done false
15045 4892 Acked Write 8 Sent Done Done false
15046 4893 Acked Write 8 Sent Done Done false
15047 4894 Acked Read 6 Sent Done Done false
15048 4895 Acked Flush 0 Sent Done Done false
15049 4896 Acked Read 10 Sent Done Done false
15050 4897 Acked Write 8 Sent Done Done false
15051 4898 Acked Read 8 Sent Done Done false
15052 4899 Acked Write 9 Sent Done Done false
15053 4900 Acked Read 3 Sent Done Done false
15054 4901 Acked Write 1 Sent Done Done false
15055 4902 Acked Read 7 Sent Done Done false
15056 4903 Acked Read 9 Sent Done Done false
15057 4904 Acked Write 3 Sent Done Done false
15058 4905 Acked Flush 0 Sent Done Done false
15059 4906 Acked Flush 0 Sent Done Done false
15060 4907 Acked Read 9 Sent Done Done false
15061 4908 Acked Write 4 Sent Done Done false
15062 4909 Acked Write 4 Sent Done Done false
15063 4910 Acked Write 1 Sent Done Done false
15064 4911 Acked Write 3 Sent Done Done false
15065 4912 Acked Write 7 Sent Done Done false
15066 4913 Acked Write 8 Sent Done Done false
15067 4914 Acked Read 10 Sent Done Done false
15068 4915 Acked Write 4 Sent Done Done false
15069 4916 Acked Read 3 Sent Done Done false
15070 4917 Acked Read 10 Sent Done Done false
15071 4918 Acked Read 2 Sent Done Done false
15072 4919 Acked Write 5 Sent Done Done false
15073 4920 Acked Read 2 Sent Done Done false
15074 4921 Acked Write 7 Sent Done Sent false
15075 STATES DS:0 DS:1 DS:2 TOTAL
15076 Sent 301 0 1 302
15077 Done 0 301 300 601
15078 Skipped 0 0 0 0
15079 Error 0 0 0 0
15080 Last Flush: 4620 4906 4906
15081 Downstairs last five completed: 4620 4619 4618 4617 4616
15082 Upstairs last five completed: 4921 4920 4919 4918 4917
15083 CLIENT: Up:0 ds:301 act:2
15084 [8810] got start action
15085 [8810] I am going to restart
15086 Starting downstairs at port 8810
15087 Make output file at "/tmp/dsc/downstairs-8810.txt"
15088 [8810][0] reports Starting
15089 Downstairs /var/tmp/dsc/region/8810 port 8810 PID:Some(1215)
15090 [8810][0] reports Running
15091 ----------------------------------------------------------------
15092 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:302
15093 States: Offline Active Active
15094 JOBID ACK TYPE BKS/EXT DS:0 DS:1 DS:2 REPLAY
15095 4621 Acked Read 7 Sent Done Done false
15096 4622 Acked Write 10 Sent Done Done false
15097 4623 Acked Read 3 Sent Done Done false
15098 4624 Acked Read 3 Sent Done Done false
15099 4625 Acked Flush 0 Sent Done Done false
15100 4626 Acked Read 4 Sent Done Done false
15101 4627 Acked Read 5 Sent Done Done false
15102 4628 Acked Write 9 Sent Done Done false
15103 4629 Acked Read 6 Sent Done Done false
15104 4630 Acked Read 1 Sent Done Done false
15105 4631 Acked Write 1 Sent Done Done false
15106 4632 Acked Read 4 Sent Done Done false
15107 4633 Acked Read 5 Sent Done Done false
15108 4634 Acked Read 5 Sent Done Done false
15109 4635 Acked Write 3 Sent Done Done false
15110 4636 Acked Read 2 Sent Done Done false
15111 4637 Acked Read 4 Sent Done Done false
15112 4638 Acked Flush 0 Sent Done Done false
15113 4639 Acked Write 5 Sent Done Done false
15114 4640 Acked Write 7 Sent Done Done false
15115 4641 Acked Read 5 Sent Done Done false
15116 4642 Acked Flush 0 Sent Done Done false
15117 4643 Acked Write 1 Sent Done Done false
15118 4644 Acked Read 6 Sent Done Done false
15119 4645 Acked Read 7 Sent Done Done false
15120 4646 Acked Write 5 Sent Done Done false
15121 4647 Acked Read 8 Sent Done Done false
15122 4648 Acked Write 4 Sent Done Done false
15123 4649 Acked Read 7 Sent Done Done false
15124 4650 Acked Write 10 Sent Done Done false
15125 4651 Acked Read 7 Sent Done Done false
15126 4652 Acked Read 7 Sent Done Done false
15127 4653 Acked Read 7 Sent Done Done false
15128 4654 Acked Read 10 Sent Done Done false
15129 4655 Acked Write 6 Sent Done Done false
15130 4656 Acked Write 6 Sent Done Done false
15131 4657 Acked Read 8 Sent Done Done false
15132 4658 Acked Write 8 Sent Done Done false
15133 4659 Acked Read 4 Sent Done Done false
15134 4660 Acked Write 6 Sent Done Done false
15135 4661 Acked Write 3 Sent Done Done false
15136 4662 Acked Write 6 Sent Done Done false
15137 4663 Acked Flush 0 Sent Done Done false
15138 4664 Acked Write 5 Sent Done Done false
15139 4665 Acked Write 6 Sent Done Done false
15140 4666 Acked Read 8 Sent Done Done false
15141 4667 Acked Read 8 Sent Done Done false
15142 4668 Acked Read 1 Sent Done Done false
15143 4669 Acked Read 5 Sent Done Done false
15144 4670 Acked Read 6 Sent Done Done false
15145 4671 Acked Write 1 Sent Done Done false
15146 4672 Acked Write 1 Sent Done Done false
15147 4673 Acked Read 7 Sent Done Done false
15148 4674 Acked Flush 0 Sent Done Done false
15149 4675 Acked Write 9 Sent Done Done false
15150 4676 Acked Read 10 Sent Done Done false
15151 4677 Acked Read 4 Sent Done Done false
15152 4678 Acked Read 1 Sent Done Done false
15153 4679 Acked Write 10 Sent Done Done false
15154 4680 Acked Read 4 Sent Done Done false
15155 4681 Acked Write 9 Sent Done Done false
15156 4682 Acked Write 4 Sent Done Done false
15157 4683 Acked Read 7 Sent Done Done false
15158 4684 Acked Write 1 Sent Done Done false
15159 4685 Acked Write 2 Sent Done Done false
15160 4686 Acked Write 4 Sent Done Done false
15161 4687 Acked Read 10 Sent Done Done false
15162 4688 Acked Write 6 Sent Done Done false
15163 4689 Acked Read 3 Sent Done Done false
15164 4690 Acked Write 10 Sent Done Done false
15165 4691 Acked Flush 0 Sent Done Done false
15166 4692 Acked Flush 0 Sent Done Done false
15167 4693 Acked Read 10 Sent Done Done false
15168 4694 Acked Write 3 Sent Done Done false
15169 4695 Acked Flush 0 Sent Done Done false
15170 4696 Acked Write 2 Sent Done Done false
15171 4697 Acked Write 3 Sent Done Done false
15172 4698 Acked Read 9 Sent Done Done false
15173 4699 Acked Write 1 Sent Done Done false
15174 4700 Acked Write 7 Sent Done Done false
15175 4701 Acked Write 2 Sent Done Done false
15176 4702 Acked Read 2 Sent Done Done false
15177 4703 Acked Write 10 Sent Done Done false
15178 4704 Acked Write 8 Sent Done Done false
15179 4705 Acked Read 3 Sent Done Done false
15180 4706 Acked Read 5 Sent Done Done false
15181 4707 Acked Read 5 Sent Done Done false
15182 4708 Acked Write 8 Sent Done Done false
15183 4709 Acked Write 9 Sent Done Done false
15184 4710 Acked Read 3 Sent Done Done false
15185 4711 Acked Read 2 Sent Done Done false
15186 4712 Acked Flush 0 Sent Done Done false
15187 4713 Acked Read 4 Sent Done Done false
15188 4714 Acked Read 10 Sent Done Done false
15189 4715 Acked Write 2 Sent Done Done false
15190 4716 Acked Write 5 Sent Done Done false
15191 4717 Acked Write 5 Sent Done Done false
15192 4718 Acked Read 4 Sent Done Done false
15193 4719 Acked Write 6 Sent Done Done false
15194 4720 Acked Read 8 Sent Done Done false
15195 4721 Acked Read 7 Sent Done Done false
15196 4722 Acked Flush 0 Sent Done Done false
15197 4723 Acked Write 10 Sent Done Done false
15198 4724 Acked Write 5 Sent Done Done false
15199 4725 Acked Read 5 Sent Done Done false
15200 4726 Acked Write 1 Sent Done Done false
15201 4727 Acked Read 5 Sent Done Done false
15202 4728 Acked Read 1 Sent Done Done false
15203 4729 Acked Write 9 Sent Done Done false
15204 4730 Acked Read 10 Sent Done Done false
15205 4731 Acked Read 4 Sent Done Done false
15206 4732 Acked Write 4 Sent Done Done false
15207 4733 Acked Flush 0 Sent Done Done false
15208 4734 Acked Write 6 Sent Done Done false
15209 4735 Acked Write 6 Sent Done Done false
15210 4736 Acked Read 6 Sent Done Done false
15211 4737 Acked Write 6 Sent Done Done false
15212 4738 Acked Read 6 Sent Done Done false
15213 4739 Acked Read 6 Sent Done Done false
15214 4740 Acked Read 3 Sent Done Done false
15215 4741 Acked Read 3 Sent Done Done false
15216 4742 Acked Write 6 Sent Done Done false
15217 4743 Acked Write 2 Sent Done Done false
15218 4744 Acked Write 7 Sent Done Done false
15219 4745 Acked Write 2 Sent Done Done false
15220 4746 Acked Write 6 Sent Done Done false
15221 4747 Acked Flush 0 Sent Done Done false
15222 4748 Acked Write 2 Sent Done Done false
15223 4749 Acked Read 10 Sent Done Done false
15224 4750 Acked Read 5 Sent Done Done false
15225 4751 Acked Write 4 Sent Done Done false
15226 4752 Acked Write 1 Sent Done Done false
15227 4753 Acked Write 8 Sent Done Done false
15228 4754 Acked Read 4 Sent Done Done false
15229 4755 Acked Read 10 Sent Done Done false
15230 4756 Acked Write 10 Sent Done Done false
15231 4757 Acked Read 5 Sent Done Done false
15232 4758 Acked Flush 0 Sent Done Done false
15233 4759 Acked Read 6 Sent Done Done false
15234 4760 Acked Read 5 Sent Done Done false
15235 4761 Acked Write 1 Sent Done Done false
15236 4762 Acked Read 4 Sent Done Done false
15237 4763 Acked Read 6 Sent Done Done false
15238 4764 Acked Write 7 Sent Done Done false
15239 4765 Acked Write 7 Sent Done Done false
15240 4766 Acked Write 1 Sent Done Done false
15241 4767 Acked Flush 0 Sent Done Done false
15242 4768 Acked Read 2 Sent Done Done false
15243 4769 Acked Read 7 Sent Done Done false
15244 4770 Acked Write 7 Sent Done Done false
15245 4771 Acked Read 3 Sent Done Done false
15246 4772 Acked Write 8 Sent Done Done false
15247 4773 Acked Write 8 Sent Done Done false
15248 4774 Acked Flush 0 Sent Done Done false
15249 4775 Acked Read 6 Sent Done Done false
15250 4776 Acked Write 5 Sent Done Done false
15251 4777 Acked Read 5 Sent Done Done false
15252 4778 Acked Write 8 Sent Done Done false
15253 4779 Acked Read 7 Sent Done Done false
15254 4780 Acked Write 9 Sent Done Done false
15255 4781 Acked Read 3 Sent Done Done false
15256 4782 Acked Read 5 Sent Done Done false
15257 4783 Acked Write 2 Sent Done Done false
15258 4784 Acked Write 4 Sent Done Done false
15259 4785 Acked Write 10 Sent Done Done false
15260 4786 Acked Read 9 Sent Done Done false
15261 4787 Acked Write 1 Sent Done Done false
15262 4788 Acked Read 4 Sent Done Done false
15263 4789 Acked Write 3 Sent Done Done false
15264 4790 Acked Read 10 Sent Done Done false
15265 4791 Acked Write 4 Sent Done Done false
15266 4792 Acked Read 10 Sent Done Done false
15267 4793 Acked Read 1 Sent Done Done false
15268 4794 Acked Read 1 Sent Done Done false
15269 4795 Acked Read 9 Sent Done Done false
15270 4796 Acked Read 4 Sent Done Done false
15271 4797 Acked Flush 0 Sent Done Done false
15272 4798 Acked Flush 0 Sent Done Done false
15273 4799 Acked Flush 0 Sent Done Done false
15274 4800 Acked Read 5 Sent Done Done false
15275 4801 Acked Read 4 Sent Done Done false
15276 4802 Acked Write 9 Sent Done Done false
15277 4803 Acked Read 3 Sent Done Done false
15278 4804 Acked Read 6 Sent Done Done false
15279 4805 Acked Write 9 Sent Done Done false
15280 4806 Acked Read 10 Sent Done Done false
15281 4807 Acked Write 2 Sent Done Done false
15282 4808 Acked Flush 0 Sent Done Done false
15283 4809 Acked Write 1 Sent Done Done false
15284 4810 Acked Write 6 Sent Done Done false
15285 4811 Acked Read 2 Sent Done Done false
15286 4812 Acked Write 10 Sent Done Done false
15287 4813 Acked Read 3 Sent Done Done false
15288 4814 Acked Write 2 Sent Done Done false
15289 4815 Acked Read 7 Sent Done Done false
15290 4816 Acked Read 8 Sent Done Done false
15291 4817 Acked Read 2 Sent Done Done false
15292 4818 Acked Read 7 Sent Done Done false
15293 4819 Acked Write 4 Sent Done Done false
15294 4820 Acked Read 9 Sent Done Done false
15295 4821 Acked Read 5 Sent Done Done false
15296 4822 Acked Write 2 Sent Done Done false
15297 4823 Acked Flush 0 Sent Done Done false
15298 4824 Acked Read 8 Sent Done Done false
15299 4825 Acked Read 9 Sent Done Done false
15300 4826 Acked Write 8 Sent Done Done false
15301 4827 Acked Read 9 Sent Done Done false
15302 4828 Acked Write 9 Sent Done Done false
15303 4829 Acked Flush 0 Sent Done Done false
15304 4830 Acked Read 2 Sent Done Done false
15305 4831 Acked Write 2 Sent Done Done false
15306 4832 Acked Read 10 Sent Done Done false
15307 4833 Acked Read 1 Sent Done Done false
15308 4834 Acked Write 9 Sent Done Done false
15309 4835 Acked Read 2 Sent Done Done false
15310 4836 Acked Write 8 Sent Done Done false
15311 4837 Acked Flush 0 Sent Done Done false
15312 4838 Acked Flush 0 Sent Done Done false
15313 4839 Acked Read 3 Sent Done Done false
15314 4840 Acked Read 1 Sent Done Done false
15315 4841 Acked Write 10 Sent Done Done false
15316 4842 Acked Write 9 Sent Done Done false
15317 4843 Acked Write 1 Sent Done Done false
15318 4844 Acked Read 10 Sent Done Done false
15319 4845 Acked Write 8 Sent Done Done false
15320 4846 Acked Write 1 Sent Done Done false
15321 4847 Acked Write 5 Sent Done Done false
15322 4848 Acked Flush 0 Sent Done Done false
15323 4849 Acked Read 10 Sent Done Done false
15324 4850 Acked Read 1 Sent Done Done false
15325 4851 Acked Flush 0 Sent Done Done false
15326 4852 Acked Write 2 Sent Done Done false
15327 4853 Acked Write 8 Sent Done Done false
15328 4854 Acked Read 7 Sent Done Done false
15329 4855 Acked Write 8 Sent Done Done false
15330 4856 Acked Read 1 Sent Done Done false
15331 4857 Acked Write 3 Sent Done Done false
15332 4858 Acked Flush 0 Sent Done Done false
15333 4859 Acked Write 2 Sent Done Done false
15334 4860 Acked Read 9 Sent Done Done false
15335 4861 Acked Read 6 Sent Done Done false
15336 4862 Acked Read 5 Sent Done Done false
15337 4863 Acked Read 4 Sent Done Done false
15338 4864 Acked Read 7 Sent Done Done false
15339 4865 Acked Read 3 Sent Done Done false
15340 4866 Acked Read 10 Sent Done Done false
15341 4867 Acked Write 4 Sent Done Done false
15342 4868 Acked Write 3 Sent Done Done false
15343 4869 Acked Read 10 Sent Done Done false
15344 4870 Acked Read 7 Sent Done Done false
15345 4871 Acked Write 7 Sent Done Done false
15346 4872 Acked Read 2 Sent Done Done false
15347 4873 Acked Write 7 Sent Done Done false
15348 4874 Acked Write 4 Sent Done Done false
15349 4875 Acked Write 8 Sent Done Done false
15350 4876 Acked Read 7 Sent Done Done false
15351 4877 Acked Read 10 Sent Done Done false
15352 4878 Acked Write 6 Sent Done Done false
15353 4879 Acked Read 4 Sent Done Done false
15354 4880 Acked Write 10 Sent Done Done false
15355 4881 Acked Write 7 Sent Done Done false
15356 4882 Acked Read 8 Sent Done Done false
15357 4883 Acked Read 8 Sent Done Done false
15358 4884 Acked Write 1 Sent Done Done false
15359 4885 Acked Flush 0 Sent Done Done false
15360 4886 Acked Write 8 Sent Done Done false
15361 4887 Acked Write 5 Sent Done Done false
15362 4888 Acked Write 2 Sent Done Done false
15363 4889 Acked Read 10 Sent Done Done false
15364 4890 Acked Flush 0 Sent Done Done false
15365 4891 Acked Read 9 Sent Done Done false
15366 4892 Acked Write 8 Sent Done Done false
15367 4893 Acked Write 8 Sent Done Done false
15368 4894 Acked Read 6 Sent Done Done false
15369 4895 Acked Flush 0 Sent Done Done false
15370 4896 Acked Read 10 Sent Done Done false
15371 4897 Acked Write 8 Sent Done Done false
15372 4898 Acked Read 8 Sent Done Done false
15373 4899 Acked Write 9 Sent Done Done false
15374 4900 Acked Read 3 Sent Done Done false
15375 4901 Acked Write 1 Sent Done Done false
15376 4902 Acked Read 7 Sent Done Done false
15377 4903 Acked Read 9 Sent Done Done false
15378 4904 Acked Write 3 Sent Done Done false
15379 4905 Acked Flush 0 Sent Done Done false
15380 4906 Acked Flush 0 Sent Done Done false
15381 4907 Acked Read 9 Sent Done Done false
15382 4908 Acked Write 4 Sent Done Done false
15383 4909 Acked Write 4 Sent Done Done false
15384 4910 Acked Write 1 Sent Done Done false
15385 4911 Acked Write 3 Sent Done Done false
15386 4912 Acked Write 7 Sent Done Done false
15387 4913 Acked Write 8 Sent Done Done false
15388 4914 Acked Read 10 Sent Done Done false
15389 4915 Acked Write 4 Sent Done Done false
15390 4916 Acked Read 3 Sent Done Done false
15391 4917 Acked Read 10 Sent Done Done false
15392 4918 Acked Read 2 Sent Done Done false
15393 4919 Acked Write 5 Sent Done Done false
15394 4920 Acked Read 2 Sent Done Done false
15395 4921 Acked Write 7 Sent Done Done false
15396 4922 Acked Flush 0 Sent Done Done false
15397 STATES DS:0 DS:1 DS:2 TOTAL
15398 Sent 302 0 0 302
15399 Done 0 302 302 604
15400 Skipped 0 0 0 0
15401 Error 0 0 0 0
15402 Last Flush: 4620 4922 4922
15403 Downstairs last five completed: 4620 4619 4618 4617 4616
15404 Upstairs last five completed: 4922 4921 4920 4919 4918
15405 CLIENT: Up:0 ds:302 act:2
154062025-01-10T16:38:32.680ZINFOcrucible: connecting to 127.0.0.1:8810 = io task client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
154072025-01-10T16:38:32.680ZINFOcrucible: ds_connection connected from Ok(127.0.0.1:41503) = io task client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
154082025-01-10T16:38:32.681ZWARNcrucible: version negotiation from state Offline = downstairs client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
154092025-01-10T16:38:32.681ZINFOcrucible: downstairs client at Some(127.0.0.1:8810) has region UUID 12345678-0000-0000-0000-000000008810 = downstairs client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
154102025-01-10T16:38:32.681ZINFOcrucible: Returning UUID:12345678-0000-0000-0000-000000008810 matches = downstairs client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
154112025-01-10T16:38:32.681ZINFOcrucible: send last flush ID to this DS: 4620 = downstairs client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
154122025-01-10T16:38:32.682ZINFOcrucible: Replied this last flush ID: 4620 = downstairs client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
154132025-01-10T16:38:32.682ZINFOcrucible: ds_transition from Offline to Active = downstairs client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
154142025-01-10T16:38:32.682ZINFOcrucible: [0] Transition from Offline to Active = downstairs client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
154152025-01-10T16:38:32.682ZINFOcrucible: [0] client re-new 302 jobs since flush 4620 = downstairs session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
154162025-01-10T16:38:32.682ZINFOcrucible: [0] Replayed 302 jobs since flush: 4620 = downstairs session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
15417 ----------------------------------------------------------------
15418 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:0
15419 Downstairs last five completed: 4922 4921 4920 4919 4918
15420 Upstairs last five completed: 4922 4921 4920 4919 4918
15421 CLIENT: Up:0 ds:0 act:3
15422 Replay: All jobs finished
15423 Main task has work to do, go find it
15424 got dsc Stop(1)
15425 stop 1
15426 [8820] Got stop action so:false kr:false
15427 Jan 10 16:38:34.922 INFO request completed, latency_us: 357, response_code: 204, uri: /stop/cid/1, method: POST, req_id: e5fd8bd4-211a-4e3b-9d86-0febdae36d7b, remote_addr: 127.0.0.1:55917, local_addr: 127.0.0.1:9998
15428 Jan 10 16:38:34.922 INFO {"msg":"downstairs disconnected","v":0,"name":"crucible","level":40,"time":"2025-01-10T16:38:34.922802471Z","hostname":"w-01JH8H1N3KXZ9F8ZV6CCMP5KTQ","pid":1202,"":"io task","client":"1","":"downstairs","session_id":"1df3ca91-4dc9-42d6-9897-461254b5afe2"}
15429 request completed, latency_us: 131, response_code: 200, uri: /state/cid/1, method: GET, req_id: 628ca15c-9825-4cad-9065-0a6a7fff83e9{"msg":"client task is sending Done(Finished)","v":0,"name":"crucible","level":40,"time":"2025-01-10T16:38:34.922863705Z","hostname":"w-01JH8H1N3KXZ9F8ZV6CCMP5KTQ","pid":1202,"":"io task","client":"1","":"downstairs","session_id":"1df3ca91-4dc9-42d6-9897-461254b5afe2"}
15430 , remote_addr: 127.0.0.1:55917, {"msg":"downstairs task for 1 stopped due to Finished","v":0,"name":"crucible","level":40,"time":"2025-01-10T16:38:34.922935938Z","hostname":"w-01JH8H1N3KXZ9F8ZV6CCMP5KTQ","pid":1202,"session_id":"1df3ca91-4dc9-42d6-9897-461254b5afe2"}
15431 local_addr:{"msg":"ds_transition from Active to Offline","v":0,"name":"crucible","level":30,"time":"2025-01-10T16:38:34.922966715Z","hostname":"w-01JH8H1N3KXZ9F8ZV6CCMP5KTQ","pid":1202,"client":"1","":"downstairs","session_id":"1df3ca91-4dc9-42d6-9897-461254b5afe2"}
15432 127.0.0.1:9998
154332025-01-10T16:38:34.922ZINFOcrucible: [1] Transition from Active to Offline = downstairs client = 1 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
154342025-01-10T16:38:34.923ZINFOcrucible: client task is exiting = io task client = 1 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
15435 [8820] Exited with: ExitStatus(unix_wait_status(9))
15436 [8820][1] reports Exit
15437 Jan 10 16:38:38.924 INFO request completed, latency_us: 203, response_code: 200, uri: /state/cid/1, method: GET, req_id: 66e2f008-2757-46ef-9eef-1e91237be039, remote_addr: 127.0.0.1:55917, local_addr: 127.0.0.1:9998
15438 001/300 Read block 4342 len 20480
15439 002/300 Write block 583 len 36864 data: 5 5 4 3 4 4 2 3 3
15440 003/300 Flush
15441 004/300 Flush
15442 005/300 Read block 4832 len 8192
15443 006/300 Write block 3785 len 4096 data: 4
15444 007/300 Read block 565 len 8192
15445 008/300 Write block 1265 len 36864 data: 3 3 3 3 3 2 2 2 3
15446 009/300 Read block 2540 len 32768
15447 010/300 Read block 288 len 8192
15448 011/300 Read block 1808 len 28672
15449 012/300 Read block 4196 len 36864
15450 013/300 Read block 2604 len 20480
15451 014/300 Read block 1792 len 12288
15452 015/300 Write block 2525 len 16384 data: 2 2 2 2
15453 016/300 Read block 1736 len 28672
15454 017/300 Write block 1675 len 40960 data: 4 3 3 3 3 5 5 5 5 5
15455 018/300 Read block 391 len 36864
15456 019/300 Flush
15457 020/300 Read block 3181 len 12288
15458 021/300 Read block 4706 len 36864
15459 022/300 Read block 3262 len 16384
15460 023/300 Write block 1773 len 4096 data: 2
15461 024/300 Read block 1358 len 12288
15462 025/300 Flush
15463 026/300 Flush
15464 027/300 Write block 780 len 32768 data: 3 3 3 3 2 2 4 4
15465 028/300 Read block 4018 len 12288
15466 029/300 Read block 2605 len 36864
15467 030/300 Read block 3932 len 32768
15468 031/300 Write block 3252 len 16384 data: 2 2 2 2
15469 032/300 Read block 3754 len 24576
15470 033/300 Read block 2535 len 24576
15471 034/300 Write block 2553 len 28672 data: 5 4 3 3 3 3 3
15472 035/300 Read block 804 len 32768
15473 036/300 Read block 148 len 20480
15474 037/300 Write block 1317 len 12288 data: 5 4 3
15475 038/300 Flush
15476 039/300 Write block 840 len 24576 data: 5 4 4 5 5 6
15477 040/300 Read block 404 len 20480
15478 041/300 Write block 1221 len 28672 data: 4 3 4 7 7 6 7
15479 042/300 Write block 4484 len 28672 data: 3 3 3 5 6 6 6
15480 043/300 Read block 3888 len 40960
15481 044/300 Read block 2495 len 28672
15482 045/300 Read block 3718 len 24576
15483 046/300 Read block 3850 len 12288
15484 047/300 Write block 3369 len 20480 data: 4 4 4 4 4
15485 048/300 Flush
15486 049/300 Read block 3024 len 40960
15487 050/300 Write block 2410 len 36864 data: 4 5 4 4 4 3 3 3 3
15488 051/300 Read block 1170 len 4096
15489 052/300 Read block 4354 len 16384
15490 053/300 Read block 2939 len 24576
15491 054/300 Read block 2165 len 12288
15492 055/300 Flush
15493 056/300 Read block 1326 len 20480
15494 057/300 Read block 1524 len 8192
15495 058/300 Write block 4568 len 4096 data: 5
15496 059/300 Write block 3953 len 16384 data: 2 2 2 2
15497 060/300 Read block 4496 len 4096
15498 061/300 Read block 1451 len 16384
15499 062/300 Read block 2908 len 8192
15500 063/300 Read block 3123 len 24576
15501 064/300 Read block 4899 len 24576
15502 065/300 Write block 4363 len 40960 data: 2 2 2 2 2 2 3 4 5 5
15503 066/300 Read block 886 len 4096
15504 067/300 Read block 4466 len 24576
15505 068/300 Write block 3224 len 12288 data: 4 4 5
15506 069/300 Write block 3237 len 16384 data: 2 2 3 3
15507 070/300 Write block 627 len 4096 data: 5
15508 071/300 Write block 4427 len 16384 data: 5 7 7 8
15509 072/300 Read block 577 len 12288
15510 073/300 Read block 2510 len 28672
15511 074/300 Write block 1747 len 36864 data: 4 5 4 5 4 4 4 3 3
15512 075/300 Read block 305 len 36864
15513 076/300 Write block 1051 len 24576 data: 2 2 2 2 2 3
15514 077/300 Write block 1478 len 24576 data: 3 4 4 4 5 5
15515 078/300 Write block 2850 len 36864 data: 3 3 2 2 2 2 2 2 2
15516 079/300 Write block 2134 len 12288 data: 7 6 4
15517 080/300 Write block 2941 len 4096 data: 5
15518 081/300 Write block 4984 len 28672 data: 4 4 6 6 5 5 4
15519 082/300 Write block 4162 len 28672 data: 6 5 5 7 7 6 6
15520 083/300 Read block 1156 len 16384
15521 084/300 Write block 4191 len 20480 data: 5 5 4 6 5
15522 085/300 Write block 485 len 28672 data: 4 4 4 3 3 4 4
15523 086/300 Read block 4398 len 12288
15524 087/300 Read block 100 len 36864
15525 088/300 Write block 782 len 12288 data: 4 4 3
15526 089/300 Read block 2552 len 28672
15527 090/300 Write block 2583 len 4096 data: 5
15528 091/300 Read block 4407 len 40960
15529 092/300 Read block 2718 len 40960
15530 093/300 Read block 1925 len 4096
15531 094/300 Read block 2219 len 20480
15532 095/300 Write block 2704 len 8192 data: 2 2
15533 096/300 Read block 886 len 4096
15534 097/300 Write block 2797 len 16384 data: 3 3 3 3
15535 098/300 Write block 2004 len 8192 data: 4 4
15536 099/300 Read block 3613 len 20480
15537 100/300 Write block 4551 len 32768 data: 4 6 7 7 7 8 6 5
15538 101/300 Read block 1547 len 24576
15539 102/300 Read block 1050 len 36864
15540 103/300 Write block 3787 len 28672 data: 3 2 2 3 3 4 5
15541 104/300 Read block 4105 len 4096
15542 105/300 Read block 240 len 24576
15543 106/300 Read block 3526 len 40960
15544 107/300 Read block 565 len 28672
15545 108/300 Write block 4396 len 24576 data: 5 5 5 5 5 3
15546 109/300 Flush
15547 110/300 Read block 681 len 32768
15548 111/300 Write block 3406 len 32768 data: 3 4 3 3 2 2 3 4
15549 112/300 Write block 734 len 40960 data: 5 4 3 3 3 3 2 2 2 2
15550 113/300 Write block 4148 len 16384 data: 6 6 5 5
15551 114/300 Write block 2549 len 12288 data: 3 3 4
15552 115/300 Write block 4088 len 24576 data: 4 4 5 5 5 5
15553 116/300 Read block 1392 len 36864
15554 117/300 Read block 3687 len 16384
15555 118/300 Flush
15556 119/300 Write block 4120 len 36864 data: 5 5 4 3 3 3 4 5 6
15557 120/300 Read block 1212 len 12288
15558 121/300 Read block 2940 len 16384
15559 122/300 Read block 1620 len 8192
15560 123/300 Read block 2913 len 32768
15561 124/300 Read block 4952 len 36864
15562 125/300 Write block 4150 len 20480 data: 6 6 6 6 7
15563 126/300 Write block 172 len 16384 data: 3 3 3 3
15564 127/300 Write block 2921 len 24576 data: 4 5 6 6 4 3
15565 128/300 Read block 3955 len 16384
15566 129/300 Read block 2933 len 24576
15567 130/300 Read block 1852 len 16384
15568 131/300 Read block 943 len 4096
15569 132/300 Write block 267 len 28672 data: 3 3 3 4 4 4 3
15570 133/300 Read block 2253 len 4096
15571 134/300 Read block 4694 len 32768
15572 135/300 Write block 2833 len 32768 data: 4 5 6 8 5 5 6 4
15573 136/300 Read block 762 len 32768
15574 137/300 Flush
15575 138/300 Read block 4341 len 12288
15576 139/300 Write block 1946 len 24576 data: 3 3 3 3 3 4
15577 140/300 Flush
15578 141/300 Write block 180 len 8192 data: 3 4
15579 142/300 Read block 502 len 32768
15580 143/300 Write block 1730 len 36864 data: 5 4 5 5 3 3 2 3 3
15581 144/300 Read block 441 len 36864
15582 145/300 Flush
15583 146/300 Read block 1266 len 8192
15584 147/300 Read block 4267 len 16384
15585 148/300 Read block 4424 len 36864
15586 149/300 Read block 2672 len 36864
15587 150/300 Read block 81 len 32768
15588 151/300 Read block 2317 len 32768
15589 152/300 Read block 1198 len 12288
15590 153/300 Flush
15591 154/300 Flush
15592 155/300 Read block 3361 len 16384
15593 156/300 Write block 2246 len 20480 data: 5 5 6 5 5
15594 157/300 Write block 1275 len 32768 data: 4 4 5 5 7 6 6 7
15595 158/300 Write block 2140 len 28672 data: 4 4 4 3 3 3 3
15596 159/300 Read block 4176 len 12288
15597 160/300 Write block 2691 len 4096 data: 3
15598 161/300 Read block 1812 len 40960
15599 162/300 Read block 2615 len 32768
15600 163/300 Write block 3619 len 36864 data: 2 3 3 2 2 2 3 2 2
15601 164/300 Write block 4757 len 12288 data: 3 3 3
15602 165/300 Read block 3153 len 36864
15603 166/300 Read block 1791 len 40960
15604 167/300 Write block 1231 len 8192 data: 7 3
15605 168/300 Write block 2286 len 16384 data: 3 2 3 4
15606 169/300 Read block 4464 len 20480
15607 170/300 Flush
15608 171/300 Read block 3898 len 12288
15609 172/300 Read block 2101 len 24576
15610 173/300 Write block 2604 len 20480 data: 4 4 2 3 3
15611 174/300 Read block 4078 len 28672
15612 175/300 Read block 1954 len 32768
15613 176/300 Write block 2950 len 36864 data: 4 5 6 5 6 6 4 4 3
15614 177/300 Read block 419 len 8192
15615 178/300 Write block 1103 len 32768 data: 2 2 2 2 3 3 4 4
15616 179/300 Read block 691 len 40960
15617 180/300 Write block 2111 len 12288 data: 2 2 2
15618 181/300 Read block 2919 len 40960
15619 182/300 Write block 3311 len 20480 data: 2 3 3 3 3
15620 183/300 Read block 4325 len 36864
15621 184/300 Read block 3624 len 4096
15622 185/300 Write block 3574 len 24576 data: 2 2 2 2 2 2
15623 186/300 Write block 1233 len 40960 data: 2 2 3 4 4 3 3 2 2 2
15624 187/300 Write block 1750 len 32768 data: 6 5 5 5 4 4 3 3
15625 188/300 Write block 192 len 16384 data: 2 4 4 5
15626 189/300 Write block 1727 len 4096 data: 4
15627 190/300 Write block 3806 len 16384 data: 2 2 2 2
15628 191/300 Read block 3135 len 20480
15629 192/300 Write block 1300 len 16384 data: 4 3 3 2
15630 193/300 Write block 4839 len 4096 data: 4
15631 194/300 Flush
15632 195/300 Write block 2561 len 8192 data: 3 2
15633 196/300 Read block 1167 len 8192
15634 197/300 Read block 975 len 40960
15635 198/300 Write block 1218 len 4096 data: 2
15636 199/300 Read block 3800 len 12288
15637 200/300 Flush
15638 201/300 Read block 4437 len 8192
15639 202/300 Flush
15640 203/300 Write block 2862 len 32768 data: 4 5 5 6 8 7 7 6
15641 204/300 Read block 4996 len 4096
15642 205/300 Write block 973 len 20480 data: 4 4 4 4 5
15643 206/300 Write block 717 len 16384 data: 3 2 2 2
15644 207/300 Read block 4237 len 4096
15645 208/300 Write block 2631 len 24576 data: 3 2 4 4 5 6
15646 209/300 Write block 4541 len 4096 data: 3
15647 210/300 Read block 2927 len 20480
15648 211/300 Read block 1001 len 16384
15649 212/300 Read block 4598 len 24576
15650 213/300 Read block 865 len 8192
15651 214/300 Write block 1317 len 28672 data: 6 5 4 7 6 5 6
15652 215/300 Flush
15653 216/300 Flush
15654 217/300 Flush
15655 218/300 Flush
15656 219/300 Read block 1896 len 12288
15657 220/300 Write block 1536 len 24576 data: 2 2 2 2 2 2
15658 221/300 Write block 603 len 16384 data: 6 6 7 7
15659 222/300 Write block 2012 len 4096 data: 2
15660 223/300 Read block 878 len 8192
15661 224/300 Read block 2521 len 12288
15662 225/300 Write block 3164 len 4096 data: 4
15663 226/300 Write block 4067 len 4096 data: 5
15664 227/300 Write block 3594 len 32768 data: 3 3 4 4 3 3 4 3
15665 228/300 Read block 4243 len 40960
15666 229/300 Read block 101 len 32768
15667 230/300 Read block 1739 len 32768
15668 231/300 Read block 4491 len 16384
15669 232/300 Read block 1144 len 8192
15670 233/300 Read block 3916 len 32768
15671 234/300 Read block 970 len 36864
15672 235/300 Read block 4461 len 4096
15673 236/300 Read block 65 len 20480
15674 237/300 Read block 4829 len 12288
15675 238/300 Read block 4723 len 36864
15676 239/300 Read block 134 len 32768
15677 240/300 Read block 1725 len 24576
15678 241/300 Read block 3401 len 12288
15679 242/300 Write block 889 len 20480 data: 3 2 2 2 2
15680 243/300 Read block 700 len 16384
15681 244/300 Read block 1514 len 24576
15682 245/300 Read block 4938 len 24576
15683 246/300 Flush
15684 247/300 Write block 4825 len 4096 data: 4
15685 248/300 Read block 1042 len 4096
15686 249/300 Read block 2284 len 24576
15687 250/300 Write block 2092 len 8192 data: 3 3
15688 251/300 Read block 3442 len 4096
15689 252/300 Write block 720 len 20480 data: 3 4 4 5 6
15690 253/300 Read block 743 len 24576
15691 254/300 Read block 3189 len 24576
15692 255/300 Write block 1411 len 12288 data: 4 4 4
15693 256/300 Read block 1634 len 36864
15694 257/300 Read block 3974 len 32768
15695 258/300 Read block 3883 len 36864
15696 259/300 Read block 3353 len 20480
15697 260/300 Write block 110 len 36864 data: 2 2 3 3 3 3 3 4 4
15698 261/300 Read block 1302 len 20480
15699 262/300 Flush
15700 263/300 Write block 1552 len 12288 data: 6 5 4
15701 264/300 Read block 2142 len 24576
15702 265/300 Write block 3382 len 12288 data: 7 7 9
15703 266/300 Write block 718 len 40960 data: 3 3 4 5 5 6 7 6 5 5
15704 267/300 Write block 1375 len 24576 data: 3 3 3 3 2 3
15705 268/300 Write block 4068 len 32768 data: 5 6 6 6 4 4 2 2
15706 269/300 Write block 1385 len 40960 data: 4 3 6 7 7 6 6 5 5 4
15707 270/300 Write block 2785 len 24576 data: 4 4 4 5 3 2
15708 271/300 Write block 4807 len 4096 data: 5
15709 272/300 Read block 1533 len 24576
15710 273/300 Read block 2254 len 32768
15711 274/300 Read block 564 len 8192
15712 275/300 Write block 1633 len 24576 data: 7 6 5 5 4 4
15713 276/300 Flush
15714 277/300 Write block 611 len 32768 data: 3 4 5 5 5 5 5 5
15715 278/300 Read block 2193 len 28672
15716 279/300 Write block 2302 len 24576 data: 2 2 3 3 4 5
15717 280/300 Read block 3041 len 4096
15718 281/300 Read block 50 len 40960
15719 282/300 Write block 925 len 16384 data: 4 3 3 4
15720 283/300 Read block 2113 len 24576
15721 284/300 Write block 2140 len 40960 data: 5 5 5 4 4 4 4 4 3 5
15722 285/300 Write block 3198 len 36864 data: 6 3 4 3 3 3 2 4 4
15723 286/300 Write block 2455 len 16384 data: 2 2 3 3
15724 287/300 Write block 592 len 12288 data: 3 2 2
15725 288/300 Read block 1358 len 16384
15726 289/300 Flush
15727 290/300 Flush
15728 291/300 Write block 3846 len 20480 data: 4 4 4 3 4
15729 292/300 Write block 909 len 4096 data: 3
15730 293/300 Read block 914 len 40960
15731 294/300 Read block 1750 len 36864
15732 295/300 Write block 4247 len 20480 data: 4 3 3 3 3
15733 296/300 Write block 304 len 28672 data: 3 3 3 3 3 4 5
15734 297/300 Write block 469 len 8192 data: 2 2
15735 298/300 Read block 974 len 24576
15736 299/300 Write block 546 len 40960 data: 3 3 3 4 4 2 2 2 2 2
15737 300/300 Flush
15738 301/300 Write block 3128 len 16384 data: 3 3 4 5
15739 Main task has work to do, go find it
15740 got dsc Start(1)
15741 start 1
15742 Jan 10 16:38:39.161 INFO request completed, latency_us: 239, response_code: 204, uri: /start/cid/1, method: POST, req_id: 1b6b8cfe-1edb-41fa-80b2-e2f6025211bc, remote_addr: 127.0.0.1:55917, local_addr: 127.0.0.1:9998
15743 Replay: started 1, returned:Ok(())
15744 ----------------------------------------------------------------
15745 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:301
15746 States: Active Offline Active
15747 JOBID ACK TYPE BKS/EXT DS:0 DS:1 DS:2 REPLAY
15748 4923 Acked Read 5 Done Sent Done false
15749 4924 Acked Write 9 Done Sent Done false
15750 4925 Acked Flush 0 Done Sent Done false
15751 4926 Acked Flush 0 Done Sent Done false
15752 4927 Acked Read 2 Done Sent Done false
15753 4928 Acked Write 1 Done Sent Done false
15754 4929 Acked Read 2 Done Sent Done false
15755 4930 Acked Write 9 Done Sent Done false
15756 4931 Acked Read 8 Done Sent Done false
15757 4932 Acked Read 2 Done Sent Done false
15758 4933 Acked Read 7 Done Sent Done false
15759 4934 Acked Read 9 Done Sent Done false
15760 4935 Acked Read 5 Done Sent Done false
15761 4936 Acked Read 3 Done Sent Done false
15762 4937 Acked Write 4 Done Sent Done false
15763 4938 Acked Read 7 Done Sent Done false
15764 4939 Acked Write 10 Done Sent Done false
15765 4940 Acked Read 9 Done Sent Done false
15766 4941 Acked Flush 0 Done Sent Done false
15767 4942 Acked Read 3 Done Sent Done false
15768 4943 Acked Read 9 Done Sent Done false
15769 4944 Acked Read 4 Done Sent Done false
15770 4945 Acked Write 1 Done Sent Done false
15771 4946 Acked Read 3 Done Sent Done false
15772 4947 Acked Flush 0 Done Sent Done false
15773 4948 Acked Flush 0 Done Sent Done false
15774 4949 Acked Write 8 Done Sent Done false
15775 4950 Acked Read 3 Done Sent Done false
15776 4951 Acked Read 9 Done Sent Done false
15777 4952 Acked Read 8 Done Sent Done false
15778 4953 Acked Write 4 Done Sent Done false
15779 4954 Acked Read 6 Done Sent Done false
15780 4955 Acked Read 6 Done Sent Done false
15781 4956 Acked Write 7 Done Sent Done false
15782 4957 Acked Read 8 Done Sent Done false
15783 4958 Acked Read 5 Done Sent Done false
15784 4959 Acked Write 3 Done Sent Done false
15785 4960 Acked Flush 0 Done Sent Done false
15786 4961 Acked Write 6 Done Sent Done false
15787 4962 Acked Read 5 Done Sent Done false
15788 4963 Acked Write 7 Done Sent Done false
15789 4964 Acked Write 7 Done Sent Done false
15790 4965 Acked Read 10 Done Sent Done false
15791 4966 Acked Read 7 Done Sent Done false
15792 4967 Acked Read 6 Done Sent Done false
15793 4968 Acked Read 3 Done Sent Done false
15794 4969 Acked Write 5 Done Sent Done false
15795 4970 Acked Flush 0 Done Sent Done false
15796 4971 Acked Read 10 Done Sent Done false
15797 4972 Acked Write 9 Done Sent Done false
15798 4973 Acked Read 1 Done Sent Done false
15799 4974 Acked Read 4 Done Sent Done false
15800 4975 Acked Read 6 Done Sent Done false
15801 4976 Acked Read 3 Done Sent Done false
15802 4977 Acked Flush 0 Done Sent Done false
15803 4978 Acked Read 5 Done Sent Done false
15804 4979 Acked Read 2 Done Sent Done false
15805 4980 Acked Write 1 Done Sent Done false
15806 4981 Acked Write 4 Done Sent Done false
15807 4982 Acked Read 1 Done Sent Done false
15808 4983 Acked Read 4 Done Sent Done false
15809 4984 Acked Read 2 Done Sent Done false
15810 4985 Acked Read 6 Done Sent Done false
15811 4986 Acked Read 6 Done Sent Done false
15812 4987 Acked Write 10 Done Sent Done false
15813 4988 Acked Read 1 Done Sent Done false
15814 4989 Acked Read 6 Done Sent Done false
15815 4990 Acked Write 3 Done Sent Done false
15816 4991 Acked Write 4 Done Sent Done false
15817 4992 Acked Write 1 Done Sent Done false
15818 4993 Acked Write 4 Done Sent Done false
15819 4994 Acked Read 3 Done Sent Done false
15820 4995 Acked Read 7 Done Sent Done false
15821 4996 Acked Write 9 Done Sent Done false
15822 4997 Acked Read 9 Done Sent Done false
15823 4998 Acked Write 6 Done Sent Done false
15824 4999 Acked Write 6 Done Sent Done false
15825 5000 Acked Write 9 Done Sent Done false
15826 5001 Acked Write 3 Done Sent Done false
15827 5002 Acked Write 1 Done Sent Done false
15828 5003 Acked Write 7 Done Sent Done false
15829 5004 Acked Write 7 Done Sent Done false
15830 5005 Acked Read 4 Done Sent Done false
15831 5006 Acked Write 5 Done Sent Done false
15832 5007 Acked Write 7 Done Sent Done false
15833 5008 Acked Read 3 Done Sent Done false
15834 5009 Acked Read 9 Done Sent Done false
15835 5010 Acked Write 3 Done Sent Done false
15836 5011 Acked Read 7 Done Sent Done false
15837 5012 Acked Write 1 Done Sent Done false
15838 5013 Acked Read 10 Done Sent Done false
15839 5014 Acked Read 10 Done Sent Done false
15840 5015 Acked Read 1 Done Sent Done false
15841 5016 Acked Read 5 Done Sent Done false
15842 5017 Acked Write 2 Done Sent Done false
15843 5018 Acked Read 1 Done Sent Done false
15844 5019 Acked Write 4 Done Sent Done false
15845 5020 Acked Write 2 Done Sent Done false
15846 5021 Acked Read 5 Done Sent Done false
15847 5022 Acked Write 8 Done Sent Done false
15848 5023 Acked Read 6 Done Sent Done false
15849 5024 Acked Read 9 Done Sent Done false
15850 5025 Acked Write 7 Done Sent Done false
15851 5026 Acked Read 1 Done Sent Done false
15852 5027 Acked Read 6 Done Sent Done false
15853 5028 Acked Read 10 Done Sent Done false
15854 5029 Acked Read 7 Done Sent Done false
15855 5030 Acked Write 6 Done Sent Done false
15856 5031 Acked Flush 0 Done Sent Done false
15857 5032 Acked Read 8 Done Sent Done false
15858 5033 Acked Write 8 Done Sent Done false
15859 5034 Acked Write 10 Done Sent Done false
15860 5035 Acked Write 4 Done Sent Done false
15861 5036 Acked Write 3 Done Sent Done false
15862 5037 Acked Write 6 Done Sent Done false
15863 5038 Acked Read 9 Done Sent Done false
15864 5039 Acked Read 4 Done Sent Done false
15865 5040 Acked Flush 0 Done Sent Done false
15866 5041 Acked Write 9 Done Sent Done false
15867 5042 Acked Read 3 Done Sent Done false
15868 5043 Acked Read 4 Done Sent Done false
15869 5044 Acked Read 2 Done Sent Done false
15870 5045 Acked Read 8 Done Sent Done false
15871 5046 Acked Read 9 Done Sent Done false
15872 5047 Acked Write 5 Done Sent Done false
15873 5048 Acked Write 4 Done Sent Done false
15874 5049 Acked Write 6 Done Sent Done false
15875 5050 Acked Read 4 Done Sent Done false
15876 5051 Acked Read 6 Done Sent Done false
15877 5052 Acked Read 4 Done Sent Done false
15878 5053 Acked Read 1 Done Sent Done false
15879 5054 Acked Write 7 Done Sent Done false
15880 5055 Acked Read 1 Done Sent Done false
15881 5056 Acked Read 8 Done Sent Done false
15882 5057 Acked Write 8 Done Sent Done false
15883 5058 Acked Read 8 Done Sent Done false
15884 5059 Acked Flush 0 Done Sent Done false
15885 5060 Acked Read 3 Done Sent Done false
15886 5061 Acked Write 6 Done Sent Done false
15887 5062 Acked Flush 0 Done Sent Done false
15888 5063 Acked Write 2 Done Sent Done false
15889 5064 Acked Read 8 Done Sent Done false
15890 5065 Acked Write 9 Done Sent Done false
15891 5066 Acked Read 9 Done Sent Done false
15892 5067 Acked Flush 0 Done Sent Done false
15893 5068 Acked Read 2 Done Sent Done false
15894 5069 Acked Read 4 Done Sent Done false
15895 5070 Acked Read 9 Done Sent Done false
15896 5071 Acked Read 9 Done Sent Done false
15897 5072 Acked Read 8 Done Sent Done false
15898 5073 Acked Read 8 Done Sent Done false
15899 5074 Acked Read 3 Done Sent Done false
15900 5075 Acked Flush 0 Done Sent Done false
15901 5076 Acked Flush 0 Done Sent Done false
15902 5077 Acked Read 4 Done Sent Done false
15903 5078 Acked Write 5 Done Sent Done false
15904 5079 Acked Write 8 Done Sent Done false
15905 5080 Acked Write 7 Done Sent Done false
15906 5081 Acked Read 3 Done Sent Done false
15907 5082 Acked Write 1 Done Sent Done false
15908 5083 Acked Read 10 Done Sent Done false
15909 5084 Acked Read 8 Done Sent Done false
15910 5085 Acked Write 9 Done Sent Done false
15911 5086 Acked Write 3 Done Sent Done false
15912 5087 Acked Read 9 Done Sent Done false
15913 5088 Acked Read 10 Done Sent Done false
15914 5089 Acked Write 2 Done Sent Done false
15915 5090 Acked Write 4 Done Sent Done false
15916 5091 Acked Read 5 Done Sent Done false
15917 5092 Acked Flush 0 Done Sent Done false
15918 5093 Acked Read 3 Done Sent Done false
15919 5094 Acked Read 6 Done Sent Done false
15920 5095 Acked Write 5 Done Sent Done false
15921 5096 Acked Read 7 Done Sent Done false
15922 5097 Acked Read 8 Done Sent Done false
15923 5098 Acked Write 9 Done Sent Done false
15924 5099 Acked Read 2 Done Sent Done false
15925 5100 Acked Write 8 Done Sent Done false
15926 5101 Acked Read 10 Done Sent Done false
15927 5102 Acked Write 3 Done Sent Done false
15928 5103 Acked Read 10 Done Sent Done false
15929 5104 Acked Write 5 Done Sent Done false
15930 5105 Acked Read 9 Done Sent Done false
15931 5106 Acked Read 1 Done Sent Done false
15932 5107 Acked Write 6 Done Sent Done false
15933 5108 Acked Write 10 Done Sent Done false
15934 5109 Acked Write 8 Done Sent Done false
15935 5110 Acked Write 4 Done Sent Done false
15936 5111 Acked Write 1 Done Sent Done false
15937 5112 Acked Write 4 Done Sent Done false
15938 5113 Acked Read 5 Done Sent Done false
15939 5114 Acked Write 4 Done Sent Done false
15940 5115 Acked Write 1 Done Sent Done false
15941 5116 Acked Flush 0 Done Sent Done false
15942 5117 Acked Write 2 Done Sent Done false
15943 5118 Acked Read 2 Done Sent Done false
15944 5119 Acked Read 10 Done Sent Done false
15945 5120 Acked Write 1 Done Sent Done false
15946 5121 Acked Read 3 Done Sent Done false
15947 5122 Acked Flush 0 Done Sent Done false
15948 5123 Acked Read 2 Done Sent Done false
15949 5124 Acked Flush 0 Done Sent Done false
15950 5125 Acked Write 8 Done Sent Done false
15951 5126 Acked Read 1 Done Sent Done false
15952 5127 Acked Write 5 Done Sent Done false
15953 5128 Acked Write 4 Done Sent Done false
15954 5129 Acked Read 1 Done Sent Done false
15955 5130 Acked Write 6 Done Sent Done false
15956 5131 Acked Write 1 Done Sent Done false
15957 5132 Acked Read 5 Done Sent Done false
15958 5133 Acked Read 4 Done Sent Done false
15959 5134 Acked Read 6 Done Sent Done false
15960 5135 Acked Read 2 Done Sent Done false
15961 5136 Acked Write 7 Done Sent Done false
15962 5137 Acked Flush 0 Done Sent Done false
15963 5138 Acked Flush 0 Done Sent Done false
15964 5139 Acked Flush 0 Done Sent Done false
15965 5140 Acked Flush 0 Done Sent Done false
15966 5141 Acked Read 3 Done Sent Done false
15967 5142 Acked Write 6 Done Sent Done false
15968 5143 Acked Write 4 Done Sent Done false
15969 5144 Acked Write 1 Done Sent Done false
15970 5145 Acked Read 2 Done Sent Done false
15971 5146 Acked Read 3 Done Sent Done false
15972 5147 Acked Write 1 Done Sent Done false
15973 5148 Acked Write 1 Done Sent Done false
15974 5149 Acked Write 8 Done Sent Done false
15975 5150 Acked Read 10 Done Sent Done false
15976 5151 Acked Read 8 Done Sent Done false
15977 5152 Acked Read 8 Done Sent Done false
15978 5153 Acked Read 4 Done Sent Done false
15979 5154 Acked Read 2 Done Sent Done false
15980 5155 Acked Read 8 Done Sent Done false
15981 5156 Acked Read 9 Done Sent Done false
15982 5157 Acked Read 1 Done Sent Done false
15983 5158 Acked Read 5 Done Sent Done false
15984 5159 Acked Read 3 Done Sent Done false
15985 5160 Acked Read 9 Done Sent Done false
15986 5161 Acked Read 8 Done Sent Done false
15987 5162 Acked Read 6 Done Sent Done false
15988 5163 Acked Read 3 Done Sent Done false
15989 5164 Acked Write 5 Done Sent Done false
15990 5165 Acked Read 4 Done Sent Done false
15991 5166 Acked Read 6 Done Sent Done false
15992 5167 Acked Read 6 Done Sent Done false
15993 5168 Acked Flush 0 Done Sent Done false
15994 5169 Acked Write 1 Done Sent Done false
15995 5170 Acked Read 1 Done Sent Done false
15996 5171 Acked Read 6 Done Sent Done false
15997 5172 Acked Write 2 Done Sent Done false
15998 5173 Acked Read 1 Done Sent Done false
15999 5174 Acked Write 5 Done Sent Done false
16000 5175 Acked Read 6 Done Sent Done false
16001 5176 Acked Read 6 Done Sent Done false
16002 5177 Acked Write 3 Done Sent Done false
16003 5178 Acked Read 9 Done Sent Done false
16004 5179 Acked Read 8 Done Sent Done false
16005 5180 Acked Read 9 Done Sent Done false
16006 5181 Acked Read 5 Done Sent Done false
16007 5182 Acked Write 9 Done Sent Done false
16008 5183 Acked Read 5 Done Sent Done false
16009 5184 Acked Flush 0 Done Sent Done false
16010 5185 Acked Write 3 Done Sent Done false
16011 5186 Acked Read 6 Done Sent Done false
16012 5187 Acked Write 3 Done Sent Done false
16013 5188 Acked Write 10 Done Sent Done false
16014 5189 Acked Write 6 Done Sent Done false
16015 5190 Acked Write 8 Done Sent Done false
16016 5191 Acked Write 10 Done Sent Done false
16017 5192 Acked Write 6 Done Sent Done false
16018 5193 Acked Write 1 Done Sent Done false
16019 5194 Acked Read 6 Done Sent Done false
16020 5195 Acked Read 8 Done Sent Done false
16021 5196 Acked Read 2 Done Sent Done false
16022 5197 Acked Write 6 Done Sent Done false
16023 5198 Acked Flush 0 Done Sent Done false
16024 5199 Acked Write 8 Done Sent Done false
16025 5200 Acked Read 7 Done Sent Done false
16026 5201 Acked Write 6 Done Sent Done false
16027 5202 Acked Read 1 Done Sent Done false
16028 5203 Acked Read 10 Done Sent Done false
16029 5204 Acked Write 4 Done Sent Done false
16030 5205 Acked Read 6 Done Sent Done false
16031 5206 Acked Write 10 Done Sent Done false
16032 5207 Acked Write 9 Done Sent Done false
16033 5208 Acked Write 4 Done Sent Done false
16034 5209 Acked Write 3 Done Sent Done false
16035 5210 Acked Read 4 Done Sent Done false
16036 5211 Acked Flush 0 Done Sent Done false
16037 5212 Acked Flush 0 Done Sent Done false
16038 5213 Acked Write 5 Done Sent Done false
16039 5214 Acked Write 1 Done Sent Done false
16040 5215 Acked Read 10 Done Sent Done false
16041 5216 Acked Read 9 Done Sent Done false
16042 5217 Acked Write 5 Done Sent Done false
16043 5218 Acked Write 7 Done Sent Done false
16044 5219 Acked Write 2 Done Sent Done false
16045 5220 Acked Read 6 Done Sent Done false
16046 5221 Acked Write 10 Done Sent Done false
16047 5222 Acked Flush 0 Done Sent Done false
16048 5223 Acked Write 4 Done Sent Done false
16049 STATES DS:0 DS:1 DS:2 TOTAL
16050 Sent 0 301 0 301
16051 Done 301 0 301 602
16052 Skipped 0 0 0 0
16053 Error 0 0 0 0
16054 Last Flush: 5222 4922 5222
16055 Downstairs last five completed: 4922 4921 4920 4919 4918
16056 Upstairs last five completed: 5223 5222 5221 5220 5219
16057 CLIENT: Up:0 ds:301 act:2
16058 [8820] got start action
16059 [8820] I am going to restart
16060 Starting downstairs at port 8820
16061 Make output file at "/tmp/dsc/downstairs-8820.txt"
16062 [8820][1] reports Starting
16063 Downstairs /var/tmp/dsc/region/8820 port 8820 PID:Some(1216)
16064 [8820][1] reports Running
16065 ----------------------------------------------------------------
16066 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:302
16067 States: Active Offline Active
16068 JOBID ACK TYPE BKS/EXT DS:0 DS:1 DS:2 REPLAY
16069 4923 Acked Read 5 Done Sent Done false
16070 4924 Acked Write 9 Done Sent Done false
16071 4925 Acked Flush 0 Done Sent Done false
16072 4926 Acked Flush 0 Done Sent Done false
16073 4927 Acked Read 2 Done Sent Done false
16074 4928 Acked Write 1 Done Sent Done false
16075 4929 Acked Read 2 Done Sent Done false
16076 4930 Acked Write 9 Done Sent Done false
16077 4931 Acked Read 8 Done Sent Done false
16078 4932 Acked Read 2 Done Sent Done false
16079 4933 Acked Read 7 Done Sent Done false
16080 4934 Acked Read 9 Done Sent Done false
16081 4935 Acked Read 5 Done Sent Done false
16082 4936 Acked Read 3 Done Sent Done false
16083 4937 Acked Write 4 Done Sent Done false
16084 4938 Acked Read 7 Done Sent Done false
16085 4939 Acked Write 10 Done Sent Done false
16086 4940 Acked Read 9 Done Sent Done false
16087 4941 Acked Flush 0 Done Sent Done false
16088 4942 Acked Read 3 Done Sent Done false
16089 4943 Acked Read 9 Done Sent Done false
16090 4944 Acked Read 4 Done Sent Done false
16091 4945 Acked Write 1 Done Sent Done false
16092 4946 Acked Read 3 Done Sent Done false
16093 4947 Acked Flush 0 Done Sent Done false
16094 4948 Acked Flush 0 Done Sent Done false
16095 4949 Acked Write 8 Done Sent Done false
16096 4950 Acked Read 3 Done Sent Done false
16097 4951 Acked Read 9 Done Sent Done false
16098 4952 Acked Read 8 Done Sent Done false
16099 4953 Acked Write 4 Done Sent Done false
16100 4954 Acked Read 6 Done Sent Done false
16101 4955 Acked Read 6 Done Sent Done false
16102 4956 Acked Write 7 Done Sent Done false
16103 4957 Acked Read 8 Done Sent Done false
16104 4958 Acked Read 5 Done Sent Done false
16105 4959 Acked Write 3 Done Sent Done false
16106 4960 Acked Flush 0 Done Sent Done false
16107 4961 Acked Write 6 Done Sent Done false
16108 4962 Acked Read 5 Done Sent Done false
16109 4963 Acked Write 7 Done Sent Done false
16110 4964 Acked Write 7 Done Sent Done false
16111 4965 Acked Read 10 Done Sent Done false
16112 4966 Acked Read 7 Done Sent Done false
16113 4967 Acked Read 6 Done Sent Done false
16114 4968 Acked Read 3 Done Sent Done false
16115 4969 Acked Write 5 Done Sent Done false
16116 4970 Acked Flush 0 Done Sent Done false
16117 4971 Acked Read 10 Done Sent Done false
16118 4972 Acked Write 9 Done Sent Done false
16119 4973 Acked Read 1 Done Sent Done false
16120 4974 Acked Read 4 Done Sent Done false
16121 4975 Acked Read 6 Done Sent Done false
16122 4976 Acked Read 3 Done Sent Done false
16123 4977 Acked Flush 0 Done Sent Done false
16124 4978 Acked Read 5 Done Sent Done false
16125 4979 Acked Read 2 Done Sent Done false
16126 4980 Acked Write 1 Done Sent Done false
16127 4981 Acked Write 4 Done Sent Done false
16128 4982 Acked Read 1 Done Sent Done false
16129 4983 Acked Read 4 Done Sent Done false
16130 4984 Acked Read 2 Done Sent Done false
16131 4985 Acked Read 6 Done Sent Done false
16132 4986 Acked Read 6 Done Sent Done false
16133 4987 Acked Write 10 Done Sent Done false
16134 4988 Acked Read 1 Done Sent Done false
16135 4989 Acked Read 6 Done Sent Done false
16136 4990 Acked Write 3 Done Sent Done false
16137 4991 Acked Write 4 Done Sent Done false
16138 4992 Acked Write 1 Done Sent Done false
16139 4993 Acked Write 4 Done Sent Done false
16140 4994 Acked Read 3 Done Sent Done false
16141 4995 Acked Read 7 Done Sent Done false
16142 4996 Acked Write 9 Done Sent Done false
16143 4997 Acked Read 9 Done Sent Done false
16144 4998 Acked Write 6 Done Sent Done false
16145 4999 Acked Write 6 Done Sent Done false
16146 5000 Acked Write 9 Done Sent Done false
16147 5001 Acked Write 3 Done Sent Done false
16148 5002 Acked Write 1 Done Sent Done false
16149 5003 Acked Write 7 Done Sent Done false
16150 5004 Acked Write 7 Done Sent Done false
16151 5005 Acked Read 4 Done Sent Done false
16152 5006 Acked Write 5 Done Sent Done false
16153 5007 Acked Write 7 Done Sent Done false
16154 5008 Acked Read 3 Done Sent Done false
16155 5009 Acked Read 9 Done Sent Done false
16156 5010 Acked Write 3 Done Sent Done false
16157 5011 Acked Read 7 Done Sent Done false
16158 5012 Acked Write 1 Done Sent Done false
16159 5013 Acked Read 10 Done Sent Done false
16160 5014 Acked Read 10 Done Sent Done false
16161 5015 Acked Read 1 Done Sent Done false
16162 5016 Acked Read 5 Done Sent Done false
16163 5017 Acked Write 2 Done Sent Done false
16164 5018 Acked Read 1 Done Sent Done false
16165 5019 Acked Write 4 Done Sent Done false
16166 5020 Acked Write 2 Done Sent Done false
16167 5021 Acked Read 5 Done Sent Done false
16168 5022 Acked Write 8 Done Sent Done false
16169 5023 Acked Read 6 Done Sent Done false
16170 5024 Acked Read 9 Done Sent Done false
16171 5025 Acked Write 7 Done Sent Done false
16172 5026 Acked Read 1 Done Sent Done false
16173 5027 Acked Read 6 Done Sent Done false
16174 5028 Acked Read 10 Done Sent Done false
16175 5029 Acked Read 7 Done Sent Done false
16176 5030 Acked Write 6 Done Sent Done false
16177 5031 Acked Flush 0 Done Sent Done false
16178 5032 Acked Read 8 Done Sent Done false
16179 5033 Acked Write 8 Done Sent Done false
16180 5034 Acked Write 10 Done Sent Done false
16181 5035 Acked Write 4 Done Sent Done false
16182 5036 Acked Write 3 Done Sent Done false
16183 5037 Acked Write 6 Done Sent Done false
16184 5038 Acked Read 9 Done Sent Done false
16185 5039 Acked Read 4 Done Sent Done false
16186 5040 Acked Flush 0 Done Sent Done false
16187 5041 Acked Write 9 Done Sent Done false
16188 5042 Acked Read 3 Done Sent Done false
16189 5043 Acked Read 4 Done Sent Done false
16190 5044 Acked Read 2 Done Sent Done false
16191 5045 Acked Read 8 Done Sent Done false
16192 5046 Acked Read 9 Done Sent Done false
16193 5047 Acked Write 5 Done Sent Done false
16194 5048 Acked Write 4 Done Sent Done false
16195 5049 Acked Write 6 Done Sent Done false
16196 5050 Acked Read 4 Done Sent Done false
16197 5051 Acked Read 6 Done Sent Done false
16198 5052 Acked Read 4 Done Sent Done false
16199 5053 Acked Read 1 Done Sent Done false
16200 5054 Acked Write 7 Done Sent Done false
16201 5055 Acked Read 1 Done Sent Done false
16202 5056 Acked Read 8 Done Sent Done false
16203 5057 Acked Write 8 Done Sent Done false
16204 5058 Acked Read 8 Done Sent Done false
16205 5059 Acked Flush 0 Done Sent Done false
16206 5060 Acked Read 3 Done Sent Done false
16207 5061 Acked Write 6 Done Sent Done false
16208 5062 Acked Flush 0 Done Sent Done false
16209 5063 Acked Write 2 Done Sent Done false
16210 5064 Acked Read 8 Done Sent Done false
16211 5065 Acked Write 9 Done Sent Done false
16212 5066 Acked Read 9 Done Sent Done false
16213 5067 Acked Flush 0 Done Sent Done false
16214 5068 Acked Read 2 Done Sent Done false
16215 5069 Acked Read 4 Done Sent Done false
16216 5070 Acked Read 9 Done Sent Done false
16217 5071 Acked Read 9 Done Sent Done false
16218 5072 Acked Read 8 Done Sent Done false
16219 5073 Acked Read 8 Done Sent Done false
16220 5074 Acked Read 3 Done Sent Done false
16221 5075 Acked Flush 0 Done Sent Done false
16222 5076 Acked Flush 0 Done Sent Done false
16223 5077 Acked Read 4 Done Sent Done false
16224 5078 Acked Write 5 Done Sent Done false
16225 5079 Acked Write 8 Done Sent Done false
16226 5080 Acked Write 7 Done Sent Done false
16227 5081 Acked Read 3 Done Sent Done false
16228 5082 Acked Write 1 Done Sent Done false
16229 5083 Acked Read 10 Done Sent Done false
16230 5084 Acked Read 8 Done Sent Done false
16231 5085 Acked Write 9 Done Sent Done false
16232 5086 Acked Write 3 Done Sent Done false
16233 5087 Acked Read 9 Done Sent Done false
16234 5088 Acked Read 10 Done Sent Done false
16235 5089 Acked Write 2 Done Sent Done false
16236 5090 Acked Write 4 Done Sent Done false
16237 5091 Acked Read 5 Done Sent Done false
16238 5092 Acked Flush 0 Done Sent Done false
16239 5093 Acked Read 3 Done Sent Done false
16240 5094 Acked Read 6 Done Sent Done false
16241 5095 Acked Write 5 Done Sent Done false
16242 5096 Acked Read 7 Done Sent Done false
16243 5097 Acked Read 8 Done Sent Done false
16244 5098 Acked Write 9 Done Sent Done false
16245 5099 Acked Read 2 Done Sent Done false
16246 5100 Acked Write 8 Done Sent Done false
16247 5101 Acked Read 10 Done Sent Done false
16248 5102 Acked Write 3 Done Sent Done false
16249 5103 Acked Read 10 Done Sent Done false
16250 5104 Acked Write 5 Done Sent Done false
16251 5105 Acked Read 9 Done Sent Done false
16252 5106 Acked Read 1 Done Sent Done false
16253 5107 Acked Write 6 Done Sent Done false
16254 5108 Acked Write 10 Done Sent Done false
16255 5109 Acked Write 8 Done Sent Done false
16256 5110 Acked Write 4 Done Sent Done false
16257 5111 Acked Write 1 Done Sent Done false
16258 5112 Acked Write 4 Done Sent Done false
16259 5113 Acked Read 5 Done Sent Done false
16260 5114 Acked Write 4 Done Sent Done false
16261 5115 Acked Write 1 Done Sent Done false
16262 5116 Acked Flush 0 Done Sent Done false
16263 5117 Acked Write 2 Done Sent Done false
16264 5118 Acked Read 2 Done Sent Done false
16265 5119 Acked Read 10 Done Sent Done false
16266 5120 Acked Write 1 Done Sent Done false
16267 5121 Acked Read 3 Done Sent Done false
16268 5122 Acked Flush 0 Done Sent Done false
16269 5123 Acked Read 2 Done Sent Done false
16270 5124 Acked Flush 0 Done Sent Done false
16271 5125 Acked Write 8 Done Sent Done false
16272 5126 Acked Read 1 Done Sent Done false
16273 5127 Acked Write 5 Done Sent Done false
16274 5128 Acked Write 4 Done Sent Done false
16275 5129 Acked Read 1 Done Sent Done false
16276 5130 Acked Write 6 Done Sent Done false
16277 5131 Acked Write 1 Done Sent Done false
16278 5132 Acked Read 5 Done Sent Done false
16279 5133 Acked Read 4 Done Sent Done false
16280 5134 Acked Read 6 Done Sent Done false
16281 5135 Acked Read 2 Done Sent Done false
16282 5136 Acked Write 7 Done Sent Done false
16283 5137 Acked Flush 0 Done Sent Done false
16284 5138 Acked Flush 0 Done Sent Done false
16285 5139 Acked Flush 0 Done Sent Done false
16286 5140 Acked Flush 0 Done Sent Done false
16287 5141 Acked Read 3 Done Sent Done false
16288 5142 Acked Write 6 Done Sent Done false
16289 5143 Acked Write 4 Done Sent Done false
16290 5144 Acked Write 1 Done Sent Done false
16291 5145 Acked Read 2 Done Sent Done false
16292 5146 Acked Read 3 Done Sent Done false
16293 5147 Acked Write 1 Done Sent Done false
16294 5148 Acked Write 1 Done Sent Done false
16295 5149 Acked Write 8 Done Sent Done false
16296 5150 Acked Read 10 Done Sent Done false
16297 5151 Acked Read 8 Done Sent Done false
16298 5152 Acked Read 8 Done Sent Done false
16299 5153 Acked Read 4 Done Sent Done false
16300 5154 Acked Read 2 Done Sent Done false
16301 5155 Acked Read 8 Done Sent Done false
16302 5156 Acked Read 9 Done Sent Done false
16303 5157 Acked Read 1 Done Sent Done false
16304 5158 Acked Read 5 Done Sent Done false
16305 5159 Acked Read 3 Done Sent Done false
16306 5160 Acked Read 9 Done Sent Done false
16307 5161 Acked Read 8 Done Sent Done false
16308 5162 Acked Read 6 Done Sent Done false
16309 5163 Acked Read 3 Done Sent Done false
16310 5164 Acked Write 5 Done Sent Done false
16311 5165 Acked Read 4 Done Sent Done false
16312 5166 Acked Read 6 Done Sent Done false
16313 5167 Acked Read 6 Done Sent Done false
16314 5168 Acked Flush 0 Done Sent Done false
16315 5169 Acked Write 1 Done Sent Done false
16316 5170 Acked Read 1 Done Sent Done false
16317 5171 Acked Read 6 Done Sent Done false
16318 5172 Acked Write 2 Done Sent Done false
16319 5173 Acked Read 1 Done Sent Done false
16320 5174 Acked Write 5 Done Sent Done false
16321 5175 Acked Read 6 Done Sent Done false
16322 5176 Acked Read 6 Done Sent Done false
16323 5177 Acked Write 3 Done Sent Done false
16324 5178 Acked Read 9 Done Sent Done false
16325 5179 Acked Read 8 Done Sent Done false
16326 5180 Acked Read 9 Done Sent Done false
16327 5181 Acked Read 5 Done Sent Done false
16328 5182 Acked Write 9 Done Sent Done false
16329 5183 Acked Read 5 Done Sent Done false
16330 5184 Acked Flush 0 Done Sent Done false
16331 5185 Acked Write 3 Done Sent Done false
16332 5186 Acked Read 6 Done Sent Done false
16333 5187 Acked Write 3 Done Sent Done false
16334 5188 Acked Write 10 Done Sent Done false
16335 5189 Acked Write 6 Done Sent Done false
16336 5190 Acked Write 8 Done Sent Done false
16337 5191 Acked Write 10 Done Sent Done false
16338 5192 Acked Write 6 Done Sent Done false
16339 5193 Acked Write 1 Done Sent Done false
16340 5194 Acked Read 6 Done Sent Done false
16341 5195 Acked Read 8 Done Sent Done false
16342 5196 Acked Read 2 Done Sent Done false
16343 5197 Acked Write 6 Done Sent Done false
16344 5198 Acked Flush 0 Done Sent Done false
16345 5199 Acked Write 8 Done Sent Done false
16346 5200 Acked Read 7 Done Sent Done false
16347 5201 Acked Write 6 Done Sent Done false
16348 5202 Acked Read 1 Done Sent Done false
16349 5203 Acked Read 10 Done Sent Done false
16350 5204 Acked Write 4 Done Sent Done false
16351 5205 Acked Read 6 Done Sent Done false
16352 5206 Acked Write 10 Done Sent Done false
16353 5207 Acked Write 9 Done Sent Done false
16354 5208 Acked Write 4 Done Sent Done false
16355 5209 Acked Write 3 Done Sent Done false
16356 5210 Acked Read 4 Done Sent Done false
16357 5211 Acked Flush 0 Done Sent Done false
16358 5212 Acked Flush 0 Done Sent Done false
16359 5213 Acked Write 5 Done Sent Done false
16360 5214 Acked Write 1 Done Sent Done false
16361 5215 Acked Read 10 Done Sent Done false
16362 5216 Acked Read 9 Done Sent Done false
16363 5217 Acked Write 5 Done Sent Done false
16364 5218 Acked Write 7 Done Sent Done false
16365 5219 Acked Write 2 Done Sent Done false
16366 5220 Acked Read 6 Done Sent Done false
16367 5221 Acked Write 10 Done Sent Done false
16368 5222 Acked Flush 0 Done Sent Done false
16369 5223 Acked Write 4 Done Sent Done false
16370 5224 Acked Flush 0 Done Sent Done false
16371 STATES DS:0 DS:1 DS:2 TOTAL
16372 Sent 0 302 0 302
16373 Done 302 0 302 604
16374 Skipped 0 0 0 0
16375 Error 0 0 0 0
16376 Last Flush: 5224 4922 5224
16377 Downstairs last five completed: 4922 4921 4920 4919 4918
16378 Upstairs last five completed: 5224 5223 5222 5221 5220
16379 CLIENT: Up:0 ds:302 act:2
163802025-01-10T16:38:44.924ZINFOcrucible: connecting to 127.0.0.1:8820 = io task client = 1 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
163812025-01-10T16:38:44.924ZINFOcrucible: ds_connection connected from Ok(127.0.0.1:41753) = io task client = 1 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
163822025-01-10T16:38:44.925ZWARNcrucible: version negotiation from state Offline = downstairs client = 1 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
163832025-01-10T16:38:44.925ZINFOcrucible: downstairs client at Some(127.0.0.1:8820) has region UUID 12345678-0000-0000-0000-000000008820 = downstairs client = 1 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
163842025-01-10T16:38:44.925ZINFOcrucible: Returning UUID:12345678-0000-0000-0000-000000008820 matches = downstairs client = 1 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
163852025-01-10T16:38:44.925ZINFOcrucible: send last flush ID to this DS: 4922 = downstairs client = 1 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
163862025-01-10T16:38:44.925ZINFOcrucible: Replied this last flush ID: 4922 = downstairs client = 1 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
163872025-01-10T16:38:44.925ZINFOcrucible: ds_transition from Offline to Active = downstairs client = 1 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
163882025-01-10T16:38:44.925ZINFOcrucible: [1] Transition from Offline to Active = downstairs client = 1 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
163892025-01-10T16:38:44.926ZINFOcrucible: [1] client re-new 302 jobs since flush 4922 = downstairs session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
163902025-01-10T16:38:44.926ZINFOcrucible: [1] Replayed 302 jobs since flush: 4922 = downstairs session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
16391 ----------------------------------------------------------------
16392 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:0
16393 Downstairs last five completed: 5224 5223 5222 5221 5220
16394 Upstairs last five completed: 5224 5223 5222 5221 5220
16395 CLIENT: Up:0 ds:0 act:3
16396 Replay: All jobs finished
16397 Main task has work to do, go find it
16398 got dsc Stop(0)
16399 stop 0
16400 [8810] Got stop action so:false kr:false
16401 Jan 10 16:38:47.168 INFO request completed, latency_us: 327, response_code: 204, uri: /stop/cid/0, method: POST, req_id: 3da97d36-44e6-4a33-9a94-dc49398684fa, remote_addr: 127.0.0.1:55917, local_addr: 127.0.0.1:9998
164022025-01-10T16:38:47.168ZWARNcrucible: downstairs disconnected = io task client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
164032025-01-10T16:38:47.168ZWARNcrucible: client task is sending Done(Finished) = io task client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
16404 Jan 10 16:38:47.168{"msg":"downstairs task for 0 stopped due to Finished","v":0,"name":"crucible","level":40,"time":"2025-01-10T16:38:47.168853625Z","hostname":"w-01JH8H1N3KXZ9F8ZV6CCMP5KTQ","pid":1202,"session_id":"1df3ca91-4dc9-42d6-9897-461254b5afe2"}
16405 INFO request completed, latency_us: 94, response_code: 200, uri: /state/cid/0, method{"msg":"ds_transition from Active to Offline","v":0,"name":"crucible","level":30,"time":"2025-01-10T16:38:47.168874243Z","hostname":"w-01JH8H1N3KXZ9F8ZV6CCMP5KTQ","pid":1202,"client":"0","":"downstairs","session_id":"1df3ca91-4dc9-42d6-9897-461254b5afe2"}
16406 : GET, req_id: 319271b5-67e4-41e8-97dd-da9f2491c913, remote_addr: 127.0.{"msg":"[0] Transition from Active to Offline","v":0,"name":"crucible","level":30,"time":"2025-01-10T16:38:47.168888352Z","hostname":"w-01JH8H1N3KXZ9F8ZV6CCMP5KTQ","pid":1202,"client":"0","":"downstairs","session_id":"1df3ca91-4dc9-42d6-9897-461254b5afe2"}
16407 0.1:55917, local_addr: 127.0.0.1:9998
164082025-01-10T16:38:47.168ZINFOcrucible: client task is exiting = io task client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
16409 [8810] Exited with: ExitStatus(unix_wait_status(9))
16410 [8810][0] reports Exit
16411 Jan 10 16:38:51.170 INFO request completed, latency_us: 208, response_code: 200, uri: /state/cid/0, method: GET, req_id: 9f5d33d5-da6f-4fa0-830e-e1943ab281e3, remote_addr: 127.0.0.1:55917, local_addr: 127.0.0.1:9998
16412 001/300 Read block 3171 len 4096
16413 002/300 Read block 1972 len 12288
16414 003/300 Read block 145 len 24576
16415 004/300 Read block 4204 len 28672
16416 005/300 Read block 1739 len 36864
16417 006/300 Read block 949 len 24576
16418 007/300 Write block 196 len 28672 data: 5 5 5 5 5 5 6
16419 008/300 Write block 1995 len 32768 data: 6 6 5 5 4 5 4 3
16420 009/300 Write block 2507 len 32768 data: 5 5 6 6 6 7 7 5
16421 010/300 Write block 1953 len 16384 data: 2 2 2 2
16422 011/300 Flush
16423 012/300 Read block 2888 len 36864
16424 013/300 Read block 1303 len 4096
16425 014/300 Write block 2418 len 36864 data: 4 2 3 3 3 3 3 2 3
16426 015/300 Flush
16427 016/300 Read block 312 len 12288
16428 017/300 Read block 2977 len 28672
16429 018/300 Read block 4378 len 20480
16430 019/300 Read block 750 len 24576
16431 020/300 Write block 3210 len 28672 data: 3 3 4 6 6 5 4
16432 021/300 Write block 488 len 28672 data: 4 4 5 5 4 4 5
16433 022/300 Read block 1450 len 16384
16434 023/300 Read block 4491 len 16384
16435 024/300 Read block 4599 len 40960
16436 025/300 Write block 4941 len 16384 data: 3 4 4 5
16437 026/300 Write block 3493 len 4096 data: 3
16438 027/300 Read block 4835 len 32768
16439 028/300 Read block 919 len 16384
16440 029/300 Read block 3813 len 28672
16441 030/300 Read block 2122 len 40960
16442 031/300 Write block 4668 len 12288 data: 3 4 3
16443 032/300 Write block 3702 len 32768 data: 3 3 2 2 2 2 4 5
16444 033/300 Read block 1943 len 8192
16445 034/300 Write block 4508 len 40960 data: 2 2 2 3 4 4 4 4 4 3
16446 035/300 Write block 437 len 4096 data: 2
16447 036/300 Write block 4132 len 12288 data: 4 3 4
16448 037/300 Write block 2074 len 16384 data: 3 3 3 3
16449 038/300 Write block 4455 len 28672 data: 2 2 2 2 2 2 2
16450 039/300 Write block 292 len 16384 data: 2 3 3 3
16451 040/300 Read block 84 len 4096
16452 041/300 Write block 909 len 8192 data: 4 4
16453 042/300 Read block 4655 len 16384
16454 043/300 Read block 809 len 40960
16455 044/300 Read block 1131 len 28672
16456 045/300 Write block 4653 len 4096 data: 3
16457 046/300 Flush
16458 047/300 Read block 1054 len 36864
16459 048/300 Write block 2053 len 8192 data: 7 7
16460 049/300 Read block 1785 len 16384
16461 050/300 Read block 2771 len 20480
16462 051/300 Write block 1969 len 24576 data: 2 2 2 2 3 3
16463 052/300 Write block 3782 len 40960 data: 2 3 3 5 4 4 3 3 4 4
16464 053/300 Flush
16465 054/300 Write block 2719 len 8192 data: 3 3
16466 055/300 Write block 4073 len 24576 data: 5 3 3 2 2 3
16467 056/300 Read block 1226 len 4096
16468 057/300 Write block 4361 len 36864 data: 3 3 3 3 3 3 3 3 4
16469 058/300 Write block 1692 len 12288 data: 4 4 4
16470 059/300 Write block 4484 len 32768 data: 4 4 4 6 7 7 7 5
16471 060/300 Flush
16472 061/300 Write block 1991 len 12288 data: 5 5 5
16473 062/300 Read block 760 len 40960
16474 063/300 Write block 1390 len 8192 data: 7 7
16475 064/300 Flush
16476 065/300 Flush
16477 066/300 Write block 335 len 40960 data: 4 5 3 3 4 4 4 4 4 4
16478 067/300 Write block 4430 len 24576 data: 9 8 8 7 7 6
16479 068/300 Write block 2829 len 8192 data: 2 2
16480 069/300 Read block 957 len 16384
16481 070/300 Read block 4579 len 8192
16482 071/300 Read block 844 len 20480
16483 072/300 Write block 3457 len 8192 data: 3 3
16484 073/300 Read block 3636 len 24576
16485 074/300 Read block 3796 len 28672
16486 075/300 Write block 73 len 32768 data: 6 6 6 7 7 6 5 5
16487 076/300 Write block 181 len 12288 data: 5 5 5
16488 077/300 Read block 2650 len 8192
16489 078/300 Write block 3146 len 32768 data: 4 4 4 5 5 5 4 4
16490 079/300 Write block 1230 len 16384 data: 7 8 4 3
16491 080/300 Write block 2689 len 40960 data: 4 3 4 3 3 3 4 4 4 3
16492 081/300 Write block 748 len 12288 data: 5 4 4
16493 082/300 Write block 3335 len 32768 data: 4 4 4 5 5 6 6 4
16494 083/300 Write block 895 len 24576 data: 3 2 2 2 2 2
16495 084/300 Read block 945 len 36864
16496 085/300 Write block 2959 len 32768 data: 3 4 4 4 4 3 3 2
16497 086/300 Read block 4699 len 24576
16498 087/300 Read block 3621 len 32768
16499 088/300 Flush
16500 089/300 Read block 435 len 20480
16501 090/300 Flush
16502 091/300 Read block 3008 len 16384
16503 092/300 Read block 691 len 12288
16504 093/300 Read block 3849 len 32768
16505 094/300 Read block 2294 len 36864
16506 095/300 Read block 3840 len 12288
16507 096/300 Read block 4572 len 20480
16508 097/300 Write block 3893 len 24576 data: 2 2 3 3 4 5
16509 098/300 Read block 2521 len 20480
16510 099/300 Write block 3733 len 32768 data: 6 6 6 4 3 3 3 3
16511 100/300 Read block 3318 len 16384
16512 101/300 Read block 3440 len 8192
16513 102/300 Write block 158 len 8192 data: 3 3
16514 103/300 Read block 3351 len 20480
16515 104/300 Read block 4019 len 20480
16516 105/300 Write block 1164 len 4096 data: 4
16517 106/300 Read block 3852 len 20480
16518 107/300 Read block 3635 len 32768
16519 108/300 Write block 1349 len 16384 data: 3 4 5 6
16520 109/300 Read block 2873 len 4096
16521 110/300 Read block 4523 len 16384
16522 111/300 Write block 3628 len 40960 data: 2 2 2 2 2 2 2 2 2 2
16523 112/300 Read block 4815 len 40960
16524 113/300 Write block 4230 len 16384 data: 3 3 3 2
16525 114/300 Write block 4763 len 20480 data: 4 3 2 3 3
16526 115/300 Read block 3893 len 16384
16527 116/300 Read block 4834 len 40960
16528 117/300 Write block 1810 len 12288 data: 3 4 4
16529 118/300 Read block 4499 len 28672
16530 119/300 Read block 2545 len 12288
16531 120/300 Read block 3327 len 28672
16532 121/300 Flush
16533 122/300 Read block 25 len 40960
16534 123/300 Write block 685 len 12288 data: 5 4 4
16535 124/300 Read block 3197 len 12288
16536 125/300 Read block 320 len 36864
16537 126/300 Read block 3688 len 16384
16538 127/300 Read block 1529 len 16384
16539 128/300 Read block 1631 len 36864
16540 129/300 Read block 2573 len 20480
16541 130/300 Read block 3972 len 28672
16542 131/300 Write block 429 len 40960 data: 2 3 3 3 3 3 3 2 3 2
16543 132/300 Read block 2037 len 16384
16544 133/300 Read block 1744 len 8192
16545 134/300 Read block 1143 len 28672
16546 135/300 Write block 4837 len 4096 data: 3
16547 136/300 Read block 2822 len 24576
16548 137/300 Read block 2652 len 28672
16549 138/300 Read block 2810 len 16384
16550 139/300 Write block 1684 len 20480 data: 6 5 5 4 4
16551 140/300 Write block 698 len 36864 data: 4 3 3 4 4 4 4 6 8
16552 141/300 Write block 1717 len 40960 data: 2 2 2 2 2 2 3 3 2 3
16553 142/300 Write block 2428 len 32768 data: 3 3 3 3 3 3 3 2
16554 143/300 Write block 3776 len 36864 data: 4 4 5 5 5 4 3 4 4
16555 144/300 Read block 4358 len 20480
16556 145/300 Write block 3740 len 4096 data: 4
16557 146/300 Read block 668 len 20480
16558 147/300 Write block 4195 len 16384 data: 6 6 5 5
16559 148/300 Write block 3663 len 40960 data: 3 4 4 3 3 2 3 5 4 4
16560 149/300 Write block 4354 len 40960 data: 2 2 4 4 3 3 3 4 4 4
16561 150/300 Read block 174 len 12288
16562 151/300 Write block 3253 len 16384 data: 3 3 3 2
16563 152/300 Read block 411 len 32768
16564 153/300 Read block 2390 len 8192
16565 154/300 Read block 291 len 40960
16566 155/300 Read block 2802 len 12288
16567 156/300 Read block 1014 len 24576
16568 157/300 Read block 3337 len 12288
16569 158/300 Flush
16570 159/300 Read block 4948 len 28672
16571 160/300 Read block 635 len 24576
16572 161/300 Read block 1489 len 24576
16573 162/300 Read block 2080 len 40960
16574 163/300 Read block 4405 len 36864
16575 164/300 Write block 128 len 32768 data: 3 3 3 2 2 2 2 2
16576 165/300 Write block 3109 len 36864 data: 3 3 2 3 3 4 4 3 3
16577 166/300 Read block 2724 len 16384
16578 167/300 Write block 1633 len 36864 data: 8 7 6 6 5 5 4 4 5
16579 168/300 Write block 4565 len 16384 data: 4 4 4 6
16580 169/300 Read block 2635 len 24576
16581 170/300 Read block 22 len 12288
16582 171/300 Flush
16583 172/300 Read block 150 len 40960
16584 173/300 Write block 3671 len 40960 data: 5 5 5 5 5 5 5 4 4 3
16585 174/300 Read block 3186 len 12288
16586 175/300 Read block 4023 len 28672
16587 176/300 Write block 2516 len 24576 data: 4 4 4 4 3 2
16588 177/300 Read block 2201 len 20480
16589 178/300 Read block 3649 len 12288
16590 179/300 Read block 3578 len 28672
16591 180/300 Write block 4970 len 24576 data: 3 2 2 2 3 3
16592 181/300 Read block 140 len 32768
16593 182/300 Flush
16594 183/300 Read block 900 len 20480
16595 184/300 Read block 93 len 20480
16596 185/300 Read block 3147 len 16384
16597 186/300 Read block 1759 len 20480
16598 187/300 Read block 782 len 24576
16599 188/300 Read block 1646 len 12288
16600 189/300 Read block 2004 len 28672
16601 190/300 Flush
16602 191/300 Read block 2101 len 20480
16603 192/300 Write block 1312 len 4096 data: 3
16604 193/300 Read block 1448 len 24576
16605 194/300 Write block 1006 len 28672 data: 2 2 2 3 3 3 4
16606 195/300 Read block 1455 len 4096
16607 196/300 Read block 2242 len 24576
16608 197/300 Read block 2037 len 24576
16609 198/300 Read block 3357 len 32768
16610 199/300 Read block 3462 len 40960
16611 200/300 Read block 92 len 40960
16612 201/300 Read block 215 len 20480
16613 202/300 Read block 2861 len 40960
16614 203/300 Write block 1309 len 24576 data: 3 3 4 4 5 5
16615 204/300 Write block 4758 len 32768 data: 4 4 2 3 3 5 4 3
16616 205/300 Read block 1472 len 20480
16617 206/300 Write block 3657 len 20480 data: 6 6 4 4 2
16618 207/300 Read block 4122 len 12288
16619 208/300 Read block 2006 len 8192
16620 209/300 Flush
16621 210/300 Read block 4354 len 40960
16622 211/300 Write block 260 len 28672 data: 3 3 3 4 4 3 3
16623 212/300 Read block 4689 len 16384
16624 213/300 Read block 126 len 16384
16625 214/300 Write block 3165 len 32768 data: 4 4 5 5 5 5 5 3
16626 215/300 Read block 2000 len 32768
16627 216/300 Write block 4245 len 36864 data: 3 3 5 4 4 4 4 3 3
16628 217/300 Write block 1336 len 36864 data: 7 9 8 7 6 6 7 4 4
16629 218/300 Write block 25 len 4096 data: 4
16630 219/300 Read block 859 len 32768
16631 220/300 Write block 880 len 24576 data: 6 6 6 6 6 5
16632 221/300 Write block 4372 len 40960 data: 6 6 7 7 7 6 6 4 3 3
16633 222/300 Read block 916 len 16384
16634 223/300 Flush
16635 224/300 Write block 720 len 32768 data: 5 6 6 7 8 7 6 6
16636 225/300 Write block 4813 len 12288 data: 3 3 3
16637 226/300 Flush
16638 227/300 Write block 518 len 40960 data: 3 4 5 5 4 4 4 3 4 3
16639 228/300 Write block 2899 len 16384 data: 7 7 7 6
16640 229/300 Write block 4929 len 32768 data: 3 3 3 3 3 3 3 3
16641 230/300 Flush
16642 231/300 Write block 3915 len 36864 data: 3 4 4 4 5 3 4 3 3
16643 232/300 Read block 3623 len 36864
16644 233/300 Write block 3511 len 12288 data: 2 3 3
16645 234/300 Write block 750 len 32768 data: 5 4 4 3 3 3 3 3
16646 235/300 Flush
16647 236/300 Write block 2528 len 4096 data: 3
16648 237/300 Read block 274 len 28672
16649 238/300 Read block 2572 len 24576
16650 239/300 Write block 4526 len 16384 data: 4 4 6 6
16651 240/300 Write block 2469 len 40960 data: 2 2 3 3 3 3 3 2 3 3
16652 241/300 Read block 46 len 8192
16653 242/300 Flush
16654 243/300 Read block 245 len 16384
16655 244/300 Read block 3661 len 24576
16656 245/300 Write block 3635 len 8192 data: 3 3
16657 246/300 Write block 1985 len 24576 data: 4 5 5 5 5 4
16658 247/300 Read block 4006 len 24576
16659 248/300 Read block 3532 len 16384
16660 249/300 Flush
16661 250/300 Read block 2857 len 40960
16662 251/300 Read block 4405 len 36864
16663 252/300 Flush
16664 253/300 Read block 3312 len 28672
16665 254/300 Read block 1249 len 40960
16666 255/300 Read block 1298 len 12288
16667 256/300 Read block 3318 len 8192
16668 257/300 Read block 2398 len 8192
16669 258/300 Write block 771 len 28672 data: 3 4 4 5 6 5 5
16670 259/300 Write block 3408 len 20480 data: 4 4 3 3 4
16671 260/300 Flush
16672 261/300 Flush
16673 262/300 Read block 975 len 40960
16674 263/300 Read block 1580 len 24576
16675 264/300 Read block 1673 len 24576
16676 265/300 Read block 3068 len 16384
16677 266/300 Read block 244 len 32768
16678 267/300 Write block 4788 len 20480 data: 3 3 3 2 2
16679 268/300 Read block 4024 len 28672
16680 269/300 Flush
16681 270/300 Write block 1888 len 20480 data: 4 3 3 3 4
16682 271/300 Read block 2917 len 20480
16683 272/300 Write block 4376 len 32768 data: 8 7 7 5 4 4 3 3
16684 273/300 Flush
16685 274/300 Read block 3274 len 28672
16686 275/300 Read block 560 len 16384
16687 276/300 Read block 3488 len 16384
16688 277/300 Write block 772 len 4096 data: 5
16689 278/300 Read block 3284 len 12288
16690 279/300 Write block 3003 len 8192 data: 4 6
16691 280/300 Read block 3328 len 28672
16692 281/300 Flush
16693 282/300 Read block 3074 len 20480
16694 283/300 Read block 2174 len 20480
16695 284/300 Read block 502 len 20480
16696 285/300 Write block 1165 len 16384 data: 4 4 2 2
16697 286/300 Write block 651 len 12288 data: 3 2 2
16698 287/300 Read block 12 len 20480
16699 288/300 Write block 2643 len 40960 data: 4 4 3 3 3 3 4 4 4 2
16700 289/300 Read block 1529 len 8192
16701 290/300 Write block 3330 len 20480 data: 2 2 2 3 3
16702 291/300 Flush
16703 292/300 Read block 4249 len 12288
16704 293/300 Read block 2115 len 40960
16705 294/300 Read block 4815 len 24576
16706 295/300 Write block 295 len 40960 data: 4 3 3 3 2 2 2 3 3 4
16707 296/300 Write block 3182 len 24576 data: 2 2 2 2 2 2
16708 297/300 Read block 4226 len 4096
16709 298/300 Write block 3333 len 32768 data: 4 4 5 5 5 6 6 7
16710 299/300 Read block 3644 len 16384
16711 300/300 Read block 2547 len 8192
16712 301/300 Read block 2728 len 40960
16713 Main task has work to do, go find it
16714 got dsc Start(0)
16715 start 0
16716 Jan 10 16:38:51.417 INFO request completed, latency_us: 203, response_code: 204, uri: /start/cid/0, method: POST, req_id: af1b2b33-afe1-43ba-8bf4-a644e4815165, remote_addr: 127.0.0.1:55917, local_addr: 127.0.0.1:9998
16717 Replay: started 0, returned:Ok(())
16718 ----------------------------------------------------------------
16719 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:301
16720 States: Offline Active Active
16721 JOBID ACK TYPE BKS/EXT DS:0 DS:1 DS:2 REPLAY
16722 5225 Acked Read 1 Sent Done Done false
16723 5226 Acked Read 3 Sent Done Done false
16724 5227 Acked Read 6 Sent Done Done false
16725 5228 Acked Read 7 Sent Done Done false
16726 5229 Acked Read 9 Sent Done Done false
16727 5230 Acked Read 6 Sent Done Done false
16728 5231 Acked Write 7 Sent Done Done false
16729 5232 Acked Write 8 Sent Done Done false
16730 5233 Acked Write 8 Sent Done Done false
16731 5234 Acked Write 4 Sent Done Done false
16732 5235 Acked Flush 0 Sent Done Done false
16733 5236 Acked Read 9 Sent Done Done false
16734 5237 Acked Read 1 Sent Done Done false
16735 5238 Acked Write 9 Sent Done Done false
16736 5239 Acked Flush 0 Sent Done Done false
16737 5240 Acked Read 3 Sent Done Done false
16738 5241 Acked Read 7 Sent Done Done false
16739 5242 Acked Read 5 Sent Done Done false
16740 5243 Acked Read 6 Sent Done Done false
16741 5244 Acked Write 7 Sent Done Done false
16742 5245 Acked Write 7 Sent Done Done false
16743 5246 Acked Read 4 Sent Done Done false
16744 5247 Acked Read 4 Sent Done Done false
16745 5248 Acked Read 10 Sent Done Done false
16746 5249 Acked Write 4 Sent Done Done false
16747 5250 Acked Write 1 Sent Done Done false
16748 5251 Acked Read 8 Sent Done Done false
16749 5252 Acked Read 4 Sent Done Done false
16750 5253 Acked Read 7 Sent Done Done false
16751 5254 Acked Read 10 Sent Done Done false
16752 5255 Acked Write 3 Sent Done Done false
16753 5256 Acked Write 8 Sent Done Done false
16754 5257 Acked Read 2 Sent Done Done false
16755 5258 Acked Write 10 Sent Done Done false
16756 5259 Acked Write 1 Sent Done Done false
16757 5260 Acked Write 3 Sent Done Done false
16758 5261 Acked Write 4 Sent Done Done false
16759 5262 Acked Write 7 Sent Done Done false
16760 5263 Acked Write 4 Sent Done Done false
16761 5264 Acked Read 1 Sent Done Done false
16762 5265 Acked Write 2 Sent Done Done false
16763 5266 Acked Read 4 Sent Done Done false
16764 5267 Acked Read 10 Sent Done Done false
16765 5268 Acked Read 7 Sent Done Done false
16766 5269 Acked Write 1 Sent Done Done false
16767 5270 Acked Flush 0 Sent Done Done false
16768 5271 Acked Read 9 Sent Done Done false
16769 5272 Acked Write 2 Sent Done Done false
16770 5273 Acked Read 4 Sent Done Done false
16771 5274 Acked Read 5 Sent Done Done false
16772 5275 Acked Write 6 Sent Done Done false
16773 5276 Acked Write 10 Sent Done Done false
16774 5277 Acked Flush 0 Sent Done Done false
16775 5278 Acked Write 2 Sent Done Done false
16776 5279 Acked Write 6 Sent Done Done false
16777 5280 Acked Read 1 Sent Done Done false
16778 5281 Acked Write 9 Sent Done Done false
16779 5282 Acked Write 3 Sent Done Done false
16780 5283 Acked Write 8 Sent Done Done false
16781 5284 Acked Flush 0 Sent Done Done false
16782 5285 Acked Write 3 Sent Done Done false
16783 5286 Acked Read 10 Sent Done Done false
16784 5287 Acked Write 2 Sent Done Done false
16785 5288 Acked Flush 0 Sent Done Done false
16786 5289 Acked Flush 0 Sent Done Done false
16787 5290 Acked Write 10 Sent Done Done false
16788 5291 Acked Write 6 Sent Done Done false
16789 5292 Acked Write 2 Sent Done Done false
16790 5293 Acked Read 4 Sent Done Done false
16791 5294 Acked Read 2 Sent Done Done false
16792 5295 Acked Read 5 Sent Done Done false
16793 5296 Acked Write 2 Sent Done Done false
16794 5297 Acked Read 6 Sent Done Done false
16795 5298 Acked Read 7 Sent Done Done false
16796 5299 Acked Write 8 Sent Done Done false
16797 5300 Acked Write 3 Sent Done Done false
16798 5301 Acked Read 2 Sent Done Done false
16799 5302 Acked Write 8 Sent Done Done false
16800 5303 Acked Write 4 Sent Done Done false
16801 5304 Acked Write 10 Sent Done Done false
16802 5305 Acked Write 3 Sent Done Done false
16803 5306 Acked Write 8 Sent Done Done false
16804 5307 Acked Write 6 Sent Done Done false
16805 5308 Acked Read 9 Sent Done Done false
16806 5309 Acked Write 8 Sent Done Done false
16807 5310 Acked Read 6 Sent Done Done false
16808 5311 Acked Read 8 Sent Done Done false
16809 5312 Acked Flush 0 Sent Done Done false
16810 5313 Acked Read 5 Sent Done Done false
16811 5314 Acked Flush 0 Sent Done Done false
16812 5315 Acked Read 4 Sent Done Done false
16813 5316 Acked Read 3 Sent Done Done false
16814 5317 Acked Read 8 Sent Done Done false
16815 5318 Acked Read 9 Sent Done Done false
16816 5319 Acked Read 3 Sent Done Done false
16817 5320 Acked Read 5 Sent Done Done false
16818 5321 Acked Write 6 Sent Done Done false
16819 5322 Acked Read 5 Sent Done Done false
16820 5323 Acked Write 8 Sent Done Done false
16821 5324 Acked Read 4 Sent Done Done false
16822 5325 Acked Read 2 Sent Done Done false
16823 5326 Acked Write 2 Sent Done Done false
16824 5327 Acked Read 5 Sent Done Done false
16825 5328 Acked Read 5 Sent Done Done false
16826 5329 Acked Write 1 Sent Done Done false
16827 5330 Acked Read 5 Sent Done Done false
16828 5331 Acked Read 8 Sent Done Done false
16829 5332 Acked Write 4 Sent Done Done false
16830 5333 Acked Read 1 Sent Done Done false
16831 5334 Acked Read 4 Sent Done Done false
16832 5335 Acked Write 10 Sent Done Done false
16833 5336 Acked Read 10 Sent Done Done false
16834 5337 Acked Write 4 Sent Done Done false
16835 5338 Acked Write 5 Sent Done Done false
16836 5339 Acked Read 4 Sent Done Done false
16837 5340 Acked Read 10 Sent Done Done false
16838 5341 Acked Write 3 Sent Done Done false
16839 5342 Acked Read 7 Sent Done Done false
16840 5343 Acked Read 3 Sent Done Done false
16841 5344 Acked Read 7 Sent Done Done false
16842 5345 Acked Flush 0 Sent Done Done false
16843 5346 Acked Read 10 Sent Done Done false
16844 5347 Acked Write 3 Sent Done Done false
16845 5348 Acked Read 3 Sent Done Done false
16846 5349 Acked Read 9 Sent Done Done false
16847 5350 Acked Read 4 Sent Done Done false
16848 5351 Acked Read 4 Sent Done Done false
16849 5352 Acked Read 9 Sent Done Done false
16850 5353 Acked Read 5 Sent Done Done false
16851 5354 Acked Read 7 Sent Done Done false
16852 5355 Acked Write 10 Sent Done Done false
16853 5356 Acked Read 4 Sent Done Done false
16854 5357 Acked Read 2 Sent Done Done false
16855 5358 Acked Read 7 Sent Done Done false
16856 5359 Acked Write 1 Sent Done Done false
16857 5360 Acked Read 6 Sent Done Done false
16858 5361 Acked Read 7 Sent Done Done false
16859 5362 Acked Read 4 Sent Done Done false
16860 5363 Acked Write 5 Sent Done Done false
16861 5364 Acked Write 9 Sent Done Done false
16862 5365 Acked Write 10 Sent Done Done false
16863 5366 Acked Write 8 Sent Done Done false
16864 5367 Acked Write 9 Sent Done Done false
16865 5368 Acked Read 5 Sent Done Done false
16866 5369 Acked Write 1 Sent Done Done false
16867 5370 Acked Read 5 Sent Done Done false
16868 5371 Acked Write 4 Sent Done Done false
16869 5372 Acked Write 10 Sent Done Done false
16870 5373 Acked Write 10 Sent Done Done false
16871 5374 Acked Read 3 Sent Done Done false
16872 5375 Acked Write 4 Sent Done Done false
16873 5376 Acked Read 8 Sent Done Done false
16874 5377 Acked Read 2 Sent Done Done false
16875 5378 Acked Read 10 Sent Done Done false
16876 5379 Acked Read 3 Sent Done Done false
16877 5380 Acked Read 6 Sent Done Done false
16878 5381 Acked Read 3 Sent Done Done false
16879 5382 Acked Flush 0 Sent Done Done false
16880 5383 Acked Read 7 Sent Done Done false
16881 5384 Acked Read 6 Sent Done Done false
16882 5385 Acked Read 6 Sent Done Done false
16883 5386 Acked Read 10 Sent Done Done false
16884 5387 Acked Read 9 Sent Done Done false
16885 5388 Acked Write 8 Sent Done Done false
16886 5389 Acked Write 9 Sent Done Done false
16887 5390 Acked Read 4 Sent Done Done false
16888 5391 Acked Write 9 Sent Done Done false
16889 5392 Acked Write 4 Sent Done Done false
16890 5393 Acked Read 6 Sent Done Done false
16891 5394 Acked Read 3 Sent Done Done false
16892 5395 Acked Flush 0 Sent Done Done false
16893 5396 Acked Read 10 Sent Done Done false
16894 5397 Acked Write 10 Sent Done Done false
16895 5398 Acked Read 3 Sent Done Done false
16896 5399 Acked Read 7 Sent Done Done false
16897 5400 Acked Write 6 Sent Done Done false
16898 5401 Acked Read 5 Sent Done Done false
16899 5402 Acked Read 3 Sent Done Done false
16900 5403 Acked Read 7 Sent Done Done false
16901 5404 Acked Write 6 Sent Done Done false
16902 5405 Acked Read 8 Sent Done Done false
16903 5406 Acked Flush 0 Sent Done Done false
16904 5407 Acked Read 5 Sent Done Done false
16905 5408 Acked Read 5 Sent Done Done false
16906 5409 Acked Read 4 Sent Done Done false
16907 5410 Acked Read 5 Sent Done Done false
16908 5411 Acked Read 6 Sent Done Done false
16909 5412 Acked Read 3 Sent Done Done false
16910 5413 Acked Read 7 Sent Done Done false
16911 5414 Acked Flush 0 Sent Done Done false
16912 5415 Acked Read 5 Sent Done Done false
16913 5416 Acked Write 1 Sent Done Done false
16914 5417 Acked Read 6 Sent Done Done false
16915 5418 Acked Write 7 Sent Done Done false
16916 5419 Acked Read 1 Sent Done Done false
16917 5420 Acked Read 6 Sent Done Done false
16918 5421 Acked Read 6 Sent Done Done false
16919 5422 Acked Read 8 Sent Done Done false
16920 5423 Acked Read 10 Sent Done Done false
16921 5424 Acked Read 10 Sent Done Done false
16922 5425 Acked Read 5 Sent Done Done false
16923 5426 Acked Read 10 Sent Done Done false
16924 5427 Acked Write 6 Sent Done Done false
16925 5428 Acked Write 8 Sent Done Done false
16926 5429 Acked Read 5 Sent Done Done false
16927 5430 Acked Write 5 Sent Done Done false
16928 5431 Acked Read 3 Sent Done Done false
16929 5432 Acked Read 2 Sent Done Done false
16930 5433 Acked Flush 0 Sent Done Done false
16931 5434 Acked Read 10 Sent Done Done false
16932 5435 Acked Write 7 Sent Done Done false
16933 5436 Acked Read 4 Sent Done Done false
16934 5437 Acked Read 4 Sent Done Done false
16935 5438 Acked Write 8 Sent Done Done false
16936 5439 Acked Read 8 Sent Done Done false
16937 5440 Acked Write 9 Sent Done Done false
16938 5441 Acked Write 9 Sent Done Done false
16939 5442 Acked Write 1 Sent Done Done false
16940 5443 Acked Read 8 Sent Done Done false
16941 5444 Acked Write 6 Sent Done Done false
16942 5445 Acked Write 10 Sent Done Done false
16943 5446 Acked Read 4 Sent Done Done false
16944 5447 Acked Flush 0 Sent Done Done false
16945 5448 Acked Write 8 Sent Done Done false
16946 5449 Acked Write 3 Sent Done Done false
16947 5450 Acked Flush 0 Sent Done Done false
16948 5451 Acked Write 10 Sent Done Done false
16949 5452 Acked Write 4 Sent Done Done false
16950 5453 Acked Write 8 Sent Done Done false
16951 5454 Acked Flush 0 Sent Done Done false
16952 5455 Acked Write 9 Sent Done Done false
16953 5456 Acked Read 9 Sent Done Done false
16954 5457 Acked Write 3 Sent Done Done false
16955 5458 Acked Write 8 Sent Done Done false
16956 5459 Acked Flush 0 Sent Done Done false
16957 5460 Acked Write 1 Sent Done Done false
16958 5461 Acked Read 7 Sent Done Done false
16959 5462 Acked Read 6 Sent Done Done false
16960 5463 Acked Write 4 Sent Done Done false
16961 5464 Acked Write 10 Sent Done Done false
16962 5465 Acked Read 2 Sent Done Done false
16963 5466 Acked Flush 0 Sent Done Done false
16964 5467 Acked Read 4 Sent Done Done false
16965 5468 Acked Read 6 Sent Done Done false
16966 5469 Acked Write 2 Sent Done Done false
16967 5470 Acked Write 6 Sent Done Done false
16968 5471 Acked Read 6 Sent Done Done false
16969 5472 Acked Read 4 Sent Done Done false
16970 5473 Acked Flush 0 Sent Done Done false
16971 5474 Acked Read 10 Sent Done Done false
16972 5475 Acked Read 9 Sent Done Done false
16973 5476 Acked Flush 0 Sent Done Done false
16974 5477 Acked Read 7 Sent Done Done false
16975 5478 Acked Read 10 Sent Done Done false
16976 5479 Acked Read 3 Sent Done Done false
16977 5480 Acked Read 2 Sent Done Done false
16978 5481 Acked Read 2 Sent Done Done false
16979 5482 Acked Write 7 Sent Done Done false
16980 5483 Acked Write 5 Sent Done Done false
16981 5484 Acked Flush 0 Sent Done Done false
16982 5485 Acked Flush 0 Sent Done Done false
16983 5486 Acked Read 10 Sent Done Done false
16984 5487 Acked Read 6 Sent Done Done false
16985 5488 Acked Read 6 Sent Done Done false
16986 5489 Acked Read 4 Sent Done Done false
16987 5490 Acked Read 8 Sent Done Done false
16988 5491 Acked Write 5 Sent Done Done false
16989 5492 Acked Read 7 Sent Done Done false
16990 5493 Acked Flush 0 Sent Done Done false
16991 5494 Acked Write 5 Sent Done Done false
16992 5495 Acked Read 5 Sent Done Done false
16993 5496 Acked Write 8 Sent Done Done false
16994 5497 Acked Flush 0 Sent Done Done false
16995 5498 Acked Read 7 Sent Done Done false
16996 5499 Acked Read 4 Sent Done Done false
16997 5500 Acked Read 4 Sent Done Done false
16998 5501 Acked Write 1 Sent Done Done false
16999 5502 Acked Read 3 Sent Done Done false
17000 5503 Acked Write 2 Sent Done Done false
17001 5504 Acked Read 7 Sent Done Done false
17002 5505 Acked Flush 0 Sent Done Done false
17003 5506 Acked Read 5 Sent Done Done false
17004 5507 Acked Read 5 Sent Done Done false
17005 5508 Acked Read 5 Sent Done Done false
17006 5509 Acked Write 4 Sent Done Done false
17007 5510 Acked Write 3 Sent Done Done false
17008 5511 Acked Read 5 Sent Done Done false
17009 5512 Acked Write 10 Sent Done Done false
17010 5513 Acked Read 2 Sent Done Done false
17011 5514 Acked Write 5 Sent Done Done false
17012 5515 Acked Flush 0 Sent Done Done false
17013 5516 Acked Read 3 Sent Done Done false
17014 5517 Acked Read 10 Sent Done Done false
17015 5518 Acked Read 6 Sent Done Done false
17016 5519 Acked Write 10 Sent Done Done false
17017 5520 Acked Write 6 Sent Done Done false
17018 5521 Acked Read 1 Sent Done Done false
17019 5522 Acked Write 8 Sent Done Done false
17020 5523 Acked Read 4 Sent Done Done false
17021 5524 Acked Read 2 Sent Done Done false
17022 5525 Acked Read 10 Sent Done Done false
17023 STATES DS:0 DS:1 DS:2 TOTAL
17024 Sent 301 0 0 301
17025 Done 0 301 301 602
17026 Skipped 0 0 0 0
17027 Error 0 0 0 0
17028 Last Flush: 5224 5515 5515
17029 Downstairs last five completed: 5224 5223 5222 5221 5220
17030 Upstairs last five completed: 5525 5524 5523 5522 5521
17031 CLIENT: Up:0 ds:301 act:2
17032 [8810] got start action
17033 [8810] I am going to restart
17034 Starting downstairs at port 8810
17035 Make output file at "/tmp/dsc/downstairs-8810.txt"
17036 [8810][0] reports Starting
17037 Downstairs /var/tmp/dsc/region/8810 port 8810 PID:Some(1217)
17038 [8810][0] reports Running
17039 ----------------------------------------------------------------
17040 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:302
17041 States: Offline Active Active
17042 JOBID ACK TYPE BKS/EXT DS:0 DS:1 DS:2 REPLAY
17043 5225 Acked Read 1 Sent Done Done false
17044 5226 Acked Read 3 Sent Done Done false
17045 5227 Acked Read 6 Sent Done Done false
17046 5228 Acked Read 7 Sent Done Done false
17047 5229 Acked Read 9 Sent Done Done false
17048 5230 Acked Read 6 Sent Done Done false
17049 5231 Acked Write 7 Sent Done Done false
17050 5232 Acked Write 8 Sent Done Done false
17051 5233 Acked Write 8 Sent Done Done false
17052 5234 Acked Write 4 Sent Done Done false
17053 5235 Acked Flush 0 Sent Done Done false
17054 5236 Acked Read 9 Sent Done Done false
17055 5237 Acked Read 1 Sent Done Done false
17056 5238 Acked Write 9 Sent Done Done false
17057 5239 Acked Flush 0 Sent Done Done false
17058 5240 Acked Read 3 Sent Done Done false
17059 5241 Acked Read 7 Sent Done Done false
17060 5242 Acked Read 5 Sent Done Done false
17061 5243 Acked Read 6 Sent Done Done false
17062 5244 Acked Write 7 Sent Done Done false
17063 5245 Acked Write 7 Sent Done Done false
17064 5246 Acked Read 4 Sent Done Done false
17065 5247 Acked Read 4 Sent Done Done false
17066 5248 Acked Read 10 Sent Done Done false
17067 5249 Acked Write 4 Sent Done Done false
17068 5250 Acked Write 1 Sent Done Done false
17069 5251 Acked Read 8 Sent Done Done false
17070 5252 Acked Read 4 Sent Done Done false
17071 5253 Acked Read 7 Sent Done Done false
17072 5254 Acked Read 10 Sent Done Done false
17073 5255 Acked Write 3 Sent Done Done false
17074 5256 Acked Write 8 Sent Done Done false
17075 5257 Acked Read 2 Sent Done Done false
17076 5258 Acked Write 10 Sent Done Done false
17077 5259 Acked Write 1 Sent Done Done false
17078 5260 Acked Write 3 Sent Done Done false
17079 5261 Acked Write 4 Sent Done Done false
17080 5262 Acked Write 7 Sent Done Done false
17081 5263 Acked Write 4 Sent Done Done false
17082 5264 Acked Read 1 Sent Done Done false
17083 5265 Acked Write 2 Sent Done Done false
17084 5266 Acked Read 4 Sent Done Done false
17085 5267 Acked Read 10 Sent Done Done false
17086 5268 Acked Read 7 Sent Done Done false
17087 5269 Acked Write 1 Sent Done Done false
17088 5270 Acked Flush 0 Sent Done Done false
17089 5271 Acked Read 9 Sent Done Done false
17090 5272 Acked Write 2 Sent Done Done false
17091 5273 Acked Read 4 Sent Done Done false
17092 5274 Acked Read 5 Sent Done Done false
17093 5275 Acked Write 6 Sent Done Done false
17094 5276 Acked Write 10 Sent Done Done false
17095 5277 Acked Flush 0 Sent Done Done false
17096 5278 Acked Write 2 Sent Done Done false
17097 5279 Acked Write 6 Sent Done Done false
17098 5280 Acked Read 1 Sent Done Done false
17099 5281 Acked Write 9 Sent Done Done false
17100 5282 Acked Write 3 Sent Done Done false
17101 5283 Acked Write 8 Sent Done Done false
17102 5284 Acked Flush 0 Sent Done Done false
17103 5285 Acked Write 3 Sent Done Done false
17104 5286 Acked Read 10 Sent Done Done false
17105 5287 Acked Write 2 Sent Done Done false
17106 5288 Acked Flush 0 Sent Done Done false
17107 5289 Acked Flush 0 Sent Done Done false
17108 5290 Acked Write 10 Sent Done Done false
17109 5291 Acked Write 6 Sent Done Done false
17110 5292 Acked Write 2 Sent Done Done false
17111 5293 Acked Read 4 Sent Done Done false
17112 5294 Acked Read 2 Sent Done Done false
17113 5295 Acked Read 5 Sent Done Done false
17114 5296 Acked Write 2 Sent Done Done false
17115 5297 Acked Read 6 Sent Done Done false
17116 5298 Acked Read 7 Sent Done Done false
17117 5299 Acked Write 8 Sent Done Done false
17118 5300 Acked Write 3 Sent Done Done false
17119 5301 Acked Read 2 Sent Done Done false
17120 5302 Acked Write 8 Sent Done Done false
17121 5303 Acked Write 4 Sent Done Done false
17122 5304 Acked Write 10 Sent Done Done false
17123 5305 Acked Write 3 Sent Done Done false
17124 5306 Acked Write 8 Sent Done Done false
17125 5307 Acked Write 6 Sent Done Done false
17126 5308 Acked Read 9 Sent Done Done false
17127 5309 Acked Write 8 Sent Done Done false
17128 5310 Acked Read 6 Sent Done Done false
17129 5311 Acked Read 8 Sent Done Done false
17130 5312 Acked Flush 0 Sent Done Done false
17131 5313 Acked Read 5 Sent Done Done false
17132 5314 Acked Flush 0 Sent Done Done false
17133 5315 Acked Read 4 Sent Done Done false
17134 5316 Acked Read 3 Sent Done Done false
17135 5317 Acked Read 8 Sent Done Done false
17136 5318 Acked Read 9 Sent Done Done false
17137 5319 Acked Read 3 Sent Done Done false
17138 5320 Acked Read 5 Sent Done Done false
17139 5321 Acked Write 6 Sent Done Done false
17140 5322 Acked Read 5 Sent Done Done false
17141 5323 Acked Write 8 Sent Done Done false
17142 5324 Acked Read 4 Sent Done Done false
17143 5325 Acked Read 2 Sent Done Done false
17144 5326 Acked Write 2 Sent Done Done false
17145 5327 Acked Read 5 Sent Done Done false
17146 5328 Acked Read 5 Sent Done Done false
17147 5329 Acked Write 1 Sent Done Done false
17148 5330 Acked Read 5 Sent Done Done false
17149 5331 Acked Read 8 Sent Done Done false
17150 5332 Acked Write 4 Sent Done Done false
17151 5333 Acked Read 1 Sent Done Done false
17152 5334 Acked Read 4 Sent Done Done false
17153 5335 Acked Write 10 Sent Done Done false
17154 5336 Acked Read 10 Sent Done Done false
17155 5337 Acked Write 4 Sent Done Done false
17156 5338 Acked Write 5 Sent Done Done false
17157 5339 Acked Read 4 Sent Done Done false
17158 5340 Acked Read 10 Sent Done Done false
17159 5341 Acked Write 3 Sent Done Done false
17160 5342 Acked Read 7 Sent Done Done false
17161 5343 Acked Read 3 Sent Done Done false
17162 5344 Acked Read 7 Sent Done Done false
17163 5345 Acked Flush 0 Sent Done Done false
17164 5346 Acked Read 10 Sent Done Done false
17165 5347 Acked Write 3 Sent Done Done false
17166 5348 Acked Read 3 Sent Done Done false
17167 5349 Acked Read 9 Sent Done Done false
17168 5350 Acked Read 4 Sent Done Done false
17169 5351 Acked Read 4 Sent Done Done false
17170 5352 Acked Read 9 Sent Done Done false
17171 5353 Acked Read 5 Sent Done Done false
17172 5354 Acked Read 7 Sent Done Done false
17173 5355 Acked Write 10 Sent Done Done false
17174 5356 Acked Read 4 Sent Done Done false
17175 5357 Acked Read 2 Sent Done Done false
17176 5358 Acked Read 7 Sent Done Done false
17177 5359 Acked Write 1 Sent Done Done false
17178 5360 Acked Read 6 Sent Done Done false
17179 5361 Acked Read 7 Sent Done Done false
17180 5362 Acked Read 4 Sent Done Done false
17181 5363 Acked Write 5 Sent Done Done false
17182 5364 Acked Write 9 Sent Done Done false
17183 5365 Acked Write 10 Sent Done Done false
17184 5366 Acked Write 8 Sent Done Done false
17185 5367 Acked Write 9 Sent Done Done false
17186 5368 Acked Read 5 Sent Done Done false
17187 5369 Acked Write 1 Sent Done Done false
17188 5370 Acked Read 5 Sent Done Done false
17189 5371 Acked Write 4 Sent Done Done false
17190 5372 Acked Write 10 Sent Done Done false
17191 5373 Acked Write 10 Sent Done Done false
17192 5374 Acked Read 3 Sent Done Done false
17193 5375 Acked Write 4 Sent Done Done false
17194 5376 Acked Read 8 Sent Done Done false
17195 5377 Acked Read 2 Sent Done Done false
17196 5378 Acked Read 10 Sent Done Done false
17197 5379 Acked Read 3 Sent Done Done false
17198 5380 Acked Read 6 Sent Done Done false
17199 5381 Acked Read 3 Sent Done Done false
17200 5382 Acked Flush 0 Sent Done Done false
17201 5383 Acked Read 7 Sent Done Done false
17202 5384 Acked Read 6 Sent Done Done false
17203 5385 Acked Read 6 Sent Done Done false
17204 5386 Acked Read 10 Sent Done Done false
17205 5387 Acked Read 9 Sent Done Done false
17206 5388 Acked Write 8 Sent Done Done false
17207 5389 Acked Write 9 Sent Done Done false
17208 5390 Acked Read 4 Sent Done Done false
17209 5391 Acked Write 9 Sent Done Done false
17210 5392 Acked Write 4 Sent Done Done false
17211 5393 Acked Read 6 Sent Done Done false
17212 5394 Acked Read 3 Sent Done Done false
17213 5395 Acked Flush 0 Sent Done Done false
17214 5396 Acked Read 10 Sent Done Done false
17215 5397 Acked Write 10 Sent Done Done false
17216 5398 Acked Read 3 Sent Done Done false
17217 5399 Acked Read 7 Sent Done Done false
17218 5400 Acked Write 6 Sent Done Done false
17219 5401 Acked Read 5 Sent Done Done false
17220 5402 Acked Read 3 Sent Done Done false
17221 5403 Acked Read 7 Sent Done Done false
17222 5404 Acked Write 6 Sent Done Done false
17223 5405 Acked Read 8 Sent Done Done false
17224 5406 Acked Flush 0 Sent Done Done false
17225 5407 Acked Read 5 Sent Done Done false
17226 5408 Acked Read 5 Sent Done Done false
17227 5409 Acked Read 4 Sent Done Done false
17228 5410 Acked Read 5 Sent Done Done false
17229 5411 Acked Read 6 Sent Done Done false
17230 5412 Acked Read 3 Sent Done Done false
17231 5413 Acked Read 7 Sent Done Done false
17232 5414 Acked Flush 0 Sent Done Done false
17233 5415 Acked Read 5 Sent Done Done false
17234 5416 Acked Write 1 Sent Done Done false
17235 5417 Acked Read 6 Sent Done Done false
17236 5418 Acked Write 7 Sent Done Done false
17237 5419 Acked Read 1 Sent Done Done false
17238 5420 Acked Read 6 Sent Done Done false
17239 5421 Acked Read 6 Sent Done Done false
17240 5422 Acked Read 8 Sent Done Done false
17241 5423 Acked Read 10 Sent Done Done false
17242 5424 Acked Read 10 Sent Done Done false
17243 5425 Acked Read 5 Sent Done Done false
17244 5426 Acked Read 10 Sent Done Done false
17245 5427 Acked Write 6 Sent Done Done false
17246 5428 Acked Write 8 Sent Done Done false
17247 5429 Acked Read 5 Sent Done Done false
17248 5430 Acked Write 5 Sent Done Done false
17249 5431 Acked Read 3 Sent Done Done false
17250 5432 Acked Read 2 Sent Done Done false
17251 5433 Acked Flush 0 Sent Done Done false
17252 5434 Acked Read 10 Sent Done Done false
17253 5435 Acked Write 7 Sent Done Done false
17254 5436 Acked Read 4 Sent Done Done false
17255 5437 Acked Read 4 Sent Done Done false
17256 5438 Acked Write 8 Sent Done Done false
17257 5439 Acked Read 8 Sent Done Done false
17258 5440 Acked Write 9 Sent Done Done false
17259 5441 Acked Write 9 Sent Done Done false
17260 5442 Acked Write 1 Sent Done Done false
17261 5443 Acked Read 8 Sent Done Done false
17262 5444 Acked Write 6 Sent Done Done false
17263 5445 Acked Write 10 Sent Done Done false
17264 5446 Acked Read 4 Sent Done Done false
17265 5447 Acked Flush 0 Sent Done Done false
17266 5448 Acked Write 8 Sent Done Done false
17267 5449 Acked Write 3 Sent Done Done false
17268 5450 Acked Flush 0 Sent Done Done false
17269 5451 Acked Write 10 Sent Done Done false
17270 5452 Acked Write 4 Sent Done Done false
17271 5453 Acked Write 8 Sent Done Done false
17272 5454 Acked Flush 0 Sent Done Done false
17273 5455 Acked Write 9 Sent Done Done false
17274 5456 Acked Read 9 Sent Done Done false
17275 5457 Acked Write 3 Sent Done Done false
17276 5458 Acked Write 8 Sent Done Done false
17277 5459 Acked Flush 0 Sent Done Done false
17278 5460 Acked Write 1 Sent Done Done false
17279 5461 Acked Read 7 Sent Done Done false
17280 5462 Acked Read 6 Sent Done Done false
17281 5463 Acked Write 4 Sent Done Done false
17282 5464 Acked Write 10 Sent Done Done false
17283 5465 Acked Read 2 Sent Done Done false
17284 5466 Acked Flush 0 Sent Done Done false
17285 5467 Acked Read 4 Sent Done Done false
17286 5468 Acked Read 6 Sent Done Done false
17287 5469 Acked Write 2 Sent Done Done false
17288 5470 Acked Write 6 Sent Done Done false
17289 5471 Acked Read 6 Sent Done Done false
17290 5472 Acked Read 4 Sent Done Done false
17291 5473 Acked Flush 0 Sent Done Done false
17292 5474 Acked Read 10 Sent Done Done false
17293 5475 Acked Read 9 Sent Done Done false
17294 5476 Acked Flush 0 Sent Done Done false
17295 5477 Acked Read 7 Sent Done Done false
17296 5478 Acked Read 10 Sent Done Done false
17297 5479 Acked Read 3 Sent Done Done false
17298 5480 Acked Read 2 Sent Done Done false
17299 5481 Acked Read 2 Sent Done Done false
17300 5482 Acked Write 7 Sent Done Done false
17301 5483 Acked Write 5 Sent Done Done false
17302 5484 Acked Flush 0 Sent Done Done false
17303 5485 Acked Flush 0 Sent Done Done false
17304 5486 Acked Read 10 Sent Done Done false
17305 5487 Acked Read 6 Sent Done Done false
17306 5488 Acked Read 6 Sent Done Done false
17307 5489 Acked Read 4 Sent Done Done false
17308 5490 Acked Read 8 Sent Done Done false
17309 5491 Acked Write 5 Sent Done Done false
17310 5492 Acked Read 7 Sent Done Done false
17311 5493 Acked Flush 0 Sent Done Done false
17312 5494 Acked Write 5 Sent Done Done false
17313 5495 Acked Read 5 Sent Done Done false
17314 5496 Acked Write 8 Sent Done Done false
17315 5497 Acked Flush 0 Sent Done Done false
17316 5498 Acked Read 7 Sent Done Done false
17317 5499 Acked Read 4 Sent Done Done false
17318 5500 Acked Read 4 Sent Done Done false
17319 5501 Acked Write 1 Sent Done Done false
17320 5502 Acked Read 3 Sent Done Done false
17321 5503 Acked Write 2 Sent Done Done false
17322 5504 Acked Read 7 Sent Done Done false
17323 5505 Acked Flush 0 Sent Done Done false
17324 5506 Acked Read 5 Sent Done Done false
17325 5507 Acked Read 5 Sent Done Done false
17326 5508 Acked Read 5 Sent Done Done false
17327 5509 Acked Write 4 Sent Done Done false
17328 5510 Acked Write 3 Sent Done Done false
17329 5511 Acked Read 5 Sent Done Done false
17330 5512 Acked Write 10 Sent Done Done false
17331 5513 Acked Read 2 Sent Done Done false
17332 5514 Acked Write 5 Sent Done Done false
17333 5515 Acked Flush 0 Sent Done Done false
17334 5516 Acked Read 3 Sent Done Done false
17335 5517 Acked Read 10 Sent Done Done false
17336 5518 Acked Read 6 Sent Done Done false
17337 5519 Acked Write 10 Sent Done Done false
17338 5520 Acked Write 6 Sent Done Done false
17339 5521 Acked Read 1 Sent Done Done false
17340 5522 Acked Write 8 Sent Done Done false
17341 5523 Acked Read 4 Sent Done Done false
17342 5524 Acked Read 2 Sent Done Done false
17343 5525 Acked Read 10 Sent Done Done false
17344 5526 Acked Flush 0 Sent Done Done false
17345 STATES DS:0 DS:1 DS:2 TOTAL
17346 Sent 302 0 0 302
17347 Done 0 302 302 604
17348 Skipped 0 0 0 0
17349 Error 0 0 0 0
17350 Last Flush: 5224 5526 5526
17351 Downstairs last five completed: 5224 5223 5222 5221 5220
17352 Upstairs last five completed: 5526 5525 5524 5523 5522
17353 CLIENT: Up:0 ds:302 act:2
173542025-01-10T16:38:57.169ZINFOcrucible: connecting to 127.0.0.1:8810 = io task client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
173552025-01-10T16:38:57.169ZINFOcrucible: ds_connection connected from Ok(127.0.0.1:58011) = io task client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
173562025-01-10T16:38:57.171ZWARNcrucible: version negotiation from state Offline = downstairs client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
173572025-01-10T16:38:57.171ZINFOcrucible: downstairs client at Some(127.0.0.1:8810) has region UUID 12345678-0000-0000-0000-000000008810 = downstairs client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
173582025-01-10T16:38:57.171ZINFOcrucible: Returning UUID:12345678-0000-0000-0000-000000008810 matches = downstairs client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
173592025-01-10T16:38:57.171ZINFOcrucible: send last flush ID to this DS: 5224 = downstairs client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
173602025-01-10T16:38:57.171ZINFOcrucible: Replied this last flush ID: 5224 = downstairs client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
173612025-01-10T16:38:57.172ZINFOcrucible: ds_transition from Offline to Active = downstairs client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
173622025-01-10T16:38:57.172ZINFOcrucible: [0] Transition from Offline to Active = downstairs client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
173632025-01-10T16:38:57.172ZINFOcrucible: [0] client re-new 302 jobs since flush 5224 = downstairs session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
173642025-01-10T16:38:57.172ZINFOcrucible: [0] Replayed 302 jobs since flush: 5224 = downstairs session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
17365 ----------------------------------------------------------------
17366 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:0
17367 Downstairs last five completed: 5526 5525 5524 5523 5522
17368 Upstairs last five completed: 5526 5525 5524 5523 5522
17369 CLIENT: Up:0 ds:0 act:3
17370 Replay: All jobs finished
17371 Main task has work to do, go find it
17372 got dsc Stop(0)
17373 stop 0
17374 Jan 10 16:38:59.421 [8810] Got stop action so:false kr:false
17375 INFO request completed, latency_us: 352, response_code: 204, uri: /stop/cid/0, method: POST, req_id: ab27d897-973e-49e0-a223-7f0f4b81a6fa, remote_addr: 127.0.0.1:55917, local_addr: 127.0.0.1:9998
173762025-01-10T16:38:59.422ZWARNcrucible: downstairs disconnected = io task client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
173772025-01-10T16:38:59.422ZWARNcrucible: client task is sending Done(Finished) = io task client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
173782025-01-10T16:38:59.422ZWARNcrucible: downstairs task for 0 stopped due to Finished session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
17379 Jan 10 16:38:59.422 {"msg":"ds_transition from Active to Offline","v":0,"name":"crucible","level":30,"time":"2025-01-10T16:38:59.422556656Z","hostname":"w-01JH8H1N3KXZ9F8ZV6CCMP5KTQ","pid":1202,"client":"0","":"downstairs","session_id":"1df3ca91-4dc9-42d6-9897-461254b5afe2"}
17380 INFO request completed, latency_us: 106, response_code: 200, uri: /state/cid/0, method{"msg":"[0] Transition from Active to Offline","v":0,"name":"crucible","level":30,"time":"2025-01-10T16:38:59.422581614Z","hostname":"w-01JH8H1N3KXZ9F8ZV6CCMP5KTQ","pid":1202,"client":"0","":"downstairs","session_id":"1df3ca91-4dc9-42d6-9897-461254b5afe2"}
17381 :{"msg":"client task is exiting","v":0,"name":"crucible","level":30,"time":"2025-01-10T16:38:59.42261649Z","hostname":"w-01JH8H1N3KXZ9F8ZV6CCMP5KTQ","pid":1202,"":"io task","client":"0","":"downstairs","session_id":"1df3ca91-4dc9-42d6-9897-461254b5afe2"}
17382 GET, req_id: 22beab04-adec-4403-94b9-cc70a669143f, remote_addr: 127.0.0.1:55917, local_addr: 127.0.0.1:9998
17383 [8810] Exited with: ExitStatus(unix_wait_status(9))
17384 [8810][0] reports Exit
17385 Jan 10 16:39:03.424 INFO request completed, latency_us: 205, response_code: 200, uri: /state/cid/0, method: GET, req_id: 8a1a1cae-1cfe-4c9f-9881-038d21a3fb0a, remote_addr: 127.0.0.1:55917, local_addr: 127.0.0.1:9998
17386 001/300 Flush
17387 002/300 Read block 214 len 12288
17388 003/300 Write block 1594 len 28672 data: 3 4 4 4 4 4 5
17389 004/300 Flush
17390 005/300 Read block 224 len 16384
17391 006/300 Flush
17392 007/300 Read block 2207 len 32768
17393 008/300 Read block 2570 len 20480
17394 009/300 Write block 1401 len 40960 data: 2 2 2 3 2 2 2 3 3 3
17395 010/300 Write block 2093 len 24576 data: 4 3 3 3 3 2
17396 011/300 Flush
17397 012/300 Read block 20 len 12288
17398 013/300 Flush
17399 014/300 Write block 4397 len 40960 data: 6 6 6 6 4 3 3 2 2 2
17400 015/300 Read block 2392 len 16384
17401 016/300 Write block 3838 len 36864 data: 4 4 3 4 5 4 4 4 5
17402 017/300 Read block 4067 len 20480
17403 018/300 Read block 2815 len 12288
17404 019/300 Read block 4889 len 36864
17405 020/300 Read block 3794 len 24576
17406 021/300 Write block 1881 len 4096 data: 4
17407 022/300 Read block 274 len 32768
17408 023/300 Flush
17409 024/300 Write block 3015 len 8192 data: 5 6
17410 025/300 Write block 2555 len 24576 data: 4 4 4 4 4 3
17411 026/300 Read block 4974 len 8192
17412 027/300 Write block 4457 len 12288 data: 3 3 3
17413 028/300 Read block 3122 len 8192
17414 029/300 Read block 3511 len 8192
17415 030/300 Write block 1604 len 32768 data: 6 4 4 5 5 3 3 3
17416 031/300 Write block 4505 len 32768 data: 3 3 2 3 3 3 4 5
17417 032/300 Write block 4563 len 24576 data: 2 3 5 5 5 7
17418 033/300 Write block 2638 len 24576 data: 5 5 5 5 5 5
17419 034/300 Read block 375 len 4096
17420 035/300 Read block 3642 len 20480
17421 036/300 Write block 1145 len 24576 data: 5 5 4 4 4 5
17422 037/300 Write block 1116 len 4096 data: 3
17423 038/300 Write block 606 len 12288 data: 8 5 4
17424 039/300 Write block 3058 len 8192 data: 3 4
17425 040/300 Read block 1131 len 28672
17426 041/300 Read block 2570 len 4096
17427 042/300 Read block 2348 len 24576
17428 043/300 Write block 4175 len 16384 data: 5 5 4 4
17429 044/300 Read block 2819 len 28672
17430 045/300 Read block 1940 len 32768
17431 046/300 Write block 4082 len 12288 data: 4 4 5
17432 047/300 Read block 3215 len 32768
17433 048/300 Write block 4105 len 24576 data: 2 2 3 3 3 3
17434 049/300 Write block 1378 len 36864 data: 4 3 4 3 4 4 5 5 4
17435 050/300 Flush
17436 051/300 Read block 2268 len 24576
17437 052/300 Read block 3964 len 36864
17438 053/300 Write block 4739 len 28672 data: 3 3 4 3 3 3 3
17439 054/300 Write block 2845 len 40960 data: 3 3 3 2 3 4 4 3 3 3
17440 055/300 Read block 1595 len 24576
17441 056/300 Write block 4658 len 20480 data: 3 3 4 4 3
17442 057/300 Read block 1861 len 12288
17443 058/300 Read block 4908 len 4096
17444 059/300 Read block 1116 len 40960
17445 060/300 Write block 2028 len 32768 data: 2 3 3 4 4 4 5 5
17446 061/300 Flush
17447 062/300 Read block 1538 len 12288
17448 063/300 Write block 3548 len 8192 data: 4 3
17449 064/300 Read block 1012 len 32768
17450 065/300 Read block 737 len 36864
17451 066/300 Flush
17452 067/300 Write block 1598 len 16384 data: 5 5 6 5
17453 068/300 Flush
17454 069/300 Read block 1229 len 8192
17455 070/300 Write block 1915 len 32768 data: 4 4 3 4 4 4 3 3
17456 071/300 Read block 4850 len 28672
17457 072/300 Read block 3990 len 40960
17458 073/300 Read block 112 len 4096
17459 074/300 Write block 1705 len 28672 data: 4 4 4 5 5 2 2
17460 075/300 Write block 542 len 40960 data: 3 4 4 3 4 4 4 5 5 3
17461 076/300 Read block 3855 len 32768
17462 077/300 Write block 2219 len 40960 data: 2 2 2 2 2 2 3 2 2 2
17463 078/300 Write block 448 len 8192 data: 7 7
17464 079/300 Write block 930 len 24576 data: 5 6 5 5 5 3
17465 080/300 Read block 4082 len 32768
17466 081/300 Read block 3172 len 36864
17467 082/300 Write block 2281 len 32768 data: 4 5 4 3 3 4 3 4
17468 083/300 Write block 3510 len 20480 data: 2 3 4 4 3
17469 084/300 Read block 194 len 36864
17470 085/300 Write block 4859 len 32768 data: 5 5 6 5 4 5 3 3
17471 086/300 Read block 404 len 8192
17472 087/300 Read block 4677 len 28672
17473 088/300 Flush
17474 089/300 Write block 4190 len 12288 data: 4 6 6
17475 090/300 Write block 2570 len 28672 data: 3 3 2 2 2 2 2
17476 091/300 Flush
17477 092/300 Read block 2101 len 20480
17478 093/300 Read block 4110 len 12288
17479 094/300 Read block 4296 len 28672
17480 095/300 Write block 1930 len 24576 data: 4 4 3 4 3 4
17481 096/300 Read block 3779 len 28672
17482 097/300 Read block 3064 len 32768
17483 098/300 Write block 4517 len 40960 data: 4 3 3 4 4 2 2 3 3 5
17484 099/300 Read block 2892 len 20480
17485 100/300 Read block 4054 len 16384
17486 101/300 Flush
17487 102/300 Write block 10 len 40960 data: 4 4 5 6 5 5 6 5 5 5
17488 103/300 Read block 3711 len 40960
17489 104/300 Read block 2757 len 36864
17490 105/300 Read block 4590 len 16384
17491 106/300 Write block 4769 len 8192 data: 3 3
17492 107/300 Read block 1966 len 24576
17493 108/300 Read block 1912 len 24576
17494 109/300 Read block 4095 len 4096
17495 110/300 Write block 693 len 36864 data: 4 4 4 4 3 5 4 4 5
17496 111/300 Read block 4724 len 4096
17497 112/300 Read block 695 len 12288
17498 113/300 Write block 2754 len 36864 data: 4 4 4 4 4 4 5 4 4
17499 114/300 Write block 2283 len 4096 data: 5
17500 115/300 Write block 3540 len 28672 data: 4 4 3 4 4 4 4
17501 116/300 Read block 2988 len 40960
17502 117/300 Write block 2596 len 8192 data: 4 4
17503 118/300 Read block 1664 len 36864
17504 119/300 Write block 1590 len 20480 data: 4 4 4 3 4
17505 120/300 Write block 1879 len 12288 data: 4 4 5
17506 121/300 Write block 3400 len 8192 data: 6 5
17507 122/300 Write block 4685 len 40960 data: 4 4 3 2 2 3 3 3 3 3
17508 123/300 Write block 3906 len 16384 data: 3 3 2 2
17509 124/300 Read block 2849 len 16384
17510 125/300 Flush
17511 126/300 Flush
17512 127/300 Read block 65 len 40960
17513 128/300 Flush
17514 129/300 Read block 2398 len 20480
17515 130/300 Read block 3947 len 36864
17516 131/300 Read block 514 len 24576
17517 132/300 Read block 2212 len 32768
17518 133/300 Flush
17519 134/300 Read block 2301 len 16384
17520 135/300 Read block 4748 len 40960
17521 136/300 Write block 1024 len 16384 data: 4 4 4 4
17522 137/300 Read block 3913 len 32768
17523 138/300 Write block 1030 len 24576 data: 5 4 4 4 5 4
17524 139/300 Write block 480 len 4096 data: 7
17525 140/300 Write block 2946 len 16384 data: 4 6 5 5
17526 141/300 Flush
17527 142/300 Read block 4482 len 4096
17528 143/300 Flush
17529 144/300 Write block 4313 len 8192 data: 4 4
17530 145/300 Write block 3784 len 16384 data: 5 6 5 5
17531 146/300 Read block 2643 len 12288
17532 147/300 Write block 3370 len 24576 data: 5 5 5 5 2 2
17533 148/300 Read block 2451 len 24576
17534 149/300 Read block 4479 len 4096
17535 150/300 Read block 266 len 28672
17536 151/300 Write block 1355 len 36864 data: 4 4 4 4 4 3 3 3 3
17537 152/300 Write block 3305 len 16384 data: 3 2 2 2
17538 153/300 Read block 3609 len 4096
17539 154/300 Read block 4322 len 4096
17540 155/300 Write block 3088 len 28672 data: 4 5 5 4 5 5 5
17541 156/300 Write block 1363 len 16384 data: 4 4 4 3
17542 157/300 Write block 4131 len 32768 data: 4 5 4 5 3 3 3 3
17543 158/300 Read block 219 len 24576
17544 159/300 Read block 4806 len 8192
17545 160/300 Read block 4686 len 8192
17546 161/300 Write block 4768 len 24576 data: 3 4 4 3 4 4
17547 162/300 Read block 3799 len 20480
17548 163/300 Read block 2372 len 24576
17549 164/300 Write block 1698 len 32768 data: 3 3 4 4 4 4 4 5
17550 165/300 Read block 3013 len 32768
17551 166/300 Write block 523 len 8192 data: 5 5
17552 167/300 Write block 3489 len 4096 data: 3
17553 168/300 Write block 3300 len 8192 data: 2 3
17554 169/300 Write block 2208 len 4096 data: 4
17555 170/300 Read block 4445 len 8192
17556 171/300 Read block 2726 len 28672
17557 172/300 Read block 4814 len 40960
17558 173/300 Flush
17559 174/300 Flush
17560 175/300 Read block 376 len 40960
17561 176/300 Read block 1684 len 40960
17562 177/300 Write block 1949 len 36864 data: 4 4 5 2 3 3 3 3 2
17563 178/300 Read block 1991 len 36864
17564 179/300 Write block 3482 len 36864 data: 2 2 2 2 2 3 3 4 3
17565 180/300 Write block 3718 len 16384 data: 3 3 4 3
17566 181/300 Read block 3012 len 24576
17567 182/300 Read block 428 len 28672
17568 183/300 Read block 4055 len 28672
17569 184/300 Flush
17570 185/300 Read block 3161 len 32768
17571 186/300 Write block 3686 len 28672 data: 4 3 3 3 2 2 3
17572 187/300 Read block 2116 len 36864
17573 188/300 Write block 4874 len 36864 data: 3 3 3 3 4 5 4 4 3
17574 189/300 Write block 1491 len 28672 data: 3 3 3 2 2 2 2
17575 190/300 Read block 2276 len 24576
17576 191/300 Write block 4546 len 12288 data: 3 2 2
17577 192/300 Write block 548 len 32768 data: 5 6 6 4 3 3 3 3
17578 193/300 Read block 953 len 24576
17579 194/300 Flush
17580 195/300 Read block 1174 len 36864
17581 196/300 Write block 1695 len 36864 data: 4 4 3 4 4 5 5 5 5
17582 197/300 Write block 217 len 24576 data: 3 4 4 4 5 4
17583 198/300 Write block 3808 len 28672 data: 3 3 2 2 2 2 3
17584 199/300 Read block 1451 len 12288
17585 200/300 Read block 39 len 28672
17586 201/300 Write block 2242 len 40960 data: 4 5 5 5 6 6 7 6 6 5
17587 202/300 Write block 2855 len 32768 data: 3 3 3 3 2 2 3 5
17588 203/300 Read block 1952 len 40960
17589 204/300 Read block 3586 len 24576
17590 205/300 Write block 587 len 24576 data: 5 5 3 4 4 4
17591 206/300 Read block 904 len 4096
17592 207/300 Read block 1010 len 40960
17593 208/300 Flush
17594 209/300 Read block 3955 len 4096
17595 210/300 Read block 3105 len 40960
17596 211/300 Read block 2767 len 36864
17597 212/300 Write block 3310 len 8192 data: 2 3
17598 213/300 Write block 2135 len 40960 data: 7 5 3 3 4 6 6 6 5 5
17599 214/300 Read block 1944 len 4096
17600 215/300 Read block 2773 len 20480
17601 216/300 Read block 2848 len 40960
17602 217/300 Read block 2095 len 12288
17603 218/300 Read block 467 len 24576
17604 219/300 Flush
17605 220/300 Read block 2598 len 28672
17606 221/300 Write block 1700 len 40960 data: 6 6 6 6 5 6 5 5 6 6
17607 222/300 Write block 3891 len 12288 data: 4 3 3
17608 223/300 Write block 1895 len 8192 data: 3 3
17609 224/300 Write block 3079 len 24576 data: 3 4 4 4 4 4
17610 225/300 Read block 836 len 28672
17611 226/300 Write block 4208 len 36864 data: 5 5 4 4 4 4 4 4 3
17612 227/300 Write block 3409 len 16384 data: 5 4 4 5
17613 228/300 Write block 4100 len 24576 data: 2 2 2 2 2 3
17614 229/300 Write block 1963 len 36864 data: 3 2 2 2 2 2 3 3 3
17615 230/300 Write block 3701 len 32768 data: 3 4 4 3 3 3 3 5
17616 231/300 Read block 3163 len 40960
17617 232/300 Write block 985 len 36864 data: 5 4 5 3 2 3 3 4 4
17618 233/300 Read block 1587 len 32768
17619 234/300 Write block 2047 len 8192 data: 3 4
17620 235/300 Read block 3493 len 36864
17621 236/300 Write block 4051 len 36864 data: 3 3 4 3 3 3 3 3 3
17622 237/300 Read block 3179 len 24576
17623 238/300 Write block 3045 len 20480 data: 2 3 4 4 4
17624 239/300 Write block 3329 len 24576 data: 3 3 3 3 5 5
17625 240/300 Read block 3772 len 8192
17626 241/300 Write block 3952 len 20480 data: 3 3 3 3 3
17627 242/300 Flush
17628 243/300 Write block 1228 len 12288 data: 7 7 8
17629 244/300 Flush
17630 245/300 Write block 3994 len 16384 data: 4 4 4 3
17631 246/300 Write block 2395 len 24576 data: 6 7 6 6 5 4
17632 247/300 Write block 4680 len 40960 data: 3 3 3 3 4 5 5 4 3 3
17633 248/300 Read block 2869 len 40960
17634 249/300 Write block 2014 len 4096 data: 2
17635 250/300 Read block 346 len 40960
17636 251/300 Write block 3486 len 28672 data: 3 4 4 5 4 3 3
17637 252/300 Write block 4872 len 8192 data: 3 3
17638 253/300 Write block 2550 len 24576 data: 4 5 5 6 5 5
17639 254/300 Read block 76 len 4096
17640 255/300 Write block 1001 len 32768 data: 2 2 2 2 2 3 3 3
17641 256/300 Flush
17642 257/300 Read block 693 len 40960
17643 258/300 Write block 4574 len 28672 data: 3 4 6 6 5 6 5
17644 259/300 Read block 1223 len 16384
17645 260/300 Read block 3196 len 8192
17646 261/300 Read block 4642 len 24576
17647 262/300 Read block 2703 len 40960
17648 263/300 Read block 2852 len 12288
17649 264/300 Read block 2540 len 24576
17650 265/300 Read block 4094 len 16384
17651 266/300 Read block 450 len 40960
17652 267/300 Write block 1498 len 32768 data: 2 2 3 2 2 2 3 3
17653 268/300 Write block 4084 len 4096 data: 6
17654 269/300 Write block 695 len 20480 data: 5 5 4 6 5
17655 270/300 Write block 3711 len 4096 data: 7
17656 271/300 Write block 341 len 24576 data: 5 5 5 5 5 5
17657 272/300 Flush
17658 273/300 Read block 4196 len 12288
17659 274/300 Read block 4489 len 8192
17660 275/300 Read block 4576 len 24576
17661 276/300 Read block 4217 len 20480
17662 277/300 Read block 779 len 20480
17663 278/300 Read block 3974 len 32768
17664 279/300 Write block 4609 len 16384 data: 2 2 2 3
17665 280/300 Read block 3136 len 24576
17666 281/300 Read block 2505 len 20480
17667 282/300 Read block 3790 len 32768
17668 283/300 Write block 595 len 12288 data: 2 2 4
17669 284/300 Write block 1344 len 20480 data: 5 4 4 4 3
17670 285/300 Read block 854 len 28672
17671 286/300 Read block 4510 len 24576
17672 287/300 Write block 1097 len 28672 data: 5 5 4 4 3 2 3
17673 288/300 Flush
17674 289/300 Flush
17675 290/300 Write block 3720 len 8192 data: 5 4
17676 291/300 Read block 24 len 8192
17677 292/300 Write block 2322 len 40960 data: 3 2 2 2 2 2 2 2 3 4
17678 293/300 Flush
17679 294/300 Read block 945 len 4096
17680 295/300 Write block 3706 len 20480 data: 4 4 6 6 5
17681 296/300 Read block 963 len 24576
17682 297/300 Write block 3560 len 24576 data: 3 4 4 3 3 3
17683 298/300 Write block 70 len 40960 data: 5 4 6 7 7 7 8 8 7 6
17684 299/300 Read block 100 len 8192
17685 300/300 Flush
17686 301/300 Write block 4585 len 16384 data: 3 2 3 3
17687 Main task has work to do, go find it
17688 got dsc Start(0)
17689 start 0
17690 Jan 10 16:39:03.660 INFO request completed, latency_us: 237, response_code: 204, uri: /start/cid/0, method: POST, req_id: 5749c12f-3649-4b47-a2fe-386af64ab76d, remote_addr: 127.0.0.1:55917, local_addr: 127.0.0.1:9998
17691 Replay: started 0, returned:Ok(())
17692 ----------------------------------------------------------------
17693 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:301
17694 States: Offline Active Active
17695 JOBID ACK TYPE BKS/EXT DS:0 DS:1 DS:2 REPLAY
17696 5527 Acked Flush 0 Sent Done Done false
17697 5528 Acked Read 3 Sent Done Done false
17698 5529 Acked Write 7 Sent Done Done false
17699 5530 Acked Flush 0 Sent Done Done false
17700 5531 Acked Read 4 Sent Done Done false
17701 5532 Acked Flush 0 Sent Done Done false
17702 5533 Acked Read 8 Sent Done Done false
17703 5534 Acked Read 5 Sent Done Done false
17704 5535 Acked Write 10 Sent Done Done false
17705 5536 Acked Write 6 Sent Done Done false
17706 5537 Acked Flush 0 Sent Done Done false
17707 5538 Acked Read 3 Sent Done Done false
17708 5539 Acked Flush 0 Sent Done Done false
17709 5540 Acked Write 10 Sent Done Done false
17710 5541 Acked Read 4 Sent Done Done false
17711 5542 Acked Write 9 Sent Done Done false
17712 5543 Acked Read 5 Sent Done Done false
17713 5544 Acked Read 3 Sent Done Done false
17714 5545 Acked Read 9 Sent Done Done false
17715 5546 Acked Read 6 Sent Done Done false
17716 5547 Acked Write 1 Sent Done Done false
17717 5548 Acked Read 8 Sent Done Done false
17718 5549 Acked Flush 0 Sent Done Done false
17719 5550 Acked Write 2 Sent Done Done false
17720 5551 Acked Write 6 Sent Done Done false
17721 5552 Acked Read 2 Sent Done Done false
17722 5553 Acked Write 3 Sent Done Done false
17723 5554 Acked Read 2 Sent Done Done false
17724 5555 Acked Read 2 Sent Done Done false
17725 5556 Acked Write 8 Sent Done Done false
17726 5557 Acked Write 8 Sent Done Done false
17727 5558 Acked Write 6 Sent Done Done false
17728 5559 Acked Write 6 Sent Done Done false
17729 5560 Acked Read 1 Sent Done Done false
17730 5561 Acked Read 5 Sent Done Done false
17731 5562 Acked Write 6 Sent Done Done false
17732 5563 Acked Write 1 Sent Done Done false
17733 5564 Acked Write 3 Sent Done Done false
17734 5565 Acked Write 2 Sent Done Done false
17735 5566 Acked Read 7 Sent Done Done false
17736 5567 Acked Read 1 Sent Done Done false
17737 5568 Acked Read 6 Sent Done Done false
17738 5569 Acked Write 4 Sent Done Done false
17739 5570 Acked Read 7 Sent Done Done false
17740 5571 Acked Read 8 Sent Done Done false
17741 5572 Acked Write 3 Sent Done Done false
17742 5573 Acked Read 8 Sent Done Done false
17743 5574 Acked Write 6 Sent Done Done false
17744 5575 Acked Write 9 Sent Done Done false
17745 5576 Acked Flush 0 Sent Done Done false
17746 5577 Acked Read 6 Sent Done Done false
17747 5578 Acked Read 9 Sent Done Done false
17748 5579 Acked Write 7 Sent Done Done false
17749 5580 Acked Write 10 Sent Done Done false
17750 5581 Acked Read 6 Sent Done Done false
17751 5582 Acked Write 5 Sent Done Done false
17752 5583 Acked Read 3 Sent Done Done false
17753 5584 Acked Read 1 Sent Done Done false
17754 5585 Acked Read 10 Sent Done Done false
17755 5586 Acked Write 8 Sent Done Done false
17756 5587 Acked Flush 0 Sent Done Done false
17757 5588 Acked Read 3 Sent Done Done false
17758 5589 Acked Write 2 Sent Done Done false
17759 5590 Acked Read 8 Sent Done Done false
17760 5591 Acked Read 9 Sent Done Done false
17761 5592 Acked Flush 0 Sent Done Done false
17762 5593 Acked Write 4 Sent Done Done false
17763 5594 Acked Flush 0 Sent Done Done false
17764 5595 Acked Read 2 Sent Done Done false
17765 5596 Acked Write 8 Sent Done Done false
17766 5597 Acked Read 7 Sent Done Done false
17767 5598 Acked Read 10 Sent Done Done false
17768 5599 Acked Read 1 Sent Done Done false
17769 5600 Acked Write 7 Sent Done Done false
17770 5601 Acked Write 10 Sent Done Done false
17771 5602 Acked Read 8 Sent Done Done false
17772 5603 Acked Write 10 Sent Done Done false
17773 5604 Acked Write 2 Sent Done Done false
17774 5605 Acked Write 6 Sent Done Done false
17775 5606 Acked Read 8 Sent Done Done false
17776 5607 Acked Read 9 Sent Done Done false
17777 5608 Acked Write 8 Sent Done Done false
17778 5609 Acked Write 5 Sent Done Done false
17779 5610 Acked Read 9 Sent Done Done false
17780 5611 Acked Write 8 Sent Done Done false
17781 5612 Acked Read 2 Sent Done Done false
17782 5613 Acked Read 7 Sent Done Done false
17783 5614 Acked Flush 0 Sent Done Done false
17784 5615 Acked Write 3 Sent Done Done false
17785 5616 Acked Write 7 Sent Done Done false
17786 5617 Acked Flush 0 Sent Done Done false
17787 5618 Acked Read 5 Sent Done Done false
17788 5619 Acked Read 3 Sent Done Done false
17789 5620 Acked Read 7 Sent Done Done false
17790 5621 Acked Write 6 Sent Done Done false
17791 5622 Acked Read 7 Sent Done Done false
17792 5623 Acked Read 8 Sent Done Done false
17793 5624 Acked Write 10 Sent Done Done false
17794 5625 Acked Read 5 Sent Done Done false
17795 5626 Acked Read 4 Sent Done Done false
17796 5627 Acked Flush 0 Sent Done Done false
17797 5628 Acked Write 10 Sent Done Done false
17798 5629 Acked Read 10 Sent Done Done false
17799 5630 Acked Read 9 Sent Done Done false
17800 5631 Acked Read 4 Sent Done Done false
17801 5632 Acked Write 2 Sent Done Done false
17802 5633 Acked Read 6 Sent Done Done false
17803 5634 Acked Read 6 Sent Done Done false
17804 5635 Acked Read 1 Sent Done Done false
17805 5636 Acked Write 9 Sent Done Done false
17806 5637 Acked Read 1 Sent Done Done false
17807 5638 Acked Read 3 Sent Done Done false
17808 5639 Acked Write 9 Sent Done Done false
17809 5640 Acked Write 1 Sent Done Done false
17810 5641 Acked Write 7 Sent Done Done false
17811 5642 Acked Read 10 Sent Done Done false
17812 5643 Acked Write 2 Sent Done Done false
17813 5644 Acked Read 9 Sent Done Done false
17814 5645 Acked Write 5 Sent Done Done false
17815 5646 Acked Write 3 Sent Done Done false
17816 5647 Acked Write 2 Sent Done Done false
17817 5648 Acked Write 10 Sent Done Done false
17818 5649 Acked Write 4 Sent Done Done false
17819 5650 Acked Read 4 Sent Done Done false
17820 5651 Acked Flush 0 Sent Done Done false
17821 5652 Acked Flush 0 Sent Done Done false
17822 5653 Acked Read 10 Sent Done Done false
17823 5654 Acked Flush 0 Sent Done Done false
17824 5655 Acked Read 5 Sent Done Done false
17825 5656 Acked Read 9 Sent Done Done false
17826 5657 Acked Read 6 Sent Done Done false
17827 5658 Acked Read 8 Sent Done Done false
17828 5659 Acked Flush 0 Sent Done Done false
17829 5660 Acked Read 4 Sent Done Done false
17830 5661 Acked Read 10 Sent Done Done false
17831 5662 Acked Write 4 Sent Done Done false
17832 5663 Acked Read 8 Sent Done Done false
17833 5664 Acked Write 6 Sent Done Done false
17834 5665 Acked Write 1 Sent Done Done false
17835 5666 Acked Write 4 Sent Done Done false
17836 5667 Acked Flush 0 Sent Done Done false
17837 5668 Acked Read 1 Sent Done Done false
17838 5669 Acked Flush 0 Sent Done Done false
17839 5670 Acked Write 2 Sent Done Done false
17840 5671 Acked Write 4 Sent Done Done false
17841 5672 Acked Read 3 Sent Done Done false
17842 5673 Acked Write 6 Sent Done Done false
17843 5674 Acked Read 6 Sent Done Done false
17844 5675 Acked Read 1 Sent Done Done false
17845 5676 Acked Read 7 Sent Done Done false
17846 5677 Acked Write 9 Sent Done Done false
17847 5678 Acked Write 4 Sent Done Done false
17848 5679 Acked Read 1 Sent Done Done false
17849 5680 Acked Read 1 Sent Done Done false
17850 5681 Acked Write 7 Sent Done Done false
17851 5682 Acked Write 4 Sent Done Done false
17852 5683 Acked Write 8 Sent Done Done false
17853 5684 Acked Read 6 Sent Done Done false
17854 5685 Acked Read 2 Sent Done Done false
17855 5686 Acked Read 2 Sent Done Done false
17856 5687 Acked Write 6 Sent Done Done false
17857 5688 Acked Read 5 Sent Done Done false
17858 5689 Acked Read 6 Sent Done Done false
17859 5690 Acked Write 8 Sent Done Done false
17860 5691 Acked Read 8 Sent Done Done false
17861 5692 Acked Write 2 Sent Done Done false
17862 5693 Acked Write 1 Sent Done Done false
17863 5694 Acked Write 2 Sent Done Done false
17864 5695 Acked Write 1 Sent Done Done false
17865 5696 Acked Read 2 Sent Done Done false
17866 5697 Acked Read 7 Sent Done Done false
17867 5698 Acked Read 10 Sent Done Done false
17868 5699 Acked Flush 0 Sent Done Done false
17869 5700 Acked Flush 0 Sent Done Done false
17870 5701 Acked Read 10 Sent Done Done false
17871 5702 Acked Read 10 Sent Done Done false
17872 5703 Acked Write 9 Sent Done Done false
17873 5704 Acked Read 9 Sent Done Done false
17874 5705 Acked Write 9 Sent Done Done false
17875 5706 Acked Write 4 Sent Done Done false
17876 5707 Acked Read 6 Sent Done Done false
17877 5708 Acked Read 7 Sent Done Done false
17878 5709 Acked Read 7 Sent Done Done false
17879 5710 Acked Flush 0 Sent Done Done false
17880 5711 Acked Read 8 Sent Done Done false
17881 5712 Acked Write 7 Sent Done Done false
17882 5713 Acked Read 9 Sent Done Done false
17883 5714 Acked Write 9 Sent Done Done false
17884 5715 Acked Write 7 Sent Done Done false
17885 5716 Acked Read 6 Sent Done Done false
17886 5717 Acked Write 3 Sent Done Done false
17887 5718 Acked Write 8 Sent Done Done false
17888 5719 Acked Read 6 Sent Done Done false
17889 5720 Acked Flush 0 Sent Done Done false
17890 5721 Acked Read 9 Sent Done Done false
17891 5722 Acked Write 9 Sent Done Done false
17892 5723 Acked Write 6 Sent Done Done false
17893 5724 Acked Write 7 Sent Done Done false
17894 5725 Acked Read 3 Sent Done Done false
17895 5726 Acked Read 7 Sent Done Done false
17896 5727 Acked Write 10 Sent Done Done false
17897 5728 Acked Write 8 Sent Done Done false
17898 5729 Acked Read 10 Sent Done Done false
17899 5730 Acked Read 6 Sent Done Done false
17900 5731 Acked Write 6 Sent Done Done false
17901 5732 Acked Read 1 Sent Done Done false
17902 5733 Acked Read 10 Sent Done Done false
17903 5734 Acked Flush 0 Sent Done Done false
17904 5735 Acked Read 1 Sent Done Done false
17905 5736 Acked Read 10 Sent Done Done false
17906 5737 Acked Read 9 Sent Done Done false
17907 5738 Acked Write 2 Sent Done Done false
17908 5739 Acked Write 10 Sent Done Done false
17909 5740 Acked Read 1 Sent Done Done false
17910 5741 Acked Read 5 Sent Done Done false
17911 5742 Acked Read 10 Sent Done Done false
17912 5743 Acked Read 3 Sent Done Done false
17913 5744 Acked Read 6 Sent Done Done false
17914 5745 Acked Flush 0 Sent Done Done false
17915 5746 Acked Read 7 Sent Done Done false
17916 5747 Acked Write 10 Sent Done Done false
17917 5748 Acked Write 3 Sent Done Done false
17918 5749 Acked Write 2 Sent Done Done false
17919 5750 Acked Write 6 Sent Done Done false
17920 5751 Acked Read 7 Sent Done Done false
17921 5752 Acked Write 9 Sent Done Done false
17922 5753 Acked Write 4 Sent Done Done false
17923 5754 Acked Write 6 Sent Done Done false
17924 5755 Acked Write 9 Sent Done Done false
17925 5756 Acked Write 8 Sent Done Done false
17926 5757 Acked Read 10 Sent Done Done false
17927 5758 Acked Write 9 Sent Done Done false
17928 5759 Acked Read 8 Sent Done Done false
17929 5760 Acked Write 2 Sent Done Done false
17930 5761 Acked Read 9 Sent Done Done false
17931 5762 Acked Write 9 Sent Done Done false
17932 5763 Acked Read 6 Sent Done Done false
17933 5764 Acked Write 5 Sent Done Done false
17934 5765 Acked Write 6 Sent Done Done false
17935 5766 Acked Read 2 Sent Done Done false
17936 5767 Acked Write 5 Sent Done Done false
17937 5768 Acked Flush 0 Sent Done Done false
17938 5769 Acked Write 3 Sent Done Done false
17939 5770 Acked Flush 0 Sent Done Done false
17940 5771 Acked Write 4 Sent Done Done false
17941 5772 Acked Write 6 Sent Done Done false
17942 5773 Acked Write 10 Sent Done Done false
17943 5774 Acked Read 10 Sent Done Done false
17944 5775 Acked Write 1 Sent Done Done false
17945 5776 Acked Read 10 Sent Done Done false
17946 5777 Acked Write 7 Sent Done Done false
17947 5778 Acked Write 2 Sent Done Done false
17948 5779 Acked Write 6 Sent Done Done false
17949 5780 Acked Read 1 Sent Done Done false
17950 5781 Acked Write 8 Sent Done Done false
17951 5782 Acked Flush 0 Sent Done Done false
17952 5783 Acked Read 10 Sent Done Done false
17953 5784 Acked Write 7 Sent Done Done false
17954 5785 Acked Read 4 Sent Done Done false
17955 5786 Acked Read 2 Sent Done Done false
17956 5787 Acked Read 6 Sent Done Done false
17957 5788 Acked Read 10 Sent Done Done false
17958 5789 Acked Read 3 Sent Done Done false
17959 5790 Acked Read 6 Sent Done Done false
17960 5791 Acked Read 4 Sent Done Done false
17961 5792 Acked Read 10 Sent Done Done false
17962 5793 Acked Write 8 Sent Done Done false
17963 5794 Acked Write 1 Sent Done Done false
17964 5795 Acked Write 5 Sent Done Done false
17965 5796 Acked Write 1 Sent Done Done false
17966 5797 Acked Write 6 Sent Done Done false
17967 5798 Acked Flush 0 Sent Done Done false
17968 5799 Acked Read 3 Sent Done Done false
17969 5800 Acked Read 2 Sent Done Done false
17970 5801 Acked Read 6 Sent Done Done false
17971 5802 Acked Read 5 Sent Done Done false
17972 5803 Acked Read 5 Sent Done Done false
17973 5804 Acked Read 8 Sent Done Done false
17974 5805 Acked Write 4 Sent Done Done false
17975 5806 Acked Read 6 Sent Done Done false
17976 5807 Acked Read 5 Sent Done Done false
17977 5808 Acked Read 8 Sent Done Done false
17978 5809 Acked Write 3 Sent Done Done false
17979 5810 Acked Write 5 Sent Done Done false
17980 5811 Acked Read 7 Sent Done Done false
17981 5812 Acked Read 6 Sent Done Done false
17982 5813 Acked Write 7 Sent Done Done false
17983 5814 Acked Flush 0 Sent Done Done false
17984 5815 Acked Flush 0 Sent Done Done false
17985 5816 Acked Write 2 Sent Done Done false
17986 5817 Acked Read 2 Sent Done Done false
17987 5818 Acked Write 10 Sent Done Done false
17988 5819 Acked Flush 0 Sent Done Done false
17989 5820 Acked Read 1 Sent Done Done false
17990 5821 Acked Write 5 Sent Done Done false
17991 5822 Acked Read 6 Sent Done Done false
17992 5823 Acked Write 6 Sent Done Done false
17993 5824 Acked Write 10 Sent Done Done false
17994 5825 Acked Read 2 Sent Done Done false
17995 5826 Acked Flush 0 Sent Done Done false
17996 5827 Acked Write 4 Sent Done Done false
17997 STATES DS:0 DS:1 DS:2 TOTAL
17998 Sent 301 0 0 301
17999 Done 0 301 301 602
18000 Skipped 0 0 0 0
18001 Error 0 0 0 0
18002 Last Flush: 5526 5826 5826
18003 Downstairs last five completed: 5526 5525 5524 5523 5522
18004 Upstairs last five completed: 5827 5826 5825 5824 5823
18005 CLIENT: Up:0 ds:301 act:2
18006 [8810] got start action
18007 [8810] I am going to restart
18008 Starting downstairs at port 8810
18009 Make output file at "/tmp/dsc/downstairs-8810.txt"
18010 [8810][0] reports Starting
18011 Downstairs /var/tmp/dsc/region/8810 port 8810 PID:Some(1218)
18012 [8810][0] reports Running
18013 ----------------------------------------------------------------
18014 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:302
18015 States: Offline Active Active
18016 JOBID ACK TYPE BKS/EXT DS:0 DS:1 DS:2 REPLAY
18017 5527 Acked Flush 0 Sent Done Done false
18018 5528 Acked Read 3 Sent Done Done false
18019 5529 Acked Write 7 Sent Done Done false
18020 5530 Acked Flush 0 Sent Done Done false
18021 5531 Acked Read 4 Sent Done Done false
18022 5532 Acked Flush 0 Sent Done Done false
18023 5533 Acked Read 8 Sent Done Done false
18024 5534 Acked Read 5 Sent Done Done false
18025 5535 Acked Write 10 Sent Done Done false
18026 5536 Acked Write 6 Sent Done Done false
18027 5537 Acked Flush 0 Sent Done Done false
18028 5538 Acked Read 3 Sent Done Done false
18029 5539 Acked Flush 0 Sent Done Done false
18030 5540 Acked Write 10 Sent Done Done false
18031 5541 Acked Read 4 Sent Done Done false
18032 5542 Acked Write 9 Sent Done Done false
18033 5543 Acked Read 5 Sent Done Done false
18034 5544 Acked Read 3 Sent Done Done false
18035 5545 Acked Read 9 Sent Done Done false
18036 5546 Acked Read 6 Sent Done Done false
18037 5547 Acked Write 1 Sent Done Done false
18038 5548 Acked Read 8 Sent Done Done false
18039 5549 Acked Flush 0 Sent Done Done false
18040 5550 Acked Write 2 Sent Done Done false
18041 5551 Acked Write 6 Sent Done Done false
18042 5552 Acked Read 2 Sent Done Done false
18043 5553 Acked Write 3 Sent Done Done false
18044 5554 Acked Read 2 Sent Done Done false
18045 5555 Acked Read 2 Sent Done Done false
18046 5556 Acked Write 8 Sent Done Done false
18047 5557 Acked Write 8 Sent Done Done false
18048 5558 Acked Write 6 Sent Done Done false
18049 5559 Acked Write 6 Sent Done Done false
18050 5560 Acked Read 1 Sent Done Done false
18051 5561 Acked Read 5 Sent Done Done false
18052 5562 Acked Write 6 Sent Done Done false
18053 5563 Acked Write 1 Sent Done Done false
18054 5564 Acked Write 3 Sent Done Done false
18055 5565 Acked Write 2 Sent Done Done false
18056 5566 Acked Read 7 Sent Done Done false
18057 5567 Acked Read 1 Sent Done Done false
18058 5568 Acked Read 6 Sent Done Done false
18059 5569 Acked Write 4 Sent Done Done false
18060 5570 Acked Read 7 Sent Done Done false
18061 5571 Acked Read 8 Sent Done Done false
18062 5572 Acked Write 3 Sent Done Done false
18063 5573 Acked Read 8 Sent Done Done false
18064 5574 Acked Write 6 Sent Done Done false
18065 5575 Acked Write 9 Sent Done Done false
18066 5576 Acked Flush 0 Sent Done Done false
18067 5577 Acked Read 6 Sent Done Done false
18068 5578 Acked Read 9 Sent Done Done false
18069 5579 Acked Write 7 Sent Done Done false
18070 5580 Acked Write 10 Sent Done Done false
18071 5581 Acked Read 6 Sent Done Done false
18072 5582 Acked Write 5 Sent Done Done false
18073 5583 Acked Read 3 Sent Done Done false
18074 5584 Acked Read 1 Sent Done Done false
18075 5585 Acked Read 10 Sent Done Done false
18076 5586 Acked Write 8 Sent Done Done false
18077 5587 Acked Flush 0 Sent Done Done false
18078 5588 Acked Read 3 Sent Done Done false
18079 5589 Acked Write 2 Sent Done Done false
18080 5590 Acked Read 8 Sent Done Done false
18081 5591 Acked Read 9 Sent Done Done false
18082 5592 Acked Flush 0 Sent Done Done false
18083 5593 Acked Write 4 Sent Done Done false
18084 5594 Acked Flush 0 Sent Done Done false
18085 5595 Acked Read 2 Sent Done Done false
18086 5596 Acked Write 8 Sent Done Done false
18087 5597 Acked Read 7 Sent Done Done false
18088 5598 Acked Read 10 Sent Done Done false
18089 5599 Acked Read 1 Sent Done Done false
18090 5600 Acked Write 7 Sent Done Done false
18091 5601 Acked Write 10 Sent Done Done false
18092 5602 Acked Read 8 Sent Done Done false
18093 5603 Acked Write 10 Sent Done Done false
18094 5604 Acked Write 2 Sent Done Done false
18095 5605 Acked Write 6 Sent Done Done false
18096 5606 Acked Read 8 Sent Done Done false
18097 5607 Acked Read 9 Sent Done Done false
18098 5608 Acked Write 8 Sent Done Done false
18099 5609 Acked Write 5 Sent Done Done false
18100 5610 Acked Read 9 Sent Done Done false
18101 5611 Acked Write 8 Sent Done Done false
18102 5612 Acked Read 2 Sent Done Done false
18103 5613 Acked Read 7 Sent Done Done false
18104 5614 Acked Flush 0 Sent Done Done false
18105 5615 Acked Write 3 Sent Done Done false
18106 5616 Acked Write 7 Sent Done Done false
18107 5617 Acked Flush 0 Sent Done Done false
18108 5618 Acked Read 5 Sent Done Done false
18109 5619 Acked Read 3 Sent Done Done false
18110 5620 Acked Read 7 Sent Done Done false
18111 5621 Acked Write 6 Sent Done Done false
18112 5622 Acked Read 7 Sent Done Done false
18113 5623 Acked Read 8 Sent Done Done false
18114 5624 Acked Write 10 Sent Done Done false
18115 5625 Acked Read 5 Sent Done Done false
18116 5626 Acked Read 4 Sent Done Done false
18117 5627 Acked Flush 0 Sent Done Done false
18118 5628 Acked Write 10 Sent Done Done false
18119 5629 Acked Read 10 Sent Done Done false
18120 5630 Acked Read 9 Sent Done Done false
18121 5631 Acked Read 4 Sent Done Done false
18122 5632 Acked Write 2 Sent Done Done false
18123 5633 Acked Read 6 Sent Done Done false
18124 5634 Acked Read 6 Sent Done Done false
18125 5635 Acked Read 1 Sent Done Done false
18126 5636 Acked Write 9 Sent Done Done false
18127 5637 Acked Read 1 Sent Done Done false
18128 5638 Acked Read 3 Sent Done Done false
18129 5639 Acked Write 9 Sent Done Done false
18130 5640 Acked Write 1 Sent Done Done false
18131 5641 Acked Write 7 Sent Done Done false
18132 5642 Acked Read 10 Sent Done Done false
18133 5643 Acked Write 2 Sent Done Done false
18134 5644 Acked Read 9 Sent Done Done false
18135 5645 Acked Write 5 Sent Done Done false
18136 5646 Acked Write 3 Sent Done Done false
18137 5647 Acked Write 2 Sent Done Done false
18138 5648 Acked Write 10 Sent Done Done false
18139 5649 Acked Write 4 Sent Done Done false
18140 5650 Acked Read 4 Sent Done Done false
18141 5651 Acked Flush 0 Sent Done Done false
18142 5652 Acked Flush 0 Sent Done Done false
18143 5653 Acked Read 10 Sent Done Done false
18144 5654 Acked Flush 0 Sent Done Done false
18145 5655 Acked Read 5 Sent Done Done false
18146 5656 Acked Read 9 Sent Done Done false
18147 5657 Acked Read 6 Sent Done Done false
18148 5658 Acked Read 8 Sent Done Done false
18149 5659 Acked Flush 0 Sent Done Done false
18150 5660 Acked Read 4 Sent Done Done false
18151 5661 Acked Read 10 Sent Done Done false
18152 5662 Acked Write 4 Sent Done Done false
18153 5663 Acked Read 8 Sent Done Done false
18154 5664 Acked Write 6 Sent Done Done false
18155 5665 Acked Write 1 Sent Done Done false
18156 5666 Acked Write 4 Sent Done Done false
18157 5667 Acked Flush 0 Sent Done Done false
18158 5668 Acked Read 1 Sent Done Done false
18159 5669 Acked Flush 0 Sent Done Done false
18160 5670 Acked Write 2 Sent Done Done false
18161 5671 Acked Write 4 Sent Done Done false
18162 5672 Acked Read 3 Sent Done Done false
18163 5673 Acked Write 6 Sent Done Done false
18164 5674 Acked Read 6 Sent Done Done false
18165 5675 Acked Read 1 Sent Done Done false
18166 5676 Acked Read 7 Sent Done Done false
18167 5677 Acked Write 9 Sent Done Done false
18168 5678 Acked Write 4 Sent Done Done false
18169 5679 Acked Read 1 Sent Done Done false
18170 5680 Acked Read 1 Sent Done Done false
18171 5681 Acked Write 7 Sent Done Done false
18172 5682 Acked Write 4 Sent Done Done false
18173 5683 Acked Write 8 Sent Done Done false
18174 5684 Acked Read 6 Sent Done Done false
18175 5685 Acked Read 2 Sent Done Done false
18176 5686 Acked Read 2 Sent Done Done false
18177 5687 Acked Write 6 Sent Done Done false
18178 5688 Acked Read 5 Sent Done Done false
18179 5689 Acked Read 6 Sent Done Done false
18180 5690 Acked Write 8 Sent Done Done false
18181 5691 Acked Read 8 Sent Done Done false
18182 5692 Acked Write 2 Sent Done Done false
18183 5693 Acked Write 1 Sent Done Done false
18184 5694 Acked Write 2 Sent Done Done false
18185 5695 Acked Write 1 Sent Done Done false
18186 5696 Acked Read 2 Sent Done Done false
18187 5697 Acked Read 7 Sent Done Done false
18188 5698 Acked Read 10 Sent Done Done false
18189 5699 Acked Flush 0 Sent Done Done false
18190 5700 Acked Flush 0 Sent Done Done false
18191 5701 Acked Read 10 Sent Done Done false
18192 5702 Acked Read 10 Sent Done Done false
18193 5703 Acked Write 9 Sent Done Done false
18194 5704 Acked Read 9 Sent Done Done false
18195 5705 Acked Write 9 Sent Done Done false
18196 5706 Acked Write 4 Sent Done Done false
18197 5707 Acked Read 6 Sent Done Done false
18198 5708 Acked Read 7 Sent Done Done false
18199 5709 Acked Read 7 Sent Done Done false
18200 5710 Acked Flush 0 Sent Done Done false
18201 5711 Acked Read 8 Sent Done Done false
18202 5712 Acked Write 7 Sent Done Done false
18203 5713 Acked Read 9 Sent Done Done false
18204 5714 Acked Write 9 Sent Done Done false
18205 5715 Acked Write 7 Sent Done Done false
18206 5716 Acked Read 6 Sent Done Done false
18207 5717 Acked Write 3 Sent Done Done false
18208 5718 Acked Write 8 Sent Done Done false
18209 5719 Acked Read 6 Sent Done Done false
18210 5720 Acked Flush 0 Sent Done Done false
18211 5721 Acked Read 9 Sent Done Done false
18212 5722 Acked Write 9 Sent Done Done false
18213 5723 Acked Write 6 Sent Done Done false
18214 5724 Acked Write 7 Sent Done Done false
18215 5725 Acked Read 3 Sent Done Done false
18216 5726 Acked Read 7 Sent Done Done false
18217 5727 Acked Write 10 Sent Done Done false
18218 5728 Acked Write 8 Sent Done Done false
18219 5729 Acked Read 10 Sent Done Done false
18220 5730 Acked Read 6 Sent Done Done false
18221 5731 Acked Write 6 Sent Done Done false
18222 5732 Acked Read 1 Sent Done Done false
18223 5733 Acked Read 10 Sent Done Done false
18224 5734 Acked Flush 0 Sent Done Done false
18225 5735 Acked Read 1 Sent Done Done false
18226 5736 Acked Read 10 Sent Done Done false
18227 5737 Acked Read 9 Sent Done Done false
18228 5738 Acked Write 2 Sent Done Done false
18229 5739 Acked Write 10 Sent Done Done false
18230 5740 Acked Read 1 Sent Done Done false
18231 5741 Acked Read 5 Sent Done Done false
18232 5742 Acked Read 10 Sent Done Done false
18233 5743 Acked Read 3 Sent Done Done false
18234 5744 Acked Read 6 Sent Done Done false
18235 5745 Acked Flush 0 Sent Done Done false
18236 5746 Acked Read 7 Sent Done Done false
18237 5747 Acked Write 10 Sent Done Done false
18238 5748 Acked Write 3 Sent Done Done false
18239 5749 Acked Write 2 Sent Done Done false
18240 5750 Acked Write 6 Sent Done Done false
18241 5751 Acked Read 7 Sent Done Done false
18242 5752 Acked Write 9 Sent Done Done false
18243 5753 Acked Write 4 Sent Done Done false
18244 5754 Acked Write 6 Sent Done Done false
18245 5755 Acked Write 9 Sent Done Done false
18246 5756 Acked Write 8 Sent Done Done false
18247 5757 Acked Read 10 Sent Done Done false
18248 5758 Acked Write 9 Sent Done Done false
18249 5759 Acked Read 8 Sent Done Done false
18250 5760 Acked Write 2 Sent Done Done false
18251 5761 Acked Read 9 Sent Done Done false
18252 5762 Acked Write 9 Sent Done Done false
18253 5763 Acked Read 6 Sent Done Done false
18254 5764 Acked Write 5 Sent Done Done false
18255 5765 Acked Write 6 Sent Done Done false
18256 5766 Acked Read 2 Sent Done Done false
18257 5767 Acked Write 5 Sent Done Done false
18258 5768 Acked Flush 0 Sent Done Done false
18259 5769 Acked Write 3 Sent Done Done false
18260 5770 Acked Flush 0 Sent Done Done false
18261 5771 Acked Write 4 Sent Done Done false
18262 5772 Acked Write 6 Sent Done Done false
18263 5773 Acked Write 10 Sent Done Done false
18264 5774 Acked Read 10 Sent Done Done false
18265 5775 Acked Write 1 Sent Done Done false
18266 5776 Acked Read 10 Sent Done Done false
18267 5777 Acked Write 7 Sent Done Done false
18268 5778 Acked Write 2 Sent Done Done false
18269 5779 Acked Write 6 Sent Done Done false
18270 5780 Acked Read 1 Sent Done Done false
18271 5781 Acked Write 8 Sent Done Done false
18272 5782 Acked Flush 0 Sent Done Done false
18273 5783 Acked Read 10 Sent Done Done false
18274 5784 Acked Write 7 Sent Done Done false
18275 5785 Acked Read 4 Sent Done Done false
18276 5786 Acked Read 2 Sent Done Done false
18277 5787 Acked Read 6 Sent Done Done false
18278 5788 Acked Read 10 Sent Done Done false
18279 5789 Acked Read 3 Sent Done Done false
18280 5790 Acked Read 6 Sent Done Done false
18281 5791 Acked Read 4 Sent Done Done false
18282 5792 Acked Read 10 Sent Done Done false
18283 5793 Acked Write 8 Sent Done Done false
18284 5794 Acked Write 1 Sent Done Done false
18285 5795 Acked Write 5 Sent Done Done false
18286 5796 Acked Write 1 Sent Done Done false
18287 5797 Acked Write 6 Sent Done Done false
18288 5798 Acked Flush 0 Sent Done Done false
18289 5799 Acked Read 3 Sent Done Done false
18290 5800 Acked Read 2 Sent Done Done false
18291 5801 Acked Read 6 Sent Done Done false
18292 5802 Acked Read 5 Sent Done Done false
18293 5803 Acked Read 5 Sent Done Done false
18294 5804 Acked Read 8 Sent Done Done false
18295 5805 Acked Write 4 Sent Done Done false
18296 5806 Acked Read 6 Sent Done Done false
18297 5807 Acked Read 5 Sent Done Done false
18298 5808 Acked Read 8 Sent Done Done false
18299 5809 Acked Write 3 Sent Done Done false
18300 5810 Acked Write 5 Sent Done Done false
18301 5811 Acked Read 7 Sent Done Done false
18302 5812 Acked Read 6 Sent Done Done false
18303 5813 Acked Write 7 Sent Done Done false
18304 5814 Acked Flush 0 Sent Done Done false
18305 5815 Acked Flush 0 Sent Done Done false
18306 5816 Acked Write 2 Sent Done Done false
18307 5817 Acked Read 2 Sent Done Done false
18308 5818 Acked Write 10 Sent Done Done false
18309 5819 Acked Flush 0 Sent Done Done false
18310 5820 Acked Read 1 Sent Done Done false
18311 5821 Acked Write 5 Sent Done Done false
18312 5822 Acked Read 6 Sent Done Done false
18313 5823 Acked Write 6 Sent Done Done false
18314 5824 Acked Write 10 Sent Done Done false
18315 5825 Acked Read 2 Sent Done Done false
18316 5826 Acked Flush 0 Sent Done Done false
18317 5827 Acked Write 4 Sent Done Done false
18318 5828 Acked Flush 0 Sent Done Done false
18319 STATES DS:0 DS:1 DS:2 TOTAL
18320 Sent 302 0 0 302
18321 Done 0 302 302 604
18322 Skipped 0 0 0 0
18323 Error 0 0 0 0
18324 Last Flush: 5526 5828 5828
18325 Downstairs last five completed: 5526 5525 5524 5523 5522
18326 Upstairs last five completed: 5828 5827 5826 5825 5824
18327 CLIENT: Up:0 ds:302 act:2
183282025-01-10T16:39:09.424ZINFOcrucible: connecting to 127.0.0.1:8810 = io task client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
183292025-01-10T16:39:09.424ZINFOcrucible: ds_connection connected from Ok(127.0.0.1:51063) = io task client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
183302025-01-10T16:39:09.425ZWARNcrucible: version negotiation from state Offline = downstairs client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
183312025-01-10T16:39:09.425ZINFOcrucible: downstairs client at Some(127.0.0.1:8810) has region UUID 12345678-0000-0000-0000-000000008810 = downstairs client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
183322025-01-10T16:39:09.425ZINFOcrucible: Returning UUID:12345678-0000-0000-0000-000000008810 matches = downstairs client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
183332025-01-10T16:39:09.425ZINFOcrucible: send last flush ID to this DS: 5526 = downstairs client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
183342025-01-10T16:39:09.426ZINFOcrucible: Replied this last flush ID: 5526 = downstairs client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
183352025-01-10T16:39:09.426ZINFOcrucible: ds_transition from Offline to Active = downstairs client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
183362025-01-10T16:39:09.426ZINFOcrucible: [0] Transition from Offline to Active = downstairs client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
183372025-01-10T16:39:09.426ZINFOcrucible: [0] client re-new 302 jobs since flush 5526 = downstairs session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
183382025-01-10T16:39:09.426ZINFOcrucible: [0] Replayed 302 jobs since flush: 5526 = downstairs session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
18339 ----------------------------------------------------------------
18340 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:0
18341 Downstairs last five completed: 5828 5827 5826 5825 5824
18342 Upstairs last five completed: 5828 5827 5826 5825 5824
18343 CLIENT: Up:0 ds:0 act:3
18344 Replay: All jobs finished
18345 Main task has work to do, go find it
18346 got dsc Stop(1)
18347 stop 1
18348 [8820] Got stop action so:false kr:false
18349 Jan 10 16:39:11.666 INFO request completed, latency_us: 330, response_code: 204, uri: /stop/cid/1, method: POST, req_id: 178b0d8f-e354-48eb-87aa-2271bbbd8601, remote_addr: 127.0.0.1:55917, local_addr: 127.0.0.1:9998
183502025-01-10T16:39:11.666ZWARNcrucible: downstairs disconnected = io task client = 1 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
18351 Jan 10 16:39:11.666 INFO request completed, latency_us: 154, response_code: 200, uri: /state/cid/1, method: GET, req_id: 6136ef50-df51-43e0-92b6-d0706b12707a, remote_addr: 127.0.0.1:55917, local_addr: 127.0.0.1:9998
183522025-01-10T16:39:11.667ZWARNcrucible: client task is sending Done(Finished) = io task client = 1 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
183532025-01-10T16:39:11.667ZWARNcrucible: downstairs task for 1 stopped due to Finished session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
183542025-01-10T16:39:11.667ZINFOcrucible: ds_transition from Active to Offline = downstairs client = 1 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
183552025-01-10T16:39:11.667ZINFOcrucible: [1] Transition from Active to Offline = downstairs client = 1 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
183562025-01-10T16:39:11.667ZINFOcrucible: client task is exiting = io task client = 1 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
18357 [8820] Exited with: ExitStatus(unix_wait_status(9))
18358 [8820][1] reports Exit
18359 Jan 10 16:39:15.669 INFO request completed, latency_us: 368, response_code: 200, uri: /state/cid/1, method: GET, req_id: b9d6b3a8-be63-4dbc-8c0e-ef0fa8535066, remote_addr: 127.0.0.1:55917, local_addr: 127.0.0.1:9998
18360 001/300 Write block 3368 len 12288 data: 4 5 6
18361 002/300 Write block 3616 len 32768 data: 4 3 2 3 4 4 3 3
18362 003/300 Read block 2838 len 4096
18363 004/300 Write block 1591 len 4096 data: 5
18364 005/300 Read block 2857 len 4096
18365 006/300 Write block 3855 len 20480 data: 6 3 3 2 2
18366 007/300 Write block 251 len 32768 data: 3 5 5 5 6 7 6 3
18367 008/300 Write block 4276 len 32768 data: 2 2 2 2 3 4 4 3
18368 009/300 Write block 527 len 4096 data: 4
18369 010/300 Write block 416 len 4096 data: 4
18370 011/300 Write block 3941 len 12288 data: 4 6 7
18371 012/300 Read block 411 len 24576
18372 013/300 Flush
18373 014/300 Flush
18374 015/300 Read block 768 len 36864
18375 016/300 Read block 1516 len 40960
18376 017/300 Write block 1573 len 4096 data: 4
18377 018/300 Flush
18378 019/300 Write block 3034 len 20480 data: 5 5 5 5 5
18379 020/300 Read block 1101 len 36864
18380 021/300 Read block 2355 len 8192
18381 022/300 Write block 3974 len 20480 data: 5 5 5 5 5
18382 023/300 Read block 2100 len 32768
18383 024/300 Write block 3452 len 32768 data: 3 3 2 3 3 4 4 3
18384 025/300 Write block 543 len 36864 data: 5 5 4 5 5 6 7 7 5
18385 026/300 Read block 372 len 36864
18386 027/300 Write block 2580 len 40960 data: 3 3 4 6 6 6 5 6 7 7
18387 028/300 Read block 1377 len 8192
18388 029/300 Read block 3549 len 4096
18389 030/300 Flush
18390 031/300 Read block 3671 len 32768
18391 032/300 Write block 2897 len 32768 data: 7 7 8 8 8 7 5 5
18392 033/300 Write block 2945 len 20480 data: 4 5 7 6 6
18393 034/300 Read block 3280 len 40960
18394 035/300 Write block 2149 len 36864 data: 6 5 6 6 5 6 6 6 5
18395 036/300 Read block 22 len 8192
18396 037/300 Write block 2141 len 4096 data: 7
18397 038/300 Read block 2084 len 24576
18398 039/300 Write block 2882 len 36864 data: 5 5 6 5 6 6 4 5 5
18399 040/300 Read block 1943 len 40960
18400 041/300 Write block 3004 len 40960 data: 7 4 4 4 3 2 2 2 4 4
18401 042/300 Read block 2590 len 12288
18402 043/300 Read block 1390 len 12288
18403 044/300 Write block 1584 len 20480 data: 2 2 2 4 4
18404 045/300 Write block 723 len 28672 data: 8 9 8 7 7 5 4
18405 046/300 Write block 3058 len 4096 data: 4
18406 047/300 Write block 3020 len 32768 data: 5 4 4 4 4 4 4 3
18407 048/300 Read block 506 len 28672
18408 049/300 Read block 2254 len 4096
18409 050/300 Read block 812 len 4096
18410 051/300 Write block 1340 len 24576 data: 7 7 8 5 6 5
18411 052/300 Write block 2012 len 12288 data: 3 2 3
18412 053/300 Write block 2307 len 40960 data: 6 5 5 5 5 5 6 6 5 4
18413 054/300 Flush
18414 055/300 Flush
18415 056/300 Write block 841 len 16384 data: 5 5 6 6
18416 057/300 Write block 971 len 20480 data: 6 5 5 5 5
18417 058/300 Flush
18418 059/300 Write block 3738 len 8192 data: 4 4
18419 060/300 Read block 670 len 8192
18420 061/300 Read block 667 len 40960
18421 062/300 Read block 1077 len 8192
18422 063/300 Write block 890 len 36864 data: 3 3 3 3 2 4 3 3 3
18423 064/300 Write block 1825 len 32768 data: 5 5 5 5 5 4 4 5
18424 065/300 Write block 2685 len 28672 data: 6 6 5 5 5 4 5
18425 066/300 Read block 3578 len 32768
18426 067/300 Write block 4807 len 12288 data: 6 6 5
18427 068/300 Read block 496 len 28672
18428 069/300 Write block 3669 len 32768 data: 4 6 6 6 6 6 6 6
18429 070/300 Read block 1135 len 36864
18430 071/300 Read block 4088 len 24576
18431 072/300 Flush
18432 073/300 Write block 3455 len 32768 data: 4 4 5 5 4 4 3 3
18433 074/300 Write block 3865 len 4096 data: 6
18434 075/300 Write block 2193 len 24576 data: 6 6 7 7 7 7
18435 076/300 Read block 486 len 4096
18436 077/300 Write block 4116 len 24576 data: 4 4 4 5 6 6
18437 078/300 Write block 86 len 32768 data: 2 2 3 4 4 4 4 4
18438 079/300 Read block 1337 len 24576
18439 080/300 Write block 4477 len 4096 data: 2
18440 081/300 Read block 2463 len 4096
18441 082/300 Write block 2721 len 16384 data: 3 2 3 4
18442 083/300 Write block 4430 len 32768 data: 10 9 9 8 8 7 4 4
18443 084/300 Read block 423 len 4096
18444 085/300 Flush
18445 086/300 Write block 3144 len 8192 data: 4 4
18446 087/300 Read block 3875 len 36864
18447 088/300 Write block 3462 len 32768 data: 4 3 4 4 4 4 4 3
18448 089/300 Write block 2689 len 16384 data: 6 5 6 4
18449 090/300 Read block 732 len 32768
18450 091/300 Read block 1793 len 8192
18451 092/300 Flush
18452 093/300 Write block 1972 len 12288 data: 3 4 4
18453 094/300 Write block 4648 len 4096 data: 3
18454 095/300 Read block 733 len 20480
18455 096/300 Write block 3069 len 16384 data: 4 3 2 2
18456 097/300 Read block 675 len 16384
18457 098/300 Write block 1647 len 4096 data: 3
18458 099/300 Read block 700 len 36864
18459 100/300 Read block 4793 len 36864
18460 101/300 Read block 4621 len 4096
18461 102/300 Read block 4298 len 12288
18462 103/300 Read block 2418 len 20480
18463 104/300 Write block 2074 len 12288 data: 4 4 4
18464 105/300 Read block 948 len 4096
18465 106/300 Read block 4098 len 28672
18466 107/300 Write block 2969 len 16384 data: 3 3 3 3
18467 108/300 Read block 1765 len 36864
18468 109/300 Flush
18469 110/300 Read block 4101 len 16384
18470 111/300 Read block 4291 len 36864
18471 112/300 Write block 3913 len 20480 data: 3 3 4 5 5
18472 113/300 Flush
18473 114/300 Read block 4783 len 24576
18474 115/300 Flush
18475 116/300 Write block 4423 len 20480 data: 4 4 3 4 6
18476 117/300 Read block 4511 len 40960
18477 118/300 Read block 1411 len 20480
18478 119/300 Write block 53 len 20480 data: 2 2 2 2 2
18479 120/300 Read block 2844 len 8192
18480 121/300 Read block 2109 len 40960
18481 122/300 Read block 4483 len 8192
18482 123/300 Write block 1794 len 12288 data: 3 3 3
18483 124/300 Write block 2890 len 4096 data: 6
18484 125/300 Flush
18485 126/300 Write block 3827 len 40960 data: 3 3 4 4 3 4 4 4 5 4
18486 127/300 Write block 334 len 24576 data: 3 5 6 4 4 5
18487 128/300 Write block 4921 len 32768 data: 4 3 3 3 2 3 3 3
18488 129/300 Write block 2760 len 8192 data: 6 5
18489 130/300 Write block 1690 len 16384 data: 4 5 5 5
18490 131/300 Write block 2905 len 28672 data: 3 2 2 2 2 4 3
18491 132/300 Write block 2333 len 32768 data: 5 5 5 4 4 3 4 4
18492 133/300 Read block 2408 len 12288
18493 134/300 Write block 3704 len 40960 data: 4 4 5 5 7 7 6 8 7 6
18494 135/300 Read block 4618 len 40960
18495 136/300 Flush
18496 137/300 Read block 570 len 12288
18497 138/300 Write block 3347 len 16384 data: 2 3 2 2
18498 139/300 Read block 2367 len 28672
18499 140/300 Read block 808 len 16384
18500 141/300 Read block 3135 len 40960
18501 142/300 Write block 4157 len 40960 data: 4 3 4 5 5 7 6 6 8 8
18502 143/300 Flush
18503 144/300 Read block 1400 len 4096
18504 145/300 Read block 484 len 28672
18505 146/300 Read block 3001 len 8192
18506 147/300 Read block 1975 len 8192
18507 148/300 Write block 2262 len 16384 data: 3 3 3 3
18508 149/300 Write block 4768 len 24576 data: 4 5 5 4 5 5
18509 150/300 Read block 3605 len 36864
18510 151/300 Write block 1754 len 12288 data: 5 5 4
18511 152/300 Write block 221 len 8192 data: 6 5
18512 153/300 Read block 3665 len 32768
18513 154/300 Read block 4657 len 20480
18514 155/300 Read block 2117 len 4096
18515 156/300 Read block 1264 len 36864
18516 157/300 Flush
18517 158/300 Write block 4273 len 24576 data: 2 2 2 3 3 3
18518 159/300 Read block 1242 len 12288
18519 160/300 Flush
18520 161/300 Read block 3703 len 16384
18521 162/300 Read block 1012 len 16384
18522 163/300 Read block 3560 len 28672
18523 164/300 Write block 2998 len 16384 data: 5 4 4 5
18524 165/300 Write block 459 len 4096 data: 2
18525 166/300 Flush
18526 167/300 Read block 3274 len 24576
18527 168/300 Read block 45 len 36864
18528 169/300 Write block 2726 len 36864 data: 4 4 5 5 4 5 5 3 3
18529 170/300 Write block 2350 len 12288 data: 4 3 3
18530 171/300 Write block 4686 len 8192 data: 6 5
18531 172/300 Read block 2163 len 24576
18532 173/300 Flush
18533 174/300 Write block 922 len 32768 data: 4 4 4 5 4 4 5 5
18534 175/300 Read block 3137 len 28672
18535 176/300 Read block 2919 len 12288
18536 177/300 Read block 2945 len 32768
18537 178/300 Write block 4099 len 16384 data: 3 3 3 3
18538 179/300 Read block 400 len 32768
18539 180/300 Read block 454 len 20480
18540 181/300 Read block 1720 len 28672
18541 182/300 Write block 2376 len 32768 data: 4 4 4 4 2 3 4 4
18542 183/300 Write block 1448 len 12288 data: 4 3 2
18543 184/300 Write block 1360 len 8192 data: 4 4
18544 185/300 Flush
18545 186/300 Read block 2360 len 8192
18546 187/300 Write block 4600 len 24576 data: 2 2 2 2 2 2
18547 188/300 Read block 4018 len 32768
18548 189/300 Write block 3555 len 12288 data: 3 3 3
18549 190/300 Read block 4878 len 32768
18550 191/300 Write block 1983 len 4096 data: 4
18551 192/300 Write block 3256 len 20480 data: 3 2 2 2 2
18552 193/300 Read block 4488 len 20480
18553 194/300 Read block 518 len 28672
18554 195/300 Read block 4543 len 12288
18555 196/300 Write block 1360 len 16384 data: 5 5 4 5
18556 197/300 Write block 250 len 32768 data: 3 4 6 6 6 7 8 7
18557 198/300 Write block 4686 len 12288 data: 7 6 4
18558 199/300 Read block 279 len 8192
18559 200/300 Write block 274 len 8192 data: 3 3
18560 201/300 Write block 233 len 16384 data: 3 3 3 4
18561 202/300 Read block 2590 len 36864
18562 203/300 Read block 2896 len 8192
18563 204/300 Write block 822 len 20480 data: 3 3 3 3 2
18564 205/300 Write block 2571 len 4096 data: 4
18565 206/300 Read block 3416 len 8192
18566 207/300 Flush
18567 208/300 Write block 1477 len 8192 data: 3 4
18568 209/300 Write block 1317 len 8192 data: 7 6
18569 210/300 Flush
18570 211/300 Write block 4178 len 20480 data: 5 4 4 4 4
18571 212/300 Read block 1985 len 4096
18572 213/300 Write block 4856 len 32768 data: 4 4 4 6 6 7 6 5
18573 214/300 Write block 3593 len 24576 data: 3 4 4 5 5 4
18574 215/300 Write block 4500 len 36864 data: 3 4 4 4 4 4 4 3 4
18575 216/300 Read block 627 len 24576
18576 217/300 Write block 837 len 20480 data: 5 5 6 6 6
18577 218/300 Read block 4638 len 12288
18578 219/300 Read block 1168 len 16384
18579 220/300 Read block 4603 len 20480
18580 221/300 Read block 4071 len 36864
18581 222/300 Read block 2590 len 4096
18582 223/300 Write block 2643 len 36864 data: 6 5 4 4 4 4 5 5 5
18583 224/300 Read block 4133 len 36864
18584 225/300 Read block 1130 len 40960
18585 226/300 Read block 4232 len 8192
18586 227/300 Read block 4394 len 24576
18587 228/300 Write block 3633 len 20480 data: 3 3 4 4 3
18588 229/300 Read block 2083 len 36864
18589 230/300 Read block 1645 len 28672
18590 231/300 Read block 3225 len 32768
18591 232/300 Read block 715 len 28672
18592 233/300 Read block 4729 len 40960
18593 234/300 Write block 3853 len 16384 data: 4 5 7 4
18594 235/300 Write block 1719 len 40960 data: 3 3 3 3 4 4 3 4 5 4
18595 236/300 Read block 4707 len 16384
18596 237/300 Read block 24 len 24576
18597 238/300 Read block 2234 len 28672
18598 239/300 Flush
18599 240/300 Write block 2141 len 4096 data: 8
18600 241/300 Write block 1963 len 8192 data: 4 3
18601 242/300 Write block 1104 len 32768 data: 3 3 3 4 4 5 5 4
18602 243/300 Write block 271 len 24576 data: 5 5 4 4 4 5
18603 244/300 Read block 1566 len 32768
18604 245/300 Flush
18605 246/300 Read block 1550 len 40960
18606 247/300 Read block 2133 len 24576
18607 248/300 Read block 1329 len 36864
18608 249/300 Flush
18609 250/300 Write block 4337 len 8192 data: 4 4
18610 251/300 Read block 1126 len 36864
18611 252/300 Write block 4050 len 8192 data: 4 4
18612 253/300 Flush
18613 254/300 Flush
18614 255/300 Read block 3479 len 32768
18615 256/300 Read block 4321 len 4096
18616 257/300 Write block 1431 len 12288 data: 3 2 2
18617 258/300 Write block 1088 len 40960 data: 4 4 3 4 3 3 3 3 4 6
18618 259/300 Write block 2342 len 20480 data: 3 3 5 5 5
18619 260/300 Write block 1737 len 32768 data: 4 4 3 3 3 3 5 5
18620 261/300 Read block 78 len 4096
18621 262/300 Write block 4360 len 20480 data: 4 5 5 5 4
18622 263/300 Read block 4891 len 8192
18623 264/300 Read block 311 len 36864
18624 265/300 Write block 1028 len 28672 data: 4 5 6 5 5 5 6
18625 266/300 Write block 2984 len 12288 data: 4 6 6
18626 267/300 Read block 2087 len 36864
18627 268/300 Write block 2798 len 36864 data: 4 4 4 3 4 4 5 5 4
18628 269/300 Read block 373 len 12288
18629 270/300 Read block 2444 len 32768
18630 271/300 Write block 409 len 20480 data: 3 3 3 3 3
18631 272/300 Read block 2957 len 16384
18632 273/300 Read block 4965 len 40960
18633 274/300 Read block 4155 len 32768
18634 275/300 Flush
18635 276/300 Write block 2667 len 36864 data: 2 2 2 2 2 3 3 3 4
18636 277/300 Read block 4748 len 36864
18637 278/300 Read block 478 len 40960
18638 279/300 Write block 2028 len 12288 data: 3 4 4
18639 280/300 Read block 496 len 40960
18640 281/300 Read block 3766 len 12288
18641 282/300 Read block 3823 len 40960
18642 283/300 Read block 3886 len 16384
18643 284/300 Write block 933 len 32768 data: 6 6 4 5 5 4 3 3
18644 285/300 Write block 1618 len 36864 data: 4 3 2 2 4 3 3 4 4
18645 286/300 Flush
18646 287/300 Flush
18647 288/300 Read block 524 len 28672
18648 289/300 Read block 4480 len 32768
18649 290/300 Read block 2175 len 12288
18650 291/300 Write block 1926 len 20480 data: 4 4 4 4 5
18651 292/300 Flush
18652 293/300 Read block 2779 len 24576
18653 294/300 Flush
18654 295/300 Write block 3263 len 32768 data: 5 5 5 4 4 3 3 3
18655 296/300 Read block 4869 len 12288
18656 297/300 Read block 2728 len 32768
18657 298/300 Write block 1450 len 40960 data: 3 2 3 5 5 5 4 5 6 7
18658 299/300 Write block 3520 len 28672 data: 2 3 4 4 4 4 4
18659 300/300 Flush
18660 301/300 Write block 4414 len 12288 data: 4 4 4
18661 Main task has work to do, go find it
18662 got dsc Start(1)
18663 start 1
18664 Jan 10 16:39:15.899 INFO request completed, latency_us: 215, response_code: 204, uri: /start/cid/1, method: POST, req_id: c5236ac1-d3d1-4552-b8d4-b0220de49d22, remote_addr: 127.0.0.1:55917, local_addr: 127.0.0.1:9998
18665 Replay: started 1, returned:Ok(())
18666 ----------------------------------------------------------------
18667 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:301
18668 States: Active Offline Active
18669 JOBID ACK TYPE BKS/EXT DS:0 DS:1 DS:2 REPLAY
18670 5829 Acked Write 3 Done Sent Done false
18671 5830 Acked Write 8 Done Sent Done false
18672 5831 Acked Read 1 Done Sent Done false
18673 5832 Acked Write 1 Done Sent Done false
18674 5833 Acked Read 1 Done Sent Done false
18675 5834 Acked Write 5 Done Sent Done false
18676 5835 Acked Write 8 Done Sent Done false
18677 5836 Acked Write 8 Done Sent Done false
18678 5837 Acked Write 1 Done Sent Done false
18679 5838 Acked Write 1 Done Sent Done false
18680 5839 Acked Write 3 Done Sent Done false
18681 5840 Acked Read 6 Done Sent Done false
18682 5841 Acked Flush 0 Done Sent Done false
18683 5842 Acked Flush 0 Done Sent Done false
18684 5843 Acked Read 9 Done Sent Done false
18685 5844 Acked Read 10 Done Sent Done false
18686 5845 Acked Write 1 Done Sent Done false
18687 5846 Acked Flush 0 Done Sent Done false
18688 5847 Acked Write 5 Done Sent Done false
18689 5848 Acked Read 9 Done Sent Done false
18690 5849 Acked Read 2 Done Sent Done false
18691 5850 Acked Write 5 Done Sent Done false
18692 5851 Acked Read 8 Done Sent Done false
18693 5852 Acked Write 8 Done Sent Done false
18694 5853 Acked Write 9 Done Sent Done false
18695 5854 Acked Read 9 Done Sent Done false
18696 5855 Acked Write 10 Done Sent Done false
18697 5856 Acked Read 2 Done Sent Done false
18698 5857 Acked Read 1 Done Sent Done false
18699 5858 Acked Flush 0 Done Sent Done false
18700 5859 Acked Read 8 Done Sent Done false
18701 5860 Acked Write 8 Done Sent Done false
18702 5861 Acked Write 5 Done Sent Done false
18703 5862 Acked Read 10 Done Sent Done false
18704 5863 Acked Write 9 Done Sent Done false
18705 5864 Acked Read 2 Done Sent Done false
18706 5865 Acked Write 1 Done Sent Done false
18707 5866 Acked Read 6 Done Sent Done false
18708 5867 Acked Write 9 Done Sent Done false
18709 5868 Acked Read 10 Done Sent Done false
18710 5869 Acked Write 10 Done Sent Done false
18711 5870 Acked Read 3 Done Sent Done false
18712 5871 Acked Read 3 Done Sent Done false
18713 5872 Acked Write 5 Done Sent Done false
18714 5873 Acked Write 7 Done Sent Done false
18715 5874 Acked Write 1 Done Sent Done false
18716 5875 Acked Write 8 Done Sent Done false
18717 5876 Acked Read 7 Done Sent Done false
18718 5877 Acked Read 1 Done Sent Done false
18719 5878 Acked Read 1 Done Sent Done false
18720 5879 Acked Write 6 Done Sent Done false
18721 5880 Acked Write 3 Done Sent Done false
18722 5881 Acked Write 10 Done Sent Done false
18723 5882 Acked Flush 0 Done Sent Done false
18724 5883 Acked Flush 0 Done Sent Done false
18725 5884 Acked Write 4 Done Sent Done false
18726 5885 Acked Write 5 Done Sent Done false
18727 5886 Acked Flush 0 Done Sent Done false
18728 5887 Acked Write 2 Done Sent Done false
18729 5888 Acked Read 2 Done Sent Done false
18730 5889 Acked Read 10 Done Sent Done false
18731 5890 Acked Read 2 Done Sent Done false
18732 5891 Acked Write 9 Done Sent Done false
18733 5892 Acked Write 8 Done Sent Done false
18734 5893 Acked Write 7 Done Sent Done false
18735 5894 Acked Read 8 Done Sent Done false
18736 5895 Acked Write 3 Done Sent Done false
18737 5896 Acked Read 7 Done Sent Done false
18738 5897 Acked Write 8 Done Sent Done false
18739 5898 Acked Read 9 Done Sent Done false
18740 5899 Acked Read 6 Done Sent Done false
18741 5900 Acked Flush 0 Done Sent Done false
18742 5901 Acked Write 8 Done Sent Done false
18743 5902 Acked Write 1 Done Sent Done false
18744 5903 Acked Write 6 Done Sent Done false
18745 5904 Acked Read 1 Done Sent Done false
18746 5905 Acked Write 6 Done Sent Done false
18747 5906 Acked Write 8 Done Sent Done false
18748 5907 Acked Read 6 Done Sent Done false
18749 5908 Acked Write 1 Done Sent Done false
18750 5909 Acked Read 1 Done Sent Done false
18751 5910 Acked Write 4 Done Sent Done false
18752 5911 Acked Write 8 Done Sent Done false
18753 5912 Acked Read 1 Done Sent Done false
18754 5913 Acked Flush 0 Done Sent Done false
18755 5914 Acked Write 2 Done Sent Done false
18756 5915 Acked Read 9 Done Sent Done false
18757 5916 Acked Write 8 Done Sent Done false
18758 5917 Acked Write 4 Done Sent Done false
18759 5918 Acked Read 8 Done Sent Done false
18760 5919 Acked Read 2 Done Sent Done false
18761 5920 Acked Flush 0 Done Sent Done false
18762 5921 Acked Write 3 Done Sent Done false
18763 5922 Acked Write 1 Done Sent Done false
18764 5923 Acked Read 5 Done Sent Done false
18765 5924 Acked Write 4 Done Sent Done false
18766 5925 Acked Read 4 Done Sent Done false
18767 5926 Acked Write 1 Done Sent Done false
18768 5927 Acked Read 9 Done Sent Done false
18769 5928 Acked Read 9 Done Sent Done false
18770 5929 Acked Read 1 Done Sent Done false
18771 5930 Acked Read 3 Done Sent Done false
18772 5931 Acked Read 5 Done Sent Done false
18773 5932 Acked Write 3 Done Sent Done false
18774 5933 Acked Read 1 Done Sent Done false
18775 5934 Acked Read 7 Done Sent Done false
18776 5935 Acked Write 4 Done Sent Done false
18777 5936 Acked Read 9 Done Sent Done false
18778 5937 Acked Flush 0 Done Sent Done false
18779 5938 Acked Read 4 Done Sent Done false
18780 5939 Acked Read 9 Done Sent Done false
18781 5940 Acked Write 5 Done Sent Done false
18782 5941 Acked Flush 0 Done Sent Done false
18783 5942 Acked Read 6 Done Sent Done false
18784 5943 Acked Flush 0 Done Sent Done false
18785 5944 Acked Write 5 Done Sent Done false
18786 5945 Acked Read 10 Done Sent Done false
18787 5946 Acked Read 5 Done Sent Done false
18788 5947 Acked Write 5 Done Sent Done false
18789 5948 Acked Read 2 Done Sent Done false
18790 5949 Acked Read 10 Done Sent Done false
18791 5950 Acked Read 2 Done Sent Done false
18792 5951 Acked Write 3 Done Sent Done false
18793 5952 Acked Write 1 Done Sent Done false
18794 5953 Acked Flush 0 Done Sent Done false
18795 5954 Acked Write 10 Done Sent Done false
18796 5955 Acked Write 6 Done Sent Done false
18797 5956 Acked Write 8 Done Sent Done false
18798 5957 Acked Write 2 Done Sent Done false
18799 5958 Acked Write 4 Done Sent Done false
18800 5959 Acked Write 7 Done Sent Done false
18801 5960 Acked Write 8 Done Sent Done false
18802 5961 Acked Read 3 Done Sent Done false
18803 5962 Acked Write 10 Done Sent Done false
18804 5963 Acked Read 10 Done Sent Done false
18805 5964 Acked Flush 0 Done Sent Done false
18806 5965 Acked Read 3 Done Sent Done false
18807 5966 Acked Write 4 Done Sent Done false
18808 5967 Acked Read 7 Done Sent Done false
18809 5968 Acked Read 4 Done Sent Done false
18810 5969 Acked Read 10 Done Sent Done false
18811 5970 Acked Write 10 Done Sent Done false
18812 5971 Acked Flush 0 Done Sent Done false
18813 5972 Acked Read 1 Done Sent Done false
18814 5973 Acked Read 7 Done Sent Done false
18815 5974 Acked Read 2 Done Sent Done false
18816 5975 Acked Read 2 Done Sent Done false
18817 5976 Acked Write 4 Done Sent Done false
18818 5977 Acked Write 6 Done Sent Done false
18819 5978 Acked Read 9 Done Sent Done false
18820 5979 Acked Write 3 Done Sent Done false
18821 5980 Acked Write 2 Done Sent Done false
18822 5981 Acked Read 8 Done Sent Done false
18823 5982 Acked Read 5 Done Sent Done false
18824 5983 Acked Read 1 Done Sent Done false
18825 5984 Acked Read 9 Done Sent Done false
18826 5985 Acked Flush 0 Done Sent Done false
18827 5986 Acked Write 6 Done Sent Done false
18828 5987 Acked Read 3 Done Sent Done false
18829 5988 Acked Flush 0 Done Sent Done false
18830 5989 Acked Read 4 Done Sent Done false
18831 5990 Acked Read 4 Done Sent Done false
18832 5991 Acked Read 7 Done Sent Done false
18833 5992 Acked Write 4 Done Sent Done false
18834 5993 Acked Write 1 Done Sent Done false
18835 5994 Acked Flush 0 Done Sent Done false
18836 5995 Acked Read 6 Done Sent Done false
18837 5996 Acked Read 9 Done Sent Done false
18838 5997 Acked Write 9 Done Sent Done false
18839 5998 Acked Write 3 Done Sent Done false
18840 5999 Acked Write 2 Done Sent Done false
18841 6000 Acked Read 6 Done Sent Done false
18842 6001 Acked Flush 0 Done Sent Done false
18843 6002 Acked Write 8 Done Sent Done false
18844 6003 Acked Read 7 Done Sent Done false
18845 6004 Acked Read 3 Done Sent Done false
18846 6005 Acked Read 8 Done Sent Done false
18847 6006 Acked Write 4 Done Sent Done false
18848 6007 Acked Read 8 Done Sent Done false
18849 6008 Acked Read 5 Done Sent Done false
18850 6009 Acked Read 7 Done Sent Done false
18851 6010 Acked Write 8 Done Sent Done false
18852 6011 Acked Write 3 Done Sent Done false
18853 6012 Acked Write 2 Done Sent Done false
18854 6013 Acked Flush 0 Done Sent Done false
18855 6014 Acked Read 2 Done Sent Done false
18856 6015 Acked Write 6 Done Sent Done false
18857 6016 Acked Read 8 Done Sent Done false
18858 6017 Acked Write 3 Done Sent Done false
18859 6018 Acked Read 8 Done Sent Done false
18860 6019 Acked Write 1 Done Sent Done false
18861 6020 Acked Write 5 Done Sent Done false
18862 6021 Acked Read 5 Done Sent Done false
18863 6022 Acked Read 7 Done Sent Done false
18864 6023 Acked Read 3 Done Sent Done false
18865 6024 Acked Write 4 Done Sent Done false
18866 6025 Acked Write 8 Done Sent Done false
18867 6026 Acked Write 3 Done Sent Done false
18868 6027 Acked Read 2 Done Sent Done false
18869 6028 Acked Write 2 Done Sent Done false
18870 6029 Acked Write 4 Done Sent Done false
18871 6030 Acked Read 9 Done Sent Done false
18872 6031 Acked Read 2 Done Sent Done false
18873 6032 Acked Write 5 Done Sent Done false
18874 6033 Acked Write 1 Done Sent Done false
18875 6034 Acked Read 2 Done Sent Done false
18876 6035 Acked Flush 0 Done Sent Done false
18877 6036 Acked Write 2 Done Sent Done false
18878 6037 Acked Write 2 Done Sent Done false
18879 6038 Acked Flush 0 Done Sent Done false
18880 6039 Acked Write 5 Done Sent Done false
18881 6040 Acked Read 1 Done Sent Done false
18882 6041 Acked Write 8 Done Sent Done false
18883 6042 Acked Write 6 Done Sent Done false
18884 6043 Acked Write 9 Done Sent Done false
18885 6044 Acked Read 6 Done Sent Done false
18886 6045 Acked Write 5 Done Sent Done false
18887 6046 Acked Read 3 Done Sent Done false
18888 6047 Acked Read 4 Done Sent Done false
18889 6048 Acked Read 5 Done Sent Done false
18890 6049 Acked Read 9 Done Sent Done false
18891 6050 Acked Read 1 Done Sent Done false
18892 6051 Acked Write 9 Done Sent Done false
18893 6052 Acked Read 9 Done Sent Done false
18894 6053 Acked Read 10 Done Sent Done false
18895 6054 Acked Read 2 Done Sent Done false
18896 6055 Acked Read 6 Done Sent Done false
18897 6056 Acked Write 5 Done Sent Done false
18898 6057 Acked Read 9 Done Sent Done false
18899 6058 Acked Read 7 Done Sent Done false
18900 6059 Acked Read 8 Done Sent Done false
18901 6060 Acked Read 7 Done Sent Done false
18902 6061 Acked Read 10 Done Sent Done false
18903 6062 Acked Write 4 Done Sent Done false
18904 6063 Acked Write 10 Done Sent Done false
18905 6064 Acked Read 4 Done Sent Done false
18906 6065 Acked Read 6 Done Sent Done false
18907 6066 Acked Read 7 Done Sent Done false
18908 6067 Acked Flush 0 Done Sent Done false
18909 6068 Acked Write 1 Done Sent Done false
18910 6069 Acked Write 2 Done Sent Done false
18911 6070 Acked Write 8 Done Sent Done false
18912 6071 Acked Write 6 Done Sent Done false
18913 6072 Acked Read 8 Done Sent Done false
18914 6073 Acked Flush 0 Done Sent Done false
18915 6074 Acked Read 10 Done Sent Done false
18916 6075 Acked Read 6 Done Sent Done false
18917 6076 Acked Read 9 Done Sent Done false
18918 6077 Acked Flush 0 Done Sent Done false
18919 6078 Acked Write 2 Done Sent Done false
18920 6079 Acked Read 9 Done Sent Done false
18921 6080 Acked Write 2 Done Sent Done false
18922 6081 Acked Flush 0 Done Sent Done false
18923 6082 Acked Flush 0 Done Sent Done false
18924 6083 Acked Read 8 Done Sent Done false
18925 6084 Acked Read 1 Done Sent Done false
18926 6085 Acked Write 3 Done Sent Done false
18927 6086 Acked Write 10 Done Sent Done false
18928 6087 Acked Write 5 Done Sent Done false
18929 6088 Acked Write 8 Done Sent Done false
18930 6089 Acked Read 1 Done Sent Done false
18931 6090 Acked Write 5 Done Sent Done false
18932 6091 Acked Read 2 Done Sent Done false
18933 6092 Acked Read 9 Done Sent Done false
18934 6093 Acked Write 7 Done Sent Done false
18935 6094 Acked Write 3 Done Sent Done false
18936 6095 Acked Read 9 Done Sent Done false
18937 6096 Acked Write 9 Done Sent Done false
18938 6097 Acked Read 3 Done Sent Done false
18939 6098 Acked Read 8 Done Sent Done false
18940 6099 Acked Write 5 Done Sent Done false
18941 6100 Acked Read 4 Done Sent Done false
18942 6101 Acked Read 10 Done Sent Done false
18943 6102 Acked Read 8 Done Sent Done false
18944 6103 Acked Flush 0 Done Sent Done false
18945 6104 Acked Write 9 Done Sent Done false
18946 6105 Acked Read 9 Done Sent Done false
18947 6106 Acked Read 10 Done Sent Done false
18948 6107 Acked Write 3 Done Sent Done false
18949 6108 Acked Read 10 Done Sent Done false
18950 6109 Acked Read 3 Done Sent Done false
18951 6110 Acked Read 10 Done Sent Done false
18952 6111 Acked Read 4 Done Sent Done false
18953 6112 Acked Write 8 Done Sent Done false
18954 6113 Acked Write 9 Done Sent Done false
18955 6114 Acked Flush 0 Done Sent Done false
18956 6115 Acked Flush 0 Done Sent Done false
18957 6116 Acked Read 7 Done Sent Done false
18958 6117 Acked Read 8 Done Sent Done false
18959 6118 Acked Read 3 Done Sent Done false
18960 6119 Acked Write 5 Done Sent Done false
18961 6120 Acked Flush 0 Done Sent Done false
18962 6121 Acked Read 6 Done Sent Done false
18963 6122 Acked Flush 0 Done Sent Done false
18964 6123 Acked Write 8 Done Sent Done false
18965 6124 Acked Read 3 Done Sent Done false
18966 6125 Acked Read 8 Done Sent Done false
18967 6126 Acked Write 10 Done Sent Done false
18968 6127 Acked Write 7 Done Sent Done false
18969 6128 Acked Flush 0 Done Sent Done false
18970 6129 Acked Write 3 Done Sent Done false
18971 STATES DS:0 DS:1 DS:2 TOTAL
18972 Sent 0 301 0 301
18973 Done 301 0 301 602
18974 Skipped 0 0 0 0
18975 Error 0 0 0 0
18976 Last Flush: 6128 5828 6128
18977 Downstairs last five completed: 5828 5827 5826 5825 5824
18978 Upstairs last five completed: 6129 6128 6127 6126 6125
18979 CLIENT: Up:0 ds:301 act:2
18980 [8820] got start action
18981 [8820] I am going to restart
18982 Starting downstairs at port 8820
18983 Make output file at "/tmp/dsc/downstairs-8820.txt"
18984 [8820][1] reports Starting
18985 Downstairs /var/tmp/dsc/region/8820 port 8820 PID:Some(1219)
18986 [8820][1] reports Running
18987 ----------------------------------------------------------------
18988 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:302
18989 States: Active Offline Active
18990 JOBID ACK TYPE BKS/EXT DS:0 DS:1 DS:2 REPLAY
18991 5829 Acked Write 3 Done Sent Done false
18992 5830 Acked Write 8 Done Sent Done false
18993 5831 Acked Read 1 Done Sent Done false
18994 5832 Acked Write 1 Done Sent Done false
18995 5833 Acked Read 1 Done Sent Done false
18996 5834 Acked Write 5 Done Sent Done false
18997 5835 Acked Write 8 Done Sent Done false
18998 5836 Acked Write 8 Done Sent Done false
18999 5837 Acked Write 1 Done Sent Done false
19000 5838 Acked Write 1 Done Sent Done false
19001 5839 Acked Write 3 Done Sent Done false
19002 5840 Acked Read 6 Done Sent Done false
19003 5841 Acked Flush 0 Done Sent Done false
19004 5842 Acked Flush 0 Done Sent Done false
19005 5843 Acked Read 9 Done Sent Done false
19006 5844 Acked Read 10 Done Sent Done false
19007 5845 Acked Write 1 Done Sent Done false
19008 5846 Acked Flush 0 Done Sent Done false
19009 5847 Acked Write 5 Done Sent Done false
19010 5848 Acked Read 9 Done Sent Done false
19011 5849 Acked Read 2 Done Sent Done false
19012 5850 Acked Write 5 Done Sent Done false
19013 5851 Acked Read 8 Done Sent Done false
19014 5852 Acked Write 8 Done Sent Done false
19015 5853 Acked Write 9 Done Sent Done false
19016 5854 Acked Read 9 Done Sent Done false
19017 5855 Acked Write 10 Done Sent Done false
19018 5856 Acked Read 2 Done Sent Done false
19019 5857 Acked Read 1 Done Sent Done false
19020 5858 Acked Flush 0 Done Sent Done false
19021 5859 Acked Read 8 Done Sent Done false
19022 5860 Acked Write 8 Done Sent Done false
19023 5861 Acked Write 5 Done Sent Done false
19024 5862 Acked Read 10 Done Sent Done false
19025 5863 Acked Write 9 Done Sent Done false
19026 5864 Acked Read 2 Done Sent Done false
19027 5865 Acked Write 1 Done Sent Done false
19028 5866 Acked Read 6 Done Sent Done false
19029 5867 Acked Write 9 Done Sent Done false
19030 5868 Acked Read 10 Done Sent Done false
19031 5869 Acked Write 10 Done Sent Done false
19032 5870 Acked Read 3 Done Sent Done false
19033 5871 Acked Read 3 Done Sent Done false
19034 5872 Acked Write 5 Done Sent Done false
19035 5873 Acked Write 7 Done Sent Done false
19036 5874 Acked Write 1 Done Sent Done false
19037 5875 Acked Write 8 Done Sent Done false
19038 5876 Acked Read 7 Done Sent Done false
19039 5877 Acked Read 1 Done Sent Done false
19040 5878 Acked Read 1 Done Sent Done false
19041 5879 Acked Write 6 Done Sent Done false
19042 5880 Acked Write 3 Done Sent Done false
19043 5881 Acked Write 10 Done Sent Done false
19044 5882 Acked Flush 0 Done Sent Done false
19045 5883 Acked Flush 0 Done Sent Done false
19046 5884 Acked Write 4 Done Sent Done false
19047 5885 Acked Write 5 Done Sent Done false
19048 5886 Acked Flush 0 Done Sent Done false
19049 5887 Acked Write 2 Done Sent Done false
19050 5888 Acked Read 2 Done Sent Done false
19051 5889 Acked Read 10 Done Sent Done false
19052 5890 Acked Read 2 Done Sent Done false
19053 5891 Acked Write 9 Done Sent Done false
19054 5892 Acked Write 8 Done Sent Done false
19055 5893 Acked Write 7 Done Sent Done false
19056 5894 Acked Read 8 Done Sent Done false
19057 5895 Acked Write 3 Done Sent Done false
19058 5896 Acked Read 7 Done Sent Done false
19059 5897 Acked Write 8 Done Sent Done false
19060 5898 Acked Read 9 Done Sent Done false
19061 5899 Acked Read 6 Done Sent Done false
19062 5900 Acked Flush 0 Done Sent Done false
19063 5901 Acked Write 8 Done Sent Done false
19064 5902 Acked Write 1 Done Sent Done false
19065 5903 Acked Write 6 Done Sent Done false
19066 5904 Acked Read 1 Done Sent Done false
19067 5905 Acked Write 6 Done Sent Done false
19068 5906 Acked Write 8 Done Sent Done false
19069 5907 Acked Read 6 Done Sent Done false
19070 5908 Acked Write 1 Done Sent Done false
19071 5909 Acked Read 1 Done Sent Done false
19072 5910 Acked Write 4 Done Sent Done false
19073 5911 Acked Write 8 Done Sent Done false
19074 5912 Acked Read 1 Done Sent Done false
19075 5913 Acked Flush 0 Done Sent Done false
19076 5914 Acked Write 2 Done Sent Done false
19077 5915 Acked Read 9 Done Sent Done false
19078 5916 Acked Write 8 Done Sent Done false
19079 5917 Acked Write 4 Done Sent Done false
19080 5918 Acked Read 8 Done Sent Done false
19081 5919 Acked Read 2 Done Sent Done false
19082 5920 Acked Flush 0 Done Sent Done false
19083 5921 Acked Write 3 Done Sent Done false
19084 5922 Acked Write 1 Done Sent Done false
19085 5923 Acked Read 5 Done Sent Done false
19086 5924 Acked Write 4 Done Sent Done false
19087 5925 Acked Read 4 Done Sent Done false
19088 5926 Acked Write 1 Done Sent Done false
19089 5927 Acked Read 9 Done Sent Done false
19090 5928 Acked Read 9 Done Sent Done false
19091 5929 Acked Read 1 Done Sent Done false
19092 5930 Acked Read 3 Done Sent Done false
19093 5931 Acked Read 5 Done Sent Done false
19094 5932 Acked Write 3 Done Sent Done false
19095 5933 Acked Read 1 Done Sent Done false
19096 5934 Acked Read 7 Done Sent Done false
19097 5935 Acked Write 4 Done Sent Done false
19098 5936 Acked Read 9 Done Sent Done false
19099 5937 Acked Flush 0 Done Sent Done false
19100 5938 Acked Read 4 Done Sent Done false
19101 5939 Acked Read 9 Done Sent Done false
19102 5940 Acked Write 5 Done Sent Done false
19103 5941 Acked Flush 0 Done Sent Done false
19104 5942 Acked Read 6 Done Sent Done false
19105 5943 Acked Flush 0 Done Sent Done false
19106 5944 Acked Write 5 Done Sent Done false
19107 5945 Acked Read 10 Done Sent Done false
19108 5946 Acked Read 5 Done Sent Done false
19109 5947 Acked Write 5 Done Sent Done false
19110 5948 Acked Read 2 Done Sent Done false
19111 5949 Acked Read 10 Done Sent Done false
19112 5950 Acked Read 2 Done Sent Done false
19113 5951 Acked Write 3 Done Sent Done false
19114 5952 Acked Write 1 Done Sent Done false
19115 5953 Acked Flush 0 Done Sent Done false
19116 5954 Acked Write 10 Done Sent Done false
19117 5955 Acked Write 6 Done Sent Done false
19118 5956 Acked Write 8 Done Sent Done false
19119 5957 Acked Write 2 Done Sent Done false
19120 5958 Acked Write 4 Done Sent Done false
19121 5959 Acked Write 7 Done Sent Done false
19122 5960 Acked Write 8 Done Sent Done false
19123 5961 Acked Read 3 Done Sent Done false
19124 5962 Acked Write 10 Done Sent Done false
19125 5963 Acked Read 10 Done Sent Done false
19126 5964 Acked Flush 0 Done Sent Done false
19127 5965 Acked Read 3 Done Sent Done false
19128 5966 Acked Write 4 Done Sent Done false
19129 5967 Acked Read 7 Done Sent Done false
19130 5968 Acked Read 4 Done Sent Done false
19131 5969 Acked Read 10 Done Sent Done false
19132 5970 Acked Write 10 Done Sent Done false
19133 5971 Acked Flush 0 Done Sent Done false
19134 5972 Acked Read 1 Done Sent Done false
19135 5973 Acked Read 7 Done Sent Done false
19136 5974 Acked Read 2 Done Sent Done false
19137 5975 Acked Read 2 Done Sent Done false
19138 5976 Acked Write 4 Done Sent Done false
19139 5977 Acked Write 6 Done Sent Done false
19140 5978 Acked Read 9 Done Sent Done false
19141 5979 Acked Write 3 Done Sent Done false
19142 5980 Acked Write 2 Done Sent Done false
19143 5981 Acked Read 8 Done Sent Done false
19144 5982 Acked Read 5 Done Sent Done false
19145 5983 Acked Read 1 Done Sent Done false
19146 5984 Acked Read 9 Done Sent Done false
19147 5985 Acked Flush 0 Done Sent Done false
19148 5986 Acked Write 6 Done Sent Done false
19149 5987 Acked Read 3 Done Sent Done false
19150 5988 Acked Flush 0 Done Sent Done false
19151 5989 Acked Read 4 Done Sent Done false
19152 5990 Acked Read 4 Done Sent Done false
19153 5991 Acked Read 7 Done Sent Done false
19154 5992 Acked Write 4 Done Sent Done false
19155 5993 Acked Write 1 Done Sent Done false
19156 5994 Acked Flush 0 Done Sent Done false
19157 5995 Acked Read 6 Done Sent Done false
19158 5996 Acked Read 9 Done Sent Done false
19159 5997 Acked Write 9 Done Sent Done false
19160 5998 Acked Write 3 Done Sent Done false
19161 5999 Acked Write 2 Done Sent Done false
19162 6000 Acked Read 6 Done Sent Done false
19163 6001 Acked Flush 0 Done Sent Done false
19164 6002 Acked Write 8 Done Sent Done false
19165 6003 Acked Read 7 Done Sent Done false
19166 6004 Acked Read 3 Done Sent Done false
19167 6005 Acked Read 8 Done Sent Done false
19168 6006 Acked Write 4 Done Sent Done false
19169 6007 Acked Read 8 Done Sent Done false
19170 6008 Acked Read 5 Done Sent Done false
19171 6009 Acked Read 7 Done Sent Done false
19172 6010 Acked Write 8 Done Sent Done false
19173 6011 Acked Write 3 Done Sent Done false
19174 6012 Acked Write 2 Done Sent Done false
19175 6013 Acked Flush 0 Done Sent Done false
19176 6014 Acked Read 2 Done Sent Done false
19177 6015 Acked Write 6 Done Sent Done false
19178 6016 Acked Read 8 Done Sent Done false
19179 6017 Acked Write 3 Done Sent Done false
19180 6018 Acked Read 8 Done Sent Done false
19181 6019 Acked Write 1 Done Sent Done false
19182 6020 Acked Write 5 Done Sent Done false
19183 6021 Acked Read 5 Done Sent Done false
19184 6022 Acked Read 7 Done Sent Done false
19185 6023 Acked Read 3 Done Sent Done false
19186 6024 Acked Write 4 Done Sent Done false
19187 6025 Acked Write 8 Done Sent Done false
19188 6026 Acked Write 3 Done Sent Done false
19189 6027 Acked Read 2 Done Sent Done false
19190 6028 Acked Write 2 Done Sent Done false
19191 6029 Acked Write 4 Done Sent Done false
19192 6030 Acked Read 9 Done Sent Done false
19193 6031 Acked Read 2 Done Sent Done false
19194 6032 Acked Write 5 Done Sent Done false
19195 6033 Acked Write 1 Done Sent Done false
19196 6034 Acked Read 2 Done Sent Done false
19197 6035 Acked Flush 0 Done Sent Done false
19198 6036 Acked Write 2 Done Sent Done false
19199 6037 Acked Write 2 Done Sent Done false
19200 6038 Acked Flush 0 Done Sent Done false
19201 6039 Acked Write 5 Done Sent Done false
19202 6040 Acked Read 1 Done Sent Done false
19203 6041 Acked Write 8 Done Sent Done false
19204 6042 Acked Write 6 Done Sent Done false
19205 6043 Acked Write 9 Done Sent Done false
19206 6044 Acked Read 6 Done Sent Done false
19207 6045 Acked Write 5 Done Sent Done false
19208 6046 Acked Read 3 Done Sent Done false
19209 6047 Acked Read 4 Done Sent Done false
19210 6048 Acked Read 5 Done Sent Done false
19211 6049 Acked Read 9 Done Sent Done false
19212 6050 Acked Read 1 Done Sent Done false
19213 6051 Acked Write 9 Done Sent Done false
19214 6052 Acked Read 9 Done Sent Done false
19215 6053 Acked Read 10 Done Sent Done false
19216 6054 Acked Read 2 Done Sent Done false
19217 6055 Acked Read 6 Done Sent Done false
19218 6056 Acked Write 5 Done Sent Done false
19219 6057 Acked Read 9 Done Sent Done false
19220 6058 Acked Read 7 Done Sent Done false
19221 6059 Acked Read 8 Done Sent Done false
19222 6060 Acked Read 7 Done Sent Done false
19223 6061 Acked Read 10 Done Sent Done false
19224 6062 Acked Write 4 Done Sent Done false
19225 6063 Acked Write 10 Done Sent Done false
19226 6064 Acked Read 4 Done Sent Done false
19227 6065 Acked Read 6 Done Sent Done false
19228 6066 Acked Read 7 Done Sent Done false
19229 6067 Acked Flush 0 Done Sent Done false
19230 6068 Acked Write 1 Done Sent Done false
19231 6069 Acked Write 2 Done Sent Done false
19232 6070 Acked Write 8 Done Sent Done false
19233 6071 Acked Write 6 Done Sent Done false
19234 6072 Acked Read 8 Done Sent Done false
19235 6073 Acked Flush 0 Done Sent Done false
19236 6074 Acked Read 10 Done Sent Done false
19237 6075 Acked Read 6 Done Sent Done false
19238 6076 Acked Read 9 Done Sent Done false
19239 6077 Acked Flush 0 Done Sent Done false
19240 6078 Acked Write 2 Done Sent Done false
19241 6079 Acked Read 9 Done Sent Done false
19242 6080 Acked Write 2 Done Sent Done false
19243 6081 Acked Flush 0 Done Sent Done false
19244 6082 Acked Flush 0 Done Sent Done false
19245 6083 Acked Read 8 Done Sent Done false
19246 6084 Acked Read 1 Done Sent Done false
19247 6085 Acked Write 3 Done Sent Done false
19248 6086 Acked Write 10 Done Sent Done false
19249 6087 Acked Write 5 Done Sent Done false
19250 6088 Acked Write 8 Done Sent Done false
19251 6089 Acked Read 1 Done Sent Done false
19252 6090 Acked Write 5 Done Sent Done false
19253 6091 Acked Read 2 Done Sent Done false
19254 6092 Acked Read 9 Done Sent Done false
19255 6093 Acked Write 7 Done Sent Done false
19256 6094 Acked Write 3 Done Sent Done false
19257 6095 Acked Read 9 Done Sent Done false
19258 6096 Acked Write 9 Done Sent Done false
19259 6097 Acked Read 3 Done Sent Done false
19260 6098 Acked Read 8 Done Sent Done false
19261 6099 Acked Write 5 Done Sent Done false
19262 6100 Acked Read 4 Done Sent Done false
19263 6101 Acked Read 10 Done Sent Done false
19264 6102 Acked Read 8 Done Sent Done false
19265 6103 Acked Flush 0 Done Sent Done false
19266 6104 Acked Write 9 Done Sent Done false
19267 6105 Acked Read 9 Done Sent Done false
19268 6106 Acked Read 10 Done Sent Done false
19269 6107 Acked Write 3 Done Sent Done false
19270 6108 Acked Read 10 Done Sent Done false
19271 6109 Acked Read 3 Done Sent Done false
19272 6110 Acked Read 10 Done Sent Done false
19273 6111 Acked Read 4 Done Sent Done false
19274 6112 Acked Write 8 Done Sent Done false
19275 6113 Acked Write 9 Done Sent Done false
19276 6114 Acked Flush 0 Done Sent Done false
19277 6115 Acked Flush 0 Done Sent Done false
19278 6116 Acked Read 7 Done Sent Done false
19279 6117 Acked Read 8 Done Sent Done false
19280 6118 Acked Read 3 Done Sent Done false
19281 6119 Acked Write 5 Done Sent Done false
19282 6120 Acked Flush 0 Done Sent Done false
19283 6121 Acked Read 6 Done Sent Done false
19284 6122 Acked Flush 0 Done Sent Done false
19285 6123 Acked Write 8 Done Sent Done false
19286 6124 Acked Read 3 Done Sent Done false
19287 6125 Acked Read 8 Done Sent Done false
19288 6126 Acked Write 10 Done Sent Done false
19289 6127 Acked Write 7 Done Sent Done false
19290 6128 Acked Flush 0 Done Sent Done false
19291 6129 Acked Write 3 Done Sent Done false
19292 6130 Acked Flush 0 Done Sent Done false
19293 STATES DS:0 DS:1 DS:2 TOTAL
19294 Sent 0 302 0 302
19295 Done 302 0 302 604
19296 Skipped 0 0 0 0
19297 Error 0 0 0 0
19298 Last Flush: 6130 5828 6130
19299 Downstairs last five completed: 5828 5827 5826 5825 5824
19300 Upstairs last five completed: 6130 6129 6128 6127 6126
19301 CLIENT: Up:0 ds:302 act:2
193022025-01-10T16:39:21.668ZINFOcrucible: connecting to 127.0.0.1:8820 = io task client = 1 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
193032025-01-10T16:39:21.668ZINFOcrucible: ds_connection connected from Ok(127.0.0.1:48326) = io task client = 1 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
193042025-01-10T16:39:21.669ZWARNcrucible: version negotiation from state Offline = downstairs client = 1 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
193052025-01-10T16:39:21.670ZINFOcrucible: downstairs client at Some(127.0.0.1:8820) has region UUID 12345678-0000-0000-0000-000000008820 = downstairs client = 1 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
193062025-01-10T16:39:21.670ZINFOcrucible: Returning UUID:12345678-0000-0000-0000-000000008820 matches = downstairs client = 1 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
193072025-01-10T16:39:21.670ZINFOcrucible: send last flush ID to this DS: 5828 = downstairs client = 1 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
193082025-01-10T16:39:21.670ZINFOcrucible: Replied this last flush ID: 5828 = downstairs client = 1 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
193092025-01-10T16:39:21.670ZINFOcrucible: ds_transition from Offline to Active = downstairs client = 1 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
193102025-01-10T16:39:21.670ZINFOcrucible: [1] Transition from Offline to Active = downstairs client = 1 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
193112025-01-10T16:39:21.670ZINFOcrucible: [1] client re-new 302 jobs since flush 5828 = downstairs session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
193122025-01-10T16:39:21.670ZINFOcrucible: [1] Replayed 302 jobs since flush: 5828 = downstairs session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
19313 ----------------------------------------------------------------
19314 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:0
19315 Downstairs last five completed: 6130 6129 6128 6127 6126
19316 Upstairs last five completed: 6130 6129 6128 6127 6126
19317 CLIENT: Up:0 ds:0 act:3
19318 Replay: All jobs finished
19319 Main task has work to do, go find it
19320 got dsc Stop(0)
19321 stop 0
19322 [8810] Got stop action so:false kr:false
19323 Jan 10 16:39:23.905 INFO request completed, latency_us: 335, response_code: 204, uri: /stop/cid/0, method: POST, req_id: 811db276-0b76-4216-ab2b-2eccf0a074e1, remote_addr: 127.0.0.1:55917, local_addr: 127.0.0.1:9998
193242025-01-10T16:39:23.906ZWARNcrucible: downstairs disconnected = io task client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
193252025-01-10T16:39:23.906ZWARNcrucible: client task is sending Done(Finished) = io task client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
193262025-01-10T16:39:23.906ZWARNcrucible: downstairs task for 0 stopped due to Finished session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
193272025-01-10T16:39:23.906ZINFOcrucible: ds_transition from Active to Offline = downstairs client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
193282025-01-10T16:39:23.906ZINFOcrucible: [0] Transition from Active to Offline = downstairs client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
19329 Jan 10 16:39:23.906 INFO request completed, latency_us: 125, response_code: 200, uri: /state/cid/0, method: GET, req_id: ab15951a-e788-4fd8-b9fb-d02201d09634, remote_addr: 127.0.0.1:55917, local_addr: 127.0.0.1:9998
193302025-01-10T16:39:23.906ZINFOcrucible: client task is exiting = io task client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
19331 [8810] Exited with: ExitStatus(unix_wait_status(9))
19332 [8810][0] reports Exit
19333 Jan 10 16:39:27.908 INFO request completed, latency_us: 311, response_code: 200, uri: /state/cid/0, method: GET, req_id: 17958b07-2b71-4d7b-879d-d9c3def0b07c, remote_addr: 127.0.0.1:55917, local_addr: 127.0.0.1:9998
19334 001/300 Write block 251 len 28672 data: 5 7 7 7 8 9 8
19335 002/300 Read block 4201 len 36864
19336 003/300 Write block 2067 len 32768 data: 3 4 6 6 5 4 4 5
19337 004/300 Write block 2994 len 12288 data: 5 5 5
19338 005/300 Read block 2042 len 8192
19339 006/300 Flush
19340 007/300 Write block 4774 len 16384 data: 4 3 3 3
19341 008/300 Write block 608 len 28672 data: 5 2 3 4 5 6 6
19342 009/300 Read block 1832 len 12288
19343 010/300 Write block 2288 len 40960 data: 5 5 4 5 5 3 3 3 3 3
19344 011/300 Read block 1804 len 16384
19345 012/300 Write block 2639 len 32768 data: 6 6 6 6 7 6 5 5
19346 013/300 Write block 2386 len 32768 data: 4 5 5 5 4 3 4 4
19347 014/300 Read block 634 len 16384
19348 015/300 Read block 2876 len 16384
19349 016/300 Write block 2361 len 24576 data: 2 5 5 5 4 4
19350 017/300 Flush
19351 018/300 Write block 3381 len 24576 data: 7 8 8 10 7 6
19352 019/300 Write block 3051 len 32768 data: 4 4 4 4 4 2 3 5
19353 020/300 Flush
19354 021/300 Read block 3620 len 12288
19355 022/300 Read block 4803 len 4096
19356 023/300 Read block 344 len 28672
19357 024/300 Read block 4953 len 16384
19358 025/300 Write block 2047 len 24576 data: 4 5 3 3 4 5
19359 026/300 Flush
19360 027/300 Read block 4310 len 40960
19361 028/300 Read block 659 len 20480
19362 029/300 Read block 1667 len 40960
19363 030/300 Read block 390 len 24576
19364 031/300 Write block 976 len 12288 data: 5 6 6
19365 032/300 Write block 3873 len 24576 data: 5 3 3 3 4 4
19366 033/300 Write block 3586 len 4096 data: 2
19367 034/300 Read block 3992 len 16384
19368 035/300 Write block 736 len 36864 data: 4 4 4 4 3 3 3 3 3
19369 036/300 Read block 329 len 20480
19370 037/300 Write block 4671 len 36864 data: 4 4 4 4 5 4 3 4 4
19371 038/300 Write block 579 len 28672 data: 3 3 3 5 6 6 5
19372 039/300 Read block 33 len 16384
19373 040/300 Write block 4461 len 4096 data: 3
19374 041/300 Write block 2987 len 12288 data: 7 6 5
19375 042/300 Flush
19376 043/300 Read block 1010 len 36864
19377 044/300 Write block 4675 len 40960 data: 6 5 4 5 5 4 4 4 4 5
19378 045/300 Write block 790 len 24576 data: 3 4 4 4 4 3
19379 046/300 Read block 1235 len 12288
19380 047/300 Flush
19381 048/300 Write block 3769 len 8192 data: 4 3
19382 049/300 Read block 1469 len 36864
19383 050/300 Read block 779 len 32768
19384 051/300 Read block 4395 len 4096
19385 052/300 Read block 276 len 32768
19386 053/300 Flush
19387 054/300 Read block 2625 len 8192
19388 055/300 Read block 4840 len 24576
19389 056/300 Write block 4143 len 36864 data: 4 4 3 3 4 7 7 7 7
19390 057/300 Read block 2406 len 32768
19391 058/300 Read block 459 len 20480
19392 059/300 Write block 442 len 8192 data: 3 4
19393 060/300 Write block 3637 len 8192 data: 4 2
19394 061/300 Read block 2531 len 4096
19395 062/300 Read block 343 len 40960
19396 063/300 Read block 732 len 32768
19397 064/300 Write block 3213 len 20480 data: 7 7 6 5 4
19398 065/300 Write block 3654 len 32768 data: 7 5 6 7 7 5 5 3
19399 066/300 Read block 1363 len 16384
19400 067/300 Write block 699 len 4096 data: 6
19401 068/300 Read block 4230 len 40960
19402 069/300 Read block 3764 len 8192
19403 070/300 Read block 422 len 16384
19404 071/300 Read block 3403 len 4096
19405 072/300 Write block 4625 len 4096 data: 5
19406 073/300 Write block 4072 len 28672 data: 5 6 4 4 3 3 4
19407 074/300 Read block 1489 len 12288
19408 075/300 Write block 4852 len 32768 data: 4 5 5 4 5 5 5 7
19409 076/300 Write block 4641 len 4096 data: 2
19410 077/300 Flush
19411 078/300 Read block 1382 len 28672
19412 079/300 Write block 2342 len 40960 data: 4 4 6 6 6 4 4 4 5 4
19413 080/300 Read block 1511 len 32768
19414 081/300 Read block 1068 len 24576
19415 082/300 Read block 2215 len 28672
19416 083/300 Read block 3393 len 8192
19417 084/300 Write block 1530 len 16384 data: 2 3 3 4
19418 085/300 Write block 2521 len 8192 data: 3 2
19419 086/300 Flush
19420 087/300 Read block 207 len 16384
19421 088/300 Write block 2359 len 36864 data: 4 2 3 6 6 6 5 5 4
19422 089/300 Write block 849 len 20480 data: 4 3 3 3 3
19423 090/300 Read block 399 len 12288
19424 091/300 Read block 887 len 20480
19425 092/300 Write block 2848 len 20480 data: 3 4 5 5 4
19426 093/300 Write block 2163 len 24576 data: 4 4 5 5 4 4
19427 094/300 Read block 4231 len 12288
19428 095/300 Read block 1335 len 40960
19429 096/300 Write block 4538 len 32768 data: 2 3 3 4 3 3 3 3
19430 097/300 Write block 1989 len 36864 data: 6 5 6 6 6 5 7 7 6
19431 098/300 Read block 3500 len 16384
19432 099/300 Read block 4571 len 4096
19433 100/300 Write block 1522 len 28672 data: 4 4 4 3 3 3 2
19434 101/300 Write block 2887 len 4096 data: 7
19435 102/300 Read block 693 len 32768
19436 103/300 Read block 3309 len 28672
19437 104/300 Flush
19438 105/300 Flush
19439 106/300 Write block 4120 len 24576 data: 7 7 5 4 4 4
19440 107/300 Write block 3170 len 20480 data: 6 6 4 3 3
19441 108/300 Write block 1993 len 24576 data: 7 6 8 8 7 6
19442 109/300 Read block 4055 len 40960
19443 110/300 Write block 4804 len 32768 data: 6 6 5 7 7 6 5 6
19444 111/300 Write block 1140 len 16384 data: 5 5 5 5
19445 112/300 Read block 3763 len 16384
19446 113/300 Flush
19447 114/300 Write block 4885 len 36864 data: 4 3 3 2 3 2 2 2 3
19448 115/300 Read block 2919 len 4096
19449 116/300 Write block 2703 len 20480 data: 2 3 3 4 3
19450 117/300 Write block 4616 len 40960 data: 2 2 2 2 3 4 5 5 5 6
19451 118/300 Write block 1136 len 28672 data: 3 3 5 6 6 6 6
19452 119/300 Read block 3881 len 4096
19453 120/300 Write block 3119 len 12288 data: 3 3 3
19454 121/300 Write block 3948 len 12288 data: 6 4 3
19455 122/300 Write block 2096 len 20480 data: 4 4 3 2 4
19456 123/300 Read block 2591 len 24576
19457 124/300 Read block 3734 len 12288
19458 125/300 Write block 1307 len 4096 data: 2
19459 126/300 Read block 1828 len 28672
19460 127/300 Write block 3600 len 36864 data: 5 4 2 2 2 4 5 5 5
19461 128/300 Write block 4818 len 16384 data: 4 4 4 4
19462 129/300 Read block 893 len 24576
19463 130/300 Read block 3441 len 20480
19464 131/300 Read block 1828 len 32768
19465 132/300 Write block 1623 len 8192 data: 4 4
19466 133/300 Flush
19467 134/300 Read block 2047 len 32768
19468 135/300 Write block 2807 len 40960 data: 5 6 6 6 6 5 4 4 3 2
19469 136/300 Write block 1999 len 8192 data: 5 6
19470 137/300 Flush
19471 138/300 Read block 3527 len 4096
19472 139/300 Read block 1755 len 32768
19473 140/300 Read block 2092 len 24576
19474 141/300 Write block 3771 len 36864 data: 3 3 3 5 4 5 5 6 6
19475 142/300 Write block 537 len 12288 data: 5 5 5
19476 143/300 Read block 3252 len 28672
19477 144/300 Write block 1956 len 12288 data: 4 3 2
19478 145/300 Write block 4963 len 24576 data: 5 5 4 4 3 3
19479 146/300 Read block 3072 len 32768
19480 147/300 Read block 2630 len 36864
19481 148/300 Flush
19482 149/300 Flush
19483 150/300 Flush
19484 151/300 Read block 2948 len 12288
19485 152/300 Write block 1582 len 20480 data: 2 2 3 3 3
19486 153/300 Read block 4352 len 8192
19487 154/300 Flush
19488 155/300 Read block 2186 len 24576
19489 156/300 Flush
19490 157/300 Write block 3910 len 32768 data: 2 2 3 4 4 5 6 6
19491 158/300 Read block 2830 len 24576
19492 159/300 Write block 329 len 32768 data: 3 3 3 3 3 4 6 7
19493 160/300 Flush
19494 161/300 Read block 3889 len 4096
19495 162/300 Flush
19496 163/300 Write block 4729 len 20480 data: 2 2 3 3 4
19497 164/300 Write block 3568 len 28672 data: 4 3 2 2 2 2 3
19498 165/300 Read block 3251 len 16384
19499 166/300 Read block 2414 len 40960
19500 167/300 Read block 2897 len 28672
19501 168/300 Read block 4532 len 8192
19502 169/300 Read block 3949 len 16384
19503 170/300 Write block 3233 len 36864 data: 3 3 2 2 3 3 4 4 4
19504 171/300 Read block 335 len 8192
19505 172/300 Read block 2038 len 12288
19506 173/300 Read block 3661 len 20480
19507 174/300 Read block 1325 len 40960
19508 175/300 Read block 2144 len 16384
19509 176/300 Read block 668 len 28672
19510 177/300 Write block 1132 len 24576 data: 3 3 3 3 4 4
19511 178/300 Write block 2515 len 20480 data: 4 5 5 5 5
19512 179/300 Read block 2125 len 40960
19513 180/300 Write block 4823 len 4096 data: 5
19514 181/300 Write block 1474 len 20480 data: 5 4 4 4 5
19515 182/300 Read block 4354 len 40960
19516 183/300 Read block 1648 len 12288
19517 184/300 Write block 3423 len 20480 data: 2 3 3 2 2
19518 185/300 Read block 83 len 40960
19519 186/300 Write block 2951 len 24576 data: 6 7 6 7 7 5
19520 187/300 Read block 4669 len 12288
19521 188/300 Read block 570 len 16384
19522 189/300 Read block 992 len 20480
19523 190/300 Read block 3525 len 20480
19524 191/300 Read block 1188 len 40960
19525 192/300 Read block 2759 len 28672
19526 193/300 Read block 1879 len 28672
19527 194/300 Read block 4165 len 12288
19528 195/300 Flush
19529 196/300 Write block 1717 len 12288 data: 3 3 4
19530 197/300 Read block 4958 len 16384
19531 198/300 Write block 4979 len 32768 data: 3 3 2 2 3 5 5 7
19532 199/300 Read block 2205 len 36864
19533 200/300 Write block 3020 len 4096 data: 6
19534 201/300 Write block 1151 len 32768 data: 6 7 5 4 4 4 4 4
19535 202/300 Read block 2512 len 4096
19536 203/300 Write block 1708 len 28672 data: 7 7 3 3 2 3 2
19537 204/300 Read block 2600 len 4096
19538 205/300 Write block 29 len 4096 data: 4
19539 206/300 Read block 3893 len 12288
19540 207/300 Read block 663 len 20480
19541 208/300 Read block 246 len 4096
19542 209/300 Read block 2222 len 16384
19543 210/300 Flush
19544 211/300 Write block 966 len 12288 data: 5 4 4
19545 212/300 Write block 3433 len 32768 data: 3 3 2 3 3 3 3 3
19546 213/300 Write block 829 len 20480 data: 4 4 5 5 4
19547 214/300 Write block 1391 len 20480 data: 8 6 6 5 4
19548 215/300 Flush
19549 216/300 Read block 457 len 28672
19550 217/300 Read block 292 len 8192
19551 218/300 Read block 1687 len 36864
19552 219/300 Write block 1532 len 36864 data: 4 5 4 3 3 3 3 3 3
19553 220/300 Flush
19554 221/300 Flush
19555 222/300 Flush
19556 223/300 Read block 3687 len 20480
19557 224/300 Read block 1695 len 12288
19558 225/300 Write block 1287 len 24576 data: 3 3 3 3 3 2
19559 226/300 Read block 2099 len 20480
19560 227/300 Read block 4270 len 24576
19561 228/300 Read block 2482 len 28672
19562 229/300 Read block 4547 len 16384
19563 230/300 Read block 4647 len 32768
19564 231/300 Read block 2616 len 20480
19565 232/300 Write block 2492 len 40960 data: 3 2 2 2 2 2 2 2 2 2
19566 233/300 Flush
19567 234/300 Write block 840 len 4096 data: 7
19568 235/300 Read block 518 len 8192
19569 236/300 Read block 2011 len 12288
19570 237/300 Write block 535 len 8192 data: 6 4
19571 238/300 Read block 3289 len 28672
19572 239/300 Read block 3869 len 16384
19573 240/300 Read block 553 len 24576
19574 241/300 Write block 1027 len 36864 data: 5 5 6 7 6 6 6 7 5
19575 242/300 Flush
19576 243/300 Write block 3805 len 24576 data: 3 3 3 4 4 3
19577 244/300 Read block 1657 len 4096
19578 245/300 Write block 2264 len 20480 data: 4 4 4 4 4
19579 246/300 Read block 3039 len 12288
19580 247/300 Read block 1611 len 36864
19581 248/300 Flush
19582 249/300 Write block 4024 len 28672 data: 5 5 6 6 6 5 5
19583 250/300 Flush
19584 251/300 Write block 2657 len 12288 data: 3 2 2
19585 252/300 Write block 3895 len 12288 data: 4 4 5
19586 253/300 Write block 3353 len 8192 data: 4 3
19587 254/300 Write block 819 len 32768 data: 3 4 3 4 4 4 4 3
19588 255/300 Read block 1087 len 16384
19589 256/300 Read block 352 len 12288
19590 257/300 Read block 4193 len 28672
19591 258/300 Read block 4434 len 20480
19592 259/300 Write block 917 len 8192 data: 6 6
19593 260/300 Read block 2493 len 16384
19594 261/300 Read block 4010 len 28672
19595 262/300 Write block 2804 len 36864 data: 6 6 5 6 7 7 7 7 6
19596 263/300 Write block 2548 len 8192 data: 3 4
19597 264/300 Read block 3100 len 20480
19598 265/300 Write block 4330 len 36864 data: 3 4 4 5 5 4 4 5 5
19599 266/300 Flush
19600 267/300 Write block 24 len 36864 data: 5 5 4 4 5 5 4 4 4
19601 268/300 Read block 8 len 12288
19602 269/300 Flush
19603 270/300 Read block 3551 len 28672
19604 271/300 Read block 4167 len 20480
19605 272/300 Read block 402 len 24576
19606 273/300 Read block 3572 len 28672
19607 274/300 Read block 2652 len 28672
19608 275/300 Read block 3619 len 28672
19609 276/300 Read block 2089 len 36864
19610 277/300 Write block 1482 len 40960 data: 6 6 5 6 5 2 3 3 3 4
19611 278/300 Read block 3606 len 28672
19612 279/300 Read block 759 len 40960
19613 280/300 Flush
19614 281/300 Read block 2300 len 28672
19615 282/300 Write block 1017 len 4096 data: 5
19616 283/300 Write block 1468 len 40960 data: 4 4 4 6 6 4 6 5 5 5
19617 284/300 Flush
19618 285/300 Read block 4203 len 4096
19619 286/300 Read block 4323 len 20480
19620 287/300 Read block 266 len 12288
19621 288/300 Read block 1983 len 36864
19622 289/300 Read block 2353 len 28672
19623 290/300 Write block 1176 len 8192 data: 6 5
19624 291/300 Write block 1157 len 40960 data: 5 5 4 6 5 5 6 5 5 5
19625 292/300 Read block 1734 len 20480
19626 293/300 Read block 4336 len 32768
19627 294/300 Read block 2060 len 4096
19628 295/300 Read block 3354 len 8192
19629 296/300 Write block 1606 len 8192 data: 5 6
19630 297/300 Write block 67 len 36864 data: 3 4 5 6 5 7 8 8 8
19631 298/300 Write block 772 len 20480 data: 6 5 6 7 6
19632 299/300 Read block 132 len 40960
19633 300/300 Read block 4229 len 36864
19634 301/300 Write block 1426 len 16384 data: 2 3 4 4
19635 Main task has work to do, go find it
19636 got dsc Start(0)
19637 start 0
19638 Jan 10 16:39:28.148 INFO request completed, latency_us: 213, response_code: 204, uri: /start/cid/0, method: POST, req_id: e0ab97b1-c3fd-4214-b109-547fdbbd915a, remote_addr: 127.0.0.1:55917, local_addr: 127.0.0.1:9998
19639 Replay: started 0, returned:Ok(())
19640 ----------------------------------------------------------------
19641 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:301
19642 States: Offline Active Active
19643 JOBID ACK TYPE BKS/EXT DS:0 DS:1 DS:2 REPLAY
19644 6131 Acked Write 7 Sent Done Done false
19645 6132 Acked Read 9 Sent Done Done false
19646 6133 Acked Write 8 Sent Done Done false
19647 6134 Acked Write 3 Sent Done Done false
19648 6135 Acked Read 2 Sent Done Done false
19649 6136 Acked Flush 0 Sent Done Done false
19650 6137 Acked Write 4 Sent Done Done false
19651 6138 Acked Write 7 Sent Done Done false
19652 6139 Acked Read 3 Sent Done Done false
19653 6140 Acked Write 10 Sent Done Done false
19654 6141 Acked Read 4 Sent Done Done false
19655 6142 Acked Write 8 Sent Done Done false
19656 6143 Acked Write 8 Sent Done Done false
19657 6144 Acked Read 4 Sent Done Done false
19658 6145 Acked Read 4 Sent Done Done false
19659 6146 Acked Write 6 Sent Done Done false
19660 6147 Acked Flush 0 Sent Done Done false
19661 6148 Acked Write 6 Sent Done Done false
19662 6149 Acked Write 8 Sent Done Done false
19663 6150 Acked Flush 0 Sent Done Done false
19664 6151 Acked Read 3 Sent Done Done false
19665 6152 Acked Read 1 Sent Done Done false
19666 6153 Acked Read 7 Sent Done Done false
19667 6154 Acked Read 4 Sent Done Done false
19668 6155 Acked Write 6 Sent Done Done false
19669 6156 Acked Flush 0 Sent Done Done false
19670 6157 Acked Read 10 Sent Done Done false
19671 6158 Acked Read 5 Sent Done Done false
19672 6159 Acked Read 10 Sent Done Done false
19673 6160 Acked Read 6 Sent Done Done false
19674 6161 Acked Write 3 Sent Done Done false
19675 6162 Acked Write 6 Sent Done Done false
19676 6163 Acked Write 1 Sent Done Done false
19677 6164 Acked Read 4 Sent Done Done false
19678 6165 Acked Write 9 Sent Done Done false
19679 6166 Acked Read 5 Sent Done Done false
19680 6167 Acked Write 9 Sent Done Done false
19681 6168 Acked Write 7 Sent Done Done false
19682 6169 Acked Read 4 Sent Done Done false
19683 6170 Acked Write 1 Sent Done Done false
19684 6171 Acked Write 3 Sent Done Done false
19685 6172 Acked Flush 0 Sent Done Done false
19686 6173 Acked Read 9 Sent Done Done false
19687 6174 Acked Write 10 Sent Done Done false
19688 6175 Acked Write 6 Sent Done Done false
19689 6176 Acked Read 3 Sent Done Done false
19690 6177 Acked Flush 0 Sent Done Done false
19691 6178 Acked Write 2 Sent Done Done false
19692 6179 Acked Read 9 Sent Done Done false
19693 6180 Acked Read 8 Sent Done Done false
19694 6181 Acked Read 1 Sent Done Done false
19695 6182 Acked Read 8 Sent Done Done false
19696 6183 Acked Flush 0 Sent Done Done false
19697 6184 Acked Read 2 Sent Done Done false
19698 6185 Acked Read 6 Sent Done Done false
19699 6186 Acked Write 9 Sent Done Done false
19700 6187 Acked Read 8 Sent Done Done false
19701 6188 Acked Read 5 Sent Done Done false
19702 6189 Acked Write 2 Sent Done Done false
19703 6190 Acked Write 2 Sent Done Done false
19704 6191 Acked Read 1 Sent Done Done false
19705 6192 Acked Read 10 Sent Done Done false
19706 6193 Acked Read 8 Sent Done Done false
19707 6194 Acked Write 5 Sent Done Done false
19708 6195 Acked Write 8 Sent Done Done false
19709 6196 Acked Read 4 Sent Done Done false
19710 6197 Acked Write 1 Sent Done Done false
19711 6198 Acked Read 10 Sent Done Done false
19712 6199 Acked Read 2 Sent Done Done false
19713 6200 Acked Read 4 Sent Done Done false
19714 6201 Acked Read 1 Sent Done Done false
19715 6202 Acked Write 1 Sent Done Done false
19716 6203 Acked Write 7 Sent Done Done false
19717 6204 Acked Read 3 Sent Done Done false
19718 6205 Acked Write 8 Sent Done Done false
19719 6206 Acked Write 1 Sent Done Done false
19720 6207 Acked Flush 0 Sent Done Done false
19721 6208 Acked Read 7 Sent Done Done false
19722 6209 Acked Write 10 Sent Done Done false
19723 6210 Acked Read 8 Sent Done Done false
19724 6211 Acked Read 6 Sent Done Done false
19725 6212 Acked Read 7 Sent Done Done false
19726 6213 Acked Read 2 Sent Done Done false
19727 6214 Acked Write 4 Sent Done Done false
19728 6215 Acked Write 2 Sent Done Done false
19729 6216 Acked Flush 0 Sent Done Done false
19730 6217 Acked Read 4 Sent Done Done false
19731 6218 Acked Write 9 Sent Done Done false
19732 6219 Acked Write 5 Sent Done Done false
19733 6220 Acked Read 3 Sent Done Done false
19734 6221 Acked Read 5 Sent Done Done false
19735 6222 Acked Write 5 Sent Done Done false
19736 6223 Acked Write 6 Sent Done Done false
19737 6224 Acked Read 3 Sent Done Done false
19738 6225 Acked Read 10 Sent Done Done false
19739 6226 Acked Write 8 Sent Done Done false
19740 6227 Acked Write 9 Sent Done Done false
19741 6228 Acked Read 4 Sent Done Done false
19742 6229 Acked Read 1 Sent Done Done false
19743 6230 Acked Write 7 Sent Done Done false
19744 6231 Acked Write 1 Sent Done Done false
19745 6232 Acked Read 8 Sent Done Done false
19746 6233 Acked Read 7 Sent Done Done false
19747 6234 Acked Flush 0 Sent Done Done false
19748 6235 Acked Flush 0 Sent Done Done false
19749 6236 Acked Write 6 Sent Done Done false
19750 6237 Acked Write 5 Sent Done Done false
19751 6238 Acked Write 6 Sent Done Done false
19752 6239 Acked Read 10 Sent Done Done false
19753 6240 Acked Write 8 Sent Done Done false
19754 6241 Acked Write 4 Sent Done Done false
19755 6242 Acked Read 4 Sent Done Done false
19756 6243 Acked Flush 0 Sent Done Done false
19757 6244 Acked Write 9 Sent Done Done false
19758 6245 Acked Read 1 Sent Done Done false
19759 6246 Acked Write 5 Sent Done Done false
19760 6247 Acked Write 10 Sent Done Done false
19761 6248 Acked Write 7 Sent Done Done false
19762 6249 Acked Read 1 Sent Done Done false
19763 6250 Acked Write 3 Sent Done Done false
19764 6251 Acked Write 3 Sent Done Done false
19765 6252 Acked Write 5 Sent Done Done false
19766 6253 Acked Read 6 Sent Done Done false
19767 6254 Acked Read 3 Sent Done Done false
19768 6255 Acked Write 1 Sent Done Done false
19769 6256 Acked Read 7 Sent Done Done false
19770 6257 Acked Write 9 Sent Done Done false
19771 6258 Acked Write 4 Sent Done Done false
19772 6259 Acked Read 6 Sent Done Done false
19773 6260 Acked Read 5 Sent Done Done false
19774 6261 Acked Read 8 Sent Done Done false
19775 6262 Acked Write 2 Sent Done Done false
19776 6263 Acked Flush 0 Sent Done Done false
19777 6264 Acked Read 8 Sent Done Done false
19778 6265 Acked Write 10 Sent Done Done false
19779 6266 Acked Write 2 Sent Done Done false
19780 6267 Acked Flush 0 Sent Done Done false
19781 6268 Acked Read 1 Sent Done Done false
19782 6269 Acked Read 8 Sent Done Done false
19783 6270 Acked Read 6 Sent Done Done false
19784 6271 Acked Write 9 Sent Done Done false
19785 6272 Acked Write 3 Sent Done Done false
19786 6273 Acked Read 7 Sent Done Done false
19787 6274 Acked Write 3 Sent Done Done false
19788 6275 Acked Write 6 Sent Done Done false
19789 6276 Acked Read 8 Sent Done Done false
19790 6277 Acked Read 9 Sent Done Done false
19791 6278 Acked Flush 0 Sent Done Done false
19792 6279 Acked Flush 0 Sent Done Done false
19793 6280 Acked Flush 0 Sent Done Done false
19794 6281 Acked Read 3 Sent Done Done false
19795 6282 Acked Write 5 Sent Done Done false
19796 6283 Acked Read 2 Sent Done Done false
19797 6284 Acked Flush 0 Sent Done Done false
19798 6285 Acked Read 6 Sent Done Done false
19799 6286 Acked Flush 0 Sent Done Done false
19800 6287 Acked Write 8 Sent Done Done false
19801 6288 Acked Read 6 Sent Done Done false
19802 6289 Acked Write 8 Sent Done Done false
19803 6290 Acked Flush 0 Sent Done Done false
19804 6291 Acked Read 1 Sent Done Done false
19805 6292 Acked Flush 0 Sent Done Done false
19806 6293 Acked Write 5 Sent Done Done false
19807 6294 Acked Write 7 Sent Done Done false
19808 6295 Acked Read 4 Sent Done Done false
19809 6296 Acked Read 10 Sent Done Done false
19810 6297 Acked Read 7 Sent Done Done false
19811 6298 Acked Read 2 Sent Done Done false
19812 6299 Acked Read 4 Sent Done Done false
19813 6300 Acked Write 9 Sent Done Done false
19814 6301 Acked Read 2 Sent Done Done false
19815 6302 Acked Read 3 Sent Done Done false
19816 6303 Acked Read 5 Sent Done Done false
19817 6304 Acked Read 10 Sent Done Done false
19818 6305 Acked Read 4 Sent Done Done false
19819 6306 Acked Read 7 Sent Done Done false
19820 6307 Acked Write 6 Sent Done Done false
19821 6308 Acked Write 5 Sent Done Done false
19822 6309 Acked Read 10 Sent Done Done false
19823 6310 Acked Write 1 Sent Done Done false
19824 6311 Acked Write 5 Sent Done Done false
19825 6312 Acked Read 10 Sent Done Done false
19826 6313 Acked Read 3 Sent Done Done false
19827 6314 Acked Write 5 Sent Done Done false
19828 6315 Acked Read 10 Sent Done Done false
19829 6316 Acked Write 6 Sent Done Done false
19830 6317 Acked Read 3 Sent Done Done false
19831 6318 Acked Read 4 Sent Done Done false
19832 6319 Acked Read 5 Sent Done Done false
19833 6320 Acked Read 5 Sent Done Done false
19834 6321 Acked Read 10 Sent Done Done false
19835 6322 Acked Read 7 Sent Done Done false
19836 6323 Acked Read 7 Sent Done Done false
19837 6324 Acked Read 3 Sent Done Done false
19838 6325 Acked Flush 0 Sent Done Done false
19839 6326 Acked Write 3 Sent Done Done false
19840 6327 Acked Read 4 Sent Done Done false
19841 6328 Acked Write 8 Sent Done Done false
19842 6329 Acked Read 9 Sent Done Done false
19843 6330 Acked Write 1 Sent Done Done false
19844 6331 Acked Write 8 Sent Done Done false
19845 6332 Acked Read 1 Sent Done Done false
19846 6333 Acked Write 7 Sent Done Done false
19847 6334 Acked Read 1 Sent Done Done false
19848 6335 Acked Write 1 Sent Done Done false
19849 6336 Acked Read 3 Sent Done Done false
19850 6337 Acked Read 5 Sent Done Done false
19851 6338 Acked Read 1 Sent Done Done false
19852 6339 Acked Read 4 Sent Done Done false
19853 6340 Acked Flush 0 Sent Done Done false
19854 6341 Acked Write 3 Sent Done Done false
19855 6342 Acked Write 8 Sent Done Done false
19856 6343 Acked Write 5 Sent Done Done false
19857 6344 Acked Write 5 Sent Done Done false
19858 6345 Acked Flush 0 Sent Done Done false
19859 6346 Acked Read 7 Sent Done Done false
19860 6347 Acked Read 2 Sent Done Done false
19861 6348 Acked Read 9 Sent Done Done false
19862 6349 Acked Write 9 Sent Done Done false
19863 6350 Acked Flush 0 Sent Done Done false
19864 6351 Acked Flush 0 Sent Done Done false
19865 6352 Acked Flush 0 Sent Done Done false
19866 6353 Acked Read 5 Sent Done Done false
19867 6354 Acked Read 3 Sent Done Done false
19868 6355 Acked Write 6 Sent Done Done false
19869 6356 Acked Read 5 Sent Done Done false
19870 6357 Acked Read 6 Sent Done Done false
19871 6358 Acked Read 7 Sent Done Done false
19872 6359 Acked Read 4 Sent Done Done false
19873 6360 Acked Read 8 Sent Done Done false
19874 6361 Acked Read 5 Sent Done Done false
19875 6362 Acked Write 10 Sent Done Done false
19876 6363 Acked Flush 0 Sent Done Done false
19877 6364 Acked Write 1 Sent Done Done false
19878 6365 Acked Read 2 Sent Done Done false
19879 6366 Acked Read 3 Sent Done Done false
19880 6367 Acked Write 2 Sent Done Done false
19881 6368 Acked Read 7 Sent Done Done false
19882 6369 Acked Read 4 Sent Done Done false
19883 6370 Acked Read 6 Sent Done Done false
19884 6371 Acked Write 9 Sent Done Done false
19885 6372 Acked Flush 0 Sent Done Done false
19886 6373 Acked Write 6 Sent Done Done false
19887 6374 Acked Read 1 Sent Done Done false
19888 6375 Acked Write 5 Sent Done Done false
19889 6376 Acked Read 3 Sent Done Done false
19890 6377 Acked Read 9 Sent Done Done false
19891 6378 Acked Flush 0 Sent Done Done false
19892 6379 Acked Write 7 Sent Done Done false
19893 6380 Acked Flush 0 Sent Done Done false
19894 6381 Acked Write 3 Sent Done Done false
19895 6382 Acked Write 3 Sent Done Done false
19896 6383 Acked Write 2 Sent Done Done false
19897 6384 Acked Write 8 Sent Done Done false
19898 6385 Acked Read 4 Sent Done Done false
19899 6386 Acked Read 3 Sent Done Done false
19900 6387 Acked Read 7 Sent Done Done false
19901 6388 Acked Read 5 Sent Done Done false
19902 6389 Acked Write 2 Sent Done Done false
19903 6390 Acked Read 4 Sent Done Done false
19904 6391 Acked Read 7 Sent Done Done false
19905 6392 Acked Write 9 Sent Done Done false
19906 6393 Acked Write 2 Sent Done Done false
19907 6394 Acked Read 5 Sent Done Done false
19908 6395 Acked Write 9 Sent Done Done false
19909 6396 Acked Flush 0 Sent Done Done false
19910 6397 Acked Write 9 Sent Done Done false
19911 6398 Acked Read 3 Sent Done Done false
19912 6399 Acked Flush 0 Sent Done Done false
19913 6400 Acked Read 7 Sent Done Done false
19914 6401 Acked Read 5 Sent Done Done false
19915 6402 Acked Read 6 Sent Done Done false
19916 6403 Acked Read 7 Sent Done Done false
19917 6404 Acked Read 7 Sent Done Done false
19918 6405 Acked Read 7 Sent Done Done false
19919 6406 Acked Read 9 Sent Done Done false
19920 6407 Acked Write 10 Sent Done Done false
19921 6408 Acked Read 7 Sent Done Done false
19922 6409 Acked Read 10 Sent Done Done false
19923 6410 Acked Flush 0 Sent Done Done false
19924 6411 Acked Read 7 Sent Done Done false
19925 6412 Acked Write 1 Sent Done Done false
19926 6413 Acked Write 10 Sent Done Done false
19927 6414 Acked Flush 0 Sent Done Done false
19928 6415 Acked Read 1 Sent Done Done false
19929 6416 Acked Read 5 Sent Done Done false
19930 6417 Acked Read 3 Sent Done Done false
19931 6418 Acked Read 9 Sent Done Done false
19932 6419 Acked Read 7 Sent Done Done false
19933 6420 Acked Write 2 Sent Done Done false
19934 6421 Acked Write 10 Sent Done Done false
19935 6422 Acked Read 5 Sent Done Done false
19936 6423 Acked Read 8 Sent Done Done false
19937 6424 Acked Read 1 Sent Done Done false
19938 6425 Acked Read 2 Sent Done Done false
19939 6426 Acked Write 2 Sent Done Done false
19940 6427 Acked Write 9 Sent Done Done false
19941 6428 Acked Write 5 Sent Done Done false
19942 6429 Acked Read 10 Sent Done Done false
19943 6430 Acked Read 9 Sent Done Done false
19944 6431 Acked Write 4 Sent Done Done false
19945 STATES DS:0 DS:1 DS:2 TOTAL
19946 Sent 301 0 0 301
19947 Done 0 301 301 602
19948 Skipped 0 0 0 0
19949 Error 0 0 0 0
19950 Last Flush: 6130 6414 6414
19951 Downstairs last five completed: 6130 6129 6128 6127 6126
19952 Upstairs last five completed: 6431 6430 6429 6428 6427
19953 CLIENT: Up:0 ds:301 act:2
19954 ----------------------------------------------------------------
19955 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:302
19956 States: Offline Active Active
19957 JOBID ACK TYPE BKS/EXT DS:0 DS:1 DS:2 REPLAY
19958 6131 Acked Write 7 Sent Done Done false
19959 6132 Acked Read 9 Sent Done Done false
19960 6133 Acked Write 8 Sent Done Done false
19961 6134 Acked Write 3 Sent Done Done false
19962 6135 Acked Read 2 Sent Done Done false
19963 6136 Acked Flush 0 Sent Done Done false
19964 6137 Acked Write 4 Sent Done Done false
19965 6138 Acked Write 7 Sent Done Done false
19966 6139 Acked Read 3 Sent Done Done false
19967 6140 Acked Write 10 Sent Done Done false
19968 6141 Acked Read 4 Sent Done Done false
19969 6142 Acked Write 8 Sent Done Done false
19970 6143 Acked Write 8 Sent Done Done false
19971 6144 Acked Read 4 Sent Done Done false
19972 6145 Acked Read 4 Sent Done Done false
19973 6146 Acked Write 6 Sent Done Done false
19974 6147 Acked Flush 0 Sent Done Done false
19975 6148 Acked Write 6 Sent Done Done false
19976 6149 Acked Write 8 Sent Done Done false
19977 6150 Acked Flush 0 Sent Done Done false
19978 6151 Acked Read 3 Sent Done Done false
19979 6152 Acked Read 1 Sent Done Done false
19980 6153 Acked Read 7 Sent Done Done false
19981 6154 Acked Read 4 Sent Done Done false
19982 6155 Acked Write 6 Sent Done Done false
19983 6156 Acked Flush 0 Sent Done Done false
19984 6157 Acked Read 10 Sent Done Done false
19985 6158 Acked Read 5 Sent Done Done false
19986 6159 Acked Read 10 Sent Done Done false
19987 6160 Acked Read 6 Sent Done Done false
19988 6161 Acked Write 3 Sent Done Done false
19989 6162 Acked Write 6 Sent Done Done false
19990 6163 Acked Write 1 Sent Done Done false
19991 6164 Acked Read 4 Sent Done Done false
19992 6165 Acked Write 9 Sent Done Done false
19993 6166 Acked Read 5 Sent Done Done false
19994 6167 Acked Write 9 Sent Done Done false
19995 6168 Acked Write 7 Sent Done Done false
19996 6169 Acked Read 4 Sent Done Done false
19997 6170 Acked Write 1 Sent Done Done false
19998 6171 Acked Write 3 Sent Done Done false
19999 6172 Acked Flush 0 Sent Done Done false
20000 6173 Acked Read 9 Sent Done Done false
20001 6174 Acked Write 10 Sent Done Done false
20002 6175 Acked Write 6 Sent Done Done false
20003 6176 Acked Read 3 Sent Done Done false
20004 6177 Acked Flush 0 Sent Done Done false
20005 6178 Acked Write 2 Sent Done Done false
20006 6179 Acked Read 9 Sent Done Done false
20007 6180 Acked Read 8 Sent Done Done false
20008 6181 Acked Read 1 Sent Done Done false
20009 6182 Acked Read 8 Sent Done Done false
20010 6183 Acked Flush 0 Sent Done Done false
20011 6184 Acked Read 2 Sent Done Done false
20012 6185 Acked Read 6 Sent Done Done false
20013 6186 Acked Write 9 Sent Done Done false
20014 6187 Acked Read 8 Sent Done Done false
20015 6188 Acked Read 5 Sent Done Done false
20016 6189 Acked Write 2 Sent Done Done false
20017 6190 Acked Write 2 Sent Done Done false
20018 6191 Acked Read 1 Sent Done Done false
20019 6192 Acked Read 10 Sent Done Done false
20020 6193 Acked Read 8 Sent Done Done false
20021 6194 Acked Write 5 Sent Done Done false
20022 6195 Acked Write 8 Sent Done Done false
20023 6196 Acked Read 4 Sent Done Done false
20024 6197 Acked Write 1 Sent Done Done false
20025 6198 Acked Read 10 Sent Done Done false
20026 6199 Acked Read 2 Sent Done Done false
20027 6200 Acked Read 4 Sent Done Done false
20028 6201 Acked Read 1 Sent Done Done false
20029 6202 Acked Write 1 Sent Done Done false
20030 6203 Acked Write 7 Sent Done Done false
20031 6204 Acked Read 3 Sent Done Done false
20032 6205 Acked Write 8 Sent Done Done false
20033 6206 Acked Write 1 Sent Done Done false
20034 6207 Acked Flush 0 Sent Done Done false
20035 6208 Acked Read 7 Sent Done Done false
20036 6209 Acked Write 10 Sent Done Done false
20037 6210 Acked Read 8 Sent Done Done false
20038 6211 Acked Read 6 Sent Done Done false
20039 6212 Acked Read 7 Sent Done Done false
20040 6213 Acked Read 2 Sent Done Done false
20041 6214 Acked Write 4 Sent Done Done false
20042 6215 Acked Write 2 Sent Done Done false
20043 6216 Acked Flush 0 Sent Done Done false
20044 6217 Acked Read 4 Sent Done Done false
20045 6218 Acked Write 9 Sent Done Done false
20046 6219 Acked Write 5 Sent Done Done false
20047 6220 Acked Read 3 Sent Done Done false
20048 6221 Acked Read 5 Sent Done Done false
20049 6222 Acked Write 5 Sent Done Done false
20050 6223 Acked Write 6 Sent Done Done false
20051 6224 Acked Read 3 Sent Done Done false
20052 6225 Acked Read 10 Sent Done Done false
20053 6226 Acked Write 8 Sent Done Done false
20054 6227 Acked Write 9 Sent Done Done false
20055 6228 Acked Read 4 Sent Done Done false
20056 6229 Acked Read 1 Sent Done Done false
20057 6230 Acked Write 7 Sent Done Done false
20058 6231 Acked Write 1 Sent Done Done false
20059 6232 Acked Read 8 Sent Done Done false
20060 6233 Acked Read 7 Sent Done Done false
20061 6234 Acked Flush 0 Sent Done Done false
20062 6235 Acked Flush 0 Sent Done Done false
20063 6236 Acked Write 6 Sent Done Done false
20064 6237 Acked Write 5 Sent Done Done false
20065 6238 Acked Write 6 Sent Done Done false
20066 6239 Acked Read 10 Sent Done Done false
20067 6240 Acked Write 8 Sent Done Done false
20068 6241 Acked Write 4 Sent Done Done false
20069 6242 Acked Read 4 Sent Done Done false
20070 6243 Acked Flush 0 Sent Done Done false
20071 6244 Acked Write 9 Sent Done Done false
20072 6245 Acked Read 1 Sent Done Done false
20073 6246 Acked Write 5 Sent Done Done false
20074 6247 Acked Write 10 Sent Done Done false
20075 6248 Acked Write 7 Sent Done Done false
20076 6249 Acked Read 1 Sent Done Done false
20077 6250 Acked Write 3 Sent Done Done false
20078 6251 Acked Write 3 Sent Done Done false
20079 6252 Acked Write 5 Sent Done Done false
20080 6253 Acked Read 6 Sent Done Done false
20081 6254 Acked Read 3 Sent Done Done false
20082 6255 Acked Write 1 Sent Done Done false
20083 6256 Acked Read 7 Sent Done Done false
20084 6257 Acked Write 9 Sent Done Done false
20085 6258 Acked Write 4 Sent Done Done false
20086 6259 Acked Read 6 Sent Done Done false
20087 6260 Acked Read 5 Sent Done Done false
20088 6261 Acked Read 8 Sent Done Done false
20089 6262 Acked Write 2 Sent Done Done false
20090 6263 Acked Flush 0 Sent Done Done false
20091 6264 Acked Read 8 Sent Done Done false
20092 6265 Acked Write 10 Sent Done Done false
20093 6266 Acked Write 2 Sent Done Done false
20094 6267 Acked Flush 0 Sent Done Done false
20095 6268 Acked Read 1 Sent Done Done false
20096 6269 Acked Read 8 Sent Done Done false
20097 6270 Acked Read 6 Sent Done Done false
20098 6271 Acked Write 9 Sent Done Done false
20099 6272 Acked Write 3 Sent Done Done false
20100 6273 Acked Read 7 Sent Done Done false
20101 6274 Acked Write 3 Sent Done Done false
20102 6275 Acked Write 6 Sent Done Done false
20103 6276 Acked Read 8 Sent Done Done false
20104 6277 Acked Read 9 Sent Done Done false
20105 6278 Acked Flush 0 Sent Done Done false
20106 6279 Acked Flush 0 Sent Done Done false
20107 6280 Acked Flush 0 Sent Done Done false
20108 6281 Acked Read 3 Sent Done Done false
20109 6282 Acked Write 5 Sent Done Done false
20110 6283 Acked Read 2 Sent Done Done false
20111 6284 Acked Flush 0 Sent Done Done false
20112 6285 Acked Read 6 Sent Done Done false
20113 6286 Acked Flush 0 Sent Done Done false
20114 6287 Acked Write 8 Sent Done Done false
20115 6288 Acked Read 6 Sent Done Done false
20116 6289 Acked Write 8 Sent Done Done false
20117 6290 Acked Flush 0 Sent Done Done false
20118 6291 Acked Read 1 Sent Done Done false
20119 6292 Acked Flush 0 Sent Done Done false
20120 6293 Acked Write 5 Sent Done Done false
20121 6294 Acked Write 7 Sent Done Done false
20122 6295 Acked Read 4 Sent Done Done false
20123 6296 Acked Read 10 Sent Done Done false
20124 6297 Acked Read 7 Sent Done Done false
20125 6298 Acked Read 2 Sent Done Done false
20126 6299 Acked Read 4 Sent Done Done false
20127 6300 Acked Write 9 Sent Done Done false
20128 6301 Acked Read 2 Sent Done Done false
20129 6302 Acked Read 3 Sent Done Done false
20130 6303 Acked Read 5 Sent Done Done false
20131 6304 Acked Read 10 Sent Done Done false
20132 6305 Acked Read 4 Sent Done Done false
20133 6306 Acked Read 7 Sent Done Done false
20134 6307 Acked Write 6 Sent Done Done false
20135 6308 Acked Write 5 Sent Done Done false
20136 6309 Acked Read 10 Sent Done Done false
20137 6310 Acked Write 1 Sent Done Done false
20138 6311 Acked Write 5 Sent Done Done false
20139 6312 Acked Read 10 Sent Done Done false
20140 6313 Acked Read 3 Sent Done Done false
20141 6314 Acked Write 5 Sent Done Done false
20142 6315 Acked Read 10 Sent Done Done false
20143 6316 Acked Write 6 Sent Done Done false
20144 6317 Acked Read 3 Sent Done Done false
20145 6318 Acked Read 4 Sent Done Done false
20146 6319 Acked Read 5 Sent Done Done false
20147 6320 Acked Read 5 Sent Done Done false
20148 6321 Acked Read 10 Sent Done Done false
20149 6322 Acked Read 7 Sent Done Done false
20150 6323 Acked Read 7 Sent Done Done false
20151 6324 Acked Read 3 Sent Done Done false
20152 6325 Acked Flush 0 Sent Done Done false
20153 6326 Acked Write 3 Sent Done Done false
20154 6327 Acked Read 4 Sent Done Done false
20155 6328 Acked Write 8 Sent Done Done false
20156 6329 Acked Read 9 Sent Done Done false
20157 6330 Acked Write 1 Sent Done Done false
20158 6331 Acked Write 8 Sent Done Done false
20159 6332 Acked Read 1 Sent Done Done false
20160 6333 Acked Write 7 Sent Done Done false
20161 6334 Acked Read 1 Sent Done Done false
20162 6335 Acked Write 1 Sent Done Done false
20163 6336 Acked Read 3 Sent Done Done false
20164 6337 Acked Read 5 Sent Done Done false
20165 6338 Acked Read 1 Sent Done Done false
20166 6339 Acked Read 4 Sent Done Done false
20167 6340 Acked Flush 0 Sent Done Done false
20168 6341 Acked Write 3 Sent Done Done false
20169 6342 Acked Write 8 Sent Done Done false
20170 6343 Acked Write 5 Sent Done Done false
20171 6344 Acked Write 5 Sent Done Done false
20172 6345 Acked Flush 0 Sent Done Done false
20173 6346 Acked Read 7 Sent Done Done false
20174 6347 Acked Read 2 Sent Done Done false
20175 6348 Acked Read 9 Sent Done Done false
20176 6349 Acked Write 9 Sent Done Done false
20177 6350 Acked Flush 0 Sent Done Done false
20178 6351 Acked Flush 0 Sent Done Done false
20179 6352 Acked Flush 0 Sent Done Done false
20180 6353 Acked Read 5 Sent Done Done false
20181 6354 Acked Read 3 Sent Done Done false
20182 6355 Acked Write 6 Sent Done Done false
20183 6356 Acked Read 5 Sent Done Done false
20184 6357 Acked Read 6 Sent Done Done false
20185 6358 Acked Read 7 Sent Done Done false
20186 6359 Acked Read 4 Sent Done Done false
20187 6360 Acked Read 8 Sent Done Done false
20188 6361 Acked Read 5 Sent Done Done false
20189 6362 Acked Write 10 Sent Done Done false
20190 6363 Acked Flush 0 Sent Done Done false
20191 6364 Acked Write 1 Sent Done Done false
20192 6365 Acked Read 2 Sent Done Done false
20193 6366 Acked Read 3 Sent Done Done false
20194 6367 Acked Write 2 Sent Done Done false
20195 6368 Acked Read 7 Sent Done Done false
20196 6369 Acked Read 4 Sent Done Done false
20197 6370 Acked Read 6 Sent Done Done false
20198 6371 Acked Write 9 Sent Done Done false
20199 6372 Acked Flush 0 Sent Done Done false
20200 6373 Acked Write 6 Sent Done Done false
20201 6374 Acked Read 1 Sent Done Done false
20202 6375 Acked Write 5 Sent Done Done false
20203 6376 Acked Read 3 Sent Done Done false
20204 6377 Acked Read 9 Sent Done Done false
20205 6378 Acked Flush 0 Sent Done Done false
20206 6379 Acked Write 7 Sent Done Done false
20207 6380 Acked Flush 0 Sent Done Done false
20208 6381 Acked Write 3 Sent Done Done false
20209 6382 Acked Write 3 Sent Done Done false
20210 6383 Acked Write 2 Sent Done Done false
20211 6384 Acked Write 8 Sent Done Done false
20212 6385 Acked Read 4 Sent Done Done false
20213 6386 Acked Read 3 Sent Done Done false
20214 6387 Acked Read 7 Sent Done Done false
20215 6388 Acked Read 5 Sent Done Done false
20216 6389 Acked Write 2 Sent Done Done false
20217 6390 Acked Read 4 Sent Done Done false
20218 6391 Acked Read 7 Sent Done Done false
20219 6392 Acked Write 9 Sent Done Done false
20220 6393 Acked Write 2 Sent Done Done false
20221 6394 Acked Read 5 Sent Done Done false
20222 6395 Acked Write 9 Sent Done Done false
20223 6396 Acked Flush 0 Sent Done Done false
20224 6397 Acked Write 9 Sent Done Done false
20225 6398 Acked Read 3 Sent Done Done false
20226 6399 Acked Flush 0 Sent Done Done false
20227 6400 Acked Read 7 Sent Done Done false
20228 6401 Acked Read 5 Sent Done Done false
20229 6402 Acked Read 6 Sent Done Done false
20230 6403 Acked Read 7 Sent Done Done false
20231 6404 Acked Read 7 Sent Done Done false
20232 6405 Acked Read 7 Sent Done Done false
20233 6406 Acked Read 9 Sent Done Done false
20234 6407 Acked Write 10 Sent Done Done false
20235 6408 Acked Read 7 Sent Done Done false
20236 6409 Acked Read 10 Sent Done Done false
20237 6410 Acked Flush 0 Sent Done Done false
20238 6411 Acked Read 7 Sent Done Done false
20239 6412 Acked Write 1 Sent Done Done false
20240 6413 Acked Write 10 Sent Done Done false
20241 6414 Acked Flush 0 Sent Done Done false
20242 6415 Acked Read 1 Sent Done Done false
20243 6416 Acked Read 5 Sent Done Done false
20244 6417 Acked Read 3 Sent Done Done false
20245 6418 Acked Read 9 Sent Done Done false
20246 6419 Acked Read 7 Sent Done Done false
20247 6420 Acked Write 2 Sent Done Done false
20248 6421 Acked Write 10 Sent Done Done false
20249 6422 Acked Read 5 Sent Done Done false
20250 6423 Acked Read 8 Sent Done Done false
20251 6424 Acked Read 1 Sent Done Done false
20252 6425 Acked Read 2 Sent Done Done false
20253 6426 Acked Write 2 Sent Done Done false
20254 6427 Acked Write 9 Sent Done Done false
20255 6428 Acked Write 5 Sent Done Done false
20256 6429 Acked Read 10 Sent Done Done false
20257 6430 Acked Read 9 Sent Done Done false
20258 6431 Acked Write 4 Sent Done Done false
20259 6432 Acked Flush 0 Sent Done Done false
20260 STATES DS:0 DS:1 DS:2 TOTAL
20261 Sent 302 0 0 302
20262 Done 0 302 302 604
20263 Skipped 0 0 0 0
20264 Error 0 0 0 0
20265 Last Flush: 6130 6432 6432
20266 Downstairs last five completed: 6130 6129 6128 6127 6126
20267 Upstairs last five completed: 6432 6431 6430 6429 6428
20268 CLIENT: Up:0 ds:302 act:2
202692025-01-10T16:39:33.908ZINFOcrucible: connecting to 127.0.0.1:8810 = io task client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
202702025-01-10T16:39:33.908ZWARNcrucible: ds_connection connect to 127.0.0.1:8810 failure: Os { code: 146, kind: ConnectionRefused, message: "Connection refused" } = io task client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
202712025-01-10T16:39:33.908ZWARNcrucible: client task is sending Done(ConnectionFailed(Os { code: 146, kind: ConnectionRefused, message: "Connection refused" })) = io task client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
202722025-01-10T16:39:33.908ZWARNcrucible: downstairs task for 0 stopped due to ConnectionFailed(Os { code: 146, kind: ConnectionRefused, message: "Connection refused" }) session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
202732025-01-10T16:39:33.908ZINFOcrucible: client task is exiting = io task client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
20274 [8810] got start action
20275 [8810] I am going to restart
20276 Starting downstairs at port 8810
20277 Make output file at "/tmp/dsc/downstairs-8810.txt"
20278 [8810][0] reports Starting
20279 Downstairs /var/tmp/dsc/region/8810 port 8810 PID:Some(1220)
20280 [8810][0] reports Running
20281 ----------------------------------------------------------------
20282 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:302
20283 States: Offline Active Active
20284 JOBID ACK TYPE BKS/EXT DS:0 DS:1 DS:2 REPLAY
20285 6131 Acked Write 7 Sent Done Done false
20286 6132 Acked Read 9 Sent Done Done false
20287 6133 Acked Write 8 Sent Done Done false
20288 6134 Acked Write 3 Sent Done Done false
20289 6135 Acked Read 2 Sent Done Done false
20290 6136 Acked Flush 0 Sent Done Done false
20291 6137 Acked Write 4 Sent Done Done false
20292 6138 Acked Write 7 Sent Done Done false
20293 6139 Acked Read 3 Sent Done Done false
20294 6140 Acked Write 10 Sent Done Done false
20295 6141 Acked Read 4 Sent Done Done false
20296 6142 Acked Write 8 Sent Done Done false
20297 6143 Acked Write 8 Sent Done Done false
20298 6144 Acked Read 4 Sent Done Done false
20299 6145 Acked Read 4 Sent Done Done false
20300 6146 Acked Write 6 Sent Done Done false
20301 6147 Acked Flush 0 Sent Done Done false
20302 6148 Acked Write 6 Sent Done Done false
20303 6149 Acked Write 8 Sent Done Done false
20304 6150 Acked Flush 0 Sent Done Done false
20305 6151 Acked Read 3 Sent Done Done false
20306 6152 Acked Read 1 Sent Done Done false
20307 6153 Acked Read 7 Sent Done Done false
20308 6154 Acked Read 4 Sent Done Done false
20309 6155 Acked Write 6 Sent Done Done false
20310 6156 Acked Flush 0 Sent Done Done false
20311 6157 Acked Read 10 Sent Done Done false
20312 6158 Acked Read 5 Sent Done Done false
20313 6159 Acked Read 10 Sent Done Done false
20314 6160 Acked Read 6 Sent Done Done false
20315 6161 Acked Write 3 Sent Done Done false
20316 6162 Acked Write 6 Sent Done Done false
20317 6163 Acked Write 1 Sent Done Done false
20318 6164 Acked Read 4 Sent Done Done false
20319 6165 Acked Write 9 Sent Done Done false
20320 6166 Acked Read 5 Sent Done Done false
20321 6167 Acked Write 9 Sent Done Done false
20322 6168 Acked Write 7 Sent Done Done false
20323 6169 Acked Read 4 Sent Done Done false
20324 6170 Acked Write 1 Sent Done Done false
20325 6171 Acked Write 3 Sent Done Done false
20326 6172 Acked Flush 0 Sent Done Done false
20327 6173 Acked Read 9 Sent Done Done false
20328 6174 Acked Write 10 Sent Done Done false
20329 6175 Acked Write 6 Sent Done Done false
20330 6176 Acked Read 3 Sent Done Done false
20331 6177 Acked Flush 0 Sent Done Done false
20332 6178 Acked Write 2 Sent Done Done false
20333 6179 Acked Read 9 Sent Done Done false
20334 6180 Acked Read 8 Sent Done Done false
20335 6181 Acked Read 1 Sent Done Done false
20336 6182 Acked Read 8 Sent Done Done false
20337 6183 Acked Flush 0 Sent Done Done false
20338 6184 Acked Read 2 Sent Done Done false
20339 6185 Acked Read 6 Sent Done Done false
20340 6186 Acked Write 9 Sent Done Done false
20341 6187 Acked Read 8 Sent Done Done false
20342 6188 Acked Read 5 Sent Done Done false
20343 6189 Acked Write 2 Sent Done Done false
20344 6190 Acked Write 2 Sent Done Done false
20345 6191 Acked Read 1 Sent Done Done false
20346 6192 Acked Read 10 Sent Done Done false
20347 6193 Acked Read 8 Sent Done Done false
20348 6194 Acked Write 5 Sent Done Done false
20349 6195 Acked Write 8 Sent Done Done false
20350 6196 Acked Read 4 Sent Done Done false
20351 6197 Acked Write 1 Sent Done Done false
20352 6198 Acked Read 10 Sent Done Done false
20353 6199 Acked Read 2 Sent Done Done false
20354 6200 Acked Read 4 Sent Done Done false
20355 6201 Acked Read 1 Sent Done Done false
20356 6202 Acked Write 1 Sent Done Done false
20357 6203 Acked Write 7 Sent Done Done false
20358 6204 Acked Read 3 Sent Done Done false
20359 6205 Acked Write 8 Sent Done Done false
20360 6206 Acked Write 1 Sent Done Done false
20361 6207 Acked Flush 0 Sent Done Done false
20362 6208 Acked Read 7 Sent Done Done false
20363 6209 Acked Write 10 Sent Done Done false
20364 6210 Acked Read 8 Sent Done Done false
20365 6211 Acked Read 6 Sent Done Done false
20366 6212 Acked Read 7 Sent Done Done false
20367 6213 Acked Read 2 Sent Done Done false
20368 6214 Acked Write 4 Sent Done Done false
20369 6215 Acked Write 2 Sent Done Done false
20370 6216 Acked Flush 0 Sent Done Done false
20371 6217 Acked Read 4 Sent Done Done false
20372 6218 Acked Write 9 Sent Done Done false
20373 6219 Acked Write 5 Sent Done Done false
20374 6220 Acked Read 3 Sent Done Done false
20375 6221 Acked Read 5 Sent Done Done false
20376 6222 Acked Write 5 Sent Done Done false
20377 6223 Acked Write 6 Sent Done Done false
20378 6224 Acked Read 3 Sent Done Done false
20379 6225 Acked Read 10 Sent Done Done false
20380 6226 Acked Write 8 Sent Done Done false
20381 6227 Acked Write 9 Sent Done Done false
20382 6228 Acked Read 4 Sent Done Done false
20383 6229 Acked Read 1 Sent Done Done false
20384 6230 Acked Write 7 Sent Done Done false
20385 6231 Acked Write 1 Sent Done Done false
20386 6232 Acked Read 8 Sent Done Done false
20387 6233 Acked Read 7 Sent Done Done false
20388 6234 Acked Flush 0 Sent Done Done false
20389 6235 Acked Flush 0 Sent Done Done false
20390 6236 Acked Write 6 Sent Done Done false
20391 6237 Acked Write 5 Sent Done Done false
20392 6238 Acked Write 6 Sent Done Done false
20393 6239 Acked Read 10 Sent Done Done false
20394 6240 Acked Write 8 Sent Done Done false
20395 6241 Acked Write 4 Sent Done Done false
20396 6242 Acked Read 4 Sent Done Done false
20397 6243 Acked Flush 0 Sent Done Done false
20398 6244 Acked Write 9 Sent Done Done false
20399 6245 Acked Read 1 Sent Done Done false
20400 6246 Acked Write 5 Sent Done Done false
20401 6247 Acked Write 10 Sent Done Done false
20402 6248 Acked Write 7 Sent Done Done false
20403 6249 Acked Read 1 Sent Done Done false
20404 6250 Acked Write 3 Sent Done Done false
20405 6251 Acked Write 3 Sent Done Done false
20406 6252 Acked Write 5 Sent Done Done false
20407 6253 Acked Read 6 Sent Done Done false
20408 6254 Acked Read 3 Sent Done Done false
20409 6255 Acked Write 1 Sent Done Done false
20410 6256 Acked Read 7 Sent Done Done false
20411 6257 Acked Write 9 Sent Done Done false
20412 6258 Acked Write 4 Sent Done Done false
20413 6259 Acked Read 6 Sent Done Done false
20414 6260 Acked Read 5 Sent Done Done false
20415 6261 Acked Read 8 Sent Done Done false
20416 6262 Acked Write 2 Sent Done Done false
20417 6263 Acked Flush 0 Sent Done Done false
20418 6264 Acked Read 8 Sent Done Done false
20419 6265 Acked Write 10 Sent Done Done false
20420 6266 Acked Write 2 Sent Done Done false
20421 6267 Acked Flush 0 Sent Done Done false
20422 6268 Acked Read 1 Sent Done Done false
20423 6269 Acked Read 8 Sent Done Done false
20424 6270 Acked Read 6 Sent Done Done false
20425 6271 Acked Write 9 Sent Done Done false
20426 6272 Acked Write 3 Sent Done Done false
20427 6273 Acked Read 7 Sent Done Done false
20428 6274 Acked Write 3 Sent Done Done false
20429 6275 Acked Write 6 Sent Done Done false
20430 6276 Acked Read 8 Sent Done Done false
20431 6277 Acked Read 9 Sent Done Done false
20432 6278 Acked Flush 0 Sent Done Done false
20433 6279 Acked Flush 0 Sent Done Done false
20434 6280 Acked Flush 0 Sent Done Done false
20435 6281 Acked Read 3 Sent Done Done false
20436 6282 Acked Write 5 Sent Done Done false
20437 6283 Acked Read 2 Sent Done Done false
20438 6284 Acked Flush 0 Sent Done Done false
20439 6285 Acked Read 6 Sent Done Done false
20440 6286 Acked Flush 0 Sent Done Done false
20441 6287 Acked Write 8 Sent Done Done false
20442 6288 Acked Read 6 Sent Done Done false
20443 6289 Acked Write 8 Sent Done Done false
20444 6290 Acked Flush 0 Sent Done Done false
20445 6291 Acked Read 1 Sent Done Done false
20446 6292 Acked Flush 0 Sent Done Done false
20447 6293 Acked Write 5 Sent Done Done false
20448 6294 Acked Write 7 Sent Done Done false
20449 6295 Acked Read 4 Sent Done Done false
20450 6296 Acked Read 10 Sent Done Done false
20451 6297 Acked Read 7 Sent Done Done false
20452 6298 Acked Read 2 Sent Done Done false
20453 6299 Acked Read 4 Sent Done Done false
20454 6300 Acked Write 9 Sent Done Done false
20455 6301 Acked Read 2 Sent Done Done false
20456 6302 Acked Read 3 Sent Done Done false
20457 6303 Acked Read 5 Sent Done Done false
20458 6304 Acked Read 10 Sent Done Done false
20459 6305 Acked Read 4 Sent Done Done false
20460 6306 Acked Read 7 Sent Done Done false
20461 6307 Acked Write 6 Sent Done Done false
20462 6308 Acked Write 5 Sent Done Done false
20463 6309 Acked Read 10 Sent Done Done false
20464 6310 Acked Write 1 Sent Done Done false
20465 6311 Acked Write 5 Sent Done Done false
20466 6312 Acked Read 10 Sent Done Done false
20467 6313 Acked Read 3 Sent Done Done false
20468 6314 Acked Write 5 Sent Done Done false
20469 6315 Acked Read 10 Sent Done Done false
20470 6316 Acked Write 6 Sent Done Done false
20471 6317 Acked Read 3 Sent Done Done false
20472 6318 Acked Read 4 Sent Done Done false
20473 6319 Acked Read 5 Sent Done Done false
20474 6320 Acked Read 5 Sent Done Done false
20475 6321 Acked Read 10 Sent Done Done false
20476 6322 Acked Read 7 Sent Done Done false
20477 6323 Acked Read 7 Sent Done Done false
20478 6324 Acked Read 3 Sent Done Done false
20479 6325 Acked Flush 0 Sent Done Done false
20480 6326 Acked Write 3 Sent Done Done false
20481 6327 Acked Read 4 Sent Done Done false
20482 6328 Acked Write 8 Sent Done Done false
20483 6329 Acked Read 9 Sent Done Done false
20484 6330 Acked Write 1 Sent Done Done false
20485 6331 Acked Write 8 Sent Done Done false
20486 6332 Acked Read 1 Sent Done Done false
20487 6333 Acked Write 7 Sent Done Done false
20488 6334 Acked Read 1 Sent Done Done false
20489 6335 Acked Write 1 Sent Done Done false
20490 6336 Acked Read 3 Sent Done Done false
20491 6337 Acked Read 5 Sent Done Done false
20492 6338 Acked Read 1 Sent Done Done false
20493 6339 Acked Read 4 Sent Done Done false
20494 6340 Acked Flush 0 Sent Done Done false
20495 6341 Acked Write 3 Sent Done Done false
20496 6342 Acked Write 8 Sent Done Done false
20497 6343 Acked Write 5 Sent Done Done false
20498 6344 Acked Write 5 Sent Done Done false
20499 6345 Acked Flush 0 Sent Done Done false
20500 6346 Acked Read 7 Sent Done Done false
20501 6347 Acked Read 2 Sent Done Done false
20502 6348 Acked Read 9 Sent Done Done false
20503 6349 Acked Write 9 Sent Done Done false
20504 6350 Acked Flush 0 Sent Done Done false
20505 6351 Acked Flush 0 Sent Done Done false
20506 6352 Acked Flush 0 Sent Done Done false
20507 6353 Acked Read 5 Sent Done Done false
20508 6354 Acked Read 3 Sent Done Done false
20509 6355 Acked Write 6 Sent Done Done false
20510 6356 Acked Read 5 Sent Done Done false
20511 6357 Acked Read 6 Sent Done Done false
20512 6358 Acked Read 7 Sent Done Done false
20513 6359 Acked Read 4 Sent Done Done false
20514 6360 Acked Read 8 Sent Done Done false
20515 6361 Acked Read 5 Sent Done Done false
20516 6362 Acked Write 10 Sent Done Done false
20517 6363 Acked Flush 0 Sent Done Done false
20518 6364 Acked Write 1 Sent Done Done false
20519 6365 Acked Read 2 Sent Done Done false
20520 6366 Acked Read 3 Sent Done Done false
20521 6367 Acked Write 2 Sent Done Done false
20522 6368 Acked Read 7 Sent Done Done false
20523 6369 Acked Read 4 Sent Done Done false
20524 6370 Acked Read 6 Sent Done Done false
20525 6371 Acked Write 9 Sent Done Done false
20526 6372 Acked Flush 0 Sent Done Done false
20527 6373 Acked Write 6 Sent Done Done false
20528 6374 Acked Read 1 Sent Done Done false
20529 6375 Acked Write 5 Sent Done Done false
20530 6376 Acked Read 3 Sent Done Done false
20531 6377 Acked Read 9 Sent Done Done false
20532 6378 Acked Flush 0 Sent Done Done false
20533 6379 Acked Write 7 Sent Done Done false
20534 6380 Acked Flush 0 Sent Done Done false
20535 6381 Acked Write 3 Sent Done Done false
20536 6382 Acked Write 3 Sent Done Done false
20537 6383 Acked Write 2 Sent Done Done false
20538 6384 Acked Write 8 Sent Done Done false
20539 6385 Acked Read 4 Sent Done Done false
20540 6386 Acked Read 3 Sent Done Done false
20541 6387 Acked Read 7 Sent Done Done false
20542 6388 Acked Read 5 Sent Done Done false
20543 6389 Acked Write 2 Sent Done Done false
20544 6390 Acked Read 4 Sent Done Done false
20545 6391 Acked Read 7 Sent Done Done false
20546 6392 Acked Write 9 Sent Done Done false
20547 6393 Acked Write 2 Sent Done Done false
20548 6394 Acked Read 5 Sent Done Done false
20549 6395 Acked Write 9 Sent Done Done false
20550 6396 Acked Flush 0 Sent Done Done false
20551 6397 Acked Write 9 Sent Done Done false
20552 6398 Acked Read 3 Sent Done Done false
20553 6399 Acked Flush 0 Sent Done Done false
20554 6400 Acked Read 7 Sent Done Done false
20555 6401 Acked Read 5 Sent Done Done false
20556 6402 Acked Read 6 Sent Done Done false
20557 6403 Acked Read 7 Sent Done Done false
20558 6404 Acked Read 7 Sent Done Done false
20559 6405 Acked Read 7 Sent Done Done false
20560 6406 Acked Read 9 Sent Done Done false
20561 6407 Acked Write 10 Sent Done Done false
20562 6408 Acked Read 7 Sent Done Done false
20563 6409 Acked Read 10 Sent Done Done false
20564 6410 Acked Flush 0 Sent Done Done false
20565 6411 Acked Read 7 Sent Done Done false
20566 6412 Acked Write 1 Sent Done Done false
20567 6413 Acked Write 10 Sent Done Done false
20568 6414 Acked Flush 0 Sent Done Done false
20569 6415 Acked Read 1 Sent Done Done false
20570 6416 Acked Read 5 Sent Done Done false
20571 6417 Acked Read 3 Sent Done Done false
20572 6418 Acked Read 9 Sent Done Done false
20573 6419 Acked Read 7 Sent Done Done false
20574 6420 Acked Write 2 Sent Done Done false
20575 6421 Acked Write 10 Sent Done Done false
20576 6422 Acked Read 5 Sent Done Done false
20577 6423 Acked Read 8 Sent Done Done false
20578 6424 Acked Read 1 Sent Done Done false
20579 6425 Acked Read 2 Sent Done Done false
20580 6426 Acked Write 2 Sent Done Done false
20581 6427 Acked Write 9 Sent Done Done false
20582 6428 Acked Write 5 Sent Done Done false
20583 6429 Acked Read 10 Sent Done Done false
20584 6430 Acked Read 9 Sent Done Done false
20585 6431 Acked Write 4 Sent Done Done false
20586 6432 Acked Flush 0 Sent Done Done false
20587 STATES DS:0 DS:1 DS:2 TOTAL
20588 Sent 302 0 0 302
20589 Done 0 302 302 604
20590 Skipped 0 0 0 0
20591 Error 0 0 0 0
20592 Last Flush: 6130 6432 6432
20593 Downstairs last five completed: 6130 6129 6128 6127 6126
20594 Upstairs last five completed: 6432 6431 6430 6429 6428
20595 CLIENT: Up:0 ds:302 act:2
20596 ----------------------------------------------------------------
20597 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:302
20598 States: Offline Active Active
20599 JOBID ACK TYPE BKS/EXT DS:0 DS:1 DS:2 REPLAY
20600 6131 Acked Write 7 Sent Done Done false
20601 6132 Acked Read 9 Sent Done Done false
20602 6133 Acked Write 8 Sent Done Done false
20603 6134 Acked Write 3 Sent Done Done false
20604 6135 Acked Read 2 Sent Done Done false
20605 6136 Acked Flush 0 Sent Done Done false
20606 6137 Acked Write 4 Sent Done Done false
20607 6138 Acked Write 7 Sent Done Done false
20608 6139 Acked Read 3 Sent Done Done false
20609 6140 Acked Write 10 Sent Done Done false
20610 6141 Acked Read 4 Sent Done Done false
20611 6142 Acked Write 8 Sent Done Done false
20612 6143 Acked Write 8 Sent Done Done false
20613 6144 Acked Read 4 Sent Done Done false
20614 6145 Acked Read 4 Sent Done Done false
20615 6146 Acked Write 6 Sent Done Done false
20616 6147 Acked Flush 0 Sent Done Done false
20617 6148 Acked Write 6 Sent Done Done false
20618 6149 Acked Write 8 Sent Done Done false
20619 6150 Acked Flush 0 Sent Done Done false
20620 6151 Acked Read 3 Sent Done Done false
20621 6152 Acked Read 1 Sent Done Done false
20622 6153 Acked Read 7 Sent Done Done false
20623 6154 Acked Read 4 Sent Done Done false
20624 6155 Acked Write 6 Sent Done Done false
20625 6156 Acked Flush 0 Sent Done Done false
20626 6157 Acked Read 10 Sent Done Done false
20627 6158 Acked Read 5 Sent Done Done false
20628 6159 Acked Read 10 Sent Done Done false
20629 6160 Acked Read 6 Sent Done Done false
20630 6161 Acked Write 3 Sent Done Done false
20631 6162 Acked Write 6 Sent Done Done false
20632 6163 Acked Write 1 Sent Done Done false
20633 6164 Acked Read 4 Sent Done Done false
20634 6165 Acked Write 9 Sent Done Done false
20635 6166 Acked Read 5 Sent Done Done false
20636 6167 Acked Write 9 Sent Done Done false
20637 6168 Acked Write 7 Sent Done Done false
20638 6169 Acked Read 4 Sent Done Done false
20639 6170 Acked Write 1 Sent Done Done false
20640 6171 Acked Write 3 Sent Done Done false
20641 6172 Acked Flush 0 Sent Done Done false
20642 6173 Acked Read 9 Sent Done Done false
20643 6174 Acked Write 10 Sent Done Done false
20644 6175 Acked Write 6 Sent Done Done false
20645 6176 Acked Read 3 Sent Done Done false
20646 6177 Acked Flush 0 Sent Done Done false
20647 6178 Acked Write 2 Sent Done Done false
20648 6179 Acked Read 9 Sent Done Done false
20649 6180 Acked Read 8 Sent Done Done false
20650 6181 Acked Read 1 Sent Done Done false
20651 6182 Acked Read 8 Sent Done Done false
20652 6183 Acked Flush 0 Sent Done Done false
20653 6184 Acked Read 2 Sent Done Done false
20654 6185 Acked Read 6 Sent Done Done false
20655 6186 Acked Write 9 Sent Done Done false
20656 6187 Acked Read 8 Sent Done Done false
20657 6188 Acked Read 5 Sent Done Done false
20658 6189 Acked Write 2 Sent Done Done false
20659 6190 Acked Write 2 Sent Done Done false
20660 6191 Acked Read 1 Sent Done Done false
20661 6192 Acked Read 10 Sent Done Done false
20662 6193 Acked Read 8 Sent Done Done false
20663 6194 Acked Write 5 Sent Done Done false
20664 6195 Acked Write 8 Sent Done Done false
20665 6196 Acked Read 4 Sent Done Done false
20666 6197 Acked Write 1 Sent Done Done false
20667 6198 Acked Read 10 Sent Done Done false
20668 6199 Acked Read 2 Sent Done Done false
20669 6200 Acked Read 4 Sent Done Done false
20670 6201 Acked Read 1 Sent Done Done false
20671 6202 Acked Write 1 Sent Done Done false
20672 6203 Acked Write 7 Sent Done Done false
20673 6204 Acked Read 3 Sent Done Done false
20674 6205 Acked Write 8 Sent Done Done false
20675 6206 Acked Write 1 Sent Done Done false
20676 6207 Acked Flush 0 Sent Done Done false
20677 6208 Acked Read 7 Sent Done Done false
20678 6209 Acked Write 10 Sent Done Done false
20679 6210 Acked Read 8 Sent Done Done false
20680 6211 Acked Read 6 Sent Done Done false
20681 6212 Acked Read 7 Sent Done Done false
20682 6213 Acked Read 2 Sent Done Done false
20683 6214 Acked Write 4 Sent Done Done false
20684 6215 Acked Write 2 Sent Done Done false
20685 6216 Acked Flush 0 Sent Done Done false
20686 6217 Acked Read 4 Sent Done Done false
20687 6218 Acked Write 9 Sent Done Done false
20688 6219 Acked Write 5 Sent Done Done false
20689 6220 Acked Read 3 Sent Done Done false
20690 6221 Acked Read 5 Sent Done Done false
20691 6222 Acked Write 5 Sent Done Done false
20692 6223 Acked Write 6 Sent Done Done false
20693 6224 Acked Read 3 Sent Done Done false
20694 6225 Acked Read 10 Sent Done Done false
20695 6226 Acked Write 8 Sent Done Done false
20696 6227 Acked Write 9 Sent Done Done false
20697 6228 Acked Read 4 Sent Done Done false
20698 6229 Acked Read 1 Sent Done Done false
20699 6230 Acked Write 7 Sent Done Done false
20700 6231 Acked Write 1 Sent Done Done false
20701 6232 Acked Read 8 Sent Done Done false
20702 6233 Acked Read 7 Sent Done Done false
20703 6234 Acked Flush 0 Sent Done Done false
20704 6235 Acked Flush 0 Sent Done Done false
20705 6236 Acked Write 6 Sent Done Done false
20706 6237 Acked Write 5 Sent Done Done false
20707 6238 Acked Write 6 Sent Done Done false
20708 6239 Acked Read 10 Sent Done Done false
20709 6240 Acked Write 8 Sent Done Done false
20710 6241 Acked Write 4 Sent Done Done false
20711 6242 Acked Read 4 Sent Done Done false
20712 6243 Acked Flush 0 Sent Done Done false
20713 6244 Acked Write 9 Sent Done Done false
20714 6245 Acked Read 1 Sent Done Done false
20715 6246 Acked Write 5 Sent Done Done false
20716 6247 Acked Write 10 Sent Done Done false
20717 6248 Acked Write 7 Sent Done Done false
20718 6249 Acked Read 1 Sent Done Done false
20719 6250 Acked Write 3 Sent Done Done false
20720 6251 Acked Write 3 Sent Done Done false
20721 6252 Acked Write 5 Sent Done Done false
20722 6253 Acked Read 6 Sent Done Done false
20723 6254 Acked Read 3 Sent Done Done false
20724 6255 Acked Write 1 Sent Done Done false
20725 6256 Acked Read 7 Sent Done Done false
20726 6257 Acked Write 9 Sent Done Done false
20727 6258 Acked Write 4 Sent Done Done false
20728 6259 Acked Read 6 Sent Done Done false
20729 6260 Acked Read 5 Sent Done Done false
20730 6261 Acked Read 8 Sent Done Done false
20731 6262 Acked Write 2 Sent Done Done false
20732 6263 Acked Flush 0 Sent Done Done false
20733 6264 Acked Read 8 Sent Done Done false
20734 6265 Acked Write 10 Sent Done Done false
20735 6266 Acked Write 2 Sent Done Done false
20736 6267 Acked Flush 0 Sent Done Done false
20737 6268 Acked Read 1 Sent Done Done false
20738 6269 Acked Read 8 Sent Done Done false
20739 6270 Acked Read 6 Sent Done Done false
20740 6271 Acked Write 9 Sent Done Done false
20741 6272 Acked Write 3 Sent Done Done false
20742 6273 Acked Read 7 Sent Done Done false
20743 6274 Acked Write 3 Sent Done Done false
20744 6275 Acked Write 6 Sent Done Done false
20745 6276 Acked Read 8 Sent Done Done false
20746 6277 Acked Read 9 Sent Done Done false
20747 6278 Acked Flush 0 Sent Done Done false
20748 6279 Acked Flush 0 Sent Done Done false
20749 6280 Acked Flush 0 Sent Done Done false
20750 6281 Acked Read 3 Sent Done Done false
20751 6282 Acked Write 5 Sent Done Done false
20752 6283 Acked Read 2 Sent Done Done false
20753 6284 Acked Flush 0 Sent Done Done false
20754 6285 Acked Read 6 Sent Done Done false
20755 6286 Acked Flush 0 Sent Done Done false
20756 6287 Acked Write 8 Sent Done Done false
20757 6288 Acked Read 6 Sent Done Done false
20758 6289 Acked Write 8 Sent Done Done false
20759 6290 Acked Flush 0 Sent Done Done false
20760 6291 Acked Read 1 Sent Done Done false
20761 6292 Acked Flush 0 Sent Done Done false
20762 6293 Acked Write 5 Sent Done Done false
20763 6294 Acked Write 7 Sent Done Done false
20764 6295 Acked Read 4 Sent Done Done false
20765 6296 Acked Read 10 Sent Done Done false
20766 6297 Acked Read 7 Sent Done Done false
20767 6298 Acked Read 2 Sent Done Done false
20768 6299 Acked Read 4 Sent Done Done false
20769 6300 Acked Write 9 Sent Done Done false
20770 6301 Acked Read 2 Sent Done Done false
20771 6302 Acked Read 3 Sent Done Done false
20772 6303 Acked Read 5 Sent Done Done false
20773 6304 Acked Read 10 Sent Done Done false
20774 6305 Acked Read 4 Sent Done Done false
20775 6306 Acked Read 7 Sent Done Done false
20776 6307 Acked Write 6 Sent Done Done false
20777 6308 Acked Write 5 Sent Done Done false
20778 6309 Acked Read 10 Sent Done Done false
20779 6310 Acked Write 1 Sent Done Done false
20780 6311 Acked Write 5 Sent Done Done false
20781 6312 Acked Read 10 Sent Done Done false
20782 6313 Acked Read 3 Sent Done Done false
20783 6314 Acked Write 5 Sent Done Done false
20784 6315 Acked Read 10 Sent Done Done false
20785 6316 Acked Write 6 Sent Done Done false
20786 6317 Acked Read 3 Sent Done Done false
20787 6318 Acked Read 4 Sent Done Done false
20788 6319 Acked Read 5 Sent Done Done false
20789 6320 Acked Read 5 Sent Done Done false
20790 6321 Acked Read 10 Sent Done Done false
20791 6322 Acked Read 7 Sent Done Done false
20792 6323 Acked Read 7 Sent Done Done false
20793 6324 Acked Read 3 Sent Done Done false
20794 6325 Acked Flush 0 Sent Done Done false
20795 6326 Acked Write 3 Sent Done Done false
20796 6327 Acked Read 4 Sent Done Done false
20797 6328 Acked Write 8 Sent Done Done false
20798 6329 Acked Read 9 Sent Done Done false
20799 6330 Acked Write 1 Sent Done Done false
20800 6331 Acked Write 8 Sent Done Done false
20801 6332 Acked Read 1 Sent Done Done false
20802 6333 Acked Write 7 Sent Done Done false
20803 6334 Acked Read 1 Sent Done Done false
20804 6335 Acked Write 1 Sent Done Done false
20805 6336 Acked Read 3 Sent Done Done false
20806 6337 Acked Read 5 Sent Done Done false
20807 6338 Acked Read 1 Sent Done Done false
20808 6339 Acked Read 4 Sent Done Done false
20809 6340 Acked Flush 0 Sent Done Done false
20810 6341 Acked Write 3 Sent Done Done false
20811 6342 Acked Write 8 Sent Done Done false
20812 6343 Acked Write 5 Sent Done Done false
20813 6344 Acked Write 5 Sent Done Done false
20814 6345 Acked Flush 0 Sent Done Done false
20815 6346 Acked Read 7 Sent Done Done false
20816 6347 Acked Read 2 Sent Done Done false
20817 6348 Acked Read 9 Sent Done Done false
20818 6349 Acked Write 9 Sent Done Done false
20819 6350 Acked Flush 0 Sent Done Done false
20820 6351 Acked Flush 0 Sent Done Done false
20821 6352 Acked Flush 0 Sent Done Done false
20822 6353 Acked Read 5 Sent Done Done false
20823 6354 Acked Read 3 Sent Done Done false
20824 6355 Acked Write 6 Sent Done Done false
20825 6356 Acked Read 5 Sent Done Done false
20826 6357 Acked Read 6 Sent Done Done false
20827 6358 Acked Read 7 Sent Done Done false
20828 6359 Acked Read 4 Sent Done Done false
20829 6360 Acked Read 8 Sent Done Done false
20830 6361 Acked Read 5 Sent Done Done false
20831 6362 Acked Write 10 Sent Done Done false
20832 6363 Acked Flush 0 Sent Done Done false
20833 6364 Acked Write 1 Sent Done Done false
20834 6365 Acked Read 2 Sent Done Done false
20835 6366 Acked Read 3 Sent Done Done false
20836 6367 Acked Write 2 Sent Done Done false
20837 6368 Acked Read 7 Sent Done Done false
20838 6369 Acked Read 4 Sent Done Done false
20839 6370 Acked Read 6 Sent Done Done false
20840 6371 Acked Write 9 Sent Done Done false
20841 6372 Acked Flush 0 Sent Done Done false
20842 6373 Acked Write 6 Sent Done Done false
20843 6374 Acked Read 1 Sent Done Done false
20844 6375 Acked Write 5 Sent Done Done false
20845 6376 Acked Read 3 Sent Done Done false
20846 6377 Acked Read 9 Sent Done Done false
20847 6378 Acked Flush 0 Sent Done Done false
20848 6379 Acked Write 7 Sent Done Done false
20849 6380 Acked Flush 0 Sent Done Done false
20850 6381 Acked Write 3 Sent Done Done false
20851 6382 Acked Write 3 Sent Done Done false
20852 6383 Acked Write 2 Sent Done Done false
20853 6384 Acked Write 8 Sent Done Done false
20854 6385 Acked Read 4 Sent Done Done false
20855 6386 Acked Read 3 Sent Done Done false
20856 6387 Acked Read 7 Sent Done Done false
20857 6388 Acked Read 5 Sent Done Done false
20858 6389 Acked Write 2 Sent Done Done false
20859 6390 Acked Read 4 Sent Done Done false
20860 6391 Acked Read 7 Sent Done Done false
20861 6392 Acked Write 9 Sent Done Done false
20862 6393 Acked Write 2 Sent Done Done false
20863 6394 Acked Read 5 Sent Done Done false
20864 6395 Acked Write 9 Sent Done Done false
20865 6396 Acked Flush 0 Sent Done Done false
20866 6397 Acked Write 9 Sent Done Done false
20867 6398 Acked Read 3 Sent Done Done false
20868 6399 Acked Flush 0 Sent Done Done false
20869 6400 Acked Read 7 Sent Done Done false
20870 6401 Acked Read 5 Sent Done Done false
20871 6402 Acked Read 6 Sent Done Done false
20872 6403 Acked Read 7 Sent Done Done false
20873 6404 Acked Read 7 Sent Done Done false
20874 6405 Acked Read 7 Sent Done Done false
20875 6406 Acked Read 9 Sent Done Done false
20876 6407 Acked Write 10 Sent Done Done false
20877 6408 Acked Read 7 Sent Done Done false
20878 6409 Acked Read 10 Sent Done Done false
20879 6410 Acked Flush 0 Sent Done Done false
20880 6411 Acked Read 7 Sent Done Done false
20881 6412 Acked Write 1 Sent Done Done false
20882 6413 Acked Write 10 Sent Done Done false
20883 6414 Acked Flush 0 Sent Done Done false
20884 6415 Acked Read 1 Sent Done Done false
20885 6416 Acked Read 5 Sent Done Done false
20886 6417 Acked Read 3 Sent Done Done false
20887 6418 Acked Read 9 Sent Done Done false
20888 6419 Acked Read 7 Sent Done Done false
20889 6420 Acked Write 2 Sent Done Done false
20890 6421 Acked Write 10 Sent Done Done false
20891 6422 Acked Read 5 Sent Done Done false
20892 6423 Acked Read 8 Sent Done Done false
20893 6424 Acked Read 1 Sent Done Done false
20894 6425 Acked Read 2 Sent Done Done false
20895 6426 Acked Write 2 Sent Done Done false
20896 6427 Acked Write 9 Sent Done Done false
20897 6428 Acked Write 5 Sent Done Done false
20898 6429 Acked Read 10 Sent Done Done false
20899 6430 Acked Read 9 Sent Done Done false
20900 6431 Acked Write 4 Sent Done Done false
20901 6432 Acked Flush 0 Sent Done Done false
20902 STATES DS:0 DS:1 DS:2 TOTAL
20903 Sent 302 0 0 302
20904 Done 0 302 302 604
20905 Skipped 0 0 0 0
20906 Error 0 0 0 0
20907 Last Flush: 6130 6432 6432
20908 Downstairs last five completed: 6130 6129 6128 6127 6126
20909 Upstairs last five completed: 6432 6431 6430 6429 6428
20910 CLIENT: Up:0 ds:302 act:2
209112025-01-10T16:39:43.909ZINFOcrucible: connecting to 127.0.0.1:8810 = io task client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
209122025-01-10T16:39:43.910ZINFOcrucible: ds_connection connected from Ok(127.0.0.1:42040) = io task client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
209132025-01-10T16:39:43.911ZWARNcrucible: version negotiation from state Offline = downstairs client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
209142025-01-10T16:39:43.911ZINFOcrucible: downstairs client at Some(127.0.0.1:8810) has region UUID 12345678-0000-0000-0000-000000008810 = downstairs client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
209152025-01-10T16:39:43.911ZINFOcrucible: Returning UUID:12345678-0000-0000-0000-000000008810 matches = downstairs client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
209162025-01-10T16:39:43.911ZINFOcrucible: send last flush ID to this DS: 6130 = downstairs client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
209172025-01-10T16:39:43.911ZINFOcrucible: Replied this last flush ID: 6130 = downstairs client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
209182025-01-10T16:39:43.911ZINFOcrucible: ds_transition from Offline to Active = downstairs client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
209192025-01-10T16:39:43.911ZINFOcrucible: [0] Transition from Offline to Active = downstairs client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
209202025-01-10T16:39:43.912ZINFOcrucible: [0] client re-new 302 jobs since flush 6130 = downstairs session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
209212025-01-10T16:39:43.912ZINFOcrucible: [0] Replayed 302 jobs since flush: 6130 = downstairs session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
20922 ----------------------------------------------------------------
20923 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:0
20924 Downstairs last five completed: 6432 6431 6430 6429 6428
20925 Upstairs last five completed: 6432 6431 6430 6429 6428
20926 CLIENT: Up:0 ds:0 act:3
20927 Replay: All jobs finished
20928 Main task has work to do, go find it
20929 got dsc Stop(1)
20930 stop 1
20931 Jan 10 16:39:44.159 [8820] Got stop action so:false kr:false
20932 INFO request completed, latency_us: 603, response_code: 204, uri: /stop/cid/1, method: POST, req_id: c4ff1b94-5f78-46e5-8f59-42167ffb057c, remote_addr: 127.0.0.1:55917, local_addr: 127.0.0.1:9998
20933 Jan 10 16:39:44.160 INFO request completed, latency_us: 171, response_code: 200, uri: /state/cid/1, method: GET, req_id: 7aa2bef9-216a-4bef-a4fd-d79662dd4f2c, remote_addr: 127.0.0.1:55917, local_addr: 127.0.0.1:9998
209342025-01-10T16:39:44.160ZWARNcrucible: downstairs disconnected = io task client = 1 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
209352025-01-10T16:39:44.160ZWARNcrucible: client task is sending Done(Finished) = io task client = 1 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
209362025-01-10T16:39:44.160ZWARNcrucible: downstairs task for 1 stopped due to Finished session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
209372025-01-10T16:39:44.160ZINFOcrucible: ds_transition from Active to Offline = downstairs client = 1 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
209382025-01-10T16:39:44.160ZINFOcrucible: [1] Transition from Active to Offline = downstairs client = 1 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
209392025-01-10T16:39:44.160ZINFOcrucible: client task is exiting = io task client = 1 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
20940 [8820] Exited with: ExitStatus(unix_wait_status(9))
20941 [8820][1] reports Exit
20942 Jan 10 16:39:48.162 INFO request completed, latency_us: 207, response_code: 200, uri: /state/cid/1, method: GET, req_id: 17cfc8fe-67e4-4e18-8d26-e5da6da0c51c, remote_addr: 127.0.0.1:55917, local_addr: 127.0.0.1:9998
20943 001/300 Read block 2988 len 28672
20944 002/300 Read block 377 len 24576
20945 003/300 Write block 4359 len 16384 data: 4 5 6 6
20946 004/300 Write block 1928 len 12288 data: 5 5 6
20947 005/300 Read block 370 len 8192
20948 006/300 Read block 3547 len 32768
20949 007/300 Read block 4545 len 20480
20950 008/300 Write block 4367 len 16384 data: 4 4 5 5
20951 009/300 Read block 1974 len 32768
20952 010/300 Write block 3533 len 20480 data: 2 3 3 4 3
20953 011/300 Read block 1061 len 20480
20954 012/300 Write block 2748 len 4096 data: 3
20955 013/300 Flush
20956 014/300 Read block 3804 len 20480
20957 015/300 Read block 3924 len 32768
20958 016/300 Write block 319 len 32768 data: 5 4 4 4 4 4 5 4
20959 017/300 Write block 3582 len 40960 data: 2 2 2 2 3 3 5 5 4 4
20960 018/300 Read block 2770 len 40960
20961 019/300 Write block 196 len 28672 data: 6 6 6 6 6 6 7
20962 020/300 Read block 1684 len 8192
20963 021/300 Flush
20964 022/300 Flush
20965 023/300 Read block 607 len 36864
20966 024/300 Write block 358 len 20480 data: 2 2 2 2 3
20967 025/300 Write block 2219 len 28672 data: 3 3 3 3 3 3 4
20968 026/300 Read block 3520 len 16384
20969 027/300 Write block 3943 len 24576 data: 8 7 8 8 7 7
20970 028/300 Read block 730 len 28672
20971 029/300 Read block 3740 len 36864
20972 030/300 Read block 1131 len 12288
20973 031/300 Read block 4531 len 36864
20974 032/300 Read block 62 len 20480
20975 033/300 Flush
20976 034/300 Write block 2727 len 20480 data: 5 6 6 5 6
20977 035/300 Read block 3147 len 16384
20978 036/300 Read block 1591 len 32768
20979 037/300 Read block 4528 len 8192
20980 038/300 Read block 1754 len 16384
20981 039/300 Read block 4948 len 32768
20982 040/300 Write block 3640 len 16384 data: 3 4 4 5
20983 041/300 Write block 3859 len 28672 data: 3 3 4 5 5 5 7
20984 042/300 Write block 604 len 32768 data: 7 8 9 6 6 3 4 5
20985 043/300 Read block 3709 len 12288
20986 044/300 Read block 2890 len 8192
20987 045/300 Read block 4097 len 16384
20988 046/300 Write block 2967 len 16384 data: 2 2 4 4
20989 047/300 Write block 896 len 8192 data: 4 4
20990 048/300 Flush
20991 049/300 Flush
20992 050/300 Read block 2278 len 24576
20993 051/300 Read block 4825 len 40960
20994 052/300 Write block 4590 len 32768 data: 2 2 2 2 2 2 2 2
20995 053/300 Read block 839 len 36864
20996 054/300 Write block 227 len 16384 data: 3 3 4 4
20997 055/300 Write block 2858 len 28672 data: 4 3 3 4 6 6 6
20998 056/300 Flush
20999 057/300 Write block 3192 len 36864 data: 5 5 5 5 7 7 7 4 5
21000 058/300 Read block 644 len 12288
21001 059/300 Read block 4114 len 24576
21002 060/300 Write block 3208 len 4096 data: 3
21003 061/300 Read block 4156 len 36864
21004 062/300 Write block 1695 len 16384 data: 5 5 4 5
21005 063/300 Read block 1555 len 32768
21006 064/300 Read block 3468 len 28672
21007 065/300 Read block 768 len 20480
21008 066/300 Read block 2027 len 40960
21009 067/300 Write block 2925 len 28672 data: 5 4 3 3 3 3 3
21010 068/300 Read block 846 len 32768
21011 069/300 Write block 231 len 36864 data: 5 4 4 4 4 5 5 5 4
21012 070/300 Read block 1412 len 40960
21013 071/300 Flush
21014 072/300 Read block 1637 len 4096
21015 073/300 Write block 4035 len 16384 data: 2 2 2 2
21016 074/300 Write block 4803 len 28672 data: 6 7 7 6 8 8 7
21017 075/300 Read block 572 len 24576
21018 076/300 Read block 4871 len 40960
21019 077/300 Read block 3931 len 36864
21020 078/300 Read block 4671 len 36864
21021 079/300 Write block 2503 len 36864 data: 3 4 4 5 6 6 7 7 7
21022 080/300 Read block 2264 len 16384
21023 081/300 Write block 563 len 32768 data: 5 5 5 5 4 2 2 2
21024 082/300 Flush
21025 083/300 Flush
21026 084/300 Write block 3966 len 4096 data: 3
21027 085/300 Write block 2634 len 28672 data: 5 6 7 6 6 7 7
21028 086/300 Write block 4867 len 32768 data: 3 2 3 3 3 4 4 4
21029 087/300 Write block 4846 len 16384 data: 4 3 2 3
21030 088/300 Write block 3252 len 36864 data: 3 4 4 4 4 3 3 3 3
21031 089/300 Flush
21032 090/300 Write block 3168 len 12288 data: 6 6 7
21033 091/300 Read block 160 len 16384
21034 092/300 Flush
21035 093/300 Write block 1944 len 8192 data: 3 2
21036 094/300 Read block 361 len 16384
21037 095/300 Read block 749 len 12288
21038 096/300 Write block 3851 len 40960 data: 3 3 5 6 8 5 4 3 4 4
21039 097/300 Write block 3589 len 16384 data: 6 5 5 4
21040 098/300 Read block 4256 len 36864
21041 099/300 Write block 532 len 20480 data: 6 6 6 7 5
21042 100/300 Read block 3082 len 36864
21043 101/300 Write block 4569 len 40960 data: 5 8 8 6 3 4 5 7 7 6
21044 102/300 Write block 661 len 4096 data: 2
21045 103/300 Read block 1979 len 16384
21046 104/300 Read block 1758 len 12288
21047 105/300 Write block 2402 len 36864 data: 4 3 3 3 3 4 4 4 5
21048 106/300 Read block 582 len 40960
21049 107/300 Write block 2736 len 12288 data: 4 4 3
21050 108/300 Write block 4835 len 16384 data: 3 4 4 4
21051 109/300 Read block 1291 len 40960
21052 110/300 Read block 65 len 24576
21053 111/300 Write block 50 len 20480 data: 3 3 3 3 3
21054 112/300 Write block 3875 len 40960 data: 4 4 5 5 5 5 5 4 4 3
21055 113/300 Write block 1755 len 4096 data: 6
21056 114/300 Read block 4956 len 4096
21057 115/300 Read block 813 len 12288
21058 116/300 Read block 64 len 20480
21059 117/300 Read block 4590 len 4096
21060 118/300 Read block 252 len 8192
21061 119/300 Read block 1997 len 32768
21062 120/300 Flush
21063 121/300 Read block 1671 len 4096
21064 122/300 Read block 3620 len 36864
21065 123/300 Write block 229 len 28672 data: 5 5 6 5 5 5 5
21066 124/300 Write block 1403 len 40960 data: 3 4 3 3 3 4 4 4 5 5
21067 125/300 Read block 3464 len 12288
21068 126/300 Write block 1943 len 20480 data: 4 4 3 4 4
21069 127/300 Read block 1698 len 36864
21070 128/300 Write block 4561 len 20480 data: 5 4 3 4 6
21071 129/300 Read block 2475 len 8192
21072 130/300 Read block 3143 len 12288
21073 131/300 Write block 2375 len 40960 data: 4 5 5 5 5 3 4 5 5 4
21074 132/300 Read block 3301 len 28672
21075 133/300 Write block 3509 len 36864 data: 2 3 4 5 5 4 3 3 3
21076 134/300 Write block 3943 len 36864 data: 9 8 9 9 8 8 5 4 3
21077 135/300 Flush
21078 136/300 Read block 734 len 12288
21079 137/300 Write block 3017 len 4096 data: 7
21080 138/300 Write block 4190 len 40960 data: 5 7 7 5 7 7 7 6 6 6
21081 139/300 Read block 1189 len 40960
21082 140/300 Write block 1933 len 8192 data: 5 4
21083 141/300 Write block 54 len 16384 data: 4 3 3 3
21084 142/300 Read block 4036 len 40960
21085 143/300 Read block 4141 len 40960
21086 144/300 Read block 4261 len 32768
21087 145/300 Write block 816 len 36864 data: 3 3 3 4 5 4 5 5 5
21088 146/300 Write block 4704 len 36864 data: 4 4 4 3 4 4 4 4 4
21089 147/300 Write block 2655 len 36864 data: 4 4 4 3 3 2 2 2 2
21090 148/300 Read block 947 len 28672
21091 149/300 Read block 1857 len 28672
21092 150/300 Read block 4835 len 40960
21093 151/300 Read block 624 len 20480
21094 152/300 Read block 727 len 4096
21095 153/300 Read block 883 len 28672
21096 154/300 Write block 1390 len 20480 data: 8 9 7 7 6
21097 155/300 Read block 1904 len 24576
21098 156/300 Write block 1771 len 28672 data: 2 2 3 3 3 4 5
21099 157/300 Write block 2555 len 28672 data: 6 5 5 5 5 4 4
21100 158/300 Read block 3557 len 20480
21101 159/300 Flush
21102 160/300 Write block 3674 len 8192 data: 7 7
21103 161/300 Flush
21104 162/300 Read block 4179 len 36864
21105 163/300 Write block 3099 len 32768 data: 4 4 4 3 3 3 3 4
21106 164/300 Read block 3051 len 12288
21107 165/300 Read block 960 len 40960
21108 166/300 Write block 917 len 20480 data: 7 7 6 5 4
21109 167/300 Write block 607 len 4096 data: 7
21110 168/300 Read block 1911 len 32768
21111 169/300 Write block 1710 len 20480 data: 4 4 3 4 3
21112 170/300 Write block 49 len 16384 data: 4 4 4 4
21113 171/300 Read block 4921 len 8192
21114 172/300 Write block 908 len 8192 data: 2 5
21115 173/300 Write block 1484 len 24576 data: 6 7 6 3 4 4
21116 174/300 Write block 1436 len 24576 data: 2 2 2 3 3 4
21117 175/300 Read block 3379 len 36864
21118 176/300 Read block 4419 len 16384
21119 177/300 Read block 434 len 40960
21120 178/300 Read block 4635 len 24576
21121 179/300 Write block 4141 len 40960 data: 3 3 5 5 4 4 5 8 8 8
21122 180/300 Read block 1949 len 32768
21123 181/300 Write block 2326 len 32768 data: 3 3 3 3 4 5 5 6
21124 182/300 Read block 3231 len 28672
21125 183/300 Read block 4945 len 8192
21126 184/300 Read block 2293 len 24576
21127 185/300 Flush
21128 186/300 Read block 742 len 32768
21129 187/300 Write block 3671 len 4096 data: 7
21130 188/300 Read block 4535 len 12288
21131 189/300 Write block 194 len 4096 data: 5
21132 190/300 Read block 443 len 8192
21133 191/300 Write block 4498 len 28672 data: 2 2 4 5 5 5 5
21134 192/300 Write block 3136 len 28672 data: 5 5 5 4 5 4 5
21135 193/300 Write block 4900 len 20480 data: 2 3 4 5 5
21136 194/300 Flush
21137 195/300 Write block 2912 len 36864 data: 3 3 3 4 4 4 3 4 4
21138 196/300 Read block 4370 len 8192
21139 197/300 Flush
21140 198/300 Write block 4459 len 20480 data: 4 3 4 2 3
21141 199/300 Read block 662 len 4096
21142 200/300 Write block 4026 len 40960 data: 7 7 7 6 6 5 4 3 2 3
21143 201/300 Write block 184 len 32768 data: 6 6 7 5 5 4 4 2
21144 202/300 Write block 4114 len 16384 data: 4 4 5 5
21145 203/300 Read block 3189 len 12288
21146 204/300 Write block 4250 len 28672 data: 5 5 4 4 3 3 3
21147 205/300 Read block 4301 len 12288
21148 206/300 Write block 3400 len 28672 data: 7 6 4 5 5 4 4
21149 207/300 Read block 4975 len 16384
21150 208/300 Write block 2818 len 36864 data: 2 2 2 2 2 2 2 2 3
21151 209/300 Write block 104 len 32768 data: 4 4 4 4 3 3 3 3
21152 210/300 Read block 881 len 24576
21153 211/300 Read block 3841 len 32768
21154 212/300 Read block 643 len 40960
21155 213/300 Flush
21156 214/300 Read block 1639 len 36864
21157 215/300 Write block 1423 len 4096 data: 2
21158 216/300 Read block 1625 len 20480
21159 217/300 Write block 1120 len 4096 data: 3
21160 218/300 Read block 1936 len 16384
21161 219/300 Flush
21162 220/300 Read block 509 len 32768
21163 221/300 Flush
21164 222/300 Write block 4581 len 12288 data: 5 4 5
21165 223/300 Write block 332 len 24576 data: 4 4 5 7 8 5
21166 224/300 Write block 424 len 36864 data: 3 3 3 2 2 3 4 4 4
21167 225/300 Write block 896 len 4096 data: 5
21168 226/300 Read block 145 len 16384
21169 227/300 Read block 3853 len 12288
21170 228/300 Write block 4377 len 8192 data: 8 8
21171 229/300 Write block 625 len 8192 data: 4 5
21172 230/300 Write block 997 len 32768 data: 3 2 2 2 3 3 3 3
21173 231/300 Read block 4846 len 32768
21174 232/300 Flush
21175 233/300 Read block 4639 len 8192
21176 234/300 Write block 4837 len 24576 data: 5 5 5 4 5 5
21177 235/300 Read block 3978 len 28672
21178 236/300 Write block 1349 len 8192 data: 4 5
21179 237/300 Read block 2895 len 8192
21180 238/300 Write block 456 len 20480 data: 3 3 3 3 3
21181 239/300 Write block 511 len 40960 data: 6 5 5 3 3 3 4 4 5 6
21182 240/300 Flush
21183 241/300 Flush
21184 242/300 Write block 1948 len 12288 data: 4 5 5
21185 243/300 Write block 3209 len 24576 data: 3 4 4 5 8 8
21186 244/300 Read block 3179 len 36864
21187 245/300 Read block 3586 len 20480
21188 246/300 Write block 3758 len 24576 data: 6 6 4 4 5 4
21189 247/300 Read block 274 len 12288
21190 248/300 Write block 2286 len 16384 data: 5 4 6 6
21191 249/300 Write block 2303 len 4096 data: 3
21192 250/300 Read block 91 len 28672
21193 251/300 Read block 4253 len 16384
21194 252/300 Read block 4087 len 12288
21195 253/300 Write block 4880 len 28672 data: 5 5 4 3 4 5 4
21196 254/300 Read block 3134 len 40960
21197 255/300 Read block 2378 len 32768
21198 256/300 Read block 1488 len 4096
21199 257/300 Read block 494 len 24576
21200 258/300 Read block 4128 len 40960
21201 259/300 Read block 235 len 16384
21202 260/300 Read block 1784 len 32768
21203 261/300 Write block 3328 len 8192 data: 3 4
21204 262/300 Write block 2956 len 16384 data: 6 5 4 4
21205 263/300 Read block 4501 len 32768
21206 264/300 Read block 383 len 36864
21207 265/300 Read block 2992 len 20480
21208 266/300 Write block 2782 len 40960 data: 4 4 3 5 5 5 6 4 3 2
21209 267/300 Read block 3348 len 12288
21210 268/300 Write block 1837 len 20480 data: 3 3 3 3 2
21211 269/300 Write block 2585 len 12288 data: 7 6 7
21212 270/300 Read block 2777 len 24576
21213 271/300 Write block 281 len 12288 data: 2 3 4
21214 272/300 Flush
21215 273/300 Read block 788 len 40960
21216 274/300 Read block 2100 len 36864
21217 275/300 Write block 4486 len 20480 data: 5 7 8 8 8
21218 276/300 Read block 2180 len 40960
21219 277/300 Read block 1731 len 28672
21220 278/300 Read block 2672 len 28672
21221 279/300 Read block 962 len 16384
21222 280/300 Read block 3059 len 40960
21223 281/300 Write block 89 len 16384 data: 5 5 5 5
21224 282/300 Write block 4723 len 28672 data: 4 2 2 3 3 3 3
21225 283/300 Read block 2666 len 32768
21226 284/300 Write block 2525 len 16384 data: 3 3 3 4
21227 285/300 Read block 3441 len 24576
21228 286/300 Write block 2977 len 32768 data: 4 5 6 6 5 4 3 5
21229 287/300 Write block 1033 len 32768 data: 7 8 6 4 5 3 4 3
21230 288/300 Read block 4347 len 16384
21231 289/300 Write block 1753 len 36864 data: 6 6 7 5 4 3 5 5 6
21232 290/300 Write block 3932 len 36864 data: 3 3 3 3 3 4 4 4 4
21233 291/300 Read block 3255 len 36864
21234 292/300 Read block 1173 len 28672
21235 293/300 Read block 3115 len 20480
21236 294/300 Write block 2530 len 4096 data: 2
21237 295/300 Write block 1346 len 8192 data: 5 5
21238 296/300 Flush
21239 297/300 Read block 3182 len 8192
21240 298/300 Read block 4833 len 8192
21241 299/300 Write block 1720 len 24576 data: 4 4 4 5 5 4
21242 300/300 Read block 3319 len 32768
21243 301/300 Read block 7 len 24576
21244 Main task has work to do, go find it
21245 got dsc Start(1)
21246 start 1
21247 Jan 10 16:39:48.410 INFO request completed, latency_us: 222, response_code: 204, uri: /start/cid/1, method: POST, req_id: a90852fe-7708-4903-a3b4-249527523f31, remote_addr: 127.0.0.1:55917, local_addr: 127.0.0.1:9998
21248 Replay: started 1, returned:Ok(())
21249 ----------------------------------------------------------------
21250 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:301
21251 States: Active Offline Active
21252 JOBID ACK TYPE BKS/EXT DS:0 DS:1 DS:2 REPLAY
21253 6433 Acked Read 7 Done Sent Done false
21254 6434 Acked Read 6 Done Sent Done false
21255 6435 Acked Write 4 Done Sent Done false
21256 6436 Acked Write 3 Done Sent Done false
21257 6437 Acked Read 2 Done Sent Done false
21258 6438 Acked Read 8 Done Sent Done false
21259 6439 Acked Read 5 Done Sent Done false
21260 6440 Acked Write 4 Done Sent Done false
21261 6441 Acked Read 8 Done Sent Done false
21262 6442 Acked Write 5 Done Sent Done false
21263 6443 Acked Read 5 Done Sent Done false
21264 6444 Acked Write 1 Done Sent Done false
21265 6445 Acked Flush 0 Done Sent Done false
21266 6446 Acked Read 5 Done Sent Done false
21267 6447 Acked Read 8 Done Sent Done false
21268 6448 Acked Write 8 Done Sent Done false
21269 6449 Acked Write 10 Done Sent Done false
21270 6450 Acked Read 10 Done Sent Done false
21271 6451 Acked Write 7 Done Sent Done false
21272 6452 Acked Read 2 Done Sent Done false
21273 6453 Acked Flush 0 Done Sent Done false
21274 6454 Acked Flush 0 Done Sent Done false
21275 6455 Acked Read 9 Done Sent Done false
21276 6456 Acked Write 5 Done Sent Done false
21277 6457 Acked Write 7 Done Sent Done false
21278 6458 Acked Read 4 Done Sent Done false
21279 6459 Acked Write 6 Done Sent Done false
21280 6460 Acked Read 7 Done Sent Done false
21281 6461 Acked Read 9 Done Sent Done false
21282 6462 Acked Read 3 Done Sent Done false
21283 6463 Acked Read 9 Done Sent Done false
21284 6464 Acked Read 5 Done Sent Done false
21285 6465 Acked Flush 0 Done Sent Done false
21286 6466 Acked Write 5 Done Sent Done false
21287 6467 Acked Read 4 Done Sent Done false
21288 6468 Acked Read 8 Done Sent Done false
21289 6469 Acked Read 2 Done Sent Done false
21290 6470 Acked Read 4 Done Sent Done false
21291 6471 Acked Read 8 Done Sent Done false
21292 6472 Acked Write 4 Done Sent Done false
21293 6473 Acked Write 7 Done Sent Done false
21294 6474 Acked Write 8 Done Sent Done false
21295 6475 Acked Read 3 Done Sent Done false
21296 6476 Acked Read 2 Done Sent Done false
21297 6477 Acked Read 4 Done Sent Done false
21298 6478 Acked Write 4 Done Sent Done false
21299 6479 Acked Write 2 Done Sent Done false
21300 6480 Acked Flush 0 Done Sent Done false
21301 6481 Acked Flush 0 Done Sent Done false
21302 6482 Acked Read 6 Done Sent Done false
21303 6483 Acked Read 10 Done Sent Done false
21304 6484 Acked Write 8 Done Sent Done false
21305 6485 Acked Read 9 Done Sent Done false
21306 6486 Acked Write 4 Done Sent Done false
21307 6487 Acked Write 7 Done Sent Done false
21308 6488 Acked Flush 0 Done Sent Done false
21309 6489 Acked Write 9 Done Sent Done false
21310 6490 Acked Read 3 Done Sent Done false
21311 6491 Acked Read 6 Done Sent Done false
21312 6492 Acked Write 1 Done Sent Done false
21313 6493 Acked Read 9 Done Sent Done false
21314 6494 Acked Write 4 Done Sent Done false
21315 6495 Acked Read 8 Done Sent Done false
21316 6496 Acked Read 7 Done Sent Done false
21317 6497 Acked Read 5 Done Sent Done false
21318 6498 Acked Read 10 Done Sent Done false
21319 6499 Acked Write 7 Done Sent Done false
21320 6500 Acked Read 8 Done Sent Done false
21321 6501 Acked Write 9 Done Sent Done false
21322 6502 Acked Read 10 Done Sent Done false
21323 6503 Acked Flush 0 Done Sent Done false
21324 6504 Acked Read 1 Done Sent Done false
21325 6505 Acked Write 4 Done Sent Done false
21326 6506 Acked Write 7 Done Sent Done false
21327 6507 Acked Read 6 Done Sent Done false
21328 6508 Acked Read 10 Done Sent Done false
21329 6509 Acked Read 9 Done Sent Done false
21330 6510 Acked Read 9 Done Sent Done false
21331 6511 Acked Write 9 Done Sent Done false
21332 6512 Acked Read 4 Done Sent Done false
21333 6513 Acked Write 8 Done Sent Done false
21334 6514 Acked Flush 0 Done Sent Done false
21335 6515 Acked Flush 0 Done Sent Done false
21336 6516 Acked Write 1 Done Sent Done false
21337 6517 Acked Write 7 Done Sent Done false
21338 6518 Acked Write 8 Done Sent Done false
21339 6519 Acked Write 4 Done Sent Done false
21340 6520 Acked Write 9 Done Sent Done false
21341 6521 Acked Flush 0 Done Sent Done false
21342 6522 Acked Write 3 Done Sent Done false
21343 6523 Acked Read 4 Done Sent Done false
21344 6524 Acked Flush 0 Done Sent Done false
21345 6525 Acked Write 2 Done Sent Done false
21346 6526 Acked Read 4 Done Sent Done false
21347 6527 Acked Read 3 Done Sent Done false
21348 6528 Acked Write 10 Done Sent Done false
21349 6529 Acked Write 4 Done Sent Done false
21350 6530 Acked Read 9 Done Sent Done false
21351 6531 Acked Write 5 Done Sent Done false
21352 6532 Acked Read 9 Done Sent Done false
21353 6533 Acked Write 10 Done Sent Done false
21354 6534 Acked Write 1 Done Sent Done false
21355 6535 Acked Read 4 Done Sent Done false
21356 6536 Acked Read 3 Done Sent Done false
21357 6537 Acked Write 9 Done Sent Done false
21358 6538 Acked Read 10 Done Sent Done false
21359 6539 Acked Write 3 Done Sent Done false
21360 6540 Acked Write 4 Done Sent Done false
21361 6541 Acked Read 10 Done Sent Done false
21362 6542 Acked Read 6 Done Sent Done false
21363 6543 Acked Write 5 Done Sent Done false
21364 6544 Acked Write 10 Done Sent Done false
21365 6545 Acked Write 1 Done Sent Done false
21366 6546 Acked Read 1 Done Sent Done false
21367 6547 Acked Read 3 Done Sent Done false
21368 6548 Acked Read 5 Done Sent Done false
21369 6549 Acked Read 1 Done Sent Done false
21370 6550 Acked Read 2 Done Sent Done false
21371 6551 Acked Read 8 Done Sent Done false
21372 6552 Acked Flush 0 Done Sent Done false
21373 6553 Acked Read 1 Done Sent Done false
21374 6554 Acked Read 9 Done Sent Done false
21375 6555 Acked Write 7 Done Sent Done false
21376 6556 Acked Write 10 Done Sent Done false
21377 6557 Acked Read 3 Done Sent Done false
21378 6558 Acked Write 5 Done Sent Done false
21379 6559 Acked Read 9 Done Sent Done false
21380 6560 Acked Write 5 Done Sent Done false
21381 6561 Acked Read 2 Done Sent Done false
21382 6562 Acked Read 3 Done Sent Done false
21383 6563 Acked Write 10 Done Sent Done false
21384 6564 Acked Read 7 Done Sent Done false
21385 6565 Acked Write 9 Done Sent Done false
21386 6566 Acked Write 9 Done Sent Done false
21387 6567 Acked Flush 0 Done Sent Done false
21388 6568 Acked Read 3 Done Sent Done false
21389 6569 Acked Write 1 Done Sent Done false
21390 6570 Acked Write 10 Done Sent Done false
21391 6571 Acked Read 10 Done Sent Done false
21392 6572 Acked Write 2 Done Sent Done false
21393 6573 Acked Write 4 Done Sent Done false
21394 6574 Acked Read 10 Done Sent Done false
21395 6575 Acked Read 10 Done Sent Done false
21396 6576 Acked Read 8 Done Sent Done false
21397 6577 Acked Write 9 Done Sent Done false
21398 6578 Acked Write 9 Done Sent Done false
21399 6579 Acked Write 9 Done Sent Done false
21400 6580 Acked Read 7 Done Sent Done false
21401 6581 Acked Read 7 Done Sent Done false
21402 6582 Acked Read 10 Done Sent Done false
21403 6583 Acked Read 5 Done Sent Done false
21404 6584 Acked Read 1 Done Sent Done false
21405 6585 Acked Read 7 Done Sent Done false
21406 6586 Acked Write 5 Done Sent Done false
21407 6587 Acked Read 6 Done Sent Done false
21408 6588 Acked Write 7 Done Sent Done false
21409 6589 Acked Write 7 Done Sent Done false
21410 6590 Acked Read 5 Done Sent Done false
21411 6591 Acked Flush 0 Done Sent Done false
21412 6592 Acked Write 2 Done Sent Done false
21413 6593 Acked Flush 0 Done Sent Done false
21414 6594 Acked Read 9 Done Sent Done false
21415 6595 Acked Write 8 Done Sent Done false
21416 6596 Acked Read 3 Done Sent Done false
21417 6597 Acked Read 10 Done Sent Done false
21418 6598 Acked Write 5 Done Sent Done false
21419 6599 Acked Write 1 Done Sent Done false
21420 6600 Acked Read 8 Done Sent Done false
21421 6601 Acked Write 5 Done Sent Done false
21422 6602 Acked Write 4 Done Sent Done false
21423 6603 Acked Read 2 Done Sent Done false
21424 6604 Acked Write 2 Done Sent Done false
21425 6605 Acked Write 6 Done Sent Done false
21426 6606 Acked Write 6 Done Sent Done false
21427 6607 Acked Read 9 Done Sent Done false
21428 6608 Acked Read 4 Done Sent Done false
21429 6609 Acked Read 10 Done Sent Done false
21430 6610 Acked Read 6 Done Sent Done false
21431 6611 Acked Write 10 Done Sent Done false
21432 6612 Acked Read 8 Done Sent Done false
21433 6613 Acked Write 8 Done Sent Done false
21434 6614 Acked Read 7 Done Sent Done false
21435 6615 Acked Read 2 Done Sent Done false
21436 6616 Acked Read 6 Done Sent Done false
21437 6617 Acked Flush 0 Done Sent Done false
21438 6618 Acked Read 8 Done Sent Done false
21439 6619 Acked Write 1 Done Sent Done false
21440 6620 Acked Read 3 Done Sent Done false
21441 6621 Acked Write 1 Done Sent Done false
21442 6622 Acked Read 2 Done Sent Done false
21443 6623 Acked Write 7 Done Sent Done false
21444 6624 Acked Write 7 Done Sent Done false
21445 6625 Acked Write 5 Done Sent Done false
21446 6626 Acked Flush 0 Done Sent Done false
21447 6627 Acked Write 9 Done Sent Done false
21448 6628 Acked Read 2 Done Sent Done false
21449 6629 Acked Flush 0 Done Sent Done false
21450 6630 Acked Write 5 Done Sent Done false
21451 6631 Acked Read 1 Done Sent Done false
21452 6632 Acked Write 10 Done Sent Done false
21453 6633 Acked Write 8 Done Sent Done false
21454 6634 Acked Write 4 Done Sent Done false
21455 6635 Acked Read 3 Done Sent Done false
21456 6636 Acked Write 7 Done Sent Done false
21457 6637 Acked Read 3 Done Sent Done false
21458 6638 Acked Write 7 Done Sent Done false
21459 6639 Acked Read 4 Done Sent Done false
21460 6640 Acked Write 9 Done Sent Done false
21461 6641 Acked Write 8 Done Sent Done false
21462 6642 Acked Read 6 Done Sent Done false
21463 6643 Acked Read 8 Done Sent Done false
21464 6644 Acked Read 10 Done Sent Done false
21465 6645 Acked Flush 0 Done Sent Done false
21466 6646 Acked Read 9 Done Sent Done false
21467 6647 Acked Write 1 Done Sent Done false
21468 6648 Acked Read 5 Done Sent Done false
21469 6649 Acked Write 1 Done Sent Done false
21470 6650 Acked Read 4 Done Sent Done false
21471 6651 Acked Flush 0 Done Sent Done false
21472 6652 Acked Read 8 Done Sent Done false
21473 6653 Acked Flush 0 Done Sent Done false
21474 6654 Acked Write 3 Done Sent Done false
21475 6655 Acked Write 6 Done Sent Done false
21476 6656 Acked Write 9 Done Sent Done false
21477 6657 Acked Write 1 Done Sent Done false
21478 6658 Acked Read 4 Done Sent Done false
21479 6659 Acked Read 3 Done Sent Done false
21480 6660 Acked Write 2 Done Sent Done false
21481 6661 Acked Write 2 Done Sent Done false
21482 6662 Acked Write 8 Done Sent Done false
21483 6663 Acked Read 8 Done Sent Done false
21484 6664 Acked Flush 0 Done Sent Done false
21485 6665 Acked Read 2 Done Sent Done false
21486 6666 Acked Write 6 Done Sent Done false
21487 6667 Acked Read 7 Done Sent Done false
21488 6668 Acked Write 2 Done Sent Done false
21489 6669 Acked Read 2 Done Sent Done false
21490 6670 Acked Write 5 Done Sent Done false
21491 6671 Acked Write 10 Done Sent Done false
21492 6672 Acked Flush 0 Done Sent Done false
21493 6673 Acked Flush 0 Done Sent Done false
21494 6674 Acked Write 3 Done Sent Done false
21495 6675 Acked Write 6 Done Sent Done false
21496 6676 Acked Read 9 Done Sent Done false
21497 6677 Acked Read 5 Done Sent Done false
21498 6678 Acked Write 6 Done Sent Done false
21499 6679 Acked Read 3 Done Sent Done false
21500 6680 Acked Write 4 Done Sent Done false
21501 6681 Acked Write 1 Done Sent Done false
21502 6682 Acked Read 7 Done Sent Done false
21503 6683 Acked Read 4 Done Sent Done false
21504 6684 Acked Read 3 Done Sent Done false
21505 6685 Acked Write 7 Done Sent Done false
21506 6686 Acked Read 10 Done Sent Done false
21507 6687 Acked Read 8 Done Sent Done false
21508 6688 Acked Read 1 Done Sent Done false
21509 6689 Acked Read 6 Done Sent Done false
21510 6690 Acked Read 10 Done Sent Done false
21511 6691 Acked Read 4 Done Sent Done false
21512 6692 Acked Read 8 Done Sent Done false
21513 6693 Acked Write 2 Done Sent Done false
21514 6694 Acked Write 4 Done Sent Done false
21515 6695 Acked Read 8 Done Sent Done false
21516 6696 Acked Read 9 Done Sent Done false
21517 6697 Acked Read 5 Done Sent Done false
21518 6698 Acked Write 10 Done Sent Done false
21519 6699 Acked Read 3 Done Sent Done false
21520 6700 Acked Write 5 Done Sent Done false
21521 6701 Acked Write 3 Done Sent Done false
21522 6702 Acked Read 6 Done Sent Done false
21523 6703 Acked Write 3 Done Sent Done false
21524 6704 Acked Flush 0 Done Sent Done false
21525 6705 Acked Read 10 Done Sent Done false
21526 6706 Acked Read 9 Done Sent Done false
21527 6707 Acked Write 5 Done Sent Done false
21528 6708 Acked Read 10 Done Sent Done false
21529 6709 Acked Read 7 Done Sent Done false
21530 6710 Acked Read 7 Done Sent Done false
21531 6711 Acked Read 4 Done Sent Done false
21532 6712 Acked Read 10 Done Sent Done false
21533 6713 Acked Write 4 Done Sent Done false
21534 6714 Acked Write 7 Done Sent Done false
21535 6715 Acked Read 8 Done Sent Done false
21536 6716 Acked Write 4 Done Sent Done false
21537 6717 Acked Read 6 Done Sent Done false
21538 6718 Acked Write 8 Done Sent Done false
21539 6719 Acked Write 8 Done Sent Done false
21540 6720 Acked Read 4 Done Sent Done false
21541 6721 Acked Write 9 Done Sent Done false
21542 6722 Acked Write 9 Done Sent Done false
21543 6723 Acked Read 9 Done Sent Done false
21544 6724 Acked Read 7 Done Sent Done false
21545 6725 Acked Read 5 Done Sent Done false
21546 6726 Acked Write 1 Done Sent Done false
21547 6727 Acked Write 2 Done Sent Done false
21548 6728 Acked Flush 0 Done Sent Done false
21549 6729 Acked Read 2 Done Sent Done false
21550 6730 Acked Read 2 Done Sent Done false
21551 6731 Acked Write 6 Done Sent Done false
21552 6732 Acked Read 8 Done Sent Done false
21553 6733 Acked Read 6 Done Sent Done false
21554 STATES DS:0 DS:1 DS:2 TOTAL
21555 Sent 0 301 0 301
21556 Done 301 0 301 602
21557 Skipped 0 0 0 0
21558 Error 0 0 0 0
21559 Last Flush: 6728 6432 6728
21560 Downstairs last five completed: 6432 6431 6430 6429 6428
21561 Upstairs last five completed: 6733 6732 6731 6730 6729
21562 CLIENT: Up:0 ds:301 act:2
21563 [8820] got start action
21564 [8820] I am going to restart
21565 Starting downstairs at port 8820
21566 Make output file at "/tmp/dsc/downstairs-8820.txt"
21567 [8820][1] reports Starting
21568 Downstairs /var/tmp/dsc/region/8820 port 8820 PID:Some(1221)
21569 [8820][1] reports Running
21570 ----------------------------------------------------------------
21571 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:302
21572 States: Active Offline Active
21573 JOBID ACK TYPE BKS/EXT DS:0 DS:1 DS:2 REPLAY
21574 6433 Acked Read 7 Done Sent Done false
21575 6434 Acked Read 6 Done Sent Done false
21576 6435 Acked Write 4 Done Sent Done false
21577 6436 Acked Write 3 Done Sent Done false
21578 6437 Acked Read 2 Done Sent Done false
21579 6438 Acked Read 8 Done Sent Done false
21580 6439 Acked Read 5 Done Sent Done false
21581 6440 Acked Write 4 Done Sent Done false
21582 6441 Acked Read 8 Done Sent Done false
21583 6442 Acked Write 5 Done Sent Done false
21584 6443 Acked Read 5 Done Sent Done false
21585 6444 Acked Write 1 Done Sent Done false
21586 6445 Acked Flush 0 Done Sent Done false
21587 6446 Acked Read 5 Done Sent Done false
21588 6447 Acked Read 8 Done Sent Done false
21589 6448 Acked Write 8 Done Sent Done false
21590 6449 Acked Write 10 Done Sent Done false
21591 6450 Acked Read 10 Done Sent Done false
21592 6451 Acked Write 7 Done Sent Done false
21593 6452 Acked Read 2 Done Sent Done false
21594 6453 Acked Flush 0 Done Sent Done false
21595 6454 Acked Flush 0 Done Sent Done false
21596 6455 Acked Read 9 Done Sent Done false
21597 6456 Acked Write 5 Done Sent Done false
21598 6457 Acked Write 7 Done Sent Done false
21599 6458 Acked Read 4 Done Sent Done false
21600 6459 Acked Write 6 Done Sent Done false
21601 6460 Acked Read 7 Done Sent Done false
21602 6461 Acked Read 9 Done Sent Done false
21603 6462 Acked Read 3 Done Sent Done false
21604 6463 Acked Read 9 Done Sent Done false
21605 6464 Acked Read 5 Done Sent Done false
21606 6465 Acked Flush 0 Done Sent Done false
21607 6466 Acked Write 5 Done Sent Done false
21608 6467 Acked Read 4 Done Sent Done false
21609 6468 Acked Read 8 Done Sent Done false
21610 6469 Acked Read 2 Done Sent Done false
21611 6470 Acked Read 4 Done Sent Done false
21612 6471 Acked Read 8 Done Sent Done false
21613 6472 Acked Write 4 Done Sent Done false
21614 6473 Acked Write 7 Done Sent Done false
21615 6474 Acked Write 8 Done Sent Done false
21616 6475 Acked Read 3 Done Sent Done false
21617 6476 Acked Read 2 Done Sent Done false
21618 6477 Acked Read 4 Done Sent Done false
21619 6478 Acked Write 4 Done Sent Done false
21620 6479 Acked Write 2 Done Sent Done false
21621 6480 Acked Flush 0 Done Sent Done false
21622 6481 Acked Flush 0 Done Sent Done false
21623 6482 Acked Read 6 Done Sent Done false
21624 6483 Acked Read 10 Done Sent Done false
21625 6484 Acked Write 8 Done Sent Done false
21626 6485 Acked Read 9 Done Sent Done false
21627 6486 Acked Write 4 Done Sent Done false
21628 6487 Acked Write 7 Done Sent Done false
21629 6488 Acked Flush 0 Done Sent Done false
21630 6489 Acked Write 9 Done Sent Done false
21631 6490 Acked Read 3 Done Sent Done false
21632 6491 Acked Read 6 Done Sent Done false
21633 6492 Acked Write 1 Done Sent Done false
21634 6493 Acked Read 9 Done Sent Done false
21635 6494 Acked Write 4 Done Sent Done false
21636 6495 Acked Read 8 Done Sent Done false
21637 6496 Acked Read 7 Done Sent Done false
21638 6497 Acked Read 5 Done Sent Done false
21639 6498 Acked Read 10 Done Sent Done false
21640 6499 Acked Write 7 Done Sent Done false
21641 6500 Acked Read 8 Done Sent Done false
21642 6501 Acked Write 9 Done Sent Done false
21643 6502 Acked Read 10 Done Sent Done false
21644 6503 Acked Flush 0 Done Sent Done false
21645 6504 Acked Read 1 Done Sent Done false
21646 6505 Acked Write 4 Done Sent Done false
21647 6506 Acked Write 7 Done Sent Done false
21648 6507 Acked Read 6 Done Sent Done false
21649 6508 Acked Read 10 Done Sent Done false
21650 6509 Acked Read 9 Done Sent Done false
21651 6510 Acked Read 9 Done Sent Done false
21652 6511 Acked Write 9 Done Sent Done false
21653 6512 Acked Read 4 Done Sent Done false
21654 6513 Acked Write 8 Done Sent Done false
21655 6514 Acked Flush 0 Done Sent Done false
21656 6515 Acked Flush 0 Done Sent Done false
21657 6516 Acked Write 1 Done Sent Done false
21658 6517 Acked Write 7 Done Sent Done false
21659 6518 Acked Write 8 Done Sent Done false
21660 6519 Acked Write 4 Done Sent Done false
21661 6520 Acked Write 9 Done Sent Done false
21662 6521 Acked Flush 0 Done Sent Done false
21663 6522 Acked Write 3 Done Sent Done false
21664 6523 Acked Read 4 Done Sent Done false
21665 6524 Acked Flush 0 Done Sent Done false
21666 6525 Acked Write 2 Done Sent Done false
21667 6526 Acked Read 4 Done Sent Done false
21668 6527 Acked Read 3 Done Sent Done false
21669 6528 Acked Write 10 Done Sent Done false
21670 6529 Acked Write 4 Done Sent Done false
21671 6530 Acked Read 9 Done Sent Done false
21672 6531 Acked Write 5 Done Sent Done false
21673 6532 Acked Read 9 Done Sent Done false
21674 6533 Acked Write 10 Done Sent Done false
21675 6534 Acked Write 1 Done Sent Done false
21676 6535 Acked Read 4 Done Sent Done false
21677 6536 Acked Read 3 Done Sent Done false
21678 6537 Acked Write 9 Done Sent Done false
21679 6538 Acked Read 10 Done Sent Done false
21680 6539 Acked Write 3 Done Sent Done false
21681 6540 Acked Write 4 Done Sent Done false
21682 6541 Acked Read 10 Done Sent Done false
21683 6542 Acked Read 6 Done Sent Done false
21684 6543 Acked Write 5 Done Sent Done false
21685 6544 Acked Write 10 Done Sent Done false
21686 6545 Acked Write 1 Done Sent Done false
21687 6546 Acked Read 1 Done Sent Done false
21688 6547 Acked Read 3 Done Sent Done false
21689 6548 Acked Read 5 Done Sent Done false
21690 6549 Acked Read 1 Done Sent Done false
21691 6550 Acked Read 2 Done Sent Done false
21692 6551 Acked Read 8 Done Sent Done false
21693 6552 Acked Flush 0 Done Sent Done false
21694 6553 Acked Read 1 Done Sent Done false
21695 6554 Acked Read 9 Done Sent Done false
21696 6555 Acked Write 7 Done Sent Done false
21697 6556 Acked Write 10 Done Sent Done false
21698 6557 Acked Read 3 Done Sent Done false
21699 6558 Acked Write 5 Done Sent Done false
21700 6559 Acked Read 9 Done Sent Done false
21701 6560 Acked Write 5 Done Sent Done false
21702 6561 Acked Read 2 Done Sent Done false
21703 6562 Acked Read 3 Done Sent Done false
21704 6563 Acked Write 10 Done Sent Done false
21705 6564 Acked Read 7 Done Sent Done false
21706 6565 Acked Write 9 Done Sent Done false
21707 6566 Acked Write 9 Done Sent Done false
21708 6567 Acked Flush 0 Done Sent Done false
21709 6568 Acked Read 3 Done Sent Done false
21710 6569 Acked Write 1 Done Sent Done false
21711 6570 Acked Write 10 Done Sent Done false
21712 6571 Acked Read 10 Done Sent Done false
21713 6572 Acked Write 2 Done Sent Done false
21714 6573 Acked Write 4 Done Sent Done false
21715 6574 Acked Read 10 Done Sent Done false
21716 6575 Acked Read 10 Done Sent Done false
21717 6576 Acked Read 8 Done Sent Done false
21718 6577 Acked Write 9 Done Sent Done false
21719 6578 Acked Write 9 Done Sent Done false
21720 6579 Acked Write 9 Done Sent Done false
21721 6580 Acked Read 7 Done Sent Done false
21722 6581 Acked Read 7 Done Sent Done false
21723 6582 Acked Read 10 Done Sent Done false
21724 6583 Acked Read 5 Done Sent Done false
21725 6584 Acked Read 1 Done Sent Done false
21726 6585 Acked Read 7 Done Sent Done false
21727 6586 Acked Write 5 Done Sent Done false
21728 6587 Acked Read 6 Done Sent Done false
21729 6588 Acked Write 7 Done Sent Done false
21730 6589 Acked Write 7 Done Sent Done false
21731 6590 Acked Read 5 Done Sent Done false
21732 6591 Acked Flush 0 Done Sent Done false
21733 6592 Acked Write 2 Done Sent Done false
21734 6593 Acked Flush 0 Done Sent Done false
21735 6594 Acked Read 9 Done Sent Done false
21736 6595 Acked Write 8 Done Sent Done false
21737 6596 Acked Read 3 Done Sent Done false
21738 6597 Acked Read 10 Done Sent Done false
21739 6598 Acked Write 5 Done Sent Done false
21740 6599 Acked Write 1 Done Sent Done false
21741 6600 Acked Read 8 Done Sent Done false
21742 6601 Acked Write 5 Done Sent Done false
21743 6602 Acked Write 4 Done Sent Done false
21744 6603 Acked Read 2 Done Sent Done false
21745 6604 Acked Write 2 Done Sent Done false
21746 6605 Acked Write 6 Done Sent Done false
21747 6606 Acked Write 6 Done Sent Done false
21748 6607 Acked Read 9 Done Sent Done false
21749 6608 Acked Read 4 Done Sent Done false
21750 6609 Acked Read 10 Done Sent Done false
21751 6610 Acked Read 6 Done Sent Done false
21752 6611 Acked Write 10 Done Sent Done false
21753 6612 Acked Read 8 Done Sent Done false
21754 6613 Acked Write 8 Done Sent Done false
21755 6614 Acked Read 7 Done Sent Done false
21756 6615 Acked Read 2 Done Sent Done false
21757 6616 Acked Read 6 Done Sent Done false
21758 6617 Acked Flush 0 Done Sent Done false
21759 6618 Acked Read 8 Done Sent Done false
21760 6619 Acked Write 1 Done Sent Done false
21761 6620 Acked Read 3 Done Sent Done false
21762 6621 Acked Write 1 Done Sent Done false
21763 6622 Acked Read 2 Done Sent Done false
21764 6623 Acked Write 7 Done Sent Done false
21765 6624 Acked Write 7 Done Sent Done false
21766 6625 Acked Write 5 Done Sent Done false
21767 6626 Acked Flush 0 Done Sent Done false
21768 6627 Acked Write 9 Done Sent Done false
21769 6628 Acked Read 2 Done Sent Done false
21770 6629 Acked Flush 0 Done Sent Done false
21771 6630 Acked Write 5 Done Sent Done false
21772 6631 Acked Read 1 Done Sent Done false
21773 6632 Acked Write 10 Done Sent Done false
21774 6633 Acked Write 8 Done Sent Done false
21775 6634 Acked Write 4 Done Sent Done false
21776 6635 Acked Read 3 Done Sent Done false
21777 6636 Acked Write 7 Done Sent Done false
21778 6637 Acked Read 3 Done Sent Done false
21779 6638 Acked Write 7 Done Sent Done false
21780 6639 Acked Read 4 Done Sent Done false
21781 6640 Acked Write 9 Done Sent Done false
21782 6641 Acked Write 8 Done Sent Done false
21783 6642 Acked Read 6 Done Sent Done false
21784 6643 Acked Read 8 Done Sent Done false
21785 6644 Acked Read 10 Done Sent Done false
21786 6645 Acked Flush 0 Done Sent Done false
21787 6646 Acked Read 9 Done Sent Done false
21788 6647 Acked Write 1 Done Sent Done false
21789 6648 Acked Read 5 Done Sent Done false
21790 6649 Acked Write 1 Done Sent Done false
21791 6650 Acked Read 4 Done Sent Done false
21792 6651 Acked Flush 0 Done Sent Done false
21793 6652 Acked Read 8 Done Sent Done false
21794 6653 Acked Flush 0 Done Sent Done false
21795 6654 Acked Write 3 Done Sent Done false
21796 6655 Acked Write 6 Done Sent Done false
21797 6656 Acked Write 9 Done Sent Done false
21798 6657 Acked Write 1 Done Sent Done false
21799 6658 Acked Read 4 Done Sent Done false
21800 6659 Acked Read 3 Done Sent Done false
21801 6660 Acked Write 2 Done Sent Done false
21802 6661 Acked Write 2 Done Sent Done false
21803 6662 Acked Write 8 Done Sent Done false
21804 6663 Acked Read 8 Done Sent Done false
21805 6664 Acked Flush 0 Done Sent Done false
21806 6665 Acked Read 2 Done Sent Done false
21807 6666 Acked Write 6 Done Sent Done false
21808 6667 Acked Read 7 Done Sent Done false
21809 6668 Acked Write 2 Done Sent Done false
21810 6669 Acked Read 2 Done Sent Done false
21811 6670 Acked Write 5 Done Sent Done false
21812 6671 Acked Write 10 Done Sent Done false
21813 6672 Acked Flush 0 Done Sent Done false
21814 6673 Acked Flush 0 Done Sent Done false
21815 6674 Acked Write 3 Done Sent Done false
21816 6675 Acked Write 6 Done Sent Done false
21817 6676 Acked Read 9 Done Sent Done false
21818 6677 Acked Read 5 Done Sent Done false
21819 6678 Acked Write 6 Done Sent Done false
21820 6679 Acked Read 3 Done Sent Done false
21821 6680 Acked Write 4 Done Sent Done false
21822 6681 Acked Write 1 Done Sent Done false
21823 6682 Acked Read 7 Done Sent Done false
21824 6683 Acked Read 4 Done Sent Done false
21825 6684 Acked Read 3 Done Sent Done false
21826 6685 Acked Write 7 Done Sent Done false
21827 6686 Acked Read 10 Done Sent Done false
21828 6687 Acked Read 8 Done Sent Done false
21829 6688 Acked Read 1 Done Sent Done false
21830 6689 Acked Read 6 Done Sent Done false
21831 6690 Acked Read 10 Done Sent Done false
21832 6691 Acked Read 4 Done Sent Done false
21833 6692 Acked Read 8 Done Sent Done false
21834 6693 Acked Write 2 Done Sent Done false
21835 6694 Acked Write 4 Done Sent Done false
21836 6695 Acked Read 8 Done Sent Done false
21837 6696 Acked Read 9 Done Sent Done false
21838 6697 Acked Read 5 Done Sent Done false
21839 6698 Acked Write 10 Done Sent Done false
21840 6699 Acked Read 3 Done Sent Done false
21841 6700 Acked Write 5 Done Sent Done false
21842 6701 Acked Write 3 Done Sent Done false
21843 6702 Acked Read 6 Done Sent Done false
21844 6703 Acked Write 3 Done Sent Done false
21845 6704 Acked Flush 0 Done Sent Done false
21846 6705 Acked Read 10 Done Sent Done false
21847 6706 Acked Read 9 Done Sent Done false
21848 6707 Acked Write 5 Done Sent Done false
21849 6708 Acked Read 10 Done Sent Done false
21850 6709 Acked Read 7 Done Sent Done false
21851 6710 Acked Read 7 Done Sent Done false
21852 6711 Acked Read 4 Done Sent Done false
21853 6712 Acked Read 10 Done Sent Done false
21854 6713 Acked Write 4 Done Sent Done false
21855 6714 Acked Write 7 Done Sent Done false
21856 6715 Acked Read 8 Done Sent Done false
21857 6716 Acked Write 4 Done Sent Done false
21858 6717 Acked Read 6 Done Sent Done false
21859 6718 Acked Write 8 Done Sent Done false
21860 6719 Acked Write 8 Done Sent Done false
21861 6720 Acked Read 4 Done Sent Done false
21862 6721 Acked Write 9 Done Sent Done false
21863 6722 Acked Write 9 Done Sent Done false
21864 6723 Acked Read 9 Done Sent Done false
21865 6724 Acked Read 7 Done Sent Done false
21866 6725 Acked Read 5 Done Sent Done false
21867 6726 Acked Write 1 Done Sent Done false
21868 6727 Acked Write 2 Done Sent Done false
21869 6728 Acked Flush 0 Done Sent Done false
21870 6729 Acked Read 2 Done Sent Done false
21871 6730 Acked Read 2 Done Sent Done false
21872 6731 Acked Write 6 Done Sent Done false
21873 6732 Acked Read 8 Done Sent Done false
21874 6733 Acked Read 6 Done Sent Done false
21875 6734 Acked Flush 0 Done Sent Done false
21876 STATES DS:0 DS:1 DS:2 TOTAL
21877 Sent 0 302 0 302
21878 Done 302 0 302 604
21879 Skipped 0 0 0 0
21880 Error 0 0 0 0
21881 Last Flush: 6734 6432 6734
21882 Downstairs last five completed: 6432 6431 6430 6429 6428
21883 Upstairs last five completed: 6734 6733 6732 6731 6730
21884 CLIENT: Up:0 ds:302 act:2
218852025-01-10T16:39:54.161ZINFOcrucible: connecting to 127.0.0.1:8820 = io task client = 1 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
218862025-01-10T16:39:54.162ZINFOcrucible: ds_connection connected from Ok(127.0.0.1:60718) = io task client = 1 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
218872025-01-10T16:39:54.163ZWARNcrucible: version negotiation from state Offline = downstairs client = 1 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
218882025-01-10T16:39:54.163ZINFOcrucible: downstairs client at Some(127.0.0.1:8820) has region UUID 12345678-0000-0000-0000-000000008820 = downstairs client = 1 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
218892025-01-10T16:39:54.163ZINFOcrucible: Returning UUID:12345678-0000-0000-0000-000000008820 matches = downstairs client = 1 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
218902025-01-10T16:39:54.163ZINFOcrucible: send last flush ID to this DS: 6432 = downstairs client = 1 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
218912025-01-10T16:39:54.164ZINFOcrucible: Replied this last flush ID: 6432 = downstairs client = 1 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
218922025-01-10T16:39:54.164ZINFOcrucible: ds_transition from Offline to Active = downstairs client = 1 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
218932025-01-10T16:39:54.164ZINFOcrucible: [1] Transition from Offline to Active = downstairs client = 1 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
218942025-01-10T16:39:54.164ZINFOcrucible: [1] client re-new 302 jobs since flush 6432 = downstairs session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
218952025-01-10T16:39:54.164ZINFOcrucible: [1] Replayed 302 jobs since flush: 6432 = downstairs session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
21896 ----------------------------------------------------------------
21897 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:0
21898 Downstairs last five completed: 6734 6733 6732 6731 6730
21899 Upstairs last five completed: 6734 6733 6732 6731 6730
21900 CLIENT: Up:0 ds:0 act:3
21901 Replay: All jobs finished
21902 Main task has work to do, go find it
21903 got dsc Stop(1)
21904 stop 1
21905 Jan 10 16:39:56.416 INFO request completed, latency_us: 369, response_code: 204, uri: /stop/cid/1, method: POST, req_id[8820] Got stop action so:false kr:false
21906 : e5250ff1-7b46-49a6-879e-ae7b6f9b6c97, remote_addr: 127.0.0.1:55917, local_addr: 127.0.0.1:9998
219072025-01-10T16:39:56.416ZWARNcrucible: downstairs disconnected = io task client = 1 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
219082025-01-10T16:39:56.416ZWARNcrucible: client task is sending Done(Finished) = io task client = 1 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
21909 Jan 10 16:39:56.416 INFO request completed, latency_us:{"msg":"downstairs task for 1 stopped due to Finished","v":0,"name":"crucible","level":40,"time":"2025-01-10T16:39:56.416964632Z","hostname":"w-01JH8H1N3KXZ9F8ZV6CCMP5KTQ","pid":1202,"session_id":"1df3ca91-4dc9-42d6-9897-461254b5afe2"}
21910 103, response_code: 200, uri: {"msg":"ds_transition from Active to Offline","v":0,"name":"crucible","level":30,"time":"2025-01-10T16:39:56.41698321Z","hostname":"w-01JH8H1N3KXZ9F8ZV6CCMP5KTQ","pid":1202,"client":"1","":"downstairs","session_id":"1df3ca91-4dc9-42d6-9897-461254b5afe2"}
21911 /state/cid/1{"msg":"[1] Transition from Active to Offline","v":0,"name":"crucible","level":30,"time":"2025-01-10T16:39:56.417039495Z","hostname":"w-01JH8H1N3KXZ9F8ZV6CCMP5KTQ","pid":1202,"client":"1","":"downstairs","session_id":"1df3ca91-4dc9-42d6-9897-461254b5afe2"}
21912 , method: GET, req_id: 38057fc1-a2b8-4a58-bdb5-9507b788916e, remote_addr: 127.0.0.1:55917, local_addr: 127.0.0.1{"msg":"client task is exiting","v":0,"name":"crucible","level":30,"time":"2025-01-10T16:39:56.417128546Z","hostname":"w-01JH8H1N3KXZ9F8ZV6CCMP5KTQ","pid":1202,"":"io task","client":"1","":"downstairs","session_id":"1df3ca91-4dc9-42d6-9897-461254b5afe2"}
21913 :9998
21914 [8820] Exited with: ExitStatus(unix_wait_status(9))
21915 [8820][1] reports Exit
21916 Jan 10 16:40:00.419 INFO request completed, latency_us: 346, response_code: 200, uri: /state/cid/1, method: GET, req_id: 8766a075-6a27-4aeb-9a5b-23c615f09b5e, remote_addr: 127.0.0.1:55917, local_addr: 127.0.0.1:9998
21917 001/300 Read block 1206 len 28672
21918 002/300 Read block 207 len 16384
21919 003/300 Write block 1500 len 8192 data: 4 3
21920 004/300 Write block 2887 len 12288 data: 8 5 6
21921 005/300 Flush
21922 006/300 Read block 50 len 24576
21923 007/300 Flush
21924 008/300 Read block 2936 len 28672
21925 009/300 Read block 1046 len 32768
21926 010/300 Write block 679 len 40960 data: 7 8 8 8 7 6 6 5 5 4
21927 011/300 Read block 2879 len 8192
21928 012/300 Read block 3897 len 20480
21929 013/300 Write block 2384 len 24576 data: 5 4 5 6 6 6
21930 014/300 Read block 4770 len 32768
21931 015/300 Read block 1878 len 36864
21932 016/300 Write block 3752 len 32768 data: 5 5 4 6 6 6 7 7
21933 017/300 Read block 542 len 24576
21934 018/300 Read block 1078 len 20480
21935 019/300 Read block 3312 len 12288
21936 020/300 Write block 2367 len 32768 data: 5 4 5 4 4 5 5 4
21937 021/300 Flush
21938 022/300 Read block 376 len 20480
21939 023/300 Read block 1952 len 28672
21940 024/300 Read block 367 len 4096
21941 025/300 Write block 709 len 24576 data: 3 4 3 3 3 3
21942 026/300 Read block 2526 len 4096
21943 027/300 Write block 3350 len 16384 data: 3 3 4 5
21944 028/300 Write block 1791 len 40960 data: 4 3 3 4 4 4 3 3 2 2
21945 029/300 Flush
21946 030/300 Write block 4519 len 20480 data: 4 5 5 3 3
21947 031/300 Write block 2113 len 32768 data: 3 4 3 3 5 5 5 5
21948 032/300 Write block 3724 len 24576 data: 4 5 6 8 8 8
21949 033/300 Read block 632 len 32768
21950 034/300 Read block 4757 len 40960
21951 035/300 Write block 483 len 28672 data: 3 3 5 5 5 5 5
21952 036/300 Read block 4075 len 28672
21953 037/300 Read block 204 len 40960
21954 038/300 Read block 2828 len 12288
21955 039/300 Write block 3765 len 32768 data: 4 5 6 5 5 4 4 4
21956 040/300 Flush
21957 041/300 Read block 2348 len 16384
21958 042/300 Read block 4576 len 32768
21959 043/300 Read block 2186 len 12288
21960 044/300 Read block 750 len 8192
21961 045/300 Read block 4841 len 4096
21962 046/300 Write block 1208 len 12288 data: 3 3 3
21963 047/300 Read block 1632 len 32768
21964 048/300 Write block 229 len 40960 data: 6 6 7 6 6 6 6 6 6 6
21965 049/300 Read block 365 len 24576
21966 050/300 Read block 4698 len 16384
21967 051/300 Write block 4875 len 4096 data: 4
21968 052/300 Read block 2690 len 12288
21969 053/300 Write block 587 len 4096 data: 6
21970 054/300 Write block 732 len 8192 data: 6 7
21971 055/300 Read block 1939 len 12288
21972 056/300 Write block 1869 len 8192 data: 3 3
21973 057/300 Write block 915 len 20480 data: 5 5 8 8 7
21974 058/300 Write block 2895 len 32768 data: 5 4 8 8 9 9 9 8
21975 059/300 Write block 1923 len 36864 data: 3 3 5 5 5 6 6 7 5
21976 060/300 Write block 4560 len 8192 data: 4 6
21977 061/300 Read block 2076 len 4096
21978 062/300 Read block 4723 len 16384
21979 063/300 Read block 4809 len 12288
21980 064/300 Read block 2530 len 28672
21981 065/300 Read block 677 len 20480
21982 066/300 Flush
21983 067/300 Write block 1400 len 4096 data: 2
21984 068/300 Read block 1181 len 8192
21985 069/300 Read block 470 len 16384
21986 070/300 Read block 4450 len 40960
21987 071/300 Write block 805 len 12288 data: 3 4 5
21988 072/300 Write block 258 len 20480 data: 4 3 4 4 4
21989 073/300 Write block 599 len 32768 data: 6 6 7 5 7 8 9 10
21990 074/300 Write block 3569 len 28672 data: 4 3 3 3 3 4 3
21991 075/300 Read block 2369 len 28672
21992 076/300 Read block 4798 len 8192
21993 077/300 Write block 1711 len 40960 data: 5 4 5 4 2 2 4 4 5 5
21994 078/300 Read block 4425 len 36864
21995 079/300 Read block 4052 len 20480
21996 080/300 Read block 3466 len 40960
21997 081/300 Write block 3313 len 12288 data: 4 4 4
21998 082/300 Write block 750 len 16384 data: 6 5 5 4
21999 083/300 Read block 0 len 24576
22000 084/300 Write block 4394 len 36864 data: 3 5 6 7 7 7 7 5 4
22001 085/300 Read block 3003 len 36864
22002 086/300 Read block 1969 len 8192
22003 087/300 Write block 2685 len 40960 data: 7 7 6 6 7 6 7 5 4 4
22004 088/300 Write block 841 len 32768 data: 7 6 7 7 7 5 3 3
22005 089/300 Write block 2479 len 16384 data: 3 3 4 3
22006 090/300 Write block 1682 len 32768 data: 6 6 7 6 6 5 5 4
22007 091/300 Read block 283 len 12288
22008 092/300 Write block 2185 len 16384 data: 2 2 2 4
22009 093/300 Flush
22010 094/300 Read block 1689 len 32768
22011 095/300 Read block 4919 len 24576
22012 096/300 Write block 2534 len 16384 data: 2 2 2 2
22013 097/300 Write block 3347 len 40960 data: 3 4 3 4 4 5 6 4 3 2
22014 098/300 Write block 1898 len 40960 data: 3 3 4 4 3 3 3 4 4 5
22015 099/300 Read block 3199 len 40960
22016 100/300 Write block 2099 len 8192 data: 3 5
22017 101/300 Read block 1594 len 28672
22018 102/300 Write block 3356 len 24576 data: 3 2 2 2 2 3
22019 103/300 Write block 2434 len 4096 data: 4
22020 104/300 Write block 2258 len 16384 data: 3 3 3 3
22021 105/300 Read block 3383 len 4096
22022 106/300 Read block 3705 len 12288
22023 107/300 Flush
22024 108/300 Read block 3083 len 36864
22025 109/300 Write block 1227 len 16384 data: 8 8 8 9
22026 110/300 Read block 10 len 8192
22027 111/300 Read block 4520 len 32768
22028 112/300 Write block 2224 len 32768 data: 4 5 3 3 3 2 2 2
22029 113/300 Read block 3056 len 16384
22030 114/300 Write block 1435 len 16384 data: 2 3 3 3
22031 115/300 Read block 4010 len 8192
22032 116/300 Write block 2030 len 40960 data: 5 5 5 5 6 6 5 7 8 7
22033 117/300 Read block 4719 len 36864
22034 118/300 Read block 2934 len 28672
22035 119/300 Flush
22036 120/300 Read block 3771 len 32768
22037 121/300 Read block 2664 len 24576
22038 122/300 Read block 3808 len 16384
22039 123/300 Read block 294 len 40960
22040 124/300 Read block 1262 len 16384
22041 125/300 Flush
22042 126/300 Read block 3843 len 12288
22043 127/300 Write block 904 len 4096 data: 2
22044 128/300 Flush
22045 129/300 Flush
22046 130/300 Write block 2582 len 8192 data: 5 7
22047 131/300 Flush
22048 132/300 Read block 1459 len 12288
22049 133/300 Write block 772 len 8192 data: 7 6
22050 134/300 Write block 1828 len 20480 data: 6 6 5 5 6
22051 135/300 Read block 4740 len 20480
22052 136/300 Read block 4584 len 40960
22053 137/300 Read block 1831 len 40960
22054 138/300 Read block 3180 len 36864
22055 139/300 Read block 4490 len 12288
22056 140/300 Write block 699 len 24576 data: 7 5 6 5 5 5
22057 141/300 Write block 4140 len 4096 data: 4
22058 142/300 Write block 565 len 4096 data: 6
22059 143/300 Write block 1768 len 8192 data: 5 3
22060 144/300 Read block 3250 len 16384
22061 145/300 Flush
22062 146/300 Read block 1605 len 24576
22063 147/300 Write block 3129 len 24576 data: 4 5 6 4 5 5
22064 148/300 Write block 2419 len 28672 data: 3 4 4 4 4 4 3
22065 149/300 Read block 2136 len 32768
22066 150/300 Read block 1701 len 8192
22067 151/300 Flush
22068 152/300 Read block 3105 len 16384
22069 153/300 Flush
22070 154/300 Read block 91 len 36864
22071 155/300 Write block 2490 len 32768 data: 4 3 4 3 3 3 3 3
22072 156/300 Read block 1868 len 28672
22073 157/300 Read block 3747 len 40960
22074 158/300 Read block 2311 len 4096
22075 159/300 Read block 4116 len 12288
22076 160/300 Write block 3288 len 20480 data: 5 5 5 5 5
22077 161/300 Read block 4579 len 16384
22078 162/300 Read block 2603 len 24576
22079 163/300 Read block 3889 len 8192
22080 164/300 Write block 1589 len 4096 data: 4
22081 165/300 Read block 3460 len 32768
22082 166/300 Write block 2693 len 32768 data: 5 5 5 5 5 4 3 3
22083 167/300 Flush
22084 168/300 Write block 222 len 28672 data: 6 3 3 3 3 4 4
22085 169/300 Read block 2452 len 40960
22086 170/300 Write block 1581 len 36864 data: 3 3 3 4 4 4 5 5 5
22087 171/300 Write block 1911 len 32768 data: 5 5 5 4 5 5 4 5
22088 172/300 Read block 3828 len 16384
22089 173/300 Read block 4390 len 16384
22090 174/300 Read block 1080 len 40960
22091 175/300 Read block 3314 len 20480
22092 176/300 Read block 1078 len 4096
22093 177/300 Write block 4088 len 8192 data: 5 5
22094 178/300 Read block 3803 len 8192
22095 179/300 Read block 1753 len 8192
22096 180/300 Read block 255 len 4096
22097 181/300 Write block 4845 len 8192 data: 5 5
22098 182/300 Write block 4357 len 32768 data: 5 4 5 6 7 7 6 5
22099 183/300 Read block 4060 len 40960
22100 184/300 Read block 1756 len 24576
22101 185/300 Read block 4738 len 32768
22102 186/300 Read block 2275 len 36864
22103 187/300 Write block 2617 len 24576 data: 4 5 5 4 4 3
22104 188/300 Read block 2542 len 16384
22105 189/300 Flush
22106 190/300 Read block 271 len 12288
22107 191/300 Write block 417 len 4096 data: 3
22108 192/300 Read block 1729 len 28672
22109 193/300 Read block 2592 len 8192
22110 194/300 Read block 1545 len 36864
22111 195/300 Flush
22112 196/300 Read block 4875 len 32768
22113 197/300 Read block 3336 len 4096
22114 198/300 Write block 1118 len 16384 data: 4 3 4 3
22115 199/300 Write block 2807 len 28672 data: 7 8 8 8 8 7 5
22116 200/300 Write block 1780 len 12288 data: 7 7 7
22117 201/300 Read block 4357 len 12288
22118 202/300 Read block 3818 len 24576
22119 203/300 Read block 2844 len 40960
22120 204/300 Read block 952 len 28672
22121 205/300 Write block 3400 len 8192 data: 8 7
22122 206/300 Write block 3116 len 16384 data: 4 4 2 4
22123 207/300 Write block 4693 len 32768 data: 4 4 3 3 2 2 3 3
22124 208/300 Write block 1350 len 20480 data: 6 6 7 6 4
22125 209/300 Write block 2310 len 24576 data: 6 6 6 7 7 6
22126 210/300 Write block 4377 len 16384 data: 9 9 6 5
22127 211/300 Write block 266 len 28672 data: 4 4 4 4 5 6 6
22128 212/300 Flush
22129 213/300 Flush
22130 214/300 Write block 2013 len 24576 data: 3 4 3 3 4 5
22131 215/300 Write block 4440 len 8192 data: 6 6
22132 216/300 Read block 3322 len 24576
22133 217/300 Read block 245 len 8192
22134 218/300 Write block 4700 len 36864 data: 4 3 3 4 5 5 5 4 5
22135 219/300 Flush
22136 220/300 Write block 2307 len 8192 data: 7 6
22137 221/300 Write block 1415 len 28672 data: 4 4 3 2 2 2 2
22138 222/300 Read block 3916 len 36864
22139 223/300 Read block 4464 len 16384
22140 224/300 Flush
22141 225/300 Read block 1652 len 8192
22142 226/300 Flush
22143 227/300 Read block 929 len 12288
22144 228/300 Write block 3271 len 12288 data: 3 3 2
22145 229/300 Read block 4202 len 16384
22146 230/300 Write block 753 len 40960 data: 5 4 4 4 4 3 3 3 3 5
22147 231/300 Read block 2513 len 32768
22148 232/300 Read block 1927 len 16384
22149 233/300 Read block 2683 len 4096
22150 234/300 Read block 1440 len 12288
22151 235/300 Write block 1774 len 8192 data: 4 4
22152 236/300 Read block 781 len 32768
22153 237/300 Read block 618 len 40960
22154 238/300 Read block 3234 len 8192
22155 239/300 Read block 1815 len 4096
22156 240/300 Flush
22157 241/300 Flush
22158 242/300 Read block 4651 len 4096
22159 243/300 Read block 3552 len 4096
22160 244/300 Write block 1398 len 20480 data: 2 2 3 3 3
22161 245/300 Read block 814 len 16384
22162 246/300 Write block 1882 len 24576 data: 3 3 3 4 4 3
22163 247/300 Read block 2166 len 24576
22164 248/300 Read block 566 len 12288
22165 249/300 Flush
22166 250/300 Write block 182 len 40960 data: 6 6 7 7 8 6 6 5 5 3
22167 251/300 Write block 1693 len 20480 data: 6 5 6 6 5
22168 252/300 Read block 102 len 8192
22169 253/300 Read block 2156 len 16384
22170 254/300 Write block 4669 len 8192 data: 5 4
22171 255/300 Write block 4823 len 28672 data: 6 4 5 6 6 4 5
22172 256/300 Read block 2374 len 28672
22173 257/300 Write block 879 len 4096 data: 7
22174 258/300 Read block 419 len 36864
22175 259/300 Write block 1923 len 40960 data: 4 4 6 6 6 7 7 8 6 4
22176 260/300 Read block 4891 len 32768
22177 261/300 Read block 774 len 28672
22178 262/300 Read block 1480 len 4096
22179 263/300 Write block 527 len 16384 data: 5 6 6 5
22180 264/300 Read block 3998 len 40960
22181 265/300 Write block 1502 len 32768 data: 3 3 4 4 3 3 4 5
22182 266/300 Read block 1778 len 24576
22183 267/300 Read block 4815 len 36864
22184 268/300 Read block 4695 len 40960
22185 269/300 Write block 3899 len 8192 data: 5 5
22186 270/300 Write block 2246 len 24576 data: 7 7 8 7 7 6
22187 271/300 Read block 8 len 12288
22188 272/300 Read block 2334 len 36864
22189 273/300 Write block 220 len 40960 data: 5 7 7 4 4 4 4 5 5 7
22190 274/300 Flush
22191 275/300 Flush
22192 276/300 Write block 2102 len 16384 data: 3 3 2 2
22193 277/300 Read block 3594 len 12288
22194 278/300 Flush
22195 279/300 Read block 3900 len 12288
22196 280/300 Read block 4111 len 24576
22197 281/300 Read block 2266 len 36864
22198 282/300 Write block 2222 len 32768 data: 4 4 5 6 4 4 4 3
22199 283/300 Flush
22200 284/300 Read block 554 len 32768
22201 285/300 Read block 2391 len 4096
22202 286/300 Write block 4897 len 20480 data: 5 5 4 3 4
22203 287/300 Write block 279 len 24576 data: 2 2 3 4 5 3
22204 288/300 Read block 916 len 20480
22205 289/300 Read block 3448 len 40960
22206 290/300 Write block 4923 len 16384 data: 4 4 3 4
22207 291/300 Write block 874 len 8192 data: 5 6
22208 292/300 Read block 1496 len 8192
22209 293/300 Write block 314 len 24576 data: 4 5 5 5 5 6
22210 294/300 Write block 4266 len 32768 data: 2 2 2 2 3 2 2 3
22211 295/300 Read block 3875 len 8192
22212 296/300 Read block 3930 len 36864
22213 297/300 Write block 2076 len 36864 data: 5 4 2 2 3 3 3 3 3
22214 298/300 Read block 4355 len 24576
22215 299/300 Write block 3733 len 12288 data: 7 7 7
22216 300/300 Read block 3444 len 32768
22217 301/300 Write block 2524 len 20480 data: 2 4 4 4 5
22218 Main task has work to do, go find it
22219 got dsc Start(1)
22220 start 1
22221 Jan 10 16:40:00.659 INFO request completed, latency_us: 233, response_code: 204, uri: /start/cid/1, method: POST, req_id: 12675ddc-2453-4f3f-90ab-abb8266be830, remote_addr: 127.0.0.1:55917, local_addr: 127.0.0.1:9998
22222 Replay: started 1, returned:Ok(())
22223 ----------------------------------------------------------------
22224 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:301
22225 States: Active Offline Active
22226 JOBID ACK TYPE BKS/EXT DS:0 DS:1 DS:2 REPLAY
22227 6735 Acked Read 7 Done Sent Done false
22228 6736 Acked Read 4 Done Sent Done false
22229 6737 Acked Write 2 Done Sent Done false
22230 6738 Acked Write 3 Done Sent Done false
22231 6739 Acked Flush 0 Done Sent Done false
22232 6740 Acked Read 6 Done Sent Done false
22233 6741 Acked Flush 0 Done Sent Done false
22234 6742 Acked Read 7 Done Sent Done false
22235 6743 Acked Read 8 Done Sent Done false
22236 6744 Acked Write 10 Done Sent Done false
22237 6745 Acked Read 2 Done Sent Done false
22238 6746 Acked Read 5 Done Sent Done false
22239 6747 Acked Write 6 Done Sent Done false
22240 6748 Acked Read 8 Done Sent Done false
22241 6749 Acked Read 9 Done Sent Done false
22242 6750 Acked Write 8 Done Sent Done false
22243 6751 Acked Read 6 Done Sent Done false
22244 6752 Acked Read 5 Done Sent Done false
22245 6753 Acked Read 3 Done Sent Done false
22246 6754 Acked Write 8 Done Sent Done false
22247 6755 Acked Flush 0 Done Sent Done false
22248 6756 Acked Read 5 Done Sent Done false
22249 6757 Acked Read 7 Done Sent Done false
22250 6758 Acked Read 1 Done Sent Done false
22251 6759 Acked Write 6 Done Sent Done false
22252 6760 Acked Read 1 Done Sent Done false
22253 6761 Acked Write 4 Done Sent Done false
22254 6762 Acked Write 10 Done Sent Done false
22255 6763 Acked Flush 0 Done Sent Done false
22256 6764 Acked Write 5 Done Sent Done false
22257 6765 Acked Write 8 Done Sent Done false
22258 6766 Acked Write 6 Done Sent Done false
22259 6767 Acked Read 8 Done Sent Done false
22260 6768 Acked Read 10 Done Sent Done false
22261 6769 Acked Write 7 Done Sent Done false
22262 6770 Acked Read 7 Done Sent Done false
22263 6771 Acked Read 10 Done Sent Done false
22264 6772 Acked Read 3 Done Sent Done false
22265 6773 Acked Write 8 Done Sent Done false
22266 6774 Acked Flush 0 Done Sent Done false
22267 6775 Acked Read 4 Done Sent Done false
22268 6776 Acked Read 8 Done Sent Done false
22269 6777 Acked Read 3 Done Sent Done false
22270 6778 Acked Read 2 Done Sent Done false
22271 6779 Acked Read 1 Done Sent Done false
22272 6780 Acked Write 3 Done Sent Done false
22273 6781 Acked Read 8 Done Sent Done false
22274 6782 Acked Write 10 Done Sent Done false
22275 6783 Acked Read 6 Done Sent Done false
22276 6784 Acked Read 4 Done Sent Done false
22277 6785 Acked Write 1 Done Sent Done false
22278 6786 Acked Read 3 Done Sent Done false
22279 6787 Acked Write 1 Done Sent Done false
22280 6788 Acked Write 2 Done Sent Done false
22281 6789 Acked Read 3 Done Sent Done false
22282 6790 Acked Write 2 Done Sent Done false
22283 6791 Acked Write 5 Done Sent Done false
22284 6792 Acked Write 8 Done Sent Done false
22285 6793 Acked Write 9 Done Sent Done false
22286 6794 Acked Write 2 Done Sent Done false
22287 6795 Acked Read 1 Done Sent Done false
22288 6796 Acked Read 4 Done Sent Done false
22289 6797 Acked Read 3 Done Sent Done false
22290 6798 Acked Read 7 Done Sent Done false
22291 6799 Acked Read 5 Done Sent Done false
22292 6800 Acked Flush 0 Done Sent Done false
22293 6801 Acked Write 1 Done Sent Done false
22294 6802 Acked Read 2 Done Sent Done false
22295 6803 Acked Read 4 Done Sent Done false
22296 6804 Acked Read 10 Done Sent Done false
22297 6805 Acked Write 3 Done Sent Done false
22298 6806 Acked Write 5 Done Sent Done false
22299 6807 Acked Write 8 Done Sent Done false
22300 6808 Acked Write 7 Done Sent Done false
22301 6809 Acked Read 7 Done Sent Done false
22302 6810 Acked Read 2 Done Sent Done false
22303 6811 Acked Write 10 Done Sent Done false
22304 6812 Acked Read 9 Done Sent Done false
22305 6813 Acked Read 5 Done Sent Done false
22306 6814 Acked Read 10 Done Sent Done false
22307 6815 Acked Write 3 Done Sent Done false
22308 6816 Acked Write 4 Done Sent Done false
22309 6817 Acked Read 6 Done Sent Done false
22310 6818 Acked Write 9 Done Sent Done false
22311 6819 Acked Read 9 Done Sent Done false
22312 6820 Acked Read 2 Done Sent Done false
22313 6821 Acked Write 10 Done Sent Done false
22314 6822 Acked Write 8 Done Sent Done false
22315 6823 Acked Write 4 Done Sent Done false
22316 6824 Acked Write 8 Done Sent Done false
22317 6825 Acked Read 3 Done Sent Done false
22318 6826 Acked Write 4 Done Sent Done false
22319 6827 Acked Flush 0 Done Sent Done false
22320 6828 Acked Read 8 Done Sent Done false
22321 6829 Acked Read 6 Done Sent Done false
22322 6830 Acked Write 4 Done Sent Done false
22323 6831 Acked Write 10 Done Sent Done false
22324 6832 Acked Write 10 Done Sent Done false
22325 6833 Acked Read 10 Done Sent Done false
22326 6834 Acked Write 2 Done Sent Done false
22327 6835 Acked Read 7 Done Sent Done false
22328 6836 Acked Write 6 Done Sent Done false
22329 6837 Acked Write 1 Done Sent Done false
22330 6838 Acked Write 4 Done Sent Done false
22331 6839 Acked Read 1 Done Sent Done false
22332 6840 Acked Read 3 Done Sent Done false
22333 6841 Acked Flush 0 Done Sent Done false
22334 6842 Acked Read 9 Done Sent Done false
22335 6843 Acked Write 4 Done Sent Done false
22336 6844 Acked Read 2 Done Sent Done false
22337 6845 Acked Read 8 Done Sent Done false
22338 6846 Acked Write 8 Done Sent Done false
22339 6847 Acked Read 4 Done Sent Done false
22340 6848 Acked Write 4 Done Sent Done false
22341 6849 Acked Read 2 Done Sent Done false
22342 6850 Acked Write 10 Done Sent Done false
22343 6851 Acked Read 9 Done Sent Done false
22344 6852 Acked Read 7 Done Sent Done false
22345 6853 Acked Flush 0 Done Sent Done false
22346 6854 Acked Read 8 Done Sent Done false
22347 6855 Acked Read 6 Done Sent Done false
22348 6856 Acked Read 4 Done Sent Done false
22349 6857 Acked Read 10 Done Sent Done false
22350 6858 Acked Read 4 Done Sent Done false
22351 6859 Acked Flush 0 Done Sent Done false
22352 6860 Acked Read 3 Done Sent Done false
22353 6861 Acked Write 1 Done Sent Done false
22354 6862 Acked Flush 0 Done Sent Done false
22355 6863 Acked Flush 0 Done Sent Done false
22356 6864 Acked Write 2 Done Sent Done false
22357 6865 Acked Flush 0 Done Sent Done false
22358 6866 Acked Read 3 Done Sent Done false
22359 6867 Acked Write 2 Done Sent Done false
22360 6868 Acked Write 5 Done Sent Done false
22361 6869 Acked Read 5 Done Sent Done false
22362 6870 Acked Read 10 Done Sent Done false
22363 6871 Acked Read 10 Done Sent Done false
22364 6872 Acked Read 9 Done Sent Done false
22365 6873 Acked Read 3 Done Sent Done false
22366 6874 Acked Write 6 Done Sent Done false
22367 6875 Acked Write 1 Done Sent Done false
22368 6876 Acked Write 1 Done Sent Done false
22369 6877 Acked Write 2 Done Sent Done false
22370 6878 Acked Read 4 Done Sent Done false
22371 6879 Acked Flush 0 Done Sent Done false
22372 6880 Acked Read 6 Done Sent Done false
22373 6881 Acked Write 6 Done Sent Done false
22374 6882 Acked Write 7 Done Sent Done false
22375 6883 Acked Read 8 Done Sent Done false
22376 6884 Acked Read 2 Done Sent Done false
22377 6885 Acked Flush 0 Done Sent Done false
22378 6886 Acked Read 4 Done Sent Done false
22379 6887 Acked Flush 0 Done Sent Done false
22380 6888 Acked Read 9 Done Sent Done false
22381 6889 Acked Write 8 Done Sent Done false
22382 6890 Acked Read 7 Done Sent Done false
22383 6891 Acked Read 10 Done Sent Done false
22384 6892 Acked Read 1 Done Sent Done false
22385 6893 Acked Read 3 Done Sent Done false
22386 6894 Acked Write 5 Done Sent Done false
22387 6895 Acked Read 4 Done Sent Done false
22388 6896 Acked Read 6 Done Sent Done false
22389 6897 Acked Read 2 Done Sent Done false
22390 6898 Acked Write 1 Done Sent Done false
22391 6899 Acked Read 8 Done Sent Done false
22392 6900 Acked Write 8 Done Sent Done false
22393 6901 Acked Flush 0 Done Sent Done false
22394 6902 Acked Write 7 Done Sent Done false
22395 6903 Acked Read 10 Done Sent Done false
22396 6904 Acked Write 9 Done Sent Done false
22397 6905 Acked Write 8 Done Sent Done false
22398 6906 Acked Read 4 Done Sent Done false
22399 6907 Acked Read 4 Done Sent Done false
22400 6908 Acked Read 10 Done Sent Done false
22401 6909 Acked Read 5 Done Sent Done false
22402 6910 Acked Read 1 Done Sent Done false
22403 6911 Acked Write 2 Done Sent Done false
22404 6912 Acked Read 2 Done Sent Done false
22405 6913 Acked Read 2 Done Sent Done false
22406 6914 Acked Read 1 Done Sent Done false
22407 6915 Acked Write 2 Done Sent Done false
22408 6916 Acked Write 8 Done Sent Done false
22409 6917 Acked Read 10 Done Sent Done false
22410 6918 Acked Read 6 Done Sent Done false
22411 6919 Acked Read 8 Done Sent Done false
22412 6920 Acked Read 9 Done Sent Done false
22413 6921 Acked Write 6 Done Sent Done false
22414 6922 Acked Read 4 Done Sent Done false
22415 6923 Acked Flush 0 Done Sent Done false
22416 6924 Acked Read 3 Done Sent Done false
22417 6925 Acked Write 1 Done Sent Done false
22418 6926 Acked Read 7 Done Sent Done false
22419 6927 Acked Read 2 Done Sent Done false
22420 6928 Acked Read 9 Done Sent Done false
22421 6929 Acked Flush 0 Done Sent Done false
22422 6930 Acked Read 8 Done Sent Done false
22423 6931 Acked Read 1 Done Sent Done false
22424 6932 Acked Write 4 Done Sent Done false
22425 6933 Acked Write 7 Done Sent Done false
22426 6934 Acked Write 3 Done Sent Done false
22427 6935 Acked Read 3 Done Sent Done false
22428 6936 Acked Read 6 Done Sent Done false
22429 6937 Acked Read 10 Done Sent Done false
22430 6938 Acked Read 7 Done Sent Done false
22431 6939 Acked Write 2 Done Sent Done false
22432 6940 Acked Write 4 Done Sent Done false
22433 6941 Acked Write 8 Done Sent Done false
22434 6942 Acked Write 5 Done Sent Done false
22435 6943 Acked Write 6 Done Sent Done false
22436 6944 Acked Write 4 Done Sent Done false
22437 6945 Acked Write 7 Done Sent Done false
22438 6946 Acked Flush 0 Done Sent Done false
22439 6947 Acked Flush 0 Done Sent Done false
22440 6948 Acked Write 6 Done Sent Done false
22441 6949 Acked Write 2 Done Sent Done false
22442 6950 Acked Read 6 Done Sent Done false
22443 6951 Acked Read 2 Done Sent Done false
22444 6952 Acked Write 9 Done Sent Done false
22445 6953 Acked Flush 0 Done Sent Done false
22446 6954 Acked Write 2 Done Sent Done false
22447 6955 Acked Write 7 Done Sent Done false
22448 6956 Acked Read 9 Done Sent Done false
22449 6957 Acked Read 4 Done Sent Done false
22450 6958 Acked Flush 0 Done Sent Done false
22451 6959 Acked Read 2 Done Sent Done false
22452 6960 Acked Flush 0 Done Sent Done false
22453 6961 Acked Read 3 Done Sent Done false
22454 6962 Acked Write 3 Done Sent Done false
22455 6963 Acked Read 4 Done Sent Done false
22456 6964 Acked Write 10 Done Sent Done false
22457 6965 Acked Read 8 Done Sent Done false
22458 6966 Acked Read 4 Done Sent Done false
22459 6967 Acked Read 1 Done Sent Done false
22460 6968 Acked Read 3 Done Sent Done false
22461 6969 Acked Write 2 Done Sent Done false
22462 6970 Acked Read 8 Done Sent Done false
22463 6971 Acked Read 10 Done Sent Done false
22464 6972 Acked Read 2 Done Sent Done false
22465 6973 Acked Read 1 Done Sent Done false
22466 6974 Acked Flush 0 Done Sent Done false
22467 6975 Acked Flush 0 Done Sent Done false
22468 6976 Acked Read 1 Done Sent Done false
22469 6977 Acked Read 1 Done Sent Done false
22470 6978 Acked Write 5 Done Sent Done false
22471 6979 Acked Read 4 Done Sent Done false
22472 6980 Acked Write 6 Done Sent Done false
22473 6981 Acked Read 6 Done Sent Done false
22474 6982 Acked Read 3 Done Sent Done false
22475 6983 Acked Flush 0 Done Sent Done false
22476 6984 Acked Write 10 Done Sent Done false
22477 6985 Acked Write 5 Done Sent Done false
22478 6986 Acked Read 2 Done Sent Done false
22479 6987 Acked Read 4 Done Sent Done false
22480 6988 Acked Write 2 Done Sent Done false
22481 6989 Acked Write 7 Done Sent Done false
22482 6990 Acked Read 7 Done Sent Done false
22483 6991 Acked Write 1 Done Sent Done false
22484 6992 Acked Read 9 Done Sent Done false
22485 6993 Acked Write 10 Done Sent Done false
22486 6994 Acked Read 8 Done Sent Done false
22487 6995 Acked Read 7 Done Sent Done false
22488 6996 Acked Read 1 Done Sent Done false
22489 6997 Acked Write 4 Done Sent Done false
22490 6998 Acked Read 10 Done Sent Done false
22491 6999 Acked Write 8 Done Sent Done false
22492 7000 Acked Read 6 Done Sent Done false
22493 7001 Acked Read 9 Done Sent Done false
22494 7002 Acked Read 10 Done Sent Done false
22495 7003 Acked Write 2 Done Sent Done false
22496 7004 Acked Write 6 Done Sent Done false
22497 7005 Acked Read 3 Done Sent Done false
22498 7006 Acked Read 9 Done Sent Done false
22499 7007 Acked Write 10 Done Sent Done false
22500 7008 Acked Flush 0 Done Sent Done false
22501 7009 Acked Flush 0 Done Sent Done false
22502 7010 Acked Write 4 Done Sent Done false
22503 7011 Acked Read 3 Done Sent Done false
22504 7012 Acked Flush 0 Done Sent Done false
22505 7013 Acked Read 3 Done Sent Done false
22506 7014 Acked Read 6 Done Sent Done false
22507 7015 Acked Read 9 Done Sent Done false
22508 7016 Acked Write 8 Done Sent Done false
22509 7017 Acked Flush 0 Done Sent Done false
22510 7018 Acked Read 8 Done Sent Done false
22511 7019 Acked Read 1 Done Sent Done false
22512 7020 Acked Write 5 Done Sent Done false
22513 7021 Acked Write 6 Done Sent Done false
22514 7022 Acked Read 5 Done Sent Done false
22515 7023 Acked Read 10 Done Sent Done false
22516 7024 Acked Write 4 Done Sent Done false
22517 7025 Acked Write 2 Done Sent Done false
22518 7026 Acked Read 2 Done Sent Done false
22519 7027 Acked Write 6 Done Sent Done false
22520 7028 Acked Write 8 Done Sent Done false
22521 7029 Acked Read 2 Done Sent Done false
22522 7030 Acked Read 9 Done Sent Done false
22523 7031 Acked Write 9 Done Sent Done false
22524 7032 Acked Read 6 Done Sent Done false
22525 7033 Acked Write 3 Done Sent Done false
22526 7034 Acked Read 8 Done Sent Done false
22527 7035 Acked Write 5 Done Sent Done false
22528 STATES DS:0 DS:1 DS:2 TOTAL
22529 Sent 0 301 0 301
22530 Done 301 0 301 602
22531 Skipped 0 0 0 0
22532 Error 0 0 0 0
22533 Last Flush: 7017 6734 7017
22534 Downstairs last five completed: 6734 6733 6732 6731 6730
22535 Upstairs last five completed: 7035 7034 7033 7032 7031
22536 CLIENT: Up:0 ds:301 act:2
22537 [8820] got start action
22538 [8820] I am going to restart
22539 Starting downstairs at port 8820
22540 Make output file at "/tmp/dsc/downstairs-8820.txt"
22541 [8820][1] reports Starting
22542 Downstairs /var/tmp/dsc/region/8820 port 8820 PID:Some(1222)
22543 [8820][1] reports Running
22544 ----------------------------------------------------------------
22545 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:302
22546 States: Active Offline Active
22547 JOBID ACK TYPE BKS/EXT DS:0 DS:1 DS:2 REPLAY
22548 6735 Acked Read 7 Done Sent Done false
22549 6736 Acked Read 4 Done Sent Done false
22550 6737 Acked Write 2 Done Sent Done false
22551 6738 Acked Write 3 Done Sent Done false
22552 6739 Acked Flush 0 Done Sent Done false
22553 6740 Acked Read 6 Done Sent Done false
22554 6741 Acked Flush 0 Done Sent Done false
22555 6742 Acked Read 7 Done Sent Done false
22556 6743 Acked Read 8 Done Sent Done false
22557 6744 Acked Write 10 Done Sent Done false
22558 6745 Acked Read 2 Done Sent Done false
22559 6746 Acked Read 5 Done Sent Done false
22560 6747 Acked Write 6 Done Sent Done false
22561 6748 Acked Read 8 Done Sent Done false
22562 6749 Acked Read 9 Done Sent Done false
22563 6750 Acked Write 8 Done Sent Done false
22564 6751 Acked Read 6 Done Sent Done false
22565 6752 Acked Read 5 Done Sent Done false
22566 6753 Acked Read 3 Done Sent Done false
22567 6754 Acked Write 8 Done Sent Done false
22568 6755 Acked Flush 0 Done Sent Done false
22569 6756 Acked Read 5 Done Sent Done false
22570 6757 Acked Read 7 Done Sent Done false
22571 6758 Acked Read 1 Done Sent Done false
22572 6759 Acked Write 6 Done Sent Done false
22573 6760 Acked Read 1 Done Sent Done false
22574 6761 Acked Write 4 Done Sent Done false
22575 6762 Acked Write 10 Done Sent Done false
22576 6763 Acked Flush 0 Done Sent Done false
22577 6764 Acked Write 5 Done Sent Done false
22578 6765 Acked Write 8 Done Sent Done false
22579 6766 Acked Write 6 Done Sent Done false
22580 6767 Acked Read 8 Done Sent Done false
22581 6768 Acked Read 10 Done Sent Done false
22582 6769 Acked Write 7 Done Sent Done false
22583 6770 Acked Read 7 Done Sent Done false
22584 6771 Acked Read 10 Done Sent Done false
22585 6772 Acked Read 3 Done Sent Done false
22586 6773 Acked Write 8 Done Sent Done false
22587 6774 Acked Flush 0 Done Sent Done false
22588 6775 Acked Read 4 Done Sent Done false
22589 6776 Acked Read 8 Done Sent Done false
22590 6777 Acked Read 3 Done Sent Done false
22591 6778 Acked Read 2 Done Sent Done false
22592 6779 Acked Read 1 Done Sent Done false
22593 6780 Acked Write 3 Done Sent Done false
22594 6781 Acked Read 8 Done Sent Done false
22595 6782 Acked Write 10 Done Sent Done false
22596 6783 Acked Read 6 Done Sent Done false
22597 6784 Acked Read 4 Done Sent Done false
22598 6785 Acked Write 1 Done Sent Done false
22599 6786 Acked Read 3 Done Sent Done false
22600 6787 Acked Write 1 Done Sent Done false
22601 6788 Acked Write 2 Done Sent Done false
22602 6789 Acked Read 3 Done Sent Done false
22603 6790 Acked Write 2 Done Sent Done false
22604 6791 Acked Write 5 Done Sent Done false
22605 6792 Acked Write 8 Done Sent Done false
22606 6793 Acked Write 9 Done Sent Done false
22607 6794 Acked Write 2 Done Sent Done false
22608 6795 Acked Read 1 Done Sent Done false
22609 6796 Acked Read 4 Done Sent Done false
22610 6797 Acked Read 3 Done Sent Done false
22611 6798 Acked Read 7 Done Sent Done false
22612 6799 Acked Read 5 Done Sent Done false
22613 6800 Acked Flush 0 Done Sent Done false
22614 6801 Acked Write 1 Done Sent Done false
22615 6802 Acked Read 2 Done Sent Done false
22616 6803 Acked Read 4 Done Sent Done false
22617 6804 Acked Read 10 Done Sent Done false
22618 6805 Acked Write 3 Done Sent Done false
22619 6806 Acked Write 5 Done Sent Done false
22620 6807 Acked Write 8 Done Sent Done false
22621 6808 Acked Write 7 Done Sent Done false
22622 6809 Acked Read 7 Done Sent Done false
22623 6810 Acked Read 2 Done Sent Done false
22624 6811 Acked Write 10 Done Sent Done false
22625 6812 Acked Read 9 Done Sent Done false
22626 6813 Acked Read 5 Done Sent Done false
22627 6814 Acked Read 10 Done Sent Done false
22628 6815 Acked Write 3 Done Sent Done false
22629 6816 Acked Write 4 Done Sent Done false
22630 6817 Acked Read 6 Done Sent Done false
22631 6818 Acked Write 9 Done Sent Done false
22632 6819 Acked Read 9 Done Sent Done false
22633 6820 Acked Read 2 Done Sent Done false
22634 6821 Acked Write 10 Done Sent Done false
22635 6822 Acked Write 8 Done Sent Done false
22636 6823 Acked Write 4 Done Sent Done false
22637 6824 Acked Write 8 Done Sent Done false
22638 6825 Acked Read 3 Done Sent Done false
22639 6826 Acked Write 4 Done Sent Done false
22640 6827 Acked Flush 0 Done Sent Done false
22641 6828 Acked Read 8 Done Sent Done false
22642 6829 Acked Read 6 Done Sent Done false
22643 6830 Acked Write 4 Done Sent Done false
22644 6831 Acked Write 10 Done Sent Done false
22645 6832 Acked Write 10 Done Sent Done false
22646 6833 Acked Read 10 Done Sent Done false
22647 6834 Acked Write 2 Done Sent Done false
22648 6835 Acked Read 7 Done Sent Done false
22649 6836 Acked Write 6 Done Sent Done false
22650 6837 Acked Write 1 Done Sent Done false
22651 6838 Acked Write 4 Done Sent Done false
22652 6839 Acked Read 1 Done Sent Done false
22653 6840 Acked Read 3 Done Sent Done false
22654 6841 Acked Flush 0 Done Sent Done false
22655 6842 Acked Read 9 Done Sent Done false
22656 6843 Acked Write 4 Done Sent Done false
22657 6844 Acked Read 2 Done Sent Done false
22658 6845 Acked Read 8 Done Sent Done false
22659 6846 Acked Write 8 Done Sent Done false
22660 6847 Acked Read 4 Done Sent Done false
22661 6848 Acked Write 4 Done Sent Done false
22662 6849 Acked Read 2 Done Sent Done false
22663 6850 Acked Write 10 Done Sent Done false
22664 6851 Acked Read 9 Done Sent Done false
22665 6852 Acked Read 7 Done Sent Done false
22666 6853 Acked Flush 0 Done Sent Done false
22667 6854 Acked Read 8 Done Sent Done false
22668 6855 Acked Read 6 Done Sent Done false
22669 6856 Acked Read 4 Done Sent Done false
22670 6857 Acked Read 10 Done Sent Done false
22671 6858 Acked Read 4 Done Sent Done false
22672 6859 Acked Flush 0 Done Sent Done false
22673 6860 Acked Read 3 Done Sent Done false
22674 6861 Acked Write 1 Done Sent Done false
22675 6862 Acked Flush 0 Done Sent Done false
22676 6863 Acked Flush 0 Done Sent Done false
22677 6864 Acked Write 2 Done Sent Done false
22678 6865 Acked Flush 0 Done Sent Done false
22679 6866 Acked Read 3 Done Sent Done false
22680 6867 Acked Write 2 Done Sent Done false
22681 6868 Acked Write 5 Done Sent Done false
22682 6869 Acked Read 5 Done Sent Done false
22683 6870 Acked Read 10 Done Sent Done false
22684 6871 Acked Read 10 Done Sent Done false
22685 6872 Acked Read 9 Done Sent Done false
22686 6873 Acked Read 3 Done Sent Done false
22687 6874 Acked Write 6 Done Sent Done false
22688 6875 Acked Write 1 Done Sent Done false
22689 6876 Acked Write 1 Done Sent Done false
22690 6877 Acked Write 2 Done Sent Done false
22691 6878 Acked Read 4 Done Sent Done false
22692 6879 Acked Flush 0 Done Sent Done false
22693 6880 Acked Read 6 Done Sent Done false
22694 6881 Acked Write 6 Done Sent Done false
22695 6882 Acked Write 7 Done Sent Done false
22696 6883 Acked Read 8 Done Sent Done false
22697 6884 Acked Read 2 Done Sent Done false
22698 6885 Acked Flush 0 Done Sent Done false
22699 6886 Acked Read 4 Done Sent Done false
22700 6887 Acked Flush 0 Done Sent Done false
22701 6888 Acked Read 9 Done Sent Done false
22702 6889 Acked Write 8 Done Sent Done false
22703 6890 Acked Read 7 Done Sent Done false
22704 6891 Acked Read 10 Done Sent Done false
22705 6892 Acked Read 1 Done Sent Done false
22706 6893 Acked Read 3 Done Sent Done false
22707 6894 Acked Write 5 Done Sent Done false
22708 6895 Acked Read 4 Done Sent Done false
22709 6896 Acked Read 6 Done Sent Done false
22710 6897 Acked Read 2 Done Sent Done false
22711 6898 Acked Write 1 Done Sent Done false
22712 6899 Acked Read 8 Done Sent Done false
22713 6900 Acked Write 8 Done Sent Done false
22714 6901 Acked Flush 0 Done Sent Done false
22715 6902 Acked Write 7 Done Sent Done false
22716 6903 Acked Read 10 Done Sent Done false
22717 6904 Acked Write 9 Done Sent Done false
22718 6905 Acked Write 8 Done Sent Done false
22719 6906 Acked Read 4 Done Sent Done false
22720 6907 Acked Read 4 Done Sent Done false
22721 6908 Acked Read 10 Done Sent Done false
22722 6909 Acked Read 5 Done Sent Done false
22723 6910 Acked Read 1 Done Sent Done false
22724 6911 Acked Write 2 Done Sent Done false
22725 6912 Acked Read 2 Done Sent Done false
22726 6913 Acked Read 2 Done Sent Done false
22727 6914 Acked Read 1 Done Sent Done false
22728 6915 Acked Write 2 Done Sent Done false
22729 6916 Acked Write 8 Done Sent Done false
22730 6917 Acked Read 10 Done Sent Done false
22731 6918 Acked Read 6 Done Sent Done false
22732 6919 Acked Read 8 Done Sent Done false
22733 6920 Acked Read 9 Done Sent Done false
22734 6921 Acked Write 6 Done Sent Done false
22735 6922 Acked Read 4 Done Sent Done false
22736 6923 Acked Flush 0 Done Sent Done false
22737 6924 Acked Read 3 Done Sent Done false
22738 6925 Acked Write 1 Done Sent Done false
22739 6926 Acked Read 7 Done Sent Done false
22740 6927 Acked Read 2 Done Sent Done false
22741 6928 Acked Read 9 Done Sent Done false
22742 6929 Acked Flush 0 Done Sent Done false
22743 6930 Acked Read 8 Done Sent Done false
22744 6931 Acked Read 1 Done Sent Done false
22745 6932 Acked Write 4 Done Sent Done false
22746 6933 Acked Write 7 Done Sent Done false
22747 6934 Acked Write 3 Done Sent Done false
22748 6935 Acked Read 3 Done Sent Done false
22749 6936 Acked Read 6 Done Sent Done false
22750 6937 Acked Read 10 Done Sent Done false
22751 6938 Acked Read 7 Done Sent Done false
22752 6939 Acked Write 2 Done Sent Done false
22753 6940 Acked Write 4 Done Sent Done false
22754 6941 Acked Write 8 Done Sent Done false
22755 6942 Acked Write 5 Done Sent Done false
22756 6943 Acked Write 6 Done Sent Done false
22757 6944 Acked Write 4 Done Sent Done false
22758 6945 Acked Write 7 Done Sent Done false
22759 6946 Acked Flush 0 Done Sent Done false
22760 6947 Acked Flush 0 Done Sent Done false
22761 6948 Acked Write 6 Done Sent Done false
22762 6949 Acked Write 2 Done Sent Done false
22763 6950 Acked Read 6 Done Sent Done false
22764 6951 Acked Read 2 Done Sent Done false
22765 6952 Acked Write 9 Done Sent Done false
22766 6953 Acked Flush 0 Done Sent Done false
22767 6954 Acked Write 2 Done Sent Done false
22768 6955 Acked Write 7 Done Sent Done false
22769 6956 Acked Read 9 Done Sent Done false
22770 6957 Acked Read 4 Done Sent Done false
22771 6958 Acked Flush 0 Done Sent Done false
22772 6959 Acked Read 2 Done Sent Done false
22773 6960 Acked Flush 0 Done Sent Done false
22774 6961 Acked Read 3 Done Sent Done false
22775 6962 Acked Write 3 Done Sent Done false
22776 6963 Acked Read 4 Done Sent Done false
22777 6964 Acked Write 10 Done Sent Done false
22778 6965 Acked Read 8 Done Sent Done false
22779 6966 Acked Read 4 Done Sent Done false
22780 6967 Acked Read 1 Done Sent Done false
22781 6968 Acked Read 3 Done Sent Done false
22782 6969 Acked Write 2 Done Sent Done false
22783 6970 Acked Read 8 Done Sent Done false
22784 6971 Acked Read 10 Done Sent Done false
22785 6972 Acked Read 2 Done Sent Done false
22786 6973 Acked Read 1 Done Sent Done false
22787 6974 Acked Flush 0 Done Sent Done false
22788 6975 Acked Flush 0 Done Sent Done false
22789 6976 Acked Read 1 Done Sent Done false
22790 6977 Acked Read 1 Done Sent Done false
22791 6978 Acked Write 5 Done Sent Done false
22792 6979 Acked Read 4 Done Sent Done false
22793 6980 Acked Write 6 Done Sent Done false
22794 6981 Acked Read 6 Done Sent Done false
22795 6982 Acked Read 3 Done Sent Done false
22796 6983 Acked Flush 0 Done Sent Done false
22797 6984 Acked Write 10 Done Sent Done false
22798 6985 Acked Write 5 Done Sent Done false
22799 6986 Acked Read 2 Done Sent Done false
22800 6987 Acked Read 4 Done Sent Done false
22801 6988 Acked Write 2 Done Sent Done false
22802 6989 Acked Write 7 Done Sent Done false
22803 6990 Acked Read 7 Done Sent Done false
22804 6991 Acked Write 1 Done Sent Done false
22805 6992 Acked Read 9 Done Sent Done false
22806 6993 Acked Write 10 Done Sent Done false
22807 6994 Acked Read 8 Done Sent Done false
22808 6995 Acked Read 7 Done Sent Done false
22809 6996 Acked Read 1 Done Sent Done false
22810 6997 Acked Write 4 Done Sent Done false
22811 6998 Acked Read 10 Done Sent Done false
22812 6999 Acked Write 8 Done Sent Done false
22813 7000 Acked Read 6 Done Sent Done false
22814 7001 Acked Read 9 Done Sent Done false
22815 7002 Acked Read 10 Done Sent Done false
22816 7003 Acked Write 2 Done Sent Done false
22817 7004 Acked Write 6 Done Sent Done false
22818 7005 Acked Read 3 Done Sent Done false
22819 7006 Acked Read 9 Done Sent Done false
22820 7007 Acked Write 10 Done Sent Done false
22821 7008 Acked Flush 0 Done Sent Done false
22822 7009 Acked Flush 0 Done Sent Done false
22823 7010 Acked Write 4 Done Sent Done false
22824 7011 Acked Read 3 Done Sent Done false
22825 7012 Acked Flush 0 Done Sent Done false
22826 7013 Acked Read 3 Done Sent Done false
22827 7014 Acked Read 6 Done Sent Done false
22828 7015 Acked Read 9 Done Sent Done false
22829 7016 Acked Write 8 Done Sent Done false
22830 7017 Acked Flush 0 Done Sent Done false
22831 7018 Acked Read 8 Done Sent Done false
22832 7019 Acked Read 1 Done Sent Done false
22833 7020 Acked Write 5 Done Sent Done false
22834 7021 Acked Write 6 Done Sent Done false
22835 7022 Acked Read 5 Done Sent Done false
22836 7023 Acked Read 10 Done Sent Done false
22837 7024 Acked Write 4 Done Sent Done false
22838 7025 Acked Write 2 Done Sent Done false
22839 7026 Acked Read 2 Done Sent Done false
22840 7027 Acked Write 6 Done Sent Done false
22841 7028 Acked Write 8 Done Sent Done false
22842 7029 Acked Read 2 Done Sent Done false
22843 7030 Acked Read 9 Done Sent Done false
22844 7031 Acked Write 9 Done Sent Done false
22845 7032 Acked Read 6 Done Sent Done false
22846 7033 Acked Write 3 Done Sent Done false
22847 7034 Acked Read 8 Done Sent Done false
22848 7035 Acked Write 5 Done Sent Done false
22849 7036 Acked Flush 0 Done Sent Done false
22850 STATES DS:0 DS:1 DS:2 TOTAL
22851 Sent 0 302 0 302
22852 Done 302 0 302 604
22853 Skipped 0 0 0 0
22854 Error 0 0 0 0
22855 Last Flush: 7036 6734 7036
22856 Downstairs last five completed: 6734 6733 6732 6731 6730
22857 Upstairs last five completed: 7036 7035 7034 7033 7032
22858 CLIENT: Up:0 ds:302 act:2
228592025-01-10T16:40:06.418ZINFOcrucible: connecting to 127.0.0.1:8820 = io task client = 1 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
228602025-01-10T16:40:06.418ZINFOcrucible: ds_connection connected from Ok(127.0.0.1:58690) = io task client = 1 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
228612025-01-10T16:40:06.419ZWARNcrucible: version negotiation from state Offline = downstairs client = 1 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
228622025-01-10T16:40:06.419ZINFOcrucible: downstairs client at Some(127.0.0.1:8820) has region UUID 12345678-0000-0000-0000-000000008820 = downstairs client = 1 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
228632025-01-10T16:40:06.419ZINFOcrucible: Returning UUID:12345678-0000-0000-0000-000000008820 matches = downstairs client = 1 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
228642025-01-10T16:40:06.419ZINFOcrucible: send last flush ID to this DS: 6734 = downstairs client = 1 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
228652025-01-10T16:40:06.419ZINFOcrucible: Replied this last flush ID: 6734 = downstairs client = 1 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
228662025-01-10T16:40:06.419ZINFOcrucible: ds_transition from Offline to Active = downstairs client = 1 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
228672025-01-10T16:40:06.419ZINFOcrucible: [1] Transition from Offline to Active = downstairs client = 1 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
228682025-01-10T16:40:06.420ZINFOcrucible: [1] client re-new 302 jobs since flush 6734 = downstairs session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
228692025-01-10T16:40:06.420ZINFOcrucible: [1] Replayed 302 jobs since flush: 6734 = downstairs session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
22870 ----------------------------------------------------------------
22871 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:0
22872 Downstairs last five completed: 7036 7035 7034 7033 7032
22873 Upstairs last five completed: 7036 7035 7034 7033 7032
22874 CLIENT: Up:0 ds:0 act:3
22875 Replay: All jobs finished
22876 Main task has work to do, go find it
22877 got dsc Stop(0)
22878 stop 0
22879 Jan 10 16:40:08.664[8810] Got stop action so:false kr:false
22880 INFO request completed, latency_us: 357, response_code: 204, uri: /stop/cid/0, method: POST, req_id: 6846e734-7832-4226-9b4f-b0538a165550, remote_addr: 127.0.0.1:55917, local_addr: 127.0.0.1:9998
228812025-01-10T16:40:08.665ZWARNcrucible: downstairs disconnected = io task client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
228822025-01-10T16:40:08.665ZWARNcrucible: client task is sending Done(Finished) = io task client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
228832025-01-10T16:40:08.665ZWARNcrucible: downstairs task for 0 stopped due to Finished session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
22884 Jan 10 16:40:08.665 INFO request completed, latency_us: {"msg":"ds_transition from Active to Offline","v":0,"name":"crucible","level":30,"time":"2025-01-10T16:40:08.665209881Z","hostname":"w-01JH8H1N3KXZ9F8ZV6CCMP5KTQ","pid":1202,"client":"0","":"downstairs","session_id":"1df3ca91-4dc9-42d6-9897-461254b5afe2"}
22885 185, response_code: 200, uri: /state/cid/0, method: GET, req_id:{"msg":"[0] Transition from Active to Offline","v":0,"name":"crucible","level":30,"time":"2025-01-10T16:40:08.665231159Z","hostname":"w-01JH8H1N3KXZ9F8ZV6CCMP5KTQ","pid":1202,"client":"0","":"downstairs","session_id":"1df3ca91-4dc9-42d6-9897-461254b5afe2"}
22886 9799286b-8c44-419f-9aa0-7aed0d4e232e, remote_addr: 127.0.0.1:55917, local_addr: 127.0.0.1:9998
228872025-01-10T16:40:08.665ZINFOcrucible: client task is exiting = io task client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
22888 [8810] Exited with: ExitStatus(unix_wait_status(9))
22889 [8810][0] reports Exit
22890 Jan 10 16:40:12.667 INFO request completed, latency_us: 201, response_code: 200, uri: /state/cid/0, method: GET, req_id: af2c514b-e6e6-4b59-a0f0-8afc8c00c8c4, remote_addr: 127.0.0.1:55917, local_addr: 127.0.0.1:9998
22891 001/300 Read block 3634 len 20480
22892 002/300 Write block 2931 len 16384 data: 4 5 5 4
22893 003/300 Read block 3548 len 8192
22894 004/300 Write block 1565 len 36864 data: 4 3 2 2 2 2 3 3 5
22895 005/300 Write block 4561 len 16384 data: 7 5 4 5
22896 006/300 Write block 1444 len 4096 data: 3
22897 007/300 Write block 860 len 24576 data: 2 3 3 3 3 3
22898 008/300 Flush
22899 009/300 Read block 2641 len 32768
22900 010/300 Read block 924 len 4096
22901 011/300 Write block 1429 len 40960 data: 5 4 4 3 3 2 3 4 4 4
22902 012/300 Write block 3874 len 24576 data: 4 5 5 6 6 6
22903 013/300 Read block 4326 len 4096
22904 014/300 Write block 2659 len 4096 data: 4
22905 015/300 Read block 2354 len 8192
22906 016/300 Write block 1429 len 36864 data: 6 5 5 4 4 3 4 5 5
22907 017/300 Write block 3577 len 20480 data: 3 3 3 2 2
22908 018/300 Write block 897 len 4096 data: 5
22909 019/300 Read block 1586 len 28672
22910 020/300 Write block 1530 len 16384 data: 3 4 5 6
22911 021/300 Read block 2066 len 28672
22912 022/300 Write block 4559 len 16384 data: 4 5 8 6
22913 023/300 Write block 310 len 12288 data: 6 5 4
22914 024/300 Write block 551 len 12288 data: 6 4 4
22915 025/300 Flush
22916 026/300 Write block 3993 len 24576 data: 4 5 5 5 4 3
22917 027/300 Read block 3008 len 20480
22918 028/300 Write block 1952 len 12288 data: 3 4 4
22919 029/300 Read block 4061 len 12288
22920 030/300 Flush
22921 031/300 Read block 1272 len 4096
22922 032/300 Write block 1686 len 24576 data: 7 6 6 5 5 6
22923 033/300 Read block 4182 len 36864
22924 034/300 Flush
22925 035/300 Flush
22926 036/300 Read block 977 len 4096
22927 037/300 Write block 4362 len 20480 data: 8 7 6 4 4
22928 038/300 Write block 1010 len 36864 data: 4 4 5 4 4 4 5 6 4
22929 039/300 Read block 3546 len 20480
22930 040/300 Read block 2543 len 4096
22931 041/300 Write block 2146 len 36864 data: 5 5 4 7 6 7 7 6 7
22932 042/300 Read block 3319 len 4096
22933 043/300 Read block 469 len 16384
22934 044/300 Flush
22935 045/300 Read block 1710 len 16384
22936 046/300 Write block 577 len 24576 data: 3 3 4 4 4 6
22937 047/300 Write block 2107 len 32768 data: 2 2 2 2 3 3 4 5
22938 048/300 Read block 304 len 16384
22939 049/300 Write block 3125 len 40960 data: 4 4 4 4 5 6 7 5 6 6
22940 050/300 Write block 3930 len 32768 data: 3 3 4 4 4 4 4 5
22941 051/300 Read block 198 len 24576
22942 052/300 Read block 4091 len 32768
22943 053/300 Write block 203 len 16384 data: 4 2 3 3
22944 054/300 Write block 891 len 28672 data: 4 4 4 3 5 6 6
22945 055/300 Read block 681 len 16384
22946 056/300 Write block 1849 len 12288 data: 2 2 3
22947 057/300 Write block 4687 len 40960 data: 7 5 4 4 4 4 5 5 4 4
22948 058/300 Write block 3634 len 20480 data: 4 5 5 5 3
22949 059/300 Write block 427 len 36864 data: 3 3 4 5 5 5 4 4 4
22950 060/300 Flush
22951 061/300 Write block 4213 len 4096 data: 5
22952 062/300 Write block 1589 len 16384 data: 6 5 6 5
22953 063/300 Read block 1200 len 8192
22954 064/300 Flush
22955 065/300 Read block 4353 len 40960
22956 066/300 Read block 2841 len 8192
22957 067/300 Write block 627 len 20480 data: 6 5 5 5 7
22958 068/300 Write block 2538 len 36864 data: 2 3 3 3 3 4 3 3 2
22959 069/300 Write block 2709 len 20480 data: 3 3 2 2 2
22960 070/300 Write block 2236 len 40960 data: 3 3 3 5 4 4 5 6 6 6
22961 071/300 Read block 4446 len 28672
22962 072/300 Flush
22963 073/300 Write block 2387 len 40960 data: 7 7 7 5 4 5 5 5 7 8
22964 074/300 Flush
22965 075/300 Read block 4940 len 12288
22966 076/300 Read block 2643 len 12288
22967 077/300 Read block 4718 len 28672
22968 078/300 Write block 4290 len 32768 data: 2 2 2 4 4 6 5 5
22969 079/300 Flush
22970 080/300 Read block 389 len 20480
22971 081/300 Write block 488 len 4096 data: 6
22972 082/300 Read block 2165 len 4096
22973 083/300 Write block 3547 len 20480 data: 4 5 4 4 5
22974 084/300 Read block 2407 len 24576
22975 085/300 Read block 4356 len 40960
22976 086/300 Write block 143 len 28672 data: 5 4 4 4 3 3 4
22977 087/300 Read block 3817 len 36864
22978 088/300 Read block 212 len 40960
22979 089/300 Read block 4712 len 36864
22980 090/300 Read block 511 len 16384
22981 091/300 Read block 4548 len 4096
22982 092/300 Read block 916 len 16384
22983 093/300 Write block 3265 len 20480 data: 6 5 5 4 4
22984 094/300 Read block 4442 len 16384
22985 095/300 Read block 662 len 8192
22986 096/300 Read block 1444 len 40960
22987 097/300 Read block 104 len 4096
22988 098/300 Write block 3823 len 16384 data: 3 3 4 3
22989 099/300 Write block 888 len 28672 data: 2 4 4 5 5 5 4
22990 100/300 Write block 2842 len 32768 data: 4 3 3 4 4 4 4 5
22991 101/300 Write block 2572 len 12288 data: 3 3 3
22992 102/300 Write block 119 len 20480 data: 5 6 5 5 5
22993 103/300 Read block 3980 len 40960
22994 104/300 Flush
22995 105/300 Read block 1446 len 32768
22996 106/300 Write block 4816 len 24576 data: 4 4 5 5 5 5
22997 107/300 Write block 4664 len 8192 data: 3 3
22998 108/300 Write block 3842 len 28672 data: 6 5 5 5 6 5 5
22999 109/300 Read block 582 len 4096
23000 110/300 Read block 4770 len 20480
23001 111/300 Read block 310 len 36864
23002 112/300 Read block 2660 len 32768
23003 113/300 Write block 4209 len 40960 data: 6 5 5 5 6 5 5 4 5 4
23004 114/300 Read block 3501 len 28672
23005 115/300 Write block 1641 len 16384 data: 6 4 4 3
23006 116/300 Read block 944 len 8192
23007 117/300 Flush
23008 118/300 Write block 4245 len 32768 data: 4 4 6 5 5 6 6 5
23009 119/300 Read block 992 len 40960
23010 120/300 Read block 2990 len 24576
23011 121/300 Read block 4124 len 16384
23012 122/300 Read block 2343 len 20480
23013 123/300 Write block 450 len 40960 data: 7 6 7 6 5 4 4 4 4 4
23014 124/300 Read block 4808 len 20480
23015 125/300 Write block 3768 len 32768 data: 6 6 5 5 5 4 6 5
23016 126/300 Flush
23017 127/300 Read block 750 len 16384
23018 128/300 Read block 3156 len 16384
23019 129/300 Read block 1337 len 24576
23020 130/300 Read block 3654 len 32768
23021 131/300 Write block 14 len 36864 data: 6 6 7 6 6 6 5 5 4
23022 132/300 Read block 4362 len 20480
23023 133/300 Read block 950 len 28672
23024 134/300 Flush
23025 135/300 Read block 147 len 8192
23026 136/300 Read block 719 len 36864
23027 137/300 Write block 3994 len 36864 data: 6 6 6 5 4 3 3 3 3
23028 138/300 Write block 317 len 4096 data: 6
23029 139/300 Read block 1172 len 36864
23030 140/300 Flush
23031 141/300 Write block 264 len 28672 data: 5 4 5 5 5 5 6
23032 142/300 Write block 4656 len 12288 data: 3 3 4
23033 143/300 Read block 531 len 24576
23034 144/300 Read block 3340 len 4096
23035 145/300 Read block 120 len 24576
23036 146/300 Flush
23037 147/300 Read block 4708 len 32768
23038 148/300 Write block 908 len 12288 data: 3 6 5
23039 149/300 Write block 1160 len 28672 data: 7 6 6 7 6 6 6
23040 150/300 Read block 3767 len 28672
23041 151/300 Read block 2954 len 16384
23042 152/300 Write block 1723 len 36864 data: 6 6 5 5 6 5 5 6 5
23043 153/300 Read block 2845 len 36864
23044 154/300 Write block 4649 len 40960 data: 4 3 3 3 4 3 3 4 4 5
23045 155/300 Read block 3213 len 24576
23046 156/300 Read block 1994 len 16384
23047 157/300 Flush
23048 158/300 Read block 452 len 32768
23049 159/300 Read block 4108 len 40960
23050 160/300 Write block 450 len 24576 data: 8 7 8 7 6 5
23051 161/300 Read block 1637 len 28672
23052 162/300 Read block 4819 len 16384
23053 163/300 Write block 2496 len 4096 data: 4
23054 164/300 Write block 1960 len 8192 data: 2 3
23055 165/300 Write block 1531 len 28672 data: 5 6 7 5 4 4 4
23056 166/300 Write block 2871 len 12288 data: 5 6 6
23057 167/300 Read block 3401 len 32768
23058 168/300 Write block 1757 len 40960 data: 5 4 6 6 7 7 8 7 6 6
23059 169/300 Write block 884 len 32768 data: 7 6 5 3 3 5 5 6
23060 170/300 Write block 470 len 40960 data: 3 3 3 3 3 4 4 4 5 5
23061 171/300 Write block 2794 len 36864 data: 3 3 3 4 5 5 5 4 5
23062 172/300 Read block 1129 len 36864
23063 173/300 Write block 3610 len 4096 data: 4
23064 174/300 Read block 3993 len 16384
23065 175/300 Write block 2621 len 32768 data: 5 4 3 2 2 3 5 4
23066 176/300 Write block 4277 len 28672 data: 4 4 3 4 5 5 4
23067 177/300 Read block 3149 len 24576
23068 178/300 Read block 235 len 4096
23069 179/300 Read block 3774 len 20480
23070 180/300 Read block 4463 len 4096
23071 181/300 Write block 1090 len 32768 data: 4 5 4 4 4 4 5 7
23072 182/300 Read block 1429 len 16384
23073 183/300 Flush
23074 184/300 Read block 4337 len 12288
23075 185/300 Write block 3634 len 40960 data: 5 6 6 6 4 3 4 5 5 6
23076 186/300 Flush
23077 187/300 Write block 4617 len 20480 data: 3 3 3 4 5
23078 188/300 Write block 1255 len 32768 data: 2 2 2 3 3 4 5 4
23079 189/300 Read block 537 len 8192
23080 190/300 Flush
23081 191/300 Read block 3481 len 12288
23082 192/300 Write block 3321 len 4096 data: 6
23083 193/300 Read block 813 len 4096
23084 194/300 Flush
23085 195/300 Write block 4393 len 36864 data: 3 4 6 7 8 8 8 8 6
23086 196/300 Read block 2563 len 24576
23087 197/300 Read block 4840 len 40960
23088 198/300 Read block 988 len 28672
23089 199/300 Read block 1007 len 36864
23090 200/300 Read block 4583 len 40960
23091 201/300 Write block 2602 len 4096 data: 5
23092 202/300 Read block 4978 len 12288
23093 203/300 Read block 4421 len 8192
23094 204/300 Write block 2481 len 16384 data: 5 4 5 6
23095 205/300 Read block 1134 len 36864
23096 206/300 Write block 1377 len 4096 data: 4
23097 207/300 Write block 1105 len 16384 data: 4 4 5 5
23098 208/300 Flush
23099 209/300 Read block 1308 len 12288
23100 210/300 Read block 4189 len 4096
23101 211/300 Read block 1254 len 32768
23102 212/300 Write block 1967 len 24576 data: 3 3 4 4 4 4
23103 213/300 Write block 1008 len 28672 data: 4 4 5 5 6 5 5
23104 214/300 Write block 1790 len 32768 data: 4 5 4 4 5 5 5 4
23105 215/300 Write block 3565 len 16384 data: 4 3 4 5
23106 216/300 Read block 1257 len 4096
23107 217/300 Read block 2069 len 36864
23108 218/300 Read block 901 len 40960
23109 219/300 Read block 852 len 20480
23110 220/300 Write block 280 len 8192 data: 3 4
23111 221/300 Read block 3220 len 20480
23112 222/300 Read block 4400 len 40960
23113 223/300 Write block 2682 len 12288 data: 5 5 6
23114 224/300 Write block 2519 len 40960 data: 6 4 4 3 2 3 5 5 5 6
23115 225/300 Flush
23116 226/300 Write block 2911 len 12288 data: 4 4 4
23117 227/300 Read block 4387 len 16384
23118 228/300 Write block 2776 len 36864 data: 3 3 4 3 4 4 5 5 4
23119 229/300 Read block 3843 len 28672
23120 230/300 Write block 2021 len 8192 data: 4 5
23121 231/300 Write block 2833 len 4096 data: 5
23122 232/300 Read block 220 len 32768
23123 233/300 Write block 588 len 36864 data: 6 4 5 5 5 3 3 3 3
23124 234/300 Flush
23125 235/300 Read block 4339 len 20480
23126 236/300 Write block 4302 len 12288 data: 3 3 3
23127 237/300 Read block 2963 len 40960
23128 238/300 Write block 1368 len 36864 data: 5 4 4 2 3 3 3 4 4
23129 239/300 Read block 587 len 28672
23130 240/300 Write block 4284 len 8192 data: 3 2
23131 241/300 Read block 2074 len 8192
23132 242/300 Write block 1820 len 28672 data: 5 5 4 5 4 6 6
23133 243/300 Read block 3827 len 4096
23134 244/300 Write block 4078 len 36864 data: 5 3 4 5 5 5 7 5 4
23135 245/300 Read block 2801 len 40960
23136 246/300 Read block 977 len 40960
23137 247/300 Flush
23138 248/300 Write block 1890 len 32768 data: 4 4 5 4 3 4 4 2
23139 249/300 Read block 9 len 32768
23140 250/300 Read block 3050 len 40960
23141 251/300 Write block 3101 len 16384 data: 5 4 4 4
23142 252/300 Read block 4917 len 12288
23143 253/300 Write block 1780 len 4096 data: 8
23144 254/300 Flush
23145 255/300 Write block 2079 len 12288 data: 3 4 4
23146 256/300 Write block 4589 len 20480 data: 2 3 3 3 3
23147 257/300 Read block 4698 len 12288
23148 258/300 Flush
23149 259/300 Read block 1039 len 36864
23150 260/300 Write block 3402 len 32768 data: 5 6 6 5 5 5 5 6
23151 261/300 Read block 3226 len 8192
23152 262/300 Write block 3104 len 32768 data: 5 4 5 4 3 4 4 3
23153 263/300 Write block 101 len 8192 data: 3 4
23154 264/300 Flush
23155 265/300 Read block 181 len 20480
23156 266/300 Read block 476 len 8192
23157 267/300 Write block 2296 len 16384 data: 4 4 3 3
23158 268/300 Write block 3296 len 28672 data: 2 2 2 2 3 4 4
23159 269/300 Read block 4975 len 4096
23160 270/300 Flush
23161 271/300 Write block 3126 len 40960 data: 5 5 5 6 7 8 6 7 7 5
23162 272/300 Write block 4748 len 36864 data: 3 3 3 3 4 5 4 4 4
23163 273/300 Flush
23164 274/300 Write block 4124 len 12288 data: 5 5 5
23165 275/300 Write block 1888 len 24576 data: 5 4 5 5 6 5
23166 276/300 Read block 2554 len 16384
23167 277/300 Write block 1734 len 28672 data: 4 4 3 5 5 4 4
23168 278/300 Write block 1180 len 40960 data: 6 6 6 6 6 8 7 6 6 5
23169 279/300 Read block 846 len 24576
23170 280/300 Read block 4026 len 28672
23171 281/300 Write block 572 len 20480 data: 3 3 4 4 4
23172 282/300 Write block 853 len 20480 data: 4 3 2 2 2
23173 283/300 Flush
23174 284/300 Read block 4631 len 32768
23175 285/300 Read block 1498 len 12288
23176 286/300 Write block 842 len 32768 data: 7 8 8 8 6 4 4 5
23177 287/300 Flush
23178 288/300 Read block 4632 len 40960
23179 289/300 Write block 2259 len 36864 data: 4 4 4 4 4 5 5 5 5
23180 290/300 Read block 3955 len 4096
23181 291/300 Read block 2313 len 16384
23182 292/300 Read block 1366 len 36864
23183 293/300 Write block 1148 len 4096 data: 5
23184 294/300 Read block 3222 len 16384
23185 295/300 Write block 405 len 40960 data: 3 3 3 3 4 4 4 4 4 3
23186 296/300 Read block 3835 len 40960
23187 297/300 Read block 3430 len 32768
23188 298/300 Write block 3099 len 4096 data: 5
23189 299/300 Read block 4339 len 16384
23190 300/300 Write block 4738 len 40960 data: 3 4 4 5 4 4 4 4 2 3
23191 301/300 Read block 4739 len 24576
23192 Main task has work to do, go find it
23193 got dsc Start(0)
23194 start 0
23195 Jan 10 16:40:12.901 INFO request completed, latency_us: 195, response_code: 204, uri: /start/cid/0, method: POST, req_id: 7f01ef1a-55ac-4699-92d2-58b7bda816c4, remote_addr: 127.0.0.1:55917, local_addr: 127.0.0.1:9998
23196 Replay: started 0, returned:Ok(())
23197 ----------------------------------------------------------------
23198 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:301
23199 States: Offline Active Active
23200 JOBID ACK TYPE BKS/EXT DS:0 DS:1 DS:2 REPLAY
23201 7037 Acked Read 5 Sent Done Done false
23202 7038 Acked Write 4 Sent Done Done false
23203 7039 Acked Read 2 Sent Done Done false
23204 7040 Acked Write 9 Sent Done Done false
23205 7041 Acked Write 4 Sent Done Done false
23206 7042 Acked Write 1 Sent Done Done false
23207 7043 Acked Write 6 Sent Done Done false
23208 7044 Acked Flush 0 Sent Done Done false
23209 7045 Acked Read 8 Sent Done Done false
23210 7046 Acked Read 1 Sent Done Done false
23211 7047 Acked Write 10 Sent Done Done false
23212 7048 Acked Write 6 Sent Done Done false
23213 7049 Acked Read 1 Sent Done Done false
23214 7050 Acked Write 1 Sent Done Done false
23215 7051 Acked Read 2 Sent Done Done false
23216 7052 Acked Write 9 Sent Done Done false
23217 7053 Acked Write 5 Sent Done Done false
23218 7054 Acked Write 1 Sent Done Done false
23219 7055 Acked Read 7 Sent Done Done false
23220 7056 Acked Write 4 Sent Done Done false
23221 7057 Acked Read 7 Sent Done Done false
23222 7058 Acked Write 4 Sent Done Done false
23223 7059 Acked Write 3 Sent Done Done false
23224 7060 Acked Write 3 Sent Done Done false
23225 7061 Acked Flush 0 Sent Done Done false
23226 7062 Acked Write 6 Sent Done Done false
23227 7063 Acked Read 5 Sent Done Done false
23228 7064 Acked Write 3 Sent Done Done false
23229 7065 Acked Read 3 Sent Done Done false
23230 7066 Acked Flush 0 Sent Done Done false
23231 7067 Acked Read 1 Sent Done Done false
23232 7068 Acked Write 6 Sent Done Done false
23233 7069 Acked Read 9 Sent Done Done false
23234 7070 Acked Flush 0 Sent Done Done false
23235 7071 Acked Flush 0 Sent Done Done false
23236 7072 Acked Read 1 Sent Done Done false
23237 7073 Acked Write 5 Sent Done Done false
23238 7074 Acked Write 9 Sent Done Done false
23239 7075 Acked Read 5 Sent Done Done false
23240 7076 Acked Read 1 Sent Done Done false
23241 7077 Acked Write 9 Sent Done Done false
23242 7078 Acked Read 1 Sent Done Done false
23243 7079 Acked Read 4 Sent Done Done false
23244 7080 Acked Flush 0 Sent Done Done false
23245 7081 Acked Read 4 Sent Done Done false
23246 7082 Acked Write 6 Sent Done Done false
23247 7083 Acked Write 8 Sent Done Done false
23248 7084 Acked Read 4 Sent Done Done false
23249 7085 Acked Write 10 Sent Done Done false
23250 7086 Acked Write 8 Sent Done Done false
23251 7087 Acked Read 6 Sent Done Done false
23252 7088 Acked Read 8 Sent Done Done false
23253 7089 Acked Write 4 Sent Done Done false
23254 7090 Acked Write 7 Sent Done Done false
23255 7091 Acked Read 4 Sent Done Done false
23256 7092 Acked Write 3 Sent Done Done false
23257 7093 Acked Write 10 Sent Done Done false
23258 7094 Acked Write 5 Sent Done Done false
23259 7095 Acked Write 9 Sent Done Done false
23260 7096 Acked Flush 0 Sent Done Done false
23261 7097 Acked Write 1 Sent Done Done false
23262 7098 Acked Write 4 Sent Done Done false
23263 7099 Acked Read 2 Sent Done Done false
23264 7100 Acked Flush 0 Sent Done Done false
23265 7101 Acked Read 10 Sent Done Done false
23266 7102 Acked Read 2 Sent Done Done false
23267 7103 Acked Write 5 Sent Done Done false
23268 7104 Acked Write 9 Sent Done Done false
23269 7105 Acked Write 5 Sent Done Done false
23270 7106 Acked Write 10 Sent Done Done false
23271 7107 Acked Read 7 Sent Done Done false
23272 7108 Acked Flush 0 Sent Done Done false
23273 7109 Acked Write 10 Sent Done Done false
23274 7110 Acked Flush 0 Sent Done Done false
23275 7111 Acked Read 3 Sent Done Done false
23276 7112 Acked Read 3 Sent Done Done false
23277 7113 Acked Read 7 Sent Done Done false
23278 7114 Acked Write 8 Sent Done Done false
23279 7115 Acked Flush 0 Sent Done Done false
23280 7116 Acked Read 5 Sent Done Done false
23281 7117 Acked Write 1 Sent Done Done false
23282 7118 Acked Read 1 Sent Done Done false
23283 7119 Acked Write 5 Sent Done Done false
23284 7120 Acked Read 6 Sent Done Done false
23285 7121 Acked Read 10 Sent Done Done false
23286 7122 Acked Write 7 Sent Done Done false
23287 7123 Acked Read 9 Sent Done Done false
23288 7124 Acked Read 10 Sent Done Done false
23289 7125 Acked Read 9 Sent Done Done false
23290 7126 Acked Read 4 Sent Done Done false
23291 7127 Acked Read 1 Sent Done Done false
23292 7128 Acked Read 4 Sent Done Done false
23293 7129 Acked Write 5 Sent Done Done false
23294 7130 Acked Read 4 Sent Done Done false
23295 7131 Acked Read 2 Sent Done Done false
23296 7132 Acked Read 10 Sent Done Done false
23297 7133 Acked Read 1 Sent Done Done false
23298 7134 Acked Write 4 Sent Done Done false
23299 7135 Acked Write 7 Sent Done Done false
23300 7136 Acked Write 8 Sent Done Done false
23301 7137 Acked Write 3 Sent Done Done false
23302 7138 Acked Write 5 Sent Done Done false
23303 7139 Acked Read 10 Sent Done Done false
23304 7140 Acked Flush 0 Sent Done Done false
23305 7141 Acked Read 8 Sent Done Done false
23306 7142 Acked Write 6 Sent Done Done false
23307 7143 Acked Write 2 Sent Done Done false
23308 7144 Acked Write 7 Sent Done Done false
23309 7145 Acked Read 1 Sent Done Done false
23310 7146 Acked Read 5 Sent Done Done false
23311 7147 Acked Read 9 Sent Done Done false
23312 7148 Acked Read 8 Sent Done Done false
23313 7149 Acked Write 10 Sent Done Done false
23314 7150 Acked Read 7 Sent Done Done false
23315 7151 Acked Write 4 Sent Done Done false
23316 7152 Acked Read 2 Sent Done Done false
23317 7153 Acked Flush 0 Sent Done Done false
23318 7154 Acked Write 8 Sent Done Done false
23319 7155 Acked Read 10 Sent Done Done false
23320 7156 Acked Read 6 Sent Done Done false
23321 7157 Acked Read 4 Sent Done Done false
23322 7158 Acked Read 5 Sent Done Done false
23323 7159 Acked Write 10 Sent Done Done false
23324 7160 Acked Read 5 Sent Done Done false
23325 7161 Acked Write 8 Sent Done Done false
23326 7162 Acked Flush 0 Sent Done Done false
23327 7163 Acked Read 4 Sent Done Done false
23328 7164 Acked Read 4 Sent Done Done false
23329 7165 Acked Read 6 Sent Done Done false
23330 7166 Acked Read 8 Sent Done Done false
23331 7167 Acked Write 9 Sent Done Done false
23332 7168 Acked Read 5 Sent Done Done false
23333 7169 Acked Read 7 Sent Done Done false
23334 7170 Acked Flush 0 Sent Done Done false
23335 7171 Acked Read 2 Sent Done Done false
23336 7172 Acked Read 9 Sent Done Done false
23337 7173 Acked Write 9 Sent Done Done false
23338 7174 Acked Write 1 Sent Done Done false
23339 7175 Acked Read 9 Sent Done Done false
23340 7176 Acked Flush 0 Sent Done Done false
23341 7177 Acked Write 7 Sent Done Done false
23342 7178 Acked Write 3 Sent Done Done false
23343 7179 Acked Read 6 Sent Done Done false
23344 7180 Acked Read 1 Sent Done Done false
23345 7181 Acked Read 6 Sent Done Done false
23346 7182 Acked Flush 0 Sent Done Done false
23347 7183 Acked Read 8 Sent Done Done false
23348 7184 Acked Write 3 Sent Done Done false
23349 7185 Acked Write 7 Sent Done Done false
23350 7186 Acked Read 7 Sent Done Done false
23351 7187 Acked Read 4 Sent Done Done false
23352 7188 Acked Write 9 Sent Done Done false
23353 7189 Acked Read 9 Sent Done Done false
23354 7190 Acked Write 10 Sent Done Done false
23355 7191 Acked Read 6 Sent Done Done false
23356 7192 Acked Read 4 Sent Done Done false
23357 7193 Acked Flush 0 Sent Done Done false
23358 7194 Acked Read 8 Sent Done Done false
23359 7195 Acked Read 10 Sent Done Done false
23360 7196 Acked Write 6 Sent Done Done false
23361 7197 Acked Read 7 Sent Done Done false
23362 7198 Acked Read 4 Sent Done Done false
23363 7199 Acked Write 1 Sent Done Done false
23364 7200 Acked Write 2 Sent Done Done false
23365 7201 Acked Write 7 Sent Done Done false
23366 7202 Acked Write 3 Sent Done Done false
23367 7203 Acked Read 8 Sent Done Done false
23368 7204 Acked Write 10 Sent Done Done false
23369 7205 Acked Write 8 Sent Done Done false
23370 7206 Acked Write 10 Sent Done Done false
23371 7207 Acked Write 9 Sent Done Done false
23372 7208 Acked Read 9 Sent Done Done false
23373 7209 Acked Write 1 Sent Done Done false
23374 7210 Acked Read 4 Sent Done Done false
23375 7211 Acked Write 8 Sent Done Done false
23376 7212 Acked Write 7 Sent Done Done false
23377 7213 Acked Read 6 Sent Done Done false
23378 7214 Acked Read 1 Sent Done Done false
23379 7215 Acked Read 5 Sent Done Done false
23380 7216 Acked Read 1 Sent Done Done false
23381 7217 Acked Write 8 Sent Done Done false
23382 7218 Acked Read 4 Sent Done Done false
23383 7219 Acked Flush 0 Sent Done Done false
23384 7220 Acked Read 3 Sent Done Done false
23385 7221 Acked Write 10 Sent Done Done false
23386 7222 Acked Flush 0 Sent Done Done false
23387 7223 Acked Write 5 Sent Done Done false
23388 7224 Acked Write 8 Sent Done Done false
23389 7225 Acked Read 2 Sent Done Done false
23390 7226 Acked Flush 0 Sent Done Done false
23391 7227 Acked Read 3 Sent Done Done false
23392 7228 Acked Write 1 Sent Done Done false
23393 7229 Acked Read 1 Sent Done Done false
23394 7230 Acked Flush 0 Sent Done Done false
23395 7231 Acked Write 9 Sent Done Done false
23396 7232 Acked Read 6 Sent Done Done false
23397 7233 Acked Read 10 Sent Done Done false
23398 7234 Acked Read 7 Sent Done Done false
23399 7235 Acked Read 9 Sent Done Done false
23400 7236 Acked Read 10 Sent Done Done false
23401 7237 Acked Write 1 Sent Done Done false
23402 7238 Acked Read 3 Sent Done Done false
23403 7239 Acked Read 2 Sent Done Done false
23404 7240 Acked Write 4 Sent Done Done false
23405 7241 Acked Read 9 Sent Done Done false
23406 7242 Acked Write 1 Sent Done Done false
23407 7243 Acked Write 4 Sent Done Done false
23408 7244 Acked Flush 0 Sent Done Done false
23409 7245 Acked Read 3 Sent Done Done false
23410 7246 Acked Read 1 Sent Done Done false
23411 7247 Acked Read 8 Sent Done Done false
23412 7248 Acked Write 6 Sent Done Done false
23413 7249 Acked Write 7 Sent Done Done false
23414 7250 Acked Write 8 Sent Done Done false
23415 7251 Acked Write 4 Sent Done Done false
23416 7252 Acked Read 1 Sent Done Done false
23417 7253 Acked Read 9 Sent Done Done false
23418 7254 Acked Read 10 Sent Done Done false
23419 7255 Acked Read 5 Sent Done Done false
23420 7256 Acked Write 2 Sent Done Done false
23421 7257 Acked Read 5 Sent Done Done false
23422 7258 Acked Read 10 Sent Done Done false
23423 7259 Acked Write 3 Sent Done Done false
23424 7260 Acked Write 10 Sent Done Done false
23425 7261 Acked Flush 0 Sent Done Done false
23426 7262 Acked Write 3 Sent Done Done false
23427 7263 Acked Read 4 Sent Done Done false
23428 7264 Acked Write 9 Sent Done Done false
23429 7265 Acked Read 7 Sent Done Done false
23430 7266 Acked Write 2 Sent Done Done false
23431 7267 Acked Write 1 Sent Done Done false
23432 7268 Acked Read 8 Sent Done Done false
23433 7269 Acked Write 9 Sent Done Done false
23434 7270 Acked Flush 0 Sent Done Done false
23435 7271 Acked Read 5 Sent Done Done false
23436 7272 Acked Write 3 Sent Done Done false
23437 7273 Acked Read 10 Sent Done Done false
23438 7274 Acked Write 9 Sent Done Done false
23439 7275 Acked Read 7 Sent Done Done false
23440 7276 Acked Write 2 Sent Done Done false
23441 7277 Acked Read 2 Sent Done Done false
23442 7278 Acked Write 7 Sent Done Done false
23443 7279 Acked Read 1 Sent Done Done false
23444 7280 Acked Write 9 Sent Done Done false
23445 7281 Acked Read 10 Sent Done Done false
23446 7282 Acked Read 10 Sent Done Done false
23447 7283 Acked Flush 0 Sent Done Done false
23448 7284 Acked Write 8 Sent Done Done false
23449 7285 Acked Read 8 Sent Done Done false
23450 7286 Acked Read 10 Sent Done Done false
23451 7287 Acked Write 4 Sent Done Done false
23452 7288 Acked Read 3 Sent Done Done false
23453 7289 Acked Write 1 Sent Done Done false
23454 7290 Acked Flush 0 Sent Done Done false
23455 7291 Acked Write 3 Sent Done Done false
23456 7292 Acked Write 5 Sent Done Done false
23457 7293 Acked Read 3 Sent Done Done false
23458 7294 Acked Flush 0 Sent Done Done false
23459 7295 Acked Read 9 Sent Done Done false
23460 7296 Acked Write 8 Sent Done Done false
23461 7297 Acked Read 2 Sent Done Done false
23462 7298 Acked Write 8 Sent Done Done false
23463 7299 Acked Write 2 Sent Done Done false
23464 7300 Acked Flush 0 Sent Done Done false
23465 7301 Acked Read 5 Sent Done Done false
23466 7302 Acked Read 2 Sent Done Done false
23467 7303 Acked Write 4 Sent Done Done false
23468 7304 Acked Write 7 Sent Done Done false
23469 7305 Acked Read 1 Sent Done Done false
23470 7306 Acked Flush 0 Sent Done Done false
23471 7307 Acked Write 10 Sent Done Done false
23472 7308 Acked Write 9 Sent Done Done false
23473 7309 Acked Flush 0 Sent Done Done false
23474 7310 Acked Write 3 Sent Done Done false
23475 7311 Acked Write 6 Sent Done Done false
23476 7312 Acked Read 4 Sent Done Done false
23477 7313 Acked Write 7 Sent Done Done false
23478 7314 Acked Write 10 Sent Done Done false
23479 7315 Acked Read 6 Sent Done Done false
23480 7316 Acked Read 7 Sent Done Done false
23481 7317 Acked Write 5 Sent Done Done false
23482 7318 Acked Write 5 Sent Done Done false
23483 7319 Acked Flush 0 Sent Done Done false
23484 7320 Acked Read 8 Sent Done Done false
23485 7321 Acked Read 3 Sent Done Done false
23486 7322 Acked Write 8 Sent Done Done false
23487 7323 Acked Flush 0 Sent Done Done false
23488 7324 Acked Read 10 Sent Done Done false
23489 7325 Acked Write 9 Sent Done Done false
23490 7326 Acked Read 1 Sent Done Done false
23491 7327 Acked Read 4 Sent Done Done false
23492 7328 Acked Read 9 Sent Done Done false
23493 7329 Acked Write 1 Sent Done Done false
23494 7330 Acked Read 4 Sent Done Done false
23495 7331 Acked Write 10 Sent Done Done false
23496 7332 Acked Read 10 Sent Done Done false
23497 7333 Acked Read 8 Sent Done Done false
23498 7334 Acked Write 1 Sent Done Done false
23499 7335 Acked Read 4 Sent Done Done false
23500 7336 Acked Write 10 Sent Done Done false
23501 7337 Acked Read 6 Sent Done Done false
23502 STATES DS:0 DS:1 DS:2 TOTAL
23503 Sent 301 0 0 301
23504 Done 0 301 301 602
23505 Skipped 0 0 0 0
23506 Error 0 0 0 0
23507 Last Flush: 7036 7323 7323
23508 Downstairs last five completed: 7036 7035 7034 7033 7032
23509 Upstairs last five completed: 7337 7336 7335 7334 7333
23510 CLIENT: Up:0 ds:301 act:2
23511 [8810] got start action
23512 [8810] I am going to restart
23513 Starting downstairs at port 8810
23514 Make output file at "/tmp/dsc/downstairs-8810.txt"
23515 [8810][0] reports Starting
23516 Downstairs /var/tmp/dsc/region/8810 port 8810 PID:Some(1223)
23517 [8810][0] reports Running
23518 ----------------------------------------------------------------
23519 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:302
23520 States: Offline Active Active
23521 JOBID ACK TYPE BKS/EXT DS:0 DS:1 DS:2 REPLAY
23522 7037 Acked Read 5 Sent Done Done false
23523 7038 Acked Write 4 Sent Done Done false
23524 7039 Acked Read 2 Sent Done Done false
23525 7040 Acked Write 9 Sent Done Done false
23526 7041 Acked Write 4 Sent Done Done false
23527 7042 Acked Write 1 Sent Done Done false
23528 7043 Acked Write 6 Sent Done Done false
23529 7044 Acked Flush 0 Sent Done Done false
23530 7045 Acked Read 8 Sent Done Done false
23531 7046 Acked Read 1 Sent Done Done false
23532 7047 Acked Write 10 Sent Done Done false
23533 7048 Acked Write 6 Sent Done Done false
23534 7049 Acked Read 1 Sent Done Done false
23535 7050 Acked Write 1 Sent Done Done false
23536 7051 Acked Read 2 Sent Done Done false
23537 7052 Acked Write 9 Sent Done Done false
23538 7053 Acked Write 5 Sent Done Done false
23539 7054 Acked Write 1 Sent Done Done false
23540 7055 Acked Read 7 Sent Done Done false
23541 7056 Acked Write 4 Sent Done Done false
23542 7057 Acked Read 7 Sent Done Done false
23543 7058 Acked Write 4 Sent Done Done false
23544 7059 Acked Write 3 Sent Done Done false
23545 7060 Acked Write 3 Sent Done Done false
23546 7061 Acked Flush 0 Sent Done Done false
23547 7062 Acked Write 6 Sent Done Done false
23548 7063 Acked Read 5 Sent Done Done false
23549 7064 Acked Write 3 Sent Done Done false
23550 7065 Acked Read 3 Sent Done Done false
23551 7066 Acked Flush 0 Sent Done Done false
23552 7067 Acked Read 1 Sent Done Done false
23553 7068 Acked Write 6 Sent Done Done false
23554 7069 Acked Read 9 Sent Done Done false
23555 7070 Acked Flush 0 Sent Done Done false
23556 7071 Acked Flush 0 Sent Done Done false
23557 7072 Acked Read 1 Sent Done Done false
23558 7073 Acked Write 5 Sent Done Done false
23559 7074 Acked Write 9 Sent Done Done false
23560 7075 Acked Read 5 Sent Done Done false
23561 7076 Acked Read 1 Sent Done Done false
23562 7077 Acked Write 9 Sent Done Done false
23563 7078 Acked Read 1 Sent Done Done false
23564 7079 Acked Read 4 Sent Done Done false
23565 7080 Acked Flush 0 Sent Done Done false
23566 7081 Acked Read 4 Sent Done Done false
23567 7082 Acked Write 6 Sent Done Done false
23568 7083 Acked Write 8 Sent Done Done false
23569 7084 Acked Read 4 Sent Done Done false
23570 7085 Acked Write 10 Sent Done Done false
23571 7086 Acked Write 8 Sent Done Done false
23572 7087 Acked Read 6 Sent Done Done false
23573 7088 Acked Read 8 Sent Done Done false
23574 7089 Acked Write 4 Sent Done Done false
23575 7090 Acked Write 7 Sent Done Done false
23576 7091 Acked Read 4 Sent Done Done false
23577 7092 Acked Write 3 Sent Done Done false
23578 7093 Acked Write 10 Sent Done Done false
23579 7094 Acked Write 5 Sent Done Done false
23580 7095 Acked Write 9 Sent Done Done false
23581 7096 Acked Flush 0 Sent Done Done false
23582 7097 Acked Write 1 Sent Done Done false
23583 7098 Acked Write 4 Sent Done Done false
23584 7099 Acked Read 2 Sent Done Done false
23585 7100 Acked Flush 0 Sent Done Done false
23586 7101 Acked Read 10 Sent Done Done false
23587 7102 Acked Read 2 Sent Done Done false
23588 7103 Acked Write 5 Sent Done Done false
23589 7104 Acked Write 9 Sent Done Done false
23590 7105 Acked Write 5 Sent Done Done false
23591 7106 Acked Write 10 Sent Done Done false
23592 7107 Acked Read 7 Sent Done Done false
23593 7108 Acked Flush 0 Sent Done Done false
23594 7109 Acked Write 10 Sent Done Done false
23595 7110 Acked Flush 0 Sent Done Done false
23596 7111 Acked Read 3 Sent Done Done false
23597 7112 Acked Read 3 Sent Done Done false
23598 7113 Acked Read 7 Sent Done Done false
23599 7114 Acked Write 8 Sent Done Done false
23600 7115 Acked Flush 0 Sent Done Done false
23601 7116 Acked Read 5 Sent Done Done false
23602 7117 Acked Write 1 Sent Done Done false
23603 7118 Acked Read 1 Sent Done Done false
23604 7119 Acked Write 5 Sent Done Done false
23605 7120 Acked Read 6 Sent Done Done false
23606 7121 Acked Read 10 Sent Done Done false
23607 7122 Acked Write 7 Sent Done Done false
23608 7123 Acked Read 9 Sent Done Done false
23609 7124 Acked Read 10 Sent Done Done false
23610 7125 Acked Read 9 Sent Done Done false
23611 7126 Acked Read 4 Sent Done Done false
23612 7127 Acked Read 1 Sent Done Done false
23613 7128 Acked Read 4 Sent Done Done false
23614 7129 Acked Write 5 Sent Done Done false
23615 7130 Acked Read 4 Sent Done Done false
23616 7131 Acked Read 2 Sent Done Done false
23617 7132 Acked Read 10 Sent Done Done false
23618 7133 Acked Read 1 Sent Done Done false
23619 7134 Acked Write 4 Sent Done Done false
23620 7135 Acked Write 7 Sent Done Done false
23621 7136 Acked Write 8 Sent Done Done false
23622 7137 Acked Write 3 Sent Done Done false
23623 7138 Acked Write 5 Sent Done Done false
23624 7139 Acked Read 10 Sent Done Done false
23625 7140 Acked Flush 0 Sent Done Done false
23626 7141 Acked Read 8 Sent Done Done false
23627 7142 Acked Write 6 Sent Done Done false
23628 7143 Acked Write 2 Sent Done Done false
23629 7144 Acked Write 7 Sent Done Done false
23630 7145 Acked Read 1 Sent Done Done false
23631 7146 Acked Read 5 Sent Done Done false
23632 7147 Acked Read 9 Sent Done Done false
23633 7148 Acked Read 8 Sent Done Done false
23634 7149 Acked Write 10 Sent Done Done false
23635 7150 Acked Read 7 Sent Done Done false
23636 7151 Acked Write 4 Sent Done Done false
23637 7152 Acked Read 2 Sent Done Done false
23638 7153 Acked Flush 0 Sent Done Done false
23639 7154 Acked Write 8 Sent Done Done false
23640 7155 Acked Read 10 Sent Done Done false
23641 7156 Acked Read 6 Sent Done Done false
23642 7157 Acked Read 4 Sent Done Done false
23643 7158 Acked Read 5 Sent Done Done false
23644 7159 Acked Write 10 Sent Done Done false
23645 7160 Acked Read 5 Sent Done Done false
23646 7161 Acked Write 8 Sent Done Done false
23647 7162 Acked Flush 0 Sent Done Done false
23648 7163 Acked Read 4 Sent Done Done false
23649 7164 Acked Read 4 Sent Done Done false
23650 7165 Acked Read 6 Sent Done Done false
23651 7166 Acked Read 8 Sent Done Done false
23652 7167 Acked Write 9 Sent Done Done false
23653 7168 Acked Read 5 Sent Done Done false
23654 7169 Acked Read 7 Sent Done Done false
23655 7170 Acked Flush 0 Sent Done Done false
23656 7171 Acked Read 2 Sent Done Done false
23657 7172 Acked Read 9 Sent Done Done false
23658 7173 Acked Write 9 Sent Done Done false
23659 7174 Acked Write 1 Sent Done Done false
23660 7175 Acked Read 9 Sent Done Done false
23661 7176 Acked Flush 0 Sent Done Done false
23662 7177 Acked Write 7 Sent Done Done false
23663 7178 Acked Write 3 Sent Done Done false
23664 7179 Acked Read 6 Sent Done Done false
23665 7180 Acked Read 1 Sent Done Done false
23666 7181 Acked Read 6 Sent Done Done false
23667 7182 Acked Flush 0 Sent Done Done false
23668 7183 Acked Read 8 Sent Done Done false
23669 7184 Acked Write 3 Sent Done Done false
23670 7185 Acked Write 7 Sent Done Done false
23671 7186 Acked Read 7 Sent Done Done false
23672 7187 Acked Read 4 Sent Done Done false
23673 7188 Acked Write 9 Sent Done Done false
23674 7189 Acked Read 9 Sent Done Done false
23675 7190 Acked Write 10 Sent Done Done false
23676 7191 Acked Read 6 Sent Done Done false
23677 7192 Acked Read 4 Sent Done Done false
23678 7193 Acked Flush 0 Sent Done Done false
23679 7194 Acked Read 8 Sent Done Done false
23680 7195 Acked Read 10 Sent Done Done false
23681 7196 Acked Write 6 Sent Done Done false
23682 7197 Acked Read 7 Sent Done Done false
23683 7198 Acked Read 4 Sent Done Done false
23684 7199 Acked Write 1 Sent Done Done false
23685 7200 Acked Write 2 Sent Done Done false
23686 7201 Acked Write 7 Sent Done Done false
23687 7202 Acked Write 3 Sent Done Done false
23688 7203 Acked Read 8 Sent Done Done false
23689 7204 Acked Write 10 Sent Done Done false
23690 7205 Acked Write 8 Sent Done Done false
23691 7206 Acked Write 10 Sent Done Done false
23692 7207 Acked Write 9 Sent Done Done false
23693 7208 Acked Read 9 Sent Done Done false
23694 7209 Acked Write 1 Sent Done Done false
23695 7210 Acked Read 4 Sent Done Done false
23696 7211 Acked Write 8 Sent Done Done false
23697 7212 Acked Write 7 Sent Done Done false
23698 7213 Acked Read 6 Sent Done Done false
23699 7214 Acked Read 1 Sent Done Done false
23700 7215 Acked Read 5 Sent Done Done false
23701 7216 Acked Read 1 Sent Done Done false
23702 7217 Acked Write 8 Sent Done Done false
23703 7218 Acked Read 4 Sent Done Done false
23704 7219 Acked Flush 0 Sent Done Done false
23705 7220 Acked Read 3 Sent Done Done false
23706 7221 Acked Write 10 Sent Done Done false
23707 7222 Acked Flush 0 Sent Done Done false
23708 7223 Acked Write 5 Sent Done Done false
23709 7224 Acked Write 8 Sent Done Done false
23710 7225 Acked Read 2 Sent Done Done false
23711 7226 Acked Flush 0 Sent Done Done false
23712 7227 Acked Read 3 Sent Done Done false
23713 7228 Acked Write 1 Sent Done Done false
23714 7229 Acked Read 1 Sent Done Done false
23715 7230 Acked Flush 0 Sent Done Done false
23716 7231 Acked Write 9 Sent Done Done false
23717 7232 Acked Read 6 Sent Done Done false
23718 7233 Acked Read 10 Sent Done Done false
23719 7234 Acked Read 7 Sent Done Done false
23720 7235 Acked Read 9 Sent Done Done false
23721 7236 Acked Read 10 Sent Done Done false
23722 7237 Acked Write 1 Sent Done Done false
23723 7238 Acked Read 3 Sent Done Done false
23724 7239 Acked Read 2 Sent Done Done false
23725 7240 Acked Write 4 Sent Done Done false
23726 7241 Acked Read 9 Sent Done Done false
23727 7242 Acked Write 1 Sent Done Done false
23728 7243 Acked Write 4 Sent Done Done false
23729 7244 Acked Flush 0 Sent Done Done false
23730 7245 Acked Read 3 Sent Done Done false
23731 7246 Acked Read 1 Sent Done Done false
23732 7247 Acked Read 8 Sent Done Done false
23733 7248 Acked Write 6 Sent Done Done false
23734 7249 Acked Write 7 Sent Done Done false
23735 7250 Acked Write 8 Sent Done Done false
23736 7251 Acked Write 4 Sent Done Done false
23737 7252 Acked Read 1 Sent Done Done false
23738 7253 Acked Read 9 Sent Done Done false
23739 7254 Acked Read 10 Sent Done Done false
23740 7255 Acked Read 5 Sent Done Done false
23741 7256 Acked Write 2 Sent Done Done false
23742 7257 Acked Read 5 Sent Done Done false
23743 7258 Acked Read 10 Sent Done Done false
23744 7259 Acked Write 3 Sent Done Done false
23745 7260 Acked Write 10 Sent Done Done false
23746 7261 Acked Flush 0 Sent Done Done false
23747 7262 Acked Write 3 Sent Done Done false
23748 7263 Acked Read 4 Sent Done Done false
23749 7264 Acked Write 9 Sent Done Done false
23750 7265 Acked Read 7 Sent Done Done false
23751 7266 Acked Write 2 Sent Done Done false
23752 7267 Acked Write 1 Sent Done Done false
23753 7268 Acked Read 8 Sent Done Done false
23754 7269 Acked Write 9 Sent Done Done false
23755 7270 Acked Flush 0 Sent Done Done false
23756 7271 Acked Read 5 Sent Done Done false
23757 7272 Acked Write 3 Sent Done Done false
23758 7273 Acked Read 10 Sent Done Done false
23759 7274 Acked Write 9 Sent Done Done false
23760 7275 Acked Read 7 Sent Done Done false
23761 7276 Acked Write 2 Sent Done Done false
23762 7277 Acked Read 2 Sent Done Done false
23763 7278 Acked Write 7 Sent Done Done false
23764 7279 Acked Read 1 Sent Done Done false
23765 7280 Acked Write 9 Sent Done Done false
23766 7281 Acked Read 10 Sent Done Done false
23767 7282 Acked Read 10 Sent Done Done false
23768 7283 Acked Flush 0 Sent Done Done false
23769 7284 Acked Write 8 Sent Done Done false
23770 7285 Acked Read 8 Sent Done Done false
23771 7286 Acked Read 10 Sent Done Done false
23772 7287 Acked Write 4 Sent Done Done false
23773 7288 Acked Read 3 Sent Done Done false
23774 7289 Acked Write 1 Sent Done Done false
23775 7290 Acked Flush 0 Sent Done Done false
23776 7291 Acked Write 3 Sent Done Done false
23777 7292 Acked Write 5 Sent Done Done false
23778 7293 Acked Read 3 Sent Done Done false
23779 7294 Acked Flush 0 Sent Done Done false
23780 7295 Acked Read 9 Sent Done Done false
23781 7296 Acked Write 8 Sent Done Done false
23782 7297 Acked Read 2 Sent Done Done false
23783 7298 Acked Write 8 Sent Done Done false
23784 7299 Acked Write 2 Sent Done Done false
23785 7300 Acked Flush 0 Sent Done Done false
23786 7301 Acked Read 5 Sent Done Done false
23787 7302 Acked Read 2 Sent Done Done false
23788 7303 Acked Write 4 Sent Done Done false
23789 7304 Acked Write 7 Sent Done Done false
23790 7305 Acked Read 1 Sent Done Done false
23791 7306 Acked Flush 0 Sent Done Done false
23792 7307 Acked Write 10 Sent Done Done false
23793 7308 Acked Write 9 Sent Done Done false
23794 7309 Acked Flush 0 Sent Done Done false
23795 7310 Acked Write 3 Sent Done Done false
23796 7311 Acked Write 6 Sent Done Done false
23797 7312 Acked Read 4 Sent Done Done false
23798 7313 Acked Write 7 Sent Done Done false
23799 7314 Acked Write 10 Sent Done Done false
23800 7315 Acked Read 6 Sent Done Done false
23801 7316 Acked Read 7 Sent Done Done false
23802 7317 Acked Write 5 Sent Done Done false
23803 7318 Acked Write 5 Sent Done Done false
23804 7319 Acked Flush 0 Sent Done Done false
23805 7320 Acked Read 8 Sent Done Done false
23806 7321 Acked Read 3 Sent Done Done false
23807 7322 Acked Write 8 Sent Done Done false
23808 7323 Acked Flush 0 Sent Done Done false
23809 7324 Acked Read 10 Sent Done Done false
23810 7325 Acked Write 9 Sent Done Done false
23811 7326 Acked Read 1 Sent Done Done false
23812 7327 Acked Read 4 Sent Done Done false
23813 7328 Acked Read 9 Sent Done Done false
23814 7329 Acked Write 1 Sent Done Done false
23815 7330 Acked Read 4 Sent Done Done false
23816 7331 Acked Write 10 Sent Done Done false
23817 7332 Acked Read 10 Sent Done Done false
23818 7333 Acked Read 8 Sent Done Done false
23819 7334 Acked Write 1 Sent Done Done false
23820 7335 Acked Read 4 Sent Done Done false
23821 7336 Acked Write 10 Sent Done Done false
23822 7337 Acked Read 6 Sent Done Done false
23823 7338 Acked Flush 0 Sent Done Done false
23824 STATES DS:0 DS:1 DS:2 TOTAL
23825 Sent 302 0 0 302
23826 Done 0 302 302 604
23827 Skipped 0 0 0 0
23828 Error 0 0 0 0
23829 Last Flush: 7036 7338 7338
23830 Downstairs last five completed: 7036 7035 7034 7033 7032
23831 Upstairs last five completed: 7338 7337 7336 7335 7334
23832 CLIENT: Up:0 ds:302 act:2
238332025-01-10T16:40:18.667ZINFOcrucible: connecting to 127.0.0.1:8810 = io task client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
238342025-01-10T16:40:18.667ZINFOcrucible: ds_connection connected from Ok(127.0.0.1:36941) = io task client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
238352025-01-10T16:40:18.668ZWARNcrucible: version negotiation from state Offline = downstairs client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
238362025-01-10T16:40:18.669ZINFOcrucible: downstairs client at Some(127.0.0.1:8810) has region UUID 12345678-0000-0000-0000-000000008810 = downstairs client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
238372025-01-10T16:40:18.669ZINFOcrucible: Returning UUID:12345678-0000-0000-0000-000000008810 matches = downstairs client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
238382025-01-10T16:40:18.669ZINFOcrucible: send last flush ID to this DS: 7036 = downstairs client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
238392025-01-10T16:40:18.669ZINFOcrucible: Replied this last flush ID: 7036 = downstairs client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
238402025-01-10T16:40:18.669ZINFOcrucible: ds_transition from Offline to Active = downstairs client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
238412025-01-10T16:40:18.669ZINFOcrucible: [0] Transition from Offline to Active = downstairs client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
238422025-01-10T16:40:18.669ZINFOcrucible: [0] client re-new 302 jobs since flush 7036 = downstairs session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
238432025-01-10T16:40:18.669ZINFOcrucible: [0] Replayed 302 jobs since flush: 7036 = downstairs session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
23844 ----------------------------------------------------------------
23845 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:0
23846 Downstairs last five completed: 7338 7337 7336 7335 7334
23847 Upstairs last five completed: 7338 7337 7336 7335 7334
23848 CLIENT: Up:0 ds:0 act:3
23849 Replay: All jobs finished
23850 Main task has work to do, go find it
23851 got dsc Stop(2)
23852 stop 2
23853 Jan 10 16:40:20.907 INFO request completed, latency_us: 347, response_code: 204, uri: /stop/cid/2, method: POST, req_id: 2d170ae2-d93e-4cf7-93d5-4b73317e9787, remote_addr: [8830] Got stop action so:false kr:false
23854 127.0.0.1:55917, local_addr: 127.0.0.1:9998
23855 Jan 10 16:40:20.908 INFO request completed, latency_us: 145, response_code: 200, uri: /state/cid/2, method: GET, req_id: 865f23b7-723c-417f-8d5d-437f060247b4, remote_addr: 127.0.0.1:55917, local_addr: 127.0.0.1:9998
238562025-01-10T16:40:20.908ZWARNcrucible: downstairs disconnected = io task client = 2 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
238572025-01-10T16:40:20.908ZWARNcrucible: client task is sending Done(Finished) = io task client = 2 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
238582025-01-10T16:40:20.908ZWARNcrucible: downstairs task for 2 stopped due to Finished session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
238592025-01-10T16:40:20.908ZINFOcrucible: ds_transition from Active to Offline = downstairs client = 2 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
238602025-01-10T16:40:20.908ZINFOcrucible: [2] Transition from Active to Offline = downstairs client = 2 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
238612025-01-10T16:40:20.908ZINFOcrucible: client task is exiting = io task client = 2 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
23862 [8830] Exited with: ExitStatus(unix_wait_status(9))
23863 [8830][2] reports Exit
23864 Jan 10 16:40:24.910 INFO request completed, latency_us: 201, response_code: 200, uri: /state/cid/2, method: GET, req_id: e01808f1-cfab-4a9c-8852-51aa2e5d2376, remote_addr: 127.0.0.1:55917, local_addr: 127.0.0.1:9998
23865 001/300 Read block 951 len 8192
23866 002/300 Read block 251 len 32768
23867 003/300 Write block 843 len 36864 data: 9 9 9 7 5 5 6 4 4
23868 004/300 Write block 1719 len 40960 data: 6 6 5 5 7 7 6 6 7 6
23869 005/300 Read block 106 len 4096
23870 006/300 Read block 2108 len 20480
23871 007/300 Write block 3147 len 16384 data: 5 5 6 6
23872 008/300 Read block 2892 len 4096
23873 009/300 Flush
23874 010/300 Write block 3710 len 28672 data: 7 9 8 7 6 5 6
23875 011/300 Write block 3963 len 20480 data: 3 3 4 4 4
23876 012/300 Write block 2214 len 12288 data: 2 2 2
23877 013/300 Flush
23878 014/300 Write block 2938 len 36864 data: 6 5 5 6 5 5 5 5 6
23879 015/300 Read block 1582 len 20480
23880 016/300 Flush
23881 017/300 Write block 1981 len 36864 data: 4 3 5 5 5 6 6 6 7
23882 018/300 Write block 364 len 32768 data: 4 4 4 4 4 5 5 5
23883 019/300 Read block 2956 len 12288
23884 020/300 Write block 297 len 12288 data: 4 4 3
23885 021/300 Flush
23886 022/300 Write block 4985 len 28672 data: 6 8 7 6 6 5 3
23887 023/300 Write block 3116 len 28672 data: 5 5 3 5 4 4 4
23888 024/300 Read block 4505 len 24576
23889 025/300 Write block 405 len 20480 data: 4 4 4 4 5
23890 026/300 Read block 3827 len 4096
23891 027/300 Flush
23892 028/300 Write block 1065 len 16384 data: 4 4 4 2
23893 029/300 Write block 462 len 4096 data: 3
23894 030/300 Read block 2249 len 8192
23895 031/300 Read block 1273 len 32768
23896 032/300 Flush
23897 033/300 Read block 4199 len 4096
23898 034/300 Write block 4028 len 28672 data: 8 7 7 6 5 4 3
23899 035/300 Read block 296 len 8192
23900 036/300 Write block 1973 len 8192 data: 5 5
23901 037/300 Read block 4610 len 4096
23902 038/300 Write block 2636 len 32768 data: 8 7 7 8 8 7 7 8
23903 039/300 Read block 4210 len 4096
23904 040/300 Read block 2152 len 4096
23905 041/300 Write block 4944 len 12288 data: 6 6 5
23906 042/300 Read block 1027 len 40960
23907 043/300 Write block 1696 len 12288 data: 7 6 6
23908 044/300 Write block 412 len 28672 data: 5 5 4 3 5 4 3
23909 045/300 Read block 3695 len 28672
23910 046/300 Write block 3254 len 8192 data: 5 5
23911 047/300 Write block 1365 len 28672 data: 5 4 4 6 5 5 3
23912 048/300 Write block 1051 len 20480 data: 3 3 3 3 3
23913 049/300 Write block 811 len 8192 data: 5 4
23914 050/300 Read block 4400 len 28672
23915 051/300 Write block 4877 len 40960 data: 4 5 6 6 6 5 4 5 6 5
23916 052/300 Flush
23917 053/300 Read block 1817 len 28672
23918 054/300 Flush
23919 055/300 Flush
23920 056/300 Write block 1896 len 4096 data: 5
23921 057/300 Write block 3851 len 40960 data: 4 4 6 7 9 6 5 4 5 5
23922 058/300 Write block 3500 len 12288 data: 2 3 3
23923 059/300 Read block 3662 len 36864
23924 060/300 Read block 104 len 12288
23925 061/300 Read block 1578 len 24576
23926 062/300 Read block 222 len 32768
23927 063/300 Write block 4249 len 12288 data: 6 7 7
23928 064/300 Write block 2204 len 36864 data: 3 4 3 5 5 4 4 4 5
23929 065/300 Read block 391 len 28672
23930 066/300 Write block 3363 len 24576 data: 2 2 2 3 3 5
23931 067/300 Write block 25 len 20480 data: 6 5 5 6 6
23932 068/300 Write block 4643 len 4096 data: 2
23933 069/300 Read block 1903 len 36864
23934 070/300 Read block 4651 len 36864
23935 071/300 Flush
23936 072/300 Read block 4858 len 24576
23937 073/300 Flush
23938 074/300 Write block 3805 len 36864 data: 4 4 4 5 5 4 3 3 3
23939 075/300 Read block 1264 len 16384
23940 076/300 Write block 2630 len 8192 data: 3 4
23941 077/300 Read block 4356 len 40960
23942 078/300 Read block 2126 len 24576
23943 079/300 Write block 3600 len 32768 data: 6 5 3 3 3 5 6 6
23944 080/300 Write block 3370 len 40960 data: 7 6 6 6 3 3 2 2 3 5
23945 081/300 Write block 4069 len 4096 data: 7
23946 082/300 Write block 4699 len 40960 data: 4 5 4 4 5 6 6 6 5 6
23947 083/300 Flush
23948 084/300 Read block 717 len 28672
23949 085/300 Write block 1977 len 16384 data: 3 3 2 3
23950 086/300 Write block 3924 len 28672 data: 4 4 3 3 3 3 4
23951 087/300 Write block 4111 len 12288 data: 3 4 4
23952 088/300 Read block 2909 len 8192
23953 089/300 Read block 1076 len 4096
23954 090/300 Read block 2383 len 20480
23955 091/300 Write block 2330 len 24576 data: 5 6 6 7 6 6
23956 092/300 Read block 1775 len 12288
23957 093/300 Write block 2442 len 12288 data: 4 5 5
23958 094/300 Read block 703 len 28672
23959 095/300 Write block 1764 len 40960 data: 8 7 7 5 6 4 3 3 3 4
23960 096/300 Read block 4121 len 36864
23961 097/300 Flush
23962 098/300 Read block 2503 len 16384
23963 099/300 Read block 4894 len 40960
23964 100/300 Write block 56 len 40960 data: 4 4 2 2 2 2 2 2 3 3
23965 101/300 Read block 3946 len 36864
23966 102/300 Read block 1630 len 20480
23967 103/300 Read block 2821 len 20480
23968 104/300 Write block 3828 len 40960 data: 4 5 5 4 5 5 5 6 5 4
23969 105/300 Write block 610 len 28672 data: 5 6 6 7 7 6 6
23970 106/300 Write block 2370 len 40960 data: 5 5 6 6 5 5 6 6 6 6
23971 107/300 Read block 3238 len 24576
23972 108/300 Read block 1623 len 36864
23973 109/300 Write block 1908 len 24576 data: 5 5 4 6 6 6
23974 110/300 Read block 3835 len 40960
23975 111/300 Write block 1457 len 16384 data: 6 7 8 4
23976 112/300 Write block 296 len 28672 data: 4 5 5 4 3 3 4
23977 113/300 Read block 1364 len 12288
23978 114/300 Write block 2742 len 40960 data: 2 3 3 3 3 3 4 2 2 3
23979 115/300 Read block 528 len 40960
23980 116/300 Read block 297 len 24576
23981 117/300 Write block 4179 len 8192 data: 5 5
23982 118/300 Write block 3727 len 20480 data: 9 9 9 6 6
23983 119/300 Write block 882 len 12288 data: 7 7 8
23984 120/300 Write block 518 len 12288 data: 5 6 7
23985 121/300 Read block 3845 len 8192
23986 122/300 Read block 4254 len 4096
23987 123/300 Write block 1037 len 12288 data: 6 4 5
23988 124/300 Read block 136 len 4096
23989 125/300 Read block 271 len 24576
23990 126/300 Read block 1829 len 32768
23991 127/300 Read block 1730 len 40960
23992 128/300 Read block 4039 len 4096
23993 129/300 Write block 2407 len 16384 data: 5 5 5 6
23994 130/300 Read block 2147 len 24576
23995 131/300 Read block 4127 len 4096
23996 132/300 Read block 3328 len 16384
23997 133/300 Write block 3700 len 20480 data: 3 4 5 5 5
23998 134/300 Read block 3248 len 4096
23999 135/300 Read block 2982 len 4096
24000 136/300 Write block 2040 len 16384 data: 6 6 5 4
24001 137/300 Read block 2243 len 40960
24002 138/300 Read block 2158 len 20480
24003 139/300 Write block 4299 len 24576 data: 5 5 4 4 4 4
24004 140/300 Read block 3993 len 4096
24005 141/300 Read block 766 len 12288
24006 142/300 Read block 4909 len 28672
24007 143/300 Write block 4977 len 4096 data: 3
24008 144/300 Write block 823 len 40960 data: 6 6 5 4 2 3 5 5 6 6
24009 145/300 Write block 2612 len 36864 data: 5 5 4 4 5 5 6 6 5
24010 146/300 Read block 2937 len 16384
24011 147/300 Read block 3086 len 20480
24012 148/300 Flush
24013 149/300 Write block 2228 len 20480 data: 5 4 3 3 2
24014 150/300 Write block 996 len 28672 data: 3 4 3 3 3 4 4
24015 151/300 Read block 680 len 16384
24016 152/300 Write block 648 len 4096 data: 5
24017 153/300 Flush
24018 154/300 Write block 674 len 40960 data: 5 4 4 5 4 8 9 9 9 8
24019 155/300 Write block 1772 len 20480 data: 4 5 5 5 5
24020 156/300 Read block 2284 len 24576
24021 157/300 Flush
24022 158/300 Read block 4715 len 12288
24023 159/300 Write block 739 len 12288 data: 5 4 4
24024 160/300 Write block 1278 len 12288 data: 6 8 7
24025 161/300 Write block 2244 len 40960 data: 7 7 8 8 9 8 8 7 3 3
24026 162/300 Read block 1340 len 24576
24027 163/300 Flush
24028 164/300 Write block 1200 len 40960 data: 4 4 3 2 2 2 2 2 4 4
24029 165/300 Write block 3172 len 24576 data: 5 4 4 3 2 2
24030 166/300 Write block 1180 len 32768 data: 7 7 7 7 7 9 8 7
24031 167/300 Write block 2300 len 12288 data: 2 2 3
24032 168/300 Read block 3801 len 40960
24033 169/300 Write block 670 len 16384 data: 4 4 5 6
24034 170/300 Read block 971 len 28672
24035 171/300 Write block 908 len 32768 data: 4 7 6 4 4 4 5 6
24036 172/300 Read block 1055 len 4096
24037 173/300 Read block 2158 len 24576
24038 174/300 Read block 1590 len 36864
24039 175/300 Write block 4613 len 28672 data: 2 2 2 3 4 4 4
24040 176/300 Write block 1311 len 4096 data: 5
24041 177/300 Read block 371 len 40960
24042 178/300 Read block 3695 len 12288
24043 179/300 Read block 105 len 8192
24044 180/300 Read block 4817 len 32768
24045 181/300 Read block 1558 len 24576
24046 182/300 Flush
24047 183/300 Read block 724 len 8192
24048 184/300 Write block 2465 len 12288 data: 3 3 2
24049 185/300 Read block 2249 len 4096
24050 186/300 Write block 2317 len 28672 data: 3 3 2 2 3 4 3
24051 187/300 Write block 1694 len 24576 data: 6 7 8 7 7 5
24052 188/300 Flush
24053 189/300 Write block 598 len 28672 data: 5 7 7 8 6 8 9
24054 190/300 Write block 2385 len 28672 data: 5 6 8 8 8 6 5
24055 191/300 Read block 1622 len 4096
24056 192/300 Read block 2249 len 12288
24057 193/300 Read block 4422 len 32768
24058 194/300 Write block 1355 len 8192 data: 5 5
24059 195/300 Write block 3457 len 40960 data: 6 6 5 5 4 5 4 5 5 5
24060 196/300 Write block 4904 len 12288 data: 6 4 4
24061 197/300 Flush
24062 198/300 Write block 2065 len 36864 data: 3 3 4 5 7 7 6 5 5
24063 199/300 Write block 2901 len 36864 data: 10 9 6 6 4 3 3 3 3
24064 200/300 Read block 1028 len 4096
24065 201/300 Flush
24066 202/300 Write block 3311 len 36864 data: 4 4 5 5 5 3 3 3 4
24067 203/300 Read block 1201 len 36864
24068 204/300 Read block 4305 len 4096
24069 205/300 Write block 918 len 20480 data: 9 8 6 5 5
24070 206/300 Write block 2357 len 12288 data: 5 5 5
24071 207/300 Write block 1043 len 16384 data: 2 2 2 2
24072 208/300 Write block 1409 len 12288 data: 5 5 6
24073 209/300 Write block 574 len 36864 data: 5 5 5 4 4 5 5 5 7
24074 210/300 Write block 4370 len 20480 data: 6 6 7 7 8
24075 211/300 Write block 3029 len 16384 data: 3 3 4 4
24076 212/300 Read block 524 len 4096
24077 213/300 Write block 887 len 4096 data: 4
24078 214/300 Read block 3720 len 16384
24079 215/300 Write block 875 len 16384 data: 7 4 7 7
24080 216/300 Read block 1326 len 8192
24081 217/300 Flush
24082 218/300 Write block 3457 len 8192 data: 7 7
24083 219/300 Flush
24084 220/300 Read block 475 len 8192
24085 221/300 Read block 2264 len 16384
24086 222/300 Write block 1585 len 8192 data: 5 5
24087 223/300 Read block 4136 len 20480
24088 224/300 Write block 4405 len 16384 data: 3 3 2 2
24089 225/300 Read block 1488 len 8192
24090 226/300 Write block 2009 len 4096 data: 4
24091 227/300 Read block 2075 len 20480
24092 228/300 Flush
24093 229/300 Read block 4774 len 36864
24094 230/300 Read block 4800 len 8192
24095 231/300 Read block 1870 len 16384
24096 232/300 Read block 1563 len 8192
24097 233/300 Write block 500 len 32768 data: 3 3 3 3 3 3 3 5
24098 234/300 Write block 4463 len 28672 data: 4 2 2 2 2 3 3
24099 235/300 Read block 133 len 28672
24100 236/300 Read block 1475 len 20480
24101 237/300 Read block 3551 len 4096
24102 238/300 Write block 3449 len 8192 data: 3 3
24103 239/300 Read block 2686 len 16384
24104 240/300 Read block 3330 len 36864
24105 241/300 Read block 861 len 28672
24106 242/300 Read block 651 len 32768
24107 243/300 Write block 1109 len 16384 data: 6 6 5 6
24108 244/300 Write block 4800 len 16384 data: 5 5 7 7
24109 245/300 Write block 3932 len 4096 data: 5
24110 246/300 Read block 1172 len 32768
24111 247/300 Read block 2938 len 4096
24112 248/300 Read block 757 len 24576
24113 249/300 Write block 4576 len 24576 data: 8 8 7 7 6 6
24114 250/300 Write block 1662 len 8192 data: 6 5
24115 251/300 Write block 2235 len 32768 data: 3 4 4 4 6 5 5 6
24116 252/300 Write block 3774 len 4096 data: 7
24117 253/300 Read block 243 len 8192
24118 254/300 Read block 4204 len 24576
24119 255/300 Read block 3741 len 4096
24120 256/300 Write block 1699 len 8192 data: 6 7
24121 257/300 Read block 4976 len 20480
24122 258/300 Flush
24123 259/300 Read block 1324 len 24576
24124 260/300 Read block 4216 len 36864
24125 261/300 Write block 2086 len 4096 data: 2
24126 262/300 Write block 4071 len 16384 data: 7 6 7 5
24127 263/300 Read block 1643 len 20480
24128 264/300 Write block 118 len 12288 data: 5 6 7
24129 265/300 Write block 3698 len 36864 data: 3 3 4 5 6 6 6 5 6
24130 266/300 Write block 879 len 8192 data: 8 7
24131 267/300 Read block 1964 len 24576
24132 268/300 Flush
24133 269/300 Read block 479 len 32768
24134 270/300 Write block 300 len 4096 data: 4
24135 271/300 Flush
24136 272/300 Read block 2081 len 28672
24137 273/300 Read block 1285 len 12288
24138 274/300 Read block 628 len 36864
24139 275/300 Read block 2311 len 24576
24140 276/300 Read block 4614 len 40960
24141 277/300 Read block 3748 len 28672
24142 278/300 Write block 4166 len 40960 data: 9 7 7 5 6 6 5 4 5 6
24143 279/300 Read block 4412 len 8192
24144 280/300 Read block 2715 len 40960
24145 281/300 Write block 2583 len 28672 data: 8 7 8 7 8 8 8
24146 282/300 Read block 2405 len 40960
24147 283/300 Read block 3533 len 36864
24148 284/300 Read block 789 len 28672
24149 285/300 Write block 1730 len 40960 data: 7 6 6 6 5 5 4 6 6 5
24150 286/300 Write block 448 len 40960 data: 8 8 9 8 9 8 7 6 5 5
24151 287/300 Read block 4597 len 24576
24152 288/300 Read block 3430 len 8192
24153 289/300 Write block 4325 len 16384 data: 3 4 3 3
24154 290/300 Write block 1850 len 20480 data: 3 4 2 2 3
24155 291/300 Read block 4429 len 4096
24156 292/300 Read block 3875 len 28672
24157 293/300 Read block 3799 len 24576
24158 294/300 Read block 1468 len 8192
24159 295/300 Write block 1077 len 36864 data: 2 2 2 2 2 3 4 4 3
24160 296/300 Write block 4957 len 40960 data: 3 3 4 4 5 5 6 6 5 5
24161 297/300 Flush
24162 298/300 Write block 4147 len 20480 data: 6 9 9 9 8
24163 299/300 Read block 131 len 40960
24164 300/300 Write block 3786 len 40960 data: 6 6 4 4 5 5 5 6 6 6
24165 301/300 Write block 2950 len 24576 data: 5 7 8 7 8 8
24166 Main task has work to do, go find it
24167 got dsc Start(2)
24168 start 2
24169 Jan 10 16:40:25.134 INFO request completed, latency_us: 205, response_code: 204, uri: /start/cid/2, method: POST, req_id: 1001e124-5339-4321-ac1b-5b64a28d8cdf, remote_addr: 127.0.0.1:55917, local_addr: 127.0.0.1:9998
24170 Replay: started 2, returned:Ok(())
24171 ----------------------------------------------------------------
24172 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:301
24173 States: Active Active Offline
24174 JOBID ACK TYPE BKS/EXT DS:0 DS:1 DS:2 REPLAY
24175 7339 Acked Read 2 Done Done Sent false
24176 7340 Acked Read 8 Done Done Sent false
24177 7341 Acked Write 9 Done Done Sent false
24178 7342 Acked Write 10 Done Done Sent false
24179 7343 Acked Read 1 Done Done Sent false
24180 7344 Acked Read 5 Done Done Sent false
24181 7345 Acked Write 4 Done Done Sent false
24182 7346 Acked Read 1 Done Done Sent false
24183 7347 Acked Flush 0 Done Done Sent false
24184 7348 Acked Write 7 Done Done Sent false
24185 7349 Acked Write 5 Done Done Sent false
24186 7350 Acked Write 3 Done Done Sent false
24187 7351 Acked Flush 0 Done Done Sent false
24188 7352 Acked Write 9 Done Done Sent false
24189 7353 Acked Read 5 Done Done Sent false
24190 7354 Acked Flush 0 Done Done Sent false
24191 7355 Acked Write 9 Done Done Sent false
24192 7356 Acked Write 8 Done Done Sent false
24193 7357 Acked Read 3 Done Done Sent false
24194 7358 Acked Write 3 Done Done Sent false
24195 7359 Acked Flush 0 Done Done Sent false
24196 7360 Acked Write 7 Done Done Sent false
24197 7361 Acked Write 7 Done Done Sent false
24198 7362 Acked Read 6 Done Done Sent false
24199 7363 Acked Write 5 Done Done Sent false
24200 7364 Acked Read 1 Done Done Sent false
24201 7365 Acked Flush 0 Done Done Sent false
24202 7366 Acked Write 4 Done Done Sent false
24203 7367 Acked Write 1 Done Done Sent false
24204 7368 Acked Read 2 Done Done Sent false
24205 7369 Acked Read 8 Done Done Sent false
24206 7370 Acked Flush 0 Done Done Sent false
24207 7371 Acked Read 1 Done Done Sent false
24208 7372 Acked Write 7 Done Done Sent false
24209 7373 Acked Read 2 Done Done Sent false
24210 7374 Acked Write 2 Done Done Sent false
24211 7375 Acked Read 1 Done Done Sent false
24212 7376 Acked Write 8 Done Done Sent false
24213 7377 Acked Read 1 Done Done Sent false
24214 7378 Acked Read 1 Done Done Sent false
24215 7379 Acked Write 3 Done Done Sent false
24216 7380 Acked Read 10 Done Done Sent false
24217 7381 Acked Write 3 Done Done Sent false
24218 7382 Acked Write 7 Done Done Sent false
24219 7383 Acked Read 7 Done Done Sent false
24220 7384 Acked Write 2 Done Done Sent false
24221 7385 Acked Write 7 Done Done Sent false
24222 7386 Acked Write 5 Done Done Sent false
24223 7387 Acked Write 2 Done Done Sent false
24224 7388 Acked Read 7 Done Done Sent false
24225 7389 Acked Write 10 Done Done Sent false
24226 7390 Acked Flush 0 Done Done Sent false
24227 7391 Acked Read 7 Done Done Sent false
24228 7392 Acked Flush 0 Done Done Sent false
24229 7393 Acked Flush 0 Done Done Sent false
24230 7394 Acked Write 1 Done Done Sent false
24231 7395 Acked Write 10 Done Done Sent false
24232 7396 Acked Write 3 Done Done Sent false
24233 7397 Acked Read 9 Done Done Sent false
24234 7398 Acked Read 3 Done Done Sent false
24235 7399 Acked Read 6 Done Done Sent false
24236 7400 Acked Read 8 Done Done Sent false
24237 7401 Acked Write 3 Done Done Sent false
24238 7402 Acked Write 9 Done Done Sent false
24239 7403 Acked Read 7 Done Done Sent false
24240 7404 Acked Write 6 Done Done Sent false
24241 7405 Acked Write 5 Done Done Sent false
24242 7406 Acked Write 1 Done Done Sent false
24243 7407 Acked Read 9 Done Done Sent false
24244 7408 Acked Read 9 Done Done Sent false
24245 7409 Acked Flush 0 Done Done Sent false
24246 7410 Acked Read 6 Done Done Sent false
24247 7411 Acked Flush 0 Done Done Sent false
24248 7412 Acked Write 9 Done Done Sent false
24249 7413 Acked Read 4 Done Done Sent false
24250 7414 Acked Write 2 Done Done Sent false
24251 7415 Acked Read 10 Done Done Sent false
24252 7416 Acked Read 6 Done Done Sent false
24253 7417 Acked Write 8 Done Done Sent false
24254 7418 Acked Write 10 Done Done Sent false
24255 7419 Acked Write 1 Done Done Sent false
24256 7420 Acked Write 10 Done Done Sent false
24257 7421 Acked Flush 0 Done Done Sent false
24258 7422 Acked Read 7 Done Done Sent false
24259 7423 Acked Write 4 Done Done Sent false
24260 7424 Acked Write 7 Done Done Sent false
24261 7425 Acked Write 3 Done Done Sent false
24262 7426 Acked Read 2 Done Done Sent false
24263 7427 Acked Read 1 Done Done Sent false
24264 7428 Acked Read 5 Done Done Sent false
24265 7429 Acked Write 6 Done Done Sent false
24266 7430 Acked Read 3 Done Done Sent false
24267 7431 Acked Write 3 Done Done Sent false
24268 7432 Acked Read 7 Done Done Sent false
24269 7433 Acked Write 10 Done Done Sent false
24270 7434 Acked Read 9 Done Done Sent false
24271 7435 Acked Flush 0 Done Done Sent false
24272 7436 Acked Read 4 Done Done Sent false
24273 7437 Acked Read 10 Done Done Sent false
24274 7438 Acked Write 10 Done Done Sent false
24275 7439 Acked Read 9 Done Done Sent false
24276 7440 Acked Read 5 Done Done Sent false
24277 7441 Acked Read 5 Done Done Sent false
24278 7442 Acked Write 10 Done Done Sent false
24279 7443 Acked Write 7 Done Done Sent false
24280 7444 Acked Write 10 Done Done Sent false
24281 7445 Acked Read 6 Done Done Sent false
24282 7446 Acked Read 9 Done Done Sent false
24283 7447 Acked Write 6 Done Done Sent false
24284 7448 Acked Read 10 Done Done Sent false
24285 7449 Acked Write 4 Done Done Sent false
24286 7450 Acked Write 7 Done Done Sent false
24287 7451 Acked Read 3 Done Done Sent false
24288 7452 Acked Write 10 Done Done Sent false
24289 7453 Acked Read 10 Done Done Sent false
24290 7454 Acked Read 6 Done Done Sent false
24291 7455 Acked Write 2 Done Done Sent false
24292 7456 Acked Write 5 Done Done Sent false
24293 7457 Acked Write 3 Done Done Sent false
24294 7458 Acked Write 3 Done Done Sent false
24295 7459 Acked Read 2 Done Done Sent false
24296 7460 Acked Read 1 Done Done Sent false
24297 7461 Acked Write 3 Done Done Sent false
24298 7462 Acked Read 1 Done Done Sent false
24299 7463 Acked Read 6 Done Done Sent false
24300 7464 Acked Read 8 Done Done Sent false
24301 7465 Acked Read 10 Done Done Sent false
24302 7466 Acked Read 1 Done Done Sent false
24303 7467 Acked Write 4 Done Done Sent false
24304 7468 Acked Read 6 Done Done Sent false
24305 7469 Acked Read 1 Done Done Sent false
24306 7470 Acked Read 4 Done Done Sent false
24307 7471 Acked Write 5 Done Done Sent false
24308 7472 Acked Read 1 Done Done Sent false
24309 7473 Acked Read 1 Done Done Sent false
24310 7474 Acked Write 4 Done Done Sent false
24311 7475 Acked Read 10 Done Done Sent false
24312 7476 Acked Read 5 Done Done Sent false
24313 7477 Acked Write 6 Done Done Sent false
24314 7478 Acked Read 1 Done Done Sent false
24315 7479 Acked Read 3 Done Done Sent false
24316 7480 Acked Read 7 Done Done Sent false
24317 7481 Acked Write 1 Done Done Sent false
24318 7482 Acked Write 10 Done Done Sent false
24319 7483 Acked Write 9 Done Done Sent false
24320 7484 Acked Read 4 Done Done Sent false
24321 7485 Acked Read 5 Done Done Sent false
24322 7486 Acked Flush 0 Done Done Sent false
24323 7487 Acked Write 5 Done Done Sent false
24324 7488 Acked Write 7 Done Done Sent false
24325 7489 Acked Read 4 Done Done Sent false
24326 7490 Acked Write 1 Done Done Sent false
24327 7491 Acked Flush 0 Done Done Sent false
24328 7492 Acked Write 10 Done Done Sent false
24329 7493 Acked Write 5 Done Done Sent false
24330 7494 Acked Read 6 Done Done Sent false
24331 7495 Acked Flush 0 Done Done Sent false
24332 7496 Acked Read 3 Done Done Sent false
24333 7497 Acked Write 3 Done Done Sent false
24334 7498 Acked Write 3 Done Done Sent false
24335 7499 Acked Write 10 Done Done Sent false
24336 7500 Acked Read 6 Done Done Sent false
24337 7501 Acked Flush 0 Done Done Sent false
24338 7502 Acked Write 10 Done Done Sent false
24339 7503 Acked Write 6 Done Done Sent false
24340 7504 Acked Write 8 Done Done Sent false
24341 7505 Acked Write 3 Done Done Sent false
24342 7506 Acked Read 10 Done Done Sent false
24343 7507 Acked Write 4 Done Done Sent false
24344 7508 Acked Read 7 Done Done Sent false
24345 7509 Acked Write 8 Done Done Sent false
24346 7510 Acked Read 1 Done Done Sent false
24347 7511 Acked Read 6 Done Done Sent false
24348 7512 Acked Read 9 Done Done Sent false
24349 7513 Acked Write 7 Done Done Sent false
24350 7514 Acked Write 1 Done Done Sent false
24351 7515 Acked Read 10 Done Done Sent false
24352 7516 Acked Read 3 Done Done Sent false
24353 7517 Acked Read 2 Done Done Sent false
24354 7518 Acked Read 8 Done Done Sent false
24355 7519 Acked Read 6 Done Done Sent false
24356 7520 Acked Flush 0 Done Done Sent false
24357 7521 Acked Read 2 Done Done Sent false
24358 7522 Acked Write 3 Done Done Sent false
24359 7523 Acked Read 1 Done Done Sent false
24360 7524 Acked Write 7 Done Done Sent false
24361 7525 Acked Write 6 Done Done Sent false
24362 7526 Acked Flush 0 Done Done Sent false
24363 7527 Acked Write 7 Done Done Sent false
24364 7528 Acked Write 7 Done Done Sent false
24365 7529 Acked Read 1 Done Done Sent false
24366 7530 Acked Read 3 Done Done Sent false
24367 7531 Acked Read 8 Done Done Sent false
24368 7532 Acked Write 2 Done Done Sent false
24369 7533 Acked Write 10 Done Done Sent false
24370 7534 Acked Write 3 Done Done Sent false
24371 7535 Acked Flush 0 Done Done Sent false
24372 7536 Acked Write 9 Done Done Sent false
24373 7537 Acked Write 9 Done Done Sent false
24374 7538 Acked Read 1 Done Done Sent false
24375 7539 Acked Flush 0 Done Done Sent false
24376 7540 Acked Write 9 Done Done Sent false
24377 7541 Acked Read 9 Done Done Sent false
24378 7542 Acked Read 1 Done Done Sent false
24379 7543 Acked Write 5 Done Done Sent false
24380 7544 Acked Write 3 Done Done Sent false
24381 7545 Acked Write 4 Done Done Sent false
24382 7546 Acked Write 3 Done Done Sent false
24383 7547 Acked Write 9 Done Done Sent false
24384 7548 Acked Write 5 Done Done Sent false
24385 7549 Acked Write 4 Done Done Sent false
24386 7550 Acked Read 1 Done Done Sent false
24387 7551 Acked Write 1 Done Done Sent false
24388 7552 Acked Read 4 Done Done Sent false
24389 7553 Acked Write 4 Done Done Sent false
24390 7554 Acked Read 2 Done Done Sent false
24391 7555 Acked Flush 0 Done Done Sent false
24392 7556 Acked Write 2 Done Done Sent false
24393 7557 Acked Flush 0 Done Done Sent false
24394 7558 Acked Read 2 Done Done Sent false
24395 7559 Acked Read 4 Done Done Sent false
24396 7560 Acked Write 2 Done Done Sent false
24397 7561 Acked Read 5 Done Done Sent false
24398 7562 Acked Write 4 Done Done Sent false
24399 7563 Acked Read 2 Done Done Sent false
24400 7564 Acked Write 1 Done Done Sent false
24401 7565 Acked Read 5 Done Done Sent false
24402 7566 Acked Flush 0 Done Done Sent false
24403 7567 Acked Read 9 Done Done Sent false
24404 7568 Acked Read 2 Done Done Sent false
24405 7569 Acked Read 4 Done Done Sent false
24406 7570 Acked Read 2 Done Done Sent false
24407 7571 Acked Write 8 Done Done Sent false
24408 7572 Acked Write 7 Done Done Sent false
24409 7573 Acked Read 7 Done Done Sent false
24410 7574 Acked Read 5 Done Done Sent false
24411 7575 Acked Read 1 Done Done Sent false
24412 7576 Acked Write 2 Done Done Sent false
24413 7577 Acked Read 4 Done Done Sent false
24414 7578 Acked Read 9 Done Done Sent false
24415 7579 Acked Read 7 Done Done Sent false
24416 7580 Acked Read 8 Done Done Sent false
24417 7581 Acked Write 4 Done Done Sent false
24418 7582 Acked Write 4 Done Done Sent false
24419 7583 Acked Write 1 Done Done Sent false
24420 7584 Acked Read 8 Done Done Sent false
24421 7585 Acked Read 1 Done Done Sent false
24422 7586 Acked Read 6 Done Done Sent false
24423 7587 Acked Write 6 Done Done Sent false
24424 7588 Acked Write 2 Done Done Sent false
24425 7589 Acked Write 8 Done Done Sent false
24426 7590 Acked Write 1 Done Done Sent false
24427 7591 Acked Read 2 Done Done Sent false
24428 7592 Acked Read 6 Done Done Sent false
24429 7593 Acked Read 1 Done Done Sent false
24430 7594 Acked Write 2 Done Done Sent false
24431 7595 Acked Read 5 Done Done Sent false
24432 7596 Acked Flush 0 Done Done Sent false
24433 7597 Acked Read 6 Done Done Sent false
24434 7598 Acked Read 9 Done Done Sent false
24435 7599 Acked Write 1 Done Done Sent false
24436 7600 Acked Write 4 Done Done Sent false
24437 7601 Acked Read 5 Done Done Sent false
24438 7602 Acked Write 3 Done Done Sent false
24439 7603 Acked Write 9 Done Done Sent false
24440 7604 Acked Write 2 Done Done Sent false
24441 7605 Acked Read 6 Done Done Sent false
24442 7606 Acked Flush 0 Done Done Sent false
24443 7607 Acked Read 8 Done Done Sent false
24444 7608 Acked Write 1 Done Done Sent false
24445 7609 Acked Flush 0 Done Done Sent false
24446 7610 Acked Read 7 Done Done Sent false
24447 7611 Acked Read 3 Done Done Sent false
24448 7612 Acked Read 9 Done Done Sent false
24449 7613 Acked Read 6 Done Done Sent false
24450 7614 Acked Read 10 Done Done Sent false
24451 7615 Acked Read 7 Done Done Sent false
24452 7616 Acked Write 10 Done Done Sent false
24453 7617 Acked Read 2 Done Done Sent false
24454 7618 Acked Read 10 Done Done Sent false
24455 7619 Acked Write 7 Done Done Sent false
24456 7620 Acked Read 10 Done Done Sent false
24457 7621 Acked Read 9 Done Done Sent false
24458 7622 Acked Read 7 Done Done Sent false
24459 7623 Acked Write 10 Done Done Sent false
24460 7624 Acked Write 10 Done Done Sent false
24461 7625 Acked Read 6 Done Done Sent false
24462 7626 Acked Read 2 Done Done Sent false
24463 7627 Acked Write 4 Done Done Sent false
24464 7628 Acked Write 5 Done Done Sent false
24465 7629 Acked Read 1 Done Done Sent false
24466 7630 Acked Read 7 Done Done Sent false
24467 7631 Acked Read 6 Done Done Sent false
24468 7632 Acked Read 2 Done Done Sent false
24469 7633 Acked Write 9 Done Done Sent false
24470 7634 Acked Write 10 Done Done Sent false
24471 7635 Acked Flush 0 Done Done Sent false
24472 7636 Acked Write 5 Done Done Sent false
24473 7637 Acked Read 10 Done Done Sent false
24474 7638 Acked Write 10 Sent Sent Sent false
24475 7639 Acked Write 6 Sent Sent Sent false
24476 STATES DS:0 DS:1 DS:2 TOTAL
24477 Sent 2 2 301 305
24478 Done 299 299 0 598
24479 Skipped 0 0 0 0
24480 Error 0 0 0 0
24481 Last Flush: 7635 7635 7338
24482 Downstairs last five completed: 7338 7337 7336 7335 7334
24483 Upstairs last five completed: 7639 7638 7637 7636 7635
24484 CLIENT: Up:0 ds:301 act:2
24485 ----------------------------------------------------------------
24486 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:302
24487 States: Active Active Offline
24488 JOBID ACK TYPE BKS/EXT DS:0 DS:1 DS:2 REPLAY
24489 7339 Acked Read 2 Done Done Sent false
24490 7340 Acked Read 8 Done Done Sent false
24491 7341 Acked Write 9 Done Done Sent false
24492 7342 Acked Write 10 Done Done Sent false
24493 7343 Acked Read 1 Done Done Sent false
24494 7344 Acked Read 5 Done Done Sent false
24495 7345 Acked Write 4 Done Done Sent false
24496 7346 Acked Read 1 Done Done Sent false
24497 7347 Acked Flush 0 Done Done Sent false
24498 7348 Acked Write 7 Done Done Sent false
24499 7349 Acked Write 5 Done Done Sent false
24500 7350 Acked Write 3 Done Done Sent false
24501 7351 Acked Flush 0 Done Done Sent false
24502 7352 Acked Write 9 Done Done Sent false
24503 7353 Acked Read 5 Done Done Sent false
24504 7354 Acked Flush 0 Done Done Sent false
24505 7355 Acked Write 9 Done Done Sent false
24506 7356 Acked Write 8 Done Done Sent false
24507 7357 Acked Read 3 Done Done Sent false
24508 7358 Acked Write 3 Done Done Sent false
24509 7359 Acked Flush 0 Done Done Sent false
24510 7360 Acked Write 7 Done Done Sent false
24511 7361 Acked Write 7 Done Done Sent false
24512 7362 Acked Read 6 Done Done Sent false
24513 7363 Acked Write 5 Done Done Sent false
24514 7364 Acked Read 1 Done Done Sent false
24515 7365 Acked Flush 0 Done Done Sent false
24516 7366 Acked Write 4 Done Done Sent false
24517 7367 Acked Write 1 Done Done Sent false
24518 7368 Acked Read 2 Done Done Sent false
24519 7369 Acked Read 8 Done Done Sent false
24520 7370 Acked Flush 0 Done Done Sent false
24521 7371 Acked Read 1 Done Done Sent false
24522 7372 Acked Write 7 Done Done Sent false
24523 7373 Acked Read 2 Done Done Sent false
24524 7374 Acked Write 2 Done Done Sent false
24525 7375 Acked Read 1 Done Done Sent false
24526 7376 Acked Write 8 Done Done Sent false
24527 7377 Acked Read 1 Done Done Sent false
24528 7378 Acked Read 1 Done Done Sent false
24529 7379 Acked Write 3 Done Done Sent false
24530 7380 Acked Read 10 Done Done Sent false
24531 7381 Acked Write 3 Done Done Sent false
24532 7382 Acked Write 7 Done Done Sent false
24533 7383 Acked Read 7 Done Done Sent false
24534 7384 Acked Write 2 Done Done Sent false
24535 7385 Acked Write 7 Done Done Sent false
24536 7386 Acked Write 5 Done Done Sent false
24537 7387 Acked Write 2 Done Done Sent false
24538 7388 Acked Read 7 Done Done Sent false
24539 7389 Acked Write 10 Done Done Sent false
24540 7390 Acked Flush 0 Done Done Sent false
24541 7391 Acked Read 7 Done Done Sent false
24542 7392 Acked Flush 0 Done Done Sent false
24543 7393 Acked Flush 0 Done Done Sent false
24544 7394 Acked Write 1 Done Done Sent false
24545 7395 Acked Write 10 Done Done Sent false
24546 7396 Acked Write 3 Done Done Sent false
24547 7397 Acked Read 9 Done Done Sent false
24548 7398 Acked Read 3 Done Done Sent false
24549 7399 Acked Read 6 Done Done Sent false
24550 7400 Acked Read 8 Done Done Sent false
24551 7401 Acked Write 3 Done Done Sent false
24552 7402 Acked Write 9 Done Done Sent false
24553 7403 Acked Read 7 Done Done Sent false
24554 7404 Acked Write 6 Done Done Sent false
24555 7405 Acked Write 5 Done Done Sent false
24556 7406 Acked Write 1 Done Done Sent false
24557 7407 Acked Read 9 Done Done Sent false
24558 7408 Acked Read 9 Done Done Sent false
24559 7409 Acked Flush 0 Done Done Sent false
24560 7410 Acked Read 6 Done Done Sent false
24561 7411 Acked Flush 0 Done Done Sent false
24562 7412 Acked Write 9 Done Done Sent false
24563 7413 Acked Read 4 Done Done Sent false
24564 7414 Acked Write 2 Done Done Sent false
24565 7415 Acked Read 10 Done Done Sent false
24566 7416 Acked Read 6 Done Done Sent false
24567 7417 Acked Write 8 Done Done Sent false
24568 7418 Acked Write 10 Done Done Sent false
24569 7419 Acked Write 1 Done Done Sent false
24570 7420 Acked Write 10 Done Done Sent false
24571 7421 Acked Flush 0 Done Done Sent false
24572 7422 Acked Read 7 Done Done Sent false
24573 7423 Acked Write 4 Done Done Sent false
24574 7424 Acked Write 7 Done Done Sent false
24575 7425 Acked Write 3 Done Done Sent false
24576 7426 Acked Read 2 Done Done Sent false
24577 7427 Acked Read 1 Done Done Sent false
24578 7428 Acked Read 5 Done Done Sent false
24579 7429 Acked Write 6 Done Done Sent false
24580 7430 Acked Read 3 Done Done Sent false
24581 7431 Acked Write 3 Done Done Sent false
24582 7432 Acked Read 7 Done Done Sent false
24583 7433 Acked Write 10 Done Done Sent false
24584 7434 Acked Read 9 Done Done Sent false
24585 7435 Acked Flush 0 Done Done Sent false
24586 7436 Acked Read 4 Done Done Sent false
24587 7437 Acked Read 10 Done Done Sent false
24588 7438 Acked Write 10 Done Done Sent false
24589 7439 Acked Read 9 Done Done Sent false
24590 7440 Acked Read 5 Done Done Sent false
24591 7441 Acked Read 5 Done Done Sent false
24592 7442 Acked Write 10 Done Done Sent false
24593 7443 Acked Write 7 Done Done Sent false
24594 7444 Acked Write 10 Done Done Sent false
24595 7445 Acked Read 6 Done Done Sent false
24596 7446 Acked Read 9 Done Done Sent false
24597 7447 Acked Write 6 Done Done Sent false
24598 7448 Acked Read 10 Done Done Sent false
24599 7449 Acked Write 4 Done Done Sent false
24600 7450 Acked Write 7 Done Done Sent false
24601 7451 Acked Read 3 Done Done Sent false
24602 7452 Acked Write 10 Done Done Sent false
24603 7453 Acked Read 10 Done Done Sent false
24604 7454 Acked Read 6 Done Done Sent false
24605 7455 Acked Write 2 Done Done Sent false
24606 7456 Acked Write 5 Done Done Sent false
24607 7457 Acked Write 3 Done Done Sent false
24608 7458 Acked Write 3 Done Done Sent false
24609 7459 Acked Read 2 Done Done Sent false
24610 7460 Acked Read 1 Done Done Sent false
24611 7461 Acked Write 3 Done Done Sent false
24612 7462 Acked Read 1 Done Done Sent false
24613 7463 Acked Read 6 Done Done Sent false
24614 7464 Acked Read 8 Done Done Sent false
24615 7465 Acked Read 10 Done Done Sent false
24616 7466 Acked Read 1 Done Done Sent false
24617 7467 Acked Write 4 Done Done Sent false
24618 7468 Acked Read 6 Done Done Sent false
24619 7469 Acked Read 1 Done Done Sent false
24620 7470 Acked Read 4 Done Done Sent false
24621 7471 Acked Write 5 Done Done Sent false
24622 7472 Acked Read 1 Done Done Sent false
24623 7473 Acked Read 1 Done Done Sent false
24624 7474 Acked Write 4 Done Done Sent false
24625 7475 Acked Read 10 Done Done Sent false
24626 7476 Acked Read 5 Done Done Sent false
24627 7477 Acked Write 6 Done Done Sent false
24628 7478 Acked Read 1 Done Done Sent false
24629 7479 Acked Read 3 Done Done Sent false
24630 7480 Acked Read 7 Done Done Sent false
24631 7481 Acked Write 1 Done Done Sent false
24632 7482 Acked Write 10 Done Done Sent false
24633 7483 Acked Write 9 Done Done Sent false
24634 7484 Acked Read 4 Done Done Sent false
24635 7485 Acked Read 5 Done Done Sent false
24636 7486 Acked Flush 0 Done Done Sent false
24637 7487 Acked Write 5 Done Done Sent false
24638 7488 Acked Write 7 Done Done Sent false
24639 7489 Acked Read 4 Done Done Sent false
24640 7490 Acked Write 1 Done Done Sent false
24641 7491 Acked Flush 0 Done Done Sent false
24642 7492 Acked Write 10 Done Done Sent false
24643 7493 Acked Write 5 Done Done Sent false
24644 7494 Acked Read 6 Done Done Sent false
24645 7495 Acked Flush 0 Done Done Sent false
24646 7496 Acked Read 3 Done Done Sent false
24647 7497 Acked Write 3 Done Done Sent false
24648 7498 Acked Write 3 Done Done Sent false
24649 7499 Acked Write 10 Done Done Sent false
24650 7500 Acked Read 6 Done Done Sent false
24651 7501 Acked Flush 0 Done Done Sent false
24652 7502 Acked Write 10 Done Done Sent false
24653 7503 Acked Write 6 Done Done Sent false
24654 7504 Acked Write 8 Done Done Sent false
24655 7505 Acked Write 3 Done Done Sent false
24656 7506 Acked Read 10 Done Done Sent false
24657 7507 Acked Write 4 Done Done Sent false
24658 7508 Acked Read 7 Done Done Sent false
24659 7509 Acked Write 8 Done Done Sent false
24660 7510 Acked Read 1 Done Done Sent false
24661 7511 Acked Read 6 Done Done Sent false
24662 7512 Acked Read 9 Done Done Sent false
24663 7513 Acked Write 7 Done Done Sent false
24664 7514 Acked Write 1 Done Done Sent false
24665 7515 Acked Read 10 Done Done Sent false
24666 7516 Acked Read 3 Done Done Sent false
24667 7517 Acked Read 2 Done Done Sent false
24668 7518 Acked Read 8 Done Done Sent false
24669 7519 Acked Read 6 Done Done Sent false
24670 7520 Acked Flush 0 Done Done Sent false
24671 7521 Acked Read 2 Done Done Sent false
24672 7522 Acked Write 3 Done Done Sent false
24673 7523 Acked Read 1 Done Done Sent false
24674 7524 Acked Write 7 Done Done Sent false
24675 7525 Acked Write 6 Done Done Sent false
24676 7526 Acked Flush 0 Done Done Sent false
24677 7527 Acked Write 7 Done Done Sent false
24678 7528 Acked Write 7 Done Done Sent false
24679 7529 Acked Read 1 Done Done Sent false
24680 7530 Acked Read 3 Done Done Sent false
24681 7531 Acked Read 8 Done Done Sent false
24682 7532 Acked Write 2 Done Done Sent false
24683 7533 Acked Write 10 Done Done Sent false
24684 7534 Acked Write 3 Done Done Sent false
24685 7535 Acked Flush 0 Done Done Sent false
24686 7536 Acked Write 9 Done Done Sent false
24687 7537 Acked Write 9 Done Done Sent false
24688 7538 Acked Read 1 Done Done Sent false
24689 7539 Acked Flush 0 Done Done Sent false
24690 7540 Acked Write 9 Done Done Sent false
24691 7541 Acked Read 9 Done Done Sent false
24692 7542 Acked Read 1 Done Done Sent false
24693 7543 Acked Write 5 Done Done Sent false
24694 7544 Acked Write 3 Done Done Sent false
24695 7545 Acked Write 4 Done Done Sent false
24696 7546 Acked Write 3 Done Done Sent false
24697 7547 Acked Write 9 Done Done Sent false
24698 7548 Acked Write 5 Done Done Sent false
24699 7549 Acked Write 4 Done Done Sent false
24700 7550 Acked Read 1 Done Done Sent false
24701 7551 Acked Write 1 Done Done Sent false
24702 7552 Acked Read 4 Done Done Sent false
24703 7553 Acked Write 4 Done Done Sent false
24704 7554 Acked Read 2 Done Done Sent false
24705 7555 Acked Flush 0 Done Done Sent false
24706 7556 Acked Write 2 Done Done Sent false
24707 7557 Acked Flush 0 Done Done Sent false
24708 7558 Acked Read 2 Done Done Sent false
24709 7559 Acked Read 4 Done Done Sent false
24710 7560 Acked Write 2 Done Done Sent false
24711 7561 Acked Read 5 Done Done Sent false
24712 7562 Acked Write 4 Done Done Sent false
24713 7563 Acked Read 2 Done Done Sent false
24714 7564 Acked Write 1 Done Done Sent false
24715 7565 Acked Read 5 Done Done Sent false
24716 7566 Acked Flush 0 Done Done Sent false
24717 7567 Acked Read 9 Done Done Sent false
24718 7568 Acked Read 2 Done Done Sent false
24719 7569 Acked Read 4 Done Done Sent false
24720 7570 Acked Read 2 Done Done Sent false
24721 7571 Acked Write 8 Done Done Sent false
24722 7572 Acked Write 7 Done Done Sent false
24723 7573 Acked Read 7 Done Done Sent false
24724 7574 Acked Read 5 Done Done Sent false
24725 7575 Acked Read 1 Done Done Sent false
24726 7576 Acked Write 2 Done Done Sent false
24727 7577 Acked Read 4 Done Done Sent false
24728 7578 Acked Read 9 Done Done Sent false
24729 7579 Acked Read 7 Done Done Sent false
24730 7580 Acked Read 8 Done Done Sent false
24731 7581 Acked Write 4 Done Done Sent false
24732 7582 Acked Write 4 Done Done Sent false
24733 7583 Acked Write 1 Done Done Sent false
24734 7584 Acked Read 8 Done Done Sent false
24735 7585 Acked Read 1 Done Done Sent false
24736 7586 Acked Read 6 Done Done Sent false
24737 7587 Acked Write 6 Done Done Sent false
24738 7588 Acked Write 2 Done Done Sent false
24739 7589 Acked Write 8 Done Done Sent false
24740 7590 Acked Write 1 Done Done Sent false
24741 7591 Acked Read 2 Done Done Sent false
24742 7592 Acked Read 6 Done Done Sent false
24743 7593 Acked Read 1 Done Done Sent false
24744 7594 Acked Write 2 Done Done Sent false
24745 7595 Acked Read 5 Done Done Sent false
24746 7596 Acked Flush 0 Done Done Sent false
24747 7597 Acked Read 6 Done Done Sent false
24748 7598 Acked Read 9 Done Done Sent false
24749 7599 Acked Write 1 Done Done Sent false
24750 7600 Acked Write 4 Done Done Sent false
24751 7601 Acked Read 5 Done Done Sent false
24752 7602 Acked Write 3 Done Done Sent false
24753 7603 Acked Write 9 Done Done Sent false
24754 7604 Acked Write 2 Done Done Sent false
24755 7605 Acked Read 6 Done Done Sent false
24756 7606 Acked Flush 0 Done Done Sent false
24757 7607 Acked Read 8 Done Done Sent false
24758 7608 Acked Write 1 Done Done Sent false
24759 7609 Acked Flush 0 Done Done Sent false
24760 7610 Acked Read 7 Done Done Sent false
24761 7611 Acked Read 3 Done Done Sent false
24762 7612 Acked Read 9 Done Done Sent false
24763 7613 Acked Read 6 Done Done Sent false
24764 7614 Acked Read 10 Done Done Sent false
24765 7615 Acked Read 7 Done Done Sent false
24766 7616 Acked Write 10 Done Done Sent false
24767 7617 Acked Read 2 Done Done Sent false
24768 7618 Acked Read 10 Done Done Sent false
24769 7619 Acked Write 7 Done Done Sent false
24770 7620 Acked Read 10 Done Done Sent false
24771 7621 Acked Read 9 Done Done Sent false
24772 7622 Acked Read 7 Done Done Sent false
24773 7623 Acked Write 10 Done Done Sent false
24774 7624 Acked Write 10 Done Done Sent false
24775 7625 Acked Read 6 Done Done Sent false
24776 7626 Acked Read 2 Done Done Sent false
24777 7627 Acked Write 4 Done Done Sent false
24778 7628 Acked Write 5 Done Done Sent false
24779 7629 Acked Read 1 Done Done Sent false
24780 7630 Acked Read 7 Done Done Sent false
24781 7631 Acked Read 6 Done Done Sent false
24782 7632 Acked Read 2 Done Done Sent false
24783 7633 Acked Write 9 Done Done Sent false
24784 7634 Acked Write 10 Done Done Sent false
24785 7635 Acked Flush 0 Done Done Sent false
24786 7636 Acked Write 5 Done Done Sent false
24787 7637 Acked Read 10 Done Done Sent false
24788 7638 Acked Write 10 Done Done Sent false
24789 7639 Acked Write 6 Done Done Sent false
24790 7640 Acked Flush 0 Done Done Sent false
24791 STATES DS:0 DS:1 DS:2 TOTAL
24792 Sent 0 0 302 302
24793 Done 302 302 0 604
24794 Skipped 0 0 0 0
24795 Error 0 0 0 0
24796 Last Flush: 7640 7640 7338
24797 Downstairs last five completed: 7338 7337 7336 7335 7334
24798 Upstairs last five completed: 7640 7639 7638 7637 7636
24799 CLIENT: Up:0 ds:302 act:2
248002025-01-10T16:40:30.910ZINFOcrucible: connecting to 127.0.0.1:8830 = io task client = 2 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
248012025-01-10T16:40:30.910ZWARNcrucible: ds_connection connect to 127.0.0.1:8830 failure: Os { code: 146, kind: ConnectionRefused, message: "Connection refused" } = io task client = 2 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
248022025-01-10T16:40:30.910ZWARNcrucible: client task is sending Done(ConnectionFailed(Os { code: 146, kind: ConnectionRefused, message: "Connection refused" })) = io task client = 2 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
248032025-01-10T16:40:30.910ZWARNcrucible: downstairs task for 2 stopped due to ConnectionFailed(Os { code: 146, kind: ConnectionRefused, message: "Connection refused" }) session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
248042025-01-10T16:40:30.910ZINFOcrucible: client task is exiting = io task client = 2 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
24805 ----------------------------------------------------------------
24806 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:302
24807 States: Active Active Offline
24808 JOBID ACK TYPE BKS/EXT DS:0 DS:1 DS:2 REPLAY
24809 7339 Acked Read 2 Done Done Sent false
24810 7340 Acked Read 8 Done Done Sent false
24811 7341 Acked Write 9 Done Done Sent false
24812 7342 Acked Write 10 Done Done Sent false
24813 7343 Acked Read 1 Done Done Sent false
24814 7344 Acked Read 5 Done Done Sent false
24815 7345 Acked Write 4 Done Done Sent false
24816 7346 Acked Read 1 Done Done Sent false
24817 7347 Acked Flush 0 Done Done Sent false
24818 7348 Acked Write 7 Done Done Sent false
24819 7349 Acked Write 5 Done Done Sent false
24820 7350 Acked Write 3 Done Done Sent false
24821 7351 Acked Flush 0 Done Done Sent false
24822 7352 Acked Write 9 Done Done Sent false
24823 7353 Acked Read 5 Done Done Sent false
24824 7354 Acked Flush 0 Done Done Sent false
24825 7355 Acked Write 9 Done Done Sent false
24826 7356 Acked Write 8 Done Done Sent false
24827 7357 Acked Read 3 Done Done Sent false
24828 7358 Acked Write 3 Done Done Sent false
24829 7359 Acked Flush 0 Done Done Sent false
24830 7360 Acked Write 7 Done Done Sent false
24831 7361 Acked Write 7 Done Done Sent false
24832 7362 Acked Read 6 Done Done Sent false
24833 7363 Acked Write 5 Done Done Sent false
24834 7364 Acked Read 1 Done Done Sent false
24835 7365 Acked Flush 0 Done Done Sent false
24836 7366 Acked Write 4 Done Done Sent false
24837 7367 Acked Write 1 Done Done Sent false
24838 7368 Acked Read 2 Done Done Sent false
24839 7369 Acked Read 8 Done Done Sent false
24840 7370 Acked Flush 0 Done Done Sent false
24841 7371 Acked Read 1 Done Done Sent false
24842 7372 Acked Write 7 Done Done Sent false
24843 7373 Acked Read 2 Done Done Sent false
24844 7374 Acked Write 2 Done Done Sent false
24845 7375 Acked Read 1 Done Done Sent false
24846 7376 Acked Write 8 Done Done Sent false
24847 7377 Acked Read 1 Done Done Sent false
24848 7378 Acked Read 1 Done Done Sent false
24849 7379 Acked Write 3 Done Done Sent false
24850 7380 Acked Read 10 Done Done Sent false
24851 7381 Acked Write 3 Done Done Sent false
24852 7382 Acked Write 7 Done Done Sent false
24853 7383 Acked Read 7 Done Done Sent false
24854 7384 Acked Write 2 Done Done Sent false
24855 7385 Acked Write 7 Done Done Sent false
24856 7386 Acked Write 5 Done Done Sent false
24857 7387 Acked Write 2 Done Done Sent false
24858 7388 Acked Read 7 Done Done Sent false
24859 7389 Acked Write 10 Done Done Sent false
24860 7390 Acked Flush 0 Done Done Sent false
24861 7391 Acked Read 7 Done Done Sent false
24862 7392 Acked Flush 0 Done Done Sent false
24863 7393 Acked Flush 0 Done Done Sent false
24864 7394 Acked Write 1 Done Done Sent false
24865 7395 Acked Write 10 Done Done Sent false
24866 7396 Acked Write 3 Done Done Sent false
24867 7397 Acked Read 9 Done Done Sent false
24868 7398 Acked Read 3 Done Done Sent false
24869 7399 Acked Read 6 Done Done Sent false
24870 7400 Acked Read 8 Done Done Sent false
24871 7401 Acked Write 3 Done Done Sent false
24872 7402 Acked Write 9 Done Done Sent false
24873 7403 Acked Read 7 Done Done Sent false
24874 7404 Acked Write 6 Done Done Sent false
24875 7405 Acked Write 5 Done Done Sent false
24876 7406 Acked Write 1 Done Done Sent false
24877 7407 Acked Read 9 Done Done Sent false
24878 7408 Acked Read 9 Done Done Sent false
24879 7409 Acked Flush 0 Done Done Sent false
24880 7410 Acked Read 6 Done Done Sent false
24881 7411 Acked Flush 0 Done Done Sent false
24882 7412 Acked Write 9 Done Done Sent false
24883 7413 Acked Read 4 Done Done Sent false
24884 7414 Acked Write 2 Done Done Sent false
24885 7415 Acked Read 10 Done Done Sent false
24886 7416 Acked Read 6 Done Done Sent false
24887 7417 Acked Write 8 Done Done Sent false
24888 7418 Acked Write 10 Done Done Sent false
24889 7419 Acked Write 1 Done Done Sent false
24890 7420 Acked Write 10 Done Done Sent false
24891 7421 Acked Flush 0 Done Done Sent false
24892 7422 Acked Read 7 Done Done Sent false
24893 7423 Acked Write 4 Done Done Sent false
24894 7424 Acked Write 7 Done Done Sent false
24895 7425 Acked Write 3 Done Done Sent false
24896 7426 Acked Read 2 Done Done Sent false
24897 7427 Acked Read 1 Done Done Sent false
24898 7428 Acked Read 5 Done Done Sent false
24899 7429 Acked Write 6 Done Done Sent false
24900 7430 Acked Read 3 Done Done Sent false
24901 7431 Acked Write 3 Done Done Sent false
24902 7432 Acked Read 7 Done Done Sent false
24903 7433 Acked Write 10 Done Done Sent false
24904 7434 Acked Read 9 Done Done Sent false
24905 7435 Acked Flush 0 Done Done Sent false
24906 7436 Acked Read 4 Done Done Sent false
24907 7437 Acked Read 10 Done Done Sent false
24908 7438 Acked Write 10 Done Done Sent false
24909 7439 Acked Read 9 Done Done Sent false
24910 7440 Acked Read 5 Done Done Sent false
24911 7441 Acked Read 5 Done Done Sent false
24912 7442 Acked Write 10 Done Done Sent false
24913 7443 Acked Write 7 Done Done Sent false
24914 7444 Acked Write 10 Done Done Sent false
24915 7445 Acked Read 6 Done Done Sent false
24916 7446 Acked Read 9 Done Done Sent false
24917 7447 Acked Write 6 Done Done Sent false
24918 7448 Acked Read 10 Done Done Sent false
24919 7449 Acked Write 4 Done Done Sent false
24920 7450 Acked Write 7 Done Done Sent false
24921 7451 Acked Read 3 Done Done Sent false
24922 7452 Acked Write 10 Done Done Sent false
24923 7453 Acked Read 10 Done Done Sent false
24924 7454 Acked Read 6 Done Done Sent false
24925 7455 Acked Write 2 Done Done Sent false
24926 7456 Acked Write 5 Done Done Sent false
24927 7457 Acked Write 3 Done Done Sent false
24928 7458 Acked Write 3 Done Done Sent false
24929 7459 Acked Read 2 Done Done Sent false
24930 7460 Acked Read 1 Done Done Sent false
24931 7461 Acked Write 3 Done Done Sent false
24932 7462 Acked Read 1 Done Done Sent false
24933 7463 Acked Read 6 Done Done Sent false
24934 7464 Acked Read 8 Done Done Sent false
24935 7465 Acked Read 10 Done Done Sent false
24936 7466 Acked Read 1 Done Done Sent false
24937 7467 Acked Write 4 Done Done Sent false
24938 7468 Acked Read 6 Done Done Sent false
24939 7469 Acked Read 1 Done Done Sent false
24940 7470 Acked Read 4 Done Done Sent false
24941 7471 Acked Write 5 Done Done Sent false
24942 7472 Acked Read 1 Done Done Sent false
24943 7473 Acked Read 1 Done Done Sent false
24944 7474 Acked Write 4 Done Done Sent false
24945 7475 Acked Read 10 Done Done Sent false
24946 7476 Acked Read 5 Done Done Sent false
24947 7477 Acked Write 6 Done Done Sent false
24948 7478 Acked Read 1 Done Done Sent false
24949 7479 Acked Read 3 Done Done Sent false
24950 7480 Acked Read 7 Done Done Sent false
24951 7481 Acked Write 1 Done Done Sent false
24952 7482 Acked Write 10 Done Done Sent false
24953 7483 Acked Write 9 Done Done Sent false
24954 7484 Acked Read 4 Done Done Sent false
24955 7485 Acked Read 5 Done Done Sent false
24956 7486 Acked Flush 0 Done Done Sent false
24957 7487 Acked Write 5 Done Done Sent false
24958 7488 Acked Write 7 Done Done Sent false
24959 7489 Acked Read 4 Done Done Sent false
24960 7490 Acked Write 1 Done Done Sent false
24961 7491 Acked Flush 0 Done Done Sent false
24962 7492 Acked Write 10 Done Done Sent false
24963 7493 Acked Write 5 Done Done Sent false
24964 7494 Acked Read 6 Done Done Sent false
24965 7495 Acked Flush 0 Done Done Sent false
24966 7496 Acked Read 3 Done Done Sent false
24967 7497 Acked Write 3 Done Done Sent false
24968 7498 Acked Write 3 Done Done Sent false
24969 7499 Acked Write 10 Done Done Sent false
24970 7500 Acked Read 6 Done Done Sent false
24971 7501 Acked Flush 0 Done Done Sent false
24972 7502 Acked Write 10 Done Done Sent false
24973 7503 Acked Write 6 Done Done Sent false
24974 7504 Acked Write 8 Done Done Sent false
24975 7505 Acked Write 3 Done Done Sent false
24976 7506 Acked Read 10 Done Done Sent false
24977 7507 Acked Write 4 Done Done Sent false
24978 7508 Acked Read 7 Done Done Sent false
24979 7509 Acked Write 8 Done Done Sent false
24980 7510 Acked Read 1 Done Done Sent false
24981 7511 Acked Read 6 Done Done Sent false
24982 7512 Acked Read 9 Done Done Sent false
24983 7513 Acked Write 7 Done Done Sent false
24984 7514 Acked Write 1 Done Done Sent false
24985 7515 Acked Read 10 Done Done Sent false
24986 7516 Acked Read 3 Done Done Sent false
24987 7517 Acked Read 2 Done Done Sent false
24988 7518 Acked Read 8 Done Done Sent false
24989 7519 Acked Read 6 Done Done Sent false
24990 7520 Acked Flush 0 Done Done Sent false
24991 7521 Acked Read 2 Done Done Sent false
24992 7522 Acked Write 3 Done Done Sent false
24993 7523 Acked Read 1 Done Done Sent false
24994 7524 Acked Write 7 Done Done Sent false
24995 7525 Acked Write 6 Done Done Sent false
24996 7526 Acked Flush 0 Done Done Sent false
24997 7527 Acked Write 7 Done Done Sent false
24998 7528 Acked Write 7 Done Done Sent false
24999 7529 Acked Read 1 Done Done Sent false
25000 7530 Acked Read 3 Done Done Sent false
25001 7531 Acked Read 8 Done Done Sent false
25002 7532 Acked Write 2 Done Done Sent false
25003 7533 Acked Write 10 Done Done Sent false
25004 7534 Acked Write 3 Done Done Sent false
25005 7535 Acked Flush 0 Done Done Sent false
25006 7536 Acked Write 9 Done Done Sent false
25007 7537 Acked Write 9 Done Done Sent false
25008 7538 Acked Read 1 Done Done Sent false
25009 7539 Acked Flush 0 Done Done Sent false
25010 7540 Acked Write 9 Done Done Sent false
25011 7541 Acked Read 9 Done Done Sent false
25012 7542 Acked Read 1 Done Done Sent false
25013 7543 Acked Write 5 Done Done Sent false
25014 7544 Acked Write 3 Done Done Sent false
25015 7545 Acked Write 4 Done Done Sent false
25016 7546 Acked Write 3 Done Done Sent false
25017 7547 Acked Write 9 Done Done Sent false
25018 7548 Acked Write 5 Done Done Sent false
25019 7549 Acked Write 4 Done Done Sent false
25020 7550 Acked Read 1 Done Done Sent false
25021 7551 Acked Write 1 Done Done Sent false
25022 7552 Acked Read 4 Done Done Sent false
25023 7553 Acked Write 4 Done Done Sent false
25024 7554 Acked Read 2 Done Done Sent false
25025 7555 Acked Flush 0 Done Done Sent false
25026 7556 Acked Write 2 Done Done Sent false
25027 7557 Acked Flush 0 Done Done Sent false
25028 7558 Acked Read 2 Done Done Sent false
25029 7559 Acked Read 4 Done Done Sent false
25030 7560 Acked Write 2 Done Done Sent false
25031 7561 Acked Read 5 Done Done Sent false
25032 7562 Acked Write 4 Done Done Sent false
25033 7563 Acked Read 2 Done Done Sent false
25034 7564 Acked Write 1 Done Done Sent false
25035 7565 Acked Read 5 Done Done Sent false
25036 7566 Acked Flush 0 Done Done Sent false
25037 7567 Acked Read 9 Done Done Sent false
25038 7568 Acked Read 2 Done Done Sent false
25039 7569 Acked Read 4 Done Done Sent false
25040 7570 Acked Read 2 Done Done Sent false
25041 7571 Acked Write 8 Done Done Sent false
25042 7572 Acked Write 7 Done Done Sent false
25043 7573 Acked Read 7 Done Done Sent false
25044 7574 Acked Read 5 Done Done Sent false
25045 7575 Acked Read 1 Done Done Sent false
25046 7576 Acked Write 2 Done Done Sent false
25047 7577 Acked Read 4 Done Done Sent false
25048 7578 Acked Read 9 Done Done Sent false
25049 7579 Acked Read 7 Done Done Sent false
25050 7580 Acked Read 8 Done Done Sent false
25051 7581 Acked Write 4 Done Done Sent false
25052 7582 Acked Write 4 Done Done Sent false
25053 7583 Acked Write 1 Done Done Sent false
25054 7584 Acked Read 8 Done Done Sent false
25055 7585 Acked Read 1 Done Done Sent false
25056 7586 Acked Read 6 Done Done Sent false
25057 7587 Acked Write 6 Done Done Sent false
25058 7588 Acked Write 2 Done Done Sent false
25059 7589 Acked Write 8 Done Done Sent false
25060 7590 Acked Write 1 Done Done Sent false
25061 7591 Acked Read 2 Done Done Sent false
25062 7592 Acked Read 6 Done Done Sent false
25063 7593 Acked Read 1 Done Done Sent false
25064 7594 Acked Write 2 Done Done Sent false
25065 7595 Acked Read 5 Done Done Sent false
25066 7596 Acked Flush 0 Done Done Sent false
25067 7597 Acked Read 6 Done Done Sent false
25068 7598 Acked Read 9 Done Done Sent false
25069 7599 Acked Write 1 Done Done Sent false
25070 7600 Acked Write 4 Done Done Sent false
25071 7601 Acked Read 5 Done Done Sent false
25072 7602 Acked Write 3 Done Done Sent false
25073 7603 Acked Write 9 Done Done Sent false
25074 7604 Acked Write 2 Done Done Sent false
25075 7605 Acked Read 6 Done Done Sent false
25076 7606 Acked Flush 0 Done Done Sent false
25077 7607 Acked Read 8 Done Done Sent false
25078 7608 Acked Write 1 Done Done Sent false
25079 7609 Acked Flush 0 Done Done Sent false
25080 7610 Acked Read 7 Done Done Sent false
25081 7611 Acked Read 3 Done Done Sent false
25082 7612 Acked Read 9 Done Done Sent false
25083 7613 Acked Read 6 Done Done Sent false
25084 7614 Acked Read 10 Done Done Sent false
25085 7615 Acked Read 7 Done Done Sent false
25086 7616 Acked Write 10 Done Done Sent false
25087 7617 Acked Read 2 Done Done Sent false
25088 7618 Acked Read 10 Done Done Sent false
25089 7619 Acked Write 7 Done Done Sent false
25090 7620 Acked Read 10 Done Done Sent false
25091 7621 Acked Read 9 Done Done Sent false
25092 7622 Acked Read 7 Done Done Sent false
25093 7623 Acked Write 10 Done Done Sent false
25094 7624 Acked Write 10 Done Done Sent false
25095 7625 Acked Read 6 Done Done Sent false
25096 7626 Acked Read 2 Done Done Sent false
25097 7627 Acked Write 4 Done Done Sent false
25098 7628 Acked Write 5 Done Done Sent false
25099 7629 Acked Read 1 Done Done Sent false
25100 7630 Acked Read 7 Done Done Sent false
25101 7631 Acked Read 6 Done Done Sent false
25102 7632 Acked Read 2 Done Done Sent false
25103 7633 Acked Write 9 Done Done Sent false
25104 7634 Acked Write 10 Done Done Sent false
25105 7635 Acked Flush 0 Done Done Sent false
25106 7636 Acked Write 5 Done Done Sent false
25107 7637 Acked Read 10 Done Done Sent false
25108 7638 Acked Write 10 Done Done Sent false
25109 7639 Acked Write 6 Done Done Sent false
25110 7640 Acked Flush 0 Done Done Sent false
25111 STATES DS:0 DS:1 DS:2 TOTAL
25112 Sent 0 0 302 302
25113 Done 302 302 0 604
25114 Skipped 0 0 0 0
25115 Error 0 0 0 0
25116 Last Flush: 7640 7640 7338
25117 Downstairs last five completed: 7338 7337 7336 7335 7334
25118 Upstairs last five completed: 7640 7639 7638 7637 7636
25119 CLIENT: Up:0 ds:302 act:2
25120 ----------------------------------------------------------------
25121 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:302
25122 States: Active Active Offline
25123 JOBID ACK TYPE BKS/EXT DS:0 DS:1 DS:2 REPLAY
25124 7339 Acked Read 2 Done Done Sent false
25125 7340 Acked Read 8 Done Done Sent false
25126 7341 Acked Write 9 Done Done Sent false
25127 7342 Acked Write 10 Done Done Sent false
25128 7343 Acked Read 1 Done Done Sent false
25129 7344 Acked Read 5 Done Done Sent false
25130 7345 Acked Write 4 Done Done Sent false
25131 7346 Acked Read 1 Done Done Sent false
25132 7347 Acked Flush 0 Done Done Sent false
25133 7348 Acked Write 7 Done Done Sent false
25134 7349 Acked Write 5 Done Done Sent false
25135 7350 Acked Write 3 Done Done Sent false
25136 7351 Acked Flush 0 Done Done Sent false
25137 7352 Acked Write 9 Done Done Sent false
25138 7353 Acked Read 5 Done Done Sent false
25139 7354 Acked Flush 0 Done Done Sent false
25140 7355 Acked Write 9 Done Done Sent false
25141 7356 Acked Write 8 Done Done Sent false
25142 7357 Acked Read 3 Done Done Sent false
25143 7358 Acked Write 3 Done Done Sent false
25144 7359 Acked Flush 0 Done Done Sent false
25145 7360 Acked Write 7 Done Done Sent false
25146 7361 Acked Write 7 Done Done Sent false
25147 7362 Acked Read 6 Done Done Sent false
25148 7363 Acked Write 5 Done Done Sent false
25149 7364 Acked Read 1 Done Done Sent false
25150 7365 Acked Flush 0 Done Done Sent false
25151 7366 Acked Write 4 Done Done Sent false
25152 7367 Acked Write 1 Done Done Sent false
25153 7368 Acked Read 2 Done Done Sent false
25154 7369 Acked Read 8 Done Done Sent false
25155 7370 Acked Flush 0 Done Done Sent false
25156 7371 Acked Read 1 Done Done Sent false
25157 7372 Acked Write 7 Done Done Sent false
25158 7373 Acked Read 2 Done Done Sent false
25159 7374 Acked Write 2 Done Done Sent false
25160 7375 Acked Read 1 Done Done Sent false
25161 7376 Acked Write 8 Done Done Sent false
25162 7377 Acked Read 1 Done Done Sent false
25163 7378 Acked Read 1 Done Done Sent false
25164 7379 Acked Write 3 Done Done Sent false
25165 7380 Acked Read 10 Done Done Sent false
25166 7381 Acked Write 3 Done Done Sent false
25167 7382 Acked Write 7 Done Done Sent false
25168 7383 Acked Read 7 Done Done Sent false
25169 7384 Acked Write 2 Done Done Sent false
25170 7385 Acked Write 7 Done Done Sent false
25171 7386 Acked Write 5 Done Done Sent false
25172 7387 Acked Write 2 Done Done Sent false
25173 7388 Acked Read 7 Done Done Sent false
25174 7389 Acked Write 10 Done Done Sent false
25175 7390 Acked Flush 0 Done Done Sent false
25176 7391 Acked Read 7 Done Done Sent false
25177 7392 Acked Flush 0 Done Done Sent false
25178 7393 Acked Flush 0 Done Done Sent false
25179 7394 Acked Write 1 Done Done Sent false
25180 7395 Acked Write 10 Done Done Sent false
25181 7396 Acked Write 3 Done Done Sent false
25182 7397 Acked Read 9 Done Done Sent false
25183 7398 Acked Read 3 Done Done Sent false
25184 7399 Acked Read 6 Done Done Sent false
25185 7400 Acked Read 8 Done Done Sent false
25186 7401 Acked Write 3 Done Done Sent false
25187 7402 Acked Write 9 Done Done Sent false
25188 7403 Acked Read 7 Done Done Sent false
25189 7404 Acked Write 6 Done Done Sent false
25190 7405 Acked Write 5 Done Done Sent false
25191 7406 Acked Write 1 Done Done Sent false
25192 7407 Acked Read 9 Done Done Sent false
25193 7408 Acked Read 9 Done Done Sent false
25194 7409 Acked Flush 0 Done Done Sent false
25195 7410 Acked Read 6 Done Done Sent false
25196 7411 Acked Flush 0 Done Done Sent false
25197 7412 Acked Write 9 Done Done Sent false
25198 7413 Acked Read 4 Done Done Sent false
25199 7414 Acked Write 2 Done Done Sent false
25200 7415 Acked Read 10 Done Done Sent false
25201 7416 Acked Read 6 Done Done Sent false
25202 7417 Acked Write 8 Done Done Sent false
25203 7418 Acked Write 10 Done Done Sent false
25204 7419 Acked Write 1 Done Done Sent false
25205 7420 Acked Write 10 Done Done Sent false
25206 7421 Acked Flush 0 Done Done Sent false
25207 7422 Acked Read 7 Done Done Sent false
25208 7423 Acked Write 4 Done Done Sent false
25209 7424 Acked Write 7 Done Done Sent false
25210 7425 Acked Write 3 Done Done Sent false
25211 7426 Acked Read 2 Done Done Sent false
25212 7427 Acked Read 1 Done Done Sent false
25213 7428 Acked Read 5 Done Done Sent false
25214 7429 Acked Write 6 Done Done Sent false
25215 7430 Acked Read 3 Done Done Sent false
25216 7431 Acked Write 3 Done Done Sent false
25217 7432 Acked Read 7 Done Done Sent false
25218 7433 Acked Write 10 Done Done Sent false
25219 7434 Acked Read 9 Done Done Sent false
25220 7435 Acked Flush 0 Done Done Sent false
25221 7436 Acked Read 4 Done Done Sent false
25222 7437 Acked Read 10 Done Done Sent false
25223 7438 Acked Write 10 Done Done Sent false
25224 7439 Acked Read 9 Done Done Sent false
25225 7440 Acked Read 5 Done Done Sent false
25226 7441 Acked Read 5 Done Done Sent false
25227 7442 Acked Write 10 Done Done Sent false
25228 7443 Acked Write 7 Done Done Sent false
25229 7444 Acked Write 10 Done Done Sent false
25230 7445 Acked Read 6 Done Done Sent false
25231 7446 Acked Read 9 Done Done Sent false
25232 7447 Acked Write 6 Done Done Sent false
25233 7448 Acked Read 10 Done Done Sent false
25234 7449 Acked Write 4 Done Done Sent false
25235 7450 Acked Write 7 Done Done Sent false
25236 7451 Acked Read 3 Done Done Sent false
25237 7452 Acked Write 10 Done Done Sent false
25238 7453 Acked Read 10 Done Done Sent false
25239 7454 Acked Read 6 Done Done Sent false
25240 7455 Acked Write 2 Done Done Sent false
25241 7456 Acked Write 5 Done Done Sent false
25242 7457 Acked Write 3 Done Done Sent false
25243 7458 Acked Write 3 Done Done Sent false
25244 7459 Acked Read 2 Done Done Sent false
25245 7460 Acked Read 1 Done Done Sent false
25246 7461 Acked Write 3 Done Done Sent false
25247 7462 Acked Read 1 Done Done Sent false
25248 7463 Acked Read 6 Done Done Sent false
25249 7464 Acked Read 8 Done Done Sent false
25250 7465 Acked Read 10 Done Done Sent false
25251 7466 Acked Read 1 Done Done Sent false
25252 7467 Acked Write 4 Done Done Sent false
25253 7468 Acked Read 6 Done Done Sent false
25254 7469 Acked Read 1 Done Done Sent false
25255 7470 Acked Read 4 Done Done Sent false
25256 7471 Acked Write 5 Done Done Sent false
25257 7472 Acked Read 1 Done Done Sent false
25258 7473 Acked Read 1 Done Done Sent false
25259 7474 Acked Write 4 Done Done Sent false
25260 7475 Acked Read 10 Done Done Sent false
25261 7476 Acked Read 5 Done Done Sent false
25262 7477 Acked Write 6 Done Done Sent false
25263 7478 Acked Read 1 Done Done Sent false
25264 7479 Acked Read 3 Done Done Sent false
25265 7480 Acked Read 7 Done Done Sent false
25266 7481 Acked Write 1 Done Done Sent false
25267 7482 Acked Write 10 Done Done Sent false
25268 7483 Acked Write 9 Done Done Sent false
25269 7484 Acked Read 4 Done Done Sent false
25270 7485 Acked Read 5 Done Done Sent false
25271 7486 Acked Flush 0 Done Done Sent false
25272 7487 Acked Write 5 Done Done Sent false
25273 7488 Acked Write 7 Done Done Sent false
25274 7489 Acked Read 4 Done Done Sent false
25275 7490 Acked Write 1 Done Done Sent false
25276 7491 Acked Flush 0 Done Done Sent false
25277 7492 Acked Write 10 Done Done Sent false
25278 7493 Acked Write 5 Done Done Sent false
25279 7494 Acked Read 6 Done Done Sent false
25280 7495 Acked Flush 0 Done Done Sent false
25281 7496 Acked Read 3 Done Done Sent false
25282 7497 Acked Write 3 Done Done Sent false
25283 7498 Acked Write 3 Done Done Sent false
25284 7499 Acked Write 10 Done Done Sent false
25285 7500 Acked Read 6 Done Done Sent false
25286 7501 Acked Flush 0 Done Done Sent false
25287 7502 Acked Write 10 Done Done Sent false
25288 7503 Acked Write 6 Done Done Sent false
25289 7504 Acked Write 8 Done Done Sent false
25290 7505 Acked Write 3 Done Done Sent false
25291 7506 Acked Read 10 Done Done Sent false
25292 7507 Acked Write 4 Done Done Sent false
25293 7508 Acked Read 7 Done Done Sent false
25294 7509 Acked Write 8 Done Done Sent false
25295 7510 Acked Read 1 Done Done Sent false
25296 7511 Acked Read 6 Done Done Sent false
25297 7512 Acked Read 9 Done Done Sent false
25298 7513 Acked Write 7 Done Done Sent false
25299 7514 Acked Write 1 Done Done Sent false
25300 7515 Acked Read 10 Done Done Sent false
25301 7516 Acked Read 3 Done Done Sent false
25302 7517 Acked Read 2 Done Done Sent false
25303 7518 Acked Read 8 Done Done Sent false
25304 7519 Acked Read 6 Done Done Sent false
25305 7520 Acked Flush 0 Done Done Sent false
25306 7521 Acked Read 2 Done Done Sent false
25307 7522 Acked Write 3 Done Done Sent false
25308 7523 Acked Read 1 Done Done Sent false
25309 7524 Acked Write 7 Done Done Sent false
25310 7525 Acked Write 6 Done Done Sent false
25311 7526 Acked Flush 0 Done Done Sent false
25312 7527 Acked Write 7 Done Done Sent false
25313 7528 Acked Write 7 Done Done Sent false
25314 7529 Acked Read 1 Done Done Sent false
25315 7530 Acked Read 3 Done Done Sent false
25316 7531 Acked Read 8 Done Done Sent false
25317 7532 Acked Write 2 Done Done Sent false
25318 7533 Acked Write 10 Done Done Sent false
25319 7534 Acked Write 3 Done Done Sent false
25320 7535 Acked Flush 0 Done Done Sent false
25321 7536 Acked Write 9 Done Done Sent false
25322 7537 Acked Write 9 Done Done Sent false
25323 7538 Acked Read 1 Done Done Sent false
25324 7539 Acked Flush 0 Done Done Sent false
25325 7540 Acked Write 9 Done Done Sent false
25326 7541 Acked Read 9 Done Done Sent false
25327 7542 Acked Read 1 Done Done Sent false
25328 7543 Acked Write 5 Done Done Sent false
25329 7544 Acked Write 3 Done Done Sent false
25330 7545 Acked Write 4 Done Done Sent false
25331 7546 Acked Write 3 Done Done Sent false
25332 7547 Acked Write 9 Done Done Sent false
25333 7548 Acked Write 5 Done Done Sent false
25334 7549 Acked Write 4 Done Done Sent false
25335 7550 Acked Read 1 Done Done Sent false
25336 7551 Acked Write 1 Done Done Sent false
25337 7552 Acked Read 4 Done Done Sent false
25338 7553 Acked Write 4 Done Done Sent false
25339 7554 Acked Read 2 Done Done Sent false
25340 7555 Acked Flush 0 Done Done Sent false
25341 7556 Acked Write 2 Done Done Sent false
25342 7557 Acked Flush 0 Done Done Sent false
25343 7558 Acked Read 2 Done Done Sent false
25344 7559 Acked Read 4 Done Done Sent false
25345 7560 Acked Write 2 Done Done Sent false
25346 7561 Acked Read 5 Done Done Sent false
25347 7562 Acked Write 4 Done Done Sent false
25348 7563 Acked Read 2 Done Done Sent false
25349 7564 Acked Write 1 Done Done Sent false
25350 7565 Acked Read 5 Done Done Sent false
25351 7566 Acked Flush 0 Done Done Sent false
25352 7567 Acked Read 9 Done Done Sent false
25353 7568 Acked Read 2 Done Done Sent false
25354 7569 Acked Read 4 Done Done Sent false
25355 7570 Acked Read 2 Done Done Sent false
25356 7571 Acked Write 8 Done Done Sent false
25357 7572 Acked Write 7 Done Done Sent false
25358 7573 Acked Read 7 Done Done Sent false
25359 7574 Acked Read 5 Done Done Sent false
25360 7575 Acked Read 1 Done Done Sent false
25361 7576 Acked Write 2 Done Done Sent false
25362 7577 Acked Read 4 Done Done Sent false
25363 7578 Acked Read 9 Done Done Sent false
25364 7579 Acked Read 7 Done Done Sent false
25365 7580 Acked Read 8 Done Done Sent false
25366 7581 Acked Write 4 Done Done Sent false
25367 7582 Acked Write 4 Done Done Sent false
25368 7583 Acked Write 1 Done Done Sent false
25369 7584 Acked Read 8 Done Done Sent false
25370 7585 Acked Read 1 Done Done Sent false
25371 7586 Acked Read 6 Done Done Sent false
25372 7587 Acked Write 6 Done Done Sent false
25373 7588 Acked Write 2 Done Done Sent false
25374 7589 Acked Write 8 Done Done Sent false
25375 7590 Acked Write 1 Done Done Sent false
25376 7591 Acked Read 2 Done Done Sent false
25377 7592 Acked Read 6 Done Done Sent false
25378 7593 Acked Read 1 Done Done Sent false
25379 7594 Acked Write 2 Done Done Sent false
25380 7595 Acked Read 5 Done Done Sent false
25381 7596 Acked Flush 0 Done Done Sent false
25382 7597 Acked Read 6 Done Done Sent false
25383 7598 Acked Read 9 Done Done Sent false
25384 7599 Acked Write 1 Done Done Sent false
25385 7600 Acked Write 4 Done Done Sent false
25386 7601 Acked Read 5 Done Done Sent false
25387 7602 Acked Write 3 Done Done Sent false
25388 7603 Acked Write 9 Done Done Sent false
25389 7604 Acked Write 2 Done Done Sent false
25390 7605 Acked Read 6 Done Done Sent false
25391 7606 Acked Flush 0 Done Done Sent false
25392 7607 Acked Read 8 Done Done Sent false
25393 7608 Acked Write 1 Done Done Sent false
25394 7609 Acked Flush 0 Done Done Sent false
25395 7610 Acked Read 7 Done Done Sent false
25396 7611 Acked Read 3 Done Done Sent false
25397 7612 Acked Read 9 Done Done Sent false
25398 7613 Acked Read 6 Done Done Sent false
25399 7614 Acked Read 10 Done Done Sent false
25400 7615 Acked Read 7 Done Done Sent false
25401 7616 Acked Write 10 Done Done Sent false
25402 7617 Acked Read 2 Done Done Sent false
25403 7618 Acked Read 10 Done Done Sent false
25404 7619 Acked Write 7 Done Done Sent false
25405 7620 Acked Read 10 Done Done Sent false
25406 7621 Acked Read 9 Done Done Sent false
25407 7622 Acked Read 7 Done Done Sent false
25408 7623 Acked Write 10 Done Done Sent false
25409 7624 Acked Write 10 Done Done Sent false
25410 7625 Acked Read 6 Done Done Sent false
25411 7626 Acked Read 2 Done Done Sent false
25412 7627 Acked Write 4 Done Done Sent false
25413 7628 Acked Write 5 Done Done Sent false
25414 7629 Acked Read 1 Done Done Sent false
25415 7630 Acked Read 7 Done Done Sent false
25416 7631 Acked Read 6 Done Done Sent false
25417 7632 Acked Read 2 Done Done Sent false
25418 7633 Acked Write 9 Done Done Sent false
25419 7634 Acked Write 10 Done Done Sent false
25420 7635 Acked Flush 0 Done Done Sent false
25421 7636 Acked Write 5 Done Done Sent false
25422 7637 Acked Read 10 Done Done Sent false
25423 7638 Acked Write 10 Done Done Sent false
25424 7639 Acked Write 6 Done Done Sent false
25425 7640 Acked Flush 0 Done Done Sent false
25426 STATES DS:0 DS:1 DS:2 TOTAL
25427 Sent 0 0 302 302
25428 Done 302 302 0 604
25429 Skipped 0 0 0 0
25430 Error 0 0 0 0
25431 Last Flush: 7640 7640 7338
25432 Downstairs last five completed: 7338 7337 7336 7335 7334
25433 Upstairs last five completed: 7640 7639 7638 7637 7636
25434 CLIENT: Up:0 ds:302 act:2
254352025-01-10T16:40:40.912ZINFOcrucible: connecting to 127.0.0.1:8830 = io task client = 2 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
254362025-01-10T16:40:40.912ZWARNcrucible: ds_connection connect to 127.0.0.1:8830 failure: Os { code: 146, kind: ConnectionRefused, message: "Connection refused" } = io task client = 2 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
254372025-01-10T16:40:40.912ZWARNcrucible: client task is sending Done(ConnectionFailed(Os { code: 146, kind: ConnectionRefused, message: "Connection refused" })) = io task client = 2 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
254382025-01-10T16:40:40.912ZWARNcrucible: downstairs task for 2 stopped due to ConnectionFailed(Os { code: 146, kind: ConnectionRefused, message: "Connection refused" }) session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
254392025-01-10T16:40:40.912ZINFOcrucible: client task is exiting = io task client = 2 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
25440 [8830] got start action
25441 [8830] I am going to restart
25442 Starting downstairs at port 8830
25443 Make output file at "/tmp/dsc/downstairs-8830.txt"
25444 [8830][2] reports Starting
25445 Downstairs /var/tmp/dsc/region/8830 port 8830 PID:Some(1224)
25446 [8830][2] reports Running
25447 ----------------------------------------------------------------
25448 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:302
25449 States: Active Active Offline
25450 JOBID ACK TYPE BKS/EXT DS:0 DS:1 DS:2 REPLAY
25451 7339 Acked Read 2 Done Done Sent false
25452 7340 Acked Read 8 Done Done Sent false
25453 7341 Acked Write 9 Done Done Sent false
25454 7342 Acked Write 10 Done Done Sent false
25455 7343 Acked Read 1 Done Done Sent false
25456 7344 Acked Read 5 Done Done Sent false
25457 7345 Acked Write 4 Done Done Sent false
25458 7346 Acked Read 1 Done Done Sent false
25459 7347 Acked Flush 0 Done Done Sent false
25460 7348 Acked Write 7 Done Done Sent false
25461 7349 Acked Write 5 Done Done Sent false
25462 7350 Acked Write 3 Done Done Sent false
25463 7351 Acked Flush 0 Done Done Sent false
25464 7352 Acked Write 9 Done Done Sent false
25465 7353 Acked Read 5 Done Done Sent false
25466 7354 Acked Flush 0 Done Done Sent false
25467 7355 Acked Write 9 Done Done Sent false
25468 7356 Acked Write 8 Done Done Sent false
25469 7357 Acked Read 3 Done Done Sent false
25470 7358 Acked Write 3 Done Done Sent false
25471 7359 Acked Flush 0 Done Done Sent false
25472 7360 Acked Write 7 Done Done Sent false
25473 7361 Acked Write 7 Done Done Sent false
25474 7362 Acked Read 6 Done Done Sent false
25475 7363 Acked Write 5 Done Done Sent false
25476 7364 Acked Read 1 Done Done Sent false
25477 7365 Acked Flush 0 Done Done Sent false
25478 7366 Acked Write 4 Done Done Sent false
25479 7367 Acked Write 1 Done Done Sent false
25480 7368 Acked Read 2 Done Done Sent false
25481 7369 Acked Read 8 Done Done Sent false
25482 7370 Acked Flush 0 Done Done Sent false
25483 7371 Acked Read 1 Done Done Sent false
25484 7372 Acked Write 7 Done Done Sent false
25485 7373 Acked Read 2 Done Done Sent false
25486 7374 Acked Write 2 Done Done Sent false
25487 7375 Acked Read 1 Done Done Sent false
25488 7376 Acked Write 8 Done Done Sent false
25489 7377 Acked Read 1 Done Done Sent false
25490 7378 Acked Read 1 Done Done Sent false
25491 7379 Acked Write 3 Done Done Sent false
25492 7380 Acked Read 10 Done Done Sent false
25493 7381 Acked Write 3 Done Done Sent false
25494 7382 Acked Write 7 Done Done Sent false
25495 7383 Acked Read 7 Done Done Sent false
25496 7384 Acked Write 2 Done Done Sent false
25497 7385 Acked Write 7 Done Done Sent false
25498 7386 Acked Write 5 Done Done Sent false
25499 7387 Acked Write 2 Done Done Sent false
25500 7388 Acked Read 7 Done Done Sent false
25501 7389 Acked Write 10 Done Done Sent false
25502 7390 Acked Flush 0 Done Done Sent false
25503 7391 Acked Read 7 Done Done Sent false
25504 7392 Acked Flush 0 Done Done Sent false
25505 7393 Acked Flush 0 Done Done Sent false
25506 7394 Acked Write 1 Done Done Sent false
25507 7395 Acked Write 10 Done Done Sent false
25508 7396 Acked Write 3 Done Done Sent false
25509 7397 Acked Read 9 Done Done Sent false
25510 7398 Acked Read 3 Done Done Sent false
25511 7399 Acked Read 6 Done Done Sent false
25512 7400 Acked Read 8 Done Done Sent false
25513 7401 Acked Write 3 Done Done Sent false
25514 7402 Acked Write 9 Done Done Sent false
25515 7403 Acked Read 7 Done Done Sent false
25516 7404 Acked Write 6 Done Done Sent false
25517 7405 Acked Write 5 Done Done Sent false
25518 7406 Acked Write 1 Done Done Sent false
25519 7407 Acked Read 9 Done Done Sent false
25520 7408 Acked Read 9 Done Done Sent false
25521 7409 Acked Flush 0 Done Done Sent false
25522 7410 Acked Read 6 Done Done Sent false
25523 7411 Acked Flush 0 Done Done Sent false
25524 7412 Acked Write 9 Done Done Sent false
25525 7413 Acked Read 4 Done Done Sent false
25526 7414 Acked Write 2 Done Done Sent false
25527 7415 Acked Read 10 Done Done Sent false
25528 7416 Acked Read 6 Done Done Sent false
25529 7417 Acked Write 8 Done Done Sent false
25530 7418 Acked Write 10 Done Done Sent false
25531 7419 Acked Write 1 Done Done Sent false
25532 7420 Acked Write 10 Done Done Sent false
25533 7421 Acked Flush 0 Done Done Sent false
25534 7422 Acked Read 7 Done Done Sent false
25535 7423 Acked Write 4 Done Done Sent false
25536 7424 Acked Write 7 Done Done Sent false
25537 7425 Acked Write 3 Done Done Sent false
25538 7426 Acked Read 2 Done Done Sent false
25539 7427 Acked Read 1 Done Done Sent false
25540 7428 Acked Read 5 Done Done Sent false
25541 7429 Acked Write 6 Done Done Sent false
25542 7430 Acked Read 3 Done Done Sent false
25543 7431 Acked Write 3 Done Done Sent false
25544 7432 Acked Read 7 Done Done Sent false
25545 7433 Acked Write 10 Done Done Sent false
25546 7434 Acked Read 9 Done Done Sent false
25547 7435 Acked Flush 0 Done Done Sent false
25548 7436 Acked Read 4 Done Done Sent false
25549 7437 Acked Read 10 Done Done Sent false
25550 7438 Acked Write 10 Done Done Sent false
25551 7439 Acked Read 9 Done Done Sent false
25552 7440 Acked Read 5 Done Done Sent false
25553 7441 Acked Read 5 Done Done Sent false
25554 7442 Acked Write 10 Done Done Sent false
25555 7443 Acked Write 7 Done Done Sent false
25556 7444 Acked Write 10 Done Done Sent false
25557 7445 Acked Read 6 Done Done Sent false
25558 7446 Acked Read 9 Done Done Sent false
25559 7447 Acked Write 6 Done Done Sent false
25560 7448 Acked Read 10 Done Done Sent false
25561 7449 Acked Write 4 Done Done Sent false
25562 7450 Acked Write 7 Done Done Sent false
25563 7451 Acked Read 3 Done Done Sent false
25564 7452 Acked Write 10 Done Done Sent false
25565 7453 Acked Read 10 Done Done Sent false
25566 7454 Acked Read 6 Done Done Sent false
25567 7455 Acked Write 2 Done Done Sent false
25568 7456 Acked Write 5 Done Done Sent false
25569 7457 Acked Write 3 Done Done Sent false
25570 7458 Acked Write 3 Done Done Sent false
25571 7459 Acked Read 2 Done Done Sent false
25572 7460 Acked Read 1 Done Done Sent false
25573 7461 Acked Write 3 Done Done Sent false
25574 7462 Acked Read 1 Done Done Sent false
25575 7463 Acked Read 6 Done Done Sent false
25576 7464 Acked Read 8 Done Done Sent false
25577 7465 Acked Read 10 Done Done Sent false
25578 7466 Acked Read 1 Done Done Sent false
25579 7467 Acked Write 4 Done Done Sent false
25580 7468 Acked Read 6 Done Done Sent false
25581 7469 Acked Read 1 Done Done Sent false
25582 7470 Acked Read 4 Done Done Sent false
25583 7471 Acked Write 5 Done Done Sent false
25584 7472 Acked Read 1 Done Done Sent false
25585 7473 Acked Read 1 Done Done Sent false
25586 7474 Acked Write 4 Done Done Sent false
25587 7475 Acked Read 10 Done Done Sent false
25588 7476 Acked Read 5 Done Done Sent false
25589 7477 Acked Write 6 Done Done Sent false
25590 7478 Acked Read 1 Done Done Sent false
25591 7479 Acked Read 3 Done Done Sent false
25592 7480 Acked Read 7 Done Done Sent false
25593 7481 Acked Write 1 Done Done Sent false
25594 7482 Acked Write 10 Done Done Sent false
25595 7483 Acked Write 9 Done Done Sent false
25596 7484 Acked Read 4 Done Done Sent false
25597 7485 Acked Read 5 Done Done Sent false
25598 7486 Acked Flush 0 Done Done Sent false
25599 7487 Acked Write 5 Done Done Sent false
25600 7488 Acked Write 7 Done Done Sent false
25601 7489 Acked Read 4 Done Done Sent false
25602 7490 Acked Write 1 Done Done Sent false
25603 7491 Acked Flush 0 Done Done Sent false
25604 7492 Acked Write 10 Done Done Sent false
25605 7493 Acked Write 5 Done Done Sent false
25606 7494 Acked Read 6 Done Done Sent false
25607 7495 Acked Flush 0 Done Done Sent false
25608 7496 Acked Read 3 Done Done Sent false
25609 7497 Acked Write 3 Done Done Sent false
25610 7498 Acked Write 3 Done Done Sent false
25611 7499 Acked Write 10 Done Done Sent false
25612 7500 Acked Read 6 Done Done Sent false
25613 7501 Acked Flush 0 Done Done Sent false
25614 7502 Acked Write 10 Done Done Sent false
25615 7503 Acked Write 6 Done Done Sent false
25616 7504 Acked Write 8 Done Done Sent false
25617 7505 Acked Write 3 Done Done Sent false
25618 7506 Acked Read 10 Done Done Sent false
25619 7507 Acked Write 4 Done Done Sent false
25620 7508 Acked Read 7 Done Done Sent false
25621 7509 Acked Write 8 Done Done Sent false
25622 7510 Acked Read 1 Done Done Sent false
25623 7511 Acked Read 6 Done Done Sent false
25624 7512 Acked Read 9 Done Done Sent false
25625 7513 Acked Write 7 Done Done Sent false
25626 7514 Acked Write 1 Done Done Sent false
25627 7515 Acked Read 10 Done Done Sent false
25628 7516 Acked Read 3 Done Done Sent false
25629 7517 Acked Read 2 Done Done Sent false
25630 7518 Acked Read 8 Done Done Sent false
25631 7519 Acked Read 6 Done Done Sent false
25632 7520 Acked Flush 0 Done Done Sent false
25633 7521 Acked Read 2 Done Done Sent false
25634 7522 Acked Write 3 Done Done Sent false
25635 7523 Acked Read 1 Done Done Sent false
25636 7524 Acked Write 7 Done Done Sent false
25637 7525 Acked Write 6 Done Done Sent false
25638 7526 Acked Flush 0 Done Done Sent false
25639 7527 Acked Write 7 Done Done Sent false
25640 7528 Acked Write 7 Done Done Sent false
25641 7529 Acked Read 1 Done Done Sent false
25642 7530 Acked Read 3 Done Done Sent false
25643 7531 Acked Read 8 Done Done Sent false
25644 7532 Acked Write 2 Done Done Sent false
25645 7533 Acked Write 10 Done Done Sent false
25646 7534 Acked Write 3 Done Done Sent false
25647 7535 Acked Flush 0 Done Done Sent false
25648 7536 Acked Write 9 Done Done Sent false
25649 7537 Acked Write 9 Done Done Sent false
25650 7538 Acked Read 1 Done Done Sent false
25651 7539 Acked Flush 0 Done Done Sent false
25652 7540 Acked Write 9 Done Done Sent false
25653 7541 Acked Read 9 Done Done Sent false
25654 7542 Acked Read 1 Done Done Sent false
25655 7543 Acked Write 5 Done Done Sent false
25656 7544 Acked Write 3 Done Done Sent false
25657 7545 Acked Write 4 Done Done Sent false
25658 7546 Acked Write 3 Done Done Sent false
25659 7547 Acked Write 9 Done Done Sent false
25660 7548 Acked Write 5 Done Done Sent false
25661 7549 Acked Write 4 Done Done Sent false
25662 7550 Acked Read 1 Done Done Sent false
25663 7551 Acked Write 1 Done Done Sent false
25664 7552 Acked Read 4 Done Done Sent false
25665 7553 Acked Write 4 Done Done Sent false
25666 7554 Acked Read 2 Done Done Sent false
25667 7555 Acked Flush 0 Done Done Sent false
25668 7556 Acked Write 2 Done Done Sent false
25669 7557 Acked Flush 0 Done Done Sent false
25670 7558 Acked Read 2 Done Done Sent false
25671 7559 Acked Read 4 Done Done Sent false
25672 7560 Acked Write 2 Done Done Sent false
25673 7561 Acked Read 5 Done Done Sent false
25674 7562 Acked Write 4 Done Done Sent false
25675 7563 Acked Read 2 Done Done Sent false
25676 7564 Acked Write 1 Done Done Sent false
25677 7565 Acked Read 5 Done Done Sent false
25678 7566 Acked Flush 0 Done Done Sent false
25679 7567 Acked Read 9 Done Done Sent false
25680 7568 Acked Read 2 Done Done Sent false
25681 7569 Acked Read 4 Done Done Sent false
25682 7570 Acked Read 2 Done Done Sent false
25683 7571 Acked Write 8 Done Done Sent false
25684 7572 Acked Write 7 Done Done Sent false
25685 7573 Acked Read 7 Done Done Sent false
25686 7574 Acked Read 5 Done Done Sent false
25687 7575 Acked Read 1 Done Done Sent false
25688 7576 Acked Write 2 Done Done Sent false
25689 7577 Acked Read 4 Done Done Sent false
25690 7578 Acked Read 9 Done Done Sent false
25691 7579 Acked Read 7 Done Done Sent false
25692 7580 Acked Read 8 Done Done Sent false
25693 7581 Acked Write 4 Done Done Sent false
25694 7582 Acked Write 4 Done Done Sent false
25695 7583 Acked Write 1 Done Done Sent false
25696 7584 Acked Read 8 Done Done Sent false
25697 7585 Acked Read 1 Done Done Sent false
25698 7586 Acked Read 6 Done Done Sent false
25699 7587 Acked Write 6 Done Done Sent false
25700 7588 Acked Write 2 Done Done Sent false
25701 7589 Acked Write 8 Done Done Sent false
25702 7590 Acked Write 1 Done Done Sent false
25703 7591 Acked Read 2 Done Done Sent false
25704 7592 Acked Read 6 Done Done Sent false
25705 7593 Acked Read 1 Done Done Sent false
25706 7594 Acked Write 2 Done Done Sent false
25707 7595 Acked Read 5 Done Done Sent false
25708 7596 Acked Flush 0 Done Done Sent false
25709 7597 Acked Read 6 Done Done Sent false
25710 7598 Acked Read 9 Done Done Sent false
25711 7599 Acked Write 1 Done Done Sent false
25712 7600 Acked Write 4 Done Done Sent false
25713 7601 Acked Read 5 Done Done Sent false
25714 7602 Acked Write 3 Done Done Sent false
25715 7603 Acked Write 9 Done Done Sent false
25716 7604 Acked Write 2 Done Done Sent false
25717 7605 Acked Read 6 Done Done Sent false
25718 7606 Acked Flush 0 Done Done Sent false
25719 7607 Acked Read 8 Done Done Sent false
25720 7608 Acked Write 1 Done Done Sent false
25721 7609 Acked Flush 0 Done Done Sent false
25722 7610 Acked Read 7 Done Done Sent false
25723 7611 Acked Read 3 Done Done Sent false
25724 7612 Acked Read 9 Done Done Sent false
25725 7613 Acked Read 6 Done Done Sent false
25726 7614 Acked Read 10 Done Done Sent false
25727 7615 Acked Read 7 Done Done Sent false
25728 7616 Acked Write 10 Done Done Sent false
25729 7617 Acked Read 2 Done Done Sent false
25730 7618 Acked Read 10 Done Done Sent false
25731 7619 Acked Write 7 Done Done Sent false
25732 7620 Acked Read 10 Done Done Sent false
25733 7621 Acked Read 9 Done Done Sent false
25734 7622 Acked Read 7 Done Done Sent false
25735 7623 Acked Write 10 Done Done Sent false
25736 7624 Acked Write 10 Done Done Sent false
25737 7625 Acked Read 6 Done Done Sent false
25738 7626 Acked Read 2 Done Done Sent false
25739 7627 Acked Write 4 Done Done Sent false
25740 7628 Acked Write 5 Done Done Sent false
25741 7629 Acked Read 1 Done Done Sent false
25742 7630 Acked Read 7 Done Done Sent false
25743 7631 Acked Read 6 Done Done Sent false
25744 7632 Acked Read 2 Done Done Sent false
25745 7633 Acked Write 9 Done Done Sent false
25746 7634 Acked Write 10 Done Done Sent false
25747 7635 Acked Flush 0 Done Done Sent false
25748 7636 Acked Write 5 Done Done Sent false
25749 7637 Acked Read 10 Done Done Sent false
25750 7638 Acked Write 10 Done Done Sent false
25751 7639 Acked Write 6 Done Done Sent false
25752 7640 Acked Flush 0 Done Done Sent false
25753 STATES DS:0 DS:1 DS:2 TOTAL
25754 Sent 0 0 302 302
25755 Done 302 302 0 604
25756 Skipped 0 0 0 0
25757 Error 0 0 0 0
25758 Last Flush: 7640 7640 7338
25759 Downstairs last five completed: 7338 7337 7336 7335 7334
25760 Upstairs last five completed: 7640 7639 7638 7637 7636
25761 CLIENT: Up:0 ds:302 act:2
25762 ----------------------------------------------------------------
25763 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:302
25764 States: Active Active Offline
25765 JOBID ACK TYPE BKS/EXT DS:0 DS:1 DS:2 REPLAY
25766 7339 Acked Read 2 Done Done Sent false
25767 7340 Acked Read 8 Done Done Sent false
25768 7341 Acked Write 9 Done Done Sent false
25769 7342 Acked Write 10 Done Done Sent false
25770 7343 Acked Read 1 Done Done Sent false
25771 7344 Acked Read 5 Done Done Sent false
25772 7345 Acked Write 4 Done Done Sent false
25773 7346 Acked Read 1 Done Done Sent false
25774 7347 Acked Flush 0 Done Done Sent false
25775 7348 Acked Write 7 Done Done Sent false
25776 7349 Acked Write 5 Done Done Sent false
25777 7350 Acked Write 3 Done Done Sent false
25778 7351 Acked Flush 0 Done Done Sent false
25779 7352 Acked Write 9 Done Done Sent false
25780 7353 Acked Read 5 Done Done Sent false
25781 7354 Acked Flush 0 Done Done Sent false
25782 7355 Acked Write 9 Done Done Sent false
25783 7356 Acked Write 8 Done Done Sent false
25784 7357 Acked Read 3 Done Done Sent false
25785 7358 Acked Write 3 Done Done Sent false
25786 7359 Acked Flush 0 Done Done Sent false
25787 7360 Acked Write 7 Done Done Sent false
25788 7361 Acked Write 7 Done Done Sent false
25789 7362 Acked Read 6 Done Done Sent false
25790 7363 Acked Write 5 Done Done Sent false
25791 7364 Acked Read 1 Done Done Sent false
25792 7365 Acked Flush 0 Done Done Sent false
25793 7366 Acked Write 4 Done Done Sent false
25794 7367 Acked Write 1 Done Done Sent false
25795 7368 Acked Read 2 Done Done Sent false
25796 7369 Acked Read 8 Done Done Sent false
25797 7370 Acked Flush 0 Done Done Sent false
25798 7371 Acked Read 1 Done Done Sent false
25799 7372 Acked Write 7 Done Done Sent false
25800 7373 Acked Read 2 Done Done Sent false
25801 7374 Acked Write 2 Done Done Sent false
25802 7375 Acked Read 1 Done Done Sent false
25803 7376 Acked Write 8 Done Done Sent false
25804 7377 Acked Read 1 Done Done Sent false
25805 7378 Acked Read 1 Done Done Sent false
25806 7379 Acked Write 3 Done Done Sent false
25807 7380 Acked Read 10 Done Done Sent false
25808 7381 Acked Write 3 Done Done Sent false
25809 7382 Acked Write 7 Done Done Sent false
25810 7383 Acked Read 7 Done Done Sent false
25811 7384 Acked Write 2 Done Done Sent false
25812 7385 Acked Write 7 Done Done Sent false
25813 7386 Acked Write 5 Done Done Sent false
25814 7387 Acked Write 2 Done Done Sent false
25815 7388 Acked Read 7 Done Done Sent false
25816 7389 Acked Write 10 Done Done Sent false
25817 7390 Acked Flush 0 Done Done Sent false
25818 7391 Acked Read 7 Done Done Sent false
25819 7392 Acked Flush 0 Done Done Sent false
25820 7393 Acked Flush 0 Done Done Sent false
25821 7394 Acked Write 1 Done Done Sent false
25822 7395 Acked Write 10 Done Done Sent false
25823 7396 Acked Write 3 Done Done Sent false
25824 7397 Acked Read 9 Done Done Sent false
25825 7398 Acked Read 3 Done Done Sent false
25826 7399 Acked Read 6 Done Done Sent false
25827 7400 Acked Read 8 Done Done Sent false
25828 7401 Acked Write 3 Done Done Sent false
25829 7402 Acked Write 9 Done Done Sent false
25830 7403 Acked Read 7 Done Done Sent false
25831 7404 Acked Write 6 Done Done Sent false
25832 7405 Acked Write 5 Done Done Sent false
25833 7406 Acked Write 1 Done Done Sent false
25834 7407 Acked Read 9 Done Done Sent false
25835 7408 Acked Read 9 Done Done Sent false
25836 7409 Acked Flush 0 Done Done Sent false
25837 7410 Acked Read 6 Done Done Sent false
25838 7411 Acked Flush 0 Done Done Sent false
25839 7412 Acked Write 9 Done Done Sent false
25840 7413 Acked Read 4 Done Done Sent false
25841 7414 Acked Write 2 Done Done Sent false
25842 7415 Acked Read 10 Done Done Sent false
25843 7416 Acked Read 6 Done Done Sent false
25844 7417 Acked Write 8 Done Done Sent false
25845 7418 Acked Write 10 Done Done Sent false
25846 7419 Acked Write 1 Done Done Sent false
25847 7420 Acked Write 10 Done Done Sent false
25848 7421 Acked Flush 0 Done Done Sent false
25849 7422 Acked Read 7 Done Done Sent false
25850 7423 Acked Write 4 Done Done Sent false
25851 7424 Acked Write 7 Done Done Sent false
25852 7425 Acked Write 3 Done Done Sent false
25853 7426 Acked Read 2 Done Done Sent false
25854 7427 Acked Read 1 Done Done Sent false
25855 7428 Acked Read 5 Done Done Sent false
25856 7429 Acked Write 6 Done Done Sent false
25857 7430 Acked Read 3 Done Done Sent false
25858 7431 Acked Write 3 Done Done Sent false
25859 7432 Acked Read 7 Done Done Sent false
25860 7433 Acked Write 10 Done Done Sent false
25861 7434 Acked Read 9 Done Done Sent false
25862 7435 Acked Flush 0 Done Done Sent false
25863 7436 Acked Read 4 Done Done Sent false
25864 7437 Acked Read 10 Done Done Sent false
25865 7438 Acked Write 10 Done Done Sent false
25866 7439 Acked Read 9 Done Done Sent false
25867 7440 Acked Read 5 Done Done Sent false
25868 7441 Acked Read 5 Done Done Sent false
25869 7442 Acked Write 10 Done Done Sent false
25870 7443 Acked Write 7 Done Done Sent false
25871 7444 Acked Write 10 Done Done Sent false
25872 7445 Acked Read 6 Done Done Sent false
25873 7446 Acked Read 9 Done Done Sent false
25874 7447 Acked Write 6 Done Done Sent false
25875 7448 Acked Read 10 Done Done Sent false
25876 7449 Acked Write 4 Done Done Sent false
25877 7450 Acked Write 7 Done Done Sent false
25878 7451 Acked Read 3 Done Done Sent false
25879 7452 Acked Write 10 Done Done Sent false
25880 7453 Acked Read 10 Done Done Sent false
25881 7454 Acked Read 6 Done Done Sent false
25882 7455 Acked Write 2 Done Done Sent false
25883 7456 Acked Write 5 Done Done Sent false
25884 7457 Acked Write 3 Done Done Sent false
25885 7458 Acked Write 3 Done Done Sent false
25886 7459 Acked Read 2 Done Done Sent false
25887 7460 Acked Read 1 Done Done Sent false
25888 7461 Acked Write 3 Done Done Sent false
25889 7462 Acked Read 1 Done Done Sent false
25890 7463 Acked Read 6 Done Done Sent false
25891 7464 Acked Read 8 Done Done Sent false
25892 7465 Acked Read 10 Done Done Sent false
25893 7466 Acked Read 1 Done Done Sent false
25894 7467 Acked Write 4 Done Done Sent false
25895 7468 Acked Read 6 Done Done Sent false
25896 7469 Acked Read 1 Done Done Sent false
25897 7470 Acked Read 4 Done Done Sent false
25898 7471 Acked Write 5 Done Done Sent false
25899 7472 Acked Read 1 Done Done Sent false
25900 7473 Acked Read 1 Done Done Sent false
25901 7474 Acked Write 4 Done Done Sent false
25902 7475 Acked Read 10 Done Done Sent false
25903 7476 Acked Read 5 Done Done Sent false
25904 7477 Acked Write 6 Done Done Sent false
25905 7478 Acked Read 1 Done Done Sent false
25906 7479 Acked Read 3 Done Done Sent false
25907 7480 Acked Read 7 Done Done Sent false
25908 7481 Acked Write 1 Done Done Sent false
25909 7482 Acked Write 10 Done Done Sent false
25910 7483 Acked Write 9 Done Done Sent false
25911 7484 Acked Read 4 Done Done Sent false
25912 7485 Acked Read 5 Done Done Sent false
25913 7486 Acked Flush 0 Done Done Sent false
25914 7487 Acked Write 5 Done Done Sent false
25915 7488 Acked Write 7 Done Done Sent false
25916 7489 Acked Read 4 Done Done Sent false
25917 7490 Acked Write 1 Done Done Sent false
25918 7491 Acked Flush 0 Done Done Sent false
25919 7492 Acked Write 10 Done Done Sent false
25920 7493 Acked Write 5 Done Done Sent false
25921 7494 Acked Read 6 Done Done Sent false
25922 7495 Acked Flush 0 Done Done Sent false
25923 7496 Acked Read 3 Done Done Sent false
25924 7497 Acked Write 3 Done Done Sent false
25925 7498 Acked Write 3 Done Done Sent false
25926 7499 Acked Write 10 Done Done Sent false
25927 7500 Acked Read 6 Done Done Sent false
25928 7501 Acked Flush 0 Done Done Sent false
25929 7502 Acked Write 10 Done Done Sent false
25930 7503 Acked Write 6 Done Done Sent false
25931 7504 Acked Write 8 Done Done Sent false
25932 7505 Acked Write 3 Done Done Sent false
25933 7506 Acked Read 10 Done Done Sent false
25934 7507 Acked Write 4 Done Done Sent false
25935 7508 Acked Read 7 Done Done Sent false
25936 7509 Acked Write 8 Done Done Sent false
25937 7510 Acked Read 1 Done Done Sent false
25938 7511 Acked Read 6 Done Done Sent false
25939 7512 Acked Read 9 Done Done Sent false
25940 7513 Acked Write 7 Done Done Sent false
25941 7514 Acked Write 1 Done Done Sent false
25942 7515 Acked Read 10 Done Done Sent false
25943 7516 Acked Read 3 Done Done Sent false
25944 7517 Acked Read 2 Done Done Sent false
25945 7518 Acked Read 8 Done Done Sent false
25946 7519 Acked Read 6 Done Done Sent false
25947 7520 Acked Flush 0 Done Done Sent false
25948 7521 Acked Read 2 Done Done Sent false
25949 7522 Acked Write 3 Done Done Sent false
25950 7523 Acked Read 1 Done Done Sent false
25951 7524 Acked Write 7 Done Done Sent false
25952 7525 Acked Write 6 Done Done Sent false
25953 7526 Acked Flush 0 Done Done Sent false
25954 7527 Acked Write 7 Done Done Sent false
25955 7528 Acked Write 7 Done Done Sent false
25956 7529 Acked Read 1 Done Done Sent false
25957 7530 Acked Read 3 Done Done Sent false
25958 7531 Acked Read 8 Done Done Sent false
25959 7532 Acked Write 2 Done Done Sent false
25960 7533 Acked Write 10 Done Done Sent false
25961 7534 Acked Write 3 Done Done Sent false
25962 7535 Acked Flush 0 Done Done Sent false
25963 7536 Acked Write 9 Done Done Sent false
25964 7537 Acked Write 9 Done Done Sent false
25965 7538 Acked Read 1 Done Done Sent false
25966 7539 Acked Flush 0 Done Done Sent false
25967 7540 Acked Write 9 Done Done Sent false
25968 7541 Acked Read 9 Done Done Sent false
25969 7542 Acked Read 1 Done Done Sent false
25970 7543 Acked Write 5 Done Done Sent false
25971 7544 Acked Write 3 Done Done Sent false
25972 7545 Acked Write 4 Done Done Sent false
25973 7546 Acked Write 3 Done Done Sent false
25974 7547 Acked Write 9 Done Done Sent false
25975 7548 Acked Write 5 Done Done Sent false
25976 7549 Acked Write 4 Done Done Sent false
25977 7550 Acked Read 1 Done Done Sent false
25978 7551 Acked Write 1 Done Done Sent false
25979 7552 Acked Read 4 Done Done Sent false
25980 7553 Acked Write 4 Done Done Sent false
25981 7554 Acked Read 2 Done Done Sent false
25982 7555 Acked Flush 0 Done Done Sent false
25983 7556 Acked Write 2 Done Done Sent false
25984 7557 Acked Flush 0 Done Done Sent false
25985 7558 Acked Read 2 Done Done Sent false
25986 7559 Acked Read 4 Done Done Sent false
25987 7560 Acked Write 2 Done Done Sent false
25988 7561 Acked Read 5 Done Done Sent false
25989 7562 Acked Write 4 Done Done Sent false
25990 7563 Acked Read 2 Done Done Sent false
25991 7564 Acked Write 1 Done Done Sent false
25992 7565 Acked Read 5 Done Done Sent false
25993 7566 Acked Flush 0 Done Done Sent false
25994 7567 Acked Read 9 Done Done Sent false
25995 7568 Acked Read 2 Done Done Sent false
25996 7569 Acked Read 4 Done Done Sent false
25997 7570 Acked Read 2 Done Done Sent false
25998 7571 Acked Write 8 Done Done Sent false
25999 7572 Acked Write 7 Done Done Sent false
26000 7573 Acked Read 7 Done Done Sent false
26001 7574 Acked Read 5 Done Done Sent false
26002 7575 Acked Read 1 Done Done Sent false
26003 7576 Acked Write 2 Done Done Sent false
26004 7577 Acked Read 4 Done Done Sent false
26005 7578 Acked Read 9 Done Done Sent false
26006 7579 Acked Read 7 Done Done Sent false
26007 7580 Acked Read 8 Done Done Sent false
26008 7581 Acked Write 4 Done Done Sent false
26009 7582 Acked Write 4 Done Done Sent false
26010 7583 Acked Write 1 Done Done Sent false
26011 7584 Acked Read 8 Done Done Sent false
26012 7585 Acked Read 1 Done Done Sent false
26013 7586 Acked Read 6 Done Done Sent false
26014 7587 Acked Write 6 Done Done Sent false
26015 7588 Acked Write 2 Done Done Sent false
26016 7589 Acked Write 8 Done Done Sent false
26017 7590 Acked Write 1 Done Done Sent false
26018 7591 Acked Read 2 Done Done Sent false
26019 7592 Acked Read 6 Done Done Sent false
26020 7593 Acked Read 1 Done Done Sent false
26021 7594 Acked Write 2 Done Done Sent false
26022 7595 Acked Read 5 Done Done Sent false
26023 7596 Acked Flush 0 Done Done Sent false
26024 7597 Acked Read 6 Done Done Sent false
26025 7598 Acked Read 9 Done Done Sent false
26026 7599 Acked Write 1 Done Done Sent false
26027 7600 Acked Write 4 Done Done Sent false
26028 7601 Acked Read 5 Done Done Sent false
26029 7602 Acked Write 3 Done Done Sent false
26030 7603 Acked Write 9 Done Done Sent false
26031 7604 Acked Write 2 Done Done Sent false
26032 7605 Acked Read 6 Done Done Sent false
26033 7606 Acked Flush 0 Done Done Sent false
26034 7607 Acked Read 8 Done Done Sent false
26035 7608 Acked Write 1 Done Done Sent false
26036 7609 Acked Flush 0 Done Done Sent false
26037 7610 Acked Read 7 Done Done Sent false
26038 7611 Acked Read 3 Done Done Sent false
26039 7612 Acked Read 9 Done Done Sent false
26040 7613 Acked Read 6 Done Done Sent false
26041 7614 Acked Read 10 Done Done Sent false
26042 7615 Acked Read 7 Done Done Sent false
26043 7616 Acked Write 10 Done Done Sent false
26044 7617 Acked Read 2 Done Done Sent false
26045 7618 Acked Read 10 Done Done Sent false
26046 7619 Acked Write 7 Done Done Sent false
26047 7620 Acked Read 10 Done Done Sent false
26048 7621 Acked Read 9 Done Done Sent false
26049 7622 Acked Read 7 Done Done Sent false
26050 7623 Acked Write 10 Done Done Sent false
26051 7624 Acked Write 10 Done Done Sent false
26052 7625 Acked Read 6 Done Done Sent false
26053 7626 Acked Read 2 Done Done Sent false
26054 7627 Acked Write 4 Done Done Sent false
26055 7628 Acked Write 5 Done Done Sent false
26056 7629 Acked Read 1 Done Done Sent false
26057 7630 Acked Read 7 Done Done Sent false
26058 7631 Acked Read 6 Done Done Sent false
26059 7632 Acked Read 2 Done Done Sent false
26060 7633 Acked Write 9 Done Done Sent false
26061 7634 Acked Write 10 Done Done Sent false
26062 7635 Acked Flush 0 Done Done Sent false
26063 7636 Acked Write 5 Done Done Sent false
26064 7637 Acked Read 10 Done Done Sent false
26065 7638 Acked Write 10 Done Done Sent false
26066 7639 Acked Write 6 Done Done Sent false
26067 7640 Acked Flush 0 Done Done Sent false
26068 STATES DS:0 DS:1 DS:2 TOTAL
26069 Sent 0 0 302 302
26070 Done 302 302 0 604
26071 Skipped 0 0 0 0
26072 Error 0 0 0 0
26073 Last Flush: 7640 7640 7338
26074 Downstairs last five completed: 7338 7337 7336 7335 7334
26075 Upstairs last five completed: 7640 7639 7638 7637 7636
26076 CLIENT: Up:0 ds:302 act:2
26077 ----------------------------------------------------------------
26078 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:302
26079 States: Active Active Offline
26080 JOBID ACK TYPE BKS/EXT DS:0 DS:1 DS:2 REPLAY
26081 7339 Acked Read 2 Done Done Sent false
26082 7340 Acked Read 8 Done Done Sent false
26083 7341 Acked Write 9 Done Done Sent false
26084 7342 Acked Write 10 Done Done Sent false
26085 7343 Acked Read 1 Done Done Sent false
26086 7344 Acked Read 5 Done Done Sent false
26087 7345 Acked Write 4 Done Done Sent false
26088 7346 Acked Read 1 Done Done Sent false
26089 7347 Acked Flush 0 Done Done Sent false
26090 7348 Acked Write 7 Done Done Sent false
26091 7349 Acked Write 5 Done Done Sent false
26092 7350 Acked Write 3 Done Done Sent false
26093 7351 Acked Flush 0 Done Done Sent false
26094 7352 Acked Write 9 Done Done Sent false
26095 7353 Acked Read 5 Done Done Sent false
26096 7354 Acked Flush 0 Done Done Sent false
26097 7355 Acked Write 9 Done Done Sent false
26098 7356 Acked Write 8 Done Done Sent false
26099 7357 Acked Read 3 Done Done Sent false
26100 7358 Acked Write 3 Done Done Sent false
26101 7359 Acked Flush 0 Done Done Sent false
26102 7360 Acked Write 7 Done Done Sent false
26103 7361 Acked Write 7 Done Done Sent false
26104 7362 Acked Read 6 Done Done Sent false
26105 7363 Acked Write 5 Done Done Sent false
26106 7364 Acked Read 1 Done Done Sent false
26107 7365 Acked Flush 0 Done Done Sent false
26108 7366 Acked Write 4 Done Done Sent false
26109 7367 Acked Write 1 Done Done Sent false
26110 7368 Acked Read 2 Done Done Sent false
26111 7369 Acked Read 8 Done Done Sent false
26112 7370 Acked Flush 0 Done Done Sent false
26113 7371 Acked Read 1 Done Done Sent false
26114 7372 Acked Write 7 Done Done Sent false
26115 7373 Acked Read 2 Done Done Sent false
26116 7374 Acked Write 2 Done Done Sent false
26117 7375 Acked Read 1 Done Done Sent false
26118 7376 Acked Write 8 Done Done Sent false
26119 7377 Acked Read 1 Done Done Sent false
26120 7378 Acked Read 1 Done Done Sent false
26121 7379 Acked Write 3 Done Done Sent false
26122 7380 Acked Read 10 Done Done Sent false
26123 7381 Acked Write 3 Done Done Sent false
26124 7382 Acked Write 7 Done Done Sent false
26125 7383 Acked Read 7 Done Done Sent false
26126 7384 Acked Write 2 Done Done Sent false
26127 7385 Acked Write 7 Done Done Sent false
26128 7386 Acked Write 5 Done Done Sent false
26129 7387 Acked Write 2 Done Done Sent false
26130 7388 Acked Read 7 Done Done Sent false
26131 7389 Acked Write 10 Done Done Sent false
26132 7390 Acked Flush 0 Done Done Sent false
26133 7391 Acked Read 7 Done Done Sent false
26134 7392 Acked Flush 0 Done Done Sent false
26135 7393 Acked Flush 0 Done Done Sent false
26136 7394 Acked Write 1 Done Done Sent false
26137 7395 Acked Write 10 Done Done Sent false
26138 7396 Acked Write 3 Done Done Sent false
26139 7397 Acked Read 9 Done Done Sent false
26140 7398 Acked Read 3 Done Done Sent false
26141 7399 Acked Read 6 Done Done Sent false
26142 7400 Acked Read 8 Done Done Sent false
26143 7401 Acked Write 3 Done Done Sent false
26144 7402 Acked Write 9 Done Done Sent false
26145 7403 Acked Read 7 Done Done Sent false
26146 7404 Acked Write 6 Done Done Sent false
26147 7405 Acked Write 5 Done Done Sent false
26148 7406 Acked Write 1 Done Done Sent false
26149 7407 Acked Read 9 Done Done Sent false
26150 7408 Acked Read 9 Done Done Sent false
26151 7409 Acked Flush 0 Done Done Sent false
26152 7410 Acked Read 6 Done Done Sent false
26153 7411 Acked Flush 0 Done Done Sent false
26154 7412 Acked Write 9 Done Done Sent false
26155 7413 Acked Read 4 Done Done Sent false
26156 7414 Acked Write 2 Done Done Sent false
26157 7415 Acked Read 10 Done Done Sent false
26158 7416 Acked Read 6 Done Done Sent false
26159 7417 Acked Write 8 Done Done Sent false
26160 7418 Acked Write 10 Done Done Sent false
26161 7419 Acked Write 1 Done Done Sent false
26162 7420 Acked Write 10 Done Done Sent false
26163 7421 Acked Flush 0 Done Done Sent false
26164 7422 Acked Read 7 Done Done Sent false
26165 7423 Acked Write 4 Done Done Sent false
26166 7424 Acked Write 7 Done Done Sent false
26167 7425 Acked Write 3 Done Done Sent false
26168 7426 Acked Read 2 Done Done Sent false
26169 7427 Acked Read 1 Done Done Sent false
26170 7428 Acked Read 5 Done Done Sent false
26171 7429 Acked Write 6 Done Done Sent false
26172 7430 Acked Read 3 Done Done Sent false
26173 7431 Acked Write 3 Done Done Sent false
26174 7432 Acked Read 7 Done Done Sent false
26175 7433 Acked Write 10 Done Done Sent false
26176 7434 Acked Read 9 Done Done Sent false
26177 7435 Acked Flush 0 Done Done Sent false
26178 7436 Acked Read 4 Done Done Sent false
26179 7437 Acked Read 10 Done Done Sent false
26180 7438 Acked Write 10 Done Done Sent false
26181 7439 Acked Read 9 Done Done Sent false
26182 7440 Acked Read 5 Done Done Sent false
26183 7441 Acked Read 5 Done Done Sent false
26184 7442 Acked Write 10 Done Done Sent false
26185 7443 Acked Write 7 Done Done Sent false
26186 7444 Acked Write 10 Done Done Sent false
26187 7445 Acked Read 6 Done Done Sent false
26188 7446 Acked Read 9 Done Done Sent false
26189 7447 Acked Write 6 Done Done Sent false
26190 7448 Acked Read 10 Done Done Sent false
26191 7449 Acked Write 4 Done Done Sent false
26192 7450 Acked Write 7 Done Done Sent false
26193 7451 Acked Read 3 Done Done Sent false
26194 7452 Acked Write 10 Done Done Sent false
26195 7453 Acked Read 10 Done Done Sent false
26196 7454 Acked Read 6 Done Done Sent false
26197 7455 Acked Write 2 Done Done Sent false
26198 7456 Acked Write 5 Done Done Sent false
26199 7457 Acked Write 3 Done Done Sent false
26200 7458 Acked Write 3 Done Done Sent false
26201 7459 Acked Read 2 Done Done Sent false
26202 7460 Acked Read 1 Done Done Sent false
26203 7461 Acked Write 3 Done Done Sent false
26204 7462 Acked Read 1 Done Done Sent false
26205 7463 Acked Read 6 Done Done Sent false
26206 7464 Acked Read 8 Done Done Sent false
26207 7465 Acked Read 10 Done Done Sent false
26208 7466 Acked Read 1 Done Done Sent false
26209 7467 Acked Write 4 Done Done Sent false
26210 7468 Acked Read 6 Done Done Sent false
26211 7469 Acked Read 1 Done Done Sent false
26212 7470 Acked Read 4 Done Done Sent false
26213 7471 Acked Write 5 Done Done Sent false
26214 7472 Acked Read 1 Done Done Sent false
26215 7473 Acked Read 1 Done Done Sent false
26216 7474 Acked Write 4 Done Done Sent false
26217 7475 Acked Read 10 Done Done Sent false
26218 7476 Acked Read 5 Done Done Sent false
26219 7477 Acked Write 6 Done Done Sent false
26220 7478 Acked Read 1 Done Done Sent false
26221 7479 Acked Read 3 Done Done Sent false
26222 7480 Acked Read 7 Done Done Sent false
26223 7481 Acked Write 1 Done Done Sent false
26224 7482 Acked Write 10 Done Done Sent false
26225 7483 Acked Write 9 Done Done Sent false
26226 7484 Acked Read 4 Done Done Sent false
26227 7485 Acked Read 5 Done Done Sent false
26228 7486 Acked Flush 0 Done Done Sent false
26229 7487 Acked Write 5 Done Done Sent false
26230 7488 Acked Write 7 Done Done Sent false
26231 7489 Acked Read 4 Done Done Sent false
26232 7490 Acked Write 1 Done Done Sent false
26233 7491 Acked Flush 0 Done Done Sent false
26234 7492 Acked Write 10 Done Done Sent false
26235 7493 Acked Write 5 Done Done Sent false
26236 7494 Acked Read 6 Done Done Sent false
26237 7495 Acked Flush 0 Done Done Sent false
26238 7496 Acked Read 3 Done Done Sent false
26239 7497 Acked Write 3 Done Done Sent false
26240 7498 Acked Write 3 Done Done Sent false
26241 7499 Acked Write 10 Done Done Sent false
26242 7500 Acked Read 6 Done Done Sent false
26243 7501 Acked Flush 0 Done Done Sent false
26244 7502 Acked Write 10 Done Done Sent false
26245 7503 Acked Write 6 Done Done Sent false
26246 7504 Acked Write 8 Done Done Sent false
26247 7505 Acked Write 3 Done Done Sent false
26248 7506 Acked Read 10 Done Done Sent false
26249 7507 Acked Write 4 Done Done Sent false
26250 7508 Acked Read 7 Done Done Sent false
26251 7509 Acked Write 8 Done Done Sent false
26252 7510 Acked Read 1 Done Done Sent false
26253 7511 Acked Read 6 Done Done Sent false
26254 7512 Acked Read 9 Done Done Sent false
26255 7513 Acked Write 7 Done Done Sent false
26256 7514 Acked Write 1 Done Done Sent false
26257 7515 Acked Read 10 Done Done Sent false
26258 7516 Acked Read 3 Done Done Sent false
26259 7517 Acked Read 2 Done Done Sent false
26260 7518 Acked Read 8 Done Done Sent false
26261 7519 Acked Read 6 Done Done Sent false
26262 7520 Acked Flush 0 Done Done Sent false
26263 7521 Acked Read 2 Done Done Sent false
26264 7522 Acked Write 3 Done Done Sent false
26265 7523 Acked Read 1 Done Done Sent false
26266 7524 Acked Write 7 Done Done Sent false
26267 7525 Acked Write 6 Done Done Sent false
26268 7526 Acked Flush 0 Done Done Sent false
26269 7527 Acked Write 7 Done Done Sent false
26270 7528 Acked Write 7 Done Done Sent false
26271 7529 Acked Read 1 Done Done Sent false
26272 7530 Acked Read 3 Done Done Sent false
26273 7531 Acked Read 8 Done Done Sent false
26274 7532 Acked Write 2 Done Done Sent false
26275 7533 Acked Write 10 Done Done Sent false
26276 7534 Acked Write 3 Done Done Sent false
26277 7535 Acked Flush 0 Done Done Sent false
26278 7536 Acked Write 9 Done Done Sent false
26279 7537 Acked Write 9 Done Done Sent false
26280 7538 Acked Read 1 Done Done Sent false
26281 7539 Acked Flush 0 Done Done Sent false
26282 7540 Acked Write 9 Done Done Sent false
26283 7541 Acked Read 9 Done Done Sent false
26284 7542 Acked Read 1 Done Done Sent false
26285 7543 Acked Write 5 Done Done Sent false
26286 7544 Acked Write 3 Done Done Sent false
26287 7545 Acked Write 4 Done Done Sent false
26288 7546 Acked Write 3 Done Done Sent false
26289 7547 Acked Write 9 Done Done Sent false
26290 7548 Acked Write 5 Done Done Sent false
26291 7549 Acked Write 4 Done Done Sent false
26292 7550 Acked Read 1 Done Done Sent false
26293 7551 Acked Write 1 Done Done Sent false
26294 7552 Acked Read 4 Done Done Sent false
26295 7553 Acked Write 4 Done Done Sent false
26296 7554 Acked Read 2 Done Done Sent false
26297 7555 Acked Flush 0 Done Done Sent false
26298 7556 Acked Write 2 Done Done Sent false
26299 7557 Acked Flush 0 Done Done Sent false
26300 7558 Acked Read 2 Done Done Sent false
26301 7559 Acked Read 4 Done Done Sent false
26302 7560 Acked Write 2 Done Done Sent false
26303 7561 Acked Read 5 Done Done Sent false
26304 7562 Acked Write 4 Done Done Sent false
26305 7563 Acked Read 2 Done Done Sent false
26306 7564 Acked Write 1 Done Done Sent false
26307 7565 Acked Read 5 Done Done Sent false
26308 7566 Acked Flush 0 Done Done Sent false
26309 7567 Acked Read 9 Done Done Sent false
26310 7568 Acked Read 2 Done Done Sent false
26311 7569 Acked Read 4 Done Done Sent false
26312 7570 Acked Read 2 Done Done Sent false
26313 7571 Acked Write 8 Done Done Sent false
26314 7572 Acked Write 7 Done Done Sent false
26315 7573 Acked Read 7 Done Done Sent false
26316 7574 Acked Read 5 Done Done Sent false
26317 7575 Acked Read 1 Done Done Sent false
26318 7576 Acked Write 2 Done Done Sent false
26319 7577 Acked Read 4 Done Done Sent false
26320 7578 Acked Read 9 Done Done Sent false
26321 7579 Acked Read 7 Done Done Sent false
26322 7580 Acked Read 8 Done Done Sent false
26323 7581 Acked Write 4 Done Done Sent false
26324 7582 Acked Write 4 Done Done Sent false
26325 7583 Acked Write 1 Done Done Sent false
26326 7584 Acked Read 8 Done Done Sent false
26327 7585 Acked Read 1 Done Done Sent false
26328 7586 Acked Read 6 Done Done Sent false
26329 7587 Acked Write 6 Done Done Sent false
26330 7588 Acked Write 2 Done Done Sent false
26331 7589 Acked Write 8 Done Done Sent false
26332 7590 Acked Write 1 Done Done Sent false
26333 7591 Acked Read 2 Done Done Sent false
26334 7592 Acked Read 6 Done Done Sent false
26335 7593 Acked Read 1 Done Done Sent false
26336 7594 Acked Write 2 Done Done Sent false
26337 7595 Acked Read 5 Done Done Sent false
26338 7596 Acked Flush 0 Done Done Sent false
26339 7597 Acked Read 6 Done Done Sent false
26340 7598 Acked Read 9 Done Done Sent false
26341 7599 Acked Write 1 Done Done Sent false
26342 7600 Acked Write 4 Done Done Sent false
26343 7601 Acked Read 5 Done Done Sent false
26344 7602 Acked Write 3 Done Done Sent false
26345 7603 Acked Write 9 Done Done Sent false
26346 7604 Acked Write 2 Done Done Sent false
26347 7605 Acked Read 6 Done Done Sent false
26348 7606 Acked Flush 0 Done Done Sent false
26349 7607 Acked Read 8 Done Done Sent false
26350 7608 Acked Write 1 Done Done Sent false
26351 7609 Acked Flush 0 Done Done Sent false
26352 7610 Acked Read 7 Done Done Sent false
26353 7611 Acked Read 3 Done Done Sent false
26354 7612 Acked Read 9 Done Done Sent false
26355 7613 Acked Read 6 Done Done Sent false
26356 7614 Acked Read 10 Done Done Sent false
26357 7615 Acked Read 7 Done Done Sent false
26358 7616 Acked Write 10 Done Done Sent false
26359 7617 Acked Read 2 Done Done Sent false
26360 7618 Acked Read 10 Done Done Sent false
26361 7619 Acked Write 7 Done Done Sent false
26362 7620 Acked Read 10 Done Done Sent false
26363 7621 Acked Read 9 Done Done Sent false
26364 7622 Acked Read 7 Done Done Sent false
26365 7623 Acked Write 10 Done Done Sent false
26366 7624 Acked Write 10 Done Done Sent false
26367 7625 Acked Read 6 Done Done Sent false
26368 7626 Acked Read 2 Done Done Sent false
26369 7627 Acked Write 4 Done Done Sent false
26370 7628 Acked Write 5 Done Done Sent false
26371 7629 Acked Read 1 Done Done Sent false
26372 7630 Acked Read 7 Done Done Sent false
26373 7631 Acked Read 6 Done Done Sent false
26374 7632 Acked Read 2 Done Done Sent false
26375 7633 Acked Write 9 Done Done Sent false
26376 7634 Acked Write 10 Done Done Sent false
26377 7635 Acked Flush 0 Done Done Sent false
26378 7636 Acked Write 5 Done Done Sent false
26379 7637 Acked Read 10 Done Done Sent false
26380 7638 Acked Write 10 Done Done Sent false
26381 7639 Acked Write 6 Done Done Sent false
26382 7640 Acked Flush 0 Done Done Sent false
26383 STATES DS:0 DS:1 DS:2 TOTAL
26384 Sent 0 0 302 302
26385 Done 302 302 0 604
26386 Skipped 0 0 0 0
26387 Error 0 0 0 0
26388 Last Flush: 7640 7640 7338
26389 Downstairs last five completed: 7338 7337 7336 7335 7334
26390 Upstairs last five completed: 7640 7639 7638 7637 7636
26391 CLIENT: Up:0 ds:302 act:2
263922025-01-10T16:40:50.914ZINFOcrucible: connecting to 127.0.0.1:8830 = io task client = 2 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
263932025-01-10T16:40:50.914ZINFOcrucible: ds_connection connected from Ok(127.0.0.1:41109) = io task client = 2 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
263942025-01-10T16:40:50.915ZWARNcrucible: version negotiation from state Offline = downstairs client = 2 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
263952025-01-10T16:40:50.916ZINFOcrucible: downstairs client at Some(127.0.0.1:8830) has region UUID 12345678-0000-0000-0000-000000008830 = downstairs client = 2 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
263962025-01-10T16:40:50.916ZINFOcrucible: Returning UUID:12345678-0000-0000-0000-000000008830 matches = downstairs client = 2 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
263972025-01-10T16:40:50.916ZINFOcrucible: send last flush ID to this DS: 7338 = downstairs client = 2 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
263982025-01-10T16:40:50.916ZINFOcrucible: Replied this last flush ID: 7338 = downstairs client = 2 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
263992025-01-10T16:40:50.916ZINFOcrucible: ds_transition from Offline to Active = downstairs client = 2 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
264002025-01-10T16:40:50.916ZINFOcrucible: [2] Transition from Offline to Active = downstairs client = 2 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
264012025-01-10T16:40:50.916ZINFOcrucible: [2] client re-new 302 jobs since flush 7338 = downstairs session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
264022025-01-10T16:40:50.916ZINFOcrucible: [2] Replayed 302 jobs since flush: 7338 = downstairs session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
26403 ----------------------------------------------------------------
26404 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:0
26405 Downstairs last five completed: 7640 7639 7638 7637 7636
26406 Upstairs last five completed: 7640 7639 7638 7637 7636
26407 CLIENT: Up:0 ds:0 act:3
26408 Replay: All jobs finished
26409 Main task has work to do, go find it
26410 got dsc Stop(0)
26411 stop 0
26412 [8810] Got stop action so:false kr:false
26413 Jan 10 16:40:53.151 INFO request completed, latency_us: 356, response_code: 204, uri: /stop/cid/0, method: POST, req_id: 1afe5505-64a0-42b2-92e3-710d165b1f96, remote_addr: 127.0.0.1:55917, local_addr: 127.0.0.1:9998
26414 Jan 10 16:40:53.151 INFO request completed, latency_us: 115, response_code: 200, uri: /state/cid/0, method: GET, req_id: 3b17f2a3-cf9a-4dda-9d8d-4699c5ee79cf, remote_addr: 127.0.0.1:55917, local_addr: 127.0.0.1:9998
264152025-01-10T16:40:53.151ZWARNcrucible: downstairs disconnected = io task client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
264162025-01-10T16:40:53.151ZWARNcrucible: client task is sending Done(Finished) = io task client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
264172025-01-10T16:40:53.151ZWARNcrucible: downstairs task for 0 stopped due to Finished session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
264182025-01-10T16:40:53.151ZINFOcrucible: ds_transition from Active to Offline = downstairs client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
264192025-01-10T16:40:53.151ZINFOcrucible: [0] Transition from Active to Offline = downstairs client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
264202025-01-10T16:40:53.151ZINFOcrucible: client task is exiting = io task client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
26421 [8810] Exited with: ExitStatus(unix_wait_status(9))
26422 [8810][0] reports Exit
26423 Jan 10 16:40:57.154 INFO request completed, latency_us: 271, response_code: 200, uri: /state/cid/0, method: GET, req_id: fa4d1ea0-0f8d-48c3-bd71-7b3233082adb, remote_addr: 127.0.0.1:55917, local_addr: 127.0.0.1:9998
26424 001/300 Write block 2300 len 36864 data: 3 3 4 4 4 4 5 8 7
26425 002/300 Read block 494 len 28672
26426 003/300 Write block 3314 len 40960 data: 6 6 4 4 4 5 4 7 5 5
26427 004/300 Write block 1612 len 32768 data: 4 4 5 5 4 4 5 4
26428 005/300 Read block 3544 len 16384
26429 006/300 Read block 2484 len 8192
26430 007/300 Read block 749 len 4096
26431 008/300 Write block 3258 len 12288 data: 4 4 4
26432 009/300 Write block 430 len 36864 data: 6 6 6 5 5 5 3 4 3
26433 010/300 Flush
26434 011/300 Write block 4543 len 32768 data: 4 4 4 4 3 3 2 2
26435 012/300 Flush
26436 013/300 Write block 2535 len 4096 data: 3
26437 014/300 Read block 2109 len 16384
26438 015/300 Write block 3936 len 36864 data: 5 6 5 5 5 5 7 10 9
26439 016/300 Read block 3216 len 36864
26440 017/300 Write block 2346 len 20480 data: 7 5 5 5 6
26441 018/300 Read block 969 len 24576
26442 019/300 Flush
26443 020/300 Read block 4751 len 32768
26444 021/300 Write block 3852 len 16384 data: 5 7 8 10
26445 022/300 Write block 4135 len 36864 data: 4 4 4 4 3 5 4 4 6
26446 023/300 Write block 213 len 28672 data: 7 5 4 3 4 5 5
26447 024/300 Write block 4272 len 24576 data: 3 4 3 3 4 5
26448 025/300 Read block 3736 len 24576
26449 026/300 Write block 4946 len 20480 data: 6 4 4 4 4
26450 027/300 Read block 2768 len 12288
26451 028/300 Write block 2246 len 28672 data: 9 9 10 9 9 8 4
26452 029/300 Write block 4085 len 8192 data: 6 5
26453 030/300 Read block 384 len 8192
26454 031/300 Write block 4421 len 24576 data: 3 3 5 5 4 5
26455 032/300 Flush
26456 033/300 Read block 612 len 32768
26457 034/300 Write block 2931 len 36864 data: 5 6 6 5 5 5 5 7 6
26458 035/300 Read block 4740 len 32768
26459 036/300 Read block 3401 len 36864
26460 037/300 Read block 2094 len 12288
26461 038/300 Write block 1731 len 40960 data: 7 7 7 6 6 5 7 7 6 5
26462 039/300 Read block 3390 len 40960
26463 040/300 Write block 4554 len 8192 data: 8 8
26464 041/300 Read block 2035 len 40960
26465 042/300 Read block 2616 len 32768
26466 043/300 Read block 154 len 28672
26467 044/300 Write block 4199 len 8192 data: 7 5
26468 045/300 Read block 3263 len 20480
26469 046/300 Read block 3823 len 8192
26470 047/300 Read block 953 len 24576
26471 048/300 Write block 2639 len 20480 data: 9 9 8 8 9
26472 049/300 Write block 367 len 16384 data: 5 5 6 6
26473 050/300 Write block 1823 len 8192 data: 6 5
26474 051/300 Read block 1146 len 40960
26475 052/300 Write block 3349 len 24576 data: 4 5 5 6 7 5
26476 053/300 Flush
26477 054/300 Read block 3627 len 24576
26478 055/300 Flush
26479 056/300 Read block 3036 len 32768
26480 057/300 Write block 683 len 28672 data: 9 7 7 6 6 5 4
26481 058/300 Write block 2777 len 40960 data: 4 5 4 5 5 6 6 5 6 6
26482 059/300 Read block 1408 len 28672
26483 060/300 Read block 1499 len 16384
26484 061/300 Write block 4334 len 28672 data: 6 5 5 6 6 5 6
26485 062/300 Write block 17 len 4096 data: 7
26486 063/300 Read block 4020 len 24576
26487 064/300 Read block 4483 len 12288
26488 065/300 Read block 1301 len 32768
26489 066/300 Write block 3454 len 40960 data: 3 5 5 8 8 6 6 5 6 5
26490 067/300 Write block 3072 len 12288 data: 3 2 2
26491 068/300 Read block 4695 len 20480
26492 069/300 Write block 4599 len 24576 data: 2 3 3 3 3 3
26493 070/300 Read block 1779 len 28672
26494 071/300 Read block 3521 len 16384
26495 072/300 Write block 4633 len 24576 data: 4 5 5 4 3 3
26496 073/300 Read block 3137 len 36864
26497 074/300 Read block 3556 len 32768
26498 075/300 Read block 2271 len 16384
26499 076/300 Read block 292 len 36864
26500 077/300 Read block 2872 len 4096
26501 078/300 Read block 4063 len 32768
26502 079/300 Read block 4710 len 32768
26503 080/300 Read block 930 len 20480
26504 081/300 Write block 4022 len 16384 data: 4 4 6 6
26505 082/300 Write block 4500 len 16384 data: 5 6 6 6
26506 083/300 Write block 2887 len 36864 data: 9 6 7 7 4 5 4 4 6
26507 084/300 Read block 775 len 20480
26508 085/300 Read block 3657 len 4096
26509 086/300 Flush
26510 087/300 Read block 2811 len 12288
26511 088/300 Write block 1262 len 4096 data: 5
26512 089/300 Read block 1749 len 36864
26513 090/300 Read block 3404 len 12288
26514 091/300 Write block 3184 len 32768 data: 3 3 3 3 2 3 4 4
26515 092/300 Read block 2056 len 28672
26516 093/300 Write block 580 len 20480 data: 6 6 8 7 7
26517 094/300 Read block 4197 len 4096
26518 095/300 Write block 2071 len 20480 data: 7 6 6 6 5
26519 096/300 Read block 97 len 36864
26520 097/300 Write block 3271 len 32768 data: 4 4 3 3 3 2 2 2
26521 098/300 Read block 3580 len 16384
26522 099/300 Read block 4044 len 16384
26523 100/300 Read block 2881 len 40960
26524 101/300 Write block 352 len 24576 data: 2 2 2 2 2 2
26525 102/300 Read block 913 len 8192
26526 103/300 Write block 807 len 40960 data: 6 5 5 5 6 5 3 3 3 4
26527 104/300 Write block 3965 len 20480 data: 5 5 5 4 3
26528 105/300 Read block 1408 len 4096
26529 106/300 Write block 637 len 20480 data: 5 4 3 3 3
26530 107/300 Write block 2092 len 36864 data: 4 5 4 4 5 5 4 4 6
26531 108/300 Read block 3870 len 24576
26532 109/300 Flush
26533 110/300 Write block 4563 len 12288 data: 5 6 7
26534 111/300 Flush
26535 112/300 Write block 692 len 32768 data: 4 5 5 6 6 5 7 8
26536 113/300 Write block 1660 len 16384 data: 6 6 7 6
26537 114/300 Read block 4298 len 4096
26538 115/300 Read block 2086 len 36864
26539 116/300 Write block 2855 len 4096 data: 4
26540 117/300 Write block 3391 len 16384 data: 4 4 5 5
26541 118/300 Read block 115 len 8192
26542 119/300 Write block 1750 len 4096 data: 7
26543 120/300 Flush
26544 121/300 Write block 2111 len 32768 data: 4 4 5 6 4 4 6 6
26545 122/300 Read block 3312 len 8192
26546 123/300 Read block 2275 len 12288
26547 124/300 Read block 4624 len 40960
26548 125/300 Read block 269 len 12288
26549 126/300 Read block 2099 len 8192
26550 127/300 Read block 3355 len 36864
26551 128/300 Read block 3327 len 32768
26552 129/300 Read block 4851 len 24576
26553 130/300 Write block 4071 len 20480 data: 8 7 8 6 5
26554 131/300 Read block 1266 len 4096
26555 132/300 Write block 540 len 24576 data: 4 3 4 6 6 5
26556 133/300 Write block 793 len 32768 data: 5 5 4 3 3 3 4 3
26557 134/300 Write block 4729 len 32768 data: 4 3 4 4 5 5 4 4
26558 135/300 Write block 2167 len 32768 data: 5 5 4 6 6 6 5 4
26559 136/300 Read block 2197 len 16384
26560 137/300 Read block 2704 len 8192
26561 138/300 Read block 729 len 20480
26562 139/300 Read block 2099 len 28672
26563 140/300 Write block 3345 len 32768 data: 2 2 4 5 5 6 6 7
26564 141/300 Flush
26565 142/300 Read block 1365 len 8192
26566 143/300 Write block 3968 len 12288 data: 5 4 3
26567 144/300 Write block 1037 len 28672 data: 7 5 6 4 3 2 3
26568 145/300 Write block 3163 len 28672 data: 2 5 5 5 6 7 7
26569 146/300 Write block 3956 len 36864 data: 4 4 4 4 4 3 3 4 4
26570 147/300 Flush
26571 148/300 Read block 784 len 36864
26572 149/300 Write block 2589 len 12288 data: 9 7 6
26573 150/300 Write block 3000 len 4096 data: 5
26574 151/300 Write block 305 len 28672 data: 4 4 4 4 5 7 6
26575 152/300 Read block 2468 len 36864
26576 153/300 Read block 2825 len 40960
26577 154/300 Write block 970 len 16384 data: 5 7 6 6
26578 155/300 Flush
26579 156/300 Flush
26580 157/300 Write block 531 len 12288 data: 6 7 7
26581 158/300 Read block 202 len 16384
26582 159/300 Flush
26583 160/300 Read block 2603 len 28672
26584 161/300 Read block 219 len 24576
26585 162/300 Read block 825 len 28672
26586 163/300 Read block 4129 len 40960
26587 164/300 Write block 1773 len 32768 data: 6 6 6 6 6 5 6 9
26588 165/300 Read block 4320 len 4096
26589 166/300 Write block 3118 len 32768 data: 4 6 5 5 5 5 4 5
26590 167/300 Write block 4938 len 20480 data: 4 3 3 4 5
26591 168/300 Flush
26592 169/300 Write block 2742 len 12288 data: 3 4 4
26593 170/300 Write block 3857 len 16384 data: 6 5 6 6
26594 171/300 Read block 2414 len 12288
26595 172/300 Read block 4415 len 40960
26596 173/300 Flush
26597 174/300 Read block 4862 len 32768
26598 175/300 Read block 795 len 12288
26599 176/300 Write block 997 len 20480 data: 5 4 4 4 5
26600 177/300 Read block 1460 len 4096
26601 178/300 Write block 2440 len 4096 data: 5
26602 179/300 Write block 1834 len 4096 data: 3
26603 180/300 Write block 3015 len 20480 data: 6 7 8 8 6
26604 181/300 Flush
26605 182/300 Read block 3586 len 12288
26606 183/300 Write block 3749 len 4096 data: 4
26607 184/300 Read block 3724 len 12288
26608 185/300 Read block 1801 len 20480
26609 186/300 Write block 120 len 36864 data: 8 6 6 6 4 4 4 4 4
26610 187/300 Write block 605 len 16384 data: 10 11 8 7
26611 188/300 Read block 4373 len 36864
26612 189/300 Read block 1091 len 24576
26613 190/300 Read block 2508 len 24576
26614 191/300 Read block 459 len 32768
26615 192/300 Read block 4367 len 4096
26616 193/300 Write block 2771 len 28672 data: 3 4 4 4 3 4 5
26617 194/300 Read block 199 len 24576
26618 195/300 Flush
26619 196/300 Write block 2892 len 36864 data: 6 5 5 7 5 9 9 10 10
26620 197/300 Write block 3270 len 40960 data: 4 5 5 4 4 4 3 3 3 3
26621 198/300 Write block 3220 len 8192 data: 5 4
26622 199/300 Read block 4632 len 28672
26623 200/300 Flush
26624 201/300 Flush
26625 202/300 Read block 3015 len 20480
26626 203/300 Read block 2974 len 28672
26627 204/300 Write block 934 len 36864 data: 7 5 6 6 5 4 4 4 4
26628 205/300 Read block 2078 len 20480
26629 206/300 Write block 2802 len 32768 data: 6 5 7 7 6 8 9 9
26630 207/300 Write block 502 len 20480 data: 4 4 4 4 4
26631 208/300 Flush
26632 209/300 Read block 3255 len 16384
26633 210/300 Write block 2258 len 12288 data: 4 5 5
26634 211/300 Write block 3378 len 24576 data: 4 6 7 8 9 9
26635 212/300 Read block 2912 len 8192
26636 213/300 Read block 1407 len 24576
26637 214/300 Flush
26638 215/300 Read block 3635 len 12288
26639 216/300 Read block 126 len 20480
26640 217/300 Read block 2197 len 4096
26641 218/300 Flush
26642 219/300 Write block 2810 len 24576 data: 9 9 8 6 5 4
26643 220/300 Write block 1126 len 28672 data: 4 3 3 3 3 3 4
26644 221/300 Write block 1500 len 12288 data: 5 4 4
26645 222/300 Write block 1817 len 32768 data: 3 3 2 6 6 5 7 6
26646 223/300 Write block 1993 len 16384 data: 8 7 9 9
26647 224/300 Write block 911 len 28672 data: 5 5 5 6 7 6 9
26648 225/300 Write block 2231 len 36864 data: 4 3 2 2 4 5 5 5 7
26649 226/300 Flush
26650 227/300 Write block 2076 len 16384 data: 6 5 3 4
26651 228/300 Read block 1521 len 16384
26652 229/300 Read block 4602 len 24576
26653 230/300 Read block 2633 len 12288
26654 231/300 Write block 1850 len 20480 data: 4 5 3 3 4
26655 232/300 Write block 3899 len 40960 data: 6 6 3 3 3 3 3 4 4 3
26656 233/300 Write block 3905 len 40960 data: 4 5 5 4 3 3 3 4 5 5
26657 234/300 Read block 2854 len 12288
26658 235/300 Read block 4646 len 12288
26659 236/300 Read block 4959 len 16384
26660 237/300 Read block 1947 len 36864
26661 238/300 Flush
26662 239/300 Read block 4430 len 24576
26663 240/300 Write block 4991 len 4096 data: 4
26664 241/300 Read block 4884 len 12288
26665 242/300 Read block 3371 len 32768
26666 243/300 Write block 1872 len 36864 data: 2 3 2 2 3 5 4 5 5
26667 244/300 Write block 1948 len 4096 data: 5
26668 245/300 Write block 4534 len 16384 data: 5 4 3 2
26669 246/300 Read block 3178 len 4096
26670 247/300 Read block 2029 len 8192
26671 248/300 Write block 3111 len 16384 data: 4 4 4 5
26672 249/300 Write block 1814 len 40960 data: 4 3 3 4 4 3 7 7 6 8
26673 250/300 Flush
26674 251/300 Write block 4589 len 32768 data: 3 4 4 4 4 3 3 3
26675 252/300 Write block 484 len 24576 data: 4 6 6 6 7 6
26676 253/300 Read block 2607 len 16384
26677 254/300 Write block 1616 len 28672 data: 5 5 6 5 3 3 5
26678 255/300 Read block 2899 len 40960
26679 256/300 Read block 2970 len 4096
26680 257/300 Flush
26681 258/300 Write block 3681 len 16384 data: 4 4 4 4
26682 259/300 Write block 1718 len 36864 data: 5 7 7 6 6 8 8 7 7
26683 260/300 Write block 418 len 32768 data: 4 3 3 3 3 3 4 4
26684 261/300 Read block 2908 len 4096
26685 262/300 Write block 4074 len 4096 data: 7
26686 263/300 Read block 4253 len 12288
26687 264/300 Write block 4747 len 4096 data: 4
26688 265/300 Write block 4273 len 8192 data: 5 4
26689 266/300 Read block 4429 len 20480
26690 267/300 Read block 1453 len 12288
26691 268/300 Read block 4442 len 8192
26692 269/300 Read block 2395 len 16384
26693 270/300 Write block 2622 len 12288 data: 5 4 3
26694 271/300 Read block 377 len 20480
26695 272/300 Read block 3584 len 24576
26696 273/300 Write block 2526 len 8192 data: 6 6
26697 274/300 Read block 3329 len 12288
26698 275/300 Write block 4316 len 12288 data: 4 3 2
26699 276/300 Write block 4155 len 24576 data: 7 6 5 4 5 6
26700 277/300 Flush
26701 278/300 Write block 3140 len 8192 data: 6 5
26702 279/300 Read block 2876 len 8192
26703 280/300 Read block 3756 len 40960
26704 281/300 Read block 2336 len 20480
26705 282/300 Read block 487 len 16384
26706 283/300 Write block 2839 len 36864 data: 7 5 3 5 4 4 5 5 5
26707 284/300 Flush
26708 285/300 Flush
26709 286/300 Read block 3403 len 12288
26710 287/300 Read block 928 len 40960
26711 288/300 Read block 1763 len 32768
26712 289/300 Write block 2516 len 24576 data: 6 6 6 7 5 5
26713 290/300 Read block 1954 len 32768
26714 291/300 Read block 2218 len 36864
26715 292/300 Write block 3463 len 28672 data: 6 6 6 6 5 5 4
26716 293/300 Read block 4894 len 16384
26717 294/300 Read block 1770 len 16384
26718 295/300 Write block 2831 len 4096 data: 4
26719 296/300 Write block 3638 len 4096 data: 5
26720 297/300 Write block 3329 len 40960 data: 5 4 4 4 6 6 6 6 6 7
26721 298/300 Write block 2867 len 8192 data: 8 8
26722 299/300 Write block 2253 len 20480 data: 4 3 3 3 2
26723 300/300 Write block 2047 len 8192 data: 5 6
26724 301/300 Read block 1006 len 32768
26725 Main task has work to do, go find it
26726 got dsc Start(0)
26727 start 0
26728 Jan 10 16:40:57.383 INFO request completed, latency_us: 228, response_code: 204, uri: /start/cid/0, method: POST, req_id: 04bc9c22-7bd0-441b-b4a8-11870c668bca, remote_addr: 127.0.0.1:55917, local_addr: 127.0.0.1:9998
26729 Replay: started 0, returned:Ok(())
26730 ----------------------------------------------------------------
26731 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:301
26732 States: Offline Active Active
26733 JOBID ACK TYPE BKS/EXT DS:0 DS:1 DS:2 REPLAY
26734 7641 Acked Write 9 Sent Done Done false
26735 7642 Acked Read 7 Sent Done Done false
26736 7643 Acked Write 10 Sent Done Done false
26737 7644 Acked Write 8 Sent Done Done false
26738 7645 Acked Read 4 Sent Done Done false
26739 7646 Acked Read 2 Sent Done Done false
26740 7647 Acked Read 1 Sent Done Done false
26741 7648 Acked Write 3 Sent Done Done false
26742 7649 Acked Write 9 Sent Done Done false
26743 7650 Acked Flush 0 Sent Done Done false
26744 7651 Acked Write 8 Sent Done Done false
26745 7652 Acked Flush 0 Sent Done Done false
26746 7653 Acked Write 1 Sent Done Done false
26747 7654 Acked Read 4 Sent Done Done false
26748 7655 Acked Write 9 Sent Done Done false
26749 7656 Acked Read 9 Sent Done Done false
26750 7657 Acked Write 5 Sent Done Done false
26751 7658 Acked Read 6 Sent Done Done false
26752 7659 Acked Flush 0 Sent Done Done false
26753 7660 Acked Read 8 Sent Done Done false
26754 7661 Acked Write 4 Sent Done Done false
26755 7662 Acked Write 9 Sent Done Done false
26756 7663 Acked Write 7 Sent Done Done false
26757 7664 Acked Write 6 Sent Done Done false
26758 7665 Acked Read 6 Sent Done Done false
26759 7666 Acked Write 5 Sent Done Done false
26760 7667 Acked Read 3 Sent Done Done false
26761 7668 Acked Write 7 Sent Done Done false
26762 7669 Acked Write 2 Sent Done Done false
26763 7670 Acked Read 2 Sent Done Done false
26764 7671 Acked Write 6 Sent Done Done false
26765 7672 Acked Flush 0 Sent Done Done false
26766 7673 Acked Read 8 Sent Done Done false
26767 7674 Acked Write 9 Sent Done Done false
26768 7675 Acked Read 8 Sent Done Done false
26769 7676 Acked Read 9 Sent Done Done false
26770 7677 Acked Read 3 Sent Done Done false
26771 7678 Acked Write 10 Sent Done Done false
26772 7679 Acked Read 10 Sent Done Done false
26773 7680 Acked Write 2 Sent Done Done false
26774 7681 Acked Read 10 Sent Done Done false
26775 7682 Acked Read 8 Sent Done Done false
26776 7683 Acked Read 7 Sent Done Done false
26777 7684 Acked Write 2 Sent Done Done false
26778 7685 Acked Read 5 Sent Done Done false
26779 7686 Acked Read 2 Sent Done Done false
26780 7687 Acked Read 6 Sent Done Done false
26781 7688 Acked Write 5 Sent Done Done false
26782 7689 Acked Write 4 Sent Done Done false
26783 7690 Acked Write 2 Sent Done Done false
26784 7691 Acked Read 10 Sent Done Done false
26785 7692 Acked Write 6 Sent Done Done false
26786 7693 Acked Flush 0 Sent Done Done false
26787 7694 Acked Read 6 Sent Done Done false
26788 7695 Acked Flush 0 Sent Done Done false
26789 7696 Acked Read 8 Sent Done Done false
26790 7697 Acked Write 7 Sent Done Done false
26791 7698 Acked Write 10 Sent Done Done false
26792 7699 Acked Read 7 Sent Done Done false
26793 7700 Acked Read 4 Sent Done Done false
26794 7701 Acked Write 7 Sent Done Done false
26795 7702 Acked Write 1 Sent Done Done false
26796 7703 Acked Read 6 Sent Done Done false
26797 7704 Acked Read 3 Sent Done Done false
26798 7705 Acked Read 8 Sent Done Done false
26799 7706 Acked Write 10 Sent Done Done false
26800 7707 Acked Write 3 Sent Done Done false
26801 7708 Acked Read 5 Sent Done Done false
26802 7709 Acked Write 6 Sent Done Done false
26803 7710 Acked Read 7 Sent Done Done false
26804 7711 Acked Read 4 Sent Done Done false
26805 7712 Acked Write 6 Sent Done Done false
26806 7713 Acked Read 9 Sent Done Done false
26807 7714 Acked Read 8 Sent Done Done false
26808 7715 Acked Read 4 Sent Done Done false
26809 7716 Acked Read 9 Sent Done Done false
26810 7717 Acked Read 1 Sent Done Done false
26811 7718 Acked Read 8 Sent Done Done false
26812 7719 Acked Read 8 Sent Done Done false
26813 7720 Acked Read 5 Sent Done Done false
26814 7721 Acked Write 4 Sent Done Done false
26815 7722 Acked Write 4 Sent Done Done false
26816 7723 Acked Write 9 Sent Done Done false
26817 7724 Acked Read 5 Sent Done Done false
26818 7725 Acked Read 1 Sent Done Done false
26819 7726 Acked Flush 0 Sent Done Done false
26820 7727 Acked Read 3 Sent Done Done false
26821 7728 Acked Write 1 Sent Done Done false
26822 7729 Acked Read 9 Sent Done Done false
26823 7730 Acked Read 3 Sent Done Done false
26824 7731 Acked Write 8 Sent Done Done false
26825 7732 Acked Read 7 Sent Done Done false
26826 7733 Acked Write 5 Sent Done Done false
26827 7734 Acked Read 1 Sent Done Done false
26828 7735 Acked Write 5 Sent Done Done false
26829 7736 Acked Read 9 Sent Done Done false
26830 7737 Acked Write 8 Sent Done Done false
26831 7738 Acked Read 4 Sent Done Done false
26832 7739 Acked Read 4 Sent Done Done false
26833 7740 Acked Read 10 Sent Done Done false
26834 7741 Acked Write 6 Sent Done Done false
26835 7742 Acked Read 2 Sent Done Done false
26836 7743 Acked Write 10 Sent Done Done false
26837 7744 Acked Write 5 Sent Done Done false
26838 7745 Acked Read 1 Sent Done Done false
26839 7746 Acked Write 5 Sent Done Done false
26840 7747 Acked Write 9 Sent Done Done false
26841 7748 Acked Read 6 Sent Done Done false
26842 7749 Acked Flush 0 Sent Done Done false
26843 7750 Acked Write 3 Sent Done Done false
26844 7751 Acked Flush 0 Sent Done Done false
26845 7752 Acked Write 8 Sent Done Done false
26846 7753 Acked Write 4 Sent Done Done false
26847 7754 Acked Read 1 Sent Done Done false
26848 7755 Acked Read 9 Sent Done Done false
26849 7756 Acked Write 1 Sent Done Done false
26850 7757 Acked Write 4 Sent Done Done false
26851 7758 Acked Read 2 Sent Done Done false
26852 7759 Acked Write 1 Sent Done Done false
26853 7760 Acked Flush 0 Sent Done Done false
26854 7761 Acked Write 8 Sent Done Done false
26855 7762 Acked Read 2 Sent Done Done false
26856 7763 Acked Read 3 Sent Done Done false
26857 7764 Acked Read 10 Sent Done Done false
26858 7765 Acked Read 3 Sent Done Done false
26859 7766 Acked Read 2 Sent Done Done false
26860 7767 Acked Read 9 Sent Done Done false
26861 7768 Acked Read 8 Sent Done Done false
26862 7769 Acked Read 6 Sent Done Done false
26863 7770 Acked Write 5 Sent Done Done false
26864 7771 Acked Read 1 Sent Done Done false
26865 7772 Acked Write 6 Sent Done Done false
26866 7773 Acked Write 8 Sent Done Done false
26867 7774 Acked Write 8 Sent Done Done false
26868 7775 Acked Write 8 Sent Done Done false
26869 7776 Acked Read 4 Sent Done Done false
26870 7777 Acked Read 2 Sent Done Done false
26871 7778 Acked Read 5 Sent Done Done false
26872 7779 Acked Read 7 Sent Done Done false
26873 7780 Acked Write 8 Sent Done Done false
26874 7781 Acked Flush 0 Sent Done Done false
26875 7782 Acked Read 2 Sent Done Done false
26876 7783 Acked Write 3 Sent Done Done false
26877 7784 Acked Write 7 Sent Done Done false
26878 7785 Acked Write 7 Sent Done Done false
26879 7786 Acked Write 9 Sent Done Done false
26880 7787 Acked Flush 0 Sent Done Done false
26881 7788 Acked Read 9 Sent Done Done false
26882 7789 Acked Write 3 Sent Done Done false
26883 7790 Acked Write 1 Sent Done Done false
26884 7791 Acked Write 7 Sent Done Done false
26885 7792 Acked Read 9 Sent Done Done false
26886 7793 Acked Read 10 Sent Done Done false
26887 7794 Acked Write 4 Sent Done Done false
26888 7795 Acked Flush 0 Sent Done Done false
26889 7796 Acked Flush 0 Sent Done Done false
26890 7797 Acked Write 3 Sent Done Done false
26891 7798 Acked Read 4 Sent Done Done false
26892 7799 Acked Flush 0 Sent Done Done false
26893 7800 Acked Read 7 Sent Done Done false
26894 7801 Acked Read 6 Sent Done Done false
26895 7802 Acked Read 7 Sent Done Done false
26896 7803 Acked Read 10 Sent Done Done false
26897 7804 Acked Write 8 Sent Done Done false
26898 7805 Acked Read 1 Sent Done Done false
26899 7806 Acked Write 8 Sent Done Done false
26900 7807 Acked Write 5 Sent Done Done false
26901 7808 Acked Flush 0 Sent Done Done false
26902 7809 Acked Write 3 Sent Done Done false
26903 7810 Acked Write 4 Sent Done Done false
26904 7811 Acked Read 3 Sent Done Done false
26905 7812 Acked Read 10 Sent Done Done false
26906 7813 Acked Flush 0 Sent Done Done false
26907 7814 Acked Read 8 Sent Done Done false
26908 7815 Acked Read 3 Sent Done Done false
26909 7816 Acked Write 5 Sent Done Done false
26910 7817 Acked Read 1 Sent Done Done false
26911 7818 Acked Write 1 Sent Done Done false
26912 7819 Acked Write 1 Sent Done Done false
26913 7820 Acked Write 5 Sent Done Done false
26914 7821 Acked Flush 0 Sent Done Done false
26915 7822 Acked Read 3 Sent Done Done false
26916 7823 Acked Write 1 Sent Done Done false
26917 7824 Acked Read 3 Sent Done Done false
26918 7825 Acked Read 5 Sent Done Done false
26919 7826 Acked Write 9 Sent Done Done false
26920 7827 Acked Write 4 Sent Done Done false
26921 7828 Acked Read 9 Sent Done Done false
26922 7829 Acked Read 6 Sent Done Done false
26923 7830 Acked Read 6 Sent Done Done false
26924 7831 Acked Read 8 Sent Done Done false
26925 7832 Acked Read 1 Sent Done Done false
26926 7833 Acked Write 7 Sent Done Done false
26927 7834 Acked Read 6 Sent Done Done false
26928 7835 Acked Flush 0 Sent Done Done false
26929 7836 Acked Write 9 Sent Done Done false
26930 7837 Acked Write 10 Sent Done Done false
26931 7838 Acked Write 2 Sent Done Done false
26932 7839 Acked Read 7 Sent Done Done false
26933 7840 Acked Flush 0 Sent Done Done false
26934 7841 Acked Flush 0 Sent Done Done false
26935 7842 Acked Read 5 Sent Done Done false
26936 7843 Acked Read 7 Sent Done Done false
26937 7844 Acked Write 9 Sent Done Done false
26938 7845 Acked Read 5 Sent Done Done false
26939 7846 Acked Write 8 Sent Done Done false
26940 7847 Acked Write 5 Sent Done Done false
26941 7848 Acked Flush 0 Sent Done Done false
26942 7849 Acked Read 4 Sent Done Done false
26943 7850 Acked Write 3 Sent Done Done false
26944 7851 Acked Write 6 Sent Done Done false
26945 7852 Acked Read 2 Sent Done Done false
26946 7853 Acked Read 6 Sent Done Done false
26947 7854 Acked Flush 0 Sent Done Done false
26948 7855 Acked Read 3 Sent Done Done false
26949 7856 Acked Read 5 Sent Done Done false
26950 7857 Acked Read 1 Sent Done Done false
26951 7858 Acked Flush 0 Sent Done Done false
26952 7859 Acked Write 6 Sent Done Done false
26953 7860 Acked Write 7 Sent Done Done false
26954 7861 Acked Write 3 Sent Done Done false
26955 7862 Acked Write 8 Sent Done Done false
26956 7863 Acked Write 4 Sent Done Done false
26957 7864 Acked Write 7 Sent Done Done false
26958 7865 Acked Write 9 Sent Done Done false
26959 7866 Acked Flush 0 Sent Done Done false
26960 7867 Acked Write 4 Sent Done Done false
26961 7868 Acked Read 4 Sent Done Done false
26962 7869 Acked Read 6 Sent Done Done false
26963 7870 Acked Read 3 Sent Done Done false
26964 7871 Acked Write 5 Sent Done Done false
26965 7872 Acked Write 10 Sent Done Done false
26966 7873 Acked Write 10 Sent Done Done false
26967 7874 Acked Read 3 Sent Done Done false
26968 7875 Acked Read 3 Sent Done Done false
26969 7876 Acked Read 4 Sent Done Done false
26970 7877 Acked Read 9 Sent Done Done false
26971 7878 Acked Flush 0 Sent Done Done false
26972 7879 Acked Read 6 Sent Done Done false
26973 7880 Acked Write 1 Sent Done Done false
26974 7881 Acked Read 3 Sent Done Done false
26975 7882 Acked Read 8 Sent Done Done false
26976 7883 Acked Write 9 Sent Done Done false
26977 7884 Acked Write 1 Sent Done Done false
26978 7885 Acked Write 4 Sent Done Done false
26979 7886 Acked Read 1 Sent Done Done false
26980 7887 Acked Read 2 Sent Done Done false
26981 7888 Acked Write 4 Sent Done Done false
26982 7889 Acked Write 10 Sent Done Done false
26983 7890 Acked Flush 0 Sent Done Done false
26984 7891 Acked Write 8 Sent Done Done false
26985 7892 Acked Write 6 Sent Done Done false
26986 7893 Acked Read 4 Sent Done Done false
26987 7894 Acked Write 7 Sent Done Done false
26988 7895 Acked Read 10 Sent Done Done false
26989 7896 Acked Read 1 Sent Done Done false
26990 7897 Acked Flush 0 Sent Done Done false
26991 7898 Acked Write 4 Sent Done Done false
26992 7899 Acked Write 9 Sent Done Done false
26993 7900 Acked Write 8 Sent Done Done false
26994 7901 Acked Read 1 Sent Done Done false
26995 7902 Acked Write 1 Sent Done Done false
26996 7903 Acked Read 3 Sent Done Done false
26997 7904 Acked Write 1 Sent Done Done false
26998 7905 Acked Write 2 Sent Done Done false
26999 7906 Acked Read 5 Sent Done Done false
27000 7907 Acked Read 3 Sent Done Done false
27001 7908 Acked Read 2 Sent Done Done false
27002 7909 Acked Read 4 Sent Done Done false
27003 7910 Acked Write 3 Sent Done Done false
27004 7911 Acked Read 5 Sent Done Done false
27005 7912 Acked Read 6 Sent Done Done false
27006 7913 Acked Write 2 Sent Done Done false
27007 7914 Acked Read 3 Sent Done Done false
27008 7915 Acked Write 3 Sent Done Done false
27009 7916 Acked Write 6 Sent Done Done false
27010 7917 Acked Flush 0 Sent Done Done false
27011 7918 Acked Write 2 Sent Done Done false
27012 7919 Acked Read 2 Sent Done Done false
27013 7920 Acked Read 10 Sent Done Done false
27014 7921 Acked Read 5 Sent Done Done false
27015 7922 Acked Read 4 Sent Done Done false
27016 7923 Acked Write 9 Sent Done Done false
27017 7924 Acked Flush 0 Sent Done Done false
27018 7925 Acked Flush 0 Sent Done Done false
27019 7926 Acked Read 3 Sent Done Done false
27020 7927 Acked Read 10 Sent Done Done false
27021 7928 Acked Read 8 Sent Done Done false
27022 7929 Acked Write 6 Sent Done Done false
27023 7930 Acked Read 8 Sent Done Done false
27024 7931 Acked Read 9 Sent Done Done false
27025 7932 Acked Write 7 Sent Done Done false
27026 7933 Acked Read 4 Sent Done Done false
27027 7934 Acked Read 4 Sent Done Done false
27028 7935 Acked Write 1 Sent Done Done false
27029 7936 Acked Write 1 Sent Done Done false
27030 7937 Acked Write 10 Sent Done Done false
27031 7938 Acked Write 2 Sent Done Done false
27032 7939 Acked Write 5 Sent Done Done false
27033 7940 Acked Write 2 Sent Done Done false
27034 7941 Acked Read 8 Sent Done Done false
27035 STATES DS:0 DS:1 DS:2 TOTAL
27036 Sent 301 0 0 301
27037 Done 0 301 301 602
27038 Skipped 0 0 0 0
27039 Error 0 0 0 0
27040 Last Flush: 7640 7925 7925
27041 Downstairs last five completed: 7640 7639 7638 7637 7636
27042 Upstairs last five completed: 7941 7940 7939 7938 7937
27043 CLIENT: Up:0 ds:301 act:2
27044 ----------------------------------------------------------------
27045 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:302
27046 States: Offline Active Active
27047 JOBID ACK TYPE BKS/EXT DS:0 DS:1 DS:2 REPLAY
27048 7641 Acked Write 9 Sent Done Done false
27049 7642 Acked Read 7 Sent Done Done false
27050 7643 Acked Write 10 Sent Done Done false
27051 7644 Acked Write 8 Sent Done Done false
27052 7645 Acked Read 4 Sent Done Done false
27053 7646 Acked Read 2 Sent Done Done false
27054 7647 Acked Read 1 Sent Done Done false
27055 7648 Acked Write 3 Sent Done Done false
27056 7649 Acked Write 9 Sent Done Done false
27057 7650 Acked Flush 0 Sent Done Done false
27058 7651 Acked Write 8 Sent Done Done false
27059 7652 Acked Flush 0 Sent Done Done false
27060 7653 Acked Write 1 Sent Done Done false
27061 7654 Acked Read 4 Sent Done Done false
27062 7655 Acked Write 9 Sent Done Done false
27063 7656 Acked Read 9 Sent Done Done false
27064 7657 Acked Write 5 Sent Done Done false
27065 7658 Acked Read 6 Sent Done Done false
27066 7659 Acked Flush 0 Sent Done Done false
27067 7660 Acked Read 8 Sent Done Done false
27068 7661 Acked Write 4 Sent Done Done false
27069 7662 Acked Write 9 Sent Done Done false
27070 7663 Acked Write 7 Sent Done Done false
27071 7664 Acked Write 6 Sent Done Done false
27072 7665 Acked Read 6 Sent Done Done false
27073 7666 Acked Write 5 Sent Done Done false
27074 7667 Acked Read 3 Sent Done Done false
27075 7668 Acked Write 7 Sent Done Done false
27076 7669 Acked Write 2 Sent Done Done false
27077 7670 Acked Read 2 Sent Done Done false
27078 7671 Acked Write 6 Sent Done Done false
27079 7672 Acked Flush 0 Sent Done Done false
27080 7673 Acked Read 8 Sent Done Done false
27081 7674 Acked Write 9 Sent Done Done false
27082 7675 Acked Read 8 Sent Done Done false
27083 7676 Acked Read 9 Sent Done Done false
27084 7677 Acked Read 3 Sent Done Done false
27085 7678 Acked Write 10 Sent Done Done false
27086 7679 Acked Read 10 Sent Done Done false
27087 7680 Acked Write 2 Sent Done Done false
27088 7681 Acked Read 10 Sent Done Done false
27089 7682 Acked Read 8 Sent Done Done false
27090 7683 Acked Read 7 Sent Done Done false
27091 7684 Acked Write 2 Sent Done Done false
27092 7685 Acked Read 5 Sent Done Done false
27093 7686 Acked Read 2 Sent Done Done false
27094 7687 Acked Read 6 Sent Done Done false
27095 7688 Acked Write 5 Sent Done Done false
27096 7689 Acked Write 4 Sent Done Done false
27097 7690 Acked Write 2 Sent Done Done false
27098 7691 Acked Read 10 Sent Done Done false
27099 7692 Acked Write 6 Sent Done Done false
27100 7693 Acked Flush 0 Sent Done Done false
27101 7694 Acked Read 6 Sent Done Done false
27102 7695 Acked Flush 0 Sent Done Done false
27103 7696 Acked Read 8 Sent Done Done false
27104 7697 Acked Write 7 Sent Done Done false
27105 7698 Acked Write 10 Sent Done Done false
27106 7699 Acked Read 7 Sent Done Done false
27107 7700 Acked Read 4 Sent Done Done false
27108 7701 Acked Write 7 Sent Done Done false
27109 7702 Acked Write 1 Sent Done Done false
27110 7703 Acked Read 6 Sent Done Done false
27111 7704 Acked Read 3 Sent Done Done false
27112 7705 Acked Read 8 Sent Done Done false
27113 7706 Acked Write 10 Sent Done Done false
27114 7707 Acked Write 3 Sent Done Done false
27115 7708 Acked Read 5 Sent Done Done false
27116 7709 Acked Write 6 Sent Done Done false
27117 7710 Acked Read 7 Sent Done Done false
27118 7711 Acked Read 4 Sent Done Done false
27119 7712 Acked Write 6 Sent Done Done false
27120 7713 Acked Read 9 Sent Done Done false
27121 7714 Acked Read 8 Sent Done Done false
27122 7715 Acked Read 4 Sent Done Done false
27123 7716 Acked Read 9 Sent Done Done false
27124 7717 Acked Read 1 Sent Done Done false
27125 7718 Acked Read 8 Sent Done Done false
27126 7719 Acked Read 8 Sent Done Done false
27127 7720 Acked Read 5 Sent Done Done false
27128 7721 Acked Write 4 Sent Done Done false
27129 7722 Acked Write 4 Sent Done Done false
27130 7723 Acked Write 9 Sent Done Done false
27131 7724 Acked Read 5 Sent Done Done false
27132 7725 Acked Read 1 Sent Done Done false
27133 7726 Acked Flush 0 Sent Done Done false
27134 7727 Acked Read 3 Sent Done Done false
27135 7728 Acked Write 1 Sent Done Done false
27136 7729 Acked Read 9 Sent Done Done false
27137 7730 Acked Read 3 Sent Done Done false
27138 7731 Acked Write 8 Sent Done Done false
27139 7732 Acked Read 7 Sent Done Done false
27140 7733 Acked Write 5 Sent Done Done false
27141 7734 Acked Read 1 Sent Done Done false
27142 7735 Acked Write 5 Sent Done Done false
27143 7736 Acked Read 9 Sent Done Done false
27144 7737 Acked Write 8 Sent Done Done false
27145 7738 Acked Read 4 Sent Done Done false
27146 7739 Acked Read 4 Sent Done Done false
27147 7740 Acked Read 10 Sent Done Done false
27148 7741 Acked Write 6 Sent Done Done false
27149 7742 Acked Read 2 Sent Done Done false
27150 7743 Acked Write 10 Sent Done Done false
27151 7744 Acked Write 5 Sent Done Done false
27152 7745 Acked Read 1 Sent Done Done false
27153 7746 Acked Write 5 Sent Done Done false
27154 7747 Acked Write 9 Sent Done Done false
27155 7748 Acked Read 6 Sent Done Done false
27156 7749 Acked Flush 0 Sent Done Done false
27157 7750 Acked Write 3 Sent Done Done false
27158 7751 Acked Flush 0 Sent Done Done false
27159 7752 Acked Write 8 Sent Done Done false
27160 7753 Acked Write 4 Sent Done Done false
27161 7754 Acked Read 1 Sent Done Done false
27162 7755 Acked Read 9 Sent Done Done false
27163 7756 Acked Write 1 Sent Done Done false
27164 7757 Acked Write 4 Sent Done Done false
27165 7758 Acked Read 2 Sent Done Done false
27166 7759 Acked Write 1 Sent Done Done false
27167 7760 Acked Flush 0 Sent Done Done false
27168 7761 Acked Write 8 Sent Done Done false
27169 7762 Acked Read 2 Sent Done Done false
27170 7763 Acked Read 3 Sent Done Done false
27171 7764 Acked Read 10 Sent Done Done false
27172 7765 Acked Read 3 Sent Done Done false
27173 7766 Acked Read 2 Sent Done Done false
27174 7767 Acked Read 9 Sent Done Done false
27175 7768 Acked Read 8 Sent Done Done false
27176 7769 Acked Read 6 Sent Done Done false
27177 7770 Acked Write 5 Sent Done Done false
27178 7771 Acked Read 1 Sent Done Done false
27179 7772 Acked Write 6 Sent Done Done false
27180 7773 Acked Write 8 Sent Done Done false
27181 7774 Acked Write 8 Sent Done Done false
27182 7775 Acked Write 8 Sent Done Done false
27183 7776 Acked Read 4 Sent Done Done false
27184 7777 Acked Read 2 Sent Done Done false
27185 7778 Acked Read 5 Sent Done Done false
27186 7779 Acked Read 7 Sent Done Done false
27187 7780 Acked Write 8 Sent Done Done false
27188 7781 Acked Flush 0 Sent Done Done false
27189 7782 Acked Read 2 Sent Done Done false
27190 7783 Acked Write 3 Sent Done Done false
27191 7784 Acked Write 7 Sent Done Done false
27192 7785 Acked Write 7 Sent Done Done false
27193 7786 Acked Write 9 Sent Done Done false
27194 7787 Acked Flush 0 Sent Done Done false
27195 7788 Acked Read 9 Sent Done Done false
27196 7789 Acked Write 3 Sent Done Done false
27197 7790 Acked Write 1 Sent Done Done false
27198 7791 Acked Write 7 Sent Done Done false
27199 7792 Acked Read 9 Sent Done Done false
27200 7793 Acked Read 10 Sent Done Done false
27201 7794 Acked Write 4 Sent Done Done false
27202 7795 Acked Flush 0 Sent Done Done false
27203 7796 Acked Flush 0 Sent Done Done false
27204 7797 Acked Write 3 Sent Done Done false
27205 7798 Acked Read 4 Sent Done Done false
27206 7799 Acked Flush 0 Sent Done Done false
27207 7800 Acked Read 7 Sent Done Done false
27208 7801 Acked Read 6 Sent Done Done false
27209 7802 Acked Read 7 Sent Done Done false
27210 7803 Acked Read 10 Sent Done Done false
27211 7804 Acked Write 8 Sent Done Done false
27212 7805 Acked Read 1 Sent Done Done false
27213 7806 Acked Write 8 Sent Done Done false
27214 7807 Acked Write 5 Sent Done Done false
27215 7808 Acked Flush 0 Sent Done Done false
27216 7809 Acked Write 3 Sent Done Done false
27217 7810 Acked Write 4 Sent Done Done false
27218 7811 Acked Read 3 Sent Done Done false
27219 7812 Acked Read 10 Sent Done Done false
27220 7813 Acked Flush 0 Sent Done Done false
27221 7814 Acked Read 8 Sent Done Done false
27222 7815 Acked Read 3 Sent Done Done false
27223 7816 Acked Write 5 Sent Done Done false
27224 7817 Acked Read 1 Sent Done Done false
27225 7818 Acked Write 1 Sent Done Done false
27226 7819 Acked Write 1 Sent Done Done false
27227 7820 Acked Write 5 Sent Done Done false
27228 7821 Acked Flush 0 Sent Done Done false
27229 7822 Acked Read 3 Sent Done Done false
27230 7823 Acked Write 1 Sent Done Done false
27231 7824 Acked Read 3 Sent Done Done false
27232 7825 Acked Read 5 Sent Done Done false
27233 7826 Acked Write 9 Sent Done Done false
27234 7827 Acked Write 4 Sent Done Done false
27235 7828 Acked Read 9 Sent Done Done false
27236 7829 Acked Read 6 Sent Done Done false
27237 7830 Acked Read 6 Sent Done Done false
27238 7831 Acked Read 8 Sent Done Done false
27239 7832 Acked Read 1 Sent Done Done false
27240 7833 Acked Write 7 Sent Done Done false
27241 7834 Acked Read 6 Sent Done Done false
27242 7835 Acked Flush 0 Sent Done Done false
27243 7836 Acked Write 9 Sent Done Done false
27244 7837 Acked Write 10 Sent Done Done false
27245 7838 Acked Write 2 Sent Done Done false
27246 7839 Acked Read 7 Sent Done Done false
27247 7840 Acked Flush 0 Sent Done Done false
27248 7841 Acked Flush 0 Sent Done Done false
27249 7842 Acked Read 5 Sent Done Done false
27250 7843 Acked Read 7 Sent Done Done false
27251 7844 Acked Write 9 Sent Done Done false
27252 7845 Acked Read 5 Sent Done Done false
27253 7846 Acked Write 8 Sent Done Done false
27254 7847 Acked Write 5 Sent Done Done false
27255 7848 Acked Flush 0 Sent Done Done false
27256 7849 Acked Read 4 Sent Done Done false
27257 7850 Acked Write 3 Sent Done Done false
27258 7851 Acked Write 6 Sent Done Done false
27259 7852 Acked Read 2 Sent Done Done false
27260 7853 Acked Read 6 Sent Done Done false
27261 7854 Acked Flush 0 Sent Done Done false
27262 7855 Acked Read 3 Sent Done Done false
27263 7856 Acked Read 5 Sent Done Done false
27264 7857 Acked Read 1 Sent Done Done false
27265 7858 Acked Flush 0 Sent Done Done false
27266 7859 Acked Write 6 Sent Done Done false
27267 7860 Acked Write 7 Sent Done Done false
27268 7861 Acked Write 3 Sent Done Done false
27269 7862 Acked Write 8 Sent Done Done false
27270 7863 Acked Write 4 Sent Done Done false
27271 7864 Acked Write 7 Sent Done Done false
27272 7865 Acked Write 9 Sent Done Done false
27273 7866 Acked Flush 0 Sent Done Done false
27274 7867 Acked Write 4 Sent Done Done false
27275 7868 Acked Read 4 Sent Done Done false
27276 7869 Acked Read 6 Sent Done Done false
27277 7870 Acked Read 3 Sent Done Done false
27278 7871 Acked Write 5 Sent Done Done false
27279 7872 Acked Write 10 Sent Done Done false
27280 7873 Acked Write 10 Sent Done Done false
27281 7874 Acked Read 3 Sent Done Done false
27282 7875 Acked Read 3 Sent Done Done false
27283 7876 Acked Read 4 Sent Done Done false
27284 7877 Acked Read 9 Sent Done Done false
27285 7878 Acked Flush 0 Sent Done Done false
27286 7879 Acked Read 6 Sent Done Done false
27287 7880 Acked Write 1 Sent Done Done false
27288 7881 Acked Read 3 Sent Done Done false
27289 7882 Acked Read 8 Sent Done Done false
27290 7883 Acked Write 9 Sent Done Done false
27291 7884 Acked Write 1 Sent Done Done false
27292 7885 Acked Write 4 Sent Done Done false
27293 7886 Acked Read 1 Sent Done Done false
27294 7887 Acked Read 2 Sent Done Done false
27295 7888 Acked Write 4 Sent Done Done false
27296 7889 Acked Write 10 Sent Done Done false
27297 7890 Acked Flush 0 Sent Done Done false
27298 7891 Acked Write 8 Sent Done Done false
27299 7892 Acked Write 6 Sent Done Done false
27300 7893 Acked Read 4 Sent Done Done false
27301 7894 Acked Write 7 Sent Done Done false
27302 7895 Acked Read 10 Sent Done Done false
27303 7896 Acked Read 1 Sent Done Done false
27304 7897 Acked Flush 0 Sent Done Done false
27305 7898 Acked Write 4 Sent Done Done false
27306 7899 Acked Write 9 Sent Done Done false
27307 7900 Acked Write 8 Sent Done Done false
27308 7901 Acked Read 1 Sent Done Done false
27309 7902 Acked Write 1 Sent Done Done false
27310 7903 Acked Read 3 Sent Done Done false
27311 7904 Acked Write 1 Sent Done Done false
27312 7905 Acked Write 2 Sent Done Done false
27313 7906 Acked Read 5 Sent Done Done false
27314 7907 Acked Read 3 Sent Done Done false
27315 7908 Acked Read 2 Sent Done Done false
27316 7909 Acked Read 4 Sent Done Done false
27317 7910 Acked Write 3 Sent Done Done false
27318 7911 Acked Read 5 Sent Done Done false
27319 7912 Acked Read 6 Sent Done Done false
27320 7913 Acked Write 2 Sent Done Done false
27321 7914 Acked Read 3 Sent Done Done false
27322 7915 Acked Write 3 Sent Done Done false
27323 7916 Acked Write 6 Sent Done Done false
27324 7917 Acked Flush 0 Sent Done Done false
27325 7918 Acked Write 2 Sent Done Done false
27326 7919 Acked Read 2 Sent Done Done false
27327 7920 Acked Read 10 Sent Done Done false
27328 7921 Acked Read 5 Sent Done Done false
27329 7922 Acked Read 4 Sent Done Done false
27330 7923 Acked Write 9 Sent Done Done false
27331 7924 Acked Flush 0 Sent Done Done false
27332 7925 Acked Flush 0 Sent Done Done false
27333 7926 Acked Read 3 Sent Done Done false
27334 7927 Acked Read 10 Sent Done Done false
27335 7928 Acked Read 8 Sent Done Done false
27336 7929 Acked Write 6 Sent Done Done false
27337 7930 Acked Read 8 Sent Done Done false
27338 7931 Acked Read 9 Sent Done Done false
27339 7932 Acked Write 7 Sent Done Done false
27340 7933 Acked Read 4 Sent Done Done false
27341 7934 Acked Read 4 Sent Done Done false
27342 7935 Acked Write 1 Sent Done Done false
27343 7936 Acked Write 1 Sent Done Done false
27344 7937 Acked Write 10 Sent Done Done false
27345 7938 Acked Write 2 Sent Done Done false
27346 7939 Acked Write 5 Sent Done Done false
27347 7940 Acked Write 2 Sent Done Done false
27348 7941 Acked Read 8 Sent Done Done false
27349 7942 Acked Flush 0 Sent Done Done false
27350 STATES DS:0 DS:1 DS:2 TOTAL
27351 Sent 302 0 0 302
27352 Done 0 302 302 604
27353 Skipped 0 0 0 0
27354 Error 0 0 0 0
27355 Last Flush: 7640 7942 7942
27356 Downstairs last five completed: 7640 7639 7638 7637 7636
27357 Upstairs last five completed: 7942 7941 7940 7939 7938
27358 CLIENT: Up:0 ds:302 act:2
273592025-01-10T16:41:03.152ZINFOcrucible: connecting to 127.0.0.1:8810 = io task client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
273602025-01-10T16:41:03.152ZWARNcrucible: ds_connection connect to 127.0.0.1:8810 failure: Os { code: 146, kind: ConnectionRefused, message: "Connection refused" } = io task client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
273612025-01-10T16:41:03.152ZWARNcrucible: client task is sending Done(ConnectionFailed(Os { code: 146, kind: ConnectionRefused, message: "Connection refused" })) = io task client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
273622025-01-10T16:41:03.152ZWARNcrucible: downstairs task for 0 stopped due to ConnectionFailed(Os { code: 146, kind: ConnectionRefused, message: "Connection refused" }) session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
273632025-01-10T16:41:03.152ZINFOcrucible: client task is exiting = io task client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
27364 [8810] got start action
27365 [8810] I am going to restart
27366 Starting downstairs at port 8810
27367 Make output file at "/tmp/dsc/downstairs-8810.txt"
27368 [8810][0] reports Starting
27369 Downstairs /var/tmp/dsc/region/8810 port 8810 PID:Some(1225)
27370 [8810][0] reports Running
27371 ----------------------------------------------------------------
27372 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:302
27373 States: Offline Active Active
27374 JOBID ACK TYPE BKS/EXT DS:0 DS:1 DS:2 REPLAY
27375 7641 Acked Write 9 Sent Done Done false
27376 7642 Acked Read 7 Sent Done Done false
27377 7643 Acked Write 10 Sent Done Done false
27378 7644 Acked Write 8 Sent Done Done false
27379 7645 Acked Read 4 Sent Done Done false
27380 7646 Acked Read 2 Sent Done Done false
27381 7647 Acked Read 1 Sent Done Done false
27382 7648 Acked Write 3 Sent Done Done false
27383 7649 Acked Write 9 Sent Done Done false
27384 7650 Acked Flush 0 Sent Done Done false
27385 7651 Acked Write 8 Sent Done Done false
27386 7652 Acked Flush 0 Sent Done Done false
27387 7653 Acked Write 1 Sent Done Done false
27388 7654 Acked Read 4 Sent Done Done false
27389 7655 Acked Write 9 Sent Done Done false
27390 7656 Acked Read 9 Sent Done Done false
27391 7657 Acked Write 5 Sent Done Done false
27392 7658 Acked Read 6 Sent Done Done false
27393 7659 Acked Flush 0 Sent Done Done false
27394 7660 Acked Read 8 Sent Done Done false
27395 7661 Acked Write 4 Sent Done Done false
27396 7662 Acked Write 9 Sent Done Done false
27397 7663 Acked Write 7 Sent Done Done false
27398 7664 Acked Write 6 Sent Done Done false
27399 7665 Acked Read 6 Sent Done Done false
27400 7666 Acked Write 5 Sent Done Done false
27401 7667 Acked Read 3 Sent Done Done false
27402 7668 Acked Write 7 Sent Done Done false
27403 7669 Acked Write 2 Sent Done Done false
27404 7670 Acked Read 2 Sent Done Done false
27405 7671 Acked Write 6 Sent Done Done false
27406 7672 Acked Flush 0 Sent Done Done false
27407 7673 Acked Read 8 Sent Done Done false
27408 7674 Acked Write 9 Sent Done Done false
27409 7675 Acked Read 8 Sent Done Done false
27410 7676 Acked Read 9 Sent Done Done false
27411 7677 Acked Read 3 Sent Done Done false
27412 7678 Acked Write 10 Sent Done Done false
27413 7679 Acked Read 10 Sent Done Done false
27414 7680 Acked Write 2 Sent Done Done false
27415 7681 Acked Read 10 Sent Done Done false
27416 7682 Acked Read 8 Sent Done Done false
27417 7683 Acked Read 7 Sent Done Done false
27418 7684 Acked Write 2 Sent Done Done false
27419 7685 Acked Read 5 Sent Done Done false
27420 7686 Acked Read 2 Sent Done Done false
27421 7687 Acked Read 6 Sent Done Done false
27422 7688 Acked Write 5 Sent Done Done false
27423 7689 Acked Write 4 Sent Done Done false
27424 7690 Acked Write 2 Sent Done Done false
27425 7691 Acked Read 10 Sent Done Done false
27426 7692 Acked Write 6 Sent Done Done false
27427 7693 Acked Flush 0 Sent Done Done false
27428 7694 Acked Read 6 Sent Done Done false
27429 7695 Acked Flush 0 Sent Done Done false
27430 7696 Acked Read 8 Sent Done Done false
27431 7697 Acked Write 7 Sent Done Done false
27432 7698 Acked Write 10 Sent Done Done false
27433 7699 Acked Read 7 Sent Done Done false
27434 7700 Acked Read 4 Sent Done Done false
27435 7701 Acked Write 7 Sent Done Done false
27436 7702 Acked Write 1 Sent Done Done false
27437 7703 Acked Read 6 Sent Done Done false
27438 7704 Acked Read 3 Sent Done Done false
27439 7705 Acked Read 8 Sent Done Done false
27440 7706 Acked Write 10 Sent Done Done false
27441 7707 Acked Write 3 Sent Done Done false
27442 7708 Acked Read 5 Sent Done Done false
27443 7709 Acked Write 6 Sent Done Done false
27444 7710 Acked Read 7 Sent Done Done false
27445 7711 Acked Read 4 Sent Done Done false
27446 7712 Acked Write 6 Sent Done Done false
27447 7713 Acked Read 9 Sent Done Done false
27448 7714 Acked Read 8 Sent Done Done false
27449 7715 Acked Read 4 Sent Done Done false
27450 7716 Acked Read 9 Sent Done Done false
27451 7717 Acked Read 1 Sent Done Done false
27452 7718 Acked Read 8 Sent Done Done false
27453 7719 Acked Read 8 Sent Done Done false
27454 7720 Acked Read 5 Sent Done Done false
27455 7721 Acked Write 4 Sent Done Done false
27456 7722 Acked Write 4 Sent Done Done false
27457 7723 Acked Write 9 Sent Done Done false
27458 7724 Acked Read 5 Sent Done Done false
27459 7725 Acked Read 1 Sent Done Done false
27460 7726 Acked Flush 0 Sent Done Done false
27461 7727 Acked Read 3 Sent Done Done false
27462 7728 Acked Write 1 Sent Done Done false
27463 7729 Acked Read 9 Sent Done Done false
27464 7730 Acked Read 3 Sent Done Done false
27465 7731 Acked Write 8 Sent Done Done false
27466 7732 Acked Read 7 Sent Done Done false
27467 7733 Acked Write 5 Sent Done Done false
27468 7734 Acked Read 1 Sent Done Done false
27469 7735 Acked Write 5 Sent Done Done false
27470 7736 Acked Read 9 Sent Done Done false
27471 7737 Acked Write 8 Sent Done Done false
27472 7738 Acked Read 4 Sent Done Done false
27473 7739 Acked Read 4 Sent Done Done false
27474 7740 Acked Read 10 Sent Done Done false
27475 7741 Acked Write 6 Sent Done Done false
27476 7742 Acked Read 2 Sent Done Done false
27477 7743 Acked Write 10 Sent Done Done false
27478 7744 Acked Write 5 Sent Done Done false
27479 7745 Acked Read 1 Sent Done Done false
27480 7746 Acked Write 5 Sent Done Done false
27481 7747 Acked Write 9 Sent Done Done false
27482 7748 Acked Read 6 Sent Done Done false
27483 7749 Acked Flush 0 Sent Done Done false
27484 7750 Acked Write 3 Sent Done Done false
27485 7751 Acked Flush 0 Sent Done Done false
27486 7752 Acked Write 8 Sent Done Done false
27487 7753 Acked Write 4 Sent Done Done false
27488 7754 Acked Read 1 Sent Done Done false
27489 7755 Acked Read 9 Sent Done Done false
27490 7756 Acked Write 1 Sent Done Done false
27491 7757 Acked Write 4 Sent Done Done false
27492 7758 Acked Read 2 Sent Done Done false
27493 7759 Acked Write 1 Sent Done Done false
27494 7760 Acked Flush 0 Sent Done Done false
27495 7761 Acked Write 8 Sent Done Done false
27496 7762 Acked Read 2 Sent Done Done false
27497 7763 Acked Read 3 Sent Done Done false
27498 7764 Acked Read 10 Sent Done Done false
27499 7765 Acked Read 3 Sent Done Done false
27500 7766 Acked Read 2 Sent Done Done false
27501 7767 Acked Read 9 Sent Done Done false
27502 7768 Acked Read 8 Sent Done Done false
27503 7769 Acked Read 6 Sent Done Done false
27504 7770 Acked Write 5 Sent Done Done false
27505 7771 Acked Read 1 Sent Done Done false
27506 7772 Acked Write 6 Sent Done Done false
27507 7773 Acked Write 8 Sent Done Done false
27508 7774 Acked Write 8 Sent Done Done false
27509 7775 Acked Write 8 Sent Done Done false
27510 7776 Acked Read 4 Sent Done Done false
27511 7777 Acked Read 2 Sent Done Done false
27512 7778 Acked Read 5 Sent Done Done false
27513 7779 Acked Read 7 Sent Done Done false
27514 7780 Acked Write 8 Sent Done Done false
27515 7781 Acked Flush 0 Sent Done Done false
27516 7782 Acked Read 2 Sent Done Done false
27517 7783 Acked Write 3 Sent Done Done false
27518 7784 Acked Write 7 Sent Done Done false
27519 7785 Acked Write 7 Sent Done Done false
27520 7786 Acked Write 9 Sent Done Done false
27521 7787 Acked Flush 0 Sent Done Done false
27522 7788 Acked Read 9 Sent Done Done false
27523 7789 Acked Write 3 Sent Done Done false
27524 7790 Acked Write 1 Sent Done Done false
27525 7791 Acked Write 7 Sent Done Done false
27526 7792 Acked Read 9 Sent Done Done false
27527 7793 Acked Read 10 Sent Done Done false
27528 7794 Acked Write 4 Sent Done Done false
27529 7795 Acked Flush 0 Sent Done Done false
27530 7796 Acked Flush 0 Sent Done Done false
27531 7797 Acked Write 3 Sent Done Done false
27532 7798 Acked Read 4 Sent Done Done false
27533 7799 Acked Flush 0 Sent Done Done false
27534 7800 Acked Read 7 Sent Done Done false
27535 7801 Acked Read 6 Sent Done Done false
27536 7802 Acked Read 7 Sent Done Done false
27537 7803 Acked Read 10 Sent Done Done false
27538 7804 Acked Write 8 Sent Done Done false
27539 7805 Acked Read 1 Sent Done Done false
27540 7806 Acked Write 8 Sent Done Done false
27541 7807 Acked Write 5 Sent Done Done false
27542 7808 Acked Flush 0 Sent Done Done false
27543 7809 Acked Write 3 Sent Done Done false
27544 7810 Acked Write 4 Sent Done Done false
27545 7811 Acked Read 3 Sent Done Done false
27546 7812 Acked Read 10 Sent Done Done false
27547 7813 Acked Flush 0 Sent Done Done false
27548 7814 Acked Read 8 Sent Done Done false
27549 7815 Acked Read 3 Sent Done Done false
27550 7816 Acked Write 5 Sent Done Done false
27551 7817 Acked Read 1 Sent Done Done false
27552 7818 Acked Write 1 Sent Done Done false
27553 7819 Acked Write 1 Sent Done Done false
27554 7820 Acked Write 5 Sent Done Done false
27555 7821 Acked Flush 0 Sent Done Done false
27556 7822 Acked Read 3 Sent Done Done false
27557 7823 Acked Write 1 Sent Done Done false
27558 7824 Acked Read 3 Sent Done Done false
27559 7825 Acked Read 5 Sent Done Done false
27560 7826 Acked Write 9 Sent Done Done false
27561 7827 Acked Write 4 Sent Done Done false
27562 7828 Acked Read 9 Sent Done Done false
27563 7829 Acked Read 6 Sent Done Done false
27564 7830 Acked Read 6 Sent Done Done false
27565 7831 Acked Read 8 Sent Done Done false
27566 7832 Acked Read 1 Sent Done Done false
27567 7833 Acked Write 7 Sent Done Done false
27568 7834 Acked Read 6 Sent Done Done false
27569 7835 Acked Flush 0 Sent Done Done false
27570 7836 Acked Write 9 Sent Done Done false
27571 7837 Acked Write 10 Sent Done Done false
27572 7838 Acked Write 2 Sent Done Done false
27573 7839 Acked Read 7 Sent Done Done false
27574 7840 Acked Flush 0 Sent Done Done false
27575 7841 Acked Flush 0 Sent Done Done false
27576 7842 Acked Read 5 Sent Done Done false
27577 7843 Acked Read 7 Sent Done Done false
27578 7844 Acked Write 9 Sent Done Done false
27579 7845 Acked Read 5 Sent Done Done false
27580 7846 Acked Write 8 Sent Done Done false
27581 7847 Acked Write 5 Sent Done Done false
27582 7848 Acked Flush 0 Sent Done Done false
27583 7849 Acked Read 4 Sent Done Done false
27584 7850 Acked Write 3 Sent Done Done false
27585 7851 Acked Write 6 Sent Done Done false
27586 7852 Acked Read 2 Sent Done Done false
27587 7853 Acked Read 6 Sent Done Done false
27588 7854 Acked Flush 0 Sent Done Done false
27589 7855 Acked Read 3 Sent Done Done false
27590 7856 Acked Read 5 Sent Done Done false
27591 7857 Acked Read 1 Sent Done Done false
27592 7858 Acked Flush 0 Sent Done Done false
27593 7859 Acked Write 6 Sent Done Done false
27594 7860 Acked Write 7 Sent Done Done false
27595 7861 Acked Write 3 Sent Done Done false
27596 7862 Acked Write 8 Sent Done Done false
27597 7863 Acked Write 4 Sent Done Done false
27598 7864 Acked Write 7 Sent Done Done false
27599 7865 Acked Write 9 Sent Done Done false
27600 7866 Acked Flush 0 Sent Done Done false
27601 7867 Acked Write 4 Sent Done Done false
27602 7868 Acked Read 4 Sent Done Done false
27603 7869 Acked Read 6 Sent Done Done false
27604 7870 Acked Read 3 Sent Done Done false
27605 7871 Acked Write 5 Sent Done Done false
27606 7872 Acked Write 10 Sent Done Done false
27607 7873 Acked Write 10 Sent Done Done false
27608 7874 Acked Read 3 Sent Done Done false
27609 7875 Acked Read 3 Sent Done Done false
27610 7876 Acked Read 4 Sent Done Done false
27611 7877 Acked Read 9 Sent Done Done false
27612 7878 Acked Flush 0 Sent Done Done false
27613 7879 Acked Read 6 Sent Done Done false
27614 7880 Acked Write 1 Sent Done Done false
27615 7881 Acked Read 3 Sent Done Done false
27616 7882 Acked Read 8 Sent Done Done false
27617 7883 Acked Write 9 Sent Done Done false
27618 7884 Acked Write 1 Sent Done Done false
27619 7885 Acked Write 4 Sent Done Done false
27620 7886 Acked Read 1 Sent Done Done false
27621 7887 Acked Read 2 Sent Done Done false
27622 7888 Acked Write 4 Sent Done Done false
27623 7889 Acked Write 10 Sent Done Done false
27624 7890 Acked Flush 0 Sent Done Done false
27625 7891 Acked Write 8 Sent Done Done false
27626 7892 Acked Write 6 Sent Done Done false
27627 7893 Acked Read 4 Sent Done Done false
27628 7894 Acked Write 7 Sent Done Done false
27629 7895 Acked Read 10 Sent Done Done false
27630 7896 Acked Read 1 Sent Done Done false
27631 7897 Acked Flush 0 Sent Done Done false
27632 7898 Acked Write 4 Sent Done Done false
27633 7899 Acked Write 9 Sent Done Done false
27634 7900 Acked Write 8 Sent Done Done false
27635 7901 Acked Read 1 Sent Done Done false
27636 7902 Acked Write 1 Sent Done Done false
27637 7903 Acked Read 3 Sent Done Done false
27638 7904 Acked Write 1 Sent Done Done false
27639 7905 Acked Write 2 Sent Done Done false
27640 7906 Acked Read 5 Sent Done Done false
27641 7907 Acked Read 3 Sent Done Done false
27642 7908 Acked Read 2 Sent Done Done false
27643 7909 Acked Read 4 Sent Done Done false
27644 7910 Acked Write 3 Sent Done Done false
27645 7911 Acked Read 5 Sent Done Done false
27646 7912 Acked Read 6 Sent Done Done false
27647 7913 Acked Write 2 Sent Done Done false
27648 7914 Acked Read 3 Sent Done Done false
27649 7915 Acked Write 3 Sent Done Done false
27650 7916 Acked Write 6 Sent Done Done false
27651 7917 Acked Flush 0 Sent Done Done false
27652 7918 Acked Write 2 Sent Done Done false
27653 7919 Acked Read 2 Sent Done Done false
27654 7920 Acked Read 10 Sent Done Done false
27655 7921 Acked Read 5 Sent Done Done false
27656 7922 Acked Read 4 Sent Done Done false
27657 7923 Acked Write 9 Sent Done Done false
27658 7924 Acked Flush 0 Sent Done Done false
27659 7925 Acked Flush 0 Sent Done Done false
27660 7926 Acked Read 3 Sent Done Done false
27661 7927 Acked Read 10 Sent Done Done false
27662 7928 Acked Read 8 Sent Done Done false
27663 7929 Acked Write 6 Sent Done Done false
27664 7930 Acked Read 8 Sent Done Done false
27665 7931 Acked Read 9 Sent Done Done false
27666 7932 Acked Write 7 Sent Done Done false
27667 7933 Acked Read 4 Sent Done Done false
27668 7934 Acked Read 4 Sent Done Done false
27669 7935 Acked Write 1 Sent Done Done false
27670 7936 Acked Write 1 Sent Done Done false
27671 7937 Acked Write 10 Sent Done Done false
27672 7938 Acked Write 2 Sent Done Done false
27673 7939 Acked Write 5 Sent Done Done false
27674 7940 Acked Write 2 Sent Done Done false
27675 7941 Acked Read 8 Sent Done Done false
27676 7942 Acked Flush 0 Sent Done Done false
27677 STATES DS:0 DS:1 DS:2 TOTAL
27678 Sent 302 0 0 302
27679 Done 0 302 302 604
27680 Skipped 0 0 0 0
27681 Error 0 0 0 0
27682 Last Flush: 7640 7942 7942
27683 Downstairs last five completed: 7640 7639 7638 7637 7636
27684 Upstairs last five completed: 7942 7941 7940 7939 7938
27685 CLIENT: Up:0 ds:302 act:2
27686 ----------------------------------------------------------------
27687 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:302
27688 States: Offline Active Active
27689 JOBID ACK TYPE BKS/EXT DS:0 DS:1 DS:2 REPLAY
27690 7641 Acked Write 9 Sent Done Done false
27691 7642 Acked Read 7 Sent Done Done false
27692 7643 Acked Write 10 Sent Done Done false
27693 7644 Acked Write 8 Sent Done Done false
27694 7645 Acked Read 4 Sent Done Done false
27695 7646 Acked Read 2 Sent Done Done false
27696 7647 Acked Read 1 Sent Done Done false
27697 7648 Acked Write 3 Sent Done Done false
27698 7649 Acked Write 9 Sent Done Done false
27699 7650 Acked Flush 0 Sent Done Done false
27700 7651 Acked Write 8 Sent Done Done false
27701 7652 Acked Flush 0 Sent Done Done false
27702 7653 Acked Write 1 Sent Done Done false
27703 7654 Acked Read 4 Sent Done Done false
27704 7655 Acked Write 9 Sent Done Done false
27705 7656 Acked Read 9 Sent Done Done false
27706 7657 Acked Write 5 Sent Done Done false
27707 7658 Acked Read 6 Sent Done Done false
27708 7659 Acked Flush 0 Sent Done Done false
27709 7660 Acked Read 8 Sent Done Done false
27710 7661 Acked Write 4 Sent Done Done false
27711 7662 Acked Write 9 Sent Done Done false
27712 7663 Acked Write 7 Sent Done Done false
27713 7664 Acked Write 6 Sent Done Done false
27714 7665 Acked Read 6 Sent Done Done false
27715 7666 Acked Write 5 Sent Done Done false
27716 7667 Acked Read 3 Sent Done Done false
27717 7668 Acked Write 7 Sent Done Done false
27718 7669 Acked Write 2 Sent Done Done false
27719 7670 Acked Read 2 Sent Done Done false
27720 7671 Acked Write 6 Sent Done Done false
27721 7672 Acked Flush 0 Sent Done Done false
27722 7673 Acked Read 8 Sent Done Done false
27723 7674 Acked Write 9 Sent Done Done false
27724 7675 Acked Read 8 Sent Done Done false
27725 7676 Acked Read 9 Sent Done Done false
27726 7677 Acked Read 3 Sent Done Done false
27727 7678 Acked Write 10 Sent Done Done false
27728 7679 Acked Read 10 Sent Done Done false
27729 7680 Acked Write 2 Sent Done Done false
27730 7681 Acked Read 10 Sent Done Done false
27731 7682 Acked Read 8 Sent Done Done false
27732 7683 Acked Read 7 Sent Done Done false
27733 7684 Acked Write 2 Sent Done Done false
27734 7685 Acked Read 5 Sent Done Done false
27735 7686 Acked Read 2 Sent Done Done false
27736 7687 Acked Read 6 Sent Done Done false
27737 7688 Acked Write 5 Sent Done Done false
27738 7689 Acked Write 4 Sent Done Done false
27739 7690 Acked Write 2 Sent Done Done false
27740 7691 Acked Read 10 Sent Done Done false
27741 7692 Acked Write 6 Sent Done Done false
27742 7693 Acked Flush 0 Sent Done Done false
27743 7694 Acked Read 6 Sent Done Done false
27744 7695 Acked Flush 0 Sent Done Done false
27745 7696 Acked Read 8 Sent Done Done false
27746 7697 Acked Write 7 Sent Done Done false
27747 7698 Acked Write 10 Sent Done Done false
27748 7699 Acked Read 7 Sent Done Done false
27749 7700 Acked Read 4 Sent Done Done false
27750 7701 Acked Write 7 Sent Done Done false
27751 7702 Acked Write 1 Sent Done Done false
27752 7703 Acked Read 6 Sent Done Done false
27753 7704 Acked Read 3 Sent Done Done false
27754 7705 Acked Read 8 Sent Done Done false
27755 7706 Acked Write 10 Sent Done Done false
27756 7707 Acked Write 3 Sent Done Done false
27757 7708 Acked Read 5 Sent Done Done false
27758 7709 Acked Write 6 Sent Done Done false
27759 7710 Acked Read 7 Sent Done Done false
27760 7711 Acked Read 4 Sent Done Done false
27761 7712 Acked Write 6 Sent Done Done false
27762 7713 Acked Read 9 Sent Done Done false
27763 7714 Acked Read 8 Sent Done Done false
27764 7715 Acked Read 4 Sent Done Done false
27765 7716 Acked Read 9 Sent Done Done false
27766 7717 Acked Read 1 Sent Done Done false
27767 7718 Acked Read 8 Sent Done Done false
27768 7719 Acked Read 8 Sent Done Done false
27769 7720 Acked Read 5 Sent Done Done false
27770 7721 Acked Write 4 Sent Done Done false
27771 7722 Acked Write 4 Sent Done Done false
27772 7723 Acked Write 9 Sent Done Done false
27773 7724 Acked Read 5 Sent Done Done false
27774 7725 Acked Read 1 Sent Done Done false
27775 7726 Acked Flush 0 Sent Done Done false
27776 7727 Acked Read 3 Sent Done Done false
27777 7728 Acked Write 1 Sent Done Done false
27778 7729 Acked Read 9 Sent Done Done false
27779 7730 Acked Read 3 Sent Done Done false
27780 7731 Acked Write 8 Sent Done Done false
27781 7732 Acked Read 7 Sent Done Done false
27782 7733 Acked Write 5 Sent Done Done false
27783 7734 Acked Read 1 Sent Done Done false
27784 7735 Acked Write 5 Sent Done Done false
27785 7736 Acked Read 9 Sent Done Done false
27786 7737 Acked Write 8 Sent Done Done false
27787 7738 Acked Read 4 Sent Done Done false
27788 7739 Acked Read 4 Sent Done Done false
27789 7740 Acked Read 10 Sent Done Done false
27790 7741 Acked Write 6 Sent Done Done false
27791 7742 Acked Read 2 Sent Done Done false
27792 7743 Acked Write 10 Sent Done Done false
27793 7744 Acked Write 5 Sent Done Done false
27794 7745 Acked Read 1 Sent Done Done false
27795 7746 Acked Write 5 Sent Done Done false
27796 7747 Acked Write 9 Sent Done Done false
27797 7748 Acked Read 6 Sent Done Done false
27798 7749 Acked Flush 0 Sent Done Done false
27799 7750 Acked Write 3 Sent Done Done false
27800 7751 Acked Flush 0 Sent Done Done false
27801 7752 Acked Write 8 Sent Done Done false
27802 7753 Acked Write 4 Sent Done Done false
27803 7754 Acked Read 1 Sent Done Done false
27804 7755 Acked Read 9 Sent Done Done false
27805 7756 Acked Write 1 Sent Done Done false
27806 7757 Acked Write 4 Sent Done Done false
27807 7758 Acked Read 2 Sent Done Done false
27808 7759 Acked Write 1 Sent Done Done false
27809 7760 Acked Flush 0 Sent Done Done false
27810 7761 Acked Write 8 Sent Done Done false
27811 7762 Acked Read 2 Sent Done Done false
27812 7763 Acked Read 3 Sent Done Done false
27813 7764 Acked Read 10 Sent Done Done false
27814 7765 Acked Read 3 Sent Done Done false
27815 7766 Acked Read 2 Sent Done Done false
27816 7767 Acked Read 9 Sent Done Done false
27817 7768 Acked Read 8 Sent Done Done false
27818 7769 Acked Read 6 Sent Done Done false
27819 7770 Acked Write 5 Sent Done Done false
27820 7771 Acked Read 1 Sent Done Done false
27821 7772 Acked Write 6 Sent Done Done false
27822 7773 Acked Write 8 Sent Done Done false
27823 7774 Acked Write 8 Sent Done Done false
27824 7775 Acked Write 8 Sent Done Done false
27825 7776 Acked Read 4 Sent Done Done false
27826 7777 Acked Read 2 Sent Done Done false
27827 7778 Acked Read 5 Sent Done Done false
27828 7779 Acked Read 7 Sent Done Done false
27829 7780 Acked Write 8 Sent Done Done false
27830 7781 Acked Flush 0 Sent Done Done false
27831 7782 Acked Read 2 Sent Done Done false
27832 7783 Acked Write 3 Sent Done Done false
27833 7784 Acked Write 7 Sent Done Done false
27834 7785 Acked Write 7 Sent Done Done false
27835 7786 Acked Write 9 Sent Done Done false
27836 7787 Acked Flush 0 Sent Done Done false
27837 7788 Acked Read 9 Sent Done Done false
27838 7789 Acked Write 3 Sent Done Done false
27839 7790 Acked Write 1 Sent Done Done false
27840 7791 Acked Write 7 Sent Done Done false
27841 7792 Acked Read 9 Sent Done Done false
27842 7793 Acked Read 10 Sent Done Done false
27843 7794 Acked Write 4 Sent Done Done false
27844 7795 Acked Flush 0 Sent Done Done false
27845 7796 Acked Flush 0 Sent Done Done false
27846 7797 Acked Write 3 Sent Done Done false
27847 7798 Acked Read 4 Sent Done Done false
27848 7799 Acked Flush 0 Sent Done Done false
27849 7800 Acked Read 7 Sent Done Done false
27850 7801 Acked Read 6 Sent Done Done false
27851 7802 Acked Read 7 Sent Done Done false
27852 7803 Acked Read 10 Sent Done Done false
27853 7804 Acked Write 8 Sent Done Done false
27854 7805 Acked Read 1 Sent Done Done false
27855 7806 Acked Write 8 Sent Done Done false
27856 7807 Acked Write 5 Sent Done Done false
27857 7808 Acked Flush 0 Sent Done Done false
27858 7809 Acked Write 3 Sent Done Done false
27859 7810 Acked Write 4 Sent Done Done false
27860 7811 Acked Read 3 Sent Done Done false
27861 7812 Acked Read 10 Sent Done Done false
27862 7813 Acked Flush 0 Sent Done Done false
27863 7814 Acked Read 8 Sent Done Done false
27864 7815 Acked Read 3 Sent Done Done false
27865 7816 Acked Write 5 Sent Done Done false
27866 7817 Acked Read 1 Sent Done Done false
27867 7818 Acked Write 1 Sent Done Done false
27868 7819 Acked Write 1 Sent Done Done false
27869 7820 Acked Write 5 Sent Done Done false
27870 7821 Acked Flush 0 Sent Done Done false
27871 7822 Acked Read 3 Sent Done Done false
27872 7823 Acked Write 1 Sent Done Done false
27873 7824 Acked Read 3 Sent Done Done false
27874 7825 Acked Read 5 Sent Done Done false
27875 7826 Acked Write 9 Sent Done Done false
27876 7827 Acked Write 4 Sent Done Done false
27877 7828 Acked Read 9 Sent Done Done false
27878 7829 Acked Read 6 Sent Done Done false
27879 7830 Acked Read 6 Sent Done Done false
27880 7831 Acked Read 8 Sent Done Done false
27881 7832 Acked Read 1 Sent Done Done false
27882 7833 Acked Write 7 Sent Done Done false
27883 7834 Acked Read 6 Sent Done Done false
27884 7835 Acked Flush 0 Sent Done Done false
27885 7836 Acked Write 9 Sent Done Done false
27886 7837 Acked Write 10 Sent Done Done false
27887 7838 Acked Write 2 Sent Done Done false
27888 7839 Acked Read 7 Sent Done Done false
27889 7840 Acked Flush 0 Sent Done Done false
27890 7841 Acked Flush 0 Sent Done Done false
27891 7842 Acked Read 5 Sent Done Done false
27892 7843 Acked Read 7 Sent Done Done false
27893 7844 Acked Write 9 Sent Done Done false
27894 7845 Acked Read 5 Sent Done Done false
27895 7846 Acked Write 8 Sent Done Done false
27896 7847 Acked Write 5 Sent Done Done false
27897 7848 Acked Flush 0 Sent Done Done false
27898 7849 Acked Read 4 Sent Done Done false
27899 7850 Acked Write 3 Sent Done Done false
27900 7851 Acked Write 6 Sent Done Done false
27901 7852 Acked Read 2 Sent Done Done false
27902 7853 Acked Read 6 Sent Done Done false
27903 7854 Acked Flush 0 Sent Done Done false
27904 7855 Acked Read 3 Sent Done Done false
27905 7856 Acked Read 5 Sent Done Done false
27906 7857 Acked Read 1 Sent Done Done false
27907 7858 Acked Flush 0 Sent Done Done false
27908 7859 Acked Write 6 Sent Done Done false
27909 7860 Acked Write 7 Sent Done Done false
27910 7861 Acked Write 3 Sent Done Done false
27911 7862 Acked Write 8 Sent Done Done false
27912 7863 Acked Write 4 Sent Done Done false
27913 7864 Acked Write 7 Sent Done Done false
27914 7865 Acked Write 9 Sent Done Done false
27915 7866 Acked Flush 0 Sent Done Done false
27916 7867 Acked Write 4 Sent Done Done false
27917 7868 Acked Read 4 Sent Done Done false
27918 7869 Acked Read 6 Sent Done Done false
27919 7870 Acked Read 3 Sent Done Done false
27920 7871 Acked Write 5 Sent Done Done false
27921 7872 Acked Write 10 Sent Done Done false
27922 7873 Acked Write 10 Sent Done Done false
27923 7874 Acked Read 3 Sent Done Done false
27924 7875 Acked Read 3 Sent Done Done false
27925 7876 Acked Read 4 Sent Done Done false
27926 7877 Acked Read 9 Sent Done Done false
27927 7878 Acked Flush 0 Sent Done Done false
27928 7879 Acked Read 6 Sent Done Done false
27929 7880 Acked Write 1 Sent Done Done false
27930 7881 Acked Read 3 Sent Done Done false
27931 7882 Acked Read 8 Sent Done Done false
27932 7883 Acked Write 9 Sent Done Done false
27933 7884 Acked Write 1 Sent Done Done false
27934 7885 Acked Write 4 Sent Done Done false
27935 7886 Acked Read 1 Sent Done Done false
27936 7887 Acked Read 2 Sent Done Done false
27937 7888 Acked Write 4 Sent Done Done false
27938 7889 Acked Write 10 Sent Done Done false
27939 7890 Acked Flush 0 Sent Done Done false
27940 7891 Acked Write 8 Sent Done Done false
27941 7892 Acked Write 6 Sent Done Done false
27942 7893 Acked Read 4 Sent Done Done false
27943 7894 Acked Write 7 Sent Done Done false
27944 7895 Acked Read 10 Sent Done Done false
27945 7896 Acked Read 1 Sent Done Done false
27946 7897 Acked Flush 0 Sent Done Done false
27947 7898 Acked Write 4 Sent Done Done false
27948 7899 Acked Write 9 Sent Done Done false
27949 7900 Acked Write 8 Sent Done Done false
27950 7901 Acked Read 1 Sent Done Done false
27951 7902 Acked Write 1 Sent Done Done false
27952 7903 Acked Read 3 Sent Done Done false
27953 7904 Acked Write 1 Sent Done Done false
27954 7905 Acked Write 2 Sent Done Done false
27955 7906 Acked Read 5 Sent Done Done false
27956 7907 Acked Read 3 Sent Done Done false
27957 7908 Acked Read 2 Sent Done Done false
27958 7909 Acked Read 4 Sent Done Done false
27959 7910 Acked Write 3 Sent Done Done false
27960 7911 Acked Read 5 Sent Done Done false
27961 7912 Acked Read 6 Sent Done Done false
27962 7913 Acked Write 2 Sent Done Done false
27963 7914 Acked Read 3 Sent Done Done false
27964 7915 Acked Write 3 Sent Done Done false
27965 7916 Acked Write 6 Sent Done Done false
27966 7917 Acked Flush 0 Sent Done Done false
27967 7918 Acked Write 2 Sent Done Done false
27968 7919 Acked Read 2 Sent Done Done false
27969 7920 Acked Read 10 Sent Done Done false
27970 7921 Acked Read 5 Sent Done Done false
27971 7922 Acked Read 4 Sent Done Done false
27972 7923 Acked Write 9 Sent Done Done false
27973 7924 Acked Flush 0 Sent Done Done false
27974 7925 Acked Flush 0 Sent Done Done false
27975 7926 Acked Read 3 Sent Done Done false
27976 7927 Acked Read 10 Sent Done Done false
27977 7928 Acked Read 8 Sent Done Done false
27978 7929 Acked Write 6 Sent Done Done false
27979 7930 Acked Read 8 Sent Done Done false
27980 7931 Acked Read 9 Sent Done Done false
27981 7932 Acked Write 7 Sent Done Done false
27982 7933 Acked Read 4 Sent Done Done false
27983 7934 Acked Read 4 Sent Done Done false
27984 7935 Acked Write 1 Sent Done Done false
27985 7936 Acked Write 1 Sent Done Done false
27986 7937 Acked Write 10 Sent Done Done false
27987 7938 Acked Write 2 Sent Done Done false
27988 7939 Acked Write 5 Sent Done Done false
27989 7940 Acked Write 2 Sent Done Done false
27990 7941 Acked Read 8 Sent Done Done false
27991 7942 Acked Flush 0 Sent Done Done false
27992 STATES DS:0 DS:1 DS:2 TOTAL
27993 Sent 302 0 0 302
27994 Done 0 302 302 604
27995 Skipped 0 0 0 0
27996 Error 0 0 0 0
27997 Last Flush: 7640 7942 7942
27998 Downstairs last five completed: 7640 7639 7638 7637 7636
27999 Upstairs last five completed: 7942 7941 7940 7939 7938
28000 CLIENT: Up:0 ds:302 act:2
280012025-01-10T16:41:13.153ZINFOcrucible: connecting to 127.0.0.1:8810 = io task client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
280022025-01-10T16:41:13.154ZINFOcrucible: ds_connection connected from Ok(127.0.0.1:48959) = io task client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
280032025-01-10T16:41:13.155ZWARNcrucible: version negotiation from state Offline = downstairs client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
280042025-01-10T16:41:13.155ZINFOcrucible: downstairs client at Some(127.0.0.1:8810) has region UUID 12345678-0000-0000-0000-000000008810 = downstairs client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
280052025-01-10T16:41:13.155ZINFOcrucible: Returning UUID:12345678-0000-0000-0000-000000008810 matches = downstairs client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
280062025-01-10T16:41:13.155ZINFOcrucible: send last flush ID to this DS: 7640 = downstairs client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
280072025-01-10T16:41:13.156ZINFOcrucible: Replied this last flush ID: 7640 = downstairs client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
280082025-01-10T16:41:13.156ZINFOcrucible: ds_transition from Offline to Active = downstairs client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
280092025-01-10T16:41:13.156ZINFOcrucible: [0] Transition from Offline to Active = downstairs client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
280102025-01-10T16:41:13.156ZINFOcrucible: [0] client re-new 302 jobs since flush 7640 = downstairs session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
280112025-01-10T16:41:13.156ZINFOcrucible: [0] Replayed 302 jobs since flush: 7640 = downstairs session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
28012 ----------------------------------------------------------------
28013 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:0
28014 Downstairs last five completed: 7942 7941 7940 7939 7938
28015 Upstairs last five completed: 7942 7941 7940 7939 7938
28016 CLIENT: Up:0 ds:0 act:3
28017 Replay: All jobs finished
28018 Main task has work to do, go find it
28019 got dsc Stop(2)
28020 stop 2
28021 Jan 10 16:41:13.393 INFO request completed[8830] Got stop action so:false kr:false
28022 , latency_us: 347, response_code: 204, uri: /stop/cid/2, method: POST, req_id: 95b7fb56-7827-4a16-996e-bdf3fd89dcc6, remote_addr: 127.0.0.1:55917, local_addr: 127.0.0.1:9998
280232025-01-10T16:41:13.394ZWARNcrucible: downstairs disconnected = io task client = 2 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
280242025-01-10T16:41:13.394ZWARNcrucible: client task is sending Done(Finished) = io task client = 2 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
280252025-01-10T16:41:13.394ZWARNcrucible: downstairs task for 2 stopped due to Finished session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
280262025-01-10T16:41:13.394ZINFOcrucible: ds_transition from Active to Offline = downstairs client = 2 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
280272025-01-10T16:41:13.394ZINFOcrucible: [2] Transition from Active to Offline = downstairs client = 2 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
28028 Jan 10 16:41:13.394 INFO request completed, latency_us: 133, response_code: 200, uri: /state/cid/2, method: GET, req_id: ea798195-d491-4f85-bcd9-13e58b1d693e, remote_addr: 127.0.0.1:55917, local_addr: 127.0.0.1:9998
280292025-01-10T16:41:13.394ZINFOcrucible: client task is exiting = io task client = 2 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
28030 [8830] Exited with: ExitStatus(unix_wait_status(9))
28031 [8830][2] reports Exit
28032 Jan 10 16:41:17.396 INFO request completed, latency_us: 285, response_code: 200, uri: /state/cid/2, method: GET, req_id: 64f5c0e0-e223-430b-9dc9-1f964f7c2613, remote_addr: 127.0.0.1:55917, local_addr: 127.0.0.1:9998
28033 001/300 Read block 4844 len 16384
28034 002/300 Write block 642 len 40960 data: 3 6 6 7 6 7 6 5 3 4
28035 003/300 Flush
28036 004/300 Flush
28037 005/300 Read block 4712 len 4096
28038 006/300 Read block 1652 len 36864
28039 007/300 Flush
28040 008/300 Write block 3001 len 24576 data: 6 4 5 8 5 5
28041 009/300 Write block 2606 len 36864 data: 3 4 4 3 3 4 6 6 5
28042 010/300 Read block 4986 len 32768
28043 011/300 Write block 687 len 24576 data: 7 6 5 5 5 5
28044 012/300 Flush
28045 013/300 Write block 2454 len 24576 data: 3 3 3 4 4 3
28046 014/300 Write block 4067 len 24576 data: 6 6 8 7 9 8
28047 015/300 Write block 2703 len 28672 data: 3 4 4 5 4 3 4
28048 016/300 Read block 3731 len 4096
28049 017/300 Write block 2240 len 16384 data: 6 6 7 7
28050 018/300 Read block 4924 len 20480
28051 019/300 Read block 3468 len 12288
28052 020/300 Write block 1877 len 4096 data: 6
28053 021/300 Flush
28054 022/300 Write block 3265 len 4096 data: 7
28055 023/300 Write block 1859 len 40960 data: 4 3 3 5 5 5 4 4 3 3
28056 024/300 Read block 770 len 8192
28057 025/300 Read block 2806 len 16384
28058 026/300 Read block 4510 len 12288
28059 027/300 Read block 2769 len 28672
28060 028/300 Write block 919 len 16384 data: 9 7 6 6
28061 029/300 Flush
28062 030/300 Read block 2317 len 28672
28063 031/300 Write block 813 len 32768 data: 4 4 4 5 4 4 5 6
28064 032/300 Write block 328 len 24576 data: 2 4 4 4 5 5
28065 033/300 Flush
28066 034/300 Write block 3123 len 16384 data: 6 5 6 6
28067 035/300 Read block 3158 len 28672
28068 036/300 Read block 2659 len 24576
28069 037/300 Read block 3714 len 32768
28070 038/300 Read block 2574 len 8192
28071 039/300 Write block 3339 len 36864 data: 7 8 7 5 4 3 3 3 5
28072 040/300 Read block 909 len 36864
28073 041/300 Read block 4787 len 20480
28074 042/300 Flush
28075 043/300 Read block 612 len 36864
28076 044/300 Read block 4630 len 12288
28077 045/300 Read block 1245 len 8192
28078 046/300 Read block 1070 len 36864
28079 047/300 Read block 615 len 8192
28080 048/300 Read block 173 len 12288
28081 049/300 Read block 3691 len 20480
28082 050/300 Read block 241 len 40960
28083 051/300 Read block 1744 len 36864
28084 052/300 Read block 2422 len 28672
28085 053/300 Read block 4156 len 32768
28086 054/300 Read block 3367 len 4096
28087 055/300 Read block 3405 len 28672
28088 056/300 Write block 3428 len 36864 data: 2 3 3 3 3 4 4 3 4
28089 057/300 Write block 1718 len 8192 data: 6 8
28090 058/300 Read block 1117 len 36864
28091 059/300 Write block 4280 len 40960 data: 5 6 6 5 4 3 3 4 3 2
28092 060/300 Write block 4118 len 12288 data: 5 6 8
28093 061/300 Read block 351 len 32768
28094 062/300 Write block 4630 len 32768 data: 5 6 4 5 6 6 5 4
28095 063/300 Read block 565 len 12288
28096 064/300 Write block 1018 len 40960 data: 5 4 5 5 6 4 5 5 5 6
28097 065/300 Write block 4834 len 32768 data: 3 4 5 6 6 6 5 6
28098 066/300 Write block 4383 len 12288 data: 4 4 3
28099 067/300 Write block 4819 len 8192 data: 6 6
28100 068/300 Write block 2841 len 40960 data: 4 6 5 5 6 6 6 5 6 6
28101 069/300 Read block 1908 len 28672
28102 070/300 Write block 16 len 32768 data: 8 8 7 7 6 6 5 4
28103 071/300 Read block 2405 len 32768
28104 072/300 Read block 630 len 28672
28105 073/300 Write block 1378 len 20480 data: 5 4 5 4 5
28106 074/300 Write block 2195 len 36864 data: 8 8 8 8 5 4 3 2 3
28107 075/300 Read block 3956 len 40960
28108 076/300 Write block 3124 len 8192 data: 6 7
28109 077/300 Read block 3433 len 24576
28110 078/300 Read block 4497 len 24576
28111 079/300 Read block 4440 len 20480
28112 080/300 Read block 25 len 12288
28113 081/300 Write block 1015 len 28672 data: 5 6 7 6 5 6 6
28114 082/300 Write block 1029 len 40960 data: 7 8 7 7 8 9 7 5 8 6
28115 083/300 Read block 2763 len 32768
28116 084/300 Write block 1336 len 24576 data: 8 10 9 8 8 8
28117 085/300 Read block 3435 len 16384
28118 086/300 Flush
28119 087/300 Flush
28120 088/300 Read block 3942 len 4096
28121 089/300 Write block 3506 len 16384 data: 3 3 3 3
28122 090/300 Read block 106 len 36864
28123 091/300 Write block 3216 len 20480 data: 6 5 5 5 6
28124 092/300 Write block 2243 len 4096 data: 8
28125 093/300 Read block 2817 len 36864
28126 094/300 Read block 1912 len 32768
28127 095/300 Read block 1094 len 4096
28128 096/300 Read block 1559 len 8192
28129 097/300 Read block 3909 len 16384
28130 098/300 Write block 1252 len 16384 data: 2 2 2 3
28131 099/300 Flush
28132 100/300 Read block 2178 len 40960
28133 101/300 Write block 1549 len 28672 data: 7 6 6 7 6 5 5
28134 102/300 Read block 489 len 20480
28135 103/300 Write block 876 len 4096 data: 5
28136 104/300 Read block 3104 len 36864
28137 105/300 Flush
28138 106/300 Read block 693 len 8192
28139 107/300 Write block 3703 len 24576 data: 7 7 6 7 6 8
28140 108/300 Read block 296 len 40960
28141 109/300 Read block 415 len 4096
28142 110/300 Read block 1271 len 32768
28143 111/300 Read block 2228 len 40960
28144 112/300 Read block 505 len 20480
28145 113/300 Read block 2066 len 28672
28146 114/300 Read block 3168 len 28672
28147 115/300 Write block 2849 len 20480 data: 7 7 6 5 4
28148 116/300 Read block 3081 len 12288
28149 117/300 Read block 3218 len 20480
28150 118/300 Write block 1336 len 8192 data: 9 11
28151 119/300 Flush
28152 120/300 Write block 3536 len 32768 data: 5 4 3 4 5 5 4 5
28153 121/300 Read block 732 len 8192
28154 122/300 Read block 3403 len 4096
28155 123/300 Write block 3536 len 32768 data: 6 5 4 5 6 6 5 6
28156 124/300 Write block 2406 len 12288 data: 4 6 6
28157 125/300 Flush
28158 126/300 Write block 1625 len 28672 data: 5 5 5 5 4 5 6
28159 127/300 Flush
28160 128/300 Write block 1658 len 12288 data: 6 7 7
28161 129/300 Read block 1878 len 16384
28162 130/300 Write block 3327 len 8192 data: 3 4
28163 131/300 Read block 4530 len 12288
28164 132/300 Write block 1192 len 16384 data: 4 5 4 4
28165 133/300 Read block 2339 len 12288
28166 134/300 Read block 1525 len 32768
28167 135/300 Read block 45 len 12288
28168 136/300 Write block 3512 len 40960 data: 6 6 5 4 4 4 2 2 3 4
28169 137/300 Read block 850 len 4096
28170 138/300 Read block 2837 len 40960
28171 139/300 Read block 4533 len 24576
28172 140/300 Write block 2258 len 32768 data: 5 6 6 5 5 5 6 6
28173 141/300 Write block 4 len 40960 data: 2 2 3 3 3 4 5 5 6 7
28174 142/300 Flush
28175 143/300 Write block 391 len 8192 data: 3 4
28176 144/300 Write block 2861 len 4096 data: 5
28177 145/300 Read block 4477 len 16384
28178 146/300 Read block 4660 len 28672
28179 147/300 Read block 1810 len 4096
28180 148/300 Flush
28181 149/300 Read block 2440 len 32768
28182 150/300 Read block 156 len 36864
28183 151/300 Flush
28184 152/300 Write block 4763 len 28672 data: 6 5 4 4 4 5 6
28185 153/300 Flush
28186 154/300 Read block 2487 len 36864
28187 155/300 Flush
28188 156/300 Flush
28189 157/300 Read block 399 len 24576
28190 158/300 Write block 4925 len 4096 data: 4
28191 159/300 Write block 690 len 20480 data: 6 6 6 6 6
28192 160/300 Flush
28193 161/300 Read block 4311 len 24576
28194 162/300 Flush
28195 163/300 Read block 463 len 12288
28196 164/300 Read block 1915 len 4096
28197 165/300 Write block 2117 len 20480 data: 7 7 6 6 6
28198 166/300 Read block 2282 len 24576
28199 167/300 Write block 1358 len 28672 data: 5 5 6 6 5 6 5
28200 168/300 Write block 4387 len 40960 data: 3 2 2 2 3 3 4 5 7 8
28201 169/300 Write block 1232 len 12288 data: 5 4 3
28202 170/300 Write block 2258 len 8192 data: 6 7
28203 171/300 Read block 2047 len 24576
28204 172/300 Read block 1102 len 40960
28205 173/300 Read block 1205 len 28672
28206 174/300 Write block 3547 len 36864 data: 5 6 5 5 6 5 3 3 4
28207 175/300 Write block 3844 len 16384 data: 6 6 7 6
28208 176/300 Read block 2494 len 12288
28209 177/300 Write block 2881 len 8192 data: 6 6
28210 178/300 Write block 1215 len 16384 data: 2 2 2 3
28211 179/300 Read block 3629 len 12288
28212 180/300 Write block 3545 len 40960 data: 5 5 6 7 6 6 7 6 4 4
28213 181/300 Write block 1898 len 28672 data: 4 4 5 5 4 4 4
28214 182/300 Flush
28215 183/300 Flush
28216 184/300 Read block 2109 len 20480
28217 185/300 Read block 2942 len 40960
28218 186/300 Write block 3320 len 20480 data: 5 8 6 6 4
28219 187/300 Flush
28220 188/300 Read block 2028 len 24576
28221 189/300 Read block 3598 len 4096
28222 190/300 Write block 1297 len 12288 data: 5 5 5
28223 191/300 Read block 729 len 32768
28224 192/300 Write block 3553 len 32768 data: 5 5 5 4 4 3 3 4
28225 193/300 Write block 1254 len 20480 data: 3 4 3 3 4
28226 194/300 Read block 3136 len 28672
28227 195/300 Read block 4665 len 36864
28228 196/300 Read block 1585 len 4096
28229 197/300 Read block 377 len 24576
28230 198/300 Read block 56 len 28672
28231 199/300 Read block 1794 len 8192
28232 200/300 Flush
28233 201/300 Read block 1388 len 28672
28234 202/300 Flush
28235 203/300 Read block 2053 len 24576
28236 204/300 Write block 4318 len 8192 data: 3 3
28237 205/300 Read block 3889 len 32768
28238 206/300 Read block 1255 len 24576
28239 207/300 Read block 1275 len 12288
28240 208/300 Write block 4554 len 12288 data: 9 9 9
28241 209/300 Read block 3924 len 4096
28242 210/300 Read block 2079 len 16384
28243 211/300 Write block 2766 len 4096 data: 4
28244 212/300 Read block 1844 len 8192
28245 213/300 Write block 93 len 16384 data: 5 3 3 3
28246 214/300 Write block 3433 len 4096 data: 5
28247 215/300 Read block 861 len 4096
28248 216/300 Write block 1884 len 24576 data: 4 5 5 4 6 5
28249 217/300 Write block 843 len 4096 data: 10
28250 218/300 Write block 2646 len 16384 data: 6 5 5 6
28251 219/300 Read block 3672 len 32768
28252 220/300 Read block 1318 len 28672
28253 221/300 Read block 436 len 4096
28254 222/300 Read block 2202 len 36864
28255 223/300 Write block 127 len 8192 data: 5 5
28256 224/300 Read block 4930 len 32768
28257 225/300 Write block 2812 len 36864 data: 9 7 6 5 3 2 3 3 3
28258 226/300 Write block 4271 len 20480 data: 3 4 6 5 4
28259 227/300 Write block 4488 len 40960 data: 9 9 9 6 5 4 3 2 2 2
28260 228/300 Write block 3715 len 16384 data: 6 7 5 4
28261 229/300 Write block 2704 len 24576 data: 5 5 6 5 4 5
28262 230/300 Write block 1464 len 8192 data: 4 4
28263 231/300 Flush
28264 232/300 Write block 1941 len 40960 data: 4 4 5 5 4 5 5 6 6 6
28265 233/300 Read block 1683 len 20480
28266 234/300 Read block 163 len 8192
28267 235/300 Read block 1809 len 32768
28268 236/300 Read block 3529 len 12288
28269 237/300 Read block 3484 len 12288
28270 238/300 Read block 2637 len 32768
28271 239/300 Write block 1987 len 28672 data: 7 7 8 6 7 7 9
28272 240/300 Write block 470 len 32768 data: 4 4 4 4 4 5 5 5
28273 241/300 Read block 2246 len 12288
28274 242/300 Write block 4771 len 4096 data: 5
28275 243/300 Write block 2908 len 20480 data: 4 4 5 5 5
28276 244/300 Write block 1161 len 4096 data: 7
28277 245/300 Read block 1571 len 4096
28278 246/300 Write block 4933 len 8192 data: 4 4
28279 247/300 Write block 123 len 16384 data: 7 5 5 5
28280 248/300 Write block 4369 len 36864 data: 6 7 7 8 8 9 8 9 10
28281 249/300 Read block 2175 len 12288
28282 250/300 Read block 2374 len 12288
28283 251/300 Write block 3382 len 20480 data: 10 10 11 8 7
28284 252/300 Read block 2126 len 20480
28285 253/300 Write block 185 len 8192 data: 8 9
28286 254/300 Flush
28287 255/300 Write block 2210 len 8192 data: 5 5
28288 256/300 Write block 1510 len 12288 data: 5 5 3
28289 257/300 Flush
28290 258/300 Write block 272 len 8192 data: 7 5
28291 259/300 Write block 3880 len 24576 data: 6 6 5 5 4 2
28292 260/300 Write block 4975 len 36864 data: 4 3 4 3 4 4 3 3 4
28293 261/300 Flush
28294 262/300 Write block 3356 len 4096 data: 4
28295 263/300 Read block 842 len 8192
28296 264/300 Flush
28297 265/300 Read block 2273 len 16384
28298 266/300 Read block 1928 len 20480
28299 267/300 Read block 3068 len 8192
28300 268/300 Read block 3763 len 4096
28301 269/300 Write block 3889 len 8192 data: 3 4
28302 270/300 Read block 3358 len 36864
28303 271/300 Read block 642 len 16384
28304 272/300 Write block 655 len 4096 data: 2
28305 273/300 Read block 2930 len 20480
28306 274/300 Flush
28307 275/300 Read block 4098 len 36864
28308 276/300 Read block 4486 len 40960
28309 277/300 Write block 3691 len 16384 data: 3 4 2 2
28310 278/300 Write block 815 len 24576 data: 5 6 5 5 6 7
28311 279/300 Read block 736 len 20480
28312 280/300 Write block 4097 len 24576 data: 3 3 4 4 4 4
28313 281/300 Read block 1911 len 24576
28314 282/300 Read block 4689 len 4096
28315 283/300 Read block 2621 len 36864
28316 284/300 Write block 2644 len 28672 data: 7 6 7 6 6 7 6
28317 285/300 Write block 1304 len 40960 data: 2 2 2 3 2 4 4 6 5 6
28318 286/300 Write block 1077 len 36864 data: 3 3 3 3 3 4 5 5 4
28319 287/300 Write block 690 len 28672 data: 7 7 7 7 7 7 7
28320 288/300 Read block 2351 len 28672
28321 289/300 Write block 2615 len 16384 data: 5 6 6 7
28322 290/300 Read block 1085 len 24576
28323 291/300 Read block 1562 len 8192
28324 292/300 Write block 3246 len 4096 data: 4
28325 293/300 Write block 2917 len 32768 data: 5 4 5 5 5 6 7 7
28326 294/300 Write block 373 len 20480 data: 3 3 3 3 2
28327 295/300 Write block 2795 len 8192 data: 4 4
28328 296/300 Read block 589 len 40960
28329 297/300 Read block 1250 len 40960
28330 298/300 Read block 277 len 12288
28331 299/300 Write block 872 len 32768 data: 3 5 6 8 6 8 8 9
28332 300/300 Read block 4955 len 40960
28333 301/300 Read block 3706 len 16384
28334 Main task has work to do, go find it
28335 got dsc Start(2)
28336 start 2
28337 Jan 10 16:41:17.627 INFO request completed, latency_us: 217, response_code: 204, uri: /start/cid/2, method: POST, req_id: 0332adfa-aab0-4f58-a216-cbbe76f49b79, remote_addr: 127.0.0.1:55917, local_addr: 127.0.0.1:9998
28338 Replay: started 2, returned:Ok(())
28339 ----------------------------------------------------------------
28340 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:301
28341 States: Active Active Offline
28342 JOBID ACK TYPE BKS/EXT DS:0 DS:1 DS:2 REPLAY
28343 7943 Acked Read 4 Done Done Sent false
28344 7944 Acked Write 10 Done Done Sent false
28345 7945 Acked Flush 0 Done Done Sent false
28346 7946 Acked Flush 0 Done Done Sent false
28347 7947 Acked Read 1 Done Done Sent false
28348 7948 Acked Read 9 Done Done Sent false
28349 7949 Acked Flush 0 Done Done Sent false
28350 7950 Acked Write 6 Done Done Sent false
28351 7951 Acked Write 9 Done Done Sent false
28352 7952 Acked Read 8 Done Done Sent false
28353 7953 Acked Write 6 Done Done Sent false
28354 7954 Acked Flush 0 Done Done Sent false
28355 7955 Acked Write 6 Done Done Sent false
28356 7956 Acked Write 6 Done Done Sent false
28357 7957 Acked Write 7 Done Done Sent false
28358 7958 Acked Read 1 Done Done Sent false
28359 7959 Acked Write 4 Done Done Sent false
28360 7960 Acked Read 5 Done Done Sent false
28361 7961 Acked Read 3 Done Done Sent false
28362 7962 Acked Write 1 Done Done Sent false
28363 7963 Acked Flush 0 Done Done Sent false
28364 7964 Acked Write 1 Done Done Sent false
28365 7965 Acked Write 10 Done Done Sent false
28366 7966 Acked Read 2 Done Done Sent false
28367 7967 Acked Read 4 Done Done Sent false
28368 7968 Acked Read 3 Done Done Sent false
28369 7969 Acked Read 7 Done Done Sent false
28370 7970 Acked Write 4 Done Done Sent false
28371 7971 Acked Flush 0 Done Done Sent false
28372 7972 Acked Read 7 Done Done Sent false
28373 7973 Acked Write 8 Done Done Sent false
28374 7974 Acked Write 6 Done Done Sent false
28375 7975 Acked Flush 0 Done Done Sent false
28376 7976 Acked Write 4 Done Done Sent false
28377 7977 Acked Read 7 Done Done Sent false
28378 7978 Acked Read 6 Done Done Sent false
28379 7979 Acked Read 8 Done Done Sent false
28380 7980 Acked Read 2 Done Done Sent false
28381 7981 Acked Write 9 Done Done Sent false
28382 7982 Acked Read 9 Done Done Sent false
28383 7983 Acked Read 5 Done Done Sent false
28384 7984 Acked Flush 0 Done Done Sent false
28385 7985 Acked Read 9 Done Done Sent false
28386 7986 Acked Read 3 Done Done Sent false
28387 7987 Acked Read 2 Done Done Sent false
28388 7988 Acked Read 9 Done Done Sent false
28389 7989 Acked Read 2 Done Done Sent false
28390 7990 Acked Read 3 Done Done Sent false
28391 7991 Acked Read 5 Done Done Sent false
28392 7992 Acked Read 10 Done Done Sent false
28393 7993 Acked Read 9 Done Done Sent false
28394 7994 Acked Read 7 Done Done Sent false
28395 7995 Acked Read 8 Done Done Sent false
28396 7996 Acked Read 1 Done Done Sent false
28397 7997 Acked Read 7 Done Done Sent false
28398 7998 Acked Write 9 Done Done Sent false
28399 7999 Acked Write 2 Done Done Sent false
28400 8000 Acked Read 9 Done Done Sent false
28401 8001 Acked Write 10 Done Done Sent false
28402 8002 Acked Write 3 Done Done Sent false
28403 8003 Acked Read 8 Done Done Sent false
28404 8004 Acked Write 8 Done Done Sent false
28405 8005 Acked Read 3 Done Done Sent false
28406 8006 Acked Write 10 Done Done Sent false
28407 8007 Acked Write 8 Done Done Sent false
28408 8008 Acked Write 3 Done Done Sent false
28409 8009 Acked Write 2 Done Done Sent false
28410 8010 Acked Write 10 Done Done Sent false
28411 8011 Acked Read 7 Done Done Sent false
28412 8012 Acked Write 8 Done Done Sent false
28413 8013 Acked Read 8 Done Done Sent false
28414 8014 Acked Read 7 Done Done Sent false
28415 8015 Acked Write 5 Done Done Sent false
28416 8016 Acked Write 9 Done Done Sent false
28417 8017 Acked Read 10 Done Done Sent false
28418 8018 Acked Write 2 Done Done Sent false
28419 8019 Acked Read 6 Done Done Sent false
28420 8020 Acked Read 6 Done Done Sent false
28421 8021 Acked Read 5 Done Done Sent false
28422 8022 Acked Read 3 Done Done Sent false
28423 8023 Acked Write 7 Done Done Sent false
28424 8024 Acked Write 10 Done Done Sent false
28425 8025 Acked Read 8 Done Done Sent false
28426 8026 Acked Write 6 Done Done Sent false
28427 8027 Acked Read 4 Done Done Sent false
28428 8028 Acked Flush 0 Done Done Sent false
28429 8029 Acked Flush 0 Done Done Sent false
28430 8030 Acked Read 1 Done Done Sent false
28431 8031 Acked Write 4 Done Done Sent false
28432 8032 Acked Read 9 Done Done Sent false
28433 8033 Acked Write 5 Done Done Sent false
28434 8034 Acked Write 1 Done Done Sent false
28435 8035 Acked Read 9 Done Done Sent false
28436 8036 Acked Read 8 Done Done Sent false
28437 8037 Acked Read 1 Done Done Sent false
28438 8038 Acked Read 2 Done Done Sent false
28439 8039 Acked Read 4 Done Done Sent false
28440 8040 Acked Write 4 Done Done Sent false
28441 8041 Acked Flush 0 Done Done Sent false
28442 8042 Acked Read 10 Done Done Sent false
28443 8043 Acked Write 7 Done Done Sent false
28444 8044 Acked Read 5 Done Done Sent false
28445 8045 Acked Write 1 Done Done Sent false
28446 8046 Acked Read 9 Done Done Sent false
28447 8047 Acked Flush 0 Done Done Sent false
28448 8048 Acked Read 2 Done Done Sent false
28449 8049 Acked Write 6 Done Done Sent false
28450 8050 Acked Read 10 Done Done Sent false
28451 8051 Acked Read 1 Done Done Sent false
28452 8052 Acked Read 8 Done Done Sent false
28453 8053 Acked Read 10 Done Done Sent false
28454 8054 Acked Read 5 Done Done Sent false
28455 8055 Acked Read 7 Done Done Sent false
28456 8056 Acked Read 7 Done Done Sent false
28457 8057 Acked Write 5 Done Done Sent false
28458 8058 Acked Read 3 Done Done Sent false
28459 8059 Acked Read 5 Done Done Sent false
28460 8060 Acked Write 2 Done Done Sent false
28461 8061 Acked Flush 0 Done Done Sent false
28462 8062 Acked Write 8 Done Done Sent false
28463 8063 Acked Read 2 Done Done Sent false
28464 8064 Acked Read 1 Done Done Sent false
28465 8065 Acked Write 8 Done Done Sent false
28466 8066 Acked Write 3 Done Done Sent false
28467 8067 Acked Flush 0 Done Done Sent false
28468 8068 Acked Write 7 Done Done Sent false
28469 8069 Acked Flush 0 Done Done Sent false
28470 8070 Acked Write 3 Done Done Sent false
28471 8071 Acked Read 4 Done Done Sent false
28472 8072 Acked Write 2 Done Done Sent false
28473 8073 Acked Read 3 Done Done Sent false
28474 8074 Acked Write 4 Done Done Sent false
28475 8075 Acked Read 3 Done Done Sent false
28476 8076 Acked Read 8 Done Done Sent false
28477 8077 Acked Read 3 Done Done Sent false
28478 8078 Acked Write 10 Done Done Sent false
28479 8079 Acked Read 1 Done Done Sent false
28480 8080 Acked Read 10 Done Done Sent false
28481 8081 Acked Read 6 Done Done Sent false
28482 8082 Acked Write 8 Done Done Sent false
28483 8083 Acked Write 10 Done Done Sent false
28484 8084 Acked Flush 0 Done Done Sent false
28485 8085 Acked Write 2 Done Done Sent false
28486 8086 Acked Write 1 Done Done Sent false
28487 8087 Acked Read 4 Done Done Sent false
28488 8088 Acked Read 7 Done Done Sent false
28489 8089 Acked Read 1 Done Done Sent false
28490 8090 Acked Flush 0 Done Done Sent false
28491 8091 Acked Read 8 Done Done Sent false
28492 8092 Acked Read 9 Done Done Sent false
28493 8093 Acked Flush 0 Done Done Sent false
28494 8094 Acked Write 7 Done Done Sent false
28495 8095 Acked Flush 0 Done Done Sent false
28496 8096 Acked Read 9 Done Done Sent false
28497 8097 Acked Flush 0 Done Done Sent false
28498 8098 Acked Flush 0 Done Done Sent false
28499 8099 Acked Read 6 Done Done Sent false
28500 8100 Acked Write 1 Done Done Sent false
28501 8101 Acked Write 5 Done Done Sent false
28502 8102 Acked Flush 0 Done Done Sent false
28503 8103 Acked Read 6 Done Done Sent false
28504 8104 Acked Flush 0 Done Done Sent false
28505 8105 Acked Read 3 Done Done Sent false
28506 8106 Acked Read 1 Done Done Sent false
28507 8107 Acked Write 5 Done Done Sent false
28508 8108 Acked Read 6 Done Done Sent false
28509 8109 Acked Write 7 Done Done Sent false
28510 8110 Acked Write 10 Done Done Sent false
28511 8111 Acked Write 3 Done Done Sent false
28512 8112 Acked Write 2 Done Done Sent false
28513 8113 Acked Read 6 Done Done Sent false
28514 8114 Acked Read 10 Done Done Sent false
28515 8115 Acked Read 7 Done Done Sent false
28516 8116 Acked Write 9 Done Done Sent false
28517 8117 Acked Write 4 Done Done Sent false
28518 8118 Acked Read 3 Done Done Sent false
28519 8119 Acked Write 2 Done Done Sent false
28520 8120 Acked Write 4 Done Done Sent false
28521 8121 Acked Read 3 Done Done Sent false
28522 8122 Acked Write 10 Done Done Sent false
28523 8123 Acked Write 7 Done Done Sent false
28524 8124 Acked Flush 0 Done Done Sent false
28525 8125 Acked Flush 0 Done Done Sent false
28526 8126 Acked Read 5 Done Done Sent false
28527 8127 Acked Read 10 Done Done Sent false
28528 8128 Acked Write 5 Done Done Sent false
28529 8129 Acked Flush 0 Done Done Sent false
28530 8130 Acked Read 6 Done Done Sent false
28531 8131 Acked Read 1 Done Done Sent false
28532 8132 Acked Write 3 Done Done Sent false
28533 8133 Acked Read 8 Done Done Sent false
28534 8134 Acked Write 8 Done Done Sent false
28535 8135 Acked Write 5 Done Done Sent false
28536 8136 Acked Read 7 Done Done Sent false
28537 8137 Acked Read 9 Done Done Sent false
28538 8138 Acked Read 1 Done Done Sent false
28539 8139 Acked Read 6 Done Done Sent false
28540 8140 Acked Read 7 Done Done Sent false
28541 8141 Acked Read 2 Done Done Sent false
28542 8142 Acked Flush 0 Done Done Sent false
28543 8143 Acked Read 7 Done Done Sent false
28544 8144 Acked Flush 0 Done Done Sent false
28545 8145 Acked Read 6 Done Done Sent false
28546 8146 Acked Write 2 Done Done Sent false
28547 8147 Acked Read 8 Done Done Sent false
28548 8148 Acked Read 6 Done Done Sent false
28549 8149 Acked Read 3 Done Done Sent false
28550 8150 Acked Write 3 Done Done Sent false
28551 8151 Acked Read 1 Done Done Sent false
28552 8152 Acked Read 4 Done Done Sent false
28553 8153 Acked Write 1 Done Done Sent false
28554 8154 Acked Read 2 Done Done Sent false
28555 8155 Acked Write 4 Done Done Sent false
28556 8156 Acked Write 1 Done Done Sent false
28557 8157 Acked Read 1 Done Done Sent false
28558 8158 Acked Write 6 Done Done Sent false
28559 8159 Acked Write 1 Done Done Sent false
28560 8160 Acked Write 4 Done Done Sent false
28561 8161 Acked Read 8 Done Done Sent false
28562 8162 Acked Read 7 Done Done Sent false
28563 8163 Acked Read 1 Done Done Sent false
28564 8164 Acked Read 9 Done Done Sent false
28565 8165 Acked Write 2 Done Done Sent false
28566 8166 Acked Read 8 Done Done Sent false
28567 8167 Acked Write 9 Done Done Sent false
28568 8168 Acked Write 5 Done Done Sent false
28569 8169 Acked Write 10 Done Done Sent false
28570 8170 Acked Write 4 Done Done Sent false
28571 8171 Acked Write 6 Done Done Sent false
28572 8172 Acked Write 2 Done Done Sent false
28573 8173 Acked Flush 0 Done Done Sent false
28574 8174 Acked Write 10 Done Done Sent false
28575 8175 Acked Read 5 Done Done Sent false
28576 8176 Acked Read 2 Done Done Sent false
28577 8177 Acked Read 8 Done Done Sent false
28578 8178 Acked Read 3 Done Done Sent false
28579 8179 Acked Read 3 Done Done Sent false
28580 8180 Acked Read 8 Done Done Sent false
28581 8181 Acked Write 7 Done Done Sent false
28582 8182 Acked Write 8 Done Done Sent false
28583 8183 Acked Read 3 Done Done Sent false
28584 8184 Acked Write 1 Done Done Sent false
28585 8185 Acked Write 5 Done Done Sent false
28586 8186 Acked Write 1 Done Done Sent false
28587 8187 Acked Read 1 Done Done Sent false
28588 8188 Acked Write 2 Done Done Sent false
28589 8189 Acked Write 4 Done Done Sent false
28590 8190 Acked Write 9 Done Done Sent false
28591 8191 Acked Read 3 Done Done Sent false
28592 8192 Acked Read 3 Done Done Sent false
28593 8193 Acked Write 5 Done Done Sent false
28594 8194 Acked Read 5 Done Done Sent false
28595 8195 Acked Write 2 Done Done Sent false
28596 8196 Acked Flush 0 Done Done Sent false
28597 8197 Acked Write 2 Done Done Sent false
28598 8198 Acked Write 3 Done Done Sent false
28599 8199 Acked Flush 0 Done Done Sent false
28600 8200 Acked Write 2 Done Done Sent false
28601 8201 Acked Write 6 Done Done Sent false
28602 8202 Acked Write 9 Done Done Sent false
28603 8203 Acked Flush 0 Done Done Sent false
28604 8204 Acked Write 1 Done Done Sent false
28605 8205 Acked Read 2 Done Done Sent false
28606 8206 Acked Flush 0 Done Done Sent false
28607 8207 Acked Read 4 Done Done Sent false
28608 8208 Acked Read 5 Done Done Sent false
28609 8209 Acked Read 2 Done Done Sent false
28610 8210 Acked Read 1 Done Done Sent false
28611 8211 Acked Write 2 Done Done Sent false
28612 8212 Acked Read 9 Done Done Sent false
28613 8213 Acked Read 4 Done Done Sent false
28614 8214 Acked Write 1 Done Done Sent false
28615 8215 Acked Read 5 Done Done Sent false
28616 8216 Acked Flush 0 Done Done Sent false
28617 8217 Acked Read 9 Done Done Sent false
28618 8218 Acked Read 10 Done Done Sent false
28619 8219 Acked Write 4 Done Done Sent false
28620 8220 Acked Write 6 Done Done Sent false
28621 8221 Acked Read 5 Done Done Sent false
28622 8222 Acked Write 6 Done Done Sent false
28623 8223 Acked Read 6 Done Done Sent false
28624 8224 Acked Read 1 Done Done Sent false
28625 8225 Acked Read 9 Done Done Sent false
28626 8226 Acked Write 7 Done Done Sent false
28627 8227 Acked Write 10 Done Done Sent false
28628 8228 Acked Write 9 Done Done Sent false
28629 8229 Acked Write 7 Done Done Sent false
28630 8230 Acked Read 7 Done Done Sent false
28631 8231 Acked Write 4 Done Done Sent false
28632 8232 Acked Read 6 Done Done Sent false
28633 8233 Acked Read 2 Done Done Sent false
28634 8234 Acked Write 1 Done Done Sent false
28635 8235 Acked Write 8 Done Done Sent false
28636 8236 Acked Write 5 Done Done Sent false
28637 8237 Acked Write 2 Done Done Sent false
28638 8238 Acked Read 10 Done Done Sent false
28639 8239 Acked Read 10 Done Done Sent false
28640 8240 Acked Read 3 Done Done Sent false
28641 8241 Acked Write 8 Done Done Sent false
28642 8242 Acked Read 10 Done Done Sent false
28643 8243 Acked Read 4 Done Done Sent false
28644 STATES DS:0 DS:1 DS:2 TOTAL
28645 Sent 0 0 301 301
28646 Done 301 301 0 602
28647 Skipped 0 0 0 0
28648 Error 0 0 0 0
28649 Last Flush: 8216 8216 7942
28650 Downstairs last five completed: 7942 7941 7940 7939 7938
28651 Upstairs last five completed: 8243 8242 8241 8240 8239
28652 CLIENT: Up:0 ds:301 act:2
28653 [8830] got start action
28654 [8830] I am going to restart
28655 Starting downstairs at port 8830
28656 Make output file at "/tmp/dsc/downstairs-8830.txt"
28657 [8830][2] reports Starting
28658 Downstairs /var/tmp/dsc/region/8830 port 8830 PID:Some(1226)
28659 [8830][2] reports Running
28660 ----------------------------------------------------------------
28661 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:302
28662 States: Active Active Offline
28663 JOBID ACK TYPE BKS/EXT DS:0 DS:1 DS:2 REPLAY
28664 7943 Acked Read 4 Done Done Sent false
28665 7944 Acked Write 10 Done Done Sent false
28666 7945 Acked Flush 0 Done Done Sent false
28667 7946 Acked Flush 0 Done Done Sent false
28668 7947 Acked Read 1 Done Done Sent false
28669 7948 Acked Read 9 Done Done Sent false
28670 7949 Acked Flush 0 Done Done Sent false
28671 7950 Acked Write 6 Done Done Sent false
28672 7951 Acked Write 9 Done Done Sent false
28673 7952 Acked Read 8 Done Done Sent false
28674 7953 Acked Write 6 Done Done Sent false
28675 7954 Acked Flush 0 Done Done Sent false
28676 7955 Acked Write 6 Done Done Sent false
28677 7956 Acked Write 6 Done Done Sent false
28678 7957 Acked Write 7 Done Done Sent false
28679 7958 Acked Read 1 Done Done Sent false
28680 7959 Acked Write 4 Done Done Sent false
28681 7960 Acked Read 5 Done Done Sent false
28682 7961 Acked Read 3 Done Done Sent false
28683 7962 Acked Write 1 Done Done Sent false
28684 7963 Acked Flush 0 Done Done Sent false
28685 7964 Acked Write 1 Done Done Sent false
28686 7965 Acked Write 10 Done Done Sent false
28687 7966 Acked Read 2 Done Done Sent false
28688 7967 Acked Read 4 Done Done Sent false
28689 7968 Acked Read 3 Done Done Sent false
28690 7969 Acked Read 7 Done Done Sent false
28691 7970 Acked Write 4 Done Done Sent false
28692 7971 Acked Flush 0 Done Done Sent false
28693 7972 Acked Read 7 Done Done Sent false
28694 7973 Acked Write 8 Done Done Sent false
28695 7974 Acked Write 6 Done Done Sent false
28696 7975 Acked Flush 0 Done Done Sent false
28697 7976 Acked Write 4 Done Done Sent false
28698 7977 Acked Read 7 Done Done Sent false
28699 7978 Acked Read 6 Done Done Sent false
28700 7979 Acked Read 8 Done Done Sent false
28701 7980 Acked Read 2 Done Done Sent false
28702 7981 Acked Write 9 Done Done Sent false
28703 7982 Acked Read 9 Done Done Sent false
28704 7983 Acked Read 5 Done Done Sent false
28705 7984 Acked Flush 0 Done Done Sent false
28706 7985 Acked Read 9 Done Done Sent false
28707 7986 Acked Read 3 Done Done Sent false
28708 7987 Acked Read 2 Done Done Sent false
28709 7988 Acked Read 9 Done Done Sent false
28710 7989 Acked Read 2 Done Done Sent false
28711 7990 Acked Read 3 Done Done Sent false
28712 7991 Acked Read 5 Done Done Sent false
28713 7992 Acked Read 10 Done Done Sent false
28714 7993 Acked Read 9 Done Done Sent false
28715 7994 Acked Read 7 Done Done Sent false
28716 7995 Acked Read 8 Done Done Sent false
28717 7996 Acked Read 1 Done Done Sent false
28718 7997 Acked Read 7 Done Done Sent false
28719 7998 Acked Write 9 Done Done Sent false
28720 7999 Acked Write 2 Done Done Sent false
28721 8000 Acked Read 9 Done Done Sent false
28722 8001 Acked Write 10 Done Done Sent false
28723 8002 Acked Write 3 Done Done Sent false
28724 8003 Acked Read 8 Done Done Sent false
28725 8004 Acked Write 8 Done Done Sent false
28726 8005 Acked Read 3 Done Done Sent false
28727 8006 Acked Write 10 Done Done Sent false
28728 8007 Acked Write 8 Done Done Sent false
28729 8008 Acked Write 3 Done Done Sent false
28730 8009 Acked Write 2 Done Done Sent false
28731 8010 Acked Write 10 Done Done Sent false
28732 8011 Acked Read 7 Done Done Sent false
28733 8012 Acked Write 8 Done Done Sent false
28734 8013 Acked Read 8 Done Done Sent false
28735 8014 Acked Read 7 Done Done Sent false
28736 8015 Acked Write 5 Done Done Sent false
28737 8016 Acked Write 9 Done Done Sent false
28738 8017 Acked Read 10 Done Done Sent false
28739 8018 Acked Write 2 Done Done Sent false
28740 8019 Acked Read 6 Done Done Sent false
28741 8020 Acked Read 6 Done Done Sent false
28742 8021 Acked Read 5 Done Done Sent false
28743 8022 Acked Read 3 Done Done Sent false
28744 8023 Acked Write 7 Done Done Sent false
28745 8024 Acked Write 10 Done Done Sent false
28746 8025 Acked Read 8 Done Done Sent false
28747 8026 Acked Write 6 Done Done Sent false
28748 8027 Acked Read 4 Done Done Sent false
28749 8028 Acked Flush 0 Done Done Sent false
28750 8029 Acked Flush 0 Done Done Sent false
28751 8030 Acked Read 1 Done Done Sent false
28752 8031 Acked Write 4 Done Done Sent false
28753 8032 Acked Read 9 Done Done Sent false
28754 8033 Acked Write 5 Done Done Sent false
28755 8034 Acked Write 1 Done Done Sent false
28756 8035 Acked Read 9 Done Done Sent false
28757 8036 Acked Read 8 Done Done Sent false
28758 8037 Acked Read 1 Done Done Sent false
28759 8038 Acked Read 2 Done Done Sent false
28760 8039 Acked Read 4 Done Done Sent false
28761 8040 Acked Write 4 Done Done Sent false
28762 8041 Acked Flush 0 Done Done Sent false
28763 8042 Acked Read 10 Done Done Sent false
28764 8043 Acked Write 7 Done Done Sent false
28765 8044 Acked Read 5 Done Done Sent false
28766 8045 Acked Write 1 Done Done Sent false
28767 8046 Acked Read 9 Done Done Sent false
28768 8047 Acked Flush 0 Done Done Sent false
28769 8048 Acked Read 2 Done Done Sent false
28770 8049 Acked Write 6 Done Done Sent false
28771 8050 Acked Read 10 Done Done Sent false
28772 8051 Acked Read 1 Done Done Sent false
28773 8052 Acked Read 8 Done Done Sent false
28774 8053 Acked Read 10 Done Done Sent false
28775 8054 Acked Read 5 Done Done Sent false
28776 8055 Acked Read 7 Done Done Sent false
28777 8056 Acked Read 7 Done Done Sent false
28778 8057 Acked Write 5 Done Done Sent false
28779 8058 Acked Read 3 Done Done Sent false
28780 8059 Acked Read 5 Done Done Sent false
28781 8060 Acked Write 2 Done Done Sent false
28782 8061 Acked Flush 0 Done Done Sent false
28783 8062 Acked Write 8 Done Done Sent false
28784 8063 Acked Read 2 Done Done Sent false
28785 8064 Acked Read 1 Done Done Sent false
28786 8065 Acked Write 8 Done Done Sent false
28787 8066 Acked Write 3 Done Done Sent false
28788 8067 Acked Flush 0 Done Done Sent false
28789 8068 Acked Write 7 Done Done Sent false
28790 8069 Acked Flush 0 Done Done Sent false
28791 8070 Acked Write 3 Done Done Sent false
28792 8071 Acked Read 4 Done Done Sent false
28793 8072 Acked Write 2 Done Done Sent false
28794 8073 Acked Read 3 Done Done Sent false
28795 8074 Acked Write 4 Done Done Sent false
28796 8075 Acked Read 3 Done Done Sent false
28797 8076 Acked Read 8 Done Done Sent false
28798 8077 Acked Read 3 Done Done Sent false
28799 8078 Acked Write 10 Done Done Sent false
28800 8079 Acked Read 1 Done Done Sent false
28801 8080 Acked Read 10 Done Done Sent false
28802 8081 Acked Read 6 Done Done Sent false
28803 8082 Acked Write 8 Done Done Sent false
28804 8083 Acked Write 10 Done Done Sent false
28805 8084 Acked Flush 0 Done Done Sent false
28806 8085 Acked Write 2 Done Done Sent false
28807 8086 Acked Write 1 Done Done Sent false
28808 8087 Acked Read 4 Done Done Sent false
28809 8088 Acked Read 7 Done Done Sent false
28810 8089 Acked Read 1 Done Done Sent false
28811 8090 Acked Flush 0 Done Done Sent false
28812 8091 Acked Read 8 Done Done Sent false
28813 8092 Acked Read 9 Done Done Sent false
28814 8093 Acked Flush 0 Done Done Sent false
28815 8094 Acked Write 7 Done Done Sent false
28816 8095 Acked Flush 0 Done Done Sent false
28817 8096 Acked Read 9 Done Done Sent false
28818 8097 Acked Flush 0 Done Done Sent false
28819 8098 Acked Flush 0 Done Done Sent false
28820 8099 Acked Read 6 Done Done Sent false
28821 8100 Acked Write 1 Done Done Sent false
28822 8101 Acked Write 5 Done Done Sent false
28823 8102 Acked Flush 0 Done Done Sent false
28824 8103 Acked Read 6 Done Done Sent false
28825 8104 Acked Flush 0 Done Done Sent false
28826 8105 Acked Read 3 Done Done Sent false
28827 8106 Acked Read 1 Done Done Sent false
28828 8107 Acked Write 5 Done Done Sent false
28829 8108 Acked Read 6 Done Done Sent false
28830 8109 Acked Write 7 Done Done Sent false
28831 8110 Acked Write 10 Done Done Sent false
28832 8111 Acked Write 3 Done Done Sent false
28833 8112 Acked Write 2 Done Done Sent false
28834 8113 Acked Read 6 Done Done Sent false
28835 8114 Acked Read 10 Done Done Sent false
28836 8115 Acked Read 7 Done Done Sent false
28837 8116 Acked Write 9 Done Done Sent false
28838 8117 Acked Write 4 Done Done Sent false
28839 8118 Acked Read 3 Done Done Sent false
28840 8119 Acked Write 2 Done Done Sent false
28841 8120 Acked Write 4 Done Done Sent false
28842 8121 Acked Read 3 Done Done Sent false
28843 8122 Acked Write 10 Done Done Sent false
28844 8123 Acked Write 7 Done Done Sent false
28845 8124 Acked Flush 0 Done Done Sent false
28846 8125 Acked Flush 0 Done Done Sent false
28847 8126 Acked Read 5 Done Done Sent false
28848 8127 Acked Read 10 Done Done Sent false
28849 8128 Acked Write 5 Done Done Sent false
28850 8129 Acked Flush 0 Done Done Sent false
28851 8130 Acked Read 6 Done Done Sent false
28852 8131 Acked Read 1 Done Done Sent false
28853 8132 Acked Write 3 Done Done Sent false
28854 8133 Acked Read 8 Done Done Sent false
28855 8134 Acked Write 8 Done Done Sent false
28856 8135 Acked Write 5 Done Done Sent false
28857 8136 Acked Read 7 Done Done Sent false
28858 8137 Acked Read 9 Done Done Sent false
28859 8138 Acked Read 1 Done Done Sent false
28860 8139 Acked Read 6 Done Done Sent false
28861 8140 Acked Read 7 Done Done Sent false
28862 8141 Acked Read 2 Done Done Sent false
28863 8142 Acked Flush 0 Done Done Sent false
28864 8143 Acked Read 7 Done Done Sent false
28865 8144 Acked Flush 0 Done Done Sent false
28866 8145 Acked Read 6 Done Done Sent false
28867 8146 Acked Write 2 Done Done Sent false
28868 8147 Acked Read 8 Done Done Sent false
28869 8148 Acked Read 6 Done Done Sent false
28870 8149 Acked Read 3 Done Done Sent false
28871 8150 Acked Write 3 Done Done Sent false
28872 8151 Acked Read 1 Done Done Sent false
28873 8152 Acked Read 4 Done Done Sent false
28874 8153 Acked Write 1 Done Done Sent false
28875 8154 Acked Read 2 Done Done Sent false
28876 8155 Acked Write 4 Done Done Sent false
28877 8156 Acked Write 1 Done Done Sent false
28878 8157 Acked Read 1 Done Done Sent false
28879 8158 Acked Write 6 Done Done Sent false
28880 8159 Acked Write 1 Done Done Sent false
28881 8160 Acked Write 4 Done Done Sent false
28882 8161 Acked Read 8 Done Done Sent false
28883 8162 Acked Read 7 Done Done Sent false
28884 8163 Acked Read 1 Done Done Sent false
28885 8164 Acked Read 9 Done Done Sent false
28886 8165 Acked Write 2 Done Done Sent false
28887 8166 Acked Read 8 Done Done Sent false
28888 8167 Acked Write 9 Done Done Sent false
28889 8168 Acked Write 5 Done Done Sent false
28890 8169 Acked Write 10 Done Done Sent false
28891 8170 Acked Write 4 Done Done Sent false
28892 8171 Acked Write 6 Done Done Sent false
28893 8172 Acked Write 2 Done Done Sent false
28894 8173 Acked Flush 0 Done Done Sent false
28895 8174 Acked Write 10 Done Done Sent false
28896 8175 Acked Read 5 Done Done Sent false
28897 8176 Acked Read 2 Done Done Sent false
28898 8177 Acked Read 8 Done Done Sent false
28899 8178 Acked Read 3 Done Done Sent false
28900 8179 Acked Read 3 Done Done Sent false
28901 8180 Acked Read 8 Done Done Sent false
28902 8181 Acked Write 7 Done Done Sent false
28903 8182 Acked Write 8 Done Done Sent false
28904 8183 Acked Read 3 Done Done Sent false
28905 8184 Acked Write 1 Done Done Sent false
28906 8185 Acked Write 5 Done Done Sent false
28907 8186 Acked Write 1 Done Done Sent false
28908 8187 Acked Read 1 Done Done Sent false
28909 8188 Acked Write 2 Done Done Sent false
28910 8189 Acked Write 4 Done Done Sent false
28911 8190 Acked Write 9 Done Done Sent false
28912 8191 Acked Read 3 Done Done Sent false
28913 8192 Acked Read 3 Done Done Sent false
28914 8193 Acked Write 5 Done Done Sent false
28915 8194 Acked Read 5 Done Done Sent false
28916 8195 Acked Write 2 Done Done Sent false
28917 8196 Acked Flush 0 Done Done Sent false
28918 8197 Acked Write 2 Done Done Sent false
28919 8198 Acked Write 3 Done Done Sent false
28920 8199 Acked Flush 0 Done Done Sent false
28921 8200 Acked Write 2 Done Done Sent false
28922 8201 Acked Write 6 Done Done Sent false
28923 8202 Acked Write 9 Done Done Sent false
28924 8203 Acked Flush 0 Done Done Sent false
28925 8204 Acked Write 1 Done Done Sent false
28926 8205 Acked Read 2 Done Done Sent false
28927 8206 Acked Flush 0 Done Done Sent false
28928 8207 Acked Read 4 Done Done Sent false
28929 8208 Acked Read 5 Done Done Sent false
28930 8209 Acked Read 2 Done Done Sent false
28931 8210 Acked Read 1 Done Done Sent false
28932 8211 Acked Write 2 Done Done Sent false
28933 8212 Acked Read 9 Done Done Sent false
28934 8213 Acked Read 4 Done Done Sent false
28935 8214 Acked Write 1 Done Done Sent false
28936 8215 Acked Read 5 Done Done Sent false
28937 8216 Acked Flush 0 Done Done Sent false
28938 8217 Acked Read 9 Done Done Sent false
28939 8218 Acked Read 10 Done Done Sent false
28940 8219 Acked Write 4 Done Done Sent false
28941 8220 Acked Write 6 Done Done Sent false
28942 8221 Acked Read 5 Done Done Sent false
28943 8222 Acked Write 6 Done Done Sent false
28944 8223 Acked Read 6 Done Done Sent false
28945 8224 Acked Read 1 Done Done Sent false
28946 8225 Acked Read 9 Done Done Sent false
28947 8226 Acked Write 7 Done Done Sent false
28948 8227 Acked Write 10 Done Done Sent false
28949 8228 Acked Write 9 Done Done Sent false
28950 8229 Acked Write 7 Done Done Sent false
28951 8230 Acked Read 7 Done Done Sent false
28952 8231 Acked Write 4 Done Done Sent false
28953 8232 Acked Read 6 Done Done Sent false
28954 8233 Acked Read 2 Done Done Sent false
28955 8234 Acked Write 1 Done Done Sent false
28956 8235 Acked Write 8 Done Done Sent false
28957 8236 Acked Write 5 Done Done Sent false
28958 8237 Acked Write 2 Done Done Sent false
28959 8238 Acked Read 10 Done Done Sent false
28960 8239 Acked Read 10 Done Done Sent false
28961 8240 Acked Read 3 Done Done Sent false
28962 8241 Acked Write 8 Done Done Sent false
28963 8242 Acked Read 10 Done Done Sent false
28964 8243 Acked Read 4 Done Done Sent false
28965 8244 Acked Flush 0 Done Done Sent false
28966 STATES DS:0 DS:1 DS:2 TOTAL
28967 Sent 0 0 302 302
28968 Done 302 302 0 604
28969 Skipped 0 0 0 0
28970 Error 0 0 0 0
28971 Last Flush: 8244 8244 7942
28972 Downstairs last five completed: 7942 7941 7940 7939 7938
28973 Upstairs last five completed: 8244 8243 8242 8241 8240
28974 CLIENT: Up:0 ds:302 act:2
289752025-01-10T16:41:23.395ZINFOcrucible: connecting to 127.0.0.1:8830 = io task client = 2 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
289762025-01-10T16:41:23.395ZINFOcrucible: ds_connection connected from Ok(127.0.0.1:37931) = io task client = 2 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
289772025-01-10T16:41:23.397ZWARNcrucible: version negotiation from state Offline = downstairs client = 2 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
289782025-01-10T16:41:23.397ZINFOcrucible: downstairs client at Some(127.0.0.1:8830) has region UUID 12345678-0000-0000-0000-000000008830 = downstairs client = 2 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
289792025-01-10T16:41:23.397ZINFOcrucible: Returning UUID:12345678-0000-0000-0000-000000008830 matches = downstairs client = 2 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
289802025-01-10T16:41:23.397ZINFOcrucible: send last flush ID to this DS: 7942 = downstairs client = 2 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
289812025-01-10T16:41:23.397ZINFOcrucible: Replied this last flush ID: 7942 = downstairs client = 2 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
289822025-01-10T16:41:23.397ZINFOcrucible: ds_transition from Offline to Active = downstairs client = 2 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
289832025-01-10T16:41:23.398ZINFOcrucible: [2] Transition from Offline to Active = downstairs client = 2 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
289842025-01-10T16:41:23.398ZINFOcrucible: [2] client re-new 302 jobs since flush 7942 = downstairs session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
289852025-01-10T16:41:23.398ZINFOcrucible: [2] Replayed 302 jobs since flush: 7942 = downstairs session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
28986 ----------------------------------------------------------------
28987 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:0
28988 Downstairs last five completed: 8244 8243 8242 8241 8240
28989 Upstairs last five completed: 8244 8243 8242 8241 8240
28990 CLIENT: Up:0 ds:0 act:3
28991 Replay: All jobs finished
28992 Main task has work to do, go find it
28993 got dsc Stop(1)
28994 stop 1
28995 Jan 10 16:41:25.633 INFO [8820] Got stop action so:false kr:false
28996 request completed, latency_us: 363, response_code: 204, uri: /stop/cid/1, method: POST, req_id: d4192062-4e9d-40ec-b74f-2cf5076df7e0, remote_addr: 127.0.0.1:55917, local_addr: 127.0.0.1:9998
289972025-01-10T16:41:25.633ZWARNcrucible: downstairs disconnected = io task client = 1 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
289982025-01-10T16:41:25.633ZWARNcrucible: client task is sending Done(Finished) = io task client = 1 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
289992025-01-10T16:41:25.634ZWARNcrucible: downstairs task for 1 stopped due to Finished session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
290002025-01-10T16:41:25.634ZINFOcrucible: ds_transition from Active to Offline = downstairs client = 1 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
29001 Jan 10 16:41:25.634 INFO request completed{"msg":"[1] Transition from Active to Offline","v":0,"name":"crucible","level":30,"time":"2025-01-10T16:41:25.634076216Z","hostname":"w-01JH8H1N3KXZ9F8ZV6CCMP5KTQ","pid":1202,"client":"1","":"downstairs","session_id":"1df3ca91-4dc9-42d6-9897-461254b5afe2"}
29002 , latency_us: 154, response_code: 200, uri: /state/cid/1, method: GET, req_id: 365f62e2-0eda-4b20-afae-65c1ed8c77c8, remote_addr: 127.{"msg":"client task is exiting","v":0,"name":"crucible","level":30,"time":"2025-01-10T16:41:25.634151469Z","hostname":"w-01JH8H1N3KXZ9F8ZV6CCMP5KTQ","pid":1202,"":"io task","client":"1","":"downstairs","session_id":"1df3ca91-4dc9-42d6-9897-461254b5afe2"}
29003 0.0.1:55917, local_addr: 127.0.0.1:9998
29004 [8820] Exited with: ExitStatus(unix_wait_status(9))
29005 [8820][1] reports Exit
29006 Jan 10 16:41:29.636 INFO request completed, latency_us: 222, response_code: 200, uri: /state/cid/1, method: GET, req_id: 8c9dadd2-0d83-4964-9a18-0be06457260f, remote_addr: 127.0.0.1:55917, local_addr: 127.0.0.1:9998
29007 001/300 Read block 3114 len 20480
29008 002/300 Write block 1809 len 12288 data: 3 4 5
29009 003/300 Write block 3704 len 4096 data: 8
29010 004/300 Write block 4853 len 8192 data: 6 6
29011 005/300 Flush
29012 006/300 Write block 4962 len 36864 data: 6 7 7 6 6 4 4 3 4
29013 007/300 Read block 3619 len 24576
29014 008/300 Read block 4610 len 12288
29015 009/300 Read block 4318 len 24576
29016 010/300 Write block 3208 len 40960 data: 4 4 5 5 6 9 9 7 7 6
29017 011/300 Read block 2960 len 32768
29018 012/300 Read block 90 len 36864
29019 013/300 Write block 4622 len 32768 data: 6 6 6 7 5 6 5 6
29020 014/300 Write block 4107 len 20480 data: 4 4 4 4 4
29021 015/300 Write block 620 len 4096 data: 4
29022 016/300 Read block 2587 len 24576
29023 017/300 Read block 658 len 8192
29024 018/300 Write block 3974 len 28672 data: 6 6 6 6 6 4 5
29025 019/300 Flush
29026 020/300 Write block 3035 len 8192 data: 6 6
29027 021/300 Write block 392 len 16384 data: 5 3 4 4
29028 022/300 Read block 1964 len 4096
29029 023/300 Flush
29030 024/300 Read block 3428 len 16384
29031 025/300 Write block 3842 len 36864 data: 7 6 7 7 8 7 6 4 5
29032 026/300 Read block 4562 len 20480
29033 027/300 Write block 4401 len 16384 data: 7 5 4 3
29034 028/300 Read block 3964 len 4096
29035 029/300 Read block 1079 len 24576
29036 030/300 Flush
29037 031/300 Read block 182 len 28672
29038 032/300 Write block 621 len 36864 data: 3 3 4 3 5 6 7 6 6
29039 033/300 Read block 95 len 20480
29040 034/300 Write block 4637 len 40960 data: 5 4 2 2 3 2 3 3 4 4
29041 035/300 Write block 3445 len 40960 data: 2 2 2 3 4 4 3 4 4 4
29042 036/300 Read block 3438 len 36864
29043 037/300 Write block 794 len 12288 data: 6 5 4
29044 038/300 Write block 3678 len 40960 data: 5 5 4 5 5 5 5 4 5 4
29045 039/300 Read block 2774 len 28672
29046 040/300 Flush
29047 041/300 Write block 3756 len 40960 data: 7 7 8 8 5 5 6 5 4 5
29048 042/300 Read block 2633 len 28672
29049 043/300 Read block 2077 len 12288
29050 044/300 Write block 2947 len 16384 data: 8 7 7 6
29051 045/300 Write block 3333 len 24576 data: 7 7 7 7 7 8
29052 046/300 Read block 3641 len 20480
29053 047/300 Write block 1942 len 40960 data: 5 6 6 5 6 6 7 7 7 6
29054 048/300 Read block 4116 len 4096
29055 049/300 Write block 1580 len 20480 data: 3 4 4 4 5
29056 050/300 Read block 621 len 40960
29057 051/300 Read block 1077 len 36864
29058 052/300 Flush
29059 053/300 Read block 2675 len 32768
29060 054/300 Flush
29061 055/300 Write block 2805 len 16384 data: 8 7 9 10
29062 056/300 Flush
29063 057/300 Write block 241 len 12288 data: 4 4 5
29064 058/300 Write block 4116 len 20480 data: 6 6 6 7 9
29065 059/300 Read block 2009 len 40960
29066 060/300 Write block 1096 len 36864 data: 6 8 6 5 5 4 3 4 4
29067 061/300 Write block 1954 len 4096 data: 5
29068 062/300 Write block 2506 len 24576 data: 6 7 7 8 8 8
29069 063/300 Read block 3801 len 12288
29070 064/300 Write block 1437 len 32768 data: 6 5 4 4 5 3 3 4
29071 065/300 Write block 850 len 32768 data: 5 5 4 5 4 3 3 3
29072 066/300 Read block 4082 len 40960
29073 067/300 Read block 4473 len 28672
29074 068/300 Write block 9 len 40960 data: 5 6 6 7 8 7 7 9 9 8
29075 069/300 Write block 4772 len 40960 data: 6 6 5 4 4 4 3 3 3 4
29076 070/300 Flush
29077 071/300 Read block 897 len 20480
29078 072/300 Read block 2707 len 36864
29079 073/300 Read block 4546 len 32768
29080 074/300 Write block 3300 len 8192 data: 4 5
29081 075/300 Read block 2784 len 12288
29082 076/300 Read block 1051 len 28672
29083 077/300 Write block 1929 len 36864 data: 8 9 7 5 6 5 5 4 4
29084 078/300 Read block 4633 len 40960
29085 079/300 Write block 1769 len 4096 data: 5
29086 080/300 Read block 604 len 8192
29087 081/300 Write block 3559 len 8192 data: 4 5
29088 082/300 Write block 4691 len 16384 data: 5 5 6 6
29089 083/300 Read block 3728 len 40960
29090 084/300 Flush
29091 085/300 Read block 3695 len 28672
29092 086/300 Write block 796 len 12288 data: 5 4 4
29093 087/300 Write block 1309 len 40960 data: 5 5 7 6 7 6 5 5 8 7
29094 088/300 Write block 4927 len 12288 data: 4 4 4
29095 089/300 Write block 230 len 12288 data: 7 8 7
29096 090/300 Read block 4343 len 8192
29097 091/300 Read block 1558 len 32768
29098 092/300 Write block 235 len 8192 data: 7 7
29099 093/300 Write block 193 len 20480 data: 5 6 6 7 7
29100 094/300 Write block 614 len 36864 data: 8 7 7 6 6 5 5 4 4
29101 095/300 Read block 1129 len 24576
29102 096/300 Write block 1463 len 32768 data: 3 5 5 4 4 5 5 5
29103 097/300 Read block 2063 len 8192
29104 098/300 Read block 3985 len 40960
29105 099/300 Read block 1070 len 4096
29106 100/300 Write block 46 len 24576 data: 5 6 6 5 5 5
29107 101/300 Write block 1029 len 20480 data: 8 9 8 8 9
29108 102/300 Write block 265 len 12288 data: 5 6 6
29109 103/300 Flush
29110 104/300 Write block 3764 len 16384 data: 5 6 6 7
29111 105/300 Write block 4090 len 16384 data: 6 6 6 6
29112 106/300 Read block 2759 len 20480
29113 107/300 Write block 2490 len 36864 data: 5 4 5 4 4 4 5 4 3
29114 108/300 Read block 275 len 40960
29115 109/300 Write block 1985 len 24576 data: 6 7 8 8 9 7
29116 110/300 Write block 4178 len 16384 data: 6 6 6 5
29117 111/300 Read block 4956 len 28672
29118 112/300 Write block 4078 len 20480 data: 6 4 5 6 6
29119 113/300 Write block 3554 len 28672 data: 6 6 5 5 4 5 6
29120 114/300 Write block 4592 len 4096 data: 5
29121 115/300 Read block 2997 len 12288
29122 116/300 Flush
29123 117/300 Read block 2879 len 24576
29124 118/300 Read block 3701 len 40960
29125 119/300 Read block 862 len 12288
29126 120/300 Flush
29127 121/300 Read block 2649 len 24576
29128 122/300 Write block 2135 len 12288 data: 8 6 4
29129 123/300 Write block 4115 len 40960 data: 5 7 7 7 8 10 8 6 5 6
29130 124/300 Write block 494 len 32768 data: 6 5 6 6 5 2 4 4
29131 125/300 Read block 4416 len 40960
29132 126/300 Read block 139 len 8192
29133 127/300 Write block 3295 len 32768 data: 2 3 3 3 3 5 6 5
29134 128/300 Write block 3258 len 36864 data: 5 5 5 3 4 6 6 8 6
29135 129/300 Read block 1533 len 12288
29136 130/300 Read block 1011 len 16384
29137 131/300 Read block 4566 len 24576
29138 132/300 Read block 734 len 8192
29139 133/300 Write block 2358 len 4096 data: 6
29140 134/300 Flush
29141 135/300 Write block 2110 len 28672 data: 3 5 5 6 7 5 5
29142 136/300 Read block 4617 len 28672
29143 137/300 Read block 3651 len 20480
29144 138/300 Read block 117 len 20480
29145 139/300 Read block 3384 len 24576
29146 140/300 Read block 636 len 24576
29147 141/300 Read block 2662 len 32768
29148 142/300 Read block 4186 len 36864
29149 143/300 Write block 4743 len 32768 data: 5 5 5 3 5 4 4 4
29150 144/300 Read block 3967 len 4096
29151 145/300 Write block 131 len 12288 data: 3 3 3
29152 146/300 Read block 662 len 16384
29153 147/300 Write block 3287 len 12288 data: 5 6 6
29154 148/300 Flush
29155 149/300 Read block 141 len 28672
29156 150/300 Read block 4356 len 12288
29157 151/300 Write block 173 len 20480 data: 4 4 4 4 4
29158 152/300 Read block 1854 len 28672
29159 153/300 Read block 4596 len 4096
29160 154/300 Write block 4073 len 12288 data: 9 8 6
29161 155/300 Flush
29162 156/300 Read block 3091 len 40960
29163 157/300 Write block 2405 len 8192 data: 4 5
29164 158/300 Flush
29165 159/300 Read block 2112 len 16384
29166 160/300 Read block 770 len 20480
29167 161/300 Write block 4756 len 16384 data: 5 4 5 5
29168 162/300 Write block 2024 len 40960 data: 2 2 2 2 4 5 6 6 6 6
29169 163/300 Write block 4221 len 4096 data: 4
29170 164/300 Read block 2399 len 24576
29171 165/300 Write block 3042 len 16384 data: 2 2 2 3
29172 166/300 Read block 4943 len 36864
29173 167/300 Write block 3636 len 40960 data: 7 7 6 4 5 6 6 7 5 5
29174 168/300 Read block 3908 len 36864
29175 169/300 Read block 1640 len 28672
29176 170/300 Write block 2693 len 32768 data: 6 6 6 6 6 5 4 4
29177 171/300 Read block 467 len 40960
29178 172/300 Write block 4947 len 24576 data: 5 5 5 5 4 3
29179 173/300 Read block 774 len 16384
29180 174/300 Read block 4800 len 20480
29181 175/300 Read block 3760 len 28672
29182 176/300 Read block 2643 len 12288
29183 177/300 Read block 4285 len 20480
29184 178/300 Read block 1911 len 36864
29185 179/300 Write block 2889 len 40960 data: 8 8 5 7 6 6 8 6 10 10
29186 180/300 Read block 1749 len 32768
29187 181/300 Read block 3851 len 40960
29188 182/300 Write block 3434 len 28672 data: 5 4 5 4 4 4 4
29189 183/300 Read block 1841 len 24576
29190 184/300 Read block 3585 len 4096
29191 185/300 Flush
29192 186/300 Read block 3451 len 32768
29193 187/300 Read block 61 len 8192
29194 188/300 Flush
29195 189/300 Write block 1340 len 40960 data: 9 9 9 6 7 6 6 6 4 5
29196 190/300 Read block 1421 len 36864
29197 191/300 Read block 3550 len 24576
29198 192/300 Read block 271 len 8192
29199 193/300 Read block 565 len 36864
29200 194/300 Read block 4126 len 8192
29201 195/300 Read block 3840 len 28672
29202 196/300 Flush
29203 197/300 Read block 260 len 24576
29204 198/300 Read block 4320 len 16384
29205 199/300 Write block 1682 len 12288 data: 7 7 8
29206 200/300 Read block 3724 len 4096
29207 201/300 Write block 568 len 20480 data: 3 3 3 2 4
29208 202/300 Write block 1418 len 36864 data: 3 3 3 3 2 3 2 2 3
29209 203/300 Read block 4560 len 36864
29210 204/300 Read block 4420 len 16384
29211 205/300 Write block 4524 len 24576 data: 4 4 6 5 7 7
29212 206/300 Write block 4442 len 12288 data: 5 5 5
29213 207/300 Read block 1582 len 36864
29214 208/300 Write block 1006 len 24576 data: 4 4 5 5 6 6
29215 209/300 Write block 746 len 24576 data: 3 3 6 5 7 6
29216 210/300 Read block 2239 len 40960
29217 211/300 Read block 3151 len 16384
29218 212/300 Write block 1801 len 8192 data: 2 2
29219 213/300 Write block 90 len 36864 data: 6 6 6 6 4 4 4 3 3
29220 214/300 Write block 3500 len 36864 data: 3 4 4 4 3 3 4 4 4
29221 215/300 Read block 3151 len 16384
29222 216/300 Read block 4553 len 40960
29223 217/300 Read block 2175 len 40960
29224 218/300 Flush
29225 219/300 Write block 2698 len 32768 data: 6 5 5 3 2 4 6 6
29226 220/300 Write block 3302 len 16384 data: 6 4 3 4
29227 221/300 Write block 3763 len 8192 data: 6 6
29228 222/300 Read block 4587 len 20480
29229 223/300 Read block 256 len 24576
29230 224/300 Read block 2445 len 28672
29231 225/300 Read block 2568 len 20480
29232 226/300 Flush
29233 227/300 Write block 3109 len 4096 data: 5
29234 228/300 Write block 4060 len 16384 data: 3 3 5 4
29235 229/300 Read block 3023 len 16384
29236 230/300 Write block 1866 len 36864 data: 5 4 4 4 4 2 3 4 3
29237 231/300 Write block 1913 len 36864 data: 7 5 6 6 5 6 5 5 4
29238 232/300 Read block 4904 len 12288
29239 233/300 Write block 67 len 40960 data: 4 5 6 7 6 8 9 9 9 9
29240 234/300 Write block 4422 len 8192 data: 4 6
29241 235/300 Read block 649 len 16384
29242 236/300 Write block 1701 len 8192 data: 7 7
29243 237/300 Read block 3729 len 20480
29244 238/300 Read block 1367 len 4096
29245 239/300 Write block 624 len 16384 data: 4 6 7 8
29246 240/300 Read block 2014 len 20480
29247 241/300 Read block 4181 len 20480
29248 242/300 Read block 1787 len 12288
29249 243/300 Read block 6 len 16384
29250 244/300 Flush
29251 245/300 Write block 488 len 16384 data: 8 7 6 6
29252 246/300 Read block 484 len 24576
29253 247/300 Write block 3942 len 24576 data: 8 11 10 10 10 9
29254 248/300 Write block 1671 len 28672 data: 4 4 5 4 5 4 4
29255 249/300 Read block 2215 len 32768
29256 250/300 Write block 2505 len 12288 data: 5 7 8
29257 251/300 Read block 1218 len 4096
29258 252/300 Write block 1189 len 24576 data: 6 5 6 5 6 5
29259 253/300 Write block 1204 len 4096 data: 3
29260 254/300 Read block 2095 len 36864
29261 255/300 Write block 1675 len 12288 data: 6 5 5
29262 256/300 Read block 1382 len 24576
29263 257/300 Read block 876 len 16384
29264 258/300 Write block 67 len 16384 data: 5 6 7 8
29265 259/300 Read block 3748 len 36864
29266 260/300 Write block 4128 len 24576 data: 7 5 5 5 6 5
29267 261/300 Read block 4322 len 40960
29268 262/300 Write block 3624 len 36864 data: 3 4 3 3 3 3 3 3 3
29269 263/300 Write block 1666 len 28672 data: 6 6 5 6 5 5 5
29270 264/300 Read block 4251 len 20480
29271 265/300 Read block 2851 len 28672
29272 266/300 Read block 881 len 8192
29273 267/300 Read block 2131 len 16384
29274 268/300 Flush
29275 269/300 Write block 806 len 24576 data: 5 7 6 6 6 7
29276 270/300 Write block 4010 len 4096 data: 2
29277 271/300 Read block 3360 len 4096
29278 272/300 Write block 4407 len 32768 data: 3 3 2 2 2 2 4 5
29279 273/300 Write block 4371 len 32768 data: 8 9 9 10 9 10 11 10
29280 274/300 Flush
29281 275/300 Read block 285 len 32768
29282 276/300 Read block 416 len 24576
29283 277/300 Read block 3639 len 36864
29284 278/300 Read block 2870 len 40960
29285 279/300 Read block 3443 len 40960
29286 280/300 Read block 4534 len 32768
29287 281/300 Read block 210 len 36864
29288 282/300 Write block 2397 len 16384 data: 7 7 6 5
29289 283/300 Write block 563 len 16384 data: 6 6 7 6
29290 284/300 Read block 4530 len 12288
29291 285/300 Read block 3660 len 12288
29292 286/300 Write block 1934 len 28672 data: 6 6 5 5 4 4 4
29293 287/300 Flush
29294 288/300 Read block 2752 len 12288
29295 289/300 Read block 1332 len 36864
29296 290/300 Write block 4244 len 4096 data: 3
29297 291/300 Flush
29298 292/300 Read block 4259 len 8192
29299 293/300 Read block 4421 len 20480
29300 294/300 Write block 2024 len 32768 data: 3 3 3 3 5 6 7 7
29301 295/300 Write block 3619 len 8192 data: 4 5
29302 296/300 Write block 4249 len 4096 data: 7
29303 297/300 Read block 4368 len 8192
29304 298/300 Flush
29305 299/300 Write block 4928 len 20480 data: 5 5 4 4 4
29306 300/300 Read block 2940 len 40960
29307 301/300 Write block 1022 len 40960 data: 7 5 6 6 6 7 6 9 10 9
29308 Main task has work to do, go find it
29309 got dsc Start(1)
29310 start 1
29311 Jan 10 16:41:29.876 INFO request completed, latency_us: 204, response_code: 204, uri: /start/cid/1, method: POST, req_id: b7921898-6323-42ef-a21d-89eeec3e8077, remote_addr: 127.0.0.1:55917, local_addr: 127.0.0.1:9998
29312 Replay: started 1, returned:Ok(())
29313 ----------------------------------------------------------------
29314 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:301
29315 States: Active Offline Active
29316 JOBID ACK TYPE BKS/EXT DS:0 DS:1 DS:2 REPLAY
29317 8245 Acked Read 5 Done Sent Done false
29318 8246 Acked Write 3 Done Sent Done false
29319 8247 Acked Write 1 Done Sent Done false
29320 8248 Acked Write 2 Done Sent Done false
29321 8249 Acked Flush 0 Done Sent Done false
29322 8250 Acked Write 9 Done Sent Done false
29323 8251 Acked Read 6 Done Sent Done false
29324 8252 Acked Read 3 Done Sent Done false
29325 8253 Acked Read 6 Done Sent Done false
29326 8254 Acked Write 10 Done Sent Done false
29327 8255 Acked Read 8 Done Sent Done false
29328 8256 Acked Read 9 Done Sent Done false
29329 8257 Acked Write 8 Done Sent Done false
29330 8258 Acked Write 5 Done Sent Done false
29331 8259 Acked Write 1 Done Sent Done false
29332 8260 Acked Read 6 Done Sent Done false
29333 8261 Acked Read 2 Done Sent Done false
29334 8262 Acked Write 7 Done Sent Done false
29335 8263 Acked Flush 0 Done Sent Done false
29336 8264 Acked Write 2 Done Sent Done false
29337 8265 Acked Write 4 Done Sent Done false
29338 8266 Acked Read 1 Done Sent Done false
29339 8267 Acked Flush 0 Done Sent Done false
29340 8268 Acked Read 4 Done Sent Done false
29341 8269 Acked Write 9 Done Sent Done false
29342 8270 Acked Read 5 Done Sent Done false
29343 8271 Acked Write 4 Done Sent Done false
29344 8272 Acked Read 1 Done Sent Done false
29345 8273 Acked Read 6 Done Sent Done false
29346 8274 Acked Flush 0 Done Sent Done false
29347 8275 Acked Read 7 Done Sent Done false
29348 8276 Acked Write 9 Done Sent Done false
29349 8277 Acked Read 5 Done Sent Done false
29350 8278 Acked Write 10 Done Sent Done false
29351 8279 Acked Write 10 Done Sent Done false
29352 8280 Acked Read 9 Done Sent Done false
29353 8281 Acked Write 3 Done Sent Done false
29354 8282 Acked Write 10 Done Sent Done false
29355 8283 Acked Read 7 Done Sent Done false
29356 8284 Acked Flush 0 Done Sent Done false
29357 8285 Acked Write 10 Done Sent Done false
29358 8286 Acked Read 7 Done Sent Done false
29359 8287 Acked Read 3 Done Sent Done false
29360 8288 Acked Write 4 Done Sent Done false
29361 8289 Acked Write 6 Done Sent Done false
29362 8290 Acked Read 5 Done Sent Done false
29363 8291 Acked Write 10 Done Sent Done false
29364 8292 Acked Read 1 Done Sent Done false
29365 8293 Acked Write 5 Done Sent Done false
29366 8294 Acked Read 10 Done Sent Done false
29367 8295 Acked Read 9 Done Sent Done false
29368 8296 Acked Flush 0 Done Sent Done false
29369 8297 Acked Read 8 Done Sent Done false
29370 8298 Acked Flush 0 Done Sent Done false
29371 8299 Acked Write 4 Done Sent Done false
29372 8300 Acked Flush 0 Done Sent Done false
29373 8301 Acked Write 3 Done Sent Done false
29374 8302 Acked Write 5 Done Sent Done false
29375 8303 Acked Read 10 Done Sent Done false
29376 8304 Acked Write 9 Done Sent Done false
29377 8305 Acked Write 1 Done Sent Done false
29378 8306 Acked Write 6 Done Sent Done false
29379 8307 Acked Read 3 Done Sent Done false
29380 8308 Acked Write 8 Done Sent Done false
29381 8309 Acked Write 8 Done Sent Done false
29382 8310 Acked Read 10 Done Sent Done false
29383 8311 Acked Read 7 Done Sent Done false
29384 8312 Acked Write 10 Done Sent Done false
29385 8313 Acked Write 10 Done Sent Done false
29386 8314 Acked Flush 0 Done Sent Done false
29387 8315 Acked Read 5 Done Sent Done false
29388 8316 Acked Read 9 Done Sent Done false
29389 8317 Acked Read 8 Done Sent Done false
29390 8318 Acked Write 2 Done Sent Done false
29391 8319 Acked Read 3 Done Sent Done false
29392 8320 Acked Read 7 Done Sent Done false
29393 8321 Acked Write 9 Done Sent Done false
29394 8322 Acked Read 10 Done Sent Done false
29395 8323 Acked Write 1 Done Sent Done false
29396 8324 Acked Read 2 Done Sent Done false
29397 8325 Acked Write 2 Done Sent Done false
29398 8326 Acked Write 4 Done Sent Done false
29399 8327 Acked Read 10 Done Sent Done false
29400 8328 Acked Flush 0 Done Sent Done false
29401 8329 Acked Read 7 Done Sent Done false
29402 8330 Acked Write 3 Done Sent Done false
29403 8331 Acked Write 10 Done Sent Done false
29404 8332 Acked Write 3 Done Sent Done false
29405 8333 Acked Write 3 Done Sent Done false
29406 8334 Acked Read 2 Done Sent Done false
29407 8335 Acked Read 8 Done Sent Done false
29408 8336 Acked Write 2 Done Sent Done false
29409 8337 Acked Write 5 Done Sent Done false
29410 8338 Acked Write 9 Done Sent Done false
29411 8339 Acked Read 6 Done Sent Done false
29412 8340 Acked Write 8 Done Sent Done false
29413 8341 Acked Read 2 Done Sent Done false
29414 8342 Acked Read 10 Done Sent Done false
29415 8343 Acked Read 1 Done Sent Done false
29416 8344 Acked Write 6 Done Sent Done false
29417 8345 Acked Write 5 Done Sent Done false
29418 8346 Acked Write 3 Done Sent Done false
29419 8347 Acked Flush 0 Done Sent Done false
29420 8348 Acked Write 4 Done Sent Done false
29421 8349 Acked Write 4 Done Sent Done false
29422 8350 Acked Read 5 Done Sent Done false
29423 8351 Acked Write 9 Done Sent Done false
29424 8352 Acked Read 10 Done Sent Done false
29425 8353 Acked Write 6 Done Sent Done false
29426 8354 Acked Write 4 Done Sent Done false
29427 8355 Acked Read 7 Done Sent Done false
29428 8356 Acked Write 5 Done Sent Done false
29429 8357 Acked Write 7 Done Sent Done false
29430 8358 Acked Write 1 Done Sent Done false
29431 8359 Acked Read 3 Done Sent Done false
29432 8360 Acked Flush 0 Done Sent Done false
29433 8361 Acked Read 6 Done Sent Done false
29434 8362 Acked Read 10 Done Sent Done false
29435 8363 Acked Read 3 Done Sent Done false
29436 8364 Acked Flush 0 Done Sent Done false
29437 8365 Acked Read 6 Done Sent Done false
29438 8366 Acked Write 3 Done Sent Done false
29439 8367 Acked Write 10 Done Sent Done false
29440 8368 Acked Write 8 Done Sent Done false
29441 8369 Acked Read 10 Done Sent Done false
29442 8370 Acked Read 2 Done Sent Done false
29443 8371 Acked Write 8 Done Sent Done false
29444 8372 Acked Write 9 Done Sent Done false
29445 8373 Acked Read 3 Done Sent Done false
29446 8374 Acked Read 4 Done Sent Done false
29447 8375 Acked Read 6 Done Sent Done false
29448 8376 Acked Read 2 Done Sent Done false
29449 8377 Acked Write 1 Done Sent Done false
29450 8378 Acked Flush 0 Done Sent Done false
29451 8379 Acked Write 7 Done Sent Done false
29452 8380 Acked Read 7 Done Sent Done false
29453 8381 Acked Read 5 Done Sent Done false
29454 8382 Acked Read 5 Done Sent Done false
29455 8383 Acked Read 6 Done Sent Done false
29456 8384 Acked Read 6 Done Sent Done false
29457 8385 Acked Read 8 Done Sent Done false
29458 8386 Acked Read 9 Done Sent Done false
29459 8387 Acked Write 8 Done Sent Done false
29460 8388 Acked Read 1 Done Sent Done false
29461 8389 Acked Write 3 Done Sent Done false
29462 8390 Acked Read 4 Done Sent Done false
29463 8391 Acked Write 3 Done Sent Done false
29464 8392 Acked Flush 0 Done Sent Done false
29465 8393 Acked Read 7 Done Sent Done false
29466 8394 Acked Read 3 Done Sent Done false
29467 8395 Acked Write 5 Done Sent Done false
29468 8396 Acked Read 7 Done Sent Done false
29469 8397 Acked Read 1 Done Sent Done false
29470 8398 Acked Write 3 Done Sent Done false
29471 8399 Acked Flush 0 Done Sent Done false
29472 8400 Acked Read 10 Done Sent Done false
29473 8401 Acked Write 2 Done Sent Done false
29474 8402 Acked Flush 0 Done Sent Done false
29475 8403 Acked Read 4 Done Sent Done false
29476 8404 Acked Read 5 Done Sent Done false
29477 8405 Acked Write 4 Done Sent Done false
29478 8406 Acked Write 10 Done Sent Done false
29479 8407 Acked Write 1 Done Sent Done false
29480 8408 Acked Read 6 Done Sent Done false
29481 8409 Acked Write 4 Done Sent Done false
29482 8410 Acked Read 9 Done Sent Done false
29483 8411 Acked Write 10 Done Sent Done false
29484 8412 Acked Read 9 Done Sent Done false
29485 8413 Acked Read 7 Done Sent Done false
29486 8414 Acked Write 8 Done Sent Done false
29487 8415 Acked Read 10 Done Sent Done false
29488 8416 Acked Write 6 Done Sent Done false
29489 8417 Acked Read 4 Done Sent Done false
29490 8418 Acked Read 5 Done Sent Done false
29491 8419 Acked Read 7 Done Sent Done false
29492 8420 Acked Read 3 Done Sent Done false
29493 8421 Acked Read 5 Done Sent Done false
29494 8422 Acked Read 9 Done Sent Done false
29495 8423 Acked Write 10 Done Sent Done false
29496 8424 Acked Read 8 Done Sent Done false
29497 8425 Acked Read 10 Done Sent Done false
29498 8426 Acked Write 7 Done Sent Done false
29499 8427 Acked Read 6 Done Sent Done false
29500 8428 Acked Read 1 Done Sent Done false
29501 8429 Acked Flush 0 Done Sent Done false
29502 8430 Acked Read 8 Done Sent Done false
29503 8431 Acked Read 2 Done Sent Done false
29504 8432 Acked Flush 0 Done Sent Done false
29505 8433 Acked Write 10 Done Sent Done false
29506 8434 Acked Read 9 Done Sent Done false
29507 8435 Acked Read 6 Done Sent Done false
29508 8436 Acked Read 2 Done Sent Done false
29509 8437 Acked Read 9 Done Sent Done false
29510 8438 Acked Read 2 Done Sent Done false
29511 8439 Acked Read 7 Done Sent Done false
29512 8440 Acked Flush 0 Done Sent Done false
29513 8441 Acked Read 6 Done Sent Done false
29514 8442 Acked Read 4 Done Sent Done false
29515 8443 Acked Write 3 Done Sent Done false
29516 8444 Acked Read 1 Done Sent Done false
29517 8445 Acked Write 5 Done Sent Done false
29518 8446 Acked Write 9 Done Sent Done false
29519 8447 Acked Read 9 Done Sent Done false
29520 8448 Acked Read 4 Done Sent Done false
29521 8449 Acked Write 6 Done Sent Done false
29522 8450 Acked Write 3 Done Sent Done false
29523 8451 Acked Read 9 Done Sent Done false
29524 8452 Acked Write 6 Done Sent Done false
29525 8453 Acked Write 6 Done Sent Done false
29526 8454 Acked Read 10 Done Sent Done false
29527 8455 Acked Read 4 Done Sent Done false
29528 8456 Acked Write 2 Done Sent Done false
29529 8457 Acked Write 9 Done Sent Done false
29530 8458 Acked Write 9 Done Sent Done false
29531 8459 Acked Read 4 Done Sent Done false
29532 8460 Acked Read 10 Done Sent Done false
29533 8461 Acked Read 10 Done Sent Done false
29534 8462 Acked Flush 0 Done Sent Done false
29535 8463 Acked Write 8 Done Sent Done false
29536 8464 Acked Write 4 Done Sent Done false
29537 8465 Acked Write 2 Done Sent Done false
29538 8466 Acked Read 5 Done Sent Done false
29539 8467 Acked Read 6 Done Sent Done false
29540 8468 Acked Read 7 Done Sent Done false
29541 8469 Acked Read 5 Done Sent Done false
29542 8470 Acked Flush 0 Done Sent Done false
29543 8471 Acked Write 1 Done Sent Done false
29544 8472 Acked Write 4 Done Sent Done false
29545 8473 Acked Read 4 Done Sent Done false
29546 8474 Acked Write 9 Done Sent Done false
29547 8475 Acked Write 9 Done Sent Done false
29548 8476 Acked Read 3 Done Sent Done false
29549 8477 Acked Write 10 Done Sent Done false
29550 8478 Acked Write 2 Done Sent Done false
29551 8479 Acked Read 4 Done Sent Done false
29552 8480 Acked Write 2 Done Sent Done false
29553 8481 Acked Read 5 Done Sent Done false
29554 8482 Acked Read 1 Done Sent Done false
29555 8483 Acked Write 4 Done Sent Done false
29556 8484 Acked Read 5 Done Sent Done false
29557 8485 Acked Read 5 Done Sent Done false
29558 8486 Acked Read 3 Done Sent Done false
29559 8487 Acked Read 4 Done Sent Done false
29560 8488 Acked Flush 0 Done Sent Done false
29561 8489 Acked Write 4 Done Sent Done false
29562 8490 Acked Read 6 Done Sent Done false
29563 8491 Acked Write 6 Done Sent Done false
29564 8492 Acked Write 7 Done Sent Done false
29565 8493 Acked Read 8 Done Sent Done false
29566 8494 Acked Write 3 Done Sent Done false
29567 8495 Acked Read 1 Done Sent Done false
29568 8496 Acked Write 6 Done Sent Done false
29569 8497 Acked Write 1 Done Sent Done false
29570 8498 Acked Read 9 Done Sent Done false
29571 8499 Acked Write 3 Done Sent Done false
29572 8500 Acked Read 6 Done Sent Done false
29573 8501 Acked Read 4 Done Sent Done false
29574 8502 Acked Write 4 Done Sent Done false
29575 8503 Acked Read 9 Done Sent Done false
29576 8504 Acked Write 6 Done Sent Done false
29577 8505 Acked Read 10 Done Sent Done false
29578 8506 Acked Write 9 Done Sent Done false
29579 8507 Acked Write 7 Done Sent Done false
29580 8508 Acked Read 5 Done Sent Done false
29581 8509 Acked Read 7 Done Sent Done false
29582 8510 Acked Read 2 Done Sent Done false
29583 8511 Acked Read 4 Done Sent Done false
29584 8512 Acked Flush 0 Done Sent Done false
29585 8513 Acked Write 6 Done Sent Done false
29586 8514 Acked Write 1 Done Sent Done false
29587 8515 Acked Read 1 Done Sent Done false
29588 8516 Acked Write 8 Done Sent Done false
29589 8517 Acked Write 8 Done Sent Done false
29590 8518 Acked Flush 0 Done Sent Done false
29591 8519 Acked Read 8 Done Sent Done false
29592 8520 Acked Read 6 Done Sent Done false
29593 8521 Acked Read 9 Done Sent Done false
29594 8522 Acked Read 10 Done Sent Done false
29595 8523 Acked Read 10 Done Sent Done false
29596 8524 Acked Read 8 Done Sent Done false
29597 8525 Acked Read 9 Done Sent Done false
29598 8526 Acked Write 4 Done Sent Done false
29599 8527 Acked Write 4 Done Sent Done false
29600 8528 Acked Read 3 Done Sent Done false
29601 8529 Acked Read 3 Done Sent Done false
29602 8530 Acked Write 7 Done Sent Done false
29603 8531 Acked Flush 0 Done Sent Done false
29604 8532 Acked Read 3 Done Sent Done false
29605 8533 Acked Read 9 Done Sent Done false
29606 8534 Acked Write 1 Done Sent Done false
29607 8535 Acked Flush 0 Done Sent Done false
29608 8536 Acked Read 2 Done Sent Done false
29609 8537 Acked Read 5 Done Sent Done false
29610 8538 Acked Write 8 Done Sent Done false
29611 8539 Acked Write 2 Done Sent Done false
29612 8540 Acked Write 1 Done Sent Done false
29613 8541 Acked Read 2 Done Sent Done false
29614 8542 Acked Flush 0 Done Sent Done false
29615 8543 Acked Write 5 Done Sent Done false
29616 8544 Acked Read 10 Done Sent Done false
29617 8545 Acked Write 10 Done Sent Done false
29618 STATES DS:0 DS:1 DS:2 TOTAL
29619 Sent 0 301 0 301
29620 Done 301 0 301 602
29621 Skipped 0 0 0 0
29622 Error 0 0 0 0
29623 Last Flush: 8542 8244 8542
29624 Downstairs last five completed: 8244 8243 8242 8241 8240
29625 Upstairs last five completed: 8545 8544 8543 8542 8541
29626 CLIENT: Up:0 ds:301 act:2
29627 ----------------------------------------------------------------
29628 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:302
29629 States: Active Offline Active
29630 JOBID ACK TYPE BKS/EXT DS:0 DS:1 DS:2 REPLAY
29631 8245 Acked Read 5 Done Sent Done false
29632 8246 Acked Write 3 Done Sent Done false
29633 8247 Acked Write 1 Done Sent Done false
29634 8248 Acked Write 2 Done Sent Done false
29635 8249 Acked Flush 0 Done Sent Done false
29636 8250 Acked Write 9 Done Sent Done false
29637 8251 Acked Read 6 Done Sent Done false
29638 8252 Acked Read 3 Done Sent Done false
29639 8253 Acked Read 6 Done Sent Done false
29640 8254 Acked Write 10 Done Sent Done false
29641 8255 Acked Read 8 Done Sent Done false
29642 8256 Acked Read 9 Done Sent Done false
29643 8257 Acked Write 8 Done Sent Done false
29644 8258 Acked Write 5 Done Sent Done false
29645 8259 Acked Write 1 Done Sent Done false
29646 8260 Acked Read 6 Done Sent Done false
29647 8261 Acked Read 2 Done Sent Done false
29648 8262 Acked Write 7 Done Sent Done false
29649 8263 Acked Flush 0 Done Sent Done false
29650 8264 Acked Write 2 Done Sent Done false
29651 8265 Acked Write 4 Done Sent Done false
29652 8266 Acked Read 1 Done Sent Done false
29653 8267 Acked Flush 0 Done Sent Done false
29654 8268 Acked Read 4 Done Sent Done false
29655 8269 Acked Write 9 Done Sent Done false
29656 8270 Acked Read 5 Done Sent Done false
29657 8271 Acked Write 4 Done Sent Done false
29658 8272 Acked Read 1 Done Sent Done false
29659 8273 Acked Read 6 Done Sent Done false
29660 8274 Acked Flush 0 Done Sent Done false
29661 8275 Acked Read 7 Done Sent Done false
29662 8276 Acked Write 9 Done Sent Done false
29663 8277 Acked Read 5 Done Sent Done false
29664 8278 Acked Write 10 Done Sent Done false
29665 8279 Acked Write 10 Done Sent Done false
29666 8280 Acked Read 9 Done Sent Done false
29667 8281 Acked Write 3 Done Sent Done false
29668 8282 Acked Write 10 Done Sent Done false
29669 8283 Acked Read 7 Done Sent Done false
29670 8284 Acked Flush 0 Done Sent Done false
29671 8285 Acked Write 10 Done Sent Done false
29672 8286 Acked Read 7 Done Sent Done false
29673 8287 Acked Read 3 Done Sent Done false
29674 8288 Acked Write 4 Done Sent Done false
29675 8289 Acked Write 6 Done Sent Done false
29676 8290 Acked Read 5 Done Sent Done false
29677 8291 Acked Write 10 Done Sent Done false
29678 8292 Acked Read 1 Done Sent Done false
29679 8293 Acked Write 5 Done Sent Done false
29680 8294 Acked Read 10 Done Sent Done false
29681 8295 Acked Read 9 Done Sent Done false
29682 8296 Acked Flush 0 Done Sent Done false
29683 8297 Acked Read 8 Done Sent Done false
29684 8298 Acked Flush 0 Done Sent Done false
29685 8299 Acked Write 4 Done Sent Done false
29686 8300 Acked Flush 0 Done Sent Done false
29687 8301 Acked Write 3 Done Sent Done false
29688 8302 Acked Write 5 Done Sent Done false
29689 8303 Acked Read 10 Done Sent Done false
29690 8304 Acked Write 9 Done Sent Done false
29691 8305 Acked Write 1 Done Sent Done false
29692 8306 Acked Write 6 Done Sent Done false
29693 8307 Acked Read 3 Done Sent Done false
29694 8308 Acked Write 8 Done Sent Done false
29695 8309 Acked Write 8 Done Sent Done false
29696 8310 Acked Read 10 Done Sent Done false
29697 8311 Acked Read 7 Done Sent Done false
29698 8312 Acked Write 10 Done Sent Done false
29699 8313 Acked Write 10 Done Sent Done false
29700 8314 Acked Flush 0 Done Sent Done false
29701 8315 Acked Read 5 Done Sent Done false
29702 8316 Acked Read 9 Done Sent Done false
29703 8317 Acked Read 8 Done Sent Done false
29704 8318 Acked Write 2 Done Sent Done false
29705 8319 Acked Read 3 Done Sent Done false
29706 8320 Acked Read 7 Done Sent Done false
29707 8321 Acked Write 9 Done Sent Done false
29708 8322 Acked Read 10 Done Sent Done false
29709 8323 Acked Write 1 Done Sent Done false
29710 8324 Acked Read 2 Done Sent Done false
29711 8325 Acked Write 2 Done Sent Done false
29712 8326 Acked Write 4 Done Sent Done false
29713 8327 Acked Read 10 Done Sent Done false
29714 8328 Acked Flush 0 Done Sent Done false
29715 8329 Acked Read 7 Done Sent Done false
29716 8330 Acked Write 3 Done Sent Done false
29717 8331 Acked Write 10 Done Sent Done false
29718 8332 Acked Write 3 Done Sent Done false
29719 8333 Acked Write 3 Done Sent Done false
29720 8334 Acked Read 2 Done Sent Done false
29721 8335 Acked Read 8 Done Sent Done false
29722 8336 Acked Write 2 Done Sent Done false
29723 8337 Acked Write 5 Done Sent Done false
29724 8338 Acked Write 9 Done Sent Done false
29725 8339 Acked Read 6 Done Sent Done false
29726 8340 Acked Write 8 Done Sent Done false
29727 8341 Acked Read 2 Done Sent Done false
29728 8342 Acked Read 10 Done Sent Done false
29729 8343 Acked Read 1 Done Sent Done false
29730 8344 Acked Write 6 Done Sent Done false
29731 8345 Acked Write 5 Done Sent Done false
29732 8346 Acked Write 3 Done Sent Done false
29733 8347 Acked Flush 0 Done Sent Done false
29734 8348 Acked Write 4 Done Sent Done false
29735 8349 Acked Write 4 Done Sent Done false
29736 8350 Acked Read 5 Done Sent Done false
29737 8351 Acked Write 9 Done Sent Done false
29738 8352 Acked Read 10 Done Sent Done false
29739 8353 Acked Write 6 Done Sent Done false
29740 8354 Acked Write 4 Done Sent Done false
29741 8355 Acked Read 7 Done Sent Done false
29742 8356 Acked Write 5 Done Sent Done false
29743 8357 Acked Write 7 Done Sent Done false
29744 8358 Acked Write 1 Done Sent Done false
29745 8359 Acked Read 3 Done Sent Done false
29746 8360 Acked Flush 0 Done Sent Done false
29747 8361 Acked Read 6 Done Sent Done false
29748 8362 Acked Read 10 Done Sent Done false
29749 8363 Acked Read 3 Done Sent Done false
29750 8364 Acked Flush 0 Done Sent Done false
29751 8365 Acked Read 6 Done Sent Done false
29752 8366 Acked Write 3 Done Sent Done false
29753 8367 Acked Write 10 Done Sent Done false
29754 8368 Acked Write 8 Done Sent Done false
29755 8369 Acked Read 10 Done Sent Done false
29756 8370 Acked Read 2 Done Sent Done false
29757 8371 Acked Write 8 Done Sent Done false
29758 8372 Acked Write 9 Done Sent Done false
29759 8373 Acked Read 3 Done Sent Done false
29760 8374 Acked Read 4 Done Sent Done false
29761 8375 Acked Read 6 Done Sent Done false
29762 8376 Acked Read 2 Done Sent Done false
29763 8377 Acked Write 1 Done Sent Done false
29764 8378 Acked Flush 0 Done Sent Done false
29765 8379 Acked Write 7 Done Sent Done false
29766 8380 Acked Read 7 Done Sent Done false
29767 8381 Acked Read 5 Done Sent Done false
29768 8382 Acked Read 5 Done Sent Done false
29769 8383 Acked Read 6 Done Sent Done false
29770 8384 Acked Read 6 Done Sent Done false
29771 8385 Acked Read 8 Done Sent Done false
29772 8386 Acked Read 9 Done Sent Done false
29773 8387 Acked Write 8 Done Sent Done false
29774 8388 Acked Read 1 Done Sent Done false
29775 8389 Acked Write 3 Done Sent Done false
29776 8390 Acked Read 4 Done Sent Done false
29777 8391 Acked Write 3 Done Sent Done false
29778 8392 Acked Flush 0 Done Sent Done false
29779 8393 Acked Read 7 Done Sent Done false
29780 8394 Acked Read 3 Done Sent Done false
29781 8395 Acked Write 5 Done Sent Done false
29782 8396 Acked Read 7 Done Sent Done false
29783 8397 Acked Read 1 Done Sent Done false
29784 8398 Acked Write 3 Done Sent Done false
29785 8399 Acked Flush 0 Done Sent Done false
29786 8400 Acked Read 10 Done Sent Done false
29787 8401 Acked Write 2 Done Sent Done false
29788 8402 Acked Flush 0 Done Sent Done false
29789 8403 Acked Read 4 Done Sent Done false
29790 8404 Acked Read 5 Done Sent Done false
29791 8405 Acked Write 4 Done Sent Done false
29792 8406 Acked Write 10 Done Sent Done false
29793 8407 Acked Write 1 Done Sent Done false
29794 8408 Acked Read 6 Done Sent Done false
29795 8409 Acked Write 4 Done Sent Done false
29796 8410 Acked Read 9 Done Sent Done false
29797 8411 Acked Write 10 Done Sent Done false
29798 8412 Acked Read 9 Done Sent Done false
29799 8413 Acked Read 7 Done Sent Done false
29800 8414 Acked Write 8 Done Sent Done false
29801 8415 Acked Read 10 Done Sent Done false
29802 8416 Acked Write 6 Done Sent Done false
29803 8417 Acked Read 4 Done Sent Done false
29804 8418 Acked Read 5 Done Sent Done false
29805 8419 Acked Read 7 Done Sent Done false
29806 8420 Acked Read 3 Done Sent Done false
29807 8421 Acked Read 5 Done Sent Done false
29808 8422 Acked Read 9 Done Sent Done false
29809 8423 Acked Write 10 Done Sent Done false
29810 8424 Acked Read 8 Done Sent Done false
29811 8425 Acked Read 10 Done Sent Done false
29812 8426 Acked Write 7 Done Sent Done false
29813 8427 Acked Read 6 Done Sent Done false
29814 8428 Acked Read 1 Done Sent Done false
29815 8429 Acked Flush 0 Done Sent Done false
29816 8430 Acked Read 8 Done Sent Done false
29817 8431 Acked Read 2 Done Sent Done false
29818 8432 Acked Flush 0 Done Sent Done false
29819 8433 Acked Write 10 Done Sent Done false
29820 8434 Acked Read 9 Done Sent Done false
29821 8435 Acked Read 6 Done Sent Done false
29822 8436 Acked Read 2 Done Sent Done false
29823 8437 Acked Read 9 Done Sent Done false
29824 8438 Acked Read 2 Done Sent Done false
29825 8439 Acked Read 7 Done Sent Done false
29826 8440 Acked Flush 0 Done Sent Done false
29827 8441 Acked Read 6 Done Sent Done false
29828 8442 Acked Read 4 Done Sent Done false
29829 8443 Acked Write 3 Done Sent Done false
29830 8444 Acked Read 1 Done Sent Done false
29831 8445 Acked Write 5 Done Sent Done false
29832 8446 Acked Write 9 Done Sent Done false
29833 8447 Acked Read 9 Done Sent Done false
29834 8448 Acked Read 4 Done Sent Done false
29835 8449 Acked Write 6 Done Sent Done false
29836 8450 Acked Write 3 Done Sent Done false
29837 8451 Acked Read 9 Done Sent Done false
29838 8452 Acked Write 6 Done Sent Done false
29839 8453 Acked Write 6 Done Sent Done false
29840 8454 Acked Read 10 Done Sent Done false
29841 8455 Acked Read 4 Done Sent Done false
29842 8456 Acked Write 2 Done Sent Done false
29843 8457 Acked Write 9 Done Sent Done false
29844 8458 Acked Write 9 Done Sent Done false
29845 8459 Acked Read 4 Done Sent Done false
29846 8460 Acked Read 10 Done Sent Done false
29847 8461 Acked Read 10 Done Sent Done false
29848 8462 Acked Flush 0 Done Sent Done false
29849 8463 Acked Write 8 Done Sent Done false
29850 8464 Acked Write 4 Done Sent Done false
29851 8465 Acked Write 2 Done Sent Done false
29852 8466 Acked Read 5 Done Sent Done false
29853 8467 Acked Read 6 Done Sent Done false
29854 8468 Acked Read 7 Done Sent Done false
29855 8469 Acked Read 5 Done Sent Done false
29856 8470 Acked Flush 0 Done Sent Done false
29857 8471 Acked Write 1 Done Sent Done false
29858 8472 Acked Write 4 Done Sent Done false
29859 8473 Acked Read 4 Done Sent Done false
29860 8474 Acked Write 9 Done Sent Done false
29861 8475 Acked Write 9 Done Sent Done false
29862 8476 Acked Read 3 Done Sent Done false
29863 8477 Acked Write 10 Done Sent Done false
29864 8478 Acked Write 2 Done Sent Done false
29865 8479 Acked Read 4 Done Sent Done false
29866 8480 Acked Write 2 Done Sent Done false
29867 8481 Acked Read 5 Done Sent Done false
29868 8482 Acked Read 1 Done Sent Done false
29869 8483 Acked Write 4 Done Sent Done false
29870 8484 Acked Read 5 Done Sent Done false
29871 8485 Acked Read 5 Done Sent Done false
29872 8486 Acked Read 3 Done Sent Done false
29873 8487 Acked Read 4 Done Sent Done false
29874 8488 Acked Flush 0 Done Sent Done false
29875 8489 Acked Write 4 Done Sent Done false
29876 8490 Acked Read 6 Done Sent Done false
29877 8491 Acked Write 6 Done Sent Done false
29878 8492 Acked Write 7 Done Sent Done false
29879 8493 Acked Read 8 Done Sent Done false
29880 8494 Acked Write 3 Done Sent Done false
29881 8495 Acked Read 1 Done Sent Done false
29882 8496 Acked Write 6 Done Sent Done false
29883 8497 Acked Write 1 Done Sent Done false
29884 8498 Acked Read 9 Done Sent Done false
29885 8499 Acked Write 3 Done Sent Done false
29886 8500 Acked Read 6 Done Sent Done false
29887 8501 Acked Read 4 Done Sent Done false
29888 8502 Acked Write 4 Done Sent Done false
29889 8503 Acked Read 9 Done Sent Done false
29890 8504 Acked Write 6 Done Sent Done false
29891 8505 Acked Read 10 Done Sent Done false
29892 8506 Acked Write 9 Done Sent Done false
29893 8507 Acked Write 7 Done Sent Done false
29894 8508 Acked Read 5 Done Sent Done false
29895 8509 Acked Read 7 Done Sent Done false
29896 8510 Acked Read 2 Done Sent Done false
29897 8511 Acked Read 4 Done Sent Done false
29898 8512 Acked Flush 0 Done Sent Done false
29899 8513 Acked Write 6 Done Sent Done false
29900 8514 Acked Write 1 Done Sent Done false
29901 8515 Acked Read 1 Done Sent Done false
29902 8516 Acked Write 8 Done Sent Done false
29903 8517 Acked Write 8 Done Sent Done false
29904 8518 Acked Flush 0 Done Sent Done false
29905 8519 Acked Read 8 Done Sent Done false
29906 8520 Acked Read 6 Done Sent Done false
29907 8521 Acked Read 9 Done Sent Done false
29908 8522 Acked Read 10 Done Sent Done false
29909 8523 Acked Read 10 Done Sent Done false
29910 8524 Acked Read 8 Done Sent Done false
29911 8525 Acked Read 9 Done Sent Done false
29912 8526 Acked Write 4 Done Sent Done false
29913 8527 Acked Write 4 Done Sent Done false
29914 8528 Acked Read 3 Done Sent Done false
29915 8529 Acked Read 3 Done Sent Done false
29916 8530 Acked Write 7 Done Sent Done false
29917 8531 Acked Flush 0 Done Sent Done false
29918 8532 Acked Read 3 Done Sent Done false
29919 8533 Acked Read 9 Done Sent Done false
29920 8534 Acked Write 1 Done Sent Done false
29921 8535 Acked Flush 0 Done Sent Done false
29922 8536 Acked Read 2 Done Sent Done false
29923 8537 Acked Read 5 Done Sent Done false
29924 8538 Acked Write 8 Done Sent Done false
29925 8539 Acked Write 2 Done Sent Done false
29926 8540 Acked Write 1 Done Sent Done false
29927 8541 Acked Read 2 Done Sent Done false
29928 8542 Acked Flush 0 Done Sent Done false
29929 8543 Acked Write 5 Done Sent Done false
29930 8544 Acked Read 10 Done Sent Done false
29931 8545 Acked Write 10 Done Sent Done false
29932 8546 Acked Flush 0 Done Sent Done false
29933 STATES DS:0 DS:1 DS:2 TOTAL
29934 Sent 0 302 0 302
29935 Done 302 0 302 604
29936 Skipped 0 0 0 0
29937 Error 0 0 0 0
29938 Last Flush: 8546 8244 8546
29939 Downstairs last five completed: 8244 8243 8242 8241 8240
29940 Upstairs last five completed: 8546 8545 8544 8543 8542
29941 CLIENT: Up:0 ds:302 act:2
299422025-01-10T16:41:35.635ZINFOcrucible: connecting to 127.0.0.1:8820 = io task client = 1 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
299432025-01-10T16:41:35.635ZWARNcrucible: ds_connection connect to 127.0.0.1:8820 failure: Os { code: 146, kind: ConnectionRefused, message: "Connection refused" } = io task client = 1 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
299442025-01-10T16:41:35.635ZWARNcrucible: client task is sending Done(ConnectionFailed(Os { code: 146, kind: ConnectionRefused, message: "Connection refused" })) = io task client = 1 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
299452025-01-10T16:41:35.635ZWARNcrucible: downstairs task for 1 stopped due to ConnectionFailed(Os { code: 146, kind: ConnectionRefused, message: "Connection refused" }) session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
299462025-01-10T16:41:35.635ZINFOcrucible: client task is exiting = io task client = 1 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
29947 [8820] got start action
29948 [8820] I am going to restart
29949 Starting downstairs at port 8820
29950 Make output file at "/tmp/dsc/downstairs-8820.txt"
29951 [8820][1] reports Starting
29952 Downstairs /var/tmp/dsc/region/8820 port 8820 PID:Some(1227)
29953 [8820][1] reports Running
29954 ----------------------------------------------------------------
29955 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:302
29956 States: Active Offline Active
29957 JOBID ACK TYPE BKS/EXT DS:0 DS:1 DS:2 REPLAY
29958 8245 Acked Read 5 Done Sent Done false
29959 8246 Acked Write 3 Done Sent Done false
29960 8247 Acked Write 1 Done Sent Done false
29961 8248 Acked Write 2 Done Sent Done false
29962 8249 Acked Flush 0 Done Sent Done false
29963 8250 Acked Write 9 Done Sent Done false
29964 8251 Acked Read 6 Done Sent Done false
29965 8252 Acked Read 3 Done Sent Done false
29966 8253 Acked Read 6 Done Sent Done false
29967 8254 Acked Write 10 Done Sent Done false
29968 8255 Acked Read 8 Done Sent Done false
29969 8256 Acked Read 9 Done Sent Done false
29970 8257 Acked Write 8 Done Sent Done false
29971 8258 Acked Write 5 Done Sent Done false
29972 8259 Acked Write 1 Done Sent Done false
29973 8260 Acked Read 6 Done Sent Done false
29974 8261 Acked Read 2 Done Sent Done false
29975 8262 Acked Write 7 Done Sent Done false
29976 8263 Acked Flush 0 Done Sent Done false
29977 8264 Acked Write 2 Done Sent Done false
29978 8265 Acked Write 4 Done Sent Done false
29979 8266 Acked Read 1 Done Sent Done false
29980 8267 Acked Flush 0 Done Sent Done false
29981 8268 Acked Read 4 Done Sent Done false
29982 8269 Acked Write 9 Done Sent Done false
29983 8270 Acked Read 5 Done Sent Done false
29984 8271 Acked Write 4 Done Sent Done false
29985 8272 Acked Read 1 Done Sent Done false
29986 8273 Acked Read 6 Done Sent Done false
29987 8274 Acked Flush 0 Done Sent Done false
29988 8275 Acked Read 7 Done Sent Done false
29989 8276 Acked Write 9 Done Sent Done false
29990 8277 Acked Read 5 Done Sent Done false
29991 8278 Acked Write 10 Done Sent Done false
29992 8279 Acked Write 10 Done Sent Done false
29993 8280 Acked Read 9 Done Sent Done false
29994 8281 Acked Write 3 Done Sent Done false
29995 8282 Acked Write 10 Done Sent Done false
29996 8283 Acked Read 7 Done Sent Done false
29997 8284 Acked Flush 0 Done Sent Done false
29998 8285 Acked Write 10 Done Sent Done false
29999 8286 Acked Read 7 Done Sent Done false
30000 8287 Acked Read 3 Done Sent Done false
30001 8288 Acked Write 4 Done Sent Done false
30002 8289 Acked Write 6 Done Sent Done false
30003 8290 Acked Read 5 Done Sent Done false
30004 8291 Acked Write 10 Done Sent Done false
30005 8292 Acked Read 1 Done Sent Done false
30006 8293 Acked Write 5 Done Sent Done false
30007 8294 Acked Read 10 Done Sent Done false
30008 8295 Acked Read 9 Done Sent Done false
30009 8296 Acked Flush 0 Done Sent Done false
30010 8297 Acked Read 8 Done Sent Done false
30011 8298 Acked Flush 0 Done Sent Done false
30012 8299 Acked Write 4 Done Sent Done false
30013 8300 Acked Flush 0 Done Sent Done false
30014 8301 Acked Write 3 Done Sent Done false
30015 8302 Acked Write 5 Done Sent Done false
30016 8303 Acked Read 10 Done Sent Done false
30017 8304 Acked Write 9 Done Sent Done false
30018 8305 Acked Write 1 Done Sent Done false
30019 8306 Acked Write 6 Done Sent Done false
30020 8307 Acked Read 3 Done Sent Done false
30021 8308 Acked Write 8 Done Sent Done false
30022 8309 Acked Write 8 Done Sent Done false
30023 8310 Acked Read 10 Done Sent Done false
30024 8311 Acked Read 7 Done Sent Done false
30025 8312 Acked Write 10 Done Sent Done false
30026 8313 Acked Write 10 Done Sent Done false
30027 8314 Acked Flush 0 Done Sent Done false
30028 8315 Acked Read 5 Done Sent Done false
30029 8316 Acked Read 9 Done Sent Done false
30030 8317 Acked Read 8 Done Sent Done false
30031 8318 Acked Write 2 Done Sent Done false
30032 8319 Acked Read 3 Done Sent Done false
30033 8320 Acked Read 7 Done Sent Done false
30034 8321 Acked Write 9 Done Sent Done false
30035 8322 Acked Read 10 Done Sent Done false
30036 8323 Acked Write 1 Done Sent Done false
30037 8324 Acked Read 2 Done Sent Done false
30038 8325 Acked Write 2 Done Sent Done false
30039 8326 Acked Write 4 Done Sent Done false
30040 8327 Acked Read 10 Done Sent Done false
30041 8328 Acked Flush 0 Done Sent Done false
30042 8329 Acked Read 7 Done Sent Done false
30043 8330 Acked Write 3 Done Sent Done false
30044 8331 Acked Write 10 Done Sent Done false
30045 8332 Acked Write 3 Done Sent Done false
30046 8333 Acked Write 3 Done Sent Done false
30047 8334 Acked Read 2 Done Sent Done false
30048 8335 Acked Read 8 Done Sent Done false
30049 8336 Acked Write 2 Done Sent Done false
30050 8337 Acked Write 5 Done Sent Done false
30051 8338 Acked Write 9 Done Sent Done false
30052 8339 Acked Read 6 Done Sent Done false
30053 8340 Acked Write 8 Done Sent Done false
30054 8341 Acked Read 2 Done Sent Done false
30055 8342 Acked Read 10 Done Sent Done false
30056 8343 Acked Read 1 Done Sent Done false
30057 8344 Acked Write 6 Done Sent Done false
30058 8345 Acked Write 5 Done Sent Done false
30059 8346 Acked Write 3 Done Sent Done false
30060 8347 Acked Flush 0 Done Sent Done false
30061 8348 Acked Write 4 Done Sent Done false
30062 8349 Acked Write 4 Done Sent Done false
30063 8350 Acked Read 5 Done Sent Done false
30064 8351 Acked Write 9 Done Sent Done false
30065 8352 Acked Read 10 Done Sent Done false
30066 8353 Acked Write 6 Done Sent Done false
30067 8354 Acked Write 4 Done Sent Done false
30068 8355 Acked Read 7 Done Sent Done false
30069 8356 Acked Write 5 Done Sent Done false
30070 8357 Acked Write 7 Done Sent Done false
30071 8358 Acked Write 1 Done Sent Done false
30072 8359 Acked Read 3 Done Sent Done false
30073 8360 Acked Flush 0 Done Sent Done false
30074 8361 Acked Read 6 Done Sent Done false
30075 8362 Acked Read 10 Done Sent Done false
30076 8363 Acked Read 3 Done Sent Done false
30077 8364 Acked Flush 0 Done Sent Done false
30078 8365 Acked Read 6 Done Sent Done false
30079 8366 Acked Write 3 Done Sent Done false
30080 8367 Acked Write 10 Done Sent Done false
30081 8368 Acked Write 8 Done Sent Done false
30082 8369 Acked Read 10 Done Sent Done false
30083 8370 Acked Read 2 Done Sent Done false
30084 8371 Acked Write 8 Done Sent Done false
30085 8372 Acked Write 9 Done Sent Done false
30086 8373 Acked Read 3 Done Sent Done false
30087 8374 Acked Read 4 Done Sent Done false
30088 8375 Acked Read 6 Done Sent Done false
30089 8376 Acked Read 2 Done Sent Done false
30090 8377 Acked Write 1 Done Sent Done false
30091 8378 Acked Flush 0 Done Sent Done false
30092 8379 Acked Write 7 Done Sent Done false
30093 8380 Acked Read 7 Done Sent Done false
30094 8381 Acked Read 5 Done Sent Done false
30095 8382 Acked Read 5 Done Sent Done false
30096 8383 Acked Read 6 Done Sent Done false
30097 8384 Acked Read 6 Done Sent Done false
30098 8385 Acked Read 8 Done Sent Done false
30099 8386 Acked Read 9 Done Sent Done false
30100 8387 Acked Write 8 Done Sent Done false
30101 8388 Acked Read 1 Done Sent Done false
30102 8389 Acked Write 3 Done Sent Done false
30103 8390 Acked Read 4 Done Sent Done false
30104 8391 Acked Write 3 Done Sent Done false
30105 8392 Acked Flush 0 Done Sent Done false
30106 8393 Acked Read 7 Done Sent Done false
30107 8394 Acked Read 3 Done Sent Done false
30108 8395 Acked Write 5 Done Sent Done false
30109 8396 Acked Read 7 Done Sent Done false
30110 8397 Acked Read 1 Done Sent Done false
30111 8398 Acked Write 3 Done Sent Done false
30112 8399 Acked Flush 0 Done Sent Done false
30113 8400 Acked Read 10 Done Sent Done false
30114 8401 Acked Write 2 Done Sent Done false
30115 8402 Acked Flush 0 Done Sent Done false
30116 8403 Acked Read 4 Done Sent Done false
30117 8404 Acked Read 5 Done Sent Done false
30118 8405 Acked Write 4 Done Sent Done false
30119 8406 Acked Write 10 Done Sent Done false
30120 8407 Acked Write 1 Done Sent Done false
30121 8408 Acked Read 6 Done Sent Done false
30122 8409 Acked Write 4 Done Sent Done false
30123 8410 Acked Read 9 Done Sent Done false
30124 8411 Acked Write 10 Done Sent Done false
30125 8412 Acked Read 9 Done Sent Done false
30126 8413 Acked Read 7 Done Sent Done false
30127 8414 Acked Write 8 Done Sent Done false
30128 8415 Acked Read 10 Done Sent Done false
30129 8416 Acked Write 6 Done Sent Done false
30130 8417 Acked Read 4 Done Sent Done false
30131 8418 Acked Read 5 Done Sent Done false
30132 8419 Acked Read 7 Done Sent Done false
30133 8420 Acked Read 3 Done Sent Done false
30134 8421 Acked Read 5 Done Sent Done false
30135 8422 Acked Read 9 Done Sent Done false
30136 8423 Acked Write 10 Done Sent Done false
30137 8424 Acked Read 8 Done Sent Done false
30138 8425 Acked Read 10 Done Sent Done false
30139 8426 Acked Write 7 Done Sent Done false
30140 8427 Acked Read 6 Done Sent Done false
30141 8428 Acked Read 1 Done Sent Done false
30142 8429 Acked Flush 0 Done Sent Done false
30143 8430 Acked Read 8 Done Sent Done false
30144 8431 Acked Read 2 Done Sent Done false
30145 8432 Acked Flush 0 Done Sent Done false
30146 8433 Acked Write 10 Done Sent Done false
30147 8434 Acked Read 9 Done Sent Done false
30148 8435 Acked Read 6 Done Sent Done false
30149 8436 Acked Read 2 Done Sent Done false
30150 8437 Acked Read 9 Done Sent Done false
30151 8438 Acked Read 2 Done Sent Done false
30152 8439 Acked Read 7 Done Sent Done false
30153 8440 Acked Flush 0 Done Sent Done false
30154 8441 Acked Read 6 Done Sent Done false
30155 8442 Acked Read 4 Done Sent Done false
30156 8443 Acked Write 3 Done Sent Done false
30157 8444 Acked Read 1 Done Sent Done false
30158 8445 Acked Write 5 Done Sent Done false
30159 8446 Acked Write 9 Done Sent Done false
30160 8447 Acked Read 9 Done Sent Done false
30161 8448 Acked Read 4 Done Sent Done false
30162 8449 Acked Write 6 Done Sent Done false
30163 8450 Acked Write 3 Done Sent Done false
30164 8451 Acked Read 9 Done Sent Done false
30165 8452 Acked Write 6 Done Sent Done false
30166 8453 Acked Write 6 Done Sent Done false
30167 8454 Acked Read 10 Done Sent Done false
30168 8455 Acked Read 4 Done Sent Done false
30169 8456 Acked Write 2 Done Sent Done false
30170 8457 Acked Write 9 Done Sent Done false
30171 8458 Acked Write 9 Done Sent Done false
30172 8459 Acked Read 4 Done Sent Done false
30173 8460 Acked Read 10 Done Sent Done false
30174 8461 Acked Read 10 Done Sent Done false
30175 8462 Acked Flush 0 Done Sent Done false
30176 8463 Acked Write 8 Done Sent Done false
30177 8464 Acked Write 4 Done Sent Done false
30178 8465 Acked Write 2 Done Sent Done false
30179 8466 Acked Read 5 Done Sent Done false
30180 8467 Acked Read 6 Done Sent Done false
30181 8468 Acked Read 7 Done Sent Done false
30182 8469 Acked Read 5 Done Sent Done false
30183 8470 Acked Flush 0 Done Sent Done false
30184 8471 Acked Write 1 Done Sent Done false
30185 8472 Acked Write 4 Done Sent Done false
30186 8473 Acked Read 4 Done Sent Done false
30187 8474 Acked Write 9 Done Sent Done false
30188 8475 Acked Write 9 Done Sent Done false
30189 8476 Acked Read 3 Done Sent Done false
30190 8477 Acked Write 10 Done Sent Done false
30191 8478 Acked Write 2 Done Sent Done false
30192 8479 Acked Read 4 Done Sent Done false
30193 8480 Acked Write 2 Done Sent Done false
30194 8481 Acked Read 5 Done Sent Done false
30195 8482 Acked Read 1 Done Sent Done false
30196 8483 Acked Write 4 Done Sent Done false
30197 8484 Acked Read 5 Done Sent Done false
30198 8485 Acked Read 5 Done Sent Done false
30199 8486 Acked Read 3 Done Sent Done false
30200 8487 Acked Read 4 Done Sent Done false
30201 8488 Acked Flush 0 Done Sent Done false
30202 8489 Acked Write 4 Done Sent Done false
30203 8490 Acked Read 6 Done Sent Done false
30204 8491 Acked Write 6 Done Sent Done false
30205 8492 Acked Write 7 Done Sent Done false
30206 8493 Acked Read 8 Done Sent Done false
30207 8494 Acked Write 3 Done Sent Done false
30208 8495 Acked Read 1 Done Sent Done false
30209 8496 Acked Write 6 Done Sent Done false
30210 8497 Acked Write 1 Done Sent Done false
30211 8498 Acked Read 9 Done Sent Done false
30212 8499 Acked Write 3 Done Sent Done false
30213 8500 Acked Read 6 Done Sent Done false
30214 8501 Acked Read 4 Done Sent Done false
30215 8502 Acked Write 4 Done Sent Done false
30216 8503 Acked Read 9 Done Sent Done false
30217 8504 Acked Write 6 Done Sent Done false
30218 8505 Acked Read 10 Done Sent Done false
30219 8506 Acked Write 9 Done Sent Done false
30220 8507 Acked Write 7 Done Sent Done false
30221 8508 Acked Read 5 Done Sent Done false
30222 8509 Acked Read 7 Done Sent Done false
30223 8510 Acked Read 2 Done Sent Done false
30224 8511 Acked Read 4 Done Sent Done false
30225 8512 Acked Flush 0 Done Sent Done false
30226 8513 Acked Write 6 Done Sent Done false
30227 8514 Acked Write 1 Done Sent Done false
30228 8515 Acked Read 1 Done Sent Done false
30229 8516 Acked Write 8 Done Sent Done false
30230 8517 Acked Write 8 Done Sent Done false
30231 8518 Acked Flush 0 Done Sent Done false
30232 8519 Acked Read 8 Done Sent Done false
30233 8520 Acked Read 6 Done Sent Done false
30234 8521 Acked Read 9 Done Sent Done false
30235 8522 Acked Read 10 Done Sent Done false
30236 8523 Acked Read 10 Done Sent Done false
30237 8524 Acked Read 8 Done Sent Done false
30238 8525 Acked Read 9 Done Sent Done false
30239 8526 Acked Write 4 Done Sent Done false
30240 8527 Acked Write 4 Done Sent Done false
30241 8528 Acked Read 3 Done Sent Done false
30242 8529 Acked Read 3 Done Sent Done false
30243 8530 Acked Write 7 Done Sent Done false
30244 8531 Acked Flush 0 Done Sent Done false
30245 8532 Acked Read 3 Done Sent Done false
30246 8533 Acked Read 9 Done Sent Done false
30247 8534 Acked Write 1 Done Sent Done false
30248 8535 Acked Flush 0 Done Sent Done false
30249 8536 Acked Read 2 Done Sent Done false
30250 8537 Acked Read 5 Done Sent Done false
30251 8538 Acked Write 8 Done Sent Done false
30252 8539 Acked Write 2 Done Sent Done false
30253 8540 Acked Write 1 Done Sent Done false
30254 8541 Acked Read 2 Done Sent Done false
30255 8542 Acked Flush 0 Done Sent Done false
30256 8543 Acked Write 5 Done Sent Done false
30257 8544 Acked Read 10 Done Sent Done false
30258 8545 Acked Write 10 Done Sent Done false
30259 8546 Acked Flush 0 Done Sent Done false
30260 STATES DS:0 DS:1 DS:2 TOTAL
30261 Sent 0 302 0 302
30262 Done 302 0 302 604
30263 Skipped 0 0 0 0
30264 Error 0 0 0 0
30265 Last Flush: 8546 8244 8546
30266 Downstairs last five completed: 8244 8243 8242 8241 8240
30267 Upstairs last five completed: 8546 8545 8544 8543 8542
30268 CLIENT: Up:0 ds:302 act:2
30269 ----------------------------------------------------------------
30270 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:302
30271 States: Active Offline Active
30272 JOBID ACK TYPE BKS/EXT DS:0 DS:1 DS:2 REPLAY
30273 8245 Acked Read 5 Done Sent Done false
30274 8246 Acked Write 3 Done Sent Done false
30275 8247 Acked Write 1 Done Sent Done false
30276 8248 Acked Write 2 Done Sent Done false
30277 8249 Acked Flush 0 Done Sent Done false
30278 8250 Acked Write 9 Done Sent Done false
30279 8251 Acked Read 6 Done Sent Done false
30280 8252 Acked Read 3 Done Sent Done false
30281 8253 Acked Read 6 Done Sent Done false
30282 8254 Acked Write 10 Done Sent Done false
30283 8255 Acked Read 8 Done Sent Done false
30284 8256 Acked Read 9 Done Sent Done false
30285 8257 Acked Write 8 Done Sent Done false
30286 8258 Acked Write 5 Done Sent Done false
30287 8259 Acked Write 1 Done Sent Done false
30288 8260 Acked Read 6 Done Sent Done false
30289 8261 Acked Read 2 Done Sent Done false
30290 8262 Acked Write 7 Done Sent Done false
30291 8263 Acked Flush 0 Done Sent Done false
30292 8264 Acked Write 2 Done Sent Done false
30293 8265 Acked Write 4 Done Sent Done false
30294 8266 Acked Read 1 Done Sent Done false
30295 8267 Acked Flush 0 Done Sent Done false
30296 8268 Acked Read 4 Done Sent Done false
30297 8269 Acked Write 9 Done Sent Done false
30298 8270 Acked Read 5 Done Sent Done false
30299 8271 Acked Write 4 Done Sent Done false
30300 8272 Acked Read 1 Done Sent Done false
30301 8273 Acked Read 6 Done Sent Done false
30302 8274 Acked Flush 0 Done Sent Done false
30303 8275 Acked Read 7 Done Sent Done false
30304 8276 Acked Write 9 Done Sent Done false
30305 8277 Acked Read 5 Done Sent Done false
30306 8278 Acked Write 10 Done Sent Done false
30307 8279 Acked Write 10 Done Sent Done false
30308 8280 Acked Read 9 Done Sent Done false
30309 8281 Acked Write 3 Done Sent Done false
30310 8282 Acked Write 10 Done Sent Done false
30311 8283 Acked Read 7 Done Sent Done false
30312 8284 Acked Flush 0 Done Sent Done false
30313 8285 Acked Write 10 Done Sent Done false
30314 8286 Acked Read 7 Done Sent Done false
30315 8287 Acked Read 3 Done Sent Done false
30316 8288 Acked Write 4 Done Sent Done false
30317 8289 Acked Write 6 Done Sent Done false
30318 8290 Acked Read 5 Done Sent Done false
30319 8291 Acked Write 10 Done Sent Done false
30320 8292 Acked Read 1 Done Sent Done false
30321 8293 Acked Write 5 Done Sent Done false
30322 8294 Acked Read 10 Done Sent Done false
30323 8295 Acked Read 9 Done Sent Done false
30324 8296 Acked Flush 0 Done Sent Done false
30325 8297 Acked Read 8 Done Sent Done false
30326 8298 Acked Flush 0 Done Sent Done false
30327 8299 Acked Write 4 Done Sent Done false
30328 8300 Acked Flush 0 Done Sent Done false
30329 8301 Acked Write 3 Done Sent Done false
30330 8302 Acked Write 5 Done Sent Done false
30331 8303 Acked Read 10 Done Sent Done false
30332 8304 Acked Write 9 Done Sent Done false
30333 8305 Acked Write 1 Done Sent Done false
30334 8306 Acked Write 6 Done Sent Done false
30335 8307 Acked Read 3 Done Sent Done false
30336 8308 Acked Write 8 Done Sent Done false
30337 8309 Acked Write 8 Done Sent Done false
30338 8310 Acked Read 10 Done Sent Done false
30339 8311 Acked Read 7 Done Sent Done false
30340 8312 Acked Write 10 Done Sent Done false
30341 8313 Acked Write 10 Done Sent Done false
30342 8314 Acked Flush 0 Done Sent Done false
30343 8315 Acked Read 5 Done Sent Done false
30344 8316 Acked Read 9 Done Sent Done false
30345 8317 Acked Read 8 Done Sent Done false
30346 8318 Acked Write 2 Done Sent Done false
30347 8319 Acked Read 3 Done Sent Done false
30348 8320 Acked Read 7 Done Sent Done false
30349 8321 Acked Write 9 Done Sent Done false
30350 8322 Acked Read 10 Done Sent Done false
30351 8323 Acked Write 1 Done Sent Done false
30352 8324 Acked Read 2 Done Sent Done false
30353 8325 Acked Write 2 Done Sent Done false
30354 8326 Acked Write 4 Done Sent Done false
30355 8327 Acked Read 10 Done Sent Done false
30356 8328 Acked Flush 0 Done Sent Done false
30357 8329 Acked Read 7 Done Sent Done false
30358 8330 Acked Write 3 Done Sent Done false
30359 8331 Acked Write 10 Done Sent Done false
30360 8332 Acked Write 3 Done Sent Done false
30361 8333 Acked Write 3 Done Sent Done false
30362 8334 Acked Read 2 Done Sent Done false
30363 8335 Acked Read 8 Done Sent Done false
30364 8336 Acked Write 2 Done Sent Done false
30365 8337 Acked Write 5 Done Sent Done false
30366 8338 Acked Write 9 Done Sent Done false
30367 8339 Acked Read 6 Done Sent Done false
30368 8340 Acked Write 8 Done Sent Done false
30369 8341 Acked Read 2 Done Sent Done false
30370 8342 Acked Read 10 Done Sent Done false
30371 8343 Acked Read 1 Done Sent Done false
30372 8344 Acked Write 6 Done Sent Done false
30373 8345 Acked Write 5 Done Sent Done false
30374 8346 Acked Write 3 Done Sent Done false
30375 8347 Acked Flush 0 Done Sent Done false
30376 8348 Acked Write 4 Done Sent Done false
30377 8349 Acked Write 4 Done Sent Done false
30378 8350 Acked Read 5 Done Sent Done false
30379 8351 Acked Write 9 Done Sent Done false
30380 8352 Acked Read 10 Done Sent Done false
30381 8353 Acked Write 6 Done Sent Done false
30382 8354 Acked Write 4 Done Sent Done false
30383 8355 Acked Read 7 Done Sent Done false
30384 8356 Acked Write 5 Done Sent Done false
30385 8357 Acked Write 7 Done Sent Done false
30386 8358 Acked Write 1 Done Sent Done false
30387 8359 Acked Read 3 Done Sent Done false
30388 8360 Acked Flush 0 Done Sent Done false
30389 8361 Acked Read 6 Done Sent Done false
30390 8362 Acked Read 10 Done Sent Done false
30391 8363 Acked Read 3 Done Sent Done false
30392 8364 Acked Flush 0 Done Sent Done false
30393 8365 Acked Read 6 Done Sent Done false
30394 8366 Acked Write 3 Done Sent Done false
30395 8367 Acked Write 10 Done Sent Done false
30396 8368 Acked Write 8 Done Sent Done false
30397 8369 Acked Read 10 Done Sent Done false
30398 8370 Acked Read 2 Done Sent Done false
30399 8371 Acked Write 8 Done Sent Done false
30400 8372 Acked Write 9 Done Sent Done false
30401 8373 Acked Read 3 Done Sent Done false
30402 8374 Acked Read 4 Done Sent Done false
30403 8375 Acked Read 6 Done Sent Done false
30404 8376 Acked Read 2 Done Sent Done false
30405 8377 Acked Write 1 Done Sent Done false
30406 8378 Acked Flush 0 Done Sent Done false
30407 8379 Acked Write 7 Done Sent Done false
30408 8380 Acked Read 7 Done Sent Done false
30409 8381 Acked Read 5 Done Sent Done false
30410 8382 Acked Read 5 Done Sent Done false
30411 8383 Acked Read 6 Done Sent Done false
30412 8384 Acked Read 6 Done Sent Done false
30413 8385 Acked Read 8 Done Sent Done false
30414 8386 Acked Read 9 Done Sent Done false
30415 8387 Acked Write 8 Done Sent Done false
30416 8388 Acked Read 1 Done Sent Done false
30417 8389 Acked Write 3 Done Sent Done false
30418 8390 Acked Read 4 Done Sent Done false
30419 8391 Acked Write 3 Done Sent Done false
30420 8392 Acked Flush 0 Done Sent Done false
30421 8393 Acked Read 7 Done Sent Done false
30422 8394 Acked Read 3 Done Sent Done false
30423 8395 Acked Write 5 Done Sent Done false
30424 8396 Acked Read 7 Done Sent Done false
30425 8397 Acked Read 1 Done Sent Done false
30426 8398 Acked Write 3 Done Sent Done false
30427 8399 Acked Flush 0 Done Sent Done false
30428 8400 Acked Read 10 Done Sent Done false
30429 8401 Acked Write 2 Done Sent Done false
30430 8402 Acked Flush 0 Done Sent Done false
30431 8403 Acked Read 4 Done Sent Done false
30432 8404 Acked Read 5 Done Sent Done false
30433 8405 Acked Write 4 Done Sent Done false
30434 8406 Acked Write 10 Done Sent Done false
30435 8407 Acked Write 1 Done Sent Done false
30436 8408 Acked Read 6 Done Sent Done false
30437 8409 Acked Write 4 Done Sent Done false
30438 8410 Acked Read 9 Done Sent Done false
30439 8411 Acked Write 10 Done Sent Done false
30440 8412 Acked Read 9 Done Sent Done false
30441 8413 Acked Read 7 Done Sent Done false
30442 8414 Acked Write 8 Done Sent Done false
30443 8415 Acked Read 10 Done Sent Done false
30444 8416 Acked Write 6 Done Sent Done false
30445 8417 Acked Read 4 Done Sent Done false
30446 8418 Acked Read 5 Done Sent Done false
30447 8419 Acked Read 7 Done Sent Done false
30448 8420 Acked Read 3 Done Sent Done false
30449 8421 Acked Read 5 Done Sent Done false
30450 8422 Acked Read 9 Done Sent Done false
30451 8423 Acked Write 10 Done Sent Done false
30452 8424 Acked Read 8 Done Sent Done false
30453 8425 Acked Read 10 Done Sent Done false
30454 8426 Acked Write 7 Done Sent Done false
30455 8427 Acked Read 6 Done Sent Done false
30456 8428 Acked Read 1 Done Sent Done false
30457 8429 Acked Flush 0 Done Sent Done false
30458 8430 Acked Read 8 Done Sent Done false
30459 8431 Acked Read 2 Done Sent Done false
30460 8432 Acked Flush 0 Done Sent Done false
30461 8433 Acked Write 10 Done Sent Done false
30462 8434 Acked Read 9 Done Sent Done false
30463 8435 Acked Read 6 Done Sent Done false
30464 8436 Acked Read 2 Done Sent Done false
30465 8437 Acked Read 9 Done Sent Done false
30466 8438 Acked Read 2 Done Sent Done false
30467 8439 Acked Read 7 Done Sent Done false
30468 8440 Acked Flush 0 Done Sent Done false
30469 8441 Acked Read 6 Done Sent Done false
30470 8442 Acked Read 4 Done Sent Done false
30471 8443 Acked Write 3 Done Sent Done false
30472 8444 Acked Read 1 Done Sent Done false
30473 8445 Acked Write 5 Done Sent Done false
30474 8446 Acked Write 9 Done Sent Done false
30475 8447 Acked Read 9 Done Sent Done false
30476 8448 Acked Read 4 Done Sent Done false
30477 8449 Acked Write 6 Done Sent Done false
30478 8450 Acked Write 3 Done Sent Done false
30479 8451 Acked Read 9 Done Sent Done false
30480 8452 Acked Write 6 Done Sent Done false
30481 8453 Acked Write 6 Done Sent Done false
30482 8454 Acked Read 10 Done Sent Done false
30483 8455 Acked Read 4 Done Sent Done false
30484 8456 Acked Write 2 Done Sent Done false
30485 8457 Acked Write 9 Done Sent Done false
30486 8458 Acked Write 9 Done Sent Done false
30487 8459 Acked Read 4 Done Sent Done false
30488 8460 Acked Read 10 Done Sent Done false
30489 8461 Acked Read 10 Done Sent Done false
30490 8462 Acked Flush 0 Done Sent Done false
30491 8463 Acked Write 8 Done Sent Done false
30492 8464 Acked Write 4 Done Sent Done false
30493 8465 Acked Write 2 Done Sent Done false
30494 8466 Acked Read 5 Done Sent Done false
30495 8467 Acked Read 6 Done Sent Done false
30496 8468 Acked Read 7 Done Sent Done false
30497 8469 Acked Read 5 Done Sent Done false
30498 8470 Acked Flush 0 Done Sent Done false
30499 8471 Acked Write 1 Done Sent Done false
30500 8472 Acked Write 4 Done Sent Done false
30501 8473 Acked Read 4 Done Sent Done false
30502 8474 Acked Write 9 Done Sent Done false
30503 8475 Acked Write 9 Done Sent Done false
30504 8476 Acked Read 3 Done Sent Done false
30505 8477 Acked Write 10 Done Sent Done false
30506 8478 Acked Write 2 Done Sent Done false
30507 8479 Acked Read 4 Done Sent Done false
30508 8480 Acked Write 2 Done Sent Done false
30509 8481 Acked Read 5 Done Sent Done false
30510 8482 Acked Read 1 Done Sent Done false
30511 8483 Acked Write 4 Done Sent Done false
30512 8484 Acked Read 5 Done Sent Done false
30513 8485 Acked Read 5 Done Sent Done false
30514 8486 Acked Read 3 Done Sent Done false
30515 8487 Acked Read 4 Done Sent Done false
30516 8488 Acked Flush 0 Done Sent Done false
30517 8489 Acked Write 4 Done Sent Done false
30518 8490 Acked Read 6 Done Sent Done false
30519 8491 Acked Write 6 Done Sent Done false
30520 8492 Acked Write 7 Done Sent Done false
30521 8493 Acked Read 8 Done Sent Done false
30522 8494 Acked Write 3 Done Sent Done false
30523 8495 Acked Read 1 Done Sent Done false
30524 8496 Acked Write 6 Done Sent Done false
30525 8497 Acked Write 1 Done Sent Done false
30526 8498 Acked Read 9 Done Sent Done false
30527 8499 Acked Write 3 Done Sent Done false
30528 8500 Acked Read 6 Done Sent Done false
30529 8501 Acked Read 4 Done Sent Done false
30530 8502 Acked Write 4 Done Sent Done false
30531 8503 Acked Read 9 Done Sent Done false
30532 8504 Acked Write 6 Done Sent Done false
30533 8505 Acked Read 10 Done Sent Done false
30534 8506 Acked Write 9 Done Sent Done false
30535 8507 Acked Write 7 Done Sent Done false
30536 8508 Acked Read 5 Done Sent Done false
30537 8509 Acked Read 7 Done Sent Done false
30538 8510 Acked Read 2 Done Sent Done false
30539 8511 Acked Read 4 Done Sent Done false
30540 8512 Acked Flush 0 Done Sent Done false
30541 8513 Acked Write 6 Done Sent Done false
30542 8514 Acked Write 1 Done Sent Done false
30543 8515 Acked Read 1 Done Sent Done false
30544 8516 Acked Write 8 Done Sent Done false
30545 8517 Acked Write 8 Done Sent Done false
30546 8518 Acked Flush 0 Done Sent Done false
30547 8519 Acked Read 8 Done Sent Done false
30548 8520 Acked Read 6 Done Sent Done false
30549 8521 Acked Read 9 Done Sent Done false
30550 8522 Acked Read 10 Done Sent Done false
30551 8523 Acked Read 10 Done Sent Done false
30552 8524 Acked Read 8 Done Sent Done false
30553 8525 Acked Read 9 Done Sent Done false
30554 8526 Acked Write 4 Done Sent Done false
30555 8527 Acked Write 4 Done Sent Done false
30556 8528 Acked Read 3 Done Sent Done false
30557 8529 Acked Read 3 Done Sent Done false
30558 8530 Acked Write 7 Done Sent Done false
30559 8531 Acked Flush 0 Done Sent Done false
30560 8532 Acked Read 3 Done Sent Done false
30561 8533 Acked Read 9 Done Sent Done false
30562 8534 Acked Write 1 Done Sent Done false
30563 8535 Acked Flush 0 Done Sent Done false
30564 8536 Acked Read 2 Done Sent Done false
30565 8537 Acked Read 5 Done Sent Done false
30566 8538 Acked Write 8 Done Sent Done false
30567 8539 Acked Write 2 Done Sent Done false
30568 8540 Acked Write 1 Done Sent Done false
30569 8541 Acked Read 2 Done Sent Done false
30570 8542 Acked Flush 0 Done Sent Done false
30571 8543 Acked Write 5 Done Sent Done false
30572 8544 Acked Read 10 Done Sent Done false
30573 8545 Acked Write 10 Done Sent Done false
30574 8546 Acked Flush 0 Done Sent Done false
30575 STATES DS:0 DS:1 DS:2 TOTAL
30576 Sent 0 302 0 302
30577 Done 302 0 302 604
30578 Skipped 0 0 0 0
30579 Error 0 0 0 0
30580 Last Flush: 8546 8244 8546
30581 Downstairs last five completed: 8244 8243 8242 8241 8240
30582 Upstairs last five completed: 8546 8545 8544 8543 8542
30583 CLIENT: Up:0 ds:302 act:2
305842025-01-10T16:41:45.636ZINFOcrucible: connecting to 127.0.0.1:8820 = io task client = 1 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
305852025-01-10T16:41:45.636ZINFOcrucible: ds_connection connected from Ok(127.0.0.1:58620) = io task client = 1 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
305862025-01-10T16:41:45.638ZWARNcrucible: version negotiation from state Offline = downstairs client = 1 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
305872025-01-10T16:41:45.638ZINFOcrucible: downstairs client at Some(127.0.0.1:8820) has region UUID 12345678-0000-0000-0000-000000008820 = downstairs client = 1 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
305882025-01-10T16:41:45.638ZINFOcrucible: Returning UUID:12345678-0000-0000-0000-000000008820 matches = downstairs client = 1 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
305892025-01-10T16:41:45.638ZINFOcrucible: send last flush ID to this DS: 8244 = downstairs client = 1 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
305902025-01-10T16:41:45.638ZINFOcrucible: Replied this last flush ID: 8244 = downstairs client = 1 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
305912025-01-10T16:41:45.639ZINFOcrucible: ds_transition from Offline to Active = downstairs client = 1 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
305922025-01-10T16:41:45.639ZINFOcrucible: [1] Transition from Offline to Active = downstairs client = 1 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
305932025-01-10T16:41:45.639ZINFOcrucible: [1] client re-new 302 jobs since flush 8244 = downstairs session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
305942025-01-10T16:41:45.639ZINFOcrucible: [1] Replayed 302 jobs since flush: 8244 = downstairs session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
30595 ----------------------------------------------------------------
30596 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:0
30597 Downstairs last five completed: 8546 8545 8544 8543 8542
30598 Upstairs last five completed: 8546 8545 8544 8543 8542
30599 CLIENT: Up:0 ds:0 act:3
30600 Replay: All jobs finished
30601 Main task has work to do, go find it
30602 got dsc Stop(2)
30603 stop 2
30604 [8830] Got stop action so:false kr:false
30605 Jan 10 16:41:45.885 INFO request completed, latency_us: 318, response_code: 204, uri: /stop/cid/2, method: POST, req_id: f6b2dddd-45b1-4805-847b-4c9b771a2693, remote_addr: 127.0.0.1:55917, local_addr: 127.0.0.1:9998
306062025-01-10T16:41:45.885ZWARNcrucible: downstairs disconnected = io task client = 2 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
306072025-01-10T16:41:45.886ZWARNcrucible: client task is sending Done(Finished) = io task client = 2 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
306082025-01-10T16:41:45.886ZWARNcrucible: downstairs task for 2 stopped due to Finished session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
30609 Jan 10 16:41:45.886 INFO request completed, latency_us: 111, response_code: 200, uri: /state/cid/2{"msg":"ds_transition from Active to Offline","v":0,"name":"crucible","level":30,"time":"2025-01-10T16:41:45.886105307Z","hostname":"w-01JH8H1N3KXZ9F8ZV6CCMP5KTQ","pid":1202,"client":"2","":"downstairs","session_id":"1df3ca91-4dc9-42d6-9897-461254b5afe2"}
30610 , method: GET, req_id: fa5ebf55-984a-4d51-b67d-e4812b94526f, remote_addr{"msg":"[2] Transition from Active to Offline","v":0,"name":"crucible","level":30,"time":"2025-01-10T16:41:45.886138964Z","hostname":"w-01JH8H1N3KXZ9F8ZV6CCMP5KTQ","pid":1202,"client":"2","":"downstairs","session_id":"1df3ca91-4dc9-42d6-9897-461254b5afe2"}
30611 : 127.0.0.1:55917, local_addr: 127.0.0.1:9998{"msg":"client task is exiting","v":0,"name":"crucible","level":30,"time":"2025-01-10T16:41:45.886163151Z","hostname":"w-01JH8H1N3KXZ9F8ZV6CCMP5KTQ","pid":1202,"":"io task","client":"2","":"downstairs","session_id":"1df3ca91-4dc9-42d6-9897-461254b5afe2"}
30612 
30613 [8830] Exited with: ExitStatus(unix_wait_status(9))
30614 [8830][2] reports Exit
30615 Jan 10 16:41:49.888 INFO request completed, latency_us: 258, response_code: 200, uri: /state/cid/2, method: GET, req_id: cf54d857-55de-4963-ad8a-97afa82d29df, remote_addr: 127.0.0.1:55917, local_addr: 127.0.0.1:9998
30616 001/300 Read block 3541 len 24576
30617 002/300 Write block 3062 len 12288 data: 7 6 7
30618 003/300 Read block 4745 len 4096
30619 004/300 Read block 295 len 16384
30620 005/300 Write block 3153 len 4096 data: 5
30621 006/300 Read block 1256 len 28672
30622 007/300 Write block 3530 len 20480 data: 3 2 2 3 4
30623 008/300 Read block 4795 len 12288
30624 009/300 Read block 3205 len 24576
30625 010/300 Write block 4072 len 36864 data: 9 10 9 7 4 4 7 5 6
30626 011/300 Write block 3364 len 4096 data: 3
30627 012/300 Read block 2782 len 16384
30628 013/300 Read block 3895 len 24576
30629 014/300 Write block 4976 len 28672 data: 4 5 4 5 5 4 4
30630 015/300 Read block 688 len 12288
30631 016/300 Write block 952 len 20480 data: 6 6 6 6 5
30632 017/300 Flush
30633 018/300 Write block 2058 len 4096 data: 4
30634 019/300 Read block 1770 len 32768
30635 020/300 Read block 4147 len 16384
30636 021/300 Write block 1810 len 4096 data: 5
30637 022/300 Read block 156 len 40960
30638 023/300 Read block 279 len 4096
30639 024/300 Write block 48 len 32768 data: 7 6 6 6 5 4 5 4
30640 025/300 Flush
30641 026/300 Read block 480 len 24576
30642 027/300 Write block 2493 len 40960 data: 5 5 5 6 5 4 3 3 3 3
30643 028/300 Write block 2757 len 16384 data: 5 5 5 7
30644 029/300 Write block 374 len 32768 data: 4 4 4 3 2 3 3 3
30645 030/300 Read block 2748 len 20480
30646 031/300 Read block 4617 len 40960
30647 032/300 Write block 390 len 24576 data: 3 4 6 4 5 5
30648 033/300 Flush
30649 034/300 Read block 3581 len 24576
30650 035/300 Flush
30651 036/300 Write block 472 len 16384 data: 5 5 5 6
30652 037/300 Read block 4438 len 24576
30653 038/300 Write block 120 len 28672 data: 9 7 7 8 6 6 6
30654 039/300 Read block 3629 len 12288
30655 040/300 Flush
30656 041/300 Read block 1267 len 24576
30657 042/300 Read block 670 len 20480
30658 043/300 Write block 3314 len 24576 data: 7 7 5 5 5 6
30659 044/300 Read block 3061 len 24576
30660 045/300 Flush
30661 046/300 Flush
30662 047/300 Write block 583 len 28672 data: 8 8 6 4 7 7 5
30663 048/300 Write block 4680 len 8192 data: 5 5
30664 049/300 Read block 2221 len 36864
30665 050/300 Read block 1271 len 40960
30666 051/300 Write block 2425 len 40960 data: 4 4 2 4 4 4 4 4 4 5
30667 052/300 Read block 3418 len 40960
30668 053/300 Read block 3528 len 40960
30669 054/300 Write block 3146 len 24576 data: 5 6 6 7 7 6
30670 055/300 Flush
30671 056/300 Read block 547 len 32768
30672 057/300 Write block 4621 len 40960 data: 6 7 7 7 8 6 7 6 7 6
30673 058/300 Read block 3406 len 40960
30674 059/300 Read block 890 len 40960
30675 060/300 Write block 3567 len 16384 data: 5 6 5 4
30676 061/300 Read block 1993 len 36864
30677 062/300 Read block 1287 len 4096
30678 063/300 Read block 3614 len 24576
30679 064/300 Write block 874 len 28672 data: 7 9 7 9 9 10 8
30680 065/300 Flush
30681 066/300 Read block 4898 len 20480
30682 067/300 Write block 4539 len 24576 data: 4 4 5 4 5 5
30683 068/300 Read block 2826 len 20480
30684 069/300 Write block 3580 len 8192 data: 3 3
30685 070/300 Flush
30686 071/300 Write block 3547 len 8192 data: 7 8
30687 072/300 Read block 3982 len 24576
30688 073/300 Flush
30689 074/300 Write block 2885 len 28672 data: 6 7 10 7 9 9 6
30690 075/300 Read block 837 len 4096
30691 076/300 Write block 1508 len 20480 data: 5 6 6 6 4
30692 077/300 Write block 4666 len 36864 data: 3 3 4 6 5 5 5 5 5
30693 078/300 Write block 4334 len 20480 data: 7 6 6 7 7
30694 079/300 Write block 145 len 12288 data: 5 5 4
30695 080/300 Flush
30696 081/300 Write block 2504 len 16384 data: 5 6 8 9
30697 082/300 Read block 865 len 24576
30698 083/300 Flush
30699 084/300 Write block 3147 len 12288 data: 7 7 8
30700 085/300 Read block 2521 len 4096
30701 086/300 Write block 2440 len 32768 data: 6 5 5 6 6 5 6 5
30702 087/300 Flush
30703 088/300 Write block 4186 len 8192 data: 3 4
30704 089/300 Write block 1921 len 12288 data: 5 4 5
30705 090/300 Read block 2860 len 36864
30706 091/300 Write block 773 len 40960 data: 7 7 8 7 6 5 3 4 4 5
30707 092/300 Read block 2399 len 16384
30708 093/300 Write block 3574 len 36864 data: 5 4 3 4 4 4 4 4 3
30709 094/300 Read block 1901 len 32768
30710 095/300 Write block 4661 len 4096 data: 5
30711 096/300 Write block 4757 len 4096 data: 5
30712 097/300 Read block 3003 len 20480
30713 098/300 Read block 3131 len 28672
30714 099/300 Read block 3296 len 20480
30715 100/300 Write block 4374 len 36864 data: 11 10 11 12 11 7 6 5 4
30716 101/300 Write block 1549 len 12288 data: 8 7 7
30717 102/300 Write block 1647 len 36864 data: 4 4 4 4 3 3 4 3 4
30718 103/300 Write block 2911 len 20480 data: 6 6 5 4 5
30719 104/300 Write block 2375 len 20480 data: 6 7 7 7 7
30720 105/300 Read block 3077 len 16384
30721 106/300 Read block 2263 len 24576
30722 107/300 Write block 1078 len 20480 data: 4 4 4 4 5
30723 108/300 Read block 2158 len 20480
30724 109/300 Write block 379 len 40960 data: 4 4 4 2 2 3 3 3 3 3
30725 110/300 Read block 2744 len 8192
30726 111/300 Read block 4566 len 36864
30727 112/300 Flush
30728 113/300 Write block 4374 len 12288 data: 12 11 12
30729 114/300 Read block 4212 len 12288
30730 115/300 Read block 1858 len 36864
30731 116/300 Flush
30732 117/300 Read block 4583 len 36864
30733 118/300 Write block 4640 len 32768 data: 3 4 3 4 4 5 5 3
30734 119/300 Read block 4113 len 36864
30735 120/300 Read block 2148 len 8192
30736 121/300 Flush
30737 122/300 Read block 4974 len 12288
30738 123/300 Write block 2948 len 40960 data: 8 8 7 8 9 8 9 9 7 6
30739 124/300 Write block 787 len 28672 data: 5 4 3 4 5 5 6
30740 125/300 Write block 2079 len 16384 data: 5 5 5 4
30741 126/300 Read block 3390 len 8192
30742 127/300 Write block 186 len 4096 data: 10
30743 128/300 Write block 782 len 8192 data: 6 5
30744 129/300 Flush
30745 130/300 Read block 216 len 36864
30746 131/300 Write block 2014 len 24576 data: 5 4 4 5 6 5
30747 132/300 Write block 401 len 40960 data: 3 3 3 4 5 5 5 5 6 5
30748 133/300 Read block 3651 len 20480
30749 134/300 Read block 4199 len 24576
30750 135/300 Read block 2837 len 40960
30751 136/300 Read block 599 len 4096
30752 137/300 Read block 4066 len 32768
30753 138/300 Write block 4402 len 36864 data: 6 5 4 4 4 4 4 3 3
30754 139/300 Read block 197 len 32768
30755 140/300 Flush
30756 141/300 Read block 4460 len 32768
30757 142/300 Write block 3478 len 20480 data: 3 3 2 2 3
30758 143/300 Read block 4416 len 16384
30759 144/300 Flush
30760 145/300 Read block 4389 len 8192
30761 146/300 Read block 4283 len 40960
30762 147/300 Write block 1958 len 24576 data: 3 2 3 4 3 5
30763 148/300 Read block 3734 len 4096
30764 149/300 Read block 1731 len 4096
30765 150/300 Read block 1874 len 24576
30766 151/300 Write block 936 len 28672 data: 7 7 6 5 5 5 5
30767 152/300 Read block 420 len 16384
30768 153/300 Read block 2119 len 8192
30769 154/300 Read block 2698 len 20480
30770 155/300 Read block 1266 len 32768
30771 156/300 Read block 735 len 12288
30772 157/300 Read block 865 len 24576
30773 158/300 Write block 4300 len 4096 data: 6
30774 159/300 Read block 3273 len 12288
30775 160/300 Read block 3746 len 40960
30776 161/300 Read block 3302 len 8192
30777 162/300 Write block 3019 len 4096 data: 7
30778 163/300 Read block 4016 len 36864
30779 164/300 Read block 3210 len 24576
30780 165/300 Read block 942 len 4096
30781 166/300 Flush
30782 167/300 Write block 934 len 24576 data: 8 6 8 8 7 6
30783 168/300 Write block 1633 len 24576 data: 9 8 7 7 6 6
30784 169/300 Read block 155 len 4096
30785 170/300 Write block 1514 len 40960 data: 5 5 4 3 2 3 3 4 5 5
30786 171/300 Write block 4213 len 12288 data: 7 6 6
30787 172/300 Read block 4704 len 28672
30788 173/300 Read block 3589 len 4096
30789 174/300 Write block 1188 len 28672 data: 7 7 6 7 6 7 6
30790 175/300 Read block 4366 len 4096
30791 176/300 Write block 3010 len 40960 data: 3 3 5 5 5 7 8 9 9 8
30792 177/300 Write block 3659 len 8192 data: 6 6
30793 178/300 Write block 1495 len 8192 data: 3 3
30794 179/300 Read block 2910 len 20480
30795 180/300 Read block 3652 len 16384
30796 181/300 Read block 4158 len 12288
30797 182/300 Write block 3529 len 4096 data: 3
30798 183/300 Read block 3156 len 8192
30799 184/300 Write block 3050 len 32768 data: 4 5 5 5 5 5 3 4
30800 185/300 Read block 1265 len 20480
30801 186/300 Write block 303 len 8192 data: 4 5
30802 187/300 Flush
30803 188/300 Read block 1159 len 12288
30804 189/300 Read block 189 len 32768
30805 190/300 Read block 113 len 28672
30806 191/300 Write block 2228 len 20480 data: 6 5 4 5 4
30807 192/300 Write block 3299 len 28672 data: 4 6 7 7 5 4 5
30808 193/300 Write block 4421 len 12288 data: 4 5 7
30809 194/300 Write block 1330 len 12288 data: 6 8 8
30810 195/300 Read block 4819 len 32768
30811 196/300 Flush
30812 197/300 Write block 2220 len 32768 data: 4 4 5 5 6 7 5 5
30813 198/300 Flush
30814 199/300 Flush
30815 200/300 Write block 925 len 20480 data: 6 5 5 6 6
30816 201/300 Write block 2929 len 24576 data: 4 4 6 7 7 6
30817 202/300 Read block 8 len 32768
30818 203/300 Write block 2521 len 28672 data: 6 4 3 4 6 7 7
30819 204/300 Flush
30820 205/300 Write block 2041 len 20480 data: 7 6 5 3 3
30821 206/300 Read block 3996 len 20480
30822 207/300 Read block 848 len 8192
30823 208/300 Read block 1264 len 20480
30824 209/300 Read block 1807 len 12288
30825 210/300 Write block 2552 len 16384 data: 6 7 6 7
30826 211/300 Read block 2591 len 16384
30827 212/300 Read block 4556 len 40960
30828 213/300 Flush
30829 214/300 Write block 566 len 32768 data: 7 5 4 4 4 3 5 4
30830 215/300 Flush
30831 216/300 Read block 2123 len 12288
30832 217/300 Write block 421 len 32768 data: 4 4 4 5 5 4 4 4
30833 218/300 Write block 3411 len 28672 data: 5 6 5 4 4 4 4
30834 219/300 Read block 2240 len 8192
30835 220/300 Read block 4700 len 40960
30836 221/300 Write block 1513 len 20480 data: 4 6 6 5 4
30837 222/300 Read block 2633 len 8192
30838 223/300 Write block 3917 len 40960 data: 7 5 6 4 5 4 4 5 5 4
30839 224/300 Write block 4979 len 12288 data: 6 6 5
30840 225/300 Read block 2122 len 20480
30841 226/300 Write block 1112 len 40960 data: 7 6 5 3 4 4 5 4 5 4
30842 227/300 Read block 3118 len 12288
30843 228/300 Read block 3866 len 36864
30844 229/300 Write block 2391 len 20480 data: 6 6 6 6 8
30845 230/300 Write block 25 len 8192 data: 7 6
30846 231/300 Read block 4087 len 12288
30847 232/300 Read block 715 len 36864
30848 233/300 Read block 2899 len 16384
30849 234/300 Write block 4813 len 32768 data: 4 4 4 5 5 6 7 7
30850 235/300 Read block 4212 len 32768
30851 236/300 Read block 651 len 12288
30852 237/300 Read block 1275 len 36864
30853 238/300 Write block 1784 len 40960 data: 6 6 5 6 6 5 5 6 5 5
30854 239/300 Write block 738 len 20480 data: 5 6 5 5 4
30855 240/300 Read block 3087 len 8192
30856 241/300 Read block 2134 len 4096
30857 242/300 Write block 1993 len 12288 data: 10 8 10
30858 243/300 Flush
30859 244/300 Read block 2785 len 12288
30860 245/300 Write block 3157 len 24576 data: 3 3 3 3 2 2
30861 246/300 Write block 192 len 36864 data: 3 6 7 7 8 8 7 7 7
30862 247/300 Write block 3179 len 16384 data: 2 2 2 3
30863 248/300 Write block 2476 len 40960 data: 3 4 4 4 4 6 5 6 7 6
30864 249/300 Read block 2248 len 32768
30865 250/300 Write block 2617 len 36864 data: 7 8 7 6 6 6 5 4 3
30866 251/300 Write block 2339 len 20480 data: 5 5 3 5 5
30867 252/300 Write block 281 len 40960 data: 5 5 6 4 3 3 3 3 3 3
30868 253/300 Read block 3574 len 4096
30869 254/300 Read block 4362 len 8192
30870 255/300 Write block 3320 len 16384 data: 6 9 7 7
30871 256/300 Flush
30872 257/300 Read block 535 len 40960
30873 258/300 Read block 1211 len 24576
30874 259/300 Read block 2341 len 40960
30875 260/300 Read block 3724 len 24576
30876 261/300 Read block 2080 len 36864
30877 262/300 Write block 4247 len 16384 data: 7 6 8 8
30878 263/300 Read block 1880 len 16384
30879 264/300 Write block 1178 len 20480 data: 4 6 8 8 8
30880 265/300 Write block 3885 len 16384 data: 3 3 3 3
30881 266/300 Write block 1759 len 40960 data: 7 7 8 8 9 9 8 8 6 7
30882 267/300 Flush
30883 268/300 Read block 2788 len 40960
30884 269/300 Write block 829 len 40960 data: 6 6 7 7 5 4 4 4 6 6
30885 270/300 Write block 1013 len 8192 data: 6 6
30886 271/300 Read block 4170 len 40960
30887 272/300 Write block 2701 len 8192 data: 4 3
30888 273/300 Read block 2757 len 20480
30889 274/300 Read block 835 len 16384
30890 275/300 Write block 2687 len 4096 data: 7
30891 276/300 Write block 4918 len 36864 data: 4 5 6 5 4 5 5 5 5
30892 277/300 Flush
30893 278/300 Read block 1329 len 40960
30894 279/300 Write block 3013 len 16384 data: 6 6 8 9
30895 280/300 Write block 3594 len 24576 data: 5 5 6 6 5 4
30896 281/300 Read block 1669 len 36864
30897 282/300 Read block 2190 len 40960
30898 283/300 Read block 2729 len 20480
30899 284/300 Read block 4011 len 40960
30900 285/300 Read block 3508 len 20480
30901 286/300 Flush
30902 287/300 Write block 3652 len 32768 data: 4 6 8 6 7 8 8 7
30903 288/300 Flush
30904 289/300 Write block 3799 len 4096 data: 6
30905 290/300 Write block 2844 len 36864 data: 6 7 7 7 6 8 8 7 6
30906 291/300 Write block 4183 len 24576 data: 4 3 2 4 5 4
30907 292/300 Read block 287 len 4096
30908 293/300 Write block 3582 len 40960 data: 4 3 3 3 4 4 6 7 6 6
30909 294/300 Read block 4820 len 12288
30910 295/300 Read block 1156 len 32768
30911 296/300 Read block 3455 len 4096
30912 297/300 Read block 801 len 16384
30913 298/300 Read block 563 len 32768
30914 299/300 Write block 4858 len 20480 data: 6 8 7 8 7
30915 300/300 Write block 4912 len 28672 data: 3 3 3 4 4 5 5
30916 301/300 Write block 3119 len 16384 data: 7 6 6 6
30917 Main task has work to do, go find it
30918 got dsc Start(2)
30919 start 2
30920 Jan 10 16:41:50.127 INFO request completed, latency_us: 282, response_code: 204, uri: /start/cid/2, method: POST, req_id: 1287b3ac-c3aa-4879-84a6-96827f779ad4, remote_addr: 127.0.0.1:55917, local_addr: 127.0.0.1:9998
30921 Replay: started 2, returned:Ok(())
30922 ----------------------------------------------------------------
30923 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:301
30924 States: Active Active Offline
30925 JOBID ACK TYPE BKS/EXT DS:0 DS:1 DS:2 REPLAY
30926 8547 Acked Read 6 Done Done Sent false
30927 8548 Acked Write 3 Done Done Sent false
30928 8549 Acked Read 1 Done Done Sent false
30929 8550 Acked Read 4 Done Done Sent false
30930 8551 Acked Write 1 Done Done Sent false
30931 8552 Acked Read 7 Done Done Sent false
30932 8553 Acked Write 5 Done Done Sent false
30933 8554 Acked Read 3 Done Done Sent false
30934 8555 Acked Read 6 Done Done Sent false
30935 8556 Acked Write 9 Done Done Sent false
30936 8557 Acked Write 1 Done Done Sent false
30937 8558 Acked Read 4 Done Done Sent false
30938 8559 Acked Read 6 Done Done Sent false
30939 8560 Acked Write 7 Done Done Sent false
30940 8561 Acked Read 3 Done Done Sent false
30941 8562 Acked Write 5 Done Done Sent false
30942 8563 Acked Flush 0 Done Done Sent false
30943 8564 Acked Write 1 Done Done Sent false
30944 8565 Acked Read 8 Done Done Sent false
30945 8566 Acked Read 4 Done Done Sent false
30946 8567 Acked Write 1 Done Done Sent false
30947 8568 Acked Read 10 Done Done Sent false
30948 8569 Acked Read 1 Done Done Sent false
30949 8570 Acked Write 8 Done Done Sent false
30950 8571 Acked Flush 0 Done Done Sent false
30951 8572 Acked Read 6 Done Done Sent false
30952 8573 Acked Write 10 Done Done Sent false
30953 8574 Acked Write 4 Done Done Sent false
30954 8575 Acked Write 8 Done Done Sent false
30955 8576 Acked Read 5 Done Done Sent false
30956 8577 Acked Read 10 Done Done Sent false
30957 8578 Acked Write 6 Done Done Sent false
30958 8579 Acked Flush 0 Done Done Sent false
30959 8580 Acked Read 6 Done Done Sent false
30960 8581 Acked Flush 0 Done Done Sent false
30961 8582 Acked Write 4 Done Done Sent false
30962 8583 Acked Read 6 Done Done Sent false
30963 8584 Acked Write 7 Done Done Sent false
30964 8585 Acked Read 3 Done Done Sent false
30965 8586 Acked Flush 0 Done Done Sent false
30966 8587 Acked Read 6 Done Done Sent false
30967 8588 Acked Read 5 Done Done Sent false
30968 8589 Acked Write 6 Done Done Sent false
30969 8590 Acked Read 6 Done Done Sent false
30970 8591 Acked Flush 0 Done Done Sent false
30971 8592 Acked Flush 0 Done Done Sent false
30972 8593 Acked Write 7 Done Done Sent false
30973 8594 Acked Write 2 Done Done Sent false
30974 8595 Acked Read 9 Done Done Sent false
30975 8596 Acked Read 10 Done Done Sent false
30976 8597 Acked Write 10 Done Done Sent false
30977 8598 Acked Read 10 Done Done Sent false
30978 8599 Acked Read 10 Done Done Sent false
30979 8600 Acked Write 6 Done Done Sent false
30980 8601 Acked Flush 0 Done Done Sent false
30981 8602 Acked Read 8 Done Done Sent false
30982 8603 Acked Write 10 Done Done Sent false
30983 8604 Acked Read 10 Done Done Sent false
30984 8605 Acked Read 10 Done Done Sent false
30985 8606 Acked Write 4 Done Done Sent false
30986 8607 Acked Read 9 Done Done Sent false
30987 8608 Acked Read 1 Done Done Sent false
30988 8609 Acked Read 6 Done Done Sent false
30989 8610 Acked Write 7 Done Done Sent false
30990 8611 Acked Flush 0 Done Done Sent false
30991 8612 Acked Read 5 Done Done Sent false
30992 8613 Acked Write 6 Done Done Sent false
30993 8614 Acked Read 5 Done Done Sent false
30994 8615 Acked Write 2 Done Done Sent false
30995 8616 Acked Flush 0 Done Done Sent false
30996 8617 Acked Write 2 Done Done Sent false
30997 8618 Acked Read 6 Done Done Sent false
30998 8619 Acked Flush 0 Done Done Sent false
30999 8620 Acked Write 7 Done Done Sent false
31000 8621 Acked Read 1 Done Done Sent false
31001 8622 Acked Write 5 Done Done Sent false
31002 8623 Acked Write 9 Done Done Sent false
31003 8624 Acked Write 5 Done Done Sent false
31004 8625 Acked Write 3 Done Done Sent false
31005 8626 Acked Flush 0 Done Done Sent false
31006 8627 Acked Write 4 Done Done Sent false
31007 8628 Acked Read 6 Done Done Sent false
31008 8629 Acked Flush 0 Done Done Sent false
31009 8630 Acked Write 3 Done Done Sent false
31010 8631 Acked Read 1 Done Done Sent false
31011 8632 Acked Write 8 Done Done Sent false
31012 8633 Acked Flush 0 Done Done Sent false
31013 8634 Acked Write 2 Done Done Sent false
31014 8635 Acked Write 3 Done Done Sent false
31015 8636 Acked Read 9 Done Done Sent false
31016 8637 Acked Write 10 Done Done Sent false
31017 8638 Acked Read 4 Done Done Sent false
31018 8639 Acked Write 9 Done Done Sent false
31019 8640 Acked Read 8 Done Done Sent false
31020 8641 Acked Write 1 Done Done Sent false
31021 8642 Acked Write 1 Done Done Sent false
31022 8643 Acked Read 5 Done Done Sent false
31023 8644 Acked Read 7 Done Done Sent false
31024 8645 Acked Read 5 Done Done Sent false
31025 8646 Acked Write 9 Done Done Sent false
31026 8647 Acked Write 3 Done Done Sent false
31027 8648 Acked Write 9 Done Done Sent false
31028 8649 Acked Write 5 Done Done Sent false
31029 8650 Acked Write 5 Done Done Sent false
31030 8651 Acked Read 4 Done Done Sent false
31031 8652 Acked Read 6 Done Done Sent false
31032 8653 Acked Write 5 Done Done Sent false
31033 8654 Acked Read 5 Done Done Sent false
31034 8655 Acked Write 10 Done Done Sent false
31035 8656 Acked Read 2 Done Done Sent false
31036 8657 Acked Read 9 Done Done Sent false
31037 8658 Acked Flush 0 Done Done Sent false
31038 8659 Acked Write 3 Done Done Sent false
31039 8660 Acked Read 3 Done Done Sent false
31040 8661 Acked Read 9 Done Done Sent false
31041 8662 Acked Flush 0 Done Done Sent false
31042 8663 Acked Read 9 Done Done Sent false
31043 8664 Acked Write 8 Done Done Sent false
31044 8665 Acked Read 9 Done Done Sent false
31045 8666 Acked Read 2 Done Done Sent false
31046 8667 Acked Flush 0 Done Done Sent false
31047 8668 Acked Read 3 Done Done Sent false
31048 8669 Acked Write 10 Done Done Sent false
31049 8670 Acked Write 7 Done Done Sent false
31050 8671 Acked Write 4 Done Done Sent false
31051 8672 Acked Read 2 Done Done Sent false
31052 8673 Acked Write 1 Done Done Sent false
31053 8674 Acked Write 2 Done Done Sent false
31054 8675 Acked Flush 0 Done Done Sent false
31055 8676 Acked Read 9 Done Done Sent false
31056 8677 Acked Write 6 Done Done Sent false
31057 8678 Acked Write 10 Done Done Sent false
31058 8679 Acked Read 5 Done Done Sent false
31059 8680 Acked Read 6 Done Done Sent false
31060 8681 Acked Read 10 Done Done Sent false
31061 8682 Acked Read 1 Done Done Sent false
31062 8683 Acked Read 8 Done Done Sent false
31063 8684 Acked Write 9 Done Done Sent false
31064 8685 Acked Read 8 Done Done Sent false
31065 8686 Acked Flush 0 Done Done Sent false
31066 8687 Acked Read 8 Done Done Sent false
31067 8688 Acked Write 5 Done Done Sent false
31068 8689 Acked Read 4 Done Done Sent false
31069 8690 Acked Flush 0 Done Done Sent false
31070 8691 Acked Read 2 Done Done Sent false
31071 8692 Acked Read 10 Done Done Sent false
31072 8693 Acked Write 6 Done Done Sent false
31073 8694 Acked Read 1 Done Done Sent false
31074 8695 Acked Read 1 Done Done Sent false
31075 8696 Acked Read 6 Done Done Sent false
31076 8697 Acked Write 7 Done Done Sent false
31077 8698 Acked Read 4 Done Done Sent false
31078 8699 Acked Read 2 Done Done Sent false
31079 8700 Acked Read 5 Done Done Sent false
31080 8701 Acked Read 8 Done Done Sent false
31081 8702 Acked Read 3 Done Done Sent false
31082 8703 Acked Read 6 Done Done Sent false
31083 8704 Acked Write 1 Done Done Sent false
31084 8705 Acked Read 3 Done Done Sent false
31085 8706 Acked Read 10 Done Done Sent false
31086 8707 Acked Read 2 Done Done Sent false
31087 8708 Acked Write 1 Done Done Sent false
31088 8709 Acked Read 9 Done Done Sent false
31089 8710 Acked Read 6 Done Done Sent false
31090 8711 Acked Read 1 Done Done Sent false
31091 8712 Acked Flush 0 Done Done Sent false
31092 8713 Acked Write 6 Done Done Sent false
31093 8714 Acked Write 6 Done Done Sent false
31094 8715 Acked Read 1 Done Done Sent false
31095 8716 Acked Write 10 Done Done Sent false
31096 8717 Acked Write 3 Done Done Sent false
31097 8718 Acked Read 7 Done Done Sent false
31098 8719 Acked Read 1 Done Done Sent false
31099 8720 Acked Write 7 Done Done Sent false
31100 8721 Acked Read 1 Done Done Sent false
31101 8722 Acked Write 10 Done Done Sent false
31102 8723 Acked Write 2 Done Done Sent false
31103 8724 Acked Write 2 Done Done Sent false
31104 8725 Acked Read 5 Done Done Sent false
31105 8726 Acked Read 4 Done Done Sent false
31106 8727 Acked Read 3 Done Done Sent false
31107 8728 Acked Write 1 Done Done Sent false
31108 8729 Acked Read 2 Done Done Sent false
31109 8730 Acked Write 8 Done Done Sent false
31110 8731 Acked Read 5 Done Done Sent false
31111 8732 Acked Write 2 Done Done Sent false
31112 8733 Acked Flush 0 Done Done Sent false
31113 8734 Acked Read 3 Done Done Sent false
31114 8735 Acked Read 8 Done Done Sent false
31115 8736 Acked Read 7 Done Done Sent false
31116 8737 Acked Write 5 Done Done Sent false
31117 8738 Acked Write 7 Done Done Sent false
31118 8739 Acked Write 3 Done Done Sent false
31119 8740 Acked Write 3 Done Done Sent false
31120 8741 Acked Read 8 Done Done Sent false
31121 8742 Acked Flush 0 Done Done Sent false
31122 8743 Acked Write 8 Done Done Sent false
31123 8744 Acked Flush 0 Done Done Sent false
31124 8745 Acked Flush 0 Done Done Sent false
31125 8746 Acked Write 5 Done Done Sent false
31126 8747 Acked Write 6 Done Done Sent false
31127 8748 Acked Read 8 Done Done Sent false
31128 8749 Acked Write 7 Done Done Sent false
31129 8750 Acked Flush 0 Done Done Sent false
31130 8751 Acked Write 5 Done Done Sent false
31131 8752 Acked Read 5 Done Done Sent false
31132 8753 Acked Read 2 Done Done Sent false
31133 8754 Acked Read 5 Done Done Sent false
31134 8755 Acked Read 3 Done Done Sent false
31135 8756 Acked Write 4 Done Done Sent false
31136 8757 Acked Read 4 Done Done Sent false
31137 8758 Acked Read 10 Done Done Sent false
31138 8759 Acked Flush 0 Done Done Sent false
31139 8760 Acked Write 8 Done Done Sent false
31140 8761 Acked Flush 0 Done Done Sent false
31141 8762 Acked Read 3 Done Done Sent false
31142 8763 Acked Write 8 Done Done Sent false
31143 8764 Acked Write 7 Done Done Sent false
31144 8765 Acked Read 2 Done Done Sent false
31145 8766 Acked Read 10 Done Done Sent false
31146 8767 Acked Write 5 Done Done Sent false
31147 8768 Acked Read 2 Done Done Sent false
31148 8769 Acked Write 10 Done Done Sent false
31149 8770 Acked Write 3 Done Done Sent false
31150 8771 Acked Read 5 Done Done Sent false
31151 8772 Acked Write 10 Done Done Sent false
31152 8773 Acked Read 3 Done Done Sent false
31153 8774 Acked Read 9 Done Done Sent false
31154 8775 Acked Write 5 Done Done Sent false
31155 8776 Acked Write 2 Done Done Sent false
31156 8777 Acked Read 3 Done Done Sent false
31157 8778 Acked Read 9 Done Done Sent false
31158 8779 Acked Read 4 Done Done Sent false
31159 8780 Acked Write 8 Done Done Sent false
31160 8781 Acked Read 8 Done Done Sent false
31161 8782 Acked Read 3 Done Done Sent false
31162 8783 Acked Read 9 Done Done Sent false
31163 8784 Acked Write 10 Done Done Sent false
31164 8785 Acked Write 5 Done Done Sent false
31165 8786 Acked Read 2 Done Done Sent false
31166 8787 Acked Read 1 Done Done Sent false
31167 8788 Acked Write 3 Done Done Sent false
31168 8789 Acked Flush 0 Done Done Sent false
31169 8790 Acked Read 3 Done Done Sent false
31170 8791 Acked Write 6 Done Done Sent false
31171 8792 Acked Write 9 Done Done Sent false
31172 8793 Acked Write 4 Done Done Sent false
31173 8794 Acked Write 10 Done Done Sent false
31174 8795 Acked Read 8 Done Done Sent false
31175 8796 Acked Write 9 Done Done Sent false
31176 8797 Acked Write 5 Done Done Sent false
31177 8798 Acked Write 10 Done Done Sent false
31178 8799 Acked Read 1 Done Done Sent false
31179 8800 Acked Read 2 Done Done Sent false
31180 8801 Acked Write 4 Done Done Sent false
31181 8802 Acked Flush 0 Done Done Sent false
31182 8803 Acked Read 10 Done Done Sent false
31183 8804 Acked Read 6 Done Done Sent false
31184 8805 Acked Read 10 Done Done Sent false
31185 8806 Acked Read 6 Done Done Sent false
31186 8807 Acked Read 9 Done Done Sent false
31187 8808 Acked Write 4 Done Done Sent false
31188 8809 Acked Read 4 Done Done Sent false
31189 8810 Acked Write 5 Done Done Sent false
31190 8811 Acked Write 4 Done Done Sent false
31191 8812 Acked Write 10 Done Done Sent false
31192 8813 Acked Flush 0 Done Done Sent false
31193 8814 Acked Read 10 Done Done Sent false
31194 8815 Acked Write 10 Done Done Sent false
31195 8816 Acked Write 2 Done Done Sent false
31196 8817 Acked Read 10 Done Done Sent false
31197 8818 Acked Write 2 Done Done Sent false
31198 8819 Acked Read 5 Done Done Sent false
31199 8820 Acked Read 4 Done Done Sent false
31200 8821 Acked Write 1 Done Done Sent false
31201 8822 Acked Write 9 Done Done Sent false
31202 8823 Acked Flush 0 Done Done Sent false
31203 8824 Acked Read 10 Done Done Sent false
31204 8825 Acked Write 4 Done Done Sent false
31205 8826 Acked Write 6 Done Done Sent false
31206 8827 Acked Read 9 Done Done Sent false
31207 8828 Acked Read 10 Done Done Sent false
31208 8829 Acked Read 5 Done Done Sent false
31209 8830 Acked Read 10 Done Done Sent false
31210 8831 Acked Read 5 Done Done Sent false
31211 8832 Acked Flush 0 Done Done Sent false
31212 8833 Acked Write 8 Done Done Sent false
31213 8834 Acked Flush 0 Done Done Sent false
31214 8835 Acked Write 1 Done Done Sent false
31215 8836 Acked Write 9 Done Done Sent false
31216 8837 Acked Write 6 Done Done Sent false
31217 8838 Acked Read 1 Done Done Sent false
31218 8839 Acked Write 10 Done Done Sent false
31219 8840 Acked Read 3 Done Done Sent false
31220 8841 Acked Read 8 Done Done Sent false
31221 8842 Acked Read 1 Done Done Sent false
31222 8843 Acked Read 4 Done Done Sent false
31223 8844 Acked Read 8 Done Done Sent false
31224 8845 Acked Write 5 Done Done Sent false
31225 8846 Acked Write 7 Done Done Sent false
31226 8847 Acked Write 4 Done Done Sent false
31227 STATES DS:0 DS:1 DS:2 TOTAL
31228 Sent 0 0 301 301
31229 Done 301 301 0 602
31230 Skipped 0 0 0 0
31231 Error 0 0 0 0
31232 Last Flush: 8834 8834 8546
31233 Downstairs last five completed: 8546 8545 8544 8543 8542
31234 Upstairs last five completed: 8847 8846 8845 8844 8843
31235 CLIENT: Up:0 ds:301 act:2
31236 [8830] got start action
31237 [8830] I am going to restart
31238 Starting downstairs at port 8830
31239 Make output file at "/tmp/dsc/downstairs-8830.txt"
31240 [8830][2] reports Starting
31241 Downstairs /var/tmp/dsc/region/8830 port 8830 PID:Some(1228)
31242 [8830][2] reports Running
31243 ----------------------------------------------------------------
31244 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:302
31245 States: Active Active Offline
31246 JOBID ACK TYPE BKS/EXT DS:0 DS:1 DS:2 REPLAY
31247 8547 Acked Read 6 Done Done Sent false
31248 8548 Acked Write 3 Done Done Sent false
31249 8549 Acked Read 1 Done Done Sent false
31250 8550 Acked Read 4 Done Done Sent false
31251 8551 Acked Write 1 Done Done Sent false
31252 8552 Acked Read 7 Done Done Sent false
31253 8553 Acked Write 5 Done Done Sent false
31254 8554 Acked Read 3 Done Done Sent false
31255 8555 Acked Read 6 Done Done Sent false
31256 8556 Acked Write 9 Done Done Sent false
31257 8557 Acked Write 1 Done Done Sent false
31258 8558 Acked Read 4 Done Done Sent false
31259 8559 Acked Read 6 Done Done Sent false
31260 8560 Acked Write 7 Done Done Sent false
31261 8561 Acked Read 3 Done Done Sent false
31262 8562 Acked Write 5 Done Done Sent false
31263 8563 Acked Flush 0 Done Done Sent false
31264 8564 Acked Write 1 Done Done Sent false
31265 8565 Acked Read 8 Done Done Sent false
31266 8566 Acked Read 4 Done Done Sent false
31267 8567 Acked Write 1 Done Done Sent false
31268 8568 Acked Read 10 Done Done Sent false
31269 8569 Acked Read 1 Done Done Sent false
31270 8570 Acked Write 8 Done Done Sent false
31271 8571 Acked Flush 0 Done Done Sent false
31272 8572 Acked Read 6 Done Done Sent false
31273 8573 Acked Write 10 Done Done Sent false
31274 8574 Acked Write 4 Done Done Sent false
31275 8575 Acked Write 8 Done Done Sent false
31276 8576 Acked Read 5 Done Done Sent false
31277 8577 Acked Read 10 Done Done Sent false
31278 8578 Acked Write 6 Done Done Sent false
31279 8579 Acked Flush 0 Done Done Sent false
31280 8580 Acked Read 6 Done Done Sent false
31281 8581 Acked Flush 0 Done Done Sent false
31282 8582 Acked Write 4 Done Done Sent false
31283 8583 Acked Read 6 Done Done Sent false
31284 8584 Acked Write 7 Done Done Sent false
31285 8585 Acked Read 3 Done Done Sent false
31286 8586 Acked Flush 0 Done Done Sent false
31287 8587 Acked Read 6 Done Done Sent false
31288 8588 Acked Read 5 Done Done Sent false
31289 8589 Acked Write 6 Done Done Sent false
31290 8590 Acked Read 6 Done Done Sent false
31291 8591 Acked Flush 0 Done Done Sent false
31292 8592 Acked Flush 0 Done Done Sent false
31293 8593 Acked Write 7 Done Done Sent false
31294 8594 Acked Write 2 Done Done Sent false
31295 8595 Acked Read 9 Done Done Sent false
31296 8596 Acked Read 10 Done Done Sent false
31297 8597 Acked Write 10 Done Done Sent false
31298 8598 Acked Read 10 Done Done Sent false
31299 8599 Acked Read 10 Done Done Sent false
31300 8600 Acked Write 6 Done Done Sent false
31301 8601 Acked Flush 0 Done Done Sent false
31302 8602 Acked Read 8 Done Done Sent false
31303 8603 Acked Write 10 Done Done Sent false
31304 8604 Acked Read 10 Done Done Sent false
31305 8605 Acked Read 10 Done Done Sent false
31306 8606 Acked Write 4 Done Done Sent false
31307 8607 Acked Read 9 Done Done Sent false
31308 8608 Acked Read 1 Done Done Sent false
31309 8609 Acked Read 6 Done Done Sent false
31310 8610 Acked Write 7 Done Done Sent false
31311 8611 Acked Flush 0 Done Done Sent false
31312 8612 Acked Read 5 Done Done Sent false
31313 8613 Acked Write 6 Done Done Sent false
31314 8614 Acked Read 5 Done Done Sent false
31315 8615 Acked Write 2 Done Done Sent false
31316 8616 Acked Flush 0 Done Done Sent false
31317 8617 Acked Write 2 Done Done Sent false
31318 8618 Acked Read 6 Done Done Sent false
31319 8619 Acked Flush 0 Done Done Sent false
31320 8620 Acked Write 7 Done Done Sent false
31321 8621 Acked Read 1 Done Done Sent false
31322 8622 Acked Write 5 Done Done Sent false
31323 8623 Acked Write 9 Done Done Sent false
31324 8624 Acked Write 5 Done Done Sent false
31325 8625 Acked Write 3 Done Done Sent false
31326 8626 Acked Flush 0 Done Done Sent false
31327 8627 Acked Write 4 Done Done Sent false
31328 8628 Acked Read 6 Done Done Sent false
31329 8629 Acked Flush 0 Done Done Sent false
31330 8630 Acked Write 3 Done Done Sent false
31331 8631 Acked Read 1 Done Done Sent false
31332 8632 Acked Write 8 Done Done Sent false
31333 8633 Acked Flush 0 Done Done Sent false
31334 8634 Acked Write 2 Done Done Sent false
31335 8635 Acked Write 3 Done Done Sent false
31336 8636 Acked Read 9 Done Done Sent false
31337 8637 Acked Write 10 Done Done Sent false
31338 8638 Acked Read 4 Done Done Sent false
31339 8639 Acked Write 9 Done Done Sent false
31340 8640 Acked Read 8 Done Done Sent false
31341 8641 Acked Write 1 Done Done Sent false
31342 8642 Acked Write 1 Done Done Sent false
31343 8643 Acked Read 5 Done Done Sent false
31344 8644 Acked Read 7 Done Done Sent false
31345 8645 Acked Read 5 Done Done Sent false
31346 8646 Acked Write 9 Done Done Sent false
31347 8647 Acked Write 3 Done Done Sent false
31348 8648 Acked Write 9 Done Done Sent false
31349 8649 Acked Write 5 Done Done Sent false
31350 8650 Acked Write 5 Done Done Sent false
31351 8651 Acked Read 4 Done Done Sent false
31352 8652 Acked Read 6 Done Done Sent false
31353 8653 Acked Write 5 Done Done Sent false
31354 8654 Acked Read 5 Done Done Sent false
31355 8655 Acked Write 10 Done Done Sent false
31356 8656 Acked Read 2 Done Done Sent false
31357 8657 Acked Read 9 Done Done Sent false
31358 8658 Acked Flush 0 Done Done Sent false
31359 8659 Acked Write 3 Done Done Sent false
31360 8660 Acked Read 3 Done Done Sent false
31361 8661 Acked Read 9 Done Done Sent false
31362 8662 Acked Flush 0 Done Done Sent false
31363 8663 Acked Read 9 Done Done Sent false
31364 8664 Acked Write 8 Done Done Sent false
31365 8665 Acked Read 9 Done Done Sent false
31366 8666 Acked Read 2 Done Done Sent false
31367 8667 Acked Flush 0 Done Done Sent false
31368 8668 Acked Read 3 Done Done Sent false
31369 8669 Acked Write 10 Done Done Sent false
31370 8670 Acked Write 7 Done Done Sent false
31371 8671 Acked Write 4 Done Done Sent false
31372 8672 Acked Read 2 Done Done Sent false
31373 8673 Acked Write 1 Done Done Sent false
31374 8674 Acked Write 2 Done Done Sent false
31375 8675 Acked Flush 0 Done Done Sent false
31376 8676 Acked Read 9 Done Done Sent false
31377 8677 Acked Write 6 Done Done Sent false
31378 8678 Acked Write 10 Done Done Sent false
31379 8679 Acked Read 5 Done Done Sent false
31380 8680 Acked Read 6 Done Done Sent false
31381 8681 Acked Read 10 Done Done Sent false
31382 8682 Acked Read 1 Done Done Sent false
31383 8683 Acked Read 8 Done Done Sent false
31384 8684 Acked Write 9 Done Done Sent false
31385 8685 Acked Read 8 Done Done Sent false
31386 8686 Acked Flush 0 Done Done Sent false
31387 8687 Acked Read 8 Done Done Sent false
31388 8688 Acked Write 5 Done Done Sent false
31389 8689 Acked Read 4 Done Done Sent false
31390 8690 Acked Flush 0 Done Done Sent false
31391 8691 Acked Read 2 Done Done Sent false
31392 8692 Acked Read 10 Done Done Sent false
31393 8693 Acked Write 6 Done Done Sent false
31394 8694 Acked Read 1 Done Done Sent false
31395 8695 Acked Read 1 Done Done Sent false
31396 8696 Acked Read 6 Done Done Sent false
31397 8697 Acked Write 7 Done Done Sent false
31398 8698 Acked Read 4 Done Done Sent false
31399 8699 Acked Read 2 Done Done Sent false
31400 8700 Acked Read 5 Done Done Sent false
31401 8701 Acked Read 8 Done Done Sent false
31402 8702 Acked Read 3 Done Done Sent false
31403 8703 Acked Read 6 Done Done Sent false
31404 8704 Acked Write 1 Done Done Sent false
31405 8705 Acked Read 3 Done Done Sent false
31406 8706 Acked Read 10 Done Done Sent false
31407 8707 Acked Read 2 Done Done Sent false
31408 8708 Acked Write 1 Done Done Sent false
31409 8709 Acked Read 9 Done Done Sent false
31410 8710 Acked Read 6 Done Done Sent false
31411 8711 Acked Read 1 Done Done Sent false
31412 8712 Acked Flush 0 Done Done Sent false
31413 8713 Acked Write 6 Done Done Sent false
31414 8714 Acked Write 6 Done Done Sent false
31415 8715 Acked Read 1 Done Done Sent false
31416 8716 Acked Write 10 Done Done Sent false
31417 8717 Acked Write 3 Done Done Sent false
31418 8718 Acked Read 7 Done Done Sent false
31419 8719 Acked Read 1 Done Done Sent false
31420 8720 Acked Write 7 Done Done Sent false
31421 8721 Acked Read 1 Done Done Sent false
31422 8722 Acked Write 10 Done Done Sent false
31423 8723 Acked Write 2 Done Done Sent false
31424 8724 Acked Write 2 Done Done Sent false
31425 8725 Acked Read 5 Done Done Sent false
31426 8726 Acked Read 4 Done Done Sent false
31427 8727 Acked Read 3 Done Done Sent false
31428 8728 Acked Write 1 Done Done Sent false
31429 8729 Acked Read 2 Done Done Sent false
31430 8730 Acked Write 8 Done Done Sent false
31431 8731 Acked Read 5 Done Done Sent false
31432 8732 Acked Write 2 Done Done Sent false
31433 8733 Acked Flush 0 Done Done Sent false
31434 8734 Acked Read 3 Done Done Sent false
31435 8735 Acked Read 8 Done Done Sent false
31436 8736 Acked Read 7 Done Done Sent false
31437 8737 Acked Write 5 Done Done Sent false
31438 8738 Acked Write 7 Done Done Sent false
31439 8739 Acked Write 3 Done Done Sent false
31440 8740 Acked Write 3 Done Done Sent false
31441 8741 Acked Read 8 Done Done Sent false
31442 8742 Acked Flush 0 Done Done Sent false
31443 8743 Acked Write 8 Done Done Sent false
31444 8744 Acked Flush 0 Done Done Sent false
31445 8745 Acked Flush 0 Done Done Sent false
31446 8746 Acked Write 5 Done Done Sent false
31447 8747 Acked Write 6 Done Done Sent false
31448 8748 Acked Read 8 Done Done Sent false
31449 8749 Acked Write 7 Done Done Sent false
31450 8750 Acked Flush 0 Done Done Sent false
31451 8751 Acked Write 5 Done Done Sent false
31452 8752 Acked Read 5 Done Done Sent false
31453 8753 Acked Read 2 Done Done Sent false
31454 8754 Acked Read 5 Done Done Sent false
31455 8755 Acked Read 3 Done Done Sent false
31456 8756 Acked Write 4 Done Done Sent false
31457 8757 Acked Read 4 Done Done Sent false
31458 8758 Acked Read 10 Done Done Sent false
31459 8759 Acked Flush 0 Done Done Sent false
31460 8760 Acked Write 8 Done Done Sent false
31461 8761 Acked Flush 0 Done Done Sent false
31462 8762 Acked Read 3 Done Done Sent false
31463 8763 Acked Write 8 Done Done Sent false
31464 8764 Acked Write 7 Done Done Sent false
31465 8765 Acked Read 2 Done Done Sent false
31466 8766 Acked Read 10 Done Done Sent false
31467 8767 Acked Write 5 Done Done Sent false
31468 8768 Acked Read 2 Done Done Sent false
31469 8769 Acked Write 10 Done Done Sent false
31470 8770 Acked Write 3 Done Done Sent false
31471 8771 Acked Read 5 Done Done Sent false
31472 8772 Acked Write 10 Done Done Sent false
31473 8773 Acked Read 3 Done Done Sent false
31474 8774 Acked Read 9 Done Done Sent false
31475 8775 Acked Write 5 Done Done Sent false
31476 8776 Acked Write 2 Done Done Sent false
31477 8777 Acked Read 3 Done Done Sent false
31478 8778 Acked Read 9 Done Done Sent false
31479 8779 Acked Read 4 Done Done Sent false
31480 8780 Acked Write 8 Done Done Sent false
31481 8781 Acked Read 8 Done Done Sent false
31482 8782 Acked Read 3 Done Done Sent false
31483 8783 Acked Read 9 Done Done Sent false
31484 8784 Acked Write 10 Done Done Sent false
31485 8785 Acked Write 5 Done Done Sent false
31486 8786 Acked Read 2 Done Done Sent false
31487 8787 Acked Read 1 Done Done Sent false
31488 8788 Acked Write 3 Done Done Sent false
31489 8789 Acked Flush 0 Done Done Sent false
31490 8790 Acked Read 3 Done Done Sent false
31491 8791 Acked Write 6 Done Done Sent false
31492 8792 Acked Write 9 Done Done Sent false
31493 8793 Acked Write 4 Done Done Sent false
31494 8794 Acked Write 10 Done Done Sent false
31495 8795 Acked Read 8 Done Done Sent false
31496 8796 Acked Write 9 Done Done Sent false
31497 8797 Acked Write 5 Done Done Sent false
31498 8798 Acked Write 10 Done Done Sent false
31499 8799 Acked Read 1 Done Done Sent false
31500 8800 Acked Read 2 Done Done Sent false
31501 8801 Acked Write 4 Done Done Sent false
31502 8802 Acked Flush 0 Done Done Sent false
31503 8803 Acked Read 10 Done Done Sent false
31504 8804 Acked Read 6 Done Done Sent false
31505 8805 Acked Read 10 Done Done Sent false
31506 8806 Acked Read 6 Done Done Sent false
31507 8807 Acked Read 9 Done Done Sent false
31508 8808 Acked Write 4 Done Done Sent false
31509 8809 Acked Read 4 Done Done Sent false
31510 8810 Acked Write 5 Done Done Sent false
31511 8811 Acked Write 4 Done Done Sent false
31512 8812 Acked Write 10 Done Done Sent false
31513 8813 Acked Flush 0 Done Done Sent false
31514 8814 Acked Read 10 Done Done Sent false
31515 8815 Acked Write 10 Done Done Sent false
31516 8816 Acked Write 2 Done Done Sent false
31517 8817 Acked Read 10 Done Done Sent false
31518 8818 Acked Write 2 Done Done Sent false
31519 8819 Acked Read 5 Done Done Sent false
31520 8820 Acked Read 4 Done Done Sent false
31521 8821 Acked Write 1 Done Done Sent false
31522 8822 Acked Write 9 Done Done Sent false
31523 8823 Acked Flush 0 Done Done Sent false
31524 8824 Acked Read 10 Done Done Sent false
31525 8825 Acked Write 4 Done Done Sent false
31526 8826 Acked Write 6 Done Done Sent false
31527 8827 Acked Read 9 Done Done Sent false
31528 8828 Acked Read 10 Done Done Sent false
31529 8829 Acked Read 5 Done Done Sent false
31530 8830 Acked Read 10 Done Done Sent false
31531 8831 Acked Read 5 Done Done Sent false
31532 8832 Acked Flush 0 Done Done Sent false
31533 8833 Acked Write 8 Done Done Sent false
31534 8834 Acked Flush 0 Done Done Sent false
31535 8835 Acked Write 1 Done Done Sent false
31536 8836 Acked Write 9 Done Done Sent false
31537 8837 Acked Write 6 Done Done Sent false
31538 8838 Acked Read 1 Done Done Sent false
31539 8839 Acked Write 10 Done Done Sent false
31540 8840 Acked Read 3 Done Done Sent false
31541 8841 Acked Read 8 Done Done Sent false
31542 8842 Acked Read 1 Done Done Sent false
31543 8843 Acked Read 4 Done Done Sent false
31544 8844 Acked Read 8 Done Done Sent false
31545 8845 Acked Write 5 Done Done Sent false
31546 8846 Acked Write 7 Done Done Sent false
31547 8847 Acked Write 4 Done Done Sent false
31548 8848 Acked Flush 0 Done Done Sent false
31549 STATES DS:0 DS:1 DS:2 TOTAL
31550 Sent 0 0 302 302
31551 Done 302 302 0 604
31552 Skipped 0 0 0 0
31553 Error 0 0 0 0
31554 Last Flush: 8848 8848 8546
31555 Downstairs last five completed: 8546 8545 8544 8543 8542
31556 Upstairs last five completed: 8848 8847 8846 8845 8844
31557 CLIENT: Up:0 ds:302 act:2
315582025-01-10T16:41:55.887ZINFOcrucible: connecting to 127.0.0.1:8830 = io task client = 2 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
315592025-01-10T16:41:55.887ZINFOcrucible: ds_connection connected from Ok(127.0.0.1:60014) = io task client = 2 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
315602025-01-10T16:41:55.888ZWARNcrucible: version negotiation from state Offline = downstairs client = 2 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
315612025-01-10T16:41:55.889ZINFOcrucible: downstairs client at Some(127.0.0.1:8830) has region UUID 12345678-0000-0000-0000-000000008830 = downstairs client = 2 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
315622025-01-10T16:41:55.889ZINFOcrucible: Returning UUID:12345678-0000-0000-0000-000000008830 matches = downstairs client = 2 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
315632025-01-10T16:41:55.889ZINFOcrucible: send last flush ID to this DS: 8546 = downstairs client = 2 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
315642025-01-10T16:41:55.889ZINFOcrucible: Replied this last flush ID: 8546 = downstairs client = 2 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
315652025-01-10T16:41:55.889ZINFOcrucible: ds_transition from Offline to Active = downstairs client = 2 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
315662025-01-10T16:41:55.889ZINFOcrucible: [2] Transition from Offline to Active = downstairs client = 2 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
315672025-01-10T16:41:55.889ZINFOcrucible: [2] client re-new 302 jobs since flush 8546 = downstairs session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
315682025-01-10T16:41:55.889ZINFOcrucible: [2] Replayed 302 jobs since flush: 8546 = downstairs session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
31569 ----------------------------------------------------------------
31570 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:0
31571 Downstairs last five completed: 8848 8847 8846 8845 8844
31572 Upstairs last five completed: 8848 8847 8846 8845 8844
31573 CLIENT: Up:0 ds:0 act:3
31574 Replay: All jobs finished
31575 Main task has work to do, go find it
31576 got dsc Stop(1)
31577 stop 1
31578 Jan 10 16:41:58.132[8820] Got stop action so:false kr:false
31579 INFO request completed, latency_us: 354, response_code: 204, uri: /stop/cid/1, method: POST, req_id: c4142646-48c4-49ca-91d6-735105b1bd46, remote_addr: 127.0.0.1:55917, local_addr: 127.0.0.1:9998
315802025-01-10T16:41:58.133ZWARNcrucible: downstairs disconnected = io task client = 1 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
315812025-01-10T16:41:58.133ZWARNcrucible: client task is sending Done(Finished) = io task client = 1 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
315822025-01-10T16:41:58.133ZWARNcrucible: downstairs task for 1 stopped due to Finished session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
31583 Jan 10 16:41:58.133 INFO request completed, latency_us: 143, {"msg":"ds_transition from Active to Offline","v":0,"name":"crucible","level":30,"time":"2025-01-10T16:41:58.133574122Z","hostname":"w-01JH8H1N3KXZ9F8ZV6CCMP5KTQ","pid":1202,"client":"1","":"downstairs","session_id":"1df3ca91-4dc9-42d6-9897-461254b5afe2"}
31584 response_code: 200, uri: /state/cid/1, method: GET, {"msg":"[1] Transition from Active to Offline","v":0,"name":"crucible","level":30,"time":"2025-01-10T16:41:58.133590931Z","hostname":"w-01JH8H1N3KXZ9F8ZV6CCMP5KTQ","pid":1202,"client":"1","":"downstairs","session_id":"1df3ca91-4dc9-42d6-9897-461254b5afe2"}
31585 req_id: ad8853e9-d603-4322-81e8-f672a61f989b, remote_addr: 127.0.0.1:55917, local_addr: 127.0.0.1:9998
315862025-01-10T16:41:58.133ZINFOcrucible: client task is exiting = io task client = 1 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
31587 [8820] Exited with: ExitStatus(unix_wait_status(9))
31588 [8820][1] reports Exit
31589 Jan 10 16:42:02.136 INFO request completed, latency_us: 306, response_code: 200, uri: /state/cid/1, method: GET, req_id: 07f48315-fda3-40f4-a963-f274bee7a3b8, remote_addr: 127.0.0.1:55917, local_addr: 127.0.0.1:9998
31590 001/300 Read block 4725 len 24576
31591 002/300 Read block 4773 len 40960
31592 003/300 Write block 2107 len 32768 data: 3 3 3 4 6 6 7 8
31593 004/300 Read block 2277 len 20480
31594 005/300 Read block 2187 len 28672
31595 006/300 Write block 3662 len 36864 data: 3 4 5 5 4 4 3 5 7
31596 007/300 Write block 3893 len 20480 data: 4 3 5 5 6
31597 008/300 Write block 1030 len 8192 data: 11 10
31598 009/300 Write block 903 len 40960 data: 2 3 2 2 2 5 8 7 6 6
31599 010/300 Write block 1760 len 12288 data: 8 9 9
31600 011/300 Flush
31601 012/300 Read block 253 len 20480
31602 013/300 Write block 836 len 28672 data: 5 7 7 7 8 8 8
31603 014/300 Write block 4414 len 12288 data: 6 5 5
31604 015/300 Read block 3816 len 16384
31605 016/300 Read block 2765 len 8192
31606 017/300 Write block 4252 len 40960 data: 6 5 4 4 4 3 3 3 3 4
31607 018/300 Read block 1283 len 36864
31608 019/300 Write block 3895 len 28672 data: 6 6 7 6 7 7 4
31609 020/300 Write block 4901 len 12288 data: 5 5 6
31610 021/300 Write block 2216 len 12288 data: 3 2 2
31611 022/300 Read block 3722 len 12288
31612 023/300 Write block 1562 len 20480 data: 6 5 6 5 4
31613 024/300 Write block 2246 len 40960 data: 10 10 11 10 10 9 5 5 4 4
31614 025/300 Read block 3468 len 16384
31615 026/300 Flush
31616 027/300 Read block 1971 len 32768
31617 028/300 Write block 3977 len 8192 data: 7 7
31618 029/300 Read block 2737 len 36864
31619 030/300 Write block 3393 len 32768 data: 6 6 5 4 4 7 7 9
31620 031/300 Read block 4077 len 12288
31621 032/300 Write block 4709 len 24576 data: 5 5 5 5 4 4
31622 033/300 Write block 2503 len 16384 data: 4 6 7 9
31623 034/300 Write block 417 len 16384 data: 5 5 4 4
31624 035/300 Read block 2976 len 8192
31625 036/300 Read block 1901 len 8192
31626 037/300 Read block 599 len 8192
31627 038/300 Read block 3754 len 12288
31628 039/300 Read block 1439 len 24576
31629 040/300 Flush
31630 041/300 Read block 4662 len 28672
31631 042/300 Read block 8 len 16384
31632 043/300 Read block 654 len 24576
31633 044/300 Read block 2715 len 32768
31634 045/300 Write block 1021 len 36864 data: 7 8 6 7 7 7 8 7 10
31635 046/300 Read block 3371 len 16384
31636 047/300 Write block 1451 len 24576 data: 3 4 6 6 6 5
31637 048/300 Read block 3958 len 40960
31638 049/300 Write block 700 len 16384 data: 6 7 6 6
31639 050/300 Write block 4147 len 20480 data: 7 10 10 10 9
31640 051/300 Read block 4051 len 8192
31641 052/300 Read block 1205 len 20480
31642 053/300 Write block 2438 len 36864 data: 3 5 7 6 6 7 7 6 7
31643 054/300 Read block 222 len 20480
31644 055/300 Read block 3397 len 20480
31645 056/300 Write block 971 len 4096 data: 8
31646 057/300 Write block 4275 len 36864 data: 5 5 6 5 4 6 7 7 6
31647 058/300 Read block 4803 len 16384
31648 059/300 Write block 268 len 16384 data: 6 6 7 7
31649 060/300 Read block 1202 len 40960
31650 061/300 Flush
31651 062/300 Read block 4212 len 28672
31652 063/300 Flush
31653 064/300 Read block 3180 len 4096
31654 065/300 Flush
31655 066/300 Write block 3191 len 4096 data: 5
31656 067/300 Read block 0 len 20480
31657 068/300 Write block 2653 len 36864 data: 2 3 5 5 5 4 5 3 3
31658 069/300 Write block 2073 len 12288 data: 7 7 6
31659 070/300 Write block 102 len 36864 data: 5 4 5 5 5 5 4 4 4
31660 071/300 Flush
31661 072/300 Write block 4976 len 32768 data: 5 6 5 7 7 6 5 5
31662 073/300 Read block 308 len 4096
31663 074/300 Read block 2525 len 12288
31664 075/300 Write block 1442 len 4096 data: 4
31665 076/300 Write block 3861 len 24576 data: 5 6 6 6 8 5
31666 077/300 Write block 731 len 40960 data: 4 7 8 6 5 5 5 6 7 6
31667 078/300 Read block 310 len 16384
31668 079/300 Write block 3408 len 40960 data: 6 7 5 6 7 6 5 5 5 5
31669 080/300 Read block 343 len 12288
31670 081/300 Write block 2915 len 24576 data: 6 5 6 5 6 6
31671 082/300 Read block 4868 len 4096
31672 083/300 Read block 965 len 28672
31673 084/300 Read block 2763 len 24576
31674 085/300 Write block 801 len 4096 data: 3
31675 086/300 Read block 1258 len 8192
31676 087/300 Write block 1042 len 16384 data: 3 4 3 3
31677 088/300 Write block 3232 len 8192 data: 3 4
31678 089/300 Read block 102 len 24576
31679 090/300 Read block 2442 len 4096
31680 091/300 Write block 311 len 40960 data: 7 5 4 5 6 6 7 6 7 5
31681 092/300 Flush
31682 093/300 Write block 4821 len 8192 data: 6 5
31683 094/300 Write block 1072 len 4096 data: 3
31684 095/300 Read block 238 len 4096
31685 096/300 Write block 2008 len 36864 data: 3 5 3 3 4 4 6 5 5
31686 097/300 Write block 2448 len 40960 data: 5 6 5 3 3 3 4 4 4 5
31687 098/300 Write block 4745 len 36864 data: 6 4 6 5 5 5 4 5 6
31688 099/300 Read block 2983 len 20480
31689 100/300 Write block 957 len 8192 data: 4 3
31690 101/300 Read block 1227 len 32768
31691 102/300 Read block 3813 len 4096
31692 103/300 Read block 1780 len 12288
31693 104/300 Read block 1525 len 24576
31694 105/300 Flush
31695 106/300 Write block 3518 len 32768 data: 3 3 4 5 5 5 5 5
31696 107/300 Write block 598 len 28672 data: 6 8 8 9 7 9 10
31697 108/300 Write block 1369 len 4096 data: 6
31698 109/300 Read block 3423 len 40960
31699 110/300 Write block 567 len 20480 data: 6 5 5 5 4
31700 111/300 Write block 4363 len 4096 data: 8
31701 112/300 Read block 4249 len 24576
31702 113/300 Read block 3069 len 16384
31703 114/300 Read block 81 len 8192
31704 115/300 Read block 4168 len 40960
31705 116/300 Read block 3991 len 28672
31706 117/300 Read block 1280 len 16384
31707 118/300 Flush
31708 119/300 Read block 374 len 36864
31709 120/300 Read block 2170 len 8192
31710 121/300 Read block 2897 len 24576
31711 122/300 Read block 2382 len 24576
31712 123/300 Read block 768 len 32768
31713 124/300 Read block 3251 len 28672
31714 125/300 Write block 4758 len 4096 data: 6
31715 126/300 Read block 1874 len 24576
31716 127/300 Read block 4924 len 4096
31717 128/300 Write block 362 len 40960 data: 4 3 5 5 5 6 6 7 7 6
31718 129/300 Write block 4698 len 28672 data: 3 5 6 5 5 6 7
31719 130/300 Flush
31720 131/300 Read block 4364 len 24576
31721 132/300 Read block 4672 len 4096
31722 133/300 Flush
31723 134/300 Read block 2164 len 8192
31724 135/300 Write block 3923 len 32768 data: 5 6 6 5 4 4 4 5
31725 136/300 Write block 274 len 8192 data: 5 5
31726 137/300 Write block 632 len 24576 data: 7 8 9 9 7 6
31727 138/300 Write block 3563 len 8192 data: 4 4
31728 139/300 Write block 2453 len 12288 data: 4 5 5
31729 140/300 Read block 3675 len 36864
31730 141/300 Write block 2236 len 4096 data: 6
31731 142/300 Read block 4550 len 20480
31732 143/300 Flush
31733 144/300 Write block 808 len 32768 data: 7 7 7 8 6 5 5 6
31734 145/300 Flush
31735 146/300 Write block 2996 len 20480 data: 6 5 6 5 6
31736 147/300 Flush
31737 148/300 Write block 991 len 36864 data: 4 5 5 4 4 4 6 5 5
31738 149/300 Read block 523 len 36864
31739 150/300 Read block 4850 len 20480
31740 151/300 Write block 3300 len 32768 data: 7 8 8 6 5 6 3 3
31741 152/300 Read block 1032 len 32768
31742 153/300 Write block 2977 len 36864 data: 5 6 7 7 6 5 4 6 7
31743 154/300 Write block 378 len 4096 data: 3
31744 155/300 Read block 4856 len 40960
31745 156/300 Write block 2499 len 8192 data: 4 4
31746 157/300 Read block 4906 len 40960
31747 158/300 Write block 3466 len 32768 data: 7 6 6 5 2 2 2 3
31748 159/300 Read block 4582 len 4096
31749 160/300 Read block 1958 len 36864
31750 161/300 Write block 3536 len 16384 data: 7 6 5 6
31751 162/300 Write block 3904 len 4096 data: 4
31752 163/300 Write block 1408 len 12288 data: 5 6 6
31753 164/300 Read block 4360 len 28672
31754 165/300 Read block 1400 len 32768
31755 166/300 Write block 1083 len 32768 data: 6 6 5 3 4 5 5 5
31756 167/300 Read block 4670 len 4096
31757 168/300 Read block 4225 len 32768
31758 169/300 Read block 5 len 40960
31759 170/300 Write block 793 len 20480 data: 7 7 6 6 5
31760 171/300 Write block 1095 len 12288 data: 5 7 9
31761 172/300 Read block 2044 len 16384
31762 173/300 Read block 619 len 36864
31763 174/300 Read block 4462 len 4096
31764 175/300 Read block 4459 len 12288
31765 176/300 Write block 2494 len 8192 data: 6 6
31766 177/300 Write block 3857 len 20480 data: 7 6 7 7 6
31767 178/300 Read block 1196 len 20480
31768 179/300 Read block 4631 len 20480
31769 180/300 Write block 4543 len 16384 data: 6 6 5 5
31770 181/300 Read block 2929 len 40960
31771 182/300 Read block 1985 len 40960
31772 183/300 Flush
31773 184/300 Read block 2658 len 36864
31774 185/300 Write block 931 len 4096 data: 7
31775 186/300 Write block 4582 len 40960 data: 5 6 5 4 3 4 4 4 5 5
31776 187/300 Read block 3342 len 20480
31777 188/300 Read block 4189 len 20480
31778 189/300 Read block 3500 len 40960
31779 190/300 Write block 716 len 12288 data: 3 4 4
31780 191/300 Read block 2495 len 12288
31781 192/300 Read block 3931 len 16384
31782 193/300 Read block 4595 len 20480
31783 194/300 Read block 4230 len 16384
31784 195/300 Write block 687 len 32768 data: 8 7 6 8 8 8 8 8
31785 196/300 Write block 2168 len 36864 data: 6 5 7 7 7 6 5 4 4
31786 197/300 Write block 2551 len 20480 data: 6 7 8 7 8
31787 198/300 Read block 3997 len 24576
31788 199/300 Read block 35 len 16384
31789 200/300 Write block 2573 len 32768 data: 4 4 3 3 2 3 3 4
31790 201/300 Flush
31791 202/300 Read block 3383 len 32768
31792 203/300 Flush
31793 204/300 Read block 717 len 8192
31794 205/300 Write block 1220 len 8192 data: 2 5
31795 206/300 Read block 2575 len 24576
31796 207/300 Flush
31797 208/300 Read block 3640 len 12288
31798 209/300 Write block 2902 len 40960 data: 10 7 7 5 4 4 5 5 6 7
31799 210/300 Read block 4458 len 24576
31800 211/300 Read block 761 len 12288
31801 212/300 Write block 4701 len 12288 data: 6 6 7
31802 213/300 Read block 2725 len 4096
31803 214/300 Write block 838 len 32768 data: 8 8 9 9 9 11 10 10
31804 215/300 Read block 3354 len 16384
31805 216/300 Write block 2080 len 8192 data: 6 6
31806 217/300 Read block 537 len 8192
31807 218/300 Read block 976 len 32768
31808 219/300 Read block 3522 len 28672
31809 220/300 Write block 1004 len 12288 data: 4 3 5
31810 221/300 Write block 4499 len 32768 data: 3 6 7 7 7 6 5 5
31811 222/300 Read block 2252 len 20480
31812 223/300 Read block 472 len 32768
31813 224/300 Read block 3461 len 16384
31814 225/300 Write block 2923 len 4096 data: 8
31815 226/300 Read block 4193 len 8192
31816 227/300 Write block 3314 len 4096 data: 8
31817 228/300 Write block 1250 len 36864 data: 2 2 3 3 4 5 4 4 5
31818 229/300 Read block 478 len 12288
31819 230/300 Read block 3455 len 12288
31820 231/300 Read block 3885 len 28672
31821 232/300 Read block 3206 len 4096
31822 233/300 Write block 541 len 16384 data: 4 5 7 7
31823 234/300 Write block 2169 len 20480 data: 6 8 8 8 7
31824 235/300 Write block 1379 len 8192 data: 5 6
31825 236/300 Write block 2457 len 24576 data: 6 5 4 3 3 3
31826 237/300 Read block 3463 len 24576
31827 238/300 Write block 2547 len 40960 data: 3 4 5 5 7 8 9 8 9 6
31828 239/300 Read block 550 len 40960
31829 240/300 Read block 334 len 40960
31830 241/300 Read block 3630 len 16384
31831 242/300 Read block 1143 len 28672
31832 243/300 Write block 1171 len 40960 data: 5 6 5 4 5 7 6 5 7 9
31833 244/300 Write block 81 len 20480 data: 5 4 4 3 2
31834 245/300 Read block 3139 len 36864
31835 246/300 Read block 1703 len 32768
31836 247/300 Write block 3001 len 12288 data: 7 5 6
31837 248/300 Read block 273 len 28672
31838 249/300 Write block 3995 len 16384 data: 7 7 6 5
31839 250/300 Read block 870 len 24576
31840 251/300 Read block 1022 len 28672
31841 252/300 Read block 12 len 12288
31842 253/300 Write block 2841 len 4096 data: 5
31843 254/300 Flush
31844 255/300 Write block 2137 len 20480 data: 5 4 5 7 9
31845 256/300 Write block 4761 len 20480 data: 4 4 7 6 5
31846 257/300 Flush
31847 258/300 Write block 685 len 28672 data: 8 7 9 8 7 9 9
31848 259/300 Write block 3938 len 16384 data: 6 6 6 6
31849 260/300 Read block 4953 len 32768
31850 261/300 Write block 1849 len 24576 data: 3 5 6 4 4 5
31851 262/300 Read block 4729 len 40960
31852 263/300 Read block 683 len 12288
31853 264/300 Write block 2789 len 28672 data: 5 4 3 2 2 4 5
31854 265/300 Read block 3521 len 36864
31855 266/300 Flush
31856 267/300 Write block 3142 len 12288 data: 6 4 5
31857 268/300 Read block 1266 len 28672
31858 269/300 Read block 3094 len 20480
31859 270/300 Write block 1393 len 24576 data: 8 7 5 4 2 3
31860 271/300 Read block 4747 len 8192
31861 272/300 Read block 3629 len 36864
31862 273/300 Read block 2404 len 36864
31863 274/300 Read block 2606 len 4096
31864 275/300 Write block 4379 len 8192 data: 8 7
31865 276/300 Read block 4356 len 8192
31866 277/300 Write block 1552 len 28672 data: 8 7 6 6 4 5 4
31867 278/300 Read block 2152 len 4096
31868 279/300 Read block 4501 len 24576
31869 280/300 Write block 2805 len 28672 data: 9 8 10 11 10 10 10
31870 281/300 Write block 404 len 40960 data: 5 6 6 6 6 7 6 5 6 6
31871 282/300 Write block 3167 len 28672 data: 7 8 8 8 7 6 5
31872 283/300 Read block 4520 len 40960
31873 284/300 Read block 2212 len 8192
31874 285/300 Write block 2857 len 4096 data: 4
31875 286/300 Read block 3086 len 16384
31876 287/300 Read block 3261 len 36864
31877 288/300 Write block 502 len 40960 data: 5 5 5 5 5 6 5 6 6 7
31878 289/300 Write block 3041 len 28672 data: 2 3 3 3 4 4 5
31879 290/300 Read block 2435 len 36864
31880 291/300 Read block 4451 len 12288
31881 292/300 Write block 1014 len 28672 data: 7 6 7 8 7 6 7
31882 293/300 Write block 4767 len 16384 data: 5 6 7 6
31883 294/300 Write block 3433 len 8192 data: 6 6
31884 295/300 Write block 4723 len 16384 data: 5 3 3 4
31885 296/300 Write block 1625 len 36864 data: 6 6 6 6 5 6 7 6 10
31886 297/300 Write block 3407 len 12288 data: 6 7 8
31887 298/300 Read block 3636 len 16384
31888 299/300 Read block 3601 len 40960
31889 300/300 Write block 398 len 32768 data: 3 3 3 4 4 4 6 7
31890 301/300 Write block 4000 len 4096 data: 4
31891 Main task has work to do, go find it
31892 got dsc Start(1)
31893 start 1
31894 Jan 10 16:42:02.370 INFO request completed, latency_us: 205, response_code: 204, uri: /start/cid/1, method: POST, req_id: 42a61728-7a45-400c-ab91-c28a15e737e3, remote_addr: 127.0.0.1:55917, local_addr: 127.0.0.1:9998
31895 Replay: started 1, returned:Ok(())
31896 ----------------------------------------------------------------
31897 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:301
31898 States: Active Offline Active
31899 JOBID ACK TYPE BKS/EXT DS:0 DS:1 DS:2 REPLAY
31900 8849 Acked Read 6 Done Sent Done false
31901 8850 Acked Read 10 Done Sent Done false
31902 8851 Acked Write 8 Done Sent Done false
31903 8852 Acked Read 5 Done Sent Done false
31904 8853 Acked Read 7 Done Sent Done false
31905 8854 Acked Write 9 Done Sent Done false
31906 8855 Acked Write 5 Done Sent Done false
31907 8856 Acked Write 2 Done Sent Done false
31908 8857 Acked Write 10 Done Sent Done false
31909 8858 Acked Write 3 Done Sent Done false
31910 8859 Acked Flush 0 Done Sent Done false
31911 8860 Acked Read 5 Done Sent Done false
31912 8861 Acked Write 7 Done Sent Done false
31913 8862 Acked Write 3 Done Sent Done false
31914 8863 Acked Read 4 Done Sent Done false
31915 8864 Acked Read 2 Done Sent Done false
31916 8865 Acked Write 10 Done Sent Done false
31917 8866 Acked Read 9 Done Sent Done false
31918 8867 Acked Write 7 Done Sent Done false
31919 8868 Acked Write 3 Done Sent Done false
31920 8869 Acked Write 3 Done Sent Done false
31921 8870 Acked Read 3 Done Sent Done false
31922 8871 Acked Write 5 Done Sent Done false
31923 8872 Acked Write 10 Done Sent Done false
31924 8873 Acked Read 4 Done Sent Done false
31925 8874 Acked Flush 0 Done Sent Done false
31926 8875 Acked Read 8 Done Sent Done false
31927 8876 Acked Write 2 Done Sent Done false
31928 8877 Acked Read 9 Done Sent Done false
31929 8878 Acked Write 8 Done Sent Done false
31930 8879 Acked Read 3 Done Sent Done false
31931 8880 Acked Write 6 Done Sent Done false
31932 8881 Acked Write 4 Done Sent Done false
31933 8882 Acked Write 4 Done Sent Done false
31934 8883 Acked Read 2 Done Sent Done false
31935 8884 Acked Read 2 Done Sent Done false
31936 8885 Acked Read 2 Done Sent Done false
31937 8886 Acked Read 3 Done Sent Done false
31938 8887 Acked Read 6 Done Sent Done false
31939 8888 Acked Flush 0 Done Sent Done false
31940 8889 Acked Read 7 Done Sent Done false
31941 8890 Acked Read 4 Done Sent Done false
31942 8891 Acked Read 6 Done Sent Done false
31943 8892 Acked Read 8 Done Sent Done false
31944 8893 Acked Write 9 Done Sent Done false
31945 8894 Acked Read 4 Done Sent Done false
31946 8895 Acked Write 6 Done Sent Done false
31947 8896 Acked Read 10 Done Sent Done false
31948 8897 Acked Write 4 Done Sent Done false
31949 8898 Acked Write 5 Done Sent Done false
31950 8899 Acked Read 2 Done Sent Done false
31951 8900 Acked Read 5 Done Sent Done false
31952 8901 Acked Write 9 Done Sent Done false
31953 8902 Acked Read 5 Done Sent Done false
31954 8903 Acked Read 5 Done Sent Done false
31955 8904 Acked Write 1 Done Sent Done false
31956 8905 Acked Write 9 Done Sent Done false
31957 8906 Acked Read 4 Done Sent Done false
31958 8907 Acked Write 4 Done Sent Done false
31959 8908 Acked Read 10 Done Sent Done false
31960 8909 Acked Flush 0 Done Sent Done false
31961 8910 Acked Read 7 Done Sent Done false
31962 8911 Acked Flush 0 Done Sent Done false
31963 8912 Acked Read 1 Done Sent Done false
31964 8913 Acked Flush 0 Done Sent Done false
31965 8914 Acked Write 1 Done Sent Done false
31966 8915 Acked Read 5 Done Sent Done false
31967 8916 Acked Write 9 Done Sent Done false
31968 8917 Acked Write 3 Done Sent Done false
31969 8918 Acked Write 9 Done Sent Done false
31970 8919 Acked Flush 0 Done Sent Done false
31971 8920 Acked Write 8 Done Sent Done false
31972 8921 Acked Read 1 Done Sent Done false
31973 8922 Acked Read 3 Done Sent Done false
31974 8923 Acked Write 1 Done Sent Done false
31975 8924 Acked Write 6 Done Sent Done false
31976 8925 Acked Write 10 Done Sent Done false
31977 8926 Acked Read 4 Done Sent Done false
31978 8927 Acked Write 10 Done Sent Done false
31979 8928 Acked Read 3 Done Sent Done false
31980 8929 Acked Write 6 Done Sent Done false
31981 8930 Acked Read 1 Done Sent Done false
31982 8931 Acked Read 7 Done Sent Done false
31983 8932 Acked Read 6 Done Sent Done false
31984 8933 Acked Write 1 Done Sent Done false
31985 8934 Acked Read 2 Done Sent Done false
31986 8935 Acked Write 4 Done Sent Done false
31987 8936 Acked Write 2 Done Sent Done false
31988 8937 Acked Read 6 Done Sent Done false
31989 8938 Acked Read 1 Done Sent Done false
31990 8939 Acked Write 10 Done Sent Done false
31991 8940 Acked Flush 0 Done Sent Done false
31992 8941 Acked Write 2 Done Sent Done false
31993 8942 Acked Write 1 Done Sent Done false
31994 8943 Acked Read 1 Done Sent Done false
31995 8944 Acked Write 9 Done Sent Done false
31996 8945 Acked Write 10 Done Sent Done false
31997 8946 Acked Write 9 Done Sent Done false
31998 8947 Acked Read 5 Done Sent Done false
31999 8948 Acked Write 2 Done Sent Done false
32000 8949 Acked Read 8 Done Sent Done false
32001 8950 Acked Read 1 Done Sent Done false
32002 8951 Acked Read 3 Done Sent Done false
32003 8952 Acked Read 6 Done Sent Done false
32004 8953 Acked Flush 0 Done Sent Done false
32005 8954 Acked Write 8 Done Sent Done false
32006 8955 Acked Write 7 Done Sent Done false
32007 8956 Acked Write 1 Done Sent Done false
32008 8957 Acked Read 10 Done Sent Done false
32009 8958 Acked Write 5 Done Sent Done false
32010 8959 Acked Write 1 Done Sent Done false
32011 8960 Acked Read 6 Done Sent Done false
32012 8961 Acked Read 4 Done Sent Done false
32013 8962 Acked Read 2 Done Sent Done false
32014 8963 Acked Read 10 Done Sent Done false
32015 8964 Acked Read 7 Done Sent Done false
32016 8965 Acked Read 4 Done Sent Done false
32017 8966 Acked Flush 0 Done Sent Done false
32018 8967 Acked Read 9 Done Sent Done false
32019 8968 Acked Read 2 Done Sent Done false
32020 8969 Acked Read 6 Done Sent Done false
32021 8970 Acked Read 6 Done Sent Done false
32022 8971 Acked Read 8 Done Sent Done false
32023 8972 Acked Read 7 Done Sent Done false
32024 8973 Acked Write 1 Done Sent Done false
32025 8974 Acked Read 6 Done Sent Done false
32026 8975 Acked Read 1 Done Sent Done false
32027 8976 Acked Write 10 Done Sent Done false
32028 8977 Acked Write 7 Done Sent Done false
32029 8978 Acked Flush 0 Done Sent Done false
32030 8979 Acked Read 6 Done Sent Done false
32031 8980 Acked Read 1 Done Sent Done false
32032 8981 Acked Flush 0 Done Sent Done false
32033 8982 Acked Read 2 Done Sent Done false
32034 8983 Acked Write 8 Done Sent Done false
32035 8984 Acked Write 2 Done Sent Done false
32036 8985 Acked Write 6 Done Sent Done false
32037 8986 Acked Write 2 Done Sent Done false
32038 8987 Acked Write 3 Done Sent Done false
32039 8988 Acked Read 9 Done Sent Done false
32040 8989 Acked Write 1 Done Sent Done false
32041 8990 Acked Read 5 Done Sent Done false
32042 8991 Acked Flush 0 Done Sent Done false
32043 8992 Acked Write 8 Done Sent Done false
32044 8993 Acked Flush 0 Done Sent Done false
32045 8994 Acked Write 5 Done Sent Done false
32046 8995 Acked Flush 0 Done Sent Done false
32047 8996 Acked Write 9 Done Sent Done false
32048 8997 Acked Read 9 Done Sent Done false
32049 8998 Acked Read 5 Done Sent Done false
32050 8999 Acked Write 8 Done Sent Done false
32051 9000 Acked Read 8 Done Sent Done false
32052 9001 Acked Write 9 Done Sent Done false
32053 9002 Acked Write 1 Done Sent Done false
32054 9003 Acked Read 10 Done Sent Done false
32055 9004 Acked Write 2 Done Sent Done false
32056 9005 Acked Read 10 Done Sent Done false
32057 9006 Acked Write 8 Done Sent Done false
32058 9007 Acked Read 1 Done Sent Done false
32059 9008 Acked Read 9 Done Sent Done false
32060 9009 Acked Write 4 Done Sent Done false
32061 9010 Acked Write 1 Done Sent Done false
32062 9011 Acked Write 3 Done Sent Done false
32063 9012 Acked Read 7 Done Sent Done false
32064 9013 Acked Read 8 Done Sent Done false
32065 9014 Acked Write 8 Done Sent Done false
32066 9015 Acked Read 1 Done Sent Done false
32067 9016 Acked Read 8 Done Sent Done false
32068 9017 Acked Read 10 Done Sent Done false
32069 9018 Acked Write 5 Done Sent Done false
32070 9019 Acked Write 3 Done Sent Done false
32071 9020 Acked Read 4 Done Sent Done false
32072 9021 Acked Read 9 Done Sent Done false
32073 9022 Acked Read 1 Done Sent Done false
32074 9023 Acked Read 3 Done Sent Done false
32075 9024 Acked Write 2 Done Sent Done false
32076 9025 Acked Write 5 Done Sent Done false
32077 9026 Acked Read 5 Done Sent Done false
32078 9027 Acked Read 5 Done Sent Done false
32079 9028 Acked Write 4 Done Sent Done false
32080 9029 Acked Read 10 Done Sent Done false
32081 9030 Acked Read 10 Done Sent Done false
32082 9031 Acked Flush 0 Done Sent Done false
32083 9032 Acked Read 9 Done Sent Done false
32084 9033 Acked Write 1 Done Sent Done false
32085 9034 Acked Write 10 Done Sent Done false
32086 9035 Acked Read 5 Done Sent Done false
32087 9036 Acked Read 5 Done Sent Done false
32088 9037 Acked Read 10 Done Sent Done false
32089 9038 Acked Write 3 Done Sent Done false
32090 9039 Acked Read 3 Done Sent Done false
32091 9040 Acked Read 4 Done Sent Done false
32092 9041 Acked Read 5 Done Sent Done false
32093 9042 Acked Read 4 Done Sent Done false
32094 9043 Acked Write 8 Done Sent Done false
32095 9044 Acked Write 9 Done Sent Done false
32096 9045 Acked Write 5 Done Sent Done false
32097 9046 Acked Read 6 Done Sent Done false
32098 9047 Acked Read 4 Done Sent Done false
32099 9048 Acked Write 8 Done Sent Done false
32100 9049 Acked Flush 0 Done Sent Done false
32101 9050 Acked Read 8 Done Sent Done false
32102 9051 Acked Flush 0 Done Sent Done false
32103 9052 Acked Read 2 Done Sent Done false
32104 9053 Acked Write 2 Done Sent Done false
32105 9054 Acked Read 6 Done Sent Done false
32106 9055 Acked Flush 0 Done Sent Done false
32107 9056 Acked Read 3 Done Sent Done false
32108 9057 Acked Write 10 Done Sent Done false
32109 9058 Acked Read 6 Done Sent Done false
32110 9059 Acked Read 3 Done Sent Done false
32111 9060 Acked Write 3 Done Sent Done false
32112 9061 Acked Read 1 Done Sent Done false
32113 9062 Acked Write 8 Done Sent Done false
32114 9063 Acked Read 4 Done Sent Done false
32115 9064 Acked Write 2 Done Sent Done false
32116 9065 Acked Read 2 Done Sent Done false
32117 9066 Acked Read 8 Done Sent Done false
32118 9067 Acked Read 7 Done Sent Done false
32119 9068 Acked Write 3 Done Sent Done false
32120 9069 Acked Write 8 Done Sent Done false
32121 9070 Acked Read 5 Done Sent Done false
32122 9071 Acked Read 8 Done Sent Done false
32123 9072 Acked Read 4 Done Sent Done false
32124 9073 Acked Write 1 Done Sent Done false
32125 9074 Acked Read 2 Done Sent Done false
32126 9075 Acked Write 1 Done Sent Done false
32127 9076 Acked Write 9 Done Sent Done false
32128 9077 Acked Read 3 Done Sent Done false
32129 9078 Acked Read 3 Done Sent Done false
32130 9079 Acked Read 7 Done Sent Done false
32131 9080 Acked Read 1 Done Sent Done false
32132 9081 Acked Write 4 Done Sent Done false
32133 9082 Acked Write 5 Done Sent Done false
32134 9083 Acked Write 2 Done Sent Done false
32135 9084 Acked Write 6 Done Sent Done false
32136 9085 Acked Read 6 Done Sent Done false
32137 9086 Acked Write 10 Done Sent Done false
32138 9087 Acked Read 10 Done Sent Done false
32139 9088 Acked Read 10 Done Sent Done false
32140 9089 Acked Read 4 Done Sent Done false
32141 9090 Acked Read 7 Done Sent Done false
32142 9091 Acked Write 10 Done Sent Done false
32143 9092 Acked Write 5 Done Sent Done false
32144 9093 Acked Read 9 Done Sent Done false
32145 9094 Acked Read 8 Done Sent Done false
32146 9095 Acked Write 3 Done Sent Done false
32147 9096 Acked Read 7 Done Sent Done false
32148 9097 Acked Write 4 Done Sent Done false
32149 9098 Acked Read 6 Done Sent Done false
32150 9099 Acked Read 7 Done Sent Done false
32151 9100 Acked Read 3 Done Sent Done false
32152 9101 Acked Write 1 Done Sent Done false
32153 9102 Acked Flush 0 Done Sent Done false
32154 9103 Acked Write 5 Done Sent Done false
32155 9104 Acked Write 5 Done Sent Done false
32156 9105 Acked Flush 0 Done Sent Done false
32157 9106 Acked Write 7 Done Sent Done false
32158 9107 Acked Write 4 Done Sent Done false
32159 9108 Acked Read 8 Done Sent Done false
32160 9109 Acked Write 6 Done Sent Done false
32161 9110 Acked Read 10 Done Sent Done false
32162 9111 Acked Read 3 Done Sent Done false
32163 9112 Acked Write 7 Done Sent Done false
32164 9113 Acked Read 9 Done Sent Done false
32165 9114 Acked Flush 0 Done Sent Done false
32166 9115 Acked Write 3 Done Sent Done false
32167 9116 Acked Read 7 Done Sent Done false
32168 9117 Acked Read 5 Done Sent Done false
32169 9118 Acked Write 6 Done Sent Done false
32170 9119 Acked Read 2 Done Sent Done false
32171 9120 Acked Read 9 Done Sent Done false
32172 9121 Acked Read 9 Done Sent Done false
32173 9122 Acked Read 1 Done Sent Done false
32174 9123 Acked Write 2 Done Sent Done false
32175 9124 Acked Read 2 Done Sent Done false
32176 9125 Acked Write 7 Done Sent Done false
32177 9126 Acked Read 1 Done Sent Done false
32178 9127 Acked Read 6 Done Sent Done false
32179 9128 Acked Write 7 Done Sent Done false
32180 9129 Acked Write 10 Done Sent Done false
32181 9130 Acked Write 7 Done Sent Done false
32182 9131 Acked Read 10 Done Sent Done false
32183 9132 Acked Read 2 Done Sent Done false
32184 9133 Acked Write 1 Done Sent Done false
32185 9134 Acked Read 4 Done Sent Done false
32186 9135 Acked Read 9 Done Sent Done false
32187 9136 Acked Write 10 Done Sent Done false
32188 9137 Acked Write 7 Done Sent Done false
32189 9138 Acked Read 9 Done Sent Done false
32190 9139 Acked Read 3 Done Sent Done false
32191 9140 Acked Write 7 Done Sent Done false
32192 9141 Acked Write 4 Done Sent Done false
32193 9142 Acked Write 2 Done Sent Done false
32194 9143 Acked Write 4 Done Sent Done false
32195 9144 Acked Write 9 Done Sent Done false
32196 9145 Acked Write 3 Done Sent Done false
32197 9146 Acked Read 4 Done Sent Done false
32198 9147 Acked Read 10 Done Sent Done false
32199 9148 Acked Write 8 Done Sent Done false
32200 9149 Acked Write 1 Done Sent Done false
32201 STATES DS:0 DS:1 DS:2 TOTAL
32202 Sent 0 301 0 301
32203 Done 301 0 301 602
32204 Skipped 0 0 0 0
32205 Error 0 0 0 0
32206 Last Flush: 9114 8848 9114
32207 Downstairs last five completed: 8848 8847 8846 8845 8844
32208 Upstairs last five completed: 9149 9148 9147 9146 9145
32209 CLIENT: Up:0 ds:301 act:2
32210 [8820] got start action
32211 [8820] I am going to restart
32212 Starting downstairs at port 8820
32213 Make output file at "/tmp/dsc/downstairs-8820.txt"
32214 [8820][1] reports Starting
32215 Downstairs /var/tmp/dsc/region/8820 port 8820 PID:Some(1229)
32216 [8820][1] reports Running
32217 ----------------------------------------------------------------
32218 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:302
32219 States: Active Offline Active
32220 JOBID ACK TYPE BKS/EXT DS:0 DS:1 DS:2 REPLAY
32221 8849 Acked Read 6 Done Sent Done false
32222 8850 Acked Read 10 Done Sent Done false
32223 8851 Acked Write 8 Done Sent Done false
32224 8852 Acked Read 5 Done Sent Done false
32225 8853 Acked Read 7 Done Sent Done false
32226 8854 Acked Write 9 Done Sent Done false
32227 8855 Acked Write 5 Done Sent Done false
32228 8856 Acked Write 2 Done Sent Done false
32229 8857 Acked Write 10 Done Sent Done false
32230 8858 Acked Write 3 Done Sent Done false
32231 8859 Acked Flush 0 Done Sent Done false
32232 8860 Acked Read 5 Done Sent Done false
32233 8861 Acked Write 7 Done Sent Done false
32234 8862 Acked Write 3 Done Sent Done false
32235 8863 Acked Read 4 Done Sent Done false
32236 8864 Acked Read 2 Done Sent Done false
32237 8865 Acked Write 10 Done Sent Done false
32238 8866 Acked Read 9 Done Sent Done false
32239 8867 Acked Write 7 Done Sent Done false
32240 8868 Acked Write 3 Done Sent Done false
32241 8869 Acked Write 3 Done Sent Done false
32242 8870 Acked Read 3 Done Sent Done false
32243 8871 Acked Write 5 Done Sent Done false
32244 8872 Acked Write 10 Done Sent Done false
32245 8873 Acked Read 4 Done Sent Done false
32246 8874 Acked Flush 0 Done Sent Done false
32247 8875 Acked Read 8 Done Sent Done false
32248 8876 Acked Write 2 Done Sent Done false
32249 8877 Acked Read 9 Done Sent Done false
32250 8878 Acked Write 8 Done Sent Done false
32251 8879 Acked Read 3 Done Sent Done false
32252 8880 Acked Write 6 Done Sent Done false
32253 8881 Acked Write 4 Done Sent Done false
32254 8882 Acked Write 4 Done Sent Done false
32255 8883 Acked Read 2 Done Sent Done false
32256 8884 Acked Read 2 Done Sent Done false
32257 8885 Acked Read 2 Done Sent Done false
32258 8886 Acked Read 3 Done Sent Done false
32259 8887 Acked Read 6 Done Sent Done false
32260 8888 Acked Flush 0 Done Sent Done false
32261 8889 Acked Read 7 Done Sent Done false
32262 8890 Acked Read 4 Done Sent Done false
32263 8891 Acked Read 6 Done Sent Done false
32264 8892 Acked Read 8 Done Sent Done false
32265 8893 Acked Write 9 Done Sent Done false
32266 8894 Acked Read 4 Done Sent Done false
32267 8895 Acked Write 6 Done Sent Done false
32268 8896 Acked Read 10 Done Sent Done false
32269 8897 Acked Write 4 Done Sent Done false
32270 8898 Acked Write 5 Done Sent Done false
32271 8899 Acked Read 2 Done Sent Done false
32272 8900 Acked Read 5 Done Sent Done false
32273 8901 Acked Write 9 Done Sent Done false
32274 8902 Acked Read 5 Done Sent Done false
32275 8903 Acked Read 5 Done Sent Done false
32276 8904 Acked Write 1 Done Sent Done false
32277 8905 Acked Write 9 Done Sent Done false
32278 8906 Acked Read 4 Done Sent Done false
32279 8907 Acked Write 4 Done Sent Done false
32280 8908 Acked Read 10 Done Sent Done false
32281 8909 Acked Flush 0 Done Sent Done false
32282 8910 Acked Read 7 Done Sent Done false
32283 8911 Acked Flush 0 Done Sent Done false
32284 8912 Acked Read 1 Done Sent Done false
32285 8913 Acked Flush 0 Done Sent Done false
32286 8914 Acked Write 1 Done Sent Done false
32287 8915 Acked Read 5 Done Sent Done false
32288 8916 Acked Write 9 Done Sent Done false
32289 8917 Acked Write 3 Done Sent Done false
32290 8918 Acked Write 9 Done Sent Done false
32291 8919 Acked Flush 0 Done Sent Done false
32292 8920 Acked Write 8 Done Sent Done false
32293 8921 Acked Read 1 Done Sent Done false
32294 8922 Acked Read 3 Done Sent Done false
32295 8923 Acked Write 1 Done Sent Done false
32296 8924 Acked Write 6 Done Sent Done false
32297 8925 Acked Write 10 Done Sent Done false
32298 8926 Acked Read 4 Done Sent Done false
32299 8927 Acked Write 10 Done Sent Done false
32300 8928 Acked Read 3 Done Sent Done false
32301 8929 Acked Write 6 Done Sent Done false
32302 8930 Acked Read 1 Done Sent Done false
32303 8931 Acked Read 7 Done Sent Done false
32304 8932 Acked Read 6 Done Sent Done false
32305 8933 Acked Write 1 Done Sent Done false
32306 8934 Acked Read 2 Done Sent Done false
32307 8935 Acked Write 4 Done Sent Done false
32308 8936 Acked Write 2 Done Sent Done false
32309 8937 Acked Read 6 Done Sent Done false
32310 8938 Acked Read 1 Done Sent Done false
32311 8939 Acked Write 10 Done Sent Done false
32312 8940 Acked Flush 0 Done Sent Done false
32313 8941 Acked Write 2 Done Sent Done false
32314 8942 Acked Write 1 Done Sent Done false
32315 8943 Acked Read 1 Done Sent Done false
32316 8944 Acked Write 9 Done Sent Done false
32317 8945 Acked Write 10 Done Sent Done false
32318 8946 Acked Write 9 Done Sent Done false
32319 8947 Acked Read 5 Done Sent Done false
32320 8948 Acked Write 2 Done Sent Done false
32321 8949 Acked Read 8 Done Sent Done false
32322 8950 Acked Read 1 Done Sent Done false
32323 8951 Acked Read 3 Done Sent Done false
32324 8952 Acked Read 6 Done Sent Done false
32325 8953 Acked Flush 0 Done Sent Done false
32326 8954 Acked Write 8 Done Sent Done false
32327 8955 Acked Write 7 Done Sent Done false
32328 8956 Acked Write 1 Done Sent Done false
32329 8957 Acked Read 10 Done Sent Done false
32330 8958 Acked Write 5 Done Sent Done false
32331 8959 Acked Write 1 Done Sent Done false
32332 8960 Acked Read 6 Done Sent Done false
32333 8961 Acked Read 4 Done Sent Done false
32334 8962 Acked Read 2 Done Sent Done false
32335 8963 Acked Read 10 Done Sent Done false
32336 8964 Acked Read 7 Done Sent Done false
32337 8965 Acked Read 4 Done Sent Done false
32338 8966 Acked Flush 0 Done Sent Done false
32339 8967 Acked Read 9 Done Sent Done false
32340 8968 Acked Read 2 Done Sent Done false
32341 8969 Acked Read 6 Done Sent Done false
32342 8970 Acked Read 6 Done Sent Done false
32343 8971 Acked Read 8 Done Sent Done false
32344 8972 Acked Read 7 Done Sent Done false
32345 8973 Acked Write 1 Done Sent Done false
32346 8974 Acked Read 6 Done Sent Done false
32347 8975 Acked Read 1 Done Sent Done false
32348 8976 Acked Write 10 Done Sent Done false
32349 8977 Acked Write 7 Done Sent Done false
32350 8978 Acked Flush 0 Done Sent Done false
32351 8979 Acked Read 6 Done Sent Done false
32352 8980 Acked Read 1 Done Sent Done false
32353 8981 Acked Flush 0 Done Sent Done false
32354 8982 Acked Read 2 Done Sent Done false
32355 8983 Acked Write 8 Done Sent Done false
32356 8984 Acked Write 2 Done Sent Done false
32357 8985 Acked Write 6 Done Sent Done false
32358 8986 Acked Write 2 Done Sent Done false
32359 8987 Acked Write 3 Done Sent Done false
32360 8988 Acked Read 9 Done Sent Done false
32361 8989 Acked Write 1 Done Sent Done false
32362 8990 Acked Read 5 Done Sent Done false
32363 8991 Acked Flush 0 Done Sent Done false
32364 8992 Acked Write 8 Done Sent Done false
32365 8993 Acked Flush 0 Done Sent Done false
32366 8994 Acked Write 5 Done Sent Done false
32367 8995 Acked Flush 0 Done Sent Done false
32368 8996 Acked Write 9 Done Sent Done false
32369 8997 Acked Read 9 Done Sent Done false
32370 8998 Acked Read 5 Done Sent Done false
32371 8999 Acked Write 8 Done Sent Done false
32372 9000 Acked Read 8 Done Sent Done false
32373 9001 Acked Write 9 Done Sent Done false
32374 9002 Acked Write 1 Done Sent Done false
32375 9003 Acked Read 10 Done Sent Done false
32376 9004 Acked Write 2 Done Sent Done false
32377 9005 Acked Read 10 Done Sent Done false
32378 9006 Acked Write 8 Done Sent Done false
32379 9007 Acked Read 1 Done Sent Done false
32380 9008 Acked Read 9 Done Sent Done false
32381 9009 Acked Write 4 Done Sent Done false
32382 9010 Acked Write 1 Done Sent Done false
32383 9011 Acked Write 3 Done Sent Done false
32384 9012 Acked Read 7 Done Sent Done false
32385 9013 Acked Read 8 Done Sent Done false
32386 9014 Acked Write 8 Done Sent Done false
32387 9015 Acked Read 1 Done Sent Done false
32388 9016 Acked Read 8 Done Sent Done false
32389 9017 Acked Read 10 Done Sent Done false
32390 9018 Acked Write 5 Done Sent Done false
32391 9019 Acked Write 3 Done Sent Done false
32392 9020 Acked Read 4 Done Sent Done false
32393 9021 Acked Read 9 Done Sent Done false
32394 9022 Acked Read 1 Done Sent Done false
32395 9023 Acked Read 3 Done Sent Done false
32396 9024 Acked Write 2 Done Sent Done false
32397 9025 Acked Write 5 Done Sent Done false
32398 9026 Acked Read 5 Done Sent Done false
32399 9027 Acked Read 5 Done Sent Done false
32400 9028 Acked Write 4 Done Sent Done false
32401 9029 Acked Read 10 Done Sent Done false
32402 9030 Acked Read 10 Done Sent Done false
32403 9031 Acked Flush 0 Done Sent Done false
32404 9032 Acked Read 9 Done Sent Done false
32405 9033 Acked Write 1 Done Sent Done false
32406 9034 Acked Write 10 Done Sent Done false
32407 9035 Acked Read 5 Done Sent Done false
32408 9036 Acked Read 5 Done Sent Done false
32409 9037 Acked Read 10 Done Sent Done false
32410 9038 Acked Write 3 Done Sent Done false
32411 9039 Acked Read 3 Done Sent Done false
32412 9040 Acked Read 4 Done Sent Done false
32413 9041 Acked Read 5 Done Sent Done false
32414 9042 Acked Read 4 Done Sent Done false
32415 9043 Acked Write 8 Done Sent Done false
32416 9044 Acked Write 9 Done Sent Done false
32417 9045 Acked Write 5 Done Sent Done false
32418 9046 Acked Read 6 Done Sent Done false
32419 9047 Acked Read 4 Done Sent Done false
32420 9048 Acked Write 8 Done Sent Done false
32421 9049 Acked Flush 0 Done Sent Done false
32422 9050 Acked Read 8 Done Sent Done false
32423 9051 Acked Flush 0 Done Sent Done false
32424 9052 Acked Read 2 Done Sent Done false
32425 9053 Acked Write 2 Done Sent Done false
32426 9054 Acked Read 6 Done Sent Done false
32427 9055 Acked Flush 0 Done Sent Done false
32428 9056 Acked Read 3 Done Sent Done false
32429 9057 Acked Write 10 Done Sent Done false
32430 9058 Acked Read 6 Done Sent Done false
32431 9059 Acked Read 3 Done Sent Done false
32432 9060 Acked Write 3 Done Sent Done false
32433 9061 Acked Read 1 Done Sent Done false
32434 9062 Acked Write 8 Done Sent Done false
32435 9063 Acked Read 4 Done Sent Done false
32436 9064 Acked Write 2 Done Sent Done false
32437 9065 Acked Read 2 Done Sent Done false
32438 9066 Acked Read 8 Done Sent Done false
32439 9067 Acked Read 7 Done Sent Done false
32440 9068 Acked Write 3 Done Sent Done false
32441 9069 Acked Write 8 Done Sent Done false
32442 9070 Acked Read 5 Done Sent Done false
32443 9071 Acked Read 8 Done Sent Done false
32444 9072 Acked Read 4 Done Sent Done false
32445 9073 Acked Write 1 Done Sent Done false
32446 9074 Acked Read 2 Done Sent Done false
32447 9075 Acked Write 1 Done Sent Done false
32448 9076 Acked Write 9 Done Sent Done false
32449 9077 Acked Read 3 Done Sent Done false
32450 9078 Acked Read 3 Done Sent Done false
32451 9079 Acked Read 7 Done Sent Done false
32452 9080 Acked Read 1 Done Sent Done false
32453 9081 Acked Write 4 Done Sent Done false
32454 9082 Acked Write 5 Done Sent Done false
32455 9083 Acked Write 2 Done Sent Done false
32456 9084 Acked Write 6 Done Sent Done false
32457 9085 Acked Read 6 Done Sent Done false
32458 9086 Acked Write 10 Done Sent Done false
32459 9087 Acked Read 10 Done Sent Done false
32460 9088 Acked Read 10 Done Sent Done false
32461 9089 Acked Read 4 Done Sent Done false
32462 9090 Acked Read 7 Done Sent Done false
32463 9091 Acked Write 10 Done Sent Done false
32464 9092 Acked Write 5 Done Sent Done false
32465 9093 Acked Read 9 Done Sent Done false
32466 9094 Acked Read 8 Done Sent Done false
32467 9095 Acked Write 3 Done Sent Done false
32468 9096 Acked Read 7 Done Sent Done false
32469 9097 Acked Write 4 Done Sent Done false
32470 9098 Acked Read 6 Done Sent Done false
32471 9099 Acked Read 7 Done Sent Done false
32472 9100 Acked Read 3 Done Sent Done false
32473 9101 Acked Write 1 Done Sent Done false
32474 9102 Acked Flush 0 Done Sent Done false
32475 9103 Acked Write 5 Done Sent Done false
32476 9104 Acked Write 5 Done Sent Done false
32477 9105 Acked Flush 0 Done Sent Done false
32478 9106 Acked Write 7 Done Sent Done false
32479 9107 Acked Write 4 Done Sent Done false
32480 9108 Acked Read 8 Done Sent Done false
32481 9109 Acked Write 6 Done Sent Done false
32482 9110 Acked Read 10 Done Sent Done false
32483 9111 Acked Read 3 Done Sent Done false
32484 9112 Acked Write 7 Done Sent Done false
32485 9113 Acked Read 9 Done Sent Done false
32486 9114 Acked Flush 0 Done Sent Done false
32487 9115 Acked Write 3 Done Sent Done false
32488 9116 Acked Read 7 Done Sent Done false
32489 9117 Acked Read 5 Done Sent Done false
32490 9118 Acked Write 6 Done Sent Done false
32491 9119 Acked Read 2 Done Sent Done false
32492 9120 Acked Read 9 Done Sent Done false
32493 9121 Acked Read 9 Done Sent Done false
32494 9122 Acked Read 1 Done Sent Done false
32495 9123 Acked Write 2 Done Sent Done false
32496 9124 Acked Read 2 Done Sent Done false
32497 9125 Acked Write 7 Done Sent Done false
32498 9126 Acked Read 1 Done Sent Done false
32499 9127 Acked Read 6 Done Sent Done false
32500 9128 Acked Write 7 Done Sent Done false
32501 9129 Acked Write 10 Done Sent Done false
32502 9130 Acked Write 7 Done Sent Done false
32503 9131 Acked Read 10 Done Sent Done false
32504 9132 Acked Read 2 Done Sent Done false
32505 9133 Acked Write 1 Done Sent Done false
32506 9134 Acked Read 4 Done Sent Done false
32507 9135 Acked Read 9 Done Sent Done false
32508 9136 Acked Write 10 Done Sent Done false
32509 9137 Acked Write 7 Done Sent Done false
32510 9138 Acked Read 9 Done Sent Done false
32511 9139 Acked Read 3 Done Sent Done false
32512 9140 Acked Write 7 Done Sent Done false
32513 9141 Acked Write 4 Done Sent Done false
32514 9142 Acked Write 2 Done Sent Done false
32515 9143 Acked Write 4 Done Sent Done false
32516 9144 Acked Write 9 Done Sent Done false
32517 9145 Acked Write 3 Done Sent Done false
32518 9146 Acked Read 4 Done Sent Done false
32519 9147 Acked Read 10 Done Sent Done false
32520 9148 Acked Write 8 Done Sent Done false
32521 9149 Acked Write 1 Done Sent Done false
32522 9150 Acked Flush 0 Done Sent Done false
32523 STATES DS:0 DS:1 DS:2 TOTAL
32524 Sent 0 302 0 302
32525 Done 302 0 302 604
32526 Skipped 0 0 0 0
32527 Error 0 0 0 0
32528 Last Flush: 9150 8848 9150
32529 Downstairs last five completed: 8848 8847 8846 8845 8844
32530 Upstairs last five completed: 9150 9149 9148 9147 9146
32531 CLIENT: Up:0 ds:302 act:2
325322025-01-10T16:42:08.135ZINFOcrucible: connecting to 127.0.0.1:8820 = io task client = 1 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
325332025-01-10T16:42:08.135ZINFOcrucible: ds_connection connected from Ok(127.0.0.1:47428) = io task client = 1 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
325342025-01-10T16:42:08.136ZWARNcrucible: version negotiation from state Offline = downstairs client = 1 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
325352025-01-10T16:42:08.136ZINFOcrucible: downstairs client at Some(127.0.0.1:8820) has region UUID 12345678-0000-0000-0000-000000008820 = downstairs client = 1 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
325362025-01-10T16:42:08.136ZINFOcrucible: Returning UUID:12345678-0000-0000-0000-000000008820 matches = downstairs client = 1 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
325372025-01-10T16:42:08.136ZINFOcrucible: send last flush ID to this DS: 8848 = downstairs client = 1 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
325382025-01-10T16:42:08.137ZINFOcrucible: Replied this last flush ID: 8848 = downstairs client = 1 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
325392025-01-10T16:42:08.137ZINFOcrucible: ds_transition from Offline to Active = downstairs client = 1 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
325402025-01-10T16:42:08.137ZINFOcrucible: [1] Transition from Offline to Active = downstairs client = 1 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
325412025-01-10T16:42:08.137ZINFOcrucible: [1] client re-new 302 jobs since flush 8848 = downstairs session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
325422025-01-10T16:42:08.137ZINFOcrucible: [1] Replayed 302 jobs since flush: 8848 = downstairs session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
32543 ----------------------------------------------------------------
32544 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:0
32545 Downstairs last five completed: 9150 9149 9148 9147 9146
32546 Upstairs last five completed: 9150 9149 9148 9147 9146
32547 CLIENT: Up:0 ds:0 act:3
32548 Replay: All jobs finished
32549 Main task has work to do, go find it
32550 got dsc Stop(0)
32551 stop 0
32552 Jan 10 16:42:10.375[8810] Got stop action so:false kr:false
32553 INFO request completed, latency_us: 407, response_code: 204, uri: /stop/cid/0, method: POST, req_id: 20797e26-d0af-4822-890b-00a47c3c2c48, remote_addr: 127.0.0.1:55917, local_addr: 127.0.0.1:9998
325542025-01-10T16:42:10.376ZWARNcrucible: downstairs disconnected = io task client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
325552025-01-10T16:42:10.376ZWARNcrucible: client task is sending Done(Finished) = io task client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
32556 Jan 10 16:42:10.376 INFO request completed, latency_us:{"msg":"downstairs task for 0 stopped due to Finished","v":0,"name":"crucible","level":40,"time":"2025-01-10T16:42:10.376352051Z","hostname":"w-01JH8H1N3KXZ9F8ZV6CCMP5KTQ","pid":1202,"session_id":"1df3ca91-4dc9-42d6-9897-461254b5afe2"}
32557 157, response_code: 200, uri: /state/cid/0, method: {"msg":"ds_transition from Active to Offline","v":0,"name":"crucible","level":30,"time":"2025-01-10T16:42:10.376412076Z","hostname":"w-01JH8H1N3KXZ9F8ZV6CCMP5KTQ","pid":1202,"client":"0","":"downstairs","session_id":"1df3ca91-4dc9-42d6-9897-461254b5afe2"}
32558 GET, req_id: c71adea9-2c9d-45fb-aef9-7769730dc3bc, remote_addr: 127.0.0.1:55917, local_addr:{"msg":"[0] Transition from Active to Offline","v":0,"name":"crucible","level":30,"time":"2025-01-10T16:42:10.376442593Z","hostname":"w-01JH8H1N3KXZ9F8ZV6CCMP5KTQ","pid":1202,"client":"0","":"downstairs","session_id":"1df3ca91-4dc9-42d6-9897-461254b5afe2"}
32559 127.0.0.1:9998
325602025-01-10T16:42:10.376ZINFOcrucible: client task is exiting = io task client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
32561 [8810] Exited with: ExitStatus(unix_wait_status(9))
32562 [8810][0] reports Exit
32563 Jan 10 16:42:14.379 INFO request completed, latency_us: 216, response_code: 200, uri: /state/cid/0, method: GET, req_id: 6a4e5b2a-25d3-4b39-bae6-b6f1ec2ad82d, remote_addr: 127.0.0.1:55917, local_addr: 127.0.0.1:9998
32564 001/300 Write block 2556 len 12288 data: 7 6 6
32565 002/300 Write block 1055 len 28672 data: 4 4 3 5 4 5 5
32566 003/300 Write block 2006 len 20480 data: 3 4 4 6 4
32567 004/300 Flush
32568 005/300 Flush
32569 006/300 Read block 3506 len 36864
32570 007/300 Read block 3863 len 8192
32571 008/300 Write block 3356 len 24576 data: 5 3 3 3 3 4
32572 009/300 Read block 2982 len 12288
32573 010/300 Read block 1042 len 40960
32574 011/300 Read block 91 len 32768
32575 012/300 Write block 676 len 8192 data: 5 6
32576 013/300 Write block 1940 len 28672 data: 5 5 6 7 7 6 7
32577 014/300 Read block 2501 len 24576
32578 015/300 Read block 4594 len 24576
32579 016/300 Write block 3137 len 32768 data: 6 6 5 7 6 7 5 6
32580 017/300 Flush
32581 018/300 Write block 2702 len 20480 data: 4 5 7 7 7
32582 019/300 Read block 3142 len 32768
32583 020/300 Read block 3691 len 4096
32584 021/300 Write block 2267 len 20480 data: 6 5 3 3 3
32585 022/300 Write block 4170 len 8192 data: 7 7
32586 023/300 Read block 36 len 4096
32587 024/300 Flush
32588 025/300 Read block 1551 len 16384
32589 026/300 Write block 1571 len 4096 data: 4
32590 027/300 Read block 2326 len 40960
32591 028/300 Read block 948 len 40960
32592 029/300 Flush
32593 030/300 Read block 1566 len 40960
32594 031/300 Read block 1078 len 40960
32595 032/300 Flush
32596 033/300 Read block 3297 len 36864
32597 034/300 Flush
32598 035/300 Write block 1108 len 20480 data: 6 7 7 6 8
32599 036/300 Read block 4709 len 28672
32600 037/300 Write block 3066 len 40960 data: 6 6 6 5 4 3 4 3 3 2
32601 038/300 Write block 4837 len 4096 data: 7
32602 039/300 Write block 4556 len 16384 data: 10 7 6 5
32603 040/300 Read block 3607 len 24576
32604 041/300 Write block 1736 len 12288 data: 6 8 8
32605 042/300 Write block 554 len 36864 data: 4 4 2 3 4 5 6 6 6
32606 043/300 Flush
32607 044/300 Write block 2354 len 40960 data: 4 4 6 6 7 6 3 4 7 7
32608 045/300 Write block 4373 len 8192 data: 10 13
32609 046/300 Flush
32610 047/300 Write block 4066 len 24576 data: 5 7 7 9 8 10
32611 048/300 Read block 566 len 36864
32612 049/300 Read block 4109 len 4096
32613 050/300 Read block 3273 len 28672
32614 051/300 Read block 4333 len 28672
32615 052/300 Write block 3883 len 40960 data: 6 5 4 4 4 4 4 5 5 4
32616 053/300 Flush
32617 054/300 Write block 183 len 12288 data: 7 8 9
32618 055/300 Write block 265 len 20480 data: 6 7 7 7 7
32619 056/300 Read block 2404 len 40960
32620 057/300 Read block 4450 len 20480
32621 058/300 Read block 3128 len 12288
32622 059/300 Write block 2381 len 12288 data: 5 6 6
32623 060/300 Read block 4278 len 20480
32624 061/300 Read block 2863 len 28672
32625 062/300 Write block 633 len 20480 data: 9 10 10 8 7
32626 063/300 Read block 1126 len 24576
32627 064/300 Read block 3248 len 16384
32628 065/300 Read block 4440 len 20480
32629 066/300 Read block 2365 len 16384
32630 067/300 Read block 2066 len 36864
32631 068/300 Read block 3949 len 28672
32632 069/300 Write block 3657 len 32768 data: 9 9 8 7 4 4 5 6
32633 070/300 Flush
32634 071/300 Write block 295 len 12288 data: 5 5 6
32635 072/300 Flush
32636 073/300 Read block 4865 len 36864
32637 074/300 Write block 1901 len 36864 data: 6 5 5 5 5 5 6 6 6
32638 075/300 Read block 2065 len 28672
32639 076/300 Write block 566 len 8192 data: 8 7
32640 077/300 Read block 2626 len 16384
32641 078/300 Read block 2183 len 20480
32642 079/300 Write block 694 len 32768 data: 9 8 8 6 8 9 7 8
32643 080/300 Read block 2962 len 36864
32644 081/300 Write block 1821 len 16384 data: 8 7 9 7
32645 082/300 Read block 2962 len 20480
32646 083/300 Read block 1776 len 8192
32647 084/300 Flush
32648 085/300 Write block 3551 len 16384 data: 8 7 6 7
32649 086/300 Read block 3121 len 4096
32650 087/300 Write block 2412 len 4096 data: 5
32651 088/300 Read block 3834 len 20480
32652 089/300 Write block 1279 len 20480 data: 9 8 7 8 7
32653 090/300 Read block 35 len 36864
32654 091/300 Write block 2934 len 28672 data: 7 6 6 6 8 7 6
32655 092/300 Write block 3673 len 24576 data: 7 8 8 7 6 6
32656 093/300 Write block 3744 len 36864 data: 3 4 4 4 4 5 5 5 6
32657 094/300 Write block 4917 len 12288 data: 6 6 6
32658 095/300 Read block 4013 len 40960
32659 096/300 Write block 2058 len 20480 data: 5 4 4 3 4
32660 097/300 Write block 1444 len 20480 data: 5 3 3 4 5
32661 098/300 Write block 3384 len 24576 data: 12 9 8 6 6 4
32662 099/300 Write block 2016 len 16384 data: 6 6 7 6
32663 100/300 Write block 3146 len 8192 data: 6 8
32664 101/300 Read block 553 len 16384
32665 102/300 Flush
32666 103/300 Read block 2498 len 8192
32667 104/300 Write block 3786 len 36864 data: 7 7 5 5 6 6 6 7 7
32668 105/300 Write block 1934 len 16384 data: 7 7 6 6
32669 106/300 Read block 2310 len 40960
32670 107/300 Read block 918 len 28672
32671 108/300 Write block 4092 len 28672 data: 7 7 5 5 4 4 4
32672 109/300 Read block 2581 len 32768
32673 110/300 Read block 981 len 20480
32674 111/300 Flush
32675 112/300 Read block 3142 len 20480
32676 113/300 Read block 1862 len 24576
32677 114/300 Read block 3414 len 4096
32678 115/300 Write block 4245 len 8192 data: 5 5
32679 116/300 Read block 4157 len 16384
32680 117/300 Write block 2772 len 24576 data: 5 5 5 4 5 6
32681 118/300 Read block 3319 len 24576
32682 119/300 Write block 3902 len 20480 data: 4 4 5 5 6
32683 120/300 Read block 667 len 4096
32684 121/300 Read block 3467 len 8192
32685 122/300 Write block 1680 len 32768 data: 6 6 8 8 9 7 8 7
32686 123/300 Write block 3158 len 16384 data: 4 4 4 3
32687 124/300 Flush
32688 125/300 Write block 4643 len 24576 data: 5 5 6 6 4 4
32689 126/300 Write block 1883 len 4096 data: 4
32690 127/300 Write block 4364 len 28672 data: 7 5 5 5 5 7 8
32691 128/300 Write block 4415 len 4096 data: 6
32692 129/300 Read block 3318 len 16384
32693 130/300 Read block 4511 len 28672
32694 131/300 Write block 767 len 8192 data: 3 3
32695 132/300 Read block 4955 len 8192
32696 133/300 Flush
32697 134/300 Read block 505 len 12288
32698 135/300 Write block 3912 len 8192 data: 5 6
32699 136/300 Write block 1862 len 28672 data: 6 6 6 5 6 5 5
32700 137/300 Write block 595 len 4096 data: 4
32701 138/300 Read block 1476 len 40960
32702 139/300 Write block 1209 len 12288 data: 5 4 2
32703 140/300 Read block 1574 len 12288
32704 141/300 Write block 3791 len 32768 data: 7 7 8 8 7 5 5 6
32705 142/300 Read block 3442 len 16384
32706 143/300 Write block 1456 len 12288 data: 6 7 8
32707 144/300 Read block 3350 len 32768
32708 145/300 Read block 4729 len 4096
32709 146/300 Write block 1921 len 36864 data: 6 5 6 5 7 7 7 8 9
32710 147/300 Read block 3658 len 28672
32711 148/300 Read block 731 len 12288
32712 149/300 Read block 2597 len 16384
32713 150/300 Flush
32714 151/300 Read block 1842 len 8192
32715 152/300 Write block 4566 len 32768 data: 6 6 8 6 9 9 7 4
32716 153/300 Read block 3418 len 4096
32717 154/300 Read block 2535 len 12288
32718 155/300 Flush
32719 156/300 Write block 259 len 36864 data: 4 5 5 5 5 6 7 8 8
32720 157/300 Write block 2315 len 4096 data: 7
32721 158/300 Flush
32722 159/300 Write block 1768 len 36864 data: 8 6 4 4 5 7 7 7 7
32723 160/300 Write block 2815 len 4096 data: 6
32724 161/300 Read block 540 len 40960
32725 162/300 Read block 3564 len 4096
32726 163/300 Write block 2035 len 20480 data: 7 6 8 9 8
32727 164/300 Read block 4222 len 8192
32728 165/300 Flush
32729 166/300 Write block 3582 len 16384 data: 5 4 4 4
32730 167/300 Read block 3838 len 32768
32731 168/300 Write block 1820 len 4096 data: 8
32732 169/300 Write block 3958 len 4096 data: 5
32733 170/300 Write block 3834 len 16384 data: 6 7 6 5
32734 171/300 Read block 1511 len 28672
32735 172/300 Read block 506 len 20480
32736 173/300 Write block 4106 len 24576 data: 3 5 5 5 5 5
32737 174/300 Read block 1649 len 40960
32738 175/300 Read block 3390 len 32768
32739 176/300 Write block 1154 len 40960 data: 5 5 5 6 6 5 8 8 7 8
32740 177/300 Read block 3869 len 12288
32741 178/300 Read block 2370 len 24576
32742 179/300 Write block 129 len 16384 data: 4 4 4 4
32743 180/300 Read block 1681 len 40960
32744 181/300 Read block 4948 len 8192
32745 182/300 Read block 1780 len 36864
32746 183/300 Read block 3953 len 8192
32747 184/300 Read block 786 len 24576
32748 185/300 Flush
32749 186/300 Write block 3888 len 28672 data: 5 5 6 6 5 5 4
32750 187/300 Write block 134 len 20480 data: 3 3 2 2 2
32751 188/300 Read block 2355 len 36864
32752 189/300 Write block 2109 len 24576 data: 4 5 7 7 8 9
32753 190/300 Write block 3501 len 28672 data: 5 5 5 4 4 5 5
32754 191/300 Write block 617 len 24576 data: 7 7 6 6 5 5
32755 192/300 Write block 1863 len 8192 data: 7 7
32756 193/300 Read block 4373 len 12288
32757 194/300 Read block 2410 len 32768
32758 195/300 Read block 871 len 20480
32759 196/300 Read block 736 len 8192
32760 197/300 Read block 4892 len 8192
32761 198/300 Write block 3749 len 20480 data: 6 6 6 7 6
32762 199/300 Read block 924 len 8192
32763 200/300 Read block 4333 len 36864
32764 201/300 Write block 2468 len 36864 data: 2 3 3 4 4 4 4 4 4
32765 202/300 Read block 1996 len 24576
32766 203/300 Read block 3223 len 36864
32767 204/300 Write block 1187 len 20480 data: 8 8 8 7 8
32768 205/300 Write block 1685 len 8192 data: 8 9
32769 206/300 Write block 3123 len 20480 data: 7 7 8 7 6
32770 207/300 Read block 2812 len 20480
32771 208/300 Read block 1741 len 16384
32772 209/300 Read block 573 len 16384
32773 210/300 Write block 4621 len 36864 data: 7 8 8 8 9 7 8 7 8
32774 211/300 Read block 3722 len 8192
32775 212/300 Flush
32776 213/300 Read block 490 len 16384
32777 214/300 Read block 949 len 4096
32778 215/300 Read block 4595 len 16384
32779 216/300 Write block 640 len 32768 data: 4 4 4 7 7 8 7 8
32780 217/300 Write block 4508 len 24576 data: 5 4 4 5 6 5
32781 218/300 Read block 3329 len 8192
32782 219/300 Write block 81 len 28672 data: 6 5 5 4 3 3 3
32783 220/300 Flush
32784 221/300 Read block 4454 len 36864
32785 222/300 Write block 3915 len 8192 data: 6 7
32786 223/300 Read block 4526 len 28672
32787 224/300 Read block 3133 len 12288
32788 225/300 Read block 4448 len 28672
32789 226/300 Flush
32790 227/300 Write block 1252 len 36864 data: 4 4 5 6 5 5 6 4 5
32791 228/300 Write block 1389 len 32768 data: 8 9 10 8 9 8 6 5
32792 229/300 Write block 556 len 20480 data: 3 4 5 6 7
32793 230/300 Read block 1467 len 32768
32794 231/300 Write block 1467 len 36864 data: 5 6 6 6 7 7 5 7 6
32795 232/300 Write block 3470 len 32768 data: 3 3 3 4 3 3 3 3
32796 233/300 Write block 4174 len 32768 data: 6 7 6 5 7 7 7 6
32797 234/300 Read block 1234 len 8192
32798 235/300 Write block 2695 len 20480 data: 7 7 7 7 6
32799 236/300 Read block 2191 len 32768
32800 237/300 Read block 1891 len 24576
32801 238/300 Write block 2230 len 20480 data: 5 6 5 3 3
32802 239/300 Flush
32803 240/300 Read block 3353 len 8192
32804 241/300 Read block 2939 len 16384
32805 242/300 Read block 4718 len 40960
32806 243/300 Read block 2369 len 12288
32807 244/300 Read block 108 len 36864
32808 245/300 Write block 2330 len 24576 data: 6 7 7 8 7 7
32809 246/300 Write block 4678 len 4096 data: 6
32810 247/300 Write block 3150 len 36864 data: 8 7 5 6 3 3 3 4 5
32811 248/300 Write block 172 len 28672 data: 4 5 5 5 5 5 3
32812 249/300 Write block 368 len 20480 data: 7 8 8 7 3
32813 250/300 Read block 1690 len 4096
32814 251/300 Read block 4901 len 40960
32815 252/300 Read block 2801 len 24576
32816 253/300 Flush
32817 254/300 Write block 4766 len 16384 data: 5 6 7 8
32818 255/300 Read block 567 len 28672
32819 256/300 Read block 2339 len 20480
32820 257/300 Write block 2912 len 4096 data: 7
32821 258/300 Write block 2844 len 20480 data: 7 8 8 8 7
32822 259/300 Write block 2411 len 40960 data: 6 6 5 5 4 4 4 5 4 5
32823 260/300 Read block 2072 len 8192
32824 261/300 Read block 3219 len 36864
32825 262/300 Read block 4669 len 16384
32826 263/300 Write block 2289 len 20480 data: 7 5 6 6 4
32827 264/300 Read block 3036 len 40960
32828 265/300 Write block 3003 len 8192 data: 7 9
32829 266/300 Read block 1065 len 28672
32830 267/300 Write block 3830 len 40960 data: 6 5 6 6 7 8 7 6 5 5
32831 268/300 Write block 3709 len 28672 data: 8 8 10 9 8 7 7
32832 269/300 Read block 4816 len 16384
32833 270/300 Write block 2085 len 24576 data: 3 3 3 2 2 2
32834 271/300 Read block 713 len 28672
32835 272/300 Write block 2797 len 4096 data: 5
32836 273/300 Read block 2602 len 4096
32837 274/300 Read block 3635 len 16384
32838 275/300 Write block 4611 len 16384 data: 3 4 3 3
32839 276/300 Write block 2009 len 4096 data: 7
32840 277/300 Read block 956 len 24576
32841 278/300 Read block 896 len 16384
32842 279/300 Read block 4616 len 8192
32843 280/300 Read block 985 len 24576
32844 281/300 Read block 3279 len 16384
32845 282/300 Flush
32846 283/300 Read block 4682 len 36864
32847 284/300 Write block 2382 len 20480 data: 7 7 6 6 7
32848 285/300 Flush
32849 286/300 Write block 4888 len 40960 data: 3 4 3 3 3 4 5 6 6 6
32850 287/300 Read block 850 len 20480
32851 288/300 Read block 4837 len 28672
32852 289/300 Write block 1434 len 32768 data: 4 5 6 7 6 5 5 6
32853 290/300 Write block 4148 len 28672 data: 11 11 11 10 7 7 8
32854 291/300 Write block 66 len 16384 data: 2 6 7 8
32855 292/300 Write block 2644 len 40960 data: 8 7 8 7 7 8 7 6 3 3
32856 293/300 Read block 2288 len 16384
32857 294/300 Write block 2981 len 24576 data: 7 6 5 7 8 7
32858 295/300 Write block 972 len 36864 data: 7 7 6 6 6 7 7 6 6
32859 296/300 Write block 1361 len 4096 data: 7
32860 297/300 Read block 1483 len 32768
32861 298/300 Write block 3796 len 16384 data: 6 6 7 7
32862 299/300 Read block 653 len 8192
32863 300/300 Write block 4014 len 20480 data: 3 4 5 4 3
32864 301/300 Write block 4524 len 28672 data: 5 5 7 6 8 8 8
32865 Main task has work to do, go find it
32866 got dsc Start(0)
32867 start 0
32868 Jan 10 16:42:14.610 INFO request completed, latency_us: 245, response_code: 204, uri: /start/cid/0, method: POST, req_id: 722757ab-33fe-4966-aa8f-b9a2d4e41714, remote_addr: 127.0.0.1:55917, local_addr: 127.0.0.1:9998
32869 Replay: started 0, returned:Ok(())
32870 ----------------------------------------------------------------
32871 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:301
32872 States: Offline Active Active
32873 JOBID ACK TYPE BKS/EXT DS:0 DS:1 DS:2 REPLAY
32874 9151 Acked Write 3 Sent Done Done false
32875 9152 Acked Write 7 Sent Done Done false
32876 9153 Acked Write 5 Sent Done Done false
32877 9154 Acked Flush 0 Sent Done Done false
32878 9155 Acked Flush 0 Sent Done Done false
32879 9156 Acked Read 9 Sent Done Done false
32880 9157 Acked Read 2 Sent Done Done false
32881 9158 Acked Write 6 Sent Done Done false
32882 9159 Acked Read 3 Sent Done Done false
32883 9160 Acked Read 10 Sent Done Done false
32884 9161 Acked Read 8 Sent Done Done false
32885 9162 Acked Write 2 Sent Done Done false
32886 9163 Acked Write 7 Sent Done Done false
32887 9164 Acked Read 6 Sent Done Done false
32888 9165 Acked Read 6 Sent Done Done false
32889 9166 Acked Write 8 Sent Done Done false
32890 9167 Acked Flush 0 Sent Done Done false
32891 9168 Acked Write 5 Sent Done Done false
32892 9169 Acked Read 8 Sent Done Done false
32893 9170 Acked Read 1 Sent Done Done false
32894 9171 Acked Write 5 Sent Done Done false
32895 9172 Acked Write 2 Sent Done Done false
32896 9173 Acked Read 1 Sent Done Done false
32897 9174 Acked Flush 0 Sent Done Done false
32898 9175 Acked Read 4 Sent Done Done false
32899 9176 Acked Write 1 Sent Done Done false
32900 9177 Acked Read 10 Sent Done Done false
32901 9178 Acked Read 10 Sent Done Done false
32902 9179 Acked Flush 0 Sent Done Done false
32903 9180 Acked Read 10 Sent Done Done false
32904 9181 Acked Read 10 Sent Done Done false
32905 9182 Acked Flush 0 Sent Done Done false
32906 9183 Acked Read 9 Sent Done Done false
32907 9184 Acked Flush 0 Sent Done Done false
32908 9185 Acked Write 5 Sent Done Done false
32909 9186 Acked Read 7 Sent Done Done false
32910 9187 Acked Write 10 Sent Done Done false
32911 9188 Acked Write 1 Sent Done Done false
32912 9189 Acked Write 4 Sent Done Done false
32913 9190 Acked Read 6 Sent Done Done false
32914 9191 Acked Write 3 Sent Done Done false
32915 9192 Acked Write 9 Sent Done Done false
32916 9193 Acked Flush 0 Sent Done Done false
32917 9194 Acked Write 10 Sent Done Done false
32918 9195 Acked Write 2 Sent Done Done false
32919 9196 Acked Flush 0 Sent Done Done false
32920 9197 Acked Write 6 Sent Done Done false
32921 9198 Acked Read 9 Sent Done Done false
32922 9199 Acked Read 1 Sent Done Done false
32923 9200 Acked Read 7 Sent Done Done false
32924 9201 Acked Read 7 Sent Done Done false
32925 9202 Acked Write 10 Sent Done Done false
32926 9203 Acked Flush 0 Sent Done Done false
32927 9204 Acked Write 3 Sent Done Done false
32928 9205 Acked Write 5 Sent Done Done false
32929 9206 Acked Read 10 Sent Done Done false
32930 9207 Acked Read 5 Sent Done Done false
32931 9208 Acked Read 3 Sent Done Done false
32932 9209 Acked Write 3 Sent Done Done false
32933 9210 Acked Read 5 Sent Done Done false
32934 9211 Acked Read 7 Sent Done Done false
32935 9212 Acked Write 5 Sent Done Done false
32936 9213 Acked Read 6 Sent Done Done false
32937 9214 Acked Read 4 Sent Done Done false
32938 9215 Acked Read 5 Sent Done Done false
32939 9216 Acked Read 4 Sent Done Done false
32940 9217 Acked Read 9 Sent Done Done false
32941 9218 Acked Read 7 Sent Done Done false
32942 9219 Acked Write 8 Sent Done Done false
32943 9220 Acked Flush 0 Sent Done Done false
32944 9221 Acked Write 3 Sent Done Done false
32945 9222 Acked Flush 0 Sent Done Done false
32946 9223 Acked Read 9 Sent Done Done false
32947 9224 Acked Write 9 Sent Done Done false
32948 9225 Acked Read 7 Sent Done Done false
32949 9226 Acked Write 2 Sent Done Done false
32950 9227 Acked Read 4 Sent Done Done false
32951 9228 Acked Read 5 Sent Done Done false
32952 9229 Acked Write 8 Sent Done Done false
32953 9230 Acked Read 9 Sent Done Done false
32954 9231 Acked Write 4 Sent Done Done false
32955 9232 Acked Read 5 Sent Done Done false
32956 9233 Acked Read 2 Sent Done Done false
32957 9234 Acked Flush 0 Sent Done Done false
32958 9235 Acked Write 4 Sent Done Done false
32959 9236 Acked Read 1 Sent Done Done false
32960 9237 Acked Write 1 Sent Done Done false
32961 9238 Acked Read 5 Sent Done Done false
32962 9239 Acked Write 5 Sent Done Done false
32963 9240 Acked Read 9 Sent Done Done false
32964 9241 Acked Write 7 Sent Done Done false
32965 9242 Acked Write 6 Sent Done Done false
32966 9243 Acked Write 9 Sent Done Done false
32967 9244 Acked Write 3 Sent Done Done false
32968 9245 Acked Read 10 Sent Done Done false
32969 9246 Acked Write 5 Sent Done Done false
32970 9247 Acked Write 5 Sent Done Done false
32971 9248 Acked Write 6 Sent Done Done false
32972 9249 Acked Write 4 Sent Done Done false
32973 9250 Acked Write 2 Sent Done Done false
32974 9251 Acked Read 4 Sent Done Done false
32975 9252 Acked Flush 0 Sent Done Done false
32976 9253 Acked Read 2 Sent Done Done false
32977 9254 Acked Write 9 Sent Done Done false
32978 9255 Acked Write 4 Sent Done Done false
32979 9256 Acked Read 10 Sent Done Done false
32980 9257 Acked Read 7 Sent Done Done false
32981 9258 Acked Write 7 Sent Done Done false
32982 9259 Acked Read 8 Sent Done Done false
32983 9260 Acked Read 5 Sent Done Done false
32984 9261 Acked Flush 0 Sent Done Done false
32985 9262 Acked Read 5 Sent Done Done false
32986 9263 Acked Read 6 Sent Done Done false
32987 9264 Acked Read 1 Sent Done Done false
32988 9265 Acked Write 2 Sent Done Done false
32989 9266 Acked Read 4 Sent Done Done false
32990 9267 Acked Write 6 Sent Done Done false
32991 9268 Acked Read 6 Sent Done Done false
32992 9269 Acked Write 5 Sent Done Done false
32993 9270 Acked Read 1 Sent Done Done false
32994 9271 Acked Read 2 Sent Done Done false
32995 9272 Acked Write 8 Sent Done Done false
32996 9273 Acked Write 4 Sent Done Done false
32997 9274 Acked Flush 0 Sent Done Done false
32998 9275 Acked Write 6 Sent Done Done false
32999 9276 Acked Write 1 Sent Done Done false
33000 9277 Acked Write 7 Sent Done Done false
33001 9278 Acked Write 1 Sent Done Done false
33002 9279 Acked Read 4 Sent Done Done false
33003 9280 Acked Read 7 Sent Done Done false
33004 9281 Acked Write 2 Sent Done Done false
33005 9282 Acked Read 2 Sent Done Done false
33006 9283 Acked Flush 0 Sent Done Done false
33007 9284 Acked Read 3 Sent Done Done false
33008 9285 Acked Write 2 Sent Done Done false
33009 9286 Acked Write 7 Sent Done Done false
33010 9287 Acked Write 1 Sent Done Done false
33011 9288 Acked Read 10 Sent Done Done false
33012 9289 Acked Write 3 Sent Done Done false
33013 9290 Acked Read 3 Sent Done Done false
33014 9291 Acked Write 8 Sent Done Done false
33015 9292 Acked Read 4 Sent Done Done false
33016 9293 Acked Write 3 Sent Done Done false
33017 9294 Acked Read 8 Sent Done Done false
33018 9295 Acked Read 1 Sent Done Done false
33019 9296 Acked Write 9 Sent Done Done false
33020 9297 Acked Read 7 Sent Done Done false
33021 9298 Acked Read 3 Sent Done Done false
33022 9299 Acked Read 4 Sent Done Done false
33023 9300 Acked Flush 0 Sent Done Done false
33024 9301 Acked Read 2 Sent Done Done false
33025 9302 Acked Write 8 Sent Done Done false
33026 9303 Acked Read 1 Sent Done Done false
33027 9304 Acked Read 3 Sent Done Done false
33028 9305 Acked Flush 0 Sent Done Done false
33029 9306 Acked Write 9 Sent Done Done false
33030 9307 Acked Write 1 Sent Done Done false
33031 9308 Acked Flush 0 Sent Done Done false
33032 9309 Acked Write 9 Sent Done Done false
33033 9310 Acked Write 1 Sent Done Done false
33034 9311 Acked Read 10 Sent Done Done false
33035 9312 Acked Read 1 Sent Done Done false
33036 9313 Acked Write 5 Sent Done Done false
33037 9314 Acked Read 2 Sent Done Done false
33038 9315 Acked Flush 0 Sent Done Done false
33039 9316 Acked Write 4 Sent Done Done false
33040 9317 Acked Read 8 Sent Done Done false
33041 9318 Acked Write 1 Sent Done Done false
33042 9319 Acked Write 1 Sent Done Done false
33043 9320 Acked Write 4 Sent Done Done false
33044 9321 Acked Read 7 Sent Done Done false
33045 9322 Acked Read 5 Sent Done Done false
33046 9323 Acked Write 6 Sent Done Done false
33047 9324 Acked Read 10 Sent Done Done false
33048 9325 Acked Read 8 Sent Done Done false
33049 9326 Acked Write 10 Sent Done Done false
33050 9327 Acked Read 3 Sent Done Done false
33051 9328 Acked Read 6 Sent Done Done false
33052 9329 Acked Write 4 Sent Done Done false
33053 9330 Acked Read 10 Sent Done Done false
33054 9331 Acked Read 2 Sent Done Done false
33055 9332 Acked Read 9 Sent Done Done false
33056 9333 Acked Read 2 Sent Done Done false
33057 9334 Acked Read 6 Sent Done Done false
33058 9335 Acked Flush 0 Sent Done Done false
33059 9336 Acked Write 7 Sent Done Done false
33060 9337 Acked Write 5 Sent Done Done false
33061 9338 Acked Read 9 Sent Done Done false
33062 9339 Acked Write 6 Sent Done Done false
33063 9340 Acked Write 7 Sent Done Done false
33064 9341 Acked Write 6 Sent Done Done false
33065 9342 Acked Write 2 Sent Done Done false
33066 9343 Acked Read 3 Sent Done Done false
33067 9344 Acked Read 8 Sent Done Done false
33068 9345 Acked Read 5 Sent Done Done false
33069 9346 Acked Read 2 Sent Done Done false
33070 9347 Acked Read 2 Sent Done Done false
33071 9348 Acked Write 5 Sent Done Done false
33072 9349 Acked Read 2 Sent Done Done false
33073 9350 Acked Read 9 Sent Done Done false
33074 9351 Acked Write 9 Sent Done Done false
33075 9352 Acked Read 6 Sent Done Done false
33076 9353 Acked Read 9 Sent Done Done false
33077 9354 Acked Write 5 Sent Done Done false
33078 9355 Acked Write 2 Sent Done Done false
33079 9356 Acked Write 5 Sent Done Done false
33080 9357 Acked Read 5 Sent Done Done false
33081 9358 Acked Read 4 Sent Done Done false
33082 9359 Acked Read 4 Sent Done Done false
33083 9360 Acked Write 9 Sent Done Done false
33084 9361 Acked Read 2 Sent Done Done false
33085 9362 Acked Flush 0 Sent Done Done false
33086 9363 Acked Read 4 Sent Done Done false
33087 9364 Acked Read 1 Sent Done Done false
33088 9365 Acked Read 4 Sent Done Done false
33089 9366 Acked Write 8 Sent Done Done false
33090 9367 Acked Write 6 Sent Done Done false
33091 9368 Acked Read 2 Sent Done Done false
33092 9369 Acked Write 7 Sent Done Done false
33093 9370 Acked Flush 0 Sent Done Done false
33094 9371 Acked Read 9 Sent Done Done false
33095 9372 Acked Write 2 Sent Done Done false
33096 9373 Acked Read 7 Sent Done Done false
33097 9374 Acked Read 3 Sent Done Done false
33098 9375 Acked Read 7 Sent Done Done false
33099 9376 Acked Flush 0 Sent Done Done false
33100 9377 Acked Write 9 Sent Done Done false
33101 9378 Acked Write 8 Sent Done Done false
33102 9379 Acked Write 5 Sent Done Done false
33103 9380 Acked Read 8 Sent Done Done false
33104 9381 Acked Write 9 Sent Done Done false
33105 9382 Acked Write 8 Sent Done Done false
33106 9383 Acked Write 8 Sent Done Done false
33107 9384 Acked Read 2 Sent Done Done false
33108 9385 Acked Write 5 Sent Done Done false
33109 9386 Acked Read 8 Sent Done Done false
33110 9387 Acked Read 6 Sent Done Done false
33111 9388 Acked Write 5 Sent Done Done false
33112 9389 Acked Flush 0 Sent Done Done false
33113 9390 Acked Read 2 Sent Done Done false
33114 9391 Acked Read 4 Sent Done Done false
33115 9392 Acked Read 10 Sent Done Done false
33116 9393 Acked Read 3 Sent Done Done false
33117 9394 Acked Read 9 Sent Done Done false
33118 9395 Acked Write 6 Sent Done Done false
33119 9396 Acked Write 1 Sent Done Done false
33120 9397 Acked Write 9 Sent Done Done false
33121 9398 Acked Write 7 Sent Done Done false
33122 9399 Acked Write 5 Sent Done Done false
33123 9400 Acked Read 1 Sent Done Done false
33124 9401 Acked Read 10 Sent Done Done false
33125 9402 Acked Read 6 Sent Done Done false
33126 9403 Acked Flush 0 Sent Done Done false
33127 9404 Acked Write 4 Sent Done Done false
33128 9405 Acked Read 7 Sent Done Done false
33129 9406 Acked Read 5 Sent Done Done false
33130 9407 Acked Write 1 Sent Done Done false
33131 9408 Acked Write 5 Sent Done Done false
33132 9409 Acked Write 10 Sent Done Done false
33133 9410 Acked Read 2 Sent Done Done false
33134 9411 Acked Read 9 Sent Done Done false
33135 9412 Acked Read 4 Sent Done Done false
33136 9413 Acked Write 5 Sent Done Done false
33137 9414 Acked Read 10 Sent Done Done false
33138 9415 Acked Write 2 Sent Done Done false
33139 9416 Acked Read 7 Sent Done Done false
33140 9417 Acked Write 10 Sent Done Done false
33141 9418 Acked Write 7 Sent Done Done false
33142 9419 Acked Read 4 Sent Done Done false
33143 9420 Acked Write 6 Sent Done Done false
33144 9421 Acked Read 7 Sent Done Done false
33145 9422 Acked Write 1 Sent Done Done false
33146 9423 Acked Read 1 Sent Done Done false
33147 9424 Acked Read 4 Sent Done Done false
33148 9425 Acked Write 4 Sent Done Done false
33149 9426 Acked Write 1 Sent Done Done false
33150 9427 Acked Read 6 Sent Done Done false
33151 9428 Acked Read 4 Sent Done Done false
33152 9429 Acked Read 2 Sent Done Done false
33153 9430 Acked Read 6 Sent Done Done false
33154 9431 Acked Read 4 Sent Done Done false
33155 9432 Acked Flush 0 Sent Done Done false
33156 9433 Acked Read 9 Sent Done Done false
33157 9434 Acked Write 5 Sent Done Done false
33158 9435 Acked Flush 0 Sent Done Done false
33159 9436 Acked Write 10 Sent Done Done false
33160 9437 Acked Read 5 Sent Done Done false
33161 9438 Acked Read 7 Sent Done Done false
33162 9439 Acked Write 8 Sent Done Done false
33163 9440 Acked Write 7 Sent Done Done false
33164 9441 Acked Write 4 Sent Done Done false
33165 9442 Acked Write 10 Sent Done Done false
33166 9443 Acked Read 4 Sent Done Done false
33167 9444 Acked Write 6 Sent Done Done false
33168 9445 Acked Write 9 Sent Done Done false
33169 9446 Acked Write 1 Sent Done Done false
33170 9447 Acked Read 8 Sent Done Done false
33171 9448 Acked Write 4 Sent Done Done false
33172 9449 Acked Read 2 Sent Done Done false
33173 9450 Acked Write 5 Sent Done Done false
33174 9451 Acked Write 7 Sent Done Done false
33175 STATES DS:0 DS:1 DS:2 TOTAL
33176 Sent 301 0 0 301
33177 Done 0 301 301 602
33178 Skipped 0 0 0 0
33179 Error 0 0 0 0
33180 Last Flush: 9150 9435 9435
33181 Downstairs last five completed: 9150 9149 9148 9147 9146
33182 Upstairs last five completed: 9451 9450 9449 9448 9447
33183 CLIENT: Up:0 ds:301 act:2
33184 [8810] got start action
33185 [8810] I am going to restart
33186 Starting downstairs at port 8810
33187 Make output file at "/tmp/dsc/downstairs-8810.txt"
33188 [8810][0] reports Starting
33189 Downstairs /var/tmp/dsc/region/8810 port 8810 PID:Some(1230)
33190 [8810][0] reports Running
33191 ----------------------------------------------------------------
33192 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:302
33193 States: Offline Active Active
33194 JOBID ACK TYPE BKS/EXT DS:0 DS:1 DS:2 REPLAY
33195 9151 Acked Write 3 Sent Done Done false
33196 9152 Acked Write 7 Sent Done Done false
33197 9153 Acked Write 5 Sent Done Done false
33198 9154 Acked Flush 0 Sent Done Done false
33199 9155 Acked Flush 0 Sent Done Done false
33200 9156 Acked Read 9 Sent Done Done false
33201 9157 Acked Read 2 Sent Done Done false
33202 9158 Acked Write 6 Sent Done Done false
33203 9159 Acked Read 3 Sent Done Done false
33204 9160 Acked Read 10 Sent Done Done false
33205 9161 Acked Read 8 Sent Done Done false
33206 9162 Acked Write 2 Sent Done Done false
33207 9163 Acked Write 7 Sent Done Done false
33208 9164 Acked Read 6 Sent Done Done false
33209 9165 Acked Read 6 Sent Done Done false
33210 9166 Acked Write 8 Sent Done Done false
33211 9167 Acked Flush 0 Sent Done Done false
33212 9168 Acked Write 5 Sent Done Done false
33213 9169 Acked Read 8 Sent Done Done false
33214 9170 Acked Read 1 Sent Done Done false
33215 9171 Acked Write 5 Sent Done Done false
33216 9172 Acked Write 2 Sent Done Done false
33217 9173 Acked Read 1 Sent Done Done false
33218 9174 Acked Flush 0 Sent Done Done false
33219 9175 Acked Read 4 Sent Done Done false
33220 9176 Acked Write 1 Sent Done Done false
33221 9177 Acked Read 10 Sent Done Done false
33222 9178 Acked Read 10 Sent Done Done false
33223 9179 Acked Flush 0 Sent Done Done false
33224 9180 Acked Read 10 Sent Done Done false
33225 9181 Acked Read 10 Sent Done Done false
33226 9182 Acked Flush 0 Sent Done Done false
33227 9183 Acked Read 9 Sent Done Done false
33228 9184 Acked Flush 0 Sent Done Done false
33229 9185 Acked Write 5 Sent Done Done false
33230 9186 Acked Read 7 Sent Done Done false
33231 9187 Acked Write 10 Sent Done Done false
33232 9188 Acked Write 1 Sent Done Done false
33233 9189 Acked Write 4 Sent Done Done false
33234 9190 Acked Read 6 Sent Done Done false
33235 9191 Acked Write 3 Sent Done Done false
33236 9192 Acked Write 9 Sent Done Done false
33237 9193 Acked Flush 0 Sent Done Done false
33238 9194 Acked Write 10 Sent Done Done false
33239 9195 Acked Write 2 Sent Done Done false
33240 9196 Acked Flush 0 Sent Done Done false
33241 9197 Acked Write 6 Sent Done Done false
33242 9198 Acked Read 9 Sent Done Done false
33243 9199 Acked Read 1 Sent Done Done false
33244 9200 Acked Read 7 Sent Done Done false
33245 9201 Acked Read 7 Sent Done Done false
33246 9202 Acked Write 10 Sent Done Done false
33247 9203 Acked Flush 0 Sent Done Done false
33248 9204 Acked Write 3 Sent Done Done false
33249 9205 Acked Write 5 Sent Done Done false
33250 9206 Acked Read 10 Sent Done Done false
33251 9207 Acked Read 5 Sent Done Done false
33252 9208 Acked Read 3 Sent Done Done false
33253 9209 Acked Write 3 Sent Done Done false
33254 9210 Acked Read 5 Sent Done Done false
33255 9211 Acked Read 7 Sent Done Done false
33256 9212 Acked Write 5 Sent Done Done false
33257 9213 Acked Read 6 Sent Done Done false
33258 9214 Acked Read 4 Sent Done Done false
33259 9215 Acked Read 5 Sent Done Done false
33260 9216 Acked Read 4 Sent Done Done false
33261 9217 Acked Read 9 Sent Done Done false
33262 9218 Acked Read 7 Sent Done Done false
33263 9219 Acked Write 8 Sent Done Done false
33264 9220 Acked Flush 0 Sent Done Done false
33265 9221 Acked Write 3 Sent Done Done false
33266 9222 Acked Flush 0 Sent Done Done false
33267 9223 Acked Read 9 Sent Done Done false
33268 9224 Acked Write 9 Sent Done Done false
33269 9225 Acked Read 7 Sent Done Done false
33270 9226 Acked Write 2 Sent Done Done false
33271 9227 Acked Read 4 Sent Done Done false
33272 9228 Acked Read 5 Sent Done Done false
33273 9229 Acked Write 8 Sent Done Done false
33274 9230 Acked Read 9 Sent Done Done false
33275 9231 Acked Write 4 Sent Done Done false
33276 9232 Acked Read 5 Sent Done Done false
33277 9233 Acked Read 2 Sent Done Done false
33278 9234 Acked Flush 0 Sent Done Done false
33279 9235 Acked Write 4 Sent Done Done false
33280 9236 Acked Read 1 Sent Done Done false
33281 9237 Acked Write 1 Sent Done Done false
33282 9238 Acked Read 5 Sent Done Done false
33283 9239 Acked Write 5 Sent Done Done false
33284 9240 Acked Read 9 Sent Done Done false
33285 9241 Acked Write 7 Sent Done Done false
33286 9242 Acked Write 6 Sent Done Done false
33287 9243 Acked Write 9 Sent Done Done false
33288 9244 Acked Write 3 Sent Done Done false
33289 9245 Acked Read 10 Sent Done Done false
33290 9246 Acked Write 5 Sent Done Done false
33291 9247 Acked Write 5 Sent Done Done false
33292 9248 Acked Write 6 Sent Done Done false
33293 9249 Acked Write 4 Sent Done Done false
33294 9250 Acked Write 2 Sent Done Done false
33295 9251 Acked Read 4 Sent Done Done false
33296 9252 Acked Flush 0 Sent Done Done false
33297 9253 Acked Read 2 Sent Done Done false
33298 9254 Acked Write 9 Sent Done Done false
33299 9255 Acked Write 4 Sent Done Done false
33300 9256 Acked Read 10 Sent Done Done false
33301 9257 Acked Read 7 Sent Done Done false
33302 9258 Acked Write 7 Sent Done Done false
33303 9259 Acked Read 8 Sent Done Done false
33304 9260 Acked Read 5 Sent Done Done false
33305 9261 Acked Flush 0 Sent Done Done false
33306 9262 Acked Read 5 Sent Done Done false
33307 9263 Acked Read 6 Sent Done Done false
33308 9264 Acked Read 1 Sent Done Done false
33309 9265 Acked Write 2 Sent Done Done false
33310 9266 Acked Read 4 Sent Done Done false
33311 9267 Acked Write 6 Sent Done Done false
33312 9268 Acked Read 6 Sent Done Done false
33313 9269 Acked Write 5 Sent Done Done false
33314 9270 Acked Read 1 Sent Done Done false
33315 9271 Acked Read 2 Sent Done Done false
33316 9272 Acked Write 8 Sent Done Done false
33317 9273 Acked Write 4 Sent Done Done false
33318 9274 Acked Flush 0 Sent Done Done false
33319 9275 Acked Write 6 Sent Done Done false
33320 9276 Acked Write 1 Sent Done Done false
33321 9277 Acked Write 7 Sent Done Done false
33322 9278 Acked Write 1 Sent Done Done false
33323 9279 Acked Read 4 Sent Done Done false
33324 9280 Acked Read 7 Sent Done Done false
33325 9281 Acked Write 2 Sent Done Done false
33326 9282 Acked Read 2 Sent Done Done false
33327 9283 Acked Flush 0 Sent Done Done false
33328 9284 Acked Read 3 Sent Done Done false
33329 9285 Acked Write 2 Sent Done Done false
33330 9286 Acked Write 7 Sent Done Done false
33331 9287 Acked Write 1 Sent Done Done false
33332 9288 Acked Read 10 Sent Done Done false
33333 9289 Acked Write 3 Sent Done Done false
33334 9290 Acked Read 3 Sent Done Done false
33335 9291 Acked Write 8 Sent Done Done false
33336 9292 Acked Read 4 Sent Done Done false
33337 9293 Acked Write 3 Sent Done Done false
33338 9294 Acked Read 8 Sent Done Done false
33339 9295 Acked Read 1 Sent Done Done false
33340 9296 Acked Write 9 Sent Done Done false
33341 9297 Acked Read 7 Sent Done Done false
33342 9298 Acked Read 3 Sent Done Done false
33343 9299 Acked Read 4 Sent Done Done false
33344 9300 Acked Flush 0 Sent Done Done false
33345 9301 Acked Read 2 Sent Done Done false
33346 9302 Acked Write 8 Sent Done Done false
33347 9303 Acked Read 1 Sent Done Done false
33348 9304 Acked Read 3 Sent Done Done false
33349 9305 Acked Flush 0 Sent Done Done false
33350 9306 Acked Write 9 Sent Done Done false
33351 9307 Acked Write 1 Sent Done Done false
33352 9308 Acked Flush 0 Sent Done Done false
33353 9309 Acked Write 9 Sent Done Done false
33354 9310 Acked Write 1 Sent Done Done false
33355 9311 Acked Read 10 Sent Done Done false
33356 9312 Acked Read 1 Sent Done Done false
33357 9313 Acked Write 5 Sent Done Done false
33358 9314 Acked Read 2 Sent Done Done false
33359 9315 Acked Flush 0 Sent Done Done false
33360 9316 Acked Write 4 Sent Done Done false
33361 9317 Acked Read 8 Sent Done Done false
33362 9318 Acked Write 1 Sent Done Done false
33363 9319 Acked Write 1 Sent Done Done false
33364 9320 Acked Write 4 Sent Done Done false
33365 9321 Acked Read 7 Sent Done Done false
33366 9322 Acked Read 5 Sent Done Done false
33367 9323 Acked Write 6 Sent Done Done false
33368 9324 Acked Read 10 Sent Done Done false
33369 9325 Acked Read 8 Sent Done Done false
33370 9326 Acked Write 10 Sent Done Done false
33371 9327 Acked Read 3 Sent Done Done false
33372 9328 Acked Read 6 Sent Done Done false
33373 9329 Acked Write 4 Sent Done Done false
33374 9330 Acked Read 10 Sent Done Done false
33375 9331 Acked Read 2 Sent Done Done false
33376 9332 Acked Read 9 Sent Done Done false
33377 9333 Acked Read 2 Sent Done Done false
33378 9334 Acked Read 6 Sent Done Done false
33379 9335 Acked Flush 0 Sent Done Done false
33380 9336 Acked Write 7 Sent Done Done false
33381 9337 Acked Write 5 Sent Done Done false
33382 9338 Acked Read 9 Sent Done Done false
33383 9339 Acked Write 6 Sent Done Done false
33384 9340 Acked Write 7 Sent Done Done false
33385 9341 Acked Write 6 Sent Done Done false
33386 9342 Acked Write 2 Sent Done Done false
33387 9343 Acked Read 3 Sent Done Done false
33388 9344 Acked Read 8 Sent Done Done false
33389 9345 Acked Read 5 Sent Done Done false
33390 9346 Acked Read 2 Sent Done Done false
33391 9347 Acked Read 2 Sent Done Done false
33392 9348 Acked Write 5 Sent Done Done false
33393 9349 Acked Read 2 Sent Done Done false
33394 9350 Acked Read 9 Sent Done Done false
33395 9351 Acked Write 9 Sent Done Done false
33396 9352 Acked Read 6 Sent Done Done false
33397 9353 Acked Read 9 Sent Done Done false
33398 9354 Acked Write 5 Sent Done Done false
33399 9355 Acked Write 2 Sent Done Done false
33400 9356 Acked Write 5 Sent Done Done false
33401 9357 Acked Read 5 Sent Done Done false
33402 9358 Acked Read 4 Sent Done Done false
33403 9359 Acked Read 4 Sent Done Done false
33404 9360 Acked Write 9 Sent Done Done false
33405 9361 Acked Read 2 Sent Done Done false
33406 9362 Acked Flush 0 Sent Done Done false
33407 9363 Acked Read 4 Sent Done Done false
33408 9364 Acked Read 1 Sent Done Done false
33409 9365 Acked Read 4 Sent Done Done false
33410 9366 Acked Write 8 Sent Done Done false
33411 9367 Acked Write 6 Sent Done Done false
33412 9368 Acked Read 2 Sent Done Done false
33413 9369 Acked Write 7 Sent Done Done false
33414 9370 Acked Flush 0 Sent Done Done false
33415 9371 Acked Read 9 Sent Done Done false
33416 9372 Acked Write 2 Sent Done Done false
33417 9373 Acked Read 7 Sent Done Done false
33418 9374 Acked Read 3 Sent Done Done false
33419 9375 Acked Read 7 Sent Done Done false
33420 9376 Acked Flush 0 Sent Done Done false
33421 9377 Acked Write 9 Sent Done Done false
33422 9378 Acked Write 8 Sent Done Done false
33423 9379 Acked Write 5 Sent Done Done false
33424 9380 Acked Read 8 Sent Done Done false
33425 9381 Acked Write 9 Sent Done Done false
33426 9382 Acked Write 8 Sent Done Done false
33427 9383 Acked Write 8 Sent Done Done false
33428 9384 Acked Read 2 Sent Done Done false
33429 9385 Acked Write 5 Sent Done Done false
33430 9386 Acked Read 8 Sent Done Done false
33431 9387 Acked Read 6 Sent Done Done false
33432 9388 Acked Write 5 Sent Done Done false
33433 9389 Acked Flush 0 Sent Done Done false
33434 9390 Acked Read 2 Sent Done Done false
33435 9391 Acked Read 4 Sent Done Done false
33436 9392 Acked Read 10 Sent Done Done false
33437 9393 Acked Read 3 Sent Done Done false
33438 9394 Acked Read 9 Sent Done Done false
33439 9395 Acked Write 6 Sent Done Done false
33440 9396 Acked Write 1 Sent Done Done false
33441 9397 Acked Write 9 Sent Done Done false
33442 9398 Acked Write 7 Sent Done Done false
33443 9399 Acked Write 5 Sent Done Done false
33444 9400 Acked Read 1 Sent Done Done false
33445 9401 Acked Read 10 Sent Done Done false
33446 9402 Acked Read 6 Sent Done Done false
33447 9403 Acked Flush 0 Sent Done Done false
33448 9404 Acked Write 4 Sent Done Done false
33449 9405 Acked Read 7 Sent Done Done false
33450 9406 Acked Read 5 Sent Done Done false
33451 9407 Acked Write 1 Sent Done Done false
33452 9408 Acked Write 5 Sent Done Done false
33453 9409 Acked Write 10 Sent Done Done false
33454 9410 Acked Read 2 Sent Done Done false
33455 9411 Acked Read 9 Sent Done Done false
33456 9412 Acked Read 4 Sent Done Done false
33457 9413 Acked Write 5 Sent Done Done false
33458 9414 Acked Read 10 Sent Done Done false
33459 9415 Acked Write 2 Sent Done Done false
33460 9416 Acked Read 7 Sent Done Done false
33461 9417 Acked Write 10 Sent Done Done false
33462 9418 Acked Write 7 Sent Done Done false
33463 9419 Acked Read 4 Sent Done Done false
33464 9420 Acked Write 6 Sent Done Done false
33465 9421 Acked Read 7 Sent Done Done false
33466 9422 Acked Write 1 Sent Done Done false
33467 9423 Acked Read 1 Sent Done Done false
33468 9424 Acked Read 4 Sent Done Done false
33469 9425 Acked Write 4 Sent Done Done false
33470 9426 Acked Write 1 Sent Done Done false
33471 9427 Acked Read 6 Sent Done Done false
33472 9428 Acked Read 4 Sent Done Done false
33473 9429 Acked Read 2 Sent Done Done false
33474 9430 Acked Read 6 Sent Done Done false
33475 9431 Acked Read 4 Sent Done Done false
33476 9432 Acked Flush 0 Sent Done Done false
33477 9433 Acked Read 9 Sent Done Done false
33478 9434 Acked Write 5 Sent Done Done false
33479 9435 Acked Flush 0 Sent Done Done false
33480 9436 Acked Write 10 Sent Done Done false
33481 9437 Acked Read 5 Sent Done Done false
33482 9438 Acked Read 7 Sent Done Done false
33483 9439 Acked Write 8 Sent Done Done false
33484 9440 Acked Write 7 Sent Done Done false
33485 9441 Acked Write 4 Sent Done Done false
33486 9442 Acked Write 10 Sent Done Done false
33487 9443 Acked Read 4 Sent Done Done false
33488 9444 Acked Write 6 Sent Done Done false
33489 9445 Acked Write 9 Sent Done Done false
33490 9446 Acked Write 1 Sent Done Done false
33491 9447 Acked Read 8 Sent Done Done false
33492 9448 Acked Write 4 Sent Done Done false
33493 9449 Acked Read 2 Sent Done Done false
33494 9450 Acked Write 5 Sent Done Done false
33495 9451 Acked Write 7 Sent Done Done false
33496 9452 Acked Flush 0 Sent Done Done false
33497 STATES DS:0 DS:1 DS:2 TOTAL
33498 Sent 302 0 0 302
33499 Done 0 302 302 604
33500 Skipped 0 0 0 0
33501 Error 0 0 0 0
33502 Last Flush: 9150 9452 9452
33503 Downstairs last five completed: 9150 9149 9148 9147 9146
33504 Upstairs last five completed: 9452 9451 9450 9449 9448
33505 CLIENT: Up:0 ds:302 act:2
335062025-01-10T16:42:20.377ZINFOcrucible: connecting to 127.0.0.1:8810 = io task client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
335072025-01-10T16:42:20.378ZINFOcrucible: ds_connection connected from Ok(127.0.0.1:60439) = io task client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
335082025-01-10T16:42:20.379ZWARNcrucible: version negotiation from state Offline = downstairs client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
335092025-01-10T16:42:20.380ZINFOcrucible: downstairs client at Some(127.0.0.1:8810) has region UUID 12345678-0000-0000-0000-000000008810 = downstairs client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
335102025-01-10T16:42:20.380ZINFOcrucible: Returning UUID:12345678-0000-0000-0000-000000008810 matches = downstairs client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
335112025-01-10T16:42:20.380ZINFOcrucible: send last flush ID to this DS: 9150 = downstairs client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
335122025-01-10T16:42:20.380ZINFOcrucible: Replied this last flush ID: 9150 = downstairs client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
335132025-01-10T16:42:20.380ZINFOcrucible: ds_transition from Offline to Active = downstairs client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
335142025-01-10T16:42:20.380ZINFOcrucible: [0] Transition from Offline to Active = downstairs client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
335152025-01-10T16:42:20.380ZINFOcrucible: [0] client re-new 302 jobs since flush 9150 = downstairs session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
335162025-01-10T16:42:20.380ZINFOcrucible: [0] Replayed 302 jobs since flush: 9150 = downstairs session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
33517 ----------------------------------------------------------------
33518 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:0
33519 Downstairs last five completed: 9452 9451 9450 9449 9448
33520 Upstairs last five completed: 9452 9451 9450 9449 9448
33521 CLIENT: Up:0 ds:0 act:3
33522 Replay: All jobs finished
33523 Main task has work to do, go find it
33524 got dsc Stop(0)
33525 stop 0
33526 [8810] Got stop action so:false kr:false
33527 Jan 10 16:42:22.616 INFO request completed, latency_us: 350, response_code: 204, uri: /stop/cid/0, method: POST, req_id: c5524cea-2d5d-48e2-b735-92bca02f7b82, remote_addr: 127.0.0.1:55917, local_addr: 127.0.0.1:9998
335282025-01-10T16:42:22.616ZWARNcrucible: downstairs disconnected = io task client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
335292025-01-10T16:42:22.616ZWARNcrucible: client task is sending Done(Finished) = io task client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
335302025-01-10T16:42:22.616ZWARNcrucible: downstairs task for 0 stopped due to Finished session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
335312025-01-10T16:42:22.616ZINFOcrucible: ds_transition from Active to Offline = downstairs client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
335322025-01-10T16:42:22.616ZINFOcrucible: [0] Transition from Active to Offline = downstairs client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
33533 Jan 10 16:42:22.616 INFO request completed, latency_us: 144, response_code: 200, uri: /state/cid/0, method: GET, req_id: c7ebadee-8c15-4b12-89cc-6d426f25317a, remote_addr: 127.0.0.1:55917, local_addr: 127.0.0.1:9998
335342025-01-10T16:42:22.616ZINFOcrucible: client task is exiting = io task client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
33535 [8810] Exited with: ExitStatus(unix_wait_status(9))
33536 [8810][0] reports Exit
33537 Jan 10 16:42:26.618 INFO request completed, latency_us: 312, response_code: 200, uri: /state/cid/0, method: GET, req_id: 9aedc116-a448-48d9-bfc9-cfbd2b5e647c, remote_addr: 127.0.0.1:55917, local_addr: 127.0.0.1:9998
33538 001/300 Write block 4134 len 16384 data: 6 5 5 5
33539 002/300 Write block 1975 len 8192 data: 3 4
33540 003/300 Write block 4200 len 28672 data: 6 5 5 6 6 4 3
33541 004/300 Flush
33542 005/300 Read block 1149 len 16384
33543 006/300 Write block 1578 len 36864 data: 4 4 4 5 5 5 6 6 6
33544 007/300 Write block 3296 len 12288 data: 4 4 4
33545 008/300 Read block 210 len 36864
33546 009/300 Write block 1172 len 28672 data: 7 6 5 6 8 7 6
33547 010/300 Write block 1949 len 28672 data: 8 8 7 4 5 6 4
33548 011/300 Read block 3529 len 40960
33549 012/300 Write block 218 len 20480 data: 6 6 6 8 8
33550 013/300 Read block 295 len 8192
33551 014/300 Write block 1202 len 36864 data: 4 3 4 3 3 3 5 6 5
33552 015/300 Read block 4330 len 24576
33553 016/300 Read block 3356 len 16384
33554 017/300 Read block 2780 len 32768
33555 018/300 Read block 3032 len 20480
33556 019/300 Read block 3187 len 24576
33557 020/300 Write block 496 len 20480 data: 7 7 6 3 5
33558 021/300 Write block 4712 len 40960 data: 6 5 5 4 4 4 2 2 4 4
33559 022/300 Read block 318 len 20480
33560 023/300 Read block 381 len 20480
33561 024/300 Write block 505 len 16384 data: 6 6 7 6
33562 025/300 Read block 4769 len 28672
33563 026/300 Read block 2610 len 16384
33564 027/300 Read block 3524 len 12288
33565 028/300 Read block 6 len 28672
33566 029/300 Write block 536 len 16384 data: 6 6 6 6
33567 030/300 Read block 2661 len 12288
33568 031/300 Write block 229 len 28672 data: 8 8 9 8 7 7 8
33569 032/300 Write block 1755 len 28672 data: 8 6 6 5 8 9 10
33570 033/300 Write block 2811 len 24576 data: 11 10 8 7 7 4
33571 034/300 Write block 1608 len 8192 data: 6 4
33572 035/300 Read block 3666 len 28672
33573 036/300 Flush
33574 037/300 Write block 3531 len 24576 data: 3 3 4 5 4 8
33575 038/300 Read block 2674 len 4096
33576 039/300 Flush
33577 040/300 Write block 1692 len 20480 data: 6 7 7 8 9
33578 041/300 Read block 1086 len 16384
33579 042/300 Read block 207 len 16384
33580 043/300 Read block 3800 len 4096
33581 044/300 Write block 1597 len 12288 data: 5 6 6
33582 045/300 Write block 1074 len 8192 data: 2 2
33583 046/300 Write block 15 len 24576 data: 8 10 10 9 8 7
33584 047/300 Write block 4786 len 40960 data: 3 3 4 4 4 3 3 2 3 3
33585 048/300 Read block 753 len 40960
33586 049/300 Read block 600 len 40960
33587 050/300 Read block 4899 len 4096
33588 051/300 Read block 1707 len 16384
33589 052/300 Read block 1348 len 36864
33590 053/300 Read block 1019 len 16384
33591 054/300 Read block 4264 len 24576
33592 055/300 Read block 1399 len 28672
33593 056/300 Read block 3189 len 8192
33594 057/300 Read block 1742 len 12288
33595 058/300 Read block 732 len 8192
33596 059/300 Read block 2066 len 16384
33597 060/300 Read block 3935 len 36864
33598 061/300 Write block 4282 len 40960 data: 8 7 5 4 4 5 4 3 3 3
33599 062/300 Read block 4420 len 12288
33600 063/300 Read block 1661 len 12288
33601 064/300 Write block 3737 len 36864 data: 4 5 5 5 3 2 3 4 5
33602 065/300 Write block 3202 len 28672 data: 4 4 3 5 5 4 5
33603 066/300 Read block 876 len 20480
33604 067/300 Write block 2189 len 12288 data: 3 4 4
33605 068/300 Read block 1627 len 32768
33606 069/300 Read block 3024 len 24576
33607 070/300 Write block 4392 len 40960 data: 4 5 6 8 9 9 9 9 9 8
33608 071/300 Write block 762 len 40960 data: 6 5 7 7 6 4 4 3 2 4
33609 072/300 Write block 4969 len 40960 data: 4 5 3 3 3 4 5 6 7 6
33610 073/300 Write block 49 len 28672 data: 7 7 7 6 5 6 5
33611 074/300 Write block 4218 len 20480 data: 5 5 4 5 4
33612 075/300 Write block 4633 len 32768 data: 6 7 7 6 6 5 3 4
33613 076/300 Read block 2734 len 24576
33614 077/300 Read block 1052 len 8192
33615 078/300 Flush
33616 079/300 Read block 3383 len 4096
33617 080/300 Write block 3484 len 28672 data: 3 3 4 5 5 6 5
33618 081/300 Read block 199 len 24576
33619 082/300 Flush
33620 083/300 Flush
33621 084/300 Write block 4969 len 12288 data: 5 6 4
33622 085/300 Read block 976 len 28672
33623 086/300 Read block 1252 len 32768
33624 087/300 Flush
33625 088/300 Write block 305 len 24576 data: 5 5 5 5 6 8
33626 089/300 Read block 591 len 32768
33627 090/300 Flush
33628 091/300 Write block 3252 len 36864 data: 4 5 6 6 5 4 6 6 6
33629 092/300 Read block 1832 len 8192
33630 093/300 Read block 1187 len 36864
33631 094/300 Write block 3732 len 12288 data: 7 8 8
33632 095/300 Read block 1338 len 12288
33633 096/300 Read block 42 len 32768
33634 097/300 Write block 4937 len 24576 data: 4 5 4 4 5 6
33635 098/300 Write block 4185 len 32768 data: 3 5 6 5 4 6 8 8
33636 099/300 Write block 973 len 24576 data: 8 7 7 7 8 8
33637 100/300 Write block 264 len 32768 data: 7 8 9 9 8 8 8 8
33638 101/300 Read block 2175 len 36864
33639 102/300 Read block 4403 len 36864
33640 103/300 Write block 876 len 20480 data: 8 10 10 11 9
33641 104/300 Read block 3410 len 24576
33642 105/300 Read block 1698 len 28672
33643 106/300 Write block 2895 len 24576 data: 9 7 11 11 11 11
33644 107/300 Write block 3605 len 28672 data: 6 7 7 6 5 5 5
33645 108/300 Read block 4045 len 8192
33646 109/300 Write block 873 len 16384 data: 6 8 10 9
33647 110/300 Write block 1528 len 32768 data: 3 2 4 6 7 8 6 5
33648 111/300 Read block 705 len 20480
33649 112/300 Write block 2097 len 4096 data: 6
33650 113/300 Read block 1189 len 28672
33651 114/300 Write block 1667 len 40960 data: 7 6 7 6 6 6 6 5 7 6
33652 115/300 Write block 832 len 28672 data: 8 6 5 5 6 8 9
33653 116/300 Write block 4806 len 36864 data: 7 9 9 8 6 7 5 5 5
33654 117/300 Write block 902 len 36864 data: 2 3 4 3 3 3 6 9 8
33655 118/300 Read block 943 len 16384
33656 119/300 Read block 3806 len 24576
33657 120/300 Read block 2921 len 40960
33658 121/300 Read block 2966 len 40960
33659 122/300 Read block 4798 len 24576
33660 123/300 Read block 2532 len 4096
33661 124/300 Read block 1146 len 28672
33662 125/300 Read block 278 len 36864
33663 126/300 Write block 4178 len 12288 data: 8 8 8
33664 127/300 Write block 5 len 20480 data: 3 4 4 4 6
33665 128/300 Read block 3416 len 40960
33666 129/300 Read block 3042 len 32768
33667 130/300 Read block 4363 len 8192
33668 131/300 Read block 125 len 32768
33669 132/300 Write block 2157 len 4096 data: 6
33670 133/300 Read block 3153 len 20480
33671 134/300 Write block 1112 len 24576 data: 9 7 6 4 5 5
33672 135/300 Write block 2757 len 40960 data: 6 6 6 8 6 5 4 3 4 5
33673 136/300 Write block 3386 len 28672 data: 9 7 7 5 4 5 5
33674 137/300 Read block 3816 len 24576
33675 138/300 Read block 1416 len 36864
33676 139/300 Write block 3407 len 20480 data: 7 8 9 6 7
33677 140/300 Read block 547 len 4096
33678 141/300 Write block 3383 len 36864 data: 11 13 10 10 8 8 6 5 6
33679 142/300 Read block 623 len 28672
33680 143/300 Read block 4238 len 28672
33681 144/300 Write block 3940 len 32768 data: 7 7 9 12 11 11 11 10
33682 145/300 Write block 1754 len 12288 data: 7 9 7
33683 146/300 Write block 4796 len 24576 data: 3 3 3 3 6 6
33684 147/300 Write block 1057 len 8192 data: 4 6
33685 148/300 Read block 3053 len 28672
33686 149/300 Read block 4603 len 32768
33687 150/300 Read block 1583 len 40960
33688 151/300 Write block 3957 len 40960 data: 5 6 5 5 4 4 5 5 6 6
33689 152/300 Read block 3956 len 36864
33690 153/300 Write block 1155 len 40960 data: 6 6 7 7 6 9 9 8 9 7
33691 154/300 Read block 3640 len 32768
33692 155/300 Read block 2899 len 36864
33693 156/300 Write block 4108 len 40960 data: 6 6 6 6 5 5 5 6 8 8
33694 157/300 Read block 388 len 36864
33695 158/300 Read block 4086 len 32768
33696 159/300 Write block 606 len 4096 data: 12
33697 160/300 Write block 512 len 12288 data: 6 6 4
33698 161/300 Flush
33699 162/300 Read block 2533 len 16384
33700 163/300 Read block 452 len 24576
33701 164/300 Write block 415 len 8192 data: 4 6
33702 165/300 Read block 3265 len 32768
33703 166/300 Read block 4881 len 40960
33704 167/300 Write block 1877 len 40960 data: 7 5 6 6 6 4 5 5 6 6
33705 168/300 Write block 1172 len 40960 data: 8 7 6 7 9 8 7 8 10 9
33706 169/300 Write block 4744 len 8192 data: 6 7
33707 170/300 Write block 3944 len 24576 data: 12 12 12 11 9 6
33708 171/300 Write block 3089 len 8192 data: 6 6
33709 172/300 Write block 3736 len 4096 data: 5
33710 173/300 Read block 2406 len 16384
33711 174/300 Read block 0 len 32768
33712 175/300 Read block 4498 len 36864
33713 176/300 Read block 1417 len 40960
33714 177/300 Read block 3994 len 20480
33715 178/300 Write block 2601 len 36864 data: 6 6 5 5 5 4 5 5 4
33716 179/300 Read block 3509 len 32768
33717 180/300 Write block 2102 len 20480 data: 4 4 3 3 2
33718 181/300 Write block 4119 len 12288 data: 9 11 9
33719 182/300 Read block 4808 len 36864
33720 183/300 Write block 3555 len 28672 data: 7 6 6 5 6 7 5
33721 184/300 Write block 4780 len 36864 data: 4 5 3 3 3 3 4 4 5
33722 185/300 Read block 2981 len 32768
33723 186/300 Write block 1222 len 16384 data: 4 5 8 8
33724 187/300 Write block 2982 len 24576 data: 7 6 8 9 8 8
33725 188/300 Write block 4159 len 20480 data: 6 7 6 8 7
33726 189/300 Write block 3312 len 8192 data: 5 6
33727 190/300 Flush
33728 191/300 Write block 3283 len 28672 data: 4 5 5 6 6 7 7
33729 192/300 Read block 1302 len 20480
33730 193/300 Read block 3389 len 12288
33731 194/300 Read block 763 len 40960
33732 195/300 Read block 1524 len 12288
33733 196/300 Read block 2828 len 24576
33734 197/300 Write block 2383 len 28672 data: 8 7 7 8 9 9 9
33735 198/300 Read block 894 len 24576
33736 199/300 Write block 463 len 16384 data: 3 3 2 2
33737 200/300 Read block 4406 len 8192
33738 201/300 Read block 3089 len 16384
33739 202/300 Write block 463 len 36864 data: 4 4 3 3 2 2 3 5 5
33740 203/300 Write block 3617 len 8192 data: 4 3
33741 204/300 Read block 2678 len 28672
33742 205/300 Write block 4272 len 8192 data: 5 7
33743 206/300 Read block 1769 len 4096
33744 207/300 Read block 1850 len 4096
33745 208/300 Read block 1777 len 8192
33746 209/300 Write block 1471 len 8192 data: 8 8
33747 210/300 Write block 2640 len 28672 data: 10 9 9 10 9 8 9
33748 211/300 Write block 1212 len 8192 data: 2 2
33749 212/300 Read block 2780 len 32768
33750 213/300 Read block 1237 len 24576
33751 214/300 Write block 3546 len 36864 data: 6 8 9 7 7 9 8 7 8
33752 215/300 Write block 2900 len 12288 data: 12 11 11
33753 216/300 Write block 3145 len 12288 data: 5 7 9
33754 217/300 Write block 1345 len 16384 data: 7 7 7 5
33755 218/300 Write block 1263 len 4096 data: 3
33756 219/300 Read block 1276 len 8192
33757 220/300 Read block 939 len 24576
33758 221/300 Write block 3827 len 12288 data: 4 5 6
33759 222/300 Read block 1208 len 24576
33760 223/300 Read block 3257 len 32768
33761 224/300 Flush
33762 225/300 Read block 1344 len 36864
33763 226/300 Read block 3257 len 36864
33764 227/300 Read block 323 len 32768
33765 228/300 Read block 446 len 8192
33766 229/300 Read block 1739 len 8192
33767 230/300 Flush
33768 231/300 Read block 3187 len 32768
33769 232/300 Read block 1284 len 32768
33770 233/300 Write block 2037 len 36864 data: 9 10 9 7 8 7 6 4 4
33771 234/300 Flush
33772 235/300 Write block 4860 len 32768 data: 8 9 8 6 6 4 4 4
33773 236/300 Read block 2295 len 28672
33774 237/300 Flush
33775 238/300 Read block 1272 len 16384
33776 239/300 Read block 3013 len 16384
33777 240/300 Read block 3911 len 32768
33778 241/300 Read block 3454 len 8192
33779 242/300 Write block 1768 len 28672 data: 9 7 5 5 6 8 8
33780 243/300 Write block 1076 len 8192 data: 2 4
33781 244/300 Read block 4591 len 28672
33782 245/300 Write block 713 len 40960 data: 4 4 3 4 5 5 4 6 7 7
33783 246/300 Read block 2709 len 20480
33784 247/300 Read block 1147 len 4096
33785 248/300 Write block 2658 len 8192 data: 5 6
33786 249/300 Write block 3020 len 4096 data: 7
33787 250/300 Flush
33788 251/300 Write block 1625 len 36864 data: 7 7 7 7 6 7 8 7 11
33789 252/300 Read block 4556 len 4096
33790 253/300 Flush
33791 254/300 Read block 1726 len 36864
33792 255/300 Write block 4427 len 20480 data: 7 8 8 11 10
33793 256/300 Read block 1401 len 20480
33794 257/300 Write block 2081 len 28672 data: 7 5 4 4 4 4 4
33795 258/300 Write block 364 len 32768 data: 6 6 6 7 8 9 9 8
33796 259/300 Write block 2409 len 32768 data: 6 7 7 7 6 6 5 5
33797 260/300 Flush
33798 261/300 Write block 4304 len 12288 data: 5 3 3
33799 262/300 Flush
33800 263/300 Read block 3459 len 12288
33801 264/300 Write block 2962 len 40960 data: 5 5 4 4 3 3 3 5 5 4
33802 265/300 Read block 4054 len 4096
33803 266/300 Write block 3537 len 16384 data: 7 6 7 7
33804 267/300 Read block 1648 len 28672
33805 268/300 Write block 3920 len 40960 data: 5 6 5 6 7 7 6 5 5 5
33806 269/300 Write block 3779 len 4096 data: 7
33807 270/300 Read block 527 len 4096
33808 271/300 Write block 3658 len 32768 data: 10 9 8 5 5 6 7 6
33809 272/300 Read block 3382 len 28672
33810 273/300 Read block 4305 len 8192
33811 274/300 Write block 2609 len 40960 data: 5 4 5 7 7 6 6 7 8 9
33812 275/300 Write block 432 len 12288 data: 7 6 6
33813 276/300 Read block 1082 len 36864
33814 277/300 Flush
33815 278/300 Flush
33816 279/300 Read block 4146 len 24576
33817 280/300 Read block 2955 len 20480
33818 281/300 Write block 214 len 4096 data: 6
33819 282/300 Flush
33820 283/300 Write block 685 len 12288 data: 9 8 10
33821 284/300 Read block 3195 len 16384
33822 285/300 Flush
33823 286/300 Write block 3675 len 24576 data: 9 8 7 7 6 5
33824 287/300 Read block 2959 len 28672
33825 288/300 Read block 192 len 12288
33826 289/300 Write block 3279 len 28672 data: 4 3 3 3 5 6 6
33827 290/300 Write block 2379 len 12288 data: 8 4 6
33828 291/300 Flush
33829 292/300 Write block 492 len 8192 data: 5 5
33830 293/300 Read block 2998 len 8192
33831 294/300 Read block 3227 len 40960
33832 295/300 Read block 3070 len 4096
33833 296/300 Write block 3477 len 36864 data: 4 4 4 3 3 4 3 4 4
33834 297/300 Read block 2444 len 20480
33835 298/300 Write block 596 len 32768 data: 4 5 7 9 9 10 8 10
33836 299/300 Read block 1308 len 32768
33837 300/300 Read block 2843 len 4096
33838 301/300 Write block 2470 len 36864 data: 4 5 5 5 5 5 5 5 5
33839 Main task has work to do, go find it
33840 got dsc Start(0)
33841 start 0
33842 Jan 10 16:42:26.858 INFO request completed, latency_us: 208, response_code: 204, uri: /start/cid/0, method: POST, req_id: bfa2c52c-9f8b-457f-8a42-e7e6dc346698, remote_addr: 127.0.0.1:55917, local_addr: 127.0.0.1:9998
33843 Replay: started 0, returned:Ok(())
33844 ----------------------------------------------------------------
33845 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:301
33846 States: Offline Active Active
33847 JOBID ACK TYPE BKS/EXT DS:0 DS:1 DS:2 REPLAY
33848 9453 Acked Write 4 Sent Done Done false
33849 9454 Acked Write 2 Sent Done Done false
33850 9455 Acked Write 7 Sent Done Done false
33851 9456 Acked Flush 0 Sent Done Done false
33852 9457 Acked Read 4 Sent Done Done false
33853 9458 Acked Write 9 Sent Done Done false
33854 9459 Acked Write 3 Sent Done Done false
33855 9460 Acked Read 9 Sent Done Done false
33856 9461 Acked Write 7 Sent Done Done false
33857 9462 Acked Write 7 Sent Done Done false
33858 9463 Acked Read 10 Sent Done Done false
33859 9464 Acked Write 5 Sent Done Done false
33860 9465 Acked Read 2 Sent Done Done false
33861 9466 Acked Write 9 Sent Done Done false
33862 9467 Acked Read 6 Sent Done Done false
33863 9468 Acked Read 4 Sent Done Done false
33864 9469 Acked Read 8 Sent Done Done false
33865 9470 Acked Read 5 Sent Done Done false
33866 9471 Acked Read 6 Sent Done Done false
33867 9472 Acked Write 5 Sent Done Done false
33868 9473 Acked Write 10 Sent Done Done false
33869 9474 Acked Read 5 Sent Done Done false
33870 9475 Acked Read 5 Sent Done Done false
33871 9476 Acked Write 4 Sent Done Done false
33872 9477 Acked Read 7 Sent Done Done false
33873 9478 Acked Read 4 Sent Done Done false
33874 9479 Acked Read 3 Sent Done Done false
33875 9480 Acked Read 7 Sent Done Done false
33876 9481 Acked Write 4 Sent Done Done false
33877 9482 Acked Read 3 Sent Done Done false
33878 9483 Acked Write 7 Sent Done Done false
33879 9484 Acked Write 7 Sent Done Done false
33880 9485 Acked Write 6 Sent Done Done false
33881 9486 Acked Write 2 Sent Done Done false
33882 9487 Acked Read 7 Sent Done Done false
33883 9488 Acked Flush 0 Sent Done Done false
33884 9489 Acked Write 6 Sent Done Done false
33885 9490 Acked Read 1 Sent Done Done false
33886 9491 Acked Flush 0 Sent Done Done false
33887 9492 Acked Write 5 Sent Done Done false
33888 9493 Acked Read 4 Sent Done Done false
33889 9494 Acked Read 4 Sent Done Done false
33890 9495 Acked Read 1 Sent Done Done false
33891 9496 Acked Write 3 Sent Done Done false
33892 9497 Acked Write 2 Sent Done Done false
33893 9498 Acked Write 6 Sent Done Done false
33894 9499 Acked Write 10 Sent Done Done false
33895 9500 Acked Read 10 Sent Done Done false
33896 9501 Acked Read 10 Sent Done Done false
33897 9502 Acked Read 1 Sent Done Done false
33898 9503 Acked Read 4 Sent Done Done false
33899 9504 Acked Read 9 Sent Done Done false
33900 9505 Acked Read 4 Sent Done Done false
33901 9506 Acked Read 6 Sent Done Done false
33902 9507 Acked Read 7 Sent Done Done false
33903 9508 Acked Read 2 Sent Done Done false
33904 9509 Acked Read 3 Sent Done Done false
33905 9510 Acked Read 2 Sent Done Done false
33906 9511 Acked Read 4 Sent Done Done false
33907 9512 Acked Read 9 Sent Done Done false
33908 9513 Acked Write 10 Sent Done Done false
33909 9514 Acked Read 3 Sent Done Done false
33910 9515 Acked Read 3 Sent Done Done false
33911 9516 Acked Write 9 Sent Done Done false
33912 9517 Acked Write 7 Sent Done Done false
33913 9518 Acked Read 5 Sent Done Done false
33914 9519 Acked Write 3 Sent Done Done false
33915 9520 Acked Read 8 Sent Done Done false
33916 9521 Acked Read 6 Sent Done Done false
33917 9522 Acked Write 10 Sent Done Done false
33918 9523 Acked Write 10 Sent Done Done false
33919 9524 Acked Write 10 Sent Done Done false
33920 9525 Acked Write 7 Sent Done Done false
33921 9526 Acked Write 5 Sent Done Done false
33922 9527 Acked Write 8 Sent Done Done false
33923 9528 Acked Read 6 Sent Done Done false
33924 9529 Acked Read 2 Sent Done Done false
33925 9530 Acked Flush 0 Sent Done Done false
33926 9531 Acked Read 1 Sent Done Done false
33927 9532 Acked Write 7 Sent Done Done false
33928 9533 Acked Read 6 Sent Done Done false
33929 9534 Acked Flush 0 Sent Done Done false
33930 9535 Acked Flush 0 Sent Done Done false
33931 9536 Acked Write 3 Sent Done Done false
33932 9537 Acked Read 7 Sent Done Done false
33933 9538 Acked Read 8 Sent Done Done false
33934 9539 Acked Flush 0 Sent Done Done false
33935 9540 Acked Write 6 Sent Done Done false
33936 9541 Acked Read 8 Sent Done Done false
33937 9542 Acked Flush 0 Sent Done Done false
33938 9543 Acked Write 9 Sent Done Done false
33939 9544 Acked Read 2 Sent Done Done false
33940 9545 Acked Read 9 Sent Done Done false
33941 9546 Acked Write 3 Sent Done Done false
33942 9547 Acked Read 3 Sent Done Done false
33943 9548 Acked Read 8 Sent Done Done false
33944 9549 Acked Write 6 Sent Done Done false
33945 9550 Acked Write 8 Sent Done Done false
33946 9551 Acked Write 6 Sent Done Done false
33947 9552 Acked Write 8 Sent Done Done false
33948 9553 Acked Read 9 Sent Done Done false
33949 9554 Acked Read 9 Sent Done Done false
33950 9555 Acked Write 5 Sent Done Done false
33951 9556 Acked Read 6 Sent Done Done false
33952 9557 Acked Read 7 Sent Done Done false
33953 9558 Acked Write 6 Sent Done Done false
33954 9559 Acked Write 7 Sent Done Done false
33955 9560 Acked Read 2 Sent Done Done false
33956 9561 Acked Write 4 Sent Done Done false
33957 9562 Acked Write 8 Sent Done Done false
33958 9563 Acked Read 5 Sent Done Done false
33959 9564 Acked Write 1 Sent Done Done false
33960 9565 Acked Read 7 Sent Done Done false
33961 9566 Acked Write 10 Sent Done Done false
33962 9567 Acked Write 7 Sent Done Done false
33963 9568 Acked Write 9 Sent Done Done false
33964 9569 Acked Write 9 Sent Done Done false
33965 9570 Acked Read 4 Sent Done Done false
33966 9571 Acked Read 6 Sent Done Done false
33967 9572 Acked Read 10 Sent Done Done false
33968 9573 Acked Read 10 Sent Done Done false
33969 9574 Acked Read 6 Sent Done Done false
33970 9575 Acked Read 1 Sent Done Done false
33971 9576 Acked Read 7 Sent Done Done false
33972 9577 Acked Read 9 Sent Done Done false
33973 9578 Acked Write 3 Sent Done Done false
33974 9579 Acked Write 5 Sent Done Done false
33975 9580 Acked Read 10 Sent Done Done false
33976 9581 Acked Read 8 Sent Done Done false
33977 9582 Acked Read 2 Sent Done Done false
33978 9583 Acked Read 8 Sent Done Done false
33979 9584 Acked Write 1 Sent Done Done false
33980 9585 Acked Read 5 Sent Done Done false
33981 9586 Acked Write 6 Sent Done Done false
33982 9587 Acked Write 10 Sent Done Done false
33983 9588 Acked Write 7 Sent Done Done false
33984 9589 Acked Read 6 Sent Done Done false
33985 9590 Acked Read 9 Sent Done Done false
33986 9591 Acked Write 5 Sent Done Done false
33987 9592 Acked Read 1 Sent Done Done false
33988 9593 Acked Write 9 Sent Done Done false
33989 9594 Acked Read 7 Sent Done Done false
33990 9595 Acked Read 7 Sent Done Done false
33991 9596 Acked Write 8 Sent Done Done false
33992 9597 Acked Write 3 Sent Done Done false
33993 9598 Acked Write 6 Sent Done Done false
33994 9599 Acked Write 2 Sent Done Done false
33995 9600 Acked Read 7 Sent Done Done false
33996 9601 Acked Read 8 Sent Done Done false
33997 9602 Acked Read 10 Sent Done Done false
33998 9603 Acked Write 10 Sent Done Done false
33999 9604 Acked Read 9 Sent Done Done false
34000 9605 Acked Write 10 Sent Done Done false
34001 9606 Acked Read 8 Sent Done Done false
34002 9607 Acked Read 9 Sent Done Done false
34003 9608 Acked Write 10 Sent Done Done false
34004 9609 Acked Read 9 Sent Done Done false
34005 9610 Acked Read 8 Sent Done Done false
34006 9611 Acked Write 1 Sent Done Done false
34007 9612 Acked Write 3 Sent Done Done false
34008 9613 Acked Flush 0 Sent Done Done false
34009 9614 Acked Read 4 Sent Done Done false
34010 9615 Acked Read 6 Sent Done Done false
34011 9616 Acked Write 2 Sent Done Done false
34012 9617 Acked Read 8 Sent Done Done false
34013 9618 Acked Read 10 Sent Done Done false
34014 9619 Acked Write 10 Sent Done Done false
34015 9620 Acked Write 10 Sent Done Done false
34016 9621 Acked Write 2 Sent Done Done false
34017 9622 Acked Write 6 Sent Done Done false
34018 9623 Acked Write 2 Sent Done Done false
34019 9624 Acked Write 1 Sent Done Done false
34020 9625 Acked Read 4 Sent Done Done false
34021 9626 Acked Read 8 Sent Done Done false
34022 9627 Acked Read 9 Sent Done Done false
34023 9628 Acked Read 10 Sent Done Done false
34024 9629 Acked Read 5 Sent Done Done false
34025 9630 Acked Write 9 Sent Done Done false
34026 9631 Acked Read 8 Sent Done Done false
34027 9632 Acked Write 5 Sent Done Done false
34028 9633 Acked Write 3 Sent Done Done false
34029 9634 Acked Read 9 Sent Done Done false
34030 9635 Acked Write 7 Sent Done Done false
34031 9636 Acked Write 9 Sent Done Done false
34032 9637 Acked Read 8 Sent Done Done false
34033 9638 Acked Write 4 Sent Done Done false
34034 9639 Acked Write 6 Sent Done Done false
34035 9640 Acked Write 5 Sent Done Done false
34036 9641 Acked Write 2 Sent Done Done false
34037 9642 Acked Flush 0 Sent Done Done false
34038 9643 Acked Write 7 Sent Done Done false
34039 9644 Acked Read 5 Sent Done Done false
34040 9645 Acked Read 3 Sent Done Done false
34041 9646 Acked Read 10 Sent Done Done false
34042 9647 Acked Read 3 Sent Done Done false
34043 9648 Acked Read 6 Sent Done Done false
34044 9649 Acked Write 7 Sent Done Done false
34045 9650 Acked Read 6 Sent Done Done false
34046 9651 Acked Write 4 Sent Done Done false
34047 9652 Acked Read 2 Sent Done Done false
34048 9653 Acked Read 4 Sent Done Done false
34049 9654 Acked Write 9 Sent Done Done false
34050 9655 Acked Write 2 Sent Done Done false
34051 9656 Acked Read 7 Sent Done Done false
34052 9657 Acked Write 2 Sent Done Done false
34053 9658 Acked Read 1 Sent Done Done false
34054 9659 Acked Read 1 Sent Done Done false
34055 9660 Acked Read 2 Sent Done Done false
34056 9661 Acked Write 2 Sent Done Done false
34057 9662 Acked Write 7 Sent Done Done false
34058 9663 Acked Write 2 Sent Done Done false
34059 9664 Acked Read 8 Sent Done Done false
34060 9665 Acked Read 6 Sent Done Done false
34061 9666 Acked Write 9 Sent Done Done false
34062 9667 Acked Write 3 Sent Done Done false
34063 9668 Acked Write 3 Sent Done Done false
34064 9669 Acked Write 4 Sent Done Done false
34065 9670 Acked Write 1 Sent Done Done false
34066 9671 Acked Read 2 Sent Done Done false
34067 9672 Acked Read 6 Sent Done Done false
34068 9673 Acked Write 3 Sent Done Done false
34069 9674 Acked Read 6 Sent Done Done false
34070 9675 Acked Read 8 Sent Done Done false
34071 9676 Acked Flush 0 Sent Done Done false
34072 9677 Acked Read 9 Sent Done Done false
34073 9678 Acked Read 9 Sent Done Done false
34074 9679 Acked Read 8 Sent Done Done false
34075 9680 Acked Read 2 Sent Done Done false
34076 9681 Acked Read 2 Sent Done Done false
34077 9682 Acked Flush 0 Sent Done Done false
34078 9683 Acked Read 8 Sent Done Done false
34079 9684 Acked Read 8 Sent Done Done false
34080 9685 Acked Write 9 Sent Done Done false
34081 9686 Acked Flush 0 Sent Done Done false
34082 9687 Acked Write 8 Sent Done Done false
34083 9688 Acked Read 7 Sent Done Done false
34084 9689 Acked Flush 0 Sent Done Done false
34085 9690 Acked Read 4 Sent Done Done false
34086 9691 Acked Read 4 Sent Done Done false
34087 9692 Acked Read 8 Sent Done Done false
34088 9693 Acked Read 2 Sent Done Done false
34089 9694 Acked Write 7 Sent Done Done false
34090 9695 Acked Write 2 Sent Done Done false
34091 9696 Acked Read 7 Sent Done Done false
34092 9697 Acked Write 10 Sent Done Done false
34093 9698 Acked Read 5 Sent Done Done false
34094 9699 Acked Read 1 Sent Done Done false
34095 9700 Acked Write 2 Sent Done Done false
34096 9701 Acked Write 1 Sent Done Done false
34097 9702 Acked Flush 0 Sent Done Done false
34098 9703 Acked Write 9 Sent Done Done false
34099 9704 Acked Read 1 Sent Done Done false
34100 9705 Acked Flush 0 Sent Done Done false
34101 9706 Acked Read 9 Sent Done Done false
34102 9707 Acked Write 5 Sent Done Done false
34103 9708 Acked Read 5 Sent Done Done false
34104 9709 Acked Write 7 Sent Done Done false
34105 9710 Acked Write 8 Sent Done Done false
34106 9711 Acked Write 8 Sent Done Done false
34107 9712 Acked Flush 0 Sent Done Done false
34108 9713 Acked Write 3 Sent Done Done false
34109 9714 Acked Flush 0 Sent Done Done false
34110 9715 Acked Read 3 Sent Done Done false
34111 9716 Acked Write 10 Sent Done Done false
34112 9717 Acked Read 1 Sent Done Done false
34113 9718 Acked Write 4 Sent Done Done false
34114 9719 Acked Read 7 Sent Done Done false
34115 9720 Acked Write 10 Sent Done Done false
34116 9721 Acked Write 1 Sent Done Done false
34117 9722 Acked Read 1 Sent Done Done false
34118 9723 Acked Write 8 Sent Done Done false
34119 9724 Acked Read 7 Sent Done Done false
34120 9725 Acked Read 2 Sent Done Done false
34121 9726 Acked Write 10 Sent Done Done false
34122 9727 Acked Write 3 Sent Done Done false
34123 9728 Acked Read 9 Sent Done Done false
34124 9729 Acked Flush 0 Sent Done Done false
34125 9730 Acked Flush 0 Sent Done Done false
34126 9731 Acked Read 6 Sent Done Done false
34127 9732 Acked Read 5 Sent Done Done false
34128 9733 Acked Write 1 Sent Done Done false
34129 9734 Acked Flush 0 Sent Done Done false
34130 9735 Acked Write 3 Sent Done Done false
34131 9736 Acked Read 4 Sent Done Done false
34132 9737 Acked Flush 0 Sent Done Done false
34133 9738 Acked Write 6 Sent Done Done false
34134 9739 Acked Read 7 Sent Done Done false
34135 9740 Acked Read 3 Sent Done Done false
34136 9741 Acked Write 7 Sent Done Done false
34137 9742 Acked Write 3 Sent Done Done false
34138 9743 Acked Flush 0 Sent Done Done false
34139 9744 Acked Write 2 Sent Done Done false
34140 9745 Acked Read 2 Sent Done Done false
34141 9746 Acked Read 10 Sent Done Done false
34142 9747 Acked Read 1 Sent Done Done false
34143 9748 Acked Write 9 Sent Done Done false
34144 9749 Acked Read 5 Sent Done Done false
34145 9750 Acked Write 8 Sent Done Done false
34146 9751 Acked Read 8 Sent Done Done false
34147 9752 Acked Read 1 Sent Done Done false
34148 9753 Acked Write 9 Sent Done Sent false
34149 STATES DS:0 DS:1 DS:2 TOTAL
34150 Sent 301 0 1 302
34151 Done 0 301 300 601
34152 Skipped 0 0 0 0
34153 Error 0 0 0 0
34154 Last Flush: 9452 9743 9743
34155 Downstairs last five completed: 9452 9451 9450 9449 9448
34156 Upstairs last five completed: 9753 9752 9751 9750 9749
34157 CLIENT: Up:0 ds:301 act:2
34158 ----------------------------------------------------------------
34159 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:302
34160 States: Offline Active Active
34161 JOBID ACK TYPE BKS/EXT DS:0 DS:1 DS:2 REPLAY
34162 9453 Acked Write 4 Sent Done Done false
34163 9454 Acked Write 2 Sent Done Done false
34164 9455 Acked Write 7 Sent Done Done false
34165 9456 Acked Flush 0 Sent Done Done false
34166 9457 Acked Read 4 Sent Done Done false
34167 9458 Acked Write 9 Sent Done Done false
34168 9459 Acked Write 3 Sent Done Done false
34169 9460 Acked Read 9 Sent Done Done false
34170 9461 Acked Write 7 Sent Done Done false
34171 9462 Acked Write 7 Sent Done Done false
34172 9463 Acked Read 10 Sent Done Done false
34173 9464 Acked Write 5 Sent Done Done false
34174 9465 Acked Read 2 Sent Done Done false
34175 9466 Acked Write 9 Sent Done Done false
34176 9467 Acked Read 6 Sent Done Done false
34177 9468 Acked Read 4 Sent Done Done false
34178 9469 Acked Read 8 Sent Done Done false
34179 9470 Acked Read 5 Sent Done Done false
34180 9471 Acked Read 6 Sent Done Done false
34181 9472 Acked Write 5 Sent Done Done false
34182 9473 Acked Write 10 Sent Done Done false
34183 9474 Acked Read 5 Sent Done Done false
34184 9475 Acked Read 5 Sent Done Done false
34185 9476 Acked Write 4 Sent Done Done false
34186 9477 Acked Read 7 Sent Done Done false
34187 9478 Acked Read 4 Sent Done Done false
34188 9479 Acked Read 3 Sent Done Done false
34189 9480 Acked Read 7 Sent Done Done false
34190 9481 Acked Write 4 Sent Done Done false
34191 9482 Acked Read 3 Sent Done Done false
34192 9483 Acked Write 7 Sent Done Done false
34193 9484 Acked Write 7 Sent Done Done false
34194 9485 Acked Write 6 Sent Done Done false
34195 9486 Acked Write 2 Sent Done Done false
34196 9487 Acked Read 7 Sent Done Done false
34197 9488 Acked Flush 0 Sent Done Done false
34198 9489 Acked Write 6 Sent Done Done false
34199 9490 Acked Read 1 Sent Done Done false
34200 9491 Acked Flush 0 Sent Done Done false
34201 9492 Acked Write 5 Sent Done Done false
34202 9493 Acked Read 4 Sent Done Done false
34203 9494 Acked Read 4 Sent Done Done false
34204 9495 Acked Read 1 Sent Done Done false
34205 9496 Acked Write 3 Sent Done Done false
34206 9497 Acked Write 2 Sent Done Done false
34207 9498 Acked Write 6 Sent Done Done false
34208 9499 Acked Write 10 Sent Done Done false
34209 9500 Acked Read 10 Sent Done Done false
34210 9501 Acked Read 10 Sent Done Done false
34211 9502 Acked Read 1 Sent Done Done false
34212 9503 Acked Read 4 Sent Done Done false
34213 9504 Acked Read 9 Sent Done Done false
34214 9505 Acked Read 4 Sent Done Done false
34215 9506 Acked Read 6 Sent Done Done false
34216 9507 Acked Read 7 Sent Done Done false
34217 9508 Acked Read 2 Sent Done Done false
34218 9509 Acked Read 3 Sent Done Done false
34219 9510 Acked Read 2 Sent Done Done false
34220 9511 Acked Read 4 Sent Done Done false
34221 9512 Acked Read 9 Sent Done Done false
34222 9513 Acked Write 10 Sent Done Done false
34223 9514 Acked Read 3 Sent Done Done false
34224 9515 Acked Read 3 Sent Done Done false
34225 9516 Acked Write 9 Sent Done Done false
34226 9517 Acked Write 7 Sent Done Done false
34227 9518 Acked Read 5 Sent Done Done false
34228 9519 Acked Write 3 Sent Done Done false
34229 9520 Acked Read 8 Sent Done Done false
34230 9521 Acked Read 6 Sent Done Done false
34231 9522 Acked Write 10 Sent Done Done false
34232 9523 Acked Write 10 Sent Done Done false
34233 9524 Acked Write 10 Sent Done Done false
34234 9525 Acked Write 7 Sent Done Done false
34235 9526 Acked Write 5 Sent Done Done false
34236 9527 Acked Write 8 Sent Done Done false
34237 9528 Acked Read 6 Sent Done Done false
34238 9529 Acked Read 2 Sent Done Done false
34239 9530 Acked Flush 0 Sent Done Done false
34240 9531 Acked Read 1 Sent Done Done false
34241 9532 Acked Write 7 Sent Done Done false
34242 9533 Acked Read 6 Sent Done Done false
34243 9534 Acked Flush 0 Sent Done Done false
34244 9535 Acked Flush 0 Sent Done Done false
34245 9536 Acked Write 3 Sent Done Done false
34246 9537 Acked Read 7 Sent Done Done false
34247 9538 Acked Read 8 Sent Done Done false
34248 9539 Acked Flush 0 Sent Done Done false
34249 9540 Acked Write 6 Sent Done Done false
34250 9541 Acked Read 8 Sent Done Done false
34251 9542 Acked Flush 0 Sent Done Done false
34252 9543 Acked Write 9 Sent Done Done false
34253 9544 Acked Read 2 Sent Done Done false
34254 9545 Acked Read 9 Sent Done Done false
34255 9546 Acked Write 3 Sent Done Done false
34256 9547 Acked Read 3 Sent Done Done false
34257 9548 Acked Read 8 Sent Done Done false
34258 9549 Acked Write 6 Sent Done Done false
34259 9550 Acked Write 8 Sent Done Done false
34260 9551 Acked Write 6 Sent Done Done false
34261 9552 Acked Write 8 Sent Done Done false
34262 9553 Acked Read 9 Sent Done Done false
34263 9554 Acked Read 9 Sent Done Done false
34264 9555 Acked Write 5 Sent Done Done false
34265 9556 Acked Read 6 Sent Done Done false
34266 9557 Acked Read 7 Sent Done Done false
34267 9558 Acked Write 6 Sent Done Done false
34268 9559 Acked Write 7 Sent Done Done false
34269 9560 Acked Read 2 Sent Done Done false
34270 9561 Acked Write 4 Sent Done Done false
34271 9562 Acked Write 8 Sent Done Done false
34272 9563 Acked Read 5 Sent Done Done false
34273 9564 Acked Write 1 Sent Done Done false
34274 9565 Acked Read 7 Sent Done Done false
34275 9566 Acked Write 10 Sent Done Done false
34276 9567 Acked Write 7 Sent Done Done false
34277 9568 Acked Write 9 Sent Done Done false
34278 9569 Acked Write 9 Sent Done Done false
34279 9570 Acked Read 4 Sent Done Done false
34280 9571 Acked Read 6 Sent Done Done false
34281 9572 Acked Read 10 Sent Done Done false
34282 9573 Acked Read 10 Sent Done Done false
34283 9574 Acked Read 6 Sent Done Done false
34284 9575 Acked Read 1 Sent Done Done false
34285 9576 Acked Read 7 Sent Done Done false
34286 9577 Acked Read 9 Sent Done Done false
34287 9578 Acked Write 3 Sent Done Done false
34288 9579 Acked Write 5 Sent Done Done false
34289 9580 Acked Read 10 Sent Done Done false
34290 9581 Acked Read 8 Sent Done Done false
34291 9582 Acked Read 2 Sent Done Done false
34292 9583 Acked Read 8 Sent Done Done false
34293 9584 Acked Write 1 Sent Done Done false
34294 9585 Acked Read 5 Sent Done Done false
34295 9586 Acked Write 6 Sent Done Done false
34296 9587 Acked Write 10 Sent Done Done false
34297 9588 Acked Write 7 Sent Done Done false
34298 9589 Acked Read 6 Sent Done Done false
34299 9590 Acked Read 9 Sent Done Done false
34300 9591 Acked Write 5 Sent Done Done false
34301 9592 Acked Read 1 Sent Done Done false
34302 9593 Acked Write 9 Sent Done Done false
34303 9594 Acked Read 7 Sent Done Done false
34304 9595 Acked Read 7 Sent Done Done false
34305 9596 Acked Write 8 Sent Done Done false
34306 9597 Acked Write 3 Sent Done Done false
34307 9598 Acked Write 6 Sent Done Done false
34308 9599 Acked Write 2 Sent Done Done false
34309 9600 Acked Read 7 Sent Done Done false
34310 9601 Acked Read 8 Sent Done Done false
34311 9602 Acked Read 10 Sent Done Done false
34312 9603 Acked Write 10 Sent Done Done false
34313 9604 Acked Read 9 Sent Done Done false
34314 9605 Acked Write 10 Sent Done Done false
34315 9606 Acked Read 8 Sent Done Done false
34316 9607 Acked Read 9 Sent Done Done false
34317 9608 Acked Write 10 Sent Done Done false
34318 9609 Acked Read 9 Sent Done Done false
34319 9610 Acked Read 8 Sent Done Done false
34320 9611 Acked Write 1 Sent Done Done false
34321 9612 Acked Write 3 Sent Done Done false
34322 9613 Acked Flush 0 Sent Done Done false
34323 9614 Acked Read 4 Sent Done Done false
34324 9615 Acked Read 6 Sent Done Done false
34325 9616 Acked Write 2 Sent Done Done false
34326 9617 Acked Read 8 Sent Done Done false
34327 9618 Acked Read 10 Sent Done Done false
34328 9619 Acked Write 10 Sent Done Done false
34329 9620 Acked Write 10 Sent Done Done false
34330 9621 Acked Write 2 Sent Done Done false
34331 9622 Acked Write 6 Sent Done Done false
34332 9623 Acked Write 2 Sent Done Done false
34333 9624 Acked Write 1 Sent Done Done false
34334 9625 Acked Read 4 Sent Done Done false
34335 9626 Acked Read 8 Sent Done Done false
34336 9627 Acked Read 9 Sent Done Done false
34337 9628 Acked Read 10 Sent Done Done false
34338 9629 Acked Read 5 Sent Done Done false
34339 9630 Acked Write 9 Sent Done Done false
34340 9631 Acked Read 8 Sent Done Done false
34341 9632 Acked Write 5 Sent Done Done false
34342 9633 Acked Write 3 Sent Done Done false
34343 9634 Acked Read 9 Sent Done Done false
34344 9635 Acked Write 7 Sent Done Done false
34345 9636 Acked Write 9 Sent Done Done false
34346 9637 Acked Read 8 Sent Done Done false
34347 9638 Acked Write 4 Sent Done Done false
34348 9639 Acked Write 6 Sent Done Done false
34349 9640 Acked Write 5 Sent Done Done false
34350 9641 Acked Write 2 Sent Done Done false
34351 9642 Acked Flush 0 Sent Done Done false
34352 9643 Acked Write 7 Sent Done Done false
34353 9644 Acked Read 5 Sent Done Done false
34354 9645 Acked Read 3 Sent Done Done false
34355 9646 Acked Read 10 Sent Done Done false
34356 9647 Acked Read 3 Sent Done Done false
34357 9648 Acked Read 6 Sent Done Done false
34358 9649 Acked Write 7 Sent Done Done false
34359 9650 Acked Read 6 Sent Done Done false
34360 9651 Acked Write 4 Sent Done Done false
34361 9652 Acked Read 2 Sent Done Done false
34362 9653 Acked Read 4 Sent Done Done false
34363 9654 Acked Write 9 Sent Done Done false
34364 9655 Acked Write 2 Sent Done Done false
34365 9656 Acked Read 7 Sent Done Done false
34366 9657 Acked Write 2 Sent Done Done false
34367 9658 Acked Read 1 Sent Done Done false
34368 9659 Acked Read 1 Sent Done Done false
34369 9660 Acked Read 2 Sent Done Done false
34370 9661 Acked Write 2 Sent Done Done false
34371 9662 Acked Write 7 Sent Done Done false
34372 9663 Acked Write 2 Sent Done Done false
34373 9664 Acked Read 8 Sent Done Done false
34374 9665 Acked Read 6 Sent Done Done false
34375 9666 Acked Write 9 Sent Done Done false
34376 9667 Acked Write 3 Sent Done Done false
34377 9668 Acked Write 3 Sent Done Done false
34378 9669 Acked Write 4 Sent Done Done false
34379 9670 Acked Write 1 Sent Done Done false
34380 9671 Acked Read 2 Sent Done Done false
34381 9672 Acked Read 6 Sent Done Done false
34382 9673 Acked Write 3 Sent Done Done false
34383 9674 Acked Read 6 Sent Done Done false
34384 9675 Acked Read 8 Sent Done Done false
34385 9676 Acked Flush 0 Sent Done Done false
34386 9677 Acked Read 9 Sent Done Done false
34387 9678 Acked Read 9 Sent Done Done false
34388 9679 Acked Read 8 Sent Done Done false
34389 9680 Acked Read 2 Sent Done Done false
34390 9681 Acked Read 2 Sent Done Done false
34391 9682 Acked Flush 0 Sent Done Done false
34392 9683 Acked Read 8 Sent Done Done false
34393 9684 Acked Read 8 Sent Done Done false
34394 9685 Acked Write 9 Sent Done Done false
34395 9686 Acked Flush 0 Sent Done Done false
34396 9687 Acked Write 8 Sent Done Done false
34397 9688 Acked Read 7 Sent Done Done false
34398 9689 Acked Flush 0 Sent Done Done false
34399 9690 Acked Read 4 Sent Done Done false
34400 9691 Acked Read 4 Sent Done Done false
34401 9692 Acked Read 8 Sent Done Done false
34402 9693 Acked Read 2 Sent Done Done false
34403 9694 Acked Write 7 Sent Done Done false
34404 9695 Acked Write 2 Sent Done Done false
34405 9696 Acked Read 7 Sent Done Done false
34406 9697 Acked Write 10 Sent Done Done false
34407 9698 Acked Read 5 Sent Done Done false
34408 9699 Acked Read 1 Sent Done Done false
34409 9700 Acked Write 2 Sent Done Done false
34410 9701 Acked Write 1 Sent Done Done false
34411 9702 Acked Flush 0 Sent Done Done false
34412 9703 Acked Write 9 Sent Done Done false
34413 9704 Acked Read 1 Sent Done Done false
34414 9705 Acked Flush 0 Sent Done Done false
34415 9706 Acked Read 9 Sent Done Done false
34416 9707 Acked Write 5 Sent Done Done false
34417 9708 Acked Read 5 Sent Done Done false
34418 9709 Acked Write 7 Sent Done Done false
34419 9710 Acked Write 8 Sent Done Done false
34420 9711 Acked Write 8 Sent Done Done false
34421 9712 Acked Flush 0 Sent Done Done false
34422 9713 Acked Write 3 Sent Done Done false
34423 9714 Acked Flush 0 Sent Done Done false
34424 9715 Acked Read 3 Sent Done Done false
34425 9716 Acked Write 10 Sent Done Done false
34426 9717 Acked Read 1 Sent Done Done false
34427 9718 Acked Write 4 Sent Done Done false
34428 9719 Acked Read 7 Sent Done Done false
34429 9720 Acked Write 10 Sent Done Done false
34430 9721 Acked Write 1 Sent Done Done false
34431 9722 Acked Read 1 Sent Done Done false
34432 9723 Acked Write 8 Sent Done Done false
34433 9724 Acked Read 7 Sent Done Done false
34434 9725 Acked Read 2 Sent Done Done false
34435 9726 Acked Write 10 Sent Done Done false
34436 9727 Acked Write 3 Sent Done Done false
34437 9728 Acked Read 9 Sent Done Done false
34438 9729 Acked Flush 0 Sent Done Done false
34439 9730 Acked Flush 0 Sent Done Done false
34440 9731 Acked Read 6 Sent Done Done false
34441 9732 Acked Read 5 Sent Done Done false
34442 9733 Acked Write 1 Sent Done Done false
34443 9734 Acked Flush 0 Sent Done Done false
34444 9735 Acked Write 3 Sent Done Done false
34445 9736 Acked Read 4 Sent Done Done false
34446 9737 Acked Flush 0 Sent Done Done false
34447 9738 Acked Write 6 Sent Done Done false
34448 9739 Acked Read 7 Sent Done Done false
34449 9740 Acked Read 3 Sent Done Done false
34450 9741 Acked Write 7 Sent Done Done false
34451 9742 Acked Write 3 Sent Done Done false
34452 9743 Acked Flush 0 Sent Done Done false
34453 9744 Acked Write 2 Sent Done Done false
34454 9745 Acked Read 2 Sent Done Done false
34455 9746 Acked Read 10 Sent Done Done false
34456 9747 Acked Read 1 Sent Done Done false
34457 9748 Acked Write 9 Sent Done Done false
34458 9749 Acked Read 5 Sent Done Done false
34459 9750 Acked Write 8 Sent Done Done false
34460 9751 Acked Read 8 Sent Done Done false
34461 9752 Acked Read 1 Sent Done Done false
34462 9753 Acked Write 9 Sent Done Done false
34463 9754 Acked Flush 0 Sent Done Done false
34464 STATES DS:0 DS:1 DS:2 TOTAL
34465 Sent 302 0 0 302
34466 Done 0 302 302 604
34467 Skipped 0 0 0 0
34468 Error 0 0 0 0
34469 Last Flush: 9452 9754 9754
34470 Downstairs last five completed: 9452 9451 9450 9449 9448
34471 Upstairs last five completed: 9754 9753 9752 9751 9750
34472 CLIENT: Up:0 ds:302 act:2
344732025-01-10T16:42:32.618ZINFOcrucible: connecting to 127.0.0.1:8810 = io task client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
344742025-01-10T16:42:32.618ZWARNcrucible: ds_connection connect to 127.0.0.1:8810 failure: Os { code: 146, kind: ConnectionRefused, message: "Connection refused" } = io task client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
344752025-01-10T16:42:32.618ZWARNcrucible: client task is sending Done(ConnectionFailed(Os { code: 146, kind: ConnectionRefused, message: "Connection refused" })) = io task client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
344762025-01-10T16:42:32.618ZWARNcrucible: downstairs task for 0 stopped due to ConnectionFailed(Os { code: 146, kind: ConnectionRefused, message: "Connection refused" }) session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
344772025-01-10T16:42:32.618ZINFOcrucible: client task is exiting = io task client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
34478 [8810] got start action
34479 [8810] I am going to restart
34480 Starting downstairs at port 8810
34481 Make output file at "/tmp/dsc/downstairs-8810.txt"
34482 [8810][0] reports Starting
34483 Downstairs /var/tmp/dsc/region/8810 port 8810 PID:Some(1231)
34484 [8810][0] reports Running
34485 ----------------------------------------------------------------
34486 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:302
34487 States: Offline Active Active
34488 JOBID ACK TYPE BKS/EXT DS:0 DS:1 DS:2 REPLAY
34489 9453 Acked Write 4 Sent Done Done false
34490 9454 Acked Write 2 Sent Done Done false
34491 9455 Acked Write 7 Sent Done Done false
34492 9456 Acked Flush 0 Sent Done Done false
34493 9457 Acked Read 4 Sent Done Done false
34494 9458 Acked Write 9 Sent Done Done false
34495 9459 Acked Write 3 Sent Done Done false
34496 9460 Acked Read 9 Sent Done Done false
34497 9461 Acked Write 7 Sent Done Done false
34498 9462 Acked Write 7 Sent Done Done false
34499 9463 Acked Read 10 Sent Done Done false
34500 9464 Acked Write 5 Sent Done Done false
34501 9465 Acked Read 2 Sent Done Done false
34502 9466 Acked Write 9 Sent Done Done false
34503 9467 Acked Read 6 Sent Done Done false
34504 9468 Acked Read 4 Sent Done Done false
34505 9469 Acked Read 8 Sent Done Done false
34506 9470 Acked Read 5 Sent Done Done false
34507 9471 Acked Read 6 Sent Done Done false
34508 9472 Acked Write 5 Sent Done Done false
34509 9473 Acked Write 10 Sent Done Done false
34510 9474 Acked Read 5 Sent Done Done false
34511 9475 Acked Read 5 Sent Done Done false
34512 9476 Acked Write 4 Sent Done Done false
34513 9477 Acked Read 7 Sent Done Done false
34514 9478 Acked Read 4 Sent Done Done false
34515 9479 Acked Read 3 Sent Done Done false
34516 9480 Acked Read 7 Sent Done Done false
34517 9481 Acked Write 4 Sent Done Done false
34518 9482 Acked Read 3 Sent Done Done false
34519 9483 Acked Write 7 Sent Done Done false
34520 9484 Acked Write 7 Sent Done Done false
34521 9485 Acked Write 6 Sent Done Done false
34522 9486 Acked Write 2 Sent Done Done false
34523 9487 Acked Read 7 Sent Done Done false
34524 9488 Acked Flush 0 Sent Done Done false
34525 9489 Acked Write 6 Sent Done Done false
34526 9490 Acked Read 1 Sent Done Done false
34527 9491 Acked Flush 0 Sent Done Done false
34528 9492 Acked Write 5 Sent Done Done false
34529 9493 Acked Read 4 Sent Done Done false
34530 9494 Acked Read 4 Sent Done Done false
34531 9495 Acked Read 1 Sent Done Done false
34532 9496 Acked Write 3 Sent Done Done false
34533 9497 Acked Write 2 Sent Done Done false
34534 9498 Acked Write 6 Sent Done Done false
34535 9499 Acked Write 10 Sent Done Done false
34536 9500 Acked Read 10 Sent Done Done false
34537 9501 Acked Read 10 Sent Done Done false
34538 9502 Acked Read 1 Sent Done Done false
34539 9503 Acked Read 4 Sent Done Done false
34540 9504 Acked Read 9 Sent Done Done false
34541 9505 Acked Read 4 Sent Done Done false
34542 9506 Acked Read 6 Sent Done Done false
34543 9507 Acked Read 7 Sent Done Done false
34544 9508 Acked Read 2 Sent Done Done false
34545 9509 Acked Read 3 Sent Done Done false
34546 9510 Acked Read 2 Sent Done Done false
34547 9511 Acked Read 4 Sent Done Done false
34548 9512 Acked Read 9 Sent Done Done false
34549 9513 Acked Write 10 Sent Done Done false
34550 9514 Acked Read 3 Sent Done Done false
34551 9515 Acked Read 3 Sent Done Done false
34552 9516 Acked Write 9 Sent Done Done false
34553 9517 Acked Write 7 Sent Done Done false
34554 9518 Acked Read 5 Sent Done Done false
34555 9519 Acked Write 3 Sent Done Done false
34556 9520 Acked Read 8 Sent Done Done false
34557 9521 Acked Read 6 Sent Done Done false
34558 9522 Acked Write 10 Sent Done Done false
34559 9523 Acked Write 10 Sent Done Done false
34560 9524 Acked Write 10 Sent Done Done false
34561 9525 Acked Write 7 Sent Done Done false
34562 9526 Acked Write 5 Sent Done Done false
34563 9527 Acked Write 8 Sent Done Done false
34564 9528 Acked Read 6 Sent Done Done false
34565 9529 Acked Read 2 Sent Done Done false
34566 9530 Acked Flush 0 Sent Done Done false
34567 9531 Acked Read 1 Sent Done Done false
34568 9532 Acked Write 7 Sent Done Done false
34569 9533 Acked Read 6 Sent Done Done false
34570 9534 Acked Flush 0 Sent Done Done false
34571 9535 Acked Flush 0 Sent Done Done false
34572 9536 Acked Write 3 Sent Done Done false
34573 9537 Acked Read 7 Sent Done Done false
34574 9538 Acked Read 8 Sent Done Done false
34575 9539 Acked Flush 0 Sent Done Done false
34576 9540 Acked Write 6 Sent Done Done false
34577 9541 Acked Read 8 Sent Done Done false
34578 9542 Acked Flush 0 Sent Done Done false
34579 9543 Acked Write 9 Sent Done Done false
34580 9544 Acked Read 2 Sent Done Done false
34581 9545 Acked Read 9 Sent Done Done false
34582 9546 Acked Write 3 Sent Done Done false
34583 9547 Acked Read 3 Sent Done Done false
34584 9548 Acked Read 8 Sent Done Done false
34585 9549 Acked Write 6 Sent Done Done false
34586 9550 Acked Write 8 Sent Done Done false
34587 9551 Acked Write 6 Sent Done Done false
34588 9552 Acked Write 8 Sent Done Done false
34589 9553 Acked Read 9 Sent Done Done false
34590 9554 Acked Read 9 Sent Done Done false
34591 9555 Acked Write 5 Sent Done Done false
34592 9556 Acked Read 6 Sent Done Done false
34593 9557 Acked Read 7 Sent Done Done false
34594 9558 Acked Write 6 Sent Done Done false
34595 9559 Acked Write 7 Sent Done Done false
34596 9560 Acked Read 2 Sent Done Done false
34597 9561 Acked Write 4 Sent Done Done false
34598 9562 Acked Write 8 Sent Done Done false
34599 9563 Acked Read 5 Sent Done Done false
34600 9564 Acked Write 1 Sent Done Done false
34601 9565 Acked Read 7 Sent Done Done false
34602 9566 Acked Write 10 Sent Done Done false
34603 9567 Acked Write 7 Sent Done Done false
34604 9568 Acked Write 9 Sent Done Done false
34605 9569 Acked Write 9 Sent Done Done false
34606 9570 Acked Read 4 Sent Done Done false
34607 9571 Acked Read 6 Sent Done Done false
34608 9572 Acked Read 10 Sent Done Done false
34609 9573 Acked Read 10 Sent Done Done false
34610 9574 Acked Read 6 Sent Done Done false
34611 9575 Acked Read 1 Sent Done Done false
34612 9576 Acked Read 7 Sent Done Done false
34613 9577 Acked Read 9 Sent Done Done false
34614 9578 Acked Write 3 Sent Done Done false
34615 9579 Acked Write 5 Sent Done Done false
34616 9580 Acked Read 10 Sent Done Done false
34617 9581 Acked Read 8 Sent Done Done false
34618 9582 Acked Read 2 Sent Done Done false
34619 9583 Acked Read 8 Sent Done Done false
34620 9584 Acked Write 1 Sent Done Done false
34621 9585 Acked Read 5 Sent Done Done false
34622 9586 Acked Write 6 Sent Done Done false
34623 9587 Acked Write 10 Sent Done Done false
34624 9588 Acked Write 7 Sent Done Done false
34625 9589 Acked Read 6 Sent Done Done false
34626 9590 Acked Read 9 Sent Done Done false
34627 9591 Acked Write 5 Sent Done Done false
34628 9592 Acked Read 1 Sent Done Done false
34629 9593 Acked Write 9 Sent Done Done false
34630 9594 Acked Read 7 Sent Done Done false
34631 9595 Acked Read 7 Sent Done Done false
34632 9596 Acked Write 8 Sent Done Done false
34633 9597 Acked Write 3 Sent Done Done false
34634 9598 Acked Write 6 Sent Done Done false
34635 9599 Acked Write 2 Sent Done Done false
34636 9600 Acked Read 7 Sent Done Done false
34637 9601 Acked Read 8 Sent Done Done false
34638 9602 Acked Read 10 Sent Done Done false
34639 9603 Acked Write 10 Sent Done Done false
34640 9604 Acked Read 9 Sent Done Done false
34641 9605 Acked Write 10 Sent Done Done false
34642 9606 Acked Read 8 Sent Done Done false
34643 9607 Acked Read 9 Sent Done Done false
34644 9608 Acked Write 10 Sent Done Done false
34645 9609 Acked Read 9 Sent Done Done false
34646 9610 Acked Read 8 Sent Done Done false
34647 9611 Acked Write 1 Sent Done Done false
34648 9612 Acked Write 3 Sent Done Done false
34649 9613 Acked Flush 0 Sent Done Done false
34650 9614 Acked Read 4 Sent Done Done false
34651 9615 Acked Read 6 Sent Done Done false
34652 9616 Acked Write 2 Sent Done Done false
34653 9617 Acked Read 8 Sent Done Done false
34654 9618 Acked Read 10 Sent Done Done false
34655 9619 Acked Write 10 Sent Done Done false
34656 9620 Acked Write 10 Sent Done Done false
34657 9621 Acked Write 2 Sent Done Done false
34658 9622 Acked Write 6 Sent Done Done false
34659 9623 Acked Write 2 Sent Done Done false
34660 9624 Acked Write 1 Sent Done Done false
34661 9625 Acked Read 4 Sent Done Done false
34662 9626 Acked Read 8 Sent Done Done false
34663 9627 Acked Read 9 Sent Done Done false
34664 9628 Acked Read 10 Sent Done Done false
34665 9629 Acked Read 5 Sent Done Done false
34666 9630 Acked Write 9 Sent Done Done false
34667 9631 Acked Read 8 Sent Done Done false
34668 9632 Acked Write 5 Sent Done Done false
34669 9633 Acked Write 3 Sent Done Done false
34670 9634 Acked Read 9 Sent Done Done false
34671 9635 Acked Write 7 Sent Done Done false
34672 9636 Acked Write 9 Sent Done Done false
34673 9637 Acked Read 8 Sent Done Done false
34674 9638 Acked Write 4 Sent Done Done false
34675 9639 Acked Write 6 Sent Done Done false
34676 9640 Acked Write 5 Sent Done Done false
34677 9641 Acked Write 2 Sent Done Done false
34678 9642 Acked Flush 0 Sent Done Done false
34679 9643 Acked Write 7 Sent Done Done false
34680 9644 Acked Read 5 Sent Done Done false
34681 9645 Acked Read 3 Sent Done Done false
34682 9646 Acked Read 10 Sent Done Done false
34683 9647 Acked Read 3 Sent Done Done false
34684 9648 Acked Read 6 Sent Done Done false
34685 9649 Acked Write 7 Sent Done Done false
34686 9650 Acked Read 6 Sent Done Done false
34687 9651 Acked Write 4 Sent Done Done false
34688 9652 Acked Read 2 Sent Done Done false
34689 9653 Acked Read 4 Sent Done Done false
34690 9654 Acked Write 9 Sent Done Done false
34691 9655 Acked Write 2 Sent Done Done false
34692 9656 Acked Read 7 Sent Done Done false
34693 9657 Acked Write 2 Sent Done Done false
34694 9658 Acked Read 1 Sent Done Done false
34695 9659 Acked Read 1 Sent Done Done false
34696 9660 Acked Read 2 Sent Done Done false
34697 9661 Acked Write 2 Sent Done Done false
34698 9662 Acked Write 7 Sent Done Done false
34699 9663 Acked Write 2 Sent Done Done false
34700 9664 Acked Read 8 Sent Done Done false
34701 9665 Acked Read 6 Sent Done Done false
34702 9666 Acked Write 9 Sent Done Done false
34703 9667 Acked Write 3 Sent Done Done false
34704 9668 Acked Write 3 Sent Done Done false
34705 9669 Acked Write 4 Sent Done Done false
34706 9670 Acked Write 1 Sent Done Done false
34707 9671 Acked Read 2 Sent Done Done false
34708 9672 Acked Read 6 Sent Done Done false
34709 9673 Acked Write 3 Sent Done Done false
34710 9674 Acked Read 6 Sent Done Done false
34711 9675 Acked Read 8 Sent Done Done false
34712 9676 Acked Flush 0 Sent Done Done false
34713 9677 Acked Read 9 Sent Done Done false
34714 9678 Acked Read 9 Sent Done Done false
34715 9679 Acked Read 8 Sent Done Done false
34716 9680 Acked Read 2 Sent Done Done false
34717 9681 Acked Read 2 Sent Done Done false
34718 9682 Acked Flush 0 Sent Done Done false
34719 9683 Acked Read 8 Sent Done Done false
34720 9684 Acked Read 8 Sent Done Done false
34721 9685 Acked Write 9 Sent Done Done false
34722 9686 Acked Flush 0 Sent Done Done false
34723 9687 Acked Write 8 Sent Done Done false
34724 9688 Acked Read 7 Sent Done Done false
34725 9689 Acked Flush 0 Sent Done Done false
34726 9690 Acked Read 4 Sent Done Done false
34727 9691 Acked Read 4 Sent Done Done false
34728 9692 Acked Read 8 Sent Done Done false
34729 9693 Acked Read 2 Sent Done Done false
34730 9694 Acked Write 7 Sent Done Done false
34731 9695 Acked Write 2 Sent Done Done false
34732 9696 Acked Read 7 Sent Done Done false
34733 9697 Acked Write 10 Sent Done Done false
34734 9698 Acked Read 5 Sent Done Done false
34735 9699 Acked Read 1 Sent Done Done false
34736 9700 Acked Write 2 Sent Done Done false
34737 9701 Acked Write 1 Sent Done Done false
34738 9702 Acked Flush 0 Sent Done Done false
34739 9703 Acked Write 9 Sent Done Done false
34740 9704 Acked Read 1 Sent Done Done false
34741 9705 Acked Flush 0 Sent Done Done false
34742 9706 Acked Read 9 Sent Done Done false
34743 9707 Acked Write 5 Sent Done Done false
34744 9708 Acked Read 5 Sent Done Done false
34745 9709 Acked Write 7 Sent Done Done false
34746 9710 Acked Write 8 Sent Done Done false
34747 9711 Acked Write 8 Sent Done Done false
34748 9712 Acked Flush 0 Sent Done Done false
34749 9713 Acked Write 3 Sent Done Done false
34750 9714 Acked Flush 0 Sent Done Done false
34751 9715 Acked Read 3 Sent Done Done false
34752 9716 Acked Write 10 Sent Done Done false
34753 9717 Acked Read 1 Sent Done Done false
34754 9718 Acked Write 4 Sent Done Done false
34755 9719 Acked Read 7 Sent Done Done false
34756 9720 Acked Write 10 Sent Done Done false
34757 9721 Acked Write 1 Sent Done Done false
34758 9722 Acked Read 1 Sent Done Done false
34759 9723 Acked Write 8 Sent Done Done false
34760 9724 Acked Read 7 Sent Done Done false
34761 9725 Acked Read 2 Sent Done Done false
34762 9726 Acked Write 10 Sent Done Done false
34763 9727 Acked Write 3 Sent Done Done false
34764 9728 Acked Read 9 Sent Done Done false
34765 9729 Acked Flush 0 Sent Done Done false
34766 9730 Acked Flush 0 Sent Done Done false
34767 9731 Acked Read 6 Sent Done Done false
34768 9732 Acked Read 5 Sent Done Done false
34769 9733 Acked Write 1 Sent Done Done false
34770 9734 Acked Flush 0 Sent Done Done false
34771 9735 Acked Write 3 Sent Done Done false
34772 9736 Acked Read 4 Sent Done Done false
34773 9737 Acked Flush 0 Sent Done Done false
34774 9738 Acked Write 6 Sent Done Done false
34775 9739 Acked Read 7 Sent Done Done false
34776 9740 Acked Read 3 Sent Done Done false
34777 9741 Acked Write 7 Sent Done Done false
34778 9742 Acked Write 3 Sent Done Done false
34779 9743 Acked Flush 0 Sent Done Done false
34780 9744 Acked Write 2 Sent Done Done false
34781 9745 Acked Read 2 Sent Done Done false
34782 9746 Acked Read 10 Sent Done Done false
34783 9747 Acked Read 1 Sent Done Done false
34784 9748 Acked Write 9 Sent Done Done false
34785 9749 Acked Read 5 Sent Done Done false
34786 9750 Acked Write 8 Sent Done Done false
34787 9751 Acked Read 8 Sent Done Done false
34788 9752 Acked Read 1 Sent Done Done false
34789 9753 Acked Write 9 Sent Done Done false
34790 9754 Acked Flush 0 Sent Done Done false
34791 STATES DS:0 DS:1 DS:2 TOTAL
34792 Sent 302 0 0 302
34793 Done 0 302 302 604
34794 Skipped 0 0 0 0
34795 Error 0 0 0 0
34796 Last Flush: 9452 9754 9754
34797 Downstairs last five completed: 9452 9451 9450 9449 9448
34798 Upstairs last five completed: 9754 9753 9752 9751 9750
34799 CLIENT: Up:0 ds:302 act:2
34800 ----------------------------------------------------------------
34801 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:302
34802 States: Offline Active Active
34803 JOBID ACK TYPE BKS/EXT DS:0 DS:1 DS:2 REPLAY
34804 9453 Acked Write 4 Sent Done Done false
34805 9454 Acked Write 2 Sent Done Done false
34806 9455 Acked Write 7 Sent Done Done false
34807 9456 Acked Flush 0 Sent Done Done false
34808 9457 Acked Read 4 Sent Done Done false
34809 9458 Acked Write 9 Sent Done Done false
34810 9459 Acked Write 3 Sent Done Done false
34811 9460 Acked Read 9 Sent Done Done false
34812 9461 Acked Write 7 Sent Done Done false
34813 9462 Acked Write 7 Sent Done Done false
34814 9463 Acked Read 10 Sent Done Done false
34815 9464 Acked Write 5 Sent Done Done false
34816 9465 Acked Read 2 Sent Done Done false
34817 9466 Acked Write 9 Sent Done Done false
34818 9467 Acked Read 6 Sent Done Done false
34819 9468 Acked Read 4 Sent Done Done false
34820 9469 Acked Read 8 Sent Done Done false
34821 9470 Acked Read 5 Sent Done Done false
34822 9471 Acked Read 6 Sent Done Done false
34823 9472 Acked Write 5 Sent Done Done false
34824 9473 Acked Write 10 Sent Done Done false
34825 9474 Acked Read 5 Sent Done Done false
34826 9475 Acked Read 5 Sent Done Done false
34827 9476 Acked Write 4 Sent Done Done false
34828 9477 Acked Read 7 Sent Done Done false
34829 9478 Acked Read 4 Sent Done Done false
34830 9479 Acked Read 3 Sent Done Done false
34831 9480 Acked Read 7 Sent Done Done false
34832 9481 Acked Write 4 Sent Done Done false
34833 9482 Acked Read 3 Sent Done Done false
34834 9483 Acked Write 7 Sent Done Done false
34835 9484 Acked Write 7 Sent Done Done false
34836 9485 Acked Write 6 Sent Done Done false
34837 9486 Acked Write 2 Sent Done Done false
34838 9487 Acked Read 7 Sent Done Done false
34839 9488 Acked Flush 0 Sent Done Done false
34840 9489 Acked Write 6 Sent Done Done false
34841 9490 Acked Read 1 Sent Done Done false
34842 9491 Acked Flush 0 Sent Done Done false
34843 9492 Acked Write 5 Sent Done Done false
34844 9493 Acked Read 4 Sent Done Done false
34845 9494 Acked Read 4 Sent Done Done false
34846 9495 Acked Read 1 Sent Done Done false
34847 9496 Acked Write 3 Sent Done Done false
34848 9497 Acked Write 2 Sent Done Done false
34849 9498 Acked Write 6 Sent Done Done false
34850 9499 Acked Write 10 Sent Done Done false
34851 9500 Acked Read 10 Sent Done Done false
34852 9501 Acked Read 10 Sent Done Done false
34853 9502 Acked Read 1 Sent Done Done false
34854 9503 Acked Read 4 Sent Done Done false
34855 9504 Acked Read 9 Sent Done Done false
34856 9505 Acked Read 4 Sent Done Done false
34857 9506 Acked Read 6 Sent Done Done false
34858 9507 Acked Read 7 Sent Done Done false
34859 9508 Acked Read 2 Sent Done Done false
34860 9509 Acked Read 3 Sent Done Done false
34861 9510 Acked Read 2 Sent Done Done false
34862 9511 Acked Read 4 Sent Done Done false
34863 9512 Acked Read 9 Sent Done Done false
34864 9513 Acked Write 10 Sent Done Done false
34865 9514 Acked Read 3 Sent Done Done false
34866 9515 Acked Read 3 Sent Done Done false
34867 9516 Acked Write 9 Sent Done Done false
34868 9517 Acked Write 7 Sent Done Done false
34869 9518 Acked Read 5 Sent Done Done false
34870 9519 Acked Write 3 Sent Done Done false
34871 9520 Acked Read 8 Sent Done Done false
34872 9521 Acked Read 6 Sent Done Done false
34873 9522 Acked Write 10 Sent Done Done false
34874 9523 Acked Write 10 Sent Done Done false
34875 9524 Acked Write 10 Sent Done Done false
34876 9525 Acked Write 7 Sent Done Done false
34877 9526 Acked Write 5 Sent Done Done false
34878 9527 Acked Write 8 Sent Done Done false
34879 9528 Acked Read 6 Sent Done Done false
34880 9529 Acked Read 2 Sent Done Done false
34881 9530 Acked Flush 0 Sent Done Done false
34882 9531 Acked Read 1 Sent Done Done false
34883 9532 Acked Write 7 Sent Done Done false
34884 9533 Acked Read 6 Sent Done Done false
34885 9534 Acked Flush 0 Sent Done Done false
34886 9535 Acked Flush 0 Sent Done Done false
34887 9536 Acked Write 3 Sent Done Done false
34888 9537 Acked Read 7 Sent Done Done false
34889 9538 Acked Read 8 Sent Done Done false
34890 9539 Acked Flush 0 Sent Done Done false
34891 9540 Acked Write 6 Sent Done Done false
34892 9541 Acked Read 8 Sent Done Done false
34893 9542 Acked Flush 0 Sent Done Done false
34894 9543 Acked Write 9 Sent Done Done false
34895 9544 Acked Read 2 Sent Done Done false
34896 9545 Acked Read 9 Sent Done Done false
34897 9546 Acked Write 3 Sent Done Done false
34898 9547 Acked Read 3 Sent Done Done false
34899 9548 Acked Read 8 Sent Done Done false
34900 9549 Acked Write 6 Sent Done Done false
34901 9550 Acked Write 8 Sent Done Done false
34902 9551 Acked Write 6 Sent Done Done false
34903 9552 Acked Write 8 Sent Done Done false
34904 9553 Acked Read 9 Sent Done Done false
34905 9554 Acked Read 9 Sent Done Done false
34906 9555 Acked Write 5 Sent Done Done false
34907 9556 Acked Read 6 Sent Done Done false
34908 9557 Acked Read 7 Sent Done Done false
34909 9558 Acked Write 6 Sent Done Done false
34910 9559 Acked Write 7 Sent Done Done false
34911 9560 Acked Read 2 Sent Done Done false
34912 9561 Acked Write 4 Sent Done Done false
34913 9562 Acked Write 8 Sent Done Done false
34914 9563 Acked Read 5 Sent Done Done false
34915 9564 Acked Write 1 Sent Done Done false
34916 9565 Acked Read 7 Sent Done Done false
34917 9566 Acked Write 10 Sent Done Done false
34918 9567 Acked Write 7 Sent Done Done false
34919 9568 Acked Write 9 Sent Done Done false
34920 9569 Acked Write 9 Sent Done Done false
34921 9570 Acked Read 4 Sent Done Done false
34922 9571 Acked Read 6 Sent Done Done false
34923 9572 Acked Read 10 Sent Done Done false
34924 9573 Acked Read 10 Sent Done Done false
34925 9574 Acked Read 6 Sent Done Done false
34926 9575 Acked Read 1 Sent Done Done false
34927 9576 Acked Read 7 Sent Done Done false
34928 9577 Acked Read 9 Sent Done Done false
34929 9578 Acked Write 3 Sent Done Done false
34930 9579 Acked Write 5 Sent Done Done false
34931 9580 Acked Read 10 Sent Done Done false
34932 9581 Acked Read 8 Sent Done Done false
34933 9582 Acked Read 2 Sent Done Done false
34934 9583 Acked Read 8 Sent Done Done false
34935 9584 Acked Write 1 Sent Done Done false
34936 9585 Acked Read 5 Sent Done Done false
34937 9586 Acked Write 6 Sent Done Done false
34938 9587 Acked Write 10 Sent Done Done false
34939 9588 Acked Write 7 Sent Done Done false
34940 9589 Acked Read 6 Sent Done Done false
34941 9590 Acked Read 9 Sent Done Done false
34942 9591 Acked Write 5 Sent Done Done false
34943 9592 Acked Read 1 Sent Done Done false
34944 9593 Acked Write 9 Sent Done Done false
34945 9594 Acked Read 7 Sent Done Done false
34946 9595 Acked Read 7 Sent Done Done false
34947 9596 Acked Write 8 Sent Done Done false
34948 9597 Acked Write 3 Sent Done Done false
34949 9598 Acked Write 6 Sent Done Done false
34950 9599 Acked Write 2 Sent Done Done false
34951 9600 Acked Read 7 Sent Done Done false
34952 9601 Acked Read 8 Sent Done Done false
34953 9602 Acked Read 10 Sent Done Done false
34954 9603 Acked Write 10 Sent Done Done false
34955 9604 Acked Read 9 Sent Done Done false
34956 9605 Acked Write 10 Sent Done Done false
34957 9606 Acked Read 8 Sent Done Done false
34958 9607 Acked Read 9 Sent Done Done false
34959 9608 Acked Write 10 Sent Done Done false
34960 9609 Acked Read 9 Sent Done Done false
34961 9610 Acked Read 8 Sent Done Done false
34962 9611 Acked Write 1 Sent Done Done false
34963 9612 Acked Write 3 Sent Done Done false
34964 9613 Acked Flush 0 Sent Done Done false
34965 9614 Acked Read 4 Sent Done Done false
34966 9615 Acked Read 6 Sent Done Done false
34967 9616 Acked Write 2 Sent Done Done false
34968 9617 Acked Read 8 Sent Done Done false
34969 9618 Acked Read 10 Sent Done Done false
34970 9619 Acked Write 10 Sent Done Done false
34971 9620 Acked Write 10 Sent Done Done false
34972 9621 Acked Write 2 Sent Done Done false
34973 9622 Acked Write 6 Sent Done Done false
34974 9623 Acked Write 2 Sent Done Done false
34975 9624 Acked Write 1 Sent Done Done false
34976 9625 Acked Read 4 Sent Done Done false
34977 9626 Acked Read 8 Sent Done Done false
34978 9627 Acked Read 9 Sent Done Done false
34979 9628 Acked Read 10 Sent Done Done false
34980 9629 Acked Read 5 Sent Done Done false
34981 9630 Acked Write 9 Sent Done Done false
34982 9631 Acked Read 8 Sent Done Done false
34983 9632 Acked Write 5 Sent Done Done false
34984 9633 Acked Write 3 Sent Done Done false
34985 9634 Acked Read 9 Sent Done Done false
34986 9635 Acked Write 7 Sent Done Done false
34987 9636 Acked Write 9 Sent Done Done false
34988 9637 Acked Read 8 Sent Done Done false
34989 9638 Acked Write 4 Sent Done Done false
34990 9639 Acked Write 6 Sent Done Done false
34991 9640 Acked Write 5 Sent Done Done false
34992 9641 Acked Write 2 Sent Done Done false
34993 9642 Acked Flush 0 Sent Done Done false
34994 9643 Acked Write 7 Sent Done Done false
34995 9644 Acked Read 5 Sent Done Done false
34996 9645 Acked Read 3 Sent Done Done false
34997 9646 Acked Read 10 Sent Done Done false
34998 9647 Acked Read 3 Sent Done Done false
34999 9648 Acked Read 6 Sent Done Done false
35000 9649 Acked Write 7 Sent Done Done false
35001 9650 Acked Read 6 Sent Done Done false
35002 9651 Acked Write 4 Sent Done Done false
35003 9652 Acked Read 2 Sent Done Done false
35004 9653 Acked Read 4 Sent Done Done false
35005 9654 Acked Write 9 Sent Done Done false
35006 9655 Acked Write 2 Sent Done Done false
35007 9656 Acked Read 7 Sent Done Done false
35008 9657 Acked Write 2 Sent Done Done false
35009 9658 Acked Read 1 Sent Done Done false
35010 9659 Acked Read 1 Sent Done Done false
35011 9660 Acked Read 2 Sent Done Done false
35012 9661 Acked Write 2 Sent Done Done false
35013 9662 Acked Write 7 Sent Done Done false
35014 9663 Acked Write 2 Sent Done Done false
35015 9664 Acked Read 8 Sent Done Done false
35016 9665 Acked Read 6 Sent Done Done false
35017 9666 Acked Write 9 Sent Done Done false
35018 9667 Acked Write 3 Sent Done Done false
35019 9668 Acked Write 3 Sent Done Done false
35020 9669 Acked Write 4 Sent Done Done false
35021 9670 Acked Write 1 Sent Done Done false
35022 9671 Acked Read 2 Sent Done Done false
35023 9672 Acked Read 6 Sent Done Done false
35024 9673 Acked Write 3 Sent Done Done false
35025 9674 Acked Read 6 Sent Done Done false
35026 9675 Acked Read 8 Sent Done Done false
35027 9676 Acked Flush 0 Sent Done Done false
35028 9677 Acked Read 9 Sent Done Done false
35029 9678 Acked Read 9 Sent Done Done false
35030 9679 Acked Read 8 Sent Done Done false
35031 9680 Acked Read 2 Sent Done Done false
35032 9681 Acked Read 2 Sent Done Done false
35033 9682 Acked Flush 0 Sent Done Done false
35034 9683 Acked Read 8 Sent Done Done false
35035 9684 Acked Read 8 Sent Done Done false
35036 9685 Acked Write 9 Sent Done Done false
35037 9686 Acked Flush 0 Sent Done Done false
35038 9687 Acked Write 8 Sent Done Done false
35039 9688 Acked Read 7 Sent Done Done false
35040 9689 Acked Flush 0 Sent Done Done false
35041 9690 Acked Read 4 Sent Done Done false
35042 9691 Acked Read 4 Sent Done Done false
35043 9692 Acked Read 8 Sent Done Done false
35044 9693 Acked Read 2 Sent Done Done false
35045 9694 Acked Write 7 Sent Done Done false
35046 9695 Acked Write 2 Sent Done Done false
35047 9696 Acked Read 7 Sent Done Done false
35048 9697 Acked Write 10 Sent Done Done false
35049 9698 Acked Read 5 Sent Done Done false
35050 9699 Acked Read 1 Sent Done Done false
35051 9700 Acked Write 2 Sent Done Done false
35052 9701 Acked Write 1 Sent Done Done false
35053 9702 Acked Flush 0 Sent Done Done false
35054 9703 Acked Write 9 Sent Done Done false
35055 9704 Acked Read 1 Sent Done Done false
35056 9705 Acked Flush 0 Sent Done Done false
35057 9706 Acked Read 9 Sent Done Done false
35058 9707 Acked Write 5 Sent Done Done false
35059 9708 Acked Read 5 Sent Done Done false
35060 9709 Acked Write 7 Sent Done Done false
35061 9710 Acked Write 8 Sent Done Done false
35062 9711 Acked Write 8 Sent Done Done false
35063 9712 Acked Flush 0 Sent Done Done false
35064 9713 Acked Write 3 Sent Done Done false
35065 9714 Acked Flush 0 Sent Done Done false
35066 9715 Acked Read 3 Sent Done Done false
35067 9716 Acked Write 10 Sent Done Done false
35068 9717 Acked Read 1 Sent Done Done false
35069 9718 Acked Write 4 Sent Done Done false
35070 9719 Acked Read 7 Sent Done Done false
35071 9720 Acked Write 10 Sent Done Done false
35072 9721 Acked Write 1 Sent Done Done false
35073 9722 Acked Read 1 Sent Done Done false
35074 9723 Acked Write 8 Sent Done Done false
35075 9724 Acked Read 7 Sent Done Done false
35076 9725 Acked Read 2 Sent Done Done false
35077 9726 Acked Write 10 Sent Done Done false
35078 9727 Acked Write 3 Sent Done Done false
35079 9728 Acked Read 9 Sent Done Done false
35080 9729 Acked Flush 0 Sent Done Done false
35081 9730 Acked Flush 0 Sent Done Done false
35082 9731 Acked Read 6 Sent Done Done false
35083 9732 Acked Read 5 Sent Done Done false
35084 9733 Acked Write 1 Sent Done Done false
35085 9734 Acked Flush 0 Sent Done Done false
35086 9735 Acked Write 3 Sent Done Done false
35087 9736 Acked Read 4 Sent Done Done false
35088 9737 Acked Flush 0 Sent Done Done false
35089 9738 Acked Write 6 Sent Done Done false
35090 9739 Acked Read 7 Sent Done Done false
35091 9740 Acked Read 3 Sent Done Done false
35092 9741 Acked Write 7 Sent Done Done false
35093 9742 Acked Write 3 Sent Done Done false
35094 9743 Acked Flush 0 Sent Done Done false
35095 9744 Acked Write 2 Sent Done Done false
35096 9745 Acked Read 2 Sent Done Done false
35097 9746 Acked Read 10 Sent Done Done false
35098 9747 Acked Read 1 Sent Done Done false
35099 9748 Acked Write 9 Sent Done Done false
35100 9749 Acked Read 5 Sent Done Done false
35101 9750 Acked Write 8 Sent Done Done false
35102 9751 Acked Read 8 Sent Done Done false
35103 9752 Acked Read 1 Sent Done Done false
35104 9753 Acked Write 9 Sent Done Done false
35105 9754 Acked Flush 0 Sent Done Done false
35106 STATES DS:0 DS:1 DS:2 TOTAL
35107 Sent 302 0 0 302
35108 Done 0 302 302 604
35109 Skipped 0 0 0 0
35110 Error 0 0 0 0
35111 Last Flush: 9452 9754 9754
35112 Downstairs last five completed: 9452 9451 9450 9449 9448
35113 Upstairs last five completed: 9754 9753 9752 9751 9750
35114 CLIENT: Up:0 ds:302 act:2
351152025-01-10T16:42:42.619ZINFOcrucible: connecting to 127.0.0.1:8810 = io task client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
351162025-01-10T16:42:42.619ZINFOcrucible: ds_connection connected from Ok(127.0.0.1:43821) = io task client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
351172025-01-10T16:42:42.620ZWARNcrucible: version negotiation from state Offline = downstairs client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
351182025-01-10T16:42:42.621ZINFOcrucible: downstairs client at Some(127.0.0.1:8810) has region UUID 12345678-0000-0000-0000-000000008810 = downstairs client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
351192025-01-10T16:42:42.621ZINFOcrucible: Returning UUID:12345678-0000-0000-0000-000000008810 matches = downstairs client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
351202025-01-10T16:42:42.621ZINFOcrucible: send last flush ID to this DS: 9452 = downstairs client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
351212025-01-10T16:42:42.621ZINFOcrucible: Replied this last flush ID: 9452 = downstairs client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
351222025-01-10T16:42:42.621ZINFOcrucible: ds_transition from Offline to Active = downstairs client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
351232025-01-10T16:42:42.621ZINFOcrucible: [0] Transition from Offline to Active = downstairs client = 0 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
351242025-01-10T16:42:42.621ZINFOcrucible: [0] client re-new 302 jobs since flush 9452 = downstairs session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
351252025-01-10T16:42:42.622ZINFOcrucible: [0] Replayed 302 jobs since flush: 9452 = downstairs session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
35126 ----------------------------------------------------------------
35127 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:0
35128 Downstairs last five completed: 9754 9753 9752 9751 9750
35129 Upstairs last five completed: 9754 9753 9752 9751 9750
35130 CLIENT: Up:0 ds:0 act:3
35131 Replay: All jobs finished
35132 Main task has work to do, go find it
35133 got dsc Stop(2)
35134 stop 2
35135 Jan 10 16:42:42.869 INFO request completed[8830] Got stop action so:false kr:false
35136 , latency_us: 379, response_code: 204, uri: /stop/cid/2, method: POST, req_id: d9a0ff8e-8d95-416e-ab48-b4e749eb40a3, remote_addr: 127.0.0.1:55917, local_addr: 127.0.0.1:9998
35137 Jan 10 16:42:42.869 INFO request completed, latency_us: 129, response_code: 200, uri: /state/cid/2, method:{"msg":"downstairs disconnected","v":0,"name":"crucible","level":40,"time":"2025-01-10T16:42:42.869861487Z","hostname":"w-01JH8H1N3KXZ9F8ZV6CCMP5KTQ","pid":1202,"":"io task","client":"2","":"downstairs","session_id":"1df3ca91-4dc9-42d6-9897-461254b5afe2"}
35138 GET, req_id: 474c1feb-7e04-416d-a3b6-4aa5889419e9, remote_addr: 127.0.0.1:55917, local_addr: 127.0.0.1:9998
351392025-01-10T16:42:42.869ZWARNcrucible: client task is sending Done(Finished) = io task client = 2 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
351402025-01-10T16:42:42.869ZWARNcrucible: downstairs task for 2 stopped due to Finished session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
351412025-01-10T16:42:42.869ZINFOcrucible: ds_transition from Active to Offline = downstairs client = 2 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
351422025-01-10T16:42:42.870ZINFOcrucible: [2] Transition from Active to Offline = downstairs client = 2 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
351432025-01-10T16:42:42.870ZINFOcrucible: client task is exiting = io task client = 2 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
35144 [8830] Exited with: ExitStatus(unix_wait_status(9))
35145 [8830][2] reports Exit
35146 Jan 10 16:42:46.871 INFO request completed, latency_us: 203, response_code: 200, uri: /state/cid/2, method: GET, req_id: 0a495ec2-0a19-41da-a5a2-6387a29eb1a4, remote_addr: 127.0.0.1:55917, local_addr: 127.0.0.1:9998
35147 001/300 Read block 2271 len 24576
35148 002/300 Read block 3708 len 4096
35149 003/300 Write block 2062 len 4096 data: 5
35150 004/300 Read block 1883 len 28672
35151 005/300 Read block 2287 len 36864
35152 006/300 Read block 3597 len 12288
35153 007/300 Write block 3567 len 40960 data: 6 7 6 5 4 4 4 6 5 4
35154 008/300 Write block 4590 len 8192 data: 6 6
35155 009/300 Write block 654 len 32768 data: 2 3 2 2 2 2 2 3
35156 010/300 Write block 4546 len 16384 data: 6 4 4 3
35157 011/300 Write block 3568 len 8192 data: 8 7
35158 012/300 Flush
35159 013/300 Write block 3056 len 8192 data: 4 5
35160 014/300 Write block 2683 len 32768 data: 6 7 8 8 8 7 8 7
35161 015/300 Read block 4552 len 40960
35162 016/300 Write block 1089 len 12288 data: 6 6 6
35163 017/300 Read block 2698 len 16384
35164 018/300 Read block 3520 len 28672
35165 019/300 Write block 3532 len 16384 data: 4 5 6 5
35166 020/300 Flush
35167 021/300 Write block 4290 len 32768 data: 4 4 3 5 5 7 6 6
35168 022/300 Read block 2151 len 24576
35169 023/300 Read block 99 len 24576
35170 024/300 Read block 1469 len 28672
35171 025/300 Flush
35172 026/300 Read block 2066 len 24576
35173 027/300 Write block 3288 len 24576 data: 8 8 6 6 6 2
35174 028/300 Write block 2220 len 28672 data: 5 5 6 6 7 8 6
35175 029/300 Read block 1394 len 20480
35176 030/300 Write block 4845 len 4096 data: 6
35177 031/300 Write block 68 len 40960 data: 8 9 9 7 9 10 10 10 10 9
35178 032/300 Flush
35179 033/300 Read block 2325 len 32768
35180 034/300 Read block 4340 len 36864
35181 035/300 Read block 1148 len 24576
35182 036/300 Read block 3668 len 12288
35183 037/300 Read block 1294 len 36864
35184 038/300 Flush
35185 039/300 Read block 4257 len 28672
35186 040/300 Read block 1072 len 20480
35187 041/300 Write block 4852 len 24576 data: 5 7 7 5 6 6
35188 042/300 Write block 4410 len 36864 data: 4 3 3 5 7 7 6 4 4
35189 043/300 Write block 3074 len 24576 data: 4 3 2 3 3 4
35190 044/300 Read block 2144 len 12288
35191 045/300 Read block 4392 len 20480
35192 046/300 Read block 4068 len 40960
35193 047/300 Read block 3516 len 36864
35194 048/300 Read block 3965 len 40960
35195 049/300 Read block 192 len 12288
35196 050/300 Flush
35197 051/300 Read block 349 len 8192
35198 052/300 Read block 413 len 28672
35199 053/300 Write block 268 len 36864 data: 9 9 9 9 8 6 6 6 6
35200 054/300 Write block 69 len 16384 data: 10 10 8 10
35201 055/300 Read block 2597 len 20480
35202 056/300 Read block 4489 len 36864
35203 057/300 Read block 2848 len 36864
35204 058/300 Read block 372 len 24576
35205 059/300 Read block 68 len 36864
35206 060/300 Read block 4905 len 20480
35207 061/300 Read block 695 len 36864
35208 062/300 Read block 2887 len 24576
35209 063/300 Read block 2685 len 36864
35210 064/300 Read block 1780 len 8192
35211 065/300 Read block 535 len 20480
35212 066/300 Read block 1148 len 36864
35213 067/300 Read block 4609 len 32768
35214 068/300 Read block 635 len 20480
35215 069/300 Read block 99 len 4096
35216 070/300 Read block 4970 len 32768
35217 071/300 Read block 3183 len 20480
35218 072/300 Write block 4412 len 16384 data: 4 6 8 8
35219 073/300 Write block 2853 len 8192 data: 5 4
35220 074/300 Read block 861 len 20480
35221 075/300 Write block 3530 len 12288 data: 4 4 5
35222 076/300 Read block 1795 len 36864
35223 077/300 Write block 1681 len 12288 data: 7 9 9
35224 078/300 Read block 3627 len 8192
35225 079/300 Read block 2166 len 36864
35226 080/300 Read block 1790 len 12288
35227 081/300 Read block 2530 len 36864
35228 082/300 Read block 1556 len 12288
35229 083/300 Flush
35230 084/300 Write block 88 len 4096 data: 4
35231 085/300 Read block 1348 len 32768
35232 086/300 Read block 2683 len 36864
35233 087/300 Read block 4383 len 28672
35234 088/300 Write block 4334 len 16384 data: 8 7 7 8
35235 089/300 Read block 20 len 4096
35236 090/300 Read block 4142 len 16384
35237 091/300 Write block 110 len 12288 data: 5 4 4
35238 092/300 Write block 3318 len 32768 data: 6 7 7 10 8 8 5 3
35239 093/300 Write block 1031 len 8192 data: 11 9
35240 094/300 Read block 3297 len 24576
35241 095/300 Flush
35242 096/300 Write block 2392 len 8192 data: 7 7
35243 097/300 Read block 563 len 20480
35244 098/300 Read block 3602 len 28672
35245 099/300 Read block 4216 len 36864
35246 100/300 Read block 1152 len 16384
35247 101/300 Write block 1858 len 20480 data: 4 5 4 4 7
35248 102/300 Write block 2782 len 32768 data: 7 7 6 7 7 6 7 6
35249 103/300 Write block 4471 len 12288 data: 3 3 3
35250 104/300 Read block 2346 len 12288
35251 105/300 Read block 303 len 12288
35252 106/300 Write block 2692 len 36864 data: 6 7 7 8 8 8 8 7 6
35253 107/300 Write block 1200 len 12288 data: 5 5 5
35254 108/300 Write block 4037 len 16384 data: 3 3 3 3
35255 109/300 Write block 3712 len 8192 data: 10 9
35256 110/300 Read block 3359 len 4096
35257 111/300 Write block 2105 len 12288 data: 4 3 4
35258 112/300 Read block 1155 len 32768
35259 113/300 Read block 4619 len 36864
35260 114/300 Write block 4638 len 16384 data: 6 4 5 5
35261 115/300 Write block 3714 len 40960 data: 8 8 8 6 5 4 6 5 3 4
35262 116/300 Write block 4939 len 12288 data: 5 5 6
35263 117/300 Write block 1119 len 20480 data: 5 6 5 3 3
35264 118/300 Read block 1140 len 28672
35265 119/300 Write block 2072 len 12288 data: 7 8 8
35266 120/300 Read block 4495 len 20480
35267 121/300 Read block 3865 len 24576
35268 122/300 Write block 816 len 16384 data: 7 6 6 7
35269 123/300 Read block 2489 len 40960
35270 124/300 Write block 3746 len 8192 data: 5 5
35271 125/300 Write block 3364 len 4096 data: 4
35272 126/300 Write block 4118 len 12288 data: 8 10 12
35273 127/300 Read block 2869 len 32768
35274 128/300 Write block 2031 len 28672 data: 8 7 7 7 8 7 10
35275 129/300 Write block 3307 len 20480 data: 4 3 2 3 5
35276 130/300 Write block 3404 len 40960 data: 7 6 6 8 9 10 7 8 8 7
35277 131/300 Read block 4706 len 36864
35278 132/300 Write block 3245 len 32768 data: 3 5 3 3 3 3 2 5
35279 133/300 Read block 3533 len 4096
35280 134/300 Write block 2135 len 16384 data: 9 7 6 5
35281 135/300 Write block 1844 len 8192 data: 2 2
35282 136/300 Read block 3089 len 36864
35283 137/300 Write block 1937 len 8192 data: 7 5
35284 138/300 Read block 2677 len 36864
35285 139/300 Read block 253 len 28672
35286 140/300 Write block 2281 len 32768 data: 5 6 6 4 4 6 5 7
35287 141/300 Read block 2832 len 24576
35288 142/300 Read block 1666 len 8192
35289 143/300 Read block 1007 len 16384
35290 144/300 Read block 1242 len 32768
35291 145/300 Read block 4703 len 12288
35292 146/300 Read block 4218 len 24576
35293 147/300 Read block 401 len 28672
35294 148/300 Write block 3192 len 36864 data: 6 6 6 6 8 8 8 5 6
35295 149/300 Read block 540 len 32768
35296 150/300 Read block 384 len 32768
35297 151/300 Read block 1704 len 24576
35298 152/300 Write block 204 len 8192 data: 3 4
35299 153/300 Write block 1930 len 16384 data: 10 8 6 7
35300 154/300 Write block 331 len 32768 data: 5 6 6 6 8 9 6 5
35301 155/300 Write block 2313 len 12288 data: 8 8 8
35302 156/300 Write block 4859 len 40960 data: 9 9 10 9 7 7 5 5 5 3
35303 157/300 Flush
35304 158/300 Write block 4225 len 20480 data: 3 3 3 3 3
35305 159/300 Flush
35306 160/300 Write block 1684 len 24576 data: 10 9 10 8 7 6
35307 161/300 Read block 4 len 40960
35308 162/300 Read block 2909 len 24576
35309 163/300 Write block 4535 len 40960 data: 5 4 3 3 5 5 6 5 7 7
35310 164/300 Read block 1557 len 28672
35311 165/300 Read block 3436 len 24576
35312 166/300 Read block 1340 len 40960
35313 167/300 Write block 4522 len 28672 data: 4 4 6 6 8 7 9
35314 168/300 Read block 2209 len 8192
35315 169/300 Read block 2301 len 16384
35316 170/300 Read block 4721 len 24576
35317 171/300 Write block 888 len 4096 data: 4
35318 172/300 Read block 130 len 16384
35319 173/300 Write block 4356 len 24576 data: 5 6 5 6 7 8
35320 174/300 Write block 2633 len 4096 data: 5
35321 175/300 Read block 2801 len 12288
35322 176/300 Read block 2350 len 20480
35323 177/300 Read block 1752 len 24576
35324 178/300 Write block 630 len 24576 data: 6 8 8 10 11 11
35325 179/300 Read block 331 len 32768
35326 180/300 Flush
35327 181/300 Read block 1948 len 32768
35328 182/300 Read block 3918 len 24576
35329 183/300 Read block 4317 len 32768
35330 184/300 Read block 2373 len 16384
35331 185/300 Write block 2557 len 24576 data: 7 7 6 5 5 3
35332 186/300 Read block 3937 len 40960
35333 187/300 Read block 1080 len 8192
35334 188/300 Flush
35335 189/300 Write block 3080 len 12288 data: 5 5 5
35336 190/300 Read block 3185 len 12288
35337 191/300 Write block 4242 len 28672 data: 4 3 4 6 6 8 7
35338 192/300 Write block 1166 len 12288 data: 7 3 3
35339 193/300 Read block 2057 len 12288
35340 194/300 Read block 4055 len 24576
35341 195/300 Read block 4281 len 36864
35342 196/300 Read block 511 len 32768
35343 197/300 Write block 2626 len 32768 data: 4 6 5 3 4 5 3 6
35344 198/300 Write block 156 len 28672 data: 2 2 4 4 4 4 5
35345 199/300 Write block 1752 len 8192 data: 6 7
35346 200/300 Read block 4208 len 20480
35347 201/300 Read block 1252 len 12288
35348 202/300 Write block 1360 len 16384 data: 7 8 6 7
35349 203/300 Read block 2388 len 24576
35350 204/300 Write block 14 len 8192 data: 8 9
35351 205/300 Read block 4972 len 16384
35352 206/300 Read block 4580 len 40960
35353 207/300 Flush
35354 208/300 Read block 982 len 12288
35355 209/300 Write block 1288 len 20480 data: 4 4 4 4 3
35356 210/300 Write block 2545 len 28672 data: 4 3 4 5 6 6 8
35357 211/300 Write block 3319 len 40960 data: 8 8 11 9 9 6 4 3 4 5
35358 212/300 Write block 3950 len 32768 data: 5 4 4 4 4 4 5 6
35359 213/300 Write block 2143 len 32768 data: 6 6 5 6 6 5 8 7
35360 214/300 Read block 550 len 32768
35361 215/300 Write block 1649 len 8192 data: 5 5
35362 216/300 Write block 850 len 24576 data: 6 6 5 6 5 4
35363 217/300 Read block 3331 len 40960
35364 218/300 Read block 1253 len 24576
35365 219/300 Write block 1906 len 20480 data: 6 7 7 7 5
35366 220/300 Read block 1554 len 36864
35367 221/300 Read block 1205 len 36864
35368 222/300 Write block 544 len 20480 data: 8 6 6 6 7
35369 223/300 Write block 4670 len 40960 data: 6 6 6 6 6 7 6 5 7 6
35370 224/300 Read block 1220 len 12288
35371 225/300 Read block 2905 len 36864
35372 226/300 Write block 3126 len 20480 data: 8 7 6 7 8
35373 227/300 Read block 405 len 12288
35374 228/300 Read block 4875 len 32768
35375 229/300 Read block 1979 len 40960
35376 230/300 Read block 1224 len 8192
35377 231/300 Read block 3802 len 32768
35378 232/300 Read block 3757 len 28672
35379 233/300 Flush
35380 234/300 Read block 1569 len 12288
35381 235/300 Flush
35382 236/300 Write block 1841 len 4096 data: 3
35383 237/300 Read block 3327 len 32768
35384 238/300 Read block 3001 len 16384
35385 239/300 Read block 4289 len 12288
35386 240/300 Read block 1029 len 20480
35387 241/300 Read block 2686 len 16384
35388 242/300 Read block 2005 len 28672
35389 243/300 Write block 2357 len 24576 data: 7 8 7 4 5 8
35390 244/300 Read block 4700 len 28672
35391 245/300 Read block 3024 len 12288
35392 246/300 Write block 2889 len 28672 data: 10 10 7 8 7 7 10
35393 247/300 Write block 4497 len 4096 data: 3
35394 248/300 Read block 3556 len 40960
35395 249/300 Read block 3183 len 28672
35396 250/300 Write block 4863 len 8192 data: 8 8
35397 251/300 Read block 2476 len 40960
35398 252/300 Write block 3136 len 8192 data: 6 7
35399 253/300 Write block 119 len 40960 data: 7 10 8 8 9 7 7 7 6 6
35400 254/300 Read block 2836 len 24576
35401 255/300 Read block 4702 len 36864
35402 256/300 Write block 4766 len 16384 data: 6 7 8 9
35403 257/300 Write block 1804 len 8192 data: 3 3
35404 258/300 Read block 2684 len 40960
35405 259/300 Read block 2101 len 12288
35406 260/300 Read block 3168 len 4096
35407 261/300 Read block 1588 len 36864
35408 262/300 Write block 4724 len 24576 data: 4 4 5 4 4 5
35409 263/300 Write block 3427 len 16384 data: 3 3 4 4
35410 264/300 Read block 1833 len 12288
35411 265/300 Write block 1109 len 16384 data: 8 8 7 10
35412 266/300 Write block 4658 len 28672 data: 6 4 5 6 4 4 4
35413 267/300 Read block 2982 len 24576
35414 268/300 Write block 1153 len 24576 data: 6 6 7 7 8 8
35415 269/300 Write block 1473 len 4096 data: 6
35416 270/300 Read block 313 len 32768
35417 271/300 Write block 436 len 4096 data: 4
35418 272/300 Read block 3479 len 8192
35419 273/300 Write block 3551 len 4096 data: 10
35420 274/300 Read block 1580 len 24576
35421 275/300 Read block 4078 len 28672
35422 276/300 Read block 1045 len 16384
35423 277/300 Read block 643 len 36864
35424 278/300 Write block 1003 len 12288 data: 4 5 4
35425 279/300 Read block 3621 len 4096
35426 280/300 Read block 2814 len 12288
35427 281/300 Read block 2872 len 36864
35428 282/300 Flush
35429 283/300 Read block 2711 len 20480
35430 284/300 Write block 2208 len 24576 data: 6 5 6 6 6 5
35431 285/300 Read block 2422 len 40960
35432 286/300 Write block 4668 len 4096 data: 5
35433 287/300 Write block 1289 len 8192 data: 5 5
35434 288/300 Read block 4644 len 8192
35435 289/300 Read block 3707 len 28672
35436 290/300 Write block 2831 len 8192 data: 5 5
35437 291/300 Read block 4278 len 36864
35438 292/300 Read block 1710 len 28672
35439 293/300 Write block 1964 len 8192 data: 4 3
35440 294/300 Read block 2917 len 4096
35441 295/300 Read block 2382 len 20480
35442 296/300 Read block 3783 len 28672
35443 297/300 Write block 2793 len 28672 data: 3 5 6 5 6 6 6
35444 298/300 Flush
35445 299/300 Write block 318 len 40960 data: 7 8 6 5 5 5 5 6 5 2
35446 300/300 Write block 4720 len 40960 data: 5 5 4 6 5 5 6 5 5 6
35447 301/300 Write block 2661 len 12288 data: 4 3 3
35448 Main task has work to do, go find it
35449 got dsc Start(2)
35450 start 2
35451 Jan 10 16:42:47.128 INFO request completed, latency_us: 219, response_code: 204, uri: /start/cid/2, method: POST, req_id: d3d3a7e7-9110-4ab1-9ce6-36e19ea38ed9, remote_addr: 127.0.0.1:55917, local_addr: 127.0.0.1:9998
35452 Replay: started 2, returned:Ok(())
35453 ----------------------------------------------------------------
35454 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:301
35455 States: Active Active Offline
35456 JOBID ACK TYPE BKS/EXT DS:0 DS:1 DS:2 REPLAY
35457 9755 Acked Read 6 Done Done Sent false
35458 9756 Acked Read 1 Done Done Sent false
35459 9757 Acked Write 1 Done Done Sent false
35460 9758 Acked Read 7 Done Done Sent false
35461 9759 Acked Read 9 Done Done Sent false
35462 9760 Acked Read 3 Done Done Sent false
35463 9761 Acked Write 10 Done Done Sent false
35464 9762 Acked Write 2 Done Done Sent false
35465 9763 Acked Write 8 Done Done Sent false
35466 9764 Acked Write 4 Done Done Sent false
35467 9765 Acked Write 2 Done Done Sent false
35468 9766 Acked Flush 0 Done Done Sent false
35469 9767 Acked Write 2 Done Done Sent false
35470 9768 Acked Write 8 Done Done Sent false
35471 9769 Acked Read 10 Done Done Sent false
35472 9770 Acked Write 3 Done Done Sent false
35473 9771 Acked Read 4 Done Done Sent false
35474 9772 Acked Read 7 Done Done Sent false
35475 9773 Acked Write 4 Done Done Sent false
35476 9774 Acked Flush 0 Done Done Sent false
35477 9775 Acked Write 8 Done Done Sent false
35478 9776 Acked Read 6 Done Done Sent false
35479 9777 Acked Read 6 Done Done Sent false
35480 9778 Acked Read 7 Done Done Sent false
35481 9779 Acked Flush 0 Done Done Sent false
35482 9780 Acked Read 6 Done Done Sent false
35483 9781 Acked Write 6 Done Done Sent false
35484 9782 Acked Write 7 Done Done Sent false
35485 9783 Acked Read 5 Done Done Sent false
35486 9784 Acked Write 1 Done Done Sent false
35487 9785 Acked Write 10 Done Done Sent false
35488 9786 Acked Flush 0 Done Done Sent false
35489 9787 Acked Read 8 Done Done Sent false
35490 9788 Acked Read 9 Done Done Sent false
35491 9789 Acked Read 6 Done Done Sent false
35492 9790 Acked Read 3 Done Done Sent false
35493 9791 Acked Read 9 Done Done Sent false
35494 9792 Acked Flush 0 Done Done Sent false
35495 9793 Acked Read 7 Done Done Sent false
35496 9794 Acked Read 5 Done Done Sent false
35497 9795 Acked Write 6 Done Done Sent false
35498 9796 Acked Write 9 Done Done Sent false
35499 9797 Acked Write 6 Done Done Sent false
35500 9798 Acked Read 3 Done Done Sent false
35501 9799 Acked Read 5 Done Done Sent false
35502 9800 Acked Read 10 Done Done Sent false
35503 9801 Acked Read 9 Done Done Sent false
35504 9802 Acked Read 10 Done Done Sent false
35505 9803 Acked Read 3 Done Done Sent false
35506 9804 Acked Flush 0 Done Done Sent false
35507 9805 Acked Read 2 Done Done Sent false
35508 9806 Acked Read 7 Done Done Sent false
35509 9807 Acked Write 9 Done Done Sent false
35510 9808 Acked Write 4 Done Done Sent false
35511 9809 Acked Read 5 Done Done Sent false
35512 9810 Acked Read 9 Done Done Sent false
35513 9811 Acked Read 9 Done Done Sent false
35514 9812 Acked Read 6 Done Done Sent false
35515 9813 Acked Read 9 Done Done Sent false
35516 9814 Acked Read 5 Done Done Sent false
35517 9815 Acked Read 9 Done Done Sent false
35518 9816 Acked Read 6 Done Done Sent false
35519 9817 Acked Read 9 Done Done Sent false
35520 9818 Acked Read 2 Done Done Sent false
35521 9819 Acked Read 5 Done Done Sent false
35522 9820 Acked Read 9 Done Done Sent false
35523 9821 Acked Read 8 Done Done Sent false
35524 9822 Acked Read 5 Done Done Sent false
35525 9823 Acked Read 1 Done Done Sent false
35526 9824 Acked Read 8 Done Done Sent false
35527 9825 Acked Read 5 Done Done Sent false
35528 9826 Acked Write 4 Done Done Sent false
35529 9827 Acked Write 2 Done Done Sent false
35530 9828 Acked Read 5 Done Done Sent false
35531 9829 Acked Write 3 Done Done Sent false
35532 9830 Acked Read 9 Done Done Sent false
35533 9831 Acked Write 3 Done Done Sent false
35534 9832 Acked Read 2 Done Done Sent false
35535 9833 Acked Read 9 Done Done Sent false
35536 9834 Acked Read 3 Done Done Sent false
35537 9835 Acked Read 9 Done Done Sent false
35538 9836 Acked Read 3 Done Done Sent false
35539 9837 Acked Flush 0 Done Done Sent false
35540 9838 Acked Write 1 Done Done Sent false
35541 9839 Acked Read 8 Done Done Sent false
35542 9840 Acked Read 9 Done Done Sent false
35543 9841 Acked Read 7 Done Done Sent false
35544 9842 Acked Write 4 Done Done Sent false
35545 9843 Acked Read 1 Done Done Sent false
35546 9844 Acked Read 4 Done Done Sent false
35547 9845 Acked Write 3 Done Done Sent false
35548 9846 Acked Write 8 Done Done Sent false
35549 9847 Acked Write 2 Done Done Sent false
35550 9848 Acked Read 6 Done Done Sent false
35551 9849 Acked Flush 0 Done Done Sent false
35552 9850 Acked Write 2 Done Done Sent false
35553 9851 Acked Read 5 Done Done Sent false
35554 9852 Acked Read 7 Done Done Sent false
35555 9853 Acked Read 9 Done Done Sent false
35556 9854 Acked Read 4 Done Done Sent false
35557 9855 Acked Write 5 Done Done Sent false
35558 9856 Acked Write 8 Done Done Sent false
35559 9857 Acked Write 3 Done Done Sent false
35560 9858 Acked Read 3 Done Done Sent false
35561 9859 Acked Read 3 Done Done Sent false
35562 9860 Acked Write 9 Done Done Sent false
35563 9861 Acked Write 3 Done Done Sent false
35564 9862 Acked Write 4 Done Done Sent false
35565 9863 Acked Write 2 Done Done Sent false
35566 9864 Acked Read 1 Done Done Sent false
35567 9865 Acked Write 3 Done Done Sent false
35568 9866 Acked Read 8 Done Done Sent false
35569 9867 Acked Read 9 Done Done Sent false
35570 9868 Acked Write 4 Done Done Sent false
35571 9869 Acked Write 10 Done Done Sent false
35572 9870 Acked Write 3 Done Done Sent false
35573 9871 Acked Write 5 Done Done Sent false
35574 9872 Acked Read 7 Done Done Sent false
35575 9873 Acked Write 3 Done Done Sent false
35576 9874 Acked Read 5 Done Done Sent false
35577 9875 Acked Read 6 Done Done Sent false
35578 9876 Acked Write 4 Done Done Sent false
35579 9877 Acked Read 10 Done Done Sent false
35580 9878 Acked Write 2 Done Done Sent false
35581 9879 Acked Write 1 Done Done Sent false
35582 9880 Acked Write 3 Done Done Sent false
35583 9881 Acked Read 8 Done Done Sent false
35584 9882 Acked Write 7 Done Done Sent false
35585 9883 Acked Write 5 Done Done Sent false
35586 9884 Acked Write 10 Done Done Sent false
35587 9885 Acked Read 9 Done Done Sent false
35588 9886 Acked Write 8 Done Done Sent false
35589 9887 Acked Read 1 Done Done Sent false
35590 9888 Acked Write 4 Done Done Sent false
35591 9889 Acked Write 2 Done Done Sent false
35592 9890 Acked Read 9 Done Done Sent false
35593 9891 Acked Write 2 Done Done Sent false
35594 9892 Acked Read 9 Done Done Sent false
35595 9893 Acked Read 7 Done Done Sent false
35596 9894 Acked Write 8 Done Done Sent false
35597 9895 Acked Read 6 Done Done Sent false
35598 9896 Acked Read 2 Done Done Sent false
35599 9897 Acked Read 4 Done Done Sent false
35600 9898 Acked Read 8 Done Done Sent false
35601 9899 Acked Read 3 Done Done Sent false
35602 9900 Acked Read 6 Done Done Sent false
35603 9901 Acked Read 7 Done Done Sent false
35604 9902 Acked Write 9 Done Done Sent false
35605 9903 Acked Read 8 Done Done Sent false
35606 9904 Acked Read 8 Done Done Sent false
35607 9905 Acked Read 6 Done Done Sent false
35608 9906 Acked Write 2 Done Done Sent false
35609 9907 Acked Write 4 Done Done Sent false
35610 9908 Acked Write 8 Done Done Sent false
35611 9909 Acked Write 3 Done Done Sent false
35612 9910 Acked Write 10 Done Done Sent false
35613 9911 Acked Flush 0 Done Done Sent false
35614 9912 Acked Write 5 Done Done Sent false
35615 9913 Acked Flush 0 Done Done Sent false
35616 9914 Acked Write 6 Done Done Sent false
35617 9915 Acked Read 10 Done Done Sent false
35618 9916 Acked Read 6 Done Done Sent false
35619 9917 Acked Write 10 Done Done Sent false
35620 9918 Acked Read 7 Done Done Sent false
35621 9919 Acked Read 6 Done Done Sent false
35622 9920 Acked Read 10 Done Done Sent false
35623 9921 Acked Write 7 Done Done Sent false
35624 9922 Acked Read 2 Done Done Sent false
35625 9923 Acked Read 4 Done Done Sent false
35626 9924 Acked Read 6 Done Done Sent false
35627 9925 Acked Write 1 Done Done Sent false
35628 9926 Acked Read 4 Done Done Sent false
35629 9927 Acked Write 6 Done Done Sent false
35630 9928 Acked Write 1 Done Done Sent false
35631 9929 Acked Read 3 Done Done Sent false
35632 9930 Acked Read 5 Done Done Sent false
35633 9931 Acked Read 6 Done Done Sent false
35634 9932 Acked Write 6 Done Done Sent false
35635 9933 Acked Read 8 Done Done Sent false
35636 9934 Acked Flush 0 Done Done Sent false
35637 9935 Acked Read 8 Done Done Sent false
35638 9936 Acked Read 6 Done Done Sent false
35639 9937 Acked Read 8 Done Done Sent false
35640 9938 Acked Read 4 Done Done Sent false
35641 9939 Acked Write 6 Done Done Sent false
35642 9940 Acked Read 10 Done Done Sent false
35643 9941 Acked Read 2 Done Done Sent false
35644 9942 Acked Flush 0 Done Done Sent false
35645 9943 Acked Write 3 Done Done Sent false
35646 9944 Acked Read 3 Done Done Sent false
35647 9945 Acked Write 7 Done Done Sent false
35648 9946 Acked Write 3 Done Done Sent false
35649 9947 Acked Read 3 Done Done Sent false
35650 9948 Acked Read 6 Done Done Sent false
35651 9949 Acked Read 9 Done Done Sent false
35652 9950 Acked Read 8 Done Done Sent false
35653 9951 Acked Write 8 Done Done Sent false
35654 9952 Acked Write 7 Done Done Sent false
35655 9953 Acked Write 2 Done Done Sent false
35656 9954 Acked Read 5 Done Done Sent false
35657 9955 Acked Read 3 Done Done Sent false
35658 9956 Acked Write 4 Done Done Sent false
35659 9957 Acked Read 6 Done Done Sent false
35660 9958 Acked Write 2 Done Done Sent false
35661 9959 Acked Read 4 Done Done Sent false
35662 9960 Acked Read 10 Done Done Sent false
35663 9961 Acked Flush 0 Done Done Sent false
35664 9962 Acked Read 3 Done Done Sent false
35665 9963 Acked Write 5 Done Done Sent false
35666 9964 Acked Write 7 Done Done Sent false
35667 9965 Acked Write 10 Done Done Sent false
35668 9966 Acked Write 8 Done Done Sent false
35669 9967 Acked Write 8 Done Done Sent false
35670 9968 Acked Read 8 Done Done Sent false
35671 9969 Acked Write 2 Done Done Sent false
35672 9970 Acked Write 6 Done Done Sent false
35673 9971 Acked Read 10 Done Done Sent false
35674 9972 Acked Read 6 Done Done Sent false
35675 9973 Acked Write 5 Done Done Sent false
35676 9974 Acked Read 9 Done Done Sent false
35677 9975 Acked Read 9 Done Done Sent false
35678 9976 Acked Write 5 Done Done Sent false
35679 9977 Acked Write 10 Done Done Sent false
35680 9978 Acked Read 3 Done Done Sent false
35681 9979 Acked Read 9 Done Done Sent false
35682 9980 Acked Write 5 Done Done Sent false
35683 9981 Acked Read 3 Done Done Sent false
35684 9982 Acked Read 8 Done Done Sent false
35685 9983 Acked Read 10 Done Done Sent false
35686 9984 Acked Read 2 Done Done Sent false
35687 9985 Acked Read 8 Done Done Sent false
35688 9986 Acked Read 7 Done Done Sent false
35689 9987 Acked Flush 0 Done Done Sent false
35690 9988 Acked Read 3 Done Done Sent false
35691 9989 Acked Flush 0 Done Done Sent false
35692 9990 Acked Write 1 Done Done Sent false
35693 9991 Acked Read 8 Done Done Sent false
35694 9992 Acked Read 4 Done Done Sent false
35695 9993 Acked Read 3 Done Done Sent false
35696 9994 Acked Read 5 Done Done Sent false
35697 9995 Acked Read 4 Done Done Sent false
35698 9996 Acked Read 7 Done Done Sent false
35699 9997 Acked Write 6 Done Done Sent false
35700 9998 Acked Read 7 Done Done Sent false
35701 9999 Acked Read 3 Done Done Sent false
35702 10000 Acked Write 7 Done Done Sent false
35703 10001 Acked Write 1 Done Done Sent false
35704 10002 Acked Read 10 Done Done Sent false
35705 10003 Acked Read 7 Done Done Sent false
35706 10004 Acked Write 2 Done Done Sent false
35707 10005 Acked Read 10 Done Done Sent false
35708 10006 Acked Write 2 Done Done Sent false
35709 10007 Acked Write 10 Done Done Sent false
35710 10008 Acked Read 6 Done Done Sent false
35711 10009 Acked Read 9 Done Done Sent false
35712 10010 Acked Write 4 Done Done Sent false
35713 10011 Acked Write 2 Done Done Sent false
35714 10012 Acked Read 10 Done Done Sent false
35715 10013 Acked Read 3 Done Done Sent false
35716 10014 Acked Read 1 Done Done Sent false
35717 10015 Acked Read 9 Done Done Sent false
35718 10016 Acked Write 6 Done Done Sent false
35719 10017 Acked Write 4 Done Done Sent false
35720 10018 Acked Read 3 Done Done Sent false
35721 10019 Acked Write 4 Done Done Sent false
35722 10020 Acked Write 7 Done Done Sent false
35723 10021 Acked Read 6 Done Done Sent false
35724 10022 Acked Write 6 Done Done Sent false
35725 10023 Acked Write 1 Done Done Sent false
35726 10024 Acked Read 8 Done Done Sent false
35727 10025 Acked Write 1 Done Done Sent false
35728 10026 Acked Read 2 Done Done Sent false
35729 10027 Acked Write 1 Done Done Sent false
35730 10028 Acked Read 6 Done Done Sent false
35731 10029 Acked Read 7 Done Done Sent false
35732 10030 Acked Read 4 Done Done Sent false
35733 10031 Acked Read 9 Done Done Sent false
35734 10032 Acked Write 3 Done Done Sent false
35735 10033 Acked Read 1 Done Done Sent false
35736 10034 Acked Read 3 Done Done Sent false
35737 10035 Acked Read 9 Done Done Sent false
35738 10036 Acked Flush 0 Done Done Sent false
35739 10037 Acked Read 5 Done Done Sent false
35740 10038 Acked Write 6 Done Done Sent false
35741 10039 Acked Read 10 Done Done Sent false
35742 10040 Acked Write 1 Done Done Sent false
35743 10041 Acked Write 2 Done Done Sent false
35744 10042 Acked Read 2 Done Done Sent false
35745 10043 Acked Read 7 Done Done Sent false
35746 10044 Acked Write 2 Done Done Sent false
35747 10045 Acked Read 9 Done Done Sent false
35748 10046 Acked Read 7 Done Done Sent false
35749 10047 Acked Write 2 Done Done Sent false
35750 10048 Acked Read 1 Done Done Sent false
35751 10049 Acked Read 5 Done Done Sent false
35752 10050 Acked Read 7 Done Done Sent false
35753 10051 Acked Write 7 Done Done Sent false
35754 10052 Acked Flush 0 Done Done Sent false
35755 10053 Acked Write 10 Done Done Sent false
35756 10054 Acked Write 10 Done Done Sent false
35757 10055 Acked Write 3 Done Sent Sent false
35758 STATES DS:0 DS:1 DS:2 TOTAL
35759 Sent 0 1 301 302
35760 Done 301 300 0 601
35761 Skipped 0 0 0 0
35762 Error 0 0 0 0
35763 Last Flush: 10052 10052 9754
35764 Downstairs last five completed: 9754 9753 9752 9751 9750
35765 Upstairs last five completed: 10055 10054 10053 10052 10051
35766 CLIENT: Up:0 ds:301 act:2
35767 ----------------------------------------------------------------
35768 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:302
35769 States: Active Active Offline
35770 JOBID ACK TYPE BKS/EXT DS:0 DS:1 DS:2 REPLAY
35771 9755 Acked Read 6 Done Done Sent false
35772 9756 Acked Read 1 Done Done Sent false
35773 9757 Acked Write 1 Done Done Sent false
35774 9758 Acked Read 7 Done Done Sent false
35775 9759 Acked Read 9 Done Done Sent false
35776 9760 Acked Read 3 Done Done Sent false
35777 9761 Acked Write 10 Done Done Sent false
35778 9762 Acked Write 2 Done Done Sent false
35779 9763 Acked Write 8 Done Done Sent false
35780 9764 Acked Write 4 Done Done Sent false
35781 9765 Acked Write 2 Done Done Sent false
35782 9766 Acked Flush 0 Done Done Sent false
35783 9767 Acked Write 2 Done Done Sent false
35784 9768 Acked Write 8 Done Done Sent false
35785 9769 Acked Read 10 Done Done Sent false
35786 9770 Acked Write 3 Done Done Sent false
35787 9771 Acked Read 4 Done Done Sent false
35788 9772 Acked Read 7 Done Done Sent false
35789 9773 Acked Write 4 Done Done Sent false
35790 9774 Acked Flush 0 Done Done Sent false
35791 9775 Acked Write 8 Done Done Sent false
35792 9776 Acked Read 6 Done Done Sent false
35793 9777 Acked Read 6 Done Done Sent false
35794 9778 Acked Read 7 Done Done Sent false
35795 9779 Acked Flush 0 Done Done Sent false
35796 9780 Acked Read 6 Done Done Sent false
35797 9781 Acked Write 6 Done Done Sent false
35798 9782 Acked Write 7 Done Done Sent false
35799 9783 Acked Read 5 Done Done Sent false
35800 9784 Acked Write 1 Done Done Sent false
35801 9785 Acked Write 10 Done Done Sent false
35802 9786 Acked Flush 0 Done Done Sent false
35803 9787 Acked Read 8 Done Done Sent false
35804 9788 Acked Read 9 Done Done Sent false
35805 9789 Acked Read 6 Done Done Sent false
35806 9790 Acked Read 3 Done Done Sent false
35807 9791 Acked Read 9 Done Done Sent false
35808 9792 Acked Flush 0 Done Done Sent false
35809 9793 Acked Read 7 Done Done Sent false
35810 9794 Acked Read 5 Done Done Sent false
35811 9795 Acked Write 6 Done Done Sent false
35812 9796 Acked Write 9 Done Done Sent false
35813 9797 Acked Write 6 Done Done Sent false
35814 9798 Acked Read 3 Done Done Sent false
35815 9799 Acked Read 5 Done Done Sent false
35816 9800 Acked Read 10 Done Done Sent false
35817 9801 Acked Read 9 Done Done Sent false
35818 9802 Acked Read 10 Done Done Sent false
35819 9803 Acked Read 3 Done Done Sent false
35820 9804 Acked Flush 0 Done Done Sent false
35821 9805 Acked Read 2 Done Done Sent false
35822 9806 Acked Read 7 Done Done Sent false
35823 9807 Acked Write 9 Done Done Sent false
35824 9808 Acked Write 4 Done Done Sent false
35825 9809 Acked Read 5 Done Done Sent false
35826 9810 Acked Read 9 Done Done Sent false
35827 9811 Acked Read 9 Done Done Sent false
35828 9812 Acked Read 6 Done Done Sent false
35829 9813 Acked Read 9 Done Done Sent false
35830 9814 Acked Read 5 Done Done Sent false
35831 9815 Acked Read 9 Done Done Sent false
35832 9816 Acked Read 6 Done Done Sent false
35833 9817 Acked Read 9 Done Done Sent false
35834 9818 Acked Read 2 Done Done Sent false
35835 9819 Acked Read 5 Done Done Sent false
35836 9820 Acked Read 9 Done Done Sent false
35837 9821 Acked Read 8 Done Done Sent false
35838 9822 Acked Read 5 Done Done Sent false
35839 9823 Acked Read 1 Done Done Sent false
35840 9824 Acked Read 8 Done Done Sent false
35841 9825 Acked Read 5 Done Done Sent false
35842 9826 Acked Write 4 Done Done Sent false
35843 9827 Acked Write 2 Done Done Sent false
35844 9828 Acked Read 5 Done Done Sent false
35845 9829 Acked Write 3 Done Done Sent false
35846 9830 Acked Read 9 Done Done Sent false
35847 9831 Acked Write 3 Done Done Sent false
35848 9832 Acked Read 2 Done Done Sent false
35849 9833 Acked Read 9 Done Done Sent false
35850 9834 Acked Read 3 Done Done Sent false
35851 9835 Acked Read 9 Done Done Sent false
35852 9836 Acked Read 3 Done Done Sent false
35853 9837 Acked Flush 0 Done Done Sent false
35854 9838 Acked Write 1 Done Done Sent false
35855 9839 Acked Read 8 Done Done Sent false
35856 9840 Acked Read 9 Done Done Sent false
35857 9841 Acked Read 7 Done Done Sent false
35858 9842 Acked Write 4 Done Done Sent false
35859 9843 Acked Read 1 Done Done Sent false
35860 9844 Acked Read 4 Done Done Sent false
35861 9845 Acked Write 3 Done Done Sent false
35862 9846 Acked Write 8 Done Done Sent false
35863 9847 Acked Write 2 Done Done Sent false
35864 9848 Acked Read 6 Done Done Sent false
35865 9849 Acked Flush 0 Done Done Sent false
35866 9850 Acked Write 2 Done Done Sent false
35867 9851 Acked Read 5 Done Done Sent false
35868 9852 Acked Read 7 Done Done Sent false
35869 9853 Acked Read 9 Done Done Sent false
35870 9854 Acked Read 4 Done Done Sent false
35871 9855 Acked Write 5 Done Done Sent false
35872 9856 Acked Write 8 Done Done Sent false
35873 9857 Acked Write 3 Done Done Sent false
35874 9858 Acked Read 3 Done Done Sent false
35875 9859 Acked Read 3 Done Done Sent false
35876 9860 Acked Write 9 Done Done Sent false
35877 9861 Acked Write 3 Done Done Sent false
35878 9862 Acked Write 4 Done Done Sent false
35879 9863 Acked Write 2 Done Done Sent false
35880 9864 Acked Read 1 Done Done Sent false
35881 9865 Acked Write 3 Done Done Sent false
35882 9866 Acked Read 8 Done Done Sent false
35883 9867 Acked Read 9 Done Done Sent false
35884 9868 Acked Write 4 Done Done Sent false
35885 9869 Acked Write 10 Done Done Sent false
35886 9870 Acked Write 3 Done Done Sent false
35887 9871 Acked Write 5 Done Done Sent false
35888 9872 Acked Read 7 Done Done Sent false
35889 9873 Acked Write 3 Done Done Sent false
35890 9874 Acked Read 5 Done Done Sent false
35891 9875 Acked Read 6 Done Done Sent false
35892 9876 Acked Write 4 Done Done Sent false
35893 9877 Acked Read 10 Done Done Sent false
35894 9878 Acked Write 2 Done Done Sent false
35895 9879 Acked Write 1 Done Done Sent false
35896 9880 Acked Write 3 Done Done Sent false
35897 9881 Acked Read 8 Done Done Sent false
35898 9882 Acked Write 7 Done Done Sent false
35899 9883 Acked Write 5 Done Done Sent false
35900 9884 Acked Write 10 Done Done Sent false
35901 9885 Acked Read 9 Done Done Sent false
35902 9886 Acked Write 8 Done Done Sent false
35903 9887 Acked Read 1 Done Done Sent false
35904 9888 Acked Write 4 Done Done Sent false
35905 9889 Acked Write 2 Done Done Sent false
35906 9890 Acked Read 9 Done Done Sent false
35907 9891 Acked Write 2 Done Done Sent false
35908 9892 Acked Read 9 Done Done Sent false
35909 9893 Acked Read 7 Done Done Sent false
35910 9894 Acked Write 8 Done Done Sent false
35911 9895 Acked Read 6 Done Done Sent false
35912 9896 Acked Read 2 Done Done Sent false
35913 9897 Acked Read 4 Done Done Sent false
35914 9898 Acked Read 8 Done Done Sent false
35915 9899 Acked Read 3 Done Done Sent false
35916 9900 Acked Read 6 Done Done Sent false
35917 9901 Acked Read 7 Done Done Sent false
35918 9902 Acked Write 9 Done Done Sent false
35919 9903 Acked Read 8 Done Done Sent false
35920 9904 Acked Read 8 Done Done Sent false
35921 9905 Acked Read 6 Done Done Sent false
35922 9906 Acked Write 2 Done Done Sent false
35923 9907 Acked Write 4 Done Done Sent false
35924 9908 Acked Write 8 Done Done Sent false
35925 9909 Acked Write 3 Done Done Sent false
35926 9910 Acked Write 10 Done Done Sent false
35927 9911 Acked Flush 0 Done Done Sent false
35928 9912 Acked Write 5 Done Done Sent false
35929 9913 Acked Flush 0 Done Done Sent false
35930 9914 Acked Write 6 Done Done Sent false
35931 9915 Acked Read 10 Done Done Sent false
35932 9916 Acked Read 6 Done Done Sent false
35933 9917 Acked Write 10 Done Done Sent false
35934 9918 Acked Read 7 Done Done Sent false
35935 9919 Acked Read 6 Done Done Sent false
35936 9920 Acked Read 10 Done Done Sent false
35937 9921 Acked Write 7 Done Done Sent false
35938 9922 Acked Read 2 Done Done Sent false
35939 9923 Acked Read 4 Done Done Sent false
35940 9924 Acked Read 6 Done Done Sent false
35941 9925 Acked Write 1 Done Done Sent false
35942 9926 Acked Read 4 Done Done Sent false
35943 9927 Acked Write 6 Done Done Sent false
35944 9928 Acked Write 1 Done Done Sent false
35945 9929 Acked Read 3 Done Done Sent false
35946 9930 Acked Read 5 Done Done Sent false
35947 9931 Acked Read 6 Done Done Sent false
35948 9932 Acked Write 6 Done Done Sent false
35949 9933 Acked Read 8 Done Done Sent false
35950 9934 Acked Flush 0 Done Done Sent false
35951 9935 Acked Read 8 Done Done Sent false
35952 9936 Acked Read 6 Done Done Sent false
35953 9937 Acked Read 8 Done Done Sent false
35954 9938 Acked Read 4 Done Done Sent false
35955 9939 Acked Write 6 Done Done Sent false
35956 9940 Acked Read 10 Done Done Sent false
35957 9941 Acked Read 2 Done Done Sent false
35958 9942 Acked Flush 0 Done Done Sent false
35959 9943 Acked Write 3 Done Done Sent false
35960 9944 Acked Read 3 Done Done Sent false
35961 9945 Acked Write 7 Done Done Sent false
35962 9946 Acked Write 3 Done Done Sent false
35963 9947 Acked Read 3 Done Done Sent false
35964 9948 Acked Read 6 Done Done Sent false
35965 9949 Acked Read 9 Done Done Sent false
35966 9950 Acked Read 8 Done Done Sent false
35967 9951 Acked Write 8 Done Done Sent false
35968 9952 Acked Write 7 Done Done Sent false
35969 9953 Acked Write 2 Done Done Sent false
35970 9954 Acked Read 5 Done Done Sent false
35971 9955 Acked Read 3 Done Done Sent false
35972 9956 Acked Write 4 Done Done Sent false
35973 9957 Acked Read 6 Done Done Sent false
35974 9958 Acked Write 2 Done Done Sent false
35975 9959 Acked Read 4 Done Done Sent false
35976 9960 Acked Read 10 Done Done Sent false
35977 9961 Acked Flush 0 Done Done Sent false
35978 9962 Acked Read 3 Done Done Sent false
35979 9963 Acked Write 5 Done Done Sent false
35980 9964 Acked Write 7 Done Done Sent false
35981 9965 Acked Write 10 Done Done Sent false
35982 9966 Acked Write 8 Done Done Sent false
35983 9967 Acked Write 8 Done Done Sent false
35984 9968 Acked Read 8 Done Done Sent false
35985 9969 Acked Write 2 Done Done Sent false
35986 9970 Acked Write 6 Done Done Sent false
35987 9971 Acked Read 10 Done Done Sent false
35988 9972 Acked Read 6 Done Done Sent false
35989 9973 Acked Write 5 Done Done Sent false
35990 9974 Acked Read 9 Done Done Sent false
35991 9975 Acked Read 9 Done Done Sent false
35992 9976 Acked Write 5 Done Done Sent false
35993 9977 Acked Write 10 Done Done Sent false
35994 9978 Acked Read 3 Done Done Sent false
35995 9979 Acked Read 9 Done Done Sent false
35996 9980 Acked Write 5 Done Done Sent false
35997 9981 Acked Read 3 Done Done Sent false
35998 9982 Acked Read 8 Done Done Sent false
35999 9983 Acked Read 10 Done Done Sent false
36000 9984 Acked Read 2 Done Done Sent false
36001 9985 Acked Read 8 Done Done Sent false
36002 9986 Acked Read 7 Done Done Sent false
36003 9987 Acked Flush 0 Done Done Sent false
36004 9988 Acked Read 3 Done Done Sent false
36005 9989 Acked Flush 0 Done Done Sent false
36006 9990 Acked Write 1 Done Done Sent false
36007 9991 Acked Read 8 Done Done Sent false
36008 9992 Acked Read 4 Done Done Sent false
36009 9993 Acked Read 3 Done Done Sent false
36010 9994 Acked Read 5 Done Done Sent false
36011 9995 Acked Read 4 Done Done Sent false
36012 9996 Acked Read 7 Done Done Sent false
36013 9997 Acked Write 6 Done Done Sent false
36014 9998 Acked Read 7 Done Done Sent false
36015 9999 Acked Read 3 Done Done Sent false
36016 10000 Acked Write 7 Done Done Sent false
36017 10001 Acked Write 1 Done Done Sent false
36018 10002 Acked Read 10 Done Done Sent false
36019 10003 Acked Read 7 Done Done Sent false
36020 10004 Acked Write 2 Done Done Sent false
36021 10005 Acked Read 10 Done Done Sent false
36022 10006 Acked Write 2 Done Done Sent false
36023 10007 Acked Write 10 Done Done Sent false
36024 10008 Acked Read 6 Done Done Sent false
36025 10009 Acked Read 9 Done Done Sent false
36026 10010 Acked Write 4 Done Done Sent false
36027 10011 Acked Write 2 Done Done Sent false
36028 10012 Acked Read 10 Done Done Sent false
36029 10013 Acked Read 3 Done Done Sent false
36030 10014 Acked Read 1 Done Done Sent false
36031 10015 Acked Read 9 Done Done Sent false
36032 10016 Acked Write 6 Done Done Sent false
36033 10017 Acked Write 4 Done Done Sent false
36034 10018 Acked Read 3 Done Done Sent false
36035 10019 Acked Write 4 Done Done Sent false
36036 10020 Acked Write 7 Done Done Sent false
36037 10021 Acked Read 6 Done Done Sent false
36038 10022 Acked Write 6 Done Done Sent false
36039 10023 Acked Write 1 Done Done Sent false
36040 10024 Acked Read 8 Done Done Sent false
36041 10025 Acked Write 1 Done Done Sent false
36042 10026 Acked Read 2 Done Done Sent false
36043 10027 Acked Write 1 Done Done Sent false
36044 10028 Acked Read 6 Done Done Sent false
36045 10029 Acked Read 7 Done Done Sent false
36046 10030 Acked Read 4 Done Done Sent false
36047 10031 Acked Read 9 Done Done Sent false
36048 10032 Acked Write 3 Done Done Sent false
36049 10033 Acked Read 1 Done Done Sent false
36050 10034 Acked Read 3 Done Done Sent false
36051 10035 Acked Read 9 Done Done Sent false
36052 10036 Acked Flush 0 Done Done Sent false
36053 10037 Acked Read 5 Done Done Sent false
36054 10038 Acked Write 6 Done Done Sent false
36055 10039 Acked Read 10 Done Done Sent false
36056 10040 Acked Write 1 Done Done Sent false
36057 10041 Acked Write 2 Done Done Sent false
36058 10042 Acked Read 2 Done Done Sent false
36059 10043 Acked Read 7 Done Done Sent false
36060 10044 Acked Write 2 Done Done Sent false
36061 10045 Acked Read 9 Done Done Sent false
36062 10046 Acked Read 7 Done Done Sent false
36063 10047 Acked Write 2 Done Done Sent false
36064 10048 Acked Read 1 Done Done Sent false
36065 10049 Acked Read 5 Done Done Sent false
36066 10050 Acked Read 7 Done Done Sent false
36067 10051 Acked Write 7 Done Done Sent false
36068 10052 Acked Flush 0 Done Done Sent false
36069 10053 Acked Write 10 Done Done Sent false
36070 10054 Acked Write 10 Done Done Sent false
36071 10055 Acked Write 3 Done Done Sent false
36072 10056 Acked Flush 0 Done Done Sent false
36073 STATES DS:0 DS:1 DS:2 TOTAL
36074 Sent 0 0 302 302
36075 Done 302 302 0 604
36076 Skipped 0 0 0 0
36077 Error 0 0 0 0
36078 Last Flush: 10056 10056 9754
36079 Downstairs last five completed: 9754 9753 9752 9751 9750
36080 Upstairs last five completed: 10056 10055 10054 10053 10052
36081 CLIENT: Up:0 ds:302 act:2
360822025-01-10T16:42:52.871ZINFOcrucible: connecting to 127.0.0.1:8830 = io task client = 2 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
360832025-01-10T16:42:52.871ZWARNcrucible: ds_connection connect to 127.0.0.1:8830 failure: Os { code: 146, kind: ConnectionRefused, message: "Connection refused" } = io task client = 2 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
360842025-01-10T16:42:52.871ZWARNcrucible: client task is sending Done(ConnectionFailed(Os { code: 146, kind: ConnectionRefused, message: "Connection refused" })) = io task client = 2 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
360852025-01-10T16:42:52.871ZWARNcrucible: downstairs task for 2 stopped due to ConnectionFailed(Os { code: 146, kind: ConnectionRefused, message: "Connection refused" }) session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
360862025-01-10T16:42:52.871ZINFOcrucible: client task is exiting = io task client = 2 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
36087 ----------------------------------------------------------------
36088 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:302
36089 States: Active Active Offline
36090 JOBID ACK TYPE BKS/EXT DS:0 DS:1 DS:2 REPLAY
36091 9755 Acked Read 6 Done Done Sent false
36092 9756 Acked Read 1 Done Done Sent false
36093 9757 Acked Write 1 Done Done Sent false
36094 9758 Acked Read 7 Done Done Sent false
36095 9759 Acked Read 9 Done Done Sent false
36096 9760 Acked Read 3 Done Done Sent false
36097 9761 Acked Write 10 Done Done Sent false
36098 9762 Acked Write 2 Done Done Sent false
36099 9763 Acked Write 8 Done Done Sent false
36100 9764 Acked Write 4 Done Done Sent false
36101 9765 Acked Write 2 Done Done Sent false
36102 9766 Acked Flush 0 Done Done Sent false
36103 9767 Acked Write 2 Done Done Sent false
36104 9768 Acked Write 8 Done Done Sent false
36105 9769 Acked Read 10 Done Done Sent false
36106 9770 Acked Write 3 Done Done Sent false
36107 9771 Acked Read 4 Done Done Sent false
36108 9772 Acked Read 7 Done Done Sent false
36109 9773 Acked Write 4 Done Done Sent false
36110 9774 Acked Flush 0 Done Done Sent false
36111 9775 Acked Write 8 Done Done Sent false
36112 9776 Acked Read 6 Done Done Sent false
36113 9777 Acked Read 6 Done Done Sent false
36114 9778 Acked Read 7 Done Done Sent false
36115 9779 Acked Flush 0 Done Done Sent false
36116 9780 Acked Read 6 Done Done Sent false
36117 9781 Acked Write 6 Done Done Sent false
36118 9782 Acked Write 7 Done Done Sent false
36119 9783 Acked Read 5 Done Done Sent false
36120 9784 Acked Write 1 Done Done Sent false
36121 9785 Acked Write 10 Done Done Sent false
36122 9786 Acked Flush 0 Done Done Sent false
36123 9787 Acked Read 8 Done Done Sent false
36124 9788 Acked Read 9 Done Done Sent false
36125 9789 Acked Read 6 Done Done Sent false
36126 9790 Acked Read 3 Done Done Sent false
36127 9791 Acked Read 9 Done Done Sent false
36128 9792 Acked Flush 0 Done Done Sent false
36129 9793 Acked Read 7 Done Done Sent false
36130 9794 Acked Read 5 Done Done Sent false
36131 9795 Acked Write 6 Done Done Sent false
36132 9796 Acked Write 9 Done Done Sent false
36133 9797 Acked Write 6 Done Done Sent false
36134 9798 Acked Read 3 Done Done Sent false
36135 9799 Acked Read 5 Done Done Sent false
36136 9800 Acked Read 10 Done Done Sent false
36137 9801 Acked Read 9 Done Done Sent false
36138 9802 Acked Read 10 Done Done Sent false
36139 9803 Acked Read 3 Done Done Sent false
36140 9804 Acked Flush 0 Done Done Sent false
36141 9805 Acked Read 2 Done Done Sent false
36142 9806 Acked Read 7 Done Done Sent false
36143 9807 Acked Write 9 Done Done Sent false
36144 9808 Acked Write 4 Done Done Sent false
36145 9809 Acked Read 5 Done Done Sent false
36146 9810 Acked Read 9 Done Done Sent false
36147 9811 Acked Read 9 Done Done Sent false
36148 9812 Acked Read 6 Done Done Sent false
36149 9813 Acked Read 9 Done Done Sent false
36150 9814 Acked Read 5 Done Done Sent false
36151 9815 Acked Read 9 Done Done Sent false
36152 9816 Acked Read 6 Done Done Sent false
36153 9817 Acked Read 9 Done Done Sent false
36154 9818 Acked Read 2 Done Done Sent false
36155 9819 Acked Read 5 Done Done Sent false
36156 9820 Acked Read 9 Done Done Sent false
36157 9821 Acked Read 8 Done Done Sent false
36158 9822 Acked Read 5 Done Done Sent false
36159 9823 Acked Read 1 Done Done Sent false
36160 9824 Acked Read 8 Done Done Sent false
36161 9825 Acked Read 5 Done Done Sent false
36162 9826 Acked Write 4 Done Done Sent false
36163 9827 Acked Write 2 Done Done Sent false
36164 9828 Acked Read 5 Done Done Sent false
36165 9829 Acked Write 3 Done Done Sent false
36166 9830 Acked Read 9 Done Done Sent false
36167 9831 Acked Write 3 Done Done Sent false
36168 9832 Acked Read 2 Done Done Sent false
36169 9833 Acked Read 9 Done Done Sent false
36170 9834 Acked Read 3 Done Done Sent false
36171 9835 Acked Read 9 Done Done Sent false
36172 9836 Acked Read 3 Done Done Sent false
36173 9837 Acked Flush 0 Done Done Sent false
36174 9838 Acked Write 1 Done Done Sent false
36175 9839 Acked Read 8 Done Done Sent false
36176 9840 Acked Read 9 Done Done Sent false
36177 9841 Acked Read 7 Done Done Sent false
36178 9842 Acked Write 4 Done Done Sent false
36179 9843 Acked Read 1 Done Done Sent false
36180 9844 Acked Read 4 Done Done Sent false
36181 9845 Acked Write 3 Done Done Sent false
36182 9846 Acked Write 8 Done Done Sent false
36183 9847 Acked Write 2 Done Done Sent false
36184 9848 Acked Read 6 Done Done Sent false
36185 9849 Acked Flush 0 Done Done Sent false
36186 9850 Acked Write 2 Done Done Sent false
36187 9851 Acked Read 5 Done Done Sent false
36188 9852 Acked Read 7 Done Done Sent false
36189 9853 Acked Read 9 Done Done Sent false
36190 9854 Acked Read 4 Done Done Sent false
36191 9855 Acked Write 5 Done Done Sent false
36192 9856 Acked Write 8 Done Done Sent false
36193 9857 Acked Write 3 Done Done Sent false
36194 9858 Acked Read 3 Done Done Sent false
36195 9859 Acked Read 3 Done Done Sent false
36196 9860 Acked Write 9 Done Done Sent false
36197 9861 Acked Write 3 Done Done Sent false
36198 9862 Acked Write 4 Done Done Sent false
36199 9863 Acked Write 2 Done Done Sent false
36200 9864 Acked Read 1 Done Done Sent false
36201 9865 Acked Write 3 Done Done Sent false
36202 9866 Acked Read 8 Done Done Sent false
36203 9867 Acked Read 9 Done Done Sent false
36204 9868 Acked Write 4 Done Done Sent false
36205 9869 Acked Write 10 Done Done Sent false
36206 9870 Acked Write 3 Done Done Sent false
36207 9871 Acked Write 5 Done Done Sent false
36208 9872 Acked Read 7 Done Done Sent false
36209 9873 Acked Write 3 Done Done Sent false
36210 9874 Acked Read 5 Done Done Sent false
36211 9875 Acked Read 6 Done Done Sent false
36212 9876 Acked Write 4 Done Done Sent false
36213 9877 Acked Read 10 Done Done Sent false
36214 9878 Acked Write 2 Done Done Sent false
36215 9879 Acked Write 1 Done Done Sent false
36216 9880 Acked Write 3 Done Done Sent false
36217 9881 Acked Read 8 Done Done Sent false
36218 9882 Acked Write 7 Done Done Sent false
36219 9883 Acked Write 5 Done Done Sent false
36220 9884 Acked Write 10 Done Done Sent false
36221 9885 Acked Read 9 Done Done Sent false
36222 9886 Acked Write 8 Done Done Sent false
36223 9887 Acked Read 1 Done Done Sent false
36224 9888 Acked Write 4 Done Done Sent false
36225 9889 Acked Write 2 Done Done Sent false
36226 9890 Acked Read 9 Done Done Sent false
36227 9891 Acked Write 2 Done Done Sent false
36228 9892 Acked Read 9 Done Done Sent false
36229 9893 Acked Read 7 Done Done Sent false
36230 9894 Acked Write 8 Done Done Sent false
36231 9895 Acked Read 6 Done Done Sent false
36232 9896 Acked Read 2 Done Done Sent false
36233 9897 Acked Read 4 Done Done Sent false
36234 9898 Acked Read 8 Done Done Sent false
36235 9899 Acked Read 3 Done Done Sent false
36236 9900 Acked Read 6 Done Done Sent false
36237 9901 Acked Read 7 Done Done Sent false
36238 9902 Acked Write 9 Done Done Sent false
36239 9903 Acked Read 8 Done Done Sent false
36240 9904 Acked Read 8 Done Done Sent false
36241 9905 Acked Read 6 Done Done Sent false
36242 9906 Acked Write 2 Done Done Sent false
36243 9907 Acked Write 4 Done Done Sent false
36244 9908 Acked Write 8 Done Done Sent false
36245 9909 Acked Write 3 Done Done Sent false
36246 9910 Acked Write 10 Done Done Sent false
36247 9911 Acked Flush 0 Done Done Sent false
36248 9912 Acked Write 5 Done Done Sent false
36249 9913 Acked Flush 0 Done Done Sent false
36250 9914 Acked Write 6 Done Done Sent false
36251 9915 Acked Read 10 Done Done Sent false
36252 9916 Acked Read 6 Done Done Sent false
36253 9917 Acked Write 10 Done Done Sent false
36254 9918 Acked Read 7 Done Done Sent false
36255 9919 Acked Read 6 Done Done Sent false
36256 9920 Acked Read 10 Done Done Sent false
36257 9921 Acked Write 7 Done Done Sent false
36258 9922 Acked Read 2 Done Done Sent false
36259 9923 Acked Read 4 Done Done Sent false
36260 9924 Acked Read 6 Done Done Sent false
36261 9925 Acked Write 1 Done Done Sent false
36262 9926 Acked Read 4 Done Done Sent false
36263 9927 Acked Write 6 Done Done Sent false
36264 9928 Acked Write 1 Done Done Sent false
36265 9929 Acked Read 3 Done Done Sent false
36266 9930 Acked Read 5 Done Done Sent false
36267 9931 Acked Read 6 Done Done Sent false
36268 9932 Acked Write 6 Done Done Sent false
36269 9933 Acked Read 8 Done Done Sent false
36270 9934 Acked Flush 0 Done Done Sent false
36271 9935 Acked Read 8 Done Done Sent false
36272 9936 Acked Read 6 Done Done Sent false
36273 9937 Acked Read 8 Done Done Sent false
36274 9938 Acked Read 4 Done Done Sent false
36275 9939 Acked Write 6 Done Done Sent false
36276 9940 Acked Read 10 Done Done Sent false
36277 9941 Acked Read 2 Done Done Sent false
36278 9942 Acked Flush 0 Done Done Sent false
36279 9943 Acked Write 3 Done Done Sent false
36280 9944 Acked Read 3 Done Done Sent false
36281 9945 Acked Write 7 Done Done Sent false
36282 9946 Acked Write 3 Done Done Sent false
36283 9947 Acked Read 3 Done Done Sent false
36284 9948 Acked Read 6 Done Done Sent false
36285 9949 Acked Read 9 Done Done Sent false
36286 9950 Acked Read 8 Done Done Sent false
36287 9951 Acked Write 8 Done Done Sent false
36288 9952 Acked Write 7 Done Done Sent false
36289 9953 Acked Write 2 Done Done Sent false
36290 9954 Acked Read 5 Done Done Sent false
36291 9955 Acked Read 3 Done Done Sent false
36292 9956 Acked Write 4 Done Done Sent false
36293 9957 Acked Read 6 Done Done Sent false
36294 9958 Acked Write 2 Done Done Sent false
36295 9959 Acked Read 4 Done Done Sent false
36296 9960 Acked Read 10 Done Done Sent false
36297 9961 Acked Flush 0 Done Done Sent false
36298 9962 Acked Read 3 Done Done Sent false
36299 9963 Acked Write 5 Done Done Sent false
36300 9964 Acked Write 7 Done Done Sent false
36301 9965 Acked Write 10 Done Done Sent false
36302 9966 Acked Write 8 Done Done Sent false
36303 9967 Acked Write 8 Done Done Sent false
36304 9968 Acked Read 8 Done Done Sent false
36305 9969 Acked Write 2 Done Done Sent false
36306 9970 Acked Write 6 Done Done Sent false
36307 9971 Acked Read 10 Done Done Sent false
36308 9972 Acked Read 6 Done Done Sent false
36309 9973 Acked Write 5 Done Done Sent false
36310 9974 Acked Read 9 Done Done Sent false
36311 9975 Acked Read 9 Done Done Sent false
36312 9976 Acked Write 5 Done Done Sent false
36313 9977 Acked Write 10 Done Done Sent false
36314 9978 Acked Read 3 Done Done Sent false
36315 9979 Acked Read 9 Done Done Sent false
36316 9980 Acked Write 5 Done Done Sent false
36317 9981 Acked Read 3 Done Done Sent false
36318 9982 Acked Read 8 Done Done Sent false
36319 9983 Acked Read 10 Done Done Sent false
36320 9984 Acked Read 2 Done Done Sent false
36321 9985 Acked Read 8 Done Done Sent false
36322 9986 Acked Read 7 Done Done Sent false
36323 9987 Acked Flush 0 Done Done Sent false
36324 9988 Acked Read 3 Done Done Sent false
36325 9989 Acked Flush 0 Done Done Sent false
36326 9990 Acked Write 1 Done Done Sent false
36327 9991 Acked Read 8 Done Done Sent false
36328 9992 Acked Read 4 Done Done Sent false
36329 9993 Acked Read 3 Done Done Sent false
36330 9994 Acked Read 5 Done Done Sent false
36331 9995 Acked Read 4 Done Done Sent false
36332 9996 Acked Read 7 Done Done Sent false
36333 9997 Acked Write 6 Done Done Sent false
36334 9998 Acked Read 7 Done Done Sent false
36335 9999 Acked Read 3 Done Done Sent false
36336 10000 Acked Write 7 Done Done Sent false
36337 10001 Acked Write 1 Done Done Sent false
36338 10002 Acked Read 10 Done Done Sent false
36339 10003 Acked Read 7 Done Done Sent false
36340 10004 Acked Write 2 Done Done Sent false
36341 10005 Acked Read 10 Done Done Sent false
36342 10006 Acked Write 2 Done Done Sent false
36343 10007 Acked Write 10 Done Done Sent false
36344 10008 Acked Read 6 Done Done Sent false
36345 10009 Acked Read 9 Done Done Sent false
36346 10010 Acked Write 4 Done Done Sent false
36347 10011 Acked Write 2 Done Done Sent false
36348 10012 Acked Read 10 Done Done Sent false
36349 10013 Acked Read 3 Done Done Sent false
36350 10014 Acked Read 1 Done Done Sent false
36351 10015 Acked Read 9 Done Done Sent false
36352 10016 Acked Write 6 Done Done Sent false
36353 10017 Acked Write 4 Done Done Sent false
36354 10018 Acked Read 3 Done Done Sent false
36355 10019 Acked Write 4 Done Done Sent false
36356 10020 Acked Write 7 Done Done Sent false
36357 10021 Acked Read 6 Done Done Sent false
36358 10022 Acked Write 6 Done Done Sent false
36359 10023 Acked Write 1 Done Done Sent false
36360 10024 Acked Read 8 Done Done Sent false
36361 10025 Acked Write 1 Done Done Sent false
36362 10026 Acked Read 2 Done Done Sent false
36363 10027 Acked Write 1 Done Done Sent false
36364 10028 Acked Read 6 Done Done Sent false
36365 10029 Acked Read 7 Done Done Sent false
36366 10030 Acked Read 4 Done Done Sent false
36367 10031 Acked Read 9 Done Done Sent false
36368 10032 Acked Write 3 Done Done Sent false
36369 10033 Acked Read 1 Done Done Sent false
36370 10034 Acked Read 3 Done Done Sent false
36371 10035 Acked Read 9 Done Done Sent false
36372 10036 Acked Flush 0 Done Done Sent false
36373 10037 Acked Read 5 Done Done Sent false
36374 10038 Acked Write 6 Done Done Sent false
36375 10039 Acked Read 10 Done Done Sent false
36376 10040 Acked Write 1 Done Done Sent false
36377 10041 Acked Write 2 Done Done Sent false
36378 10042 Acked Read 2 Done Done Sent false
36379 10043 Acked Read 7 Done Done Sent false
36380 10044 Acked Write 2 Done Done Sent false
36381 10045 Acked Read 9 Done Done Sent false
36382 10046 Acked Read 7 Done Done Sent false
36383 10047 Acked Write 2 Done Done Sent false
36384 10048 Acked Read 1 Done Done Sent false
36385 10049 Acked Read 5 Done Done Sent false
36386 10050 Acked Read 7 Done Done Sent false
36387 10051 Acked Write 7 Done Done Sent false
36388 10052 Acked Flush 0 Done Done Sent false
36389 10053 Acked Write 10 Done Done Sent false
36390 10054 Acked Write 10 Done Done Sent false
36391 10055 Acked Write 3 Done Done Sent false
36392 10056 Acked Flush 0 Done Done Sent false
36393 STATES DS:0 DS:1 DS:2 TOTAL
36394 Sent 0 0 302 302
36395 Done 302 302 0 604
36396 Skipped 0 0 0 0
36397 Error 0 0 0 0
36398 Last Flush: 10056 10056 9754
36399 Downstairs last five completed: 9754 9753 9752 9751 9750
36400 Upstairs last five completed: 10056 10055 10054 10053 10052
36401 CLIENT: Up:0 ds:302 act:2
36402 [8830] got start action
36403 [8830] I am going to restart
36404 Starting downstairs at port 8830
36405 Make output file at "/tmp/dsc/downstairs-8830.txt"
36406 [8830][2] reports Starting
36407 Downstairs /var/tmp/dsc/region/8830 port 8830 PID:Some(1232)
36408 [8830][2] reports Running
36409 ----------------------------------------------------------------
36410 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:302
36411 States: Active Active Offline
36412 JOBID ACK TYPE BKS/EXT DS:0 DS:1 DS:2 REPLAY
36413 9755 Acked Read 6 Done Done Sent false
36414 9756 Acked Read 1 Done Done Sent false
36415 9757 Acked Write 1 Done Done Sent false
36416 9758 Acked Read 7 Done Done Sent false
36417 9759 Acked Read 9 Done Done Sent false
36418 9760 Acked Read 3 Done Done Sent false
36419 9761 Acked Write 10 Done Done Sent false
36420 9762 Acked Write 2 Done Done Sent false
36421 9763 Acked Write 8 Done Done Sent false
36422 9764 Acked Write 4 Done Done Sent false
36423 9765 Acked Write 2 Done Done Sent false
36424 9766 Acked Flush 0 Done Done Sent false
36425 9767 Acked Write 2 Done Done Sent false
36426 9768 Acked Write 8 Done Done Sent false
36427 9769 Acked Read 10 Done Done Sent false
36428 9770 Acked Write 3 Done Done Sent false
36429 9771 Acked Read 4 Done Done Sent false
36430 9772 Acked Read 7 Done Done Sent false
36431 9773 Acked Write 4 Done Done Sent false
36432 9774 Acked Flush 0 Done Done Sent false
36433 9775 Acked Write 8 Done Done Sent false
36434 9776 Acked Read 6 Done Done Sent false
36435 9777 Acked Read 6 Done Done Sent false
36436 9778 Acked Read 7 Done Done Sent false
36437 9779 Acked Flush 0 Done Done Sent false
36438 9780 Acked Read 6 Done Done Sent false
36439 9781 Acked Write 6 Done Done Sent false
36440 9782 Acked Write 7 Done Done Sent false
36441 9783 Acked Read 5 Done Done Sent false
36442 9784 Acked Write 1 Done Done Sent false
36443 9785 Acked Write 10 Done Done Sent false
36444 9786 Acked Flush 0 Done Done Sent false
36445 9787 Acked Read 8 Done Done Sent false
36446 9788 Acked Read 9 Done Done Sent false
36447 9789 Acked Read 6 Done Done Sent false
36448 9790 Acked Read 3 Done Done Sent false
36449 9791 Acked Read 9 Done Done Sent false
36450 9792 Acked Flush 0 Done Done Sent false
36451 9793 Acked Read 7 Done Done Sent false
36452 9794 Acked Read 5 Done Done Sent false
36453 9795 Acked Write 6 Done Done Sent false
36454 9796 Acked Write 9 Done Done Sent false
36455 9797 Acked Write 6 Done Done Sent false
36456 9798 Acked Read 3 Done Done Sent false
36457 9799 Acked Read 5 Done Done Sent false
36458 9800 Acked Read 10 Done Done Sent false
36459 9801 Acked Read 9 Done Done Sent false
36460 9802 Acked Read 10 Done Done Sent false
36461 9803 Acked Read 3 Done Done Sent false
36462 9804 Acked Flush 0 Done Done Sent false
36463 9805 Acked Read 2 Done Done Sent false
36464 9806 Acked Read 7 Done Done Sent false
36465 9807 Acked Write 9 Done Done Sent false
36466 9808 Acked Write 4 Done Done Sent false
36467 9809 Acked Read 5 Done Done Sent false
36468 9810 Acked Read 9 Done Done Sent false
36469 9811 Acked Read 9 Done Done Sent false
36470 9812 Acked Read 6 Done Done Sent false
36471 9813 Acked Read 9 Done Done Sent false
36472 9814 Acked Read 5 Done Done Sent false
36473 9815 Acked Read 9 Done Done Sent false
36474 9816 Acked Read 6 Done Done Sent false
36475 9817 Acked Read 9 Done Done Sent false
36476 9818 Acked Read 2 Done Done Sent false
36477 9819 Acked Read 5 Done Done Sent false
36478 9820 Acked Read 9 Done Done Sent false
36479 9821 Acked Read 8 Done Done Sent false
36480 9822 Acked Read 5 Done Done Sent false
36481 9823 Acked Read 1 Done Done Sent false
36482 9824 Acked Read 8 Done Done Sent false
36483 9825 Acked Read 5 Done Done Sent false
36484 9826 Acked Write 4 Done Done Sent false
36485 9827 Acked Write 2 Done Done Sent false
36486 9828 Acked Read 5 Done Done Sent false
36487 9829 Acked Write 3 Done Done Sent false
36488 9830 Acked Read 9 Done Done Sent false
36489 9831 Acked Write 3 Done Done Sent false
36490 9832 Acked Read 2 Done Done Sent false
36491 9833 Acked Read 9 Done Done Sent false
36492 9834 Acked Read 3 Done Done Sent false
36493 9835 Acked Read 9 Done Done Sent false
36494 9836 Acked Read 3 Done Done Sent false
36495 9837 Acked Flush 0 Done Done Sent false
36496 9838 Acked Write 1 Done Done Sent false
36497 9839 Acked Read 8 Done Done Sent false
36498 9840 Acked Read 9 Done Done Sent false
36499 9841 Acked Read 7 Done Done Sent false
36500 9842 Acked Write 4 Done Done Sent false
36501 9843 Acked Read 1 Done Done Sent false
36502 9844 Acked Read 4 Done Done Sent false
36503 9845 Acked Write 3 Done Done Sent false
36504 9846 Acked Write 8 Done Done Sent false
36505 9847 Acked Write 2 Done Done Sent false
36506 9848 Acked Read 6 Done Done Sent false
36507 9849 Acked Flush 0 Done Done Sent false
36508 9850 Acked Write 2 Done Done Sent false
36509 9851 Acked Read 5 Done Done Sent false
36510 9852 Acked Read 7 Done Done Sent false
36511 9853 Acked Read 9 Done Done Sent false
36512 9854 Acked Read 4 Done Done Sent false
36513 9855 Acked Write 5 Done Done Sent false
36514 9856 Acked Write 8 Done Done Sent false
36515 9857 Acked Write 3 Done Done Sent false
36516 9858 Acked Read 3 Done Done Sent false
36517 9859 Acked Read 3 Done Done Sent false
36518 9860 Acked Write 9 Done Done Sent false
36519 9861 Acked Write 3 Done Done Sent false
36520 9862 Acked Write 4 Done Done Sent false
36521 9863 Acked Write 2 Done Done Sent false
36522 9864 Acked Read 1 Done Done Sent false
36523 9865 Acked Write 3 Done Done Sent false
36524 9866 Acked Read 8 Done Done Sent false
36525 9867 Acked Read 9 Done Done Sent false
36526 9868 Acked Write 4 Done Done Sent false
36527 9869 Acked Write 10 Done Done Sent false
36528 9870 Acked Write 3 Done Done Sent false
36529 9871 Acked Write 5 Done Done Sent false
36530 9872 Acked Read 7 Done Done Sent false
36531 9873 Acked Write 3 Done Done Sent false
36532 9874 Acked Read 5 Done Done Sent false
36533 9875 Acked Read 6 Done Done Sent false
36534 9876 Acked Write 4 Done Done Sent false
36535 9877 Acked Read 10 Done Done Sent false
36536 9878 Acked Write 2 Done Done Sent false
36537 9879 Acked Write 1 Done Done Sent false
36538 9880 Acked Write 3 Done Done Sent false
36539 9881 Acked Read 8 Done Done Sent false
36540 9882 Acked Write 7 Done Done Sent false
36541 9883 Acked Write 5 Done Done Sent false
36542 9884 Acked Write 10 Done Done Sent false
36543 9885 Acked Read 9 Done Done Sent false
36544 9886 Acked Write 8 Done Done Sent false
36545 9887 Acked Read 1 Done Done Sent false
36546 9888 Acked Write 4 Done Done Sent false
36547 9889 Acked Write 2 Done Done Sent false
36548 9890 Acked Read 9 Done Done Sent false
36549 9891 Acked Write 2 Done Done Sent false
36550 9892 Acked Read 9 Done Done Sent false
36551 9893 Acked Read 7 Done Done Sent false
36552 9894 Acked Write 8 Done Done Sent false
36553 9895 Acked Read 6 Done Done Sent false
36554 9896 Acked Read 2 Done Done Sent false
36555 9897 Acked Read 4 Done Done Sent false
36556 9898 Acked Read 8 Done Done Sent false
36557 9899 Acked Read 3 Done Done Sent false
36558 9900 Acked Read 6 Done Done Sent false
36559 9901 Acked Read 7 Done Done Sent false
36560 9902 Acked Write 9 Done Done Sent false
36561 9903 Acked Read 8 Done Done Sent false
36562 9904 Acked Read 8 Done Done Sent false
36563 9905 Acked Read 6 Done Done Sent false
36564 9906 Acked Write 2 Done Done Sent false
36565 9907 Acked Write 4 Done Done Sent false
36566 9908 Acked Write 8 Done Done Sent false
36567 9909 Acked Write 3 Done Done Sent false
36568 9910 Acked Write 10 Done Done Sent false
36569 9911 Acked Flush 0 Done Done Sent false
36570 9912 Acked Write 5 Done Done Sent false
36571 9913 Acked Flush 0 Done Done Sent false
36572 9914 Acked Write 6 Done Done Sent false
36573 9915 Acked Read 10 Done Done Sent false
36574 9916 Acked Read 6 Done Done Sent false
36575 9917 Acked Write 10 Done Done Sent false
36576 9918 Acked Read 7 Done Done Sent false
36577 9919 Acked Read 6 Done Done Sent false
36578 9920 Acked Read 10 Done Done Sent false
36579 9921 Acked Write 7 Done Done Sent false
36580 9922 Acked Read 2 Done Done Sent false
36581 9923 Acked Read 4 Done Done Sent false
36582 9924 Acked Read 6 Done Done Sent false
36583 9925 Acked Write 1 Done Done Sent false
36584 9926 Acked Read 4 Done Done Sent false
36585 9927 Acked Write 6 Done Done Sent false
36586 9928 Acked Write 1 Done Done Sent false
36587 9929 Acked Read 3 Done Done Sent false
36588 9930 Acked Read 5 Done Done Sent false
36589 9931 Acked Read 6 Done Done Sent false
36590 9932 Acked Write 6 Done Done Sent false
36591 9933 Acked Read 8 Done Done Sent false
36592 9934 Acked Flush 0 Done Done Sent false
36593 9935 Acked Read 8 Done Done Sent false
36594 9936 Acked Read 6 Done Done Sent false
36595 9937 Acked Read 8 Done Done Sent false
36596 9938 Acked Read 4 Done Done Sent false
36597 9939 Acked Write 6 Done Done Sent false
36598 9940 Acked Read 10 Done Done Sent false
36599 9941 Acked Read 2 Done Done Sent false
36600 9942 Acked Flush 0 Done Done Sent false
36601 9943 Acked Write 3 Done Done Sent false
36602 9944 Acked Read 3 Done Done Sent false
36603 9945 Acked Write 7 Done Done Sent false
36604 9946 Acked Write 3 Done Done Sent false
36605 9947 Acked Read 3 Done Done Sent false
36606 9948 Acked Read 6 Done Done Sent false
36607 9949 Acked Read 9 Done Done Sent false
36608 9950 Acked Read 8 Done Done Sent false
36609 9951 Acked Write 8 Done Done Sent false
36610 9952 Acked Write 7 Done Done Sent false
36611 9953 Acked Write 2 Done Done Sent false
36612 9954 Acked Read 5 Done Done Sent false
36613 9955 Acked Read 3 Done Done Sent false
36614 9956 Acked Write 4 Done Done Sent false
36615 9957 Acked Read 6 Done Done Sent false
36616 9958 Acked Write 2 Done Done Sent false
36617 9959 Acked Read 4 Done Done Sent false
36618 9960 Acked Read 10 Done Done Sent false
36619 9961 Acked Flush 0 Done Done Sent false
36620 9962 Acked Read 3 Done Done Sent false
36621 9963 Acked Write 5 Done Done Sent false
36622 9964 Acked Write 7 Done Done Sent false
36623 9965 Acked Write 10 Done Done Sent false
36624 9966 Acked Write 8 Done Done Sent false
36625 9967 Acked Write 8 Done Done Sent false
36626 9968 Acked Read 8 Done Done Sent false
36627 9969 Acked Write 2 Done Done Sent false
36628 9970 Acked Write 6 Done Done Sent false
36629 9971 Acked Read 10 Done Done Sent false
36630 9972 Acked Read 6 Done Done Sent false
36631 9973 Acked Write 5 Done Done Sent false
36632 9974 Acked Read 9 Done Done Sent false
36633 9975 Acked Read 9 Done Done Sent false
36634 9976 Acked Write 5 Done Done Sent false
36635 9977 Acked Write 10 Done Done Sent false
36636 9978 Acked Read 3 Done Done Sent false
36637 9979 Acked Read 9 Done Done Sent false
36638 9980 Acked Write 5 Done Done Sent false
36639 9981 Acked Read 3 Done Done Sent false
36640 9982 Acked Read 8 Done Done Sent false
36641 9983 Acked Read 10 Done Done Sent false
36642 9984 Acked Read 2 Done Done Sent false
36643 9985 Acked Read 8 Done Done Sent false
36644 9986 Acked Read 7 Done Done Sent false
36645 9987 Acked Flush 0 Done Done Sent false
36646 9988 Acked Read 3 Done Done Sent false
36647 9989 Acked Flush 0 Done Done Sent false
36648 9990 Acked Write 1 Done Done Sent false
36649 9991 Acked Read 8 Done Done Sent false
36650 9992 Acked Read 4 Done Done Sent false
36651 9993 Acked Read 3 Done Done Sent false
36652 9994 Acked Read 5 Done Done Sent false
36653 9995 Acked Read 4 Done Done Sent false
36654 9996 Acked Read 7 Done Done Sent false
36655 9997 Acked Write 6 Done Done Sent false
36656 9998 Acked Read 7 Done Done Sent false
36657 9999 Acked Read 3 Done Done Sent false
36658 10000 Acked Write 7 Done Done Sent false
36659 10001 Acked Write 1 Done Done Sent false
36660 10002 Acked Read 10 Done Done Sent false
36661 10003 Acked Read 7 Done Done Sent false
36662 10004 Acked Write 2 Done Done Sent false
36663 10005 Acked Read 10 Done Done Sent false
36664 10006 Acked Write 2 Done Done Sent false
36665 10007 Acked Write 10 Done Done Sent false
36666 10008 Acked Read 6 Done Done Sent false
36667 10009 Acked Read 9 Done Done Sent false
36668 10010 Acked Write 4 Done Done Sent false
36669 10011 Acked Write 2 Done Done Sent false
36670 10012 Acked Read 10 Done Done Sent false
36671 10013 Acked Read 3 Done Done Sent false
36672 10014 Acked Read 1 Done Done Sent false
36673 10015 Acked Read 9 Done Done Sent false
36674 10016 Acked Write 6 Done Done Sent false
36675 10017 Acked Write 4 Done Done Sent false
36676 10018 Acked Read 3 Done Done Sent false
36677 10019 Acked Write 4 Done Done Sent false
36678 10020 Acked Write 7 Done Done Sent false
36679 10021 Acked Read 6 Done Done Sent false
36680 10022 Acked Write 6 Done Done Sent false
36681 10023 Acked Write 1 Done Done Sent false
36682 10024 Acked Read 8 Done Done Sent false
36683 10025 Acked Write 1 Done Done Sent false
36684 10026 Acked Read 2 Done Done Sent false
36685 10027 Acked Write 1 Done Done Sent false
36686 10028 Acked Read 6 Done Done Sent false
36687 10029 Acked Read 7 Done Done Sent false
36688 10030 Acked Read 4 Done Done Sent false
36689 10031 Acked Read 9 Done Done Sent false
36690 10032 Acked Write 3 Done Done Sent false
36691 10033 Acked Read 1 Done Done Sent false
36692 10034 Acked Read 3 Done Done Sent false
36693 10035 Acked Read 9 Done Done Sent false
36694 10036 Acked Flush 0 Done Done Sent false
36695 10037 Acked Read 5 Done Done Sent false
36696 10038 Acked Write 6 Done Done Sent false
36697 10039 Acked Read 10 Done Done Sent false
36698 10040 Acked Write 1 Done Done Sent false
36699 10041 Acked Write 2 Done Done Sent false
36700 10042 Acked Read 2 Done Done Sent false
36701 10043 Acked Read 7 Done Done Sent false
36702 10044 Acked Write 2 Done Done Sent false
36703 10045 Acked Read 9 Done Done Sent false
36704 10046 Acked Read 7 Done Done Sent false
36705 10047 Acked Write 2 Done Done Sent false
36706 10048 Acked Read 1 Done Done Sent false
36707 10049 Acked Read 5 Done Done Sent false
36708 10050 Acked Read 7 Done Done Sent false
36709 10051 Acked Write 7 Done Done Sent false
36710 10052 Acked Flush 0 Done Done Sent false
36711 10053 Acked Write 10 Done Done Sent false
36712 10054 Acked Write 10 Done Done Sent false
36713 10055 Acked Write 3 Done Done Sent false
36714 10056 Acked Flush 0 Done Done Sent false
36715 STATES DS:0 DS:1 DS:2 TOTAL
36716 Sent 0 0 302 302
36717 Done 302 302 0 604
36718 Skipped 0 0 0 0
36719 Error 0 0 0 0
36720 Last Flush: 10056 10056 9754
36721 Downstairs last five completed: 9754 9753 9752 9751 9750
36722 Upstairs last five completed: 10056 10055 10054 10053 10052
36723 CLIENT: Up:0 ds:302 act:2
367242025-01-10T16:43:02.873ZINFOcrucible: connecting to 127.0.0.1:8830 = io task client = 2 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
367252025-01-10T16:43:02.873ZINFOcrucible: ds_connection connected from Ok(127.0.0.1:55215) = io task client = 2 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
367262025-01-10T16:43:02.874ZWARNcrucible: version negotiation from state Offline = downstairs client = 2 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
367272025-01-10T16:43:02.875ZINFOcrucible: downstairs client at Some(127.0.0.1:8830) has region UUID 12345678-0000-0000-0000-000000008830 = downstairs client = 2 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
367282025-01-10T16:43:02.875ZINFOcrucible: Returning UUID:12345678-0000-0000-0000-000000008830 matches = downstairs client = 2 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
367292025-01-10T16:43:02.875ZINFOcrucible: send last flush ID to this DS: 9754 = downstairs client = 2 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
367302025-01-10T16:43:02.875ZINFOcrucible: Replied this last flush ID: 9754 = downstairs client = 2 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
367312025-01-10T16:43:02.875ZINFOcrucible: ds_transition from Offline to Active = downstairs client = 2 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
367322025-01-10T16:43:02.875ZINFOcrucible: [2] Transition from Offline to Active = downstairs client = 2 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
367332025-01-10T16:43:02.875ZINFOcrucible: [2] client re-new 302 jobs since flush 9754 = downstairs session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
367342025-01-10T16:43:02.875ZINFOcrucible: [2] Replayed 302 jobs since flush: 9754 = downstairs session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
36735 ----------------------------------------------------------------
36736 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:0
36737 Downstairs last five completed: 10056 10055 10054 10053 10052
36738 Upstairs last five completed: 10056 10055 10054 10053 10052
36739 CLIENT: Up:0 ds:0 act:3
36740 Replay: All jobs finished
36741 Main task has work to do, go find it
36742 got dsc Stop(2)
36743 stop 2
36744 [8830] Got stop action so:false kr:false
36745 Jan 10 16:43:03.139 INFO request completed, latency_us: 363, response_code: 204, uri: /stop/cid/2, method: POST, req_id: 8b56a3a4-51ec-4578-8b09-99ea05f0068d, remote_addr: 127.0.0.1:55917, local_addr: 127.0.0.1:9998
367462025-01-10T16:43:03.140ZWARNcrucible: downstairs disconnected = io task client = 2 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
36747 Jan 10 16:43:03.140 INFO request completed, latency_us: 181, response_code: 200, uri: /state/cid/2, method: GET, req_id: abbfa490-9fc9-42b0-baf0-d22e9391e8cb, remote_addr: 127.0.0.1:55917, local_addr: 127.0.0.1:9998
367482025-01-10T16:43:03.140ZWARNcrucible: client task is sending Done(Finished) = io task client = 2 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
367492025-01-10T16:43:03.140ZWARNcrucible: downstairs task for 2 stopped due to Finished session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
367502025-01-10T16:43:03.140ZINFOcrucible: ds_transition from Active to Offline = downstairs client = 2 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
367512025-01-10T16:43:03.140ZINFOcrucible: [2] Transition from Active to Offline = downstairs client = 2 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
367522025-01-10T16:43:03.140ZINFOcrucible: client task is exiting = io task client = 2 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
36753 [8830] Exited with: ExitStatus(unix_wait_status(9))
36754 [8830][2] reports Exit
36755 Jan 10 16:43:07.143 INFO request completed, latency_us: 314, response_code: 200, uri: /state/cid/2, method: GET, req_id: d08fa4d2-2497-4fed-9950-3b981e441f41, remote_addr: 127.0.0.1:55917, local_addr: 127.0.0.1:9998
36756 001/300 Read block 2796 len 40960
36757 002/300 Write block 4042 len 16384 data: 3 4 4 4
36758 003/300 Write block 4607 len 40960 data: 2 2 3 3 4 5 4 4 3 4
36759 004/300 Read block 1771 len 8192
36760 005/300 Write block 374 len 16384 data: 5 5 5 4
36761 006/300 Write block 2430 len 8192 data: 5 5
36762 007/300 Flush
36763 008/300 Write block 2310 len 32768 data: 7 7 7 9 9 9 5 4
36764 009/300 Write block 3578 len 28672 data: 5 5 5 5 6 5 5
36765 010/300 Read block 102 len 8192
36766 011/300 Flush
36767 012/300 Write block 2908 len 20480 data: 6 6 7 8 8
36768 013/300 Read block 3269 len 20480
36769 014/300 Write block 1324 len 32768 data: 6 5 5 6 6 6 7 9
36770 015/300 Write block 833 len 40960 data: 7 6 6 7 9 10 9 10 10 10
36771 016/300 Read block 4401 len 12288
36772 017/300 Read block 3861 len 12288
36773 018/300 Write block 2954 len 12288 data: 10 10 8
36774 019/300 Read block 2556 len 4096
36775 020/300 Write block 3717 len 8192 data: 7 6
36776 021/300 Read block 4522 len 32768
36777 022/300 Read block 1430 len 4096
36778 023/300 Read block 2760 len 8192
36779 024/300 Flush
36780 025/300 Read block 1732 len 32768
36781 026/300 Write block 893 len 16384 data: 6 5 6 7
36782 027/300 Read block 3209 len 24576
36783 028/300 Read block 4804 len 32768
36784 029/300 Read block 4780 len 36864
36785 030/300 Read block 160 len 40960
36786 031/300 Read block 2278 len 28672
36787 032/300 Read block 1587 len 40960
36788 033/300 Write block 4971 len 36864 data: 5 4 4 5 6 7 8 7 8
36789 034/300 Write block 3974 len 40960 data: 7 7 7 8 8 5 6 5 6 8
36790 035/300 Read block 2526 len 40960
36791 036/300 Read block 3402 len 4096
36792 037/300 Read block 313 len 28672
36793 038/300 Write block 121 len 40960 data: 9 9 10 8 8 8 7 7 5 5
36794 039/300 Write block 3458 len 32768 data: 9 7 7 6 7 7 7 7
36795 040/300 Write block 4458 len 32768 data: 4 5 4 5 3 5 3 3
36796 041/300 Flush
36797 042/300 Write block 1322 len 24576 data: 6 7 7 6 6 7
36798 043/300 Write block 1147 len 20480 data: 5 6 5 6 7
36799 044/300 Write block 4282 len 36864 data: 9 8 6 5 5 6 5 4 5
36800 045/300 Write block 1163 len 24576 data: 10 8 7 8 4 4
36801 046/300 Read block 2416 len 16384
36802 047/300 Read block 3252 len 8192
36803 048/300 Read block 3617 len 32768
36804 049/300 Read block 1279 len 32768
36805 050/300 Write block 1903 len 4096 data: 6
36806 051/300 Read block 2484 len 32768
36807 052/300 Flush
36808 053/300 Write block 3213 len 32768 data: 10 10 8 8 7 6 6 7
36809 054/300 Read block 3403 len 28672
36810 055/300 Write block 1590 len 20480 data: 6 7 6 4 5
36811 056/300 Write block 900 len 16384 data: 3 3 3 4
36812 057/300 Write block 4049 len 24576 data: 5 5 5 4 5 4
36813 058/300 Read block 2278 len 24576
36814 059/300 Flush
36815 060/300 Write block 3368 len 12288 data: 6 6 8
36816 061/300 Write block 3103 len 36864 data: 5 6 5 6 5 4 6 5 5
36817 062/300 Read block 1186 len 40960
36818 063/300 Read block 3985 len 12288
36819 064/300 Read block 3087 len 4096
36820 065/300 Read block 4784 len 32768
36821 066/300 Write block 1233 len 36864 data: 5 4 4 5 5 4 4 3 3
36822 067/300 Flush
36823 068/300 Read block 560 len 24576
36824 069/300 Write block 3238 len 16384 data: 4 5 5 5
36825 070/300 Read block 158 len 32768
36826 071/300 Read block 513 len 16384
36827 072/300 Write block 4965 len 16384 data: 7 7 5 5
36828 073/300 Read block 1237 len 40960
36829 074/300 Write block 4573 len 36864 data: 5 5 6 9 9 8 8 7 7
36830 075/300 Read block 255 len 4096
36831 076/300 Write block 1142 len 12288 data: 7 6 6
36832 077/300 Write block 712 len 40960 data: 4 5 5 4 5 6 6 5 7 8
36833 078/300 Read block 203 len 36864
36834 079/300 Write block 4826 len 8192 data: 7 7
36835 080/300 Read block 3869 len 32768
36836 081/300 Read block 3207 len 40960
36837 082/300 Read block 886 len 28672
36838 083/300 Read block 2247 len 40960
36839 084/300 Read block 3063 len 24576
36840 085/300 Write block 457 len 24576 data: 6 5 5 4 3 4
36841 086/300 Read block 4363 len 4096
36842 087/300 Write block 3906 len 8192 data: 7 6
36843 088/300 Write block 345 len 8192 data: 6 6
36844 089/300 Write block 2783 len 28672 data: 8 7 8 8 7 8 7
36845 090/300 Write block 4796 len 40960 data: 4 4 4 4 7 7 8 8 8 8
36846 091/300 Read block 1740 len 4096
36847 092/300 Read block 159 len 28672
36848 093/300 Read block 4084 len 4096
36849 094/300 Read block 939 len 40960
36850 095/300 Write block 3327 len 40960 data: 5 6 6 5 5 5 8 8 8 8
36851 096/300 Read block 2166 len 4096
36852 097/300 Flush
36853 098/300 Read block 4924 len 16384
36854 099/300 Flush
36855 100/300 Write block 3136 len 16384 data: 7 8 7 6
36856 101/300 Write block 2920 len 4096 data: 7
36857 102/300 Write block 1895 len 12288 data: 5 6 3
36858 103/300 Read block 3724 len 40960
36859 104/300 Read block 1093 len 4096
36860 105/300 Read block 2108 len 16384
36861 106/300 Read block 1372 len 20480
36862 107/300 Read block 1386 len 24576
36863 108/300 Read block 3354 len 40960
36864 109/300 Write block 3709 len 4096 data: 9
36865 110/300 Write block 170 len 12288 data: 3 3 5
36866 111/300 Flush
36867 112/300 Write block 3447 len 36864 data: 3 4 5 5 4 5 5 5 6
36868 113/300 Write block 3065 len 4096 data: 7
36869 114/300 Read block 2210 len 24576
36870 115/300 Read block 3386 len 12288
36871 116/300 Read block 2953 len 4096
36872 117/300 Read block 3023 len 36864
36873 118/300 Read block 353 len 4096
36874 119/300 Read block 4809 len 12288
36875 120/300 Flush
36876 121/300 Read block 2372 len 4096
36877 122/300 Write block 1561 len 12288 data: 6 7 6
36878 123/300 Write block 1231 len 36864 data: 9 6 6 5 5 6 6 5 5
36879 124/300 Write block 1935 len 16384 data: 8 7 8 6
36880 125/300 Read block 3861 len 40960
36881 126/300 Write block 1029 len 4096 data: 11
36882 127/300 Read block 2687 len 32768
36883 128/300 Write block 83 len 16384 data: 6 5 4 4
36884 129/300 Read block 2644 len 16384
36885 130/300 Flush
36886 131/300 Read block 2438 len 36864
36887 132/300 Write block 4559 len 32768 data: 6 6 9 7 6 7 8 7
36888 133/300 Read block 1556 len 4096
36889 134/300 Write block 2284 len 12288 data: 5 5 7
36890 135/300 Write block 1564 len 28672 data: 7 6 5 3 3 3 3
36891 136/300 Read block 7 len 20480
36892 137/300 Read block 4553 len 4096
36893 138/300 Write block 1135 len 32768 data: 4 5 5 6 7 7 7 8
36894 139/300 Read block 4952 len 36864
36895 140/300 Read block 2548 len 20480
36896 141/300 Read block 335 len 28672
36897 142/300 Read block 4084 len 16384
36898 143/300 Read block 251 len 32768
36899 144/300 Read block 2747 len 12288
36900 145/300 Read block 4848 len 40960
36901 146/300 Read block 2352 len 36864
36902 147/300 Read block 1212 len 8192
36903 148/300 Read block 3288 len 40960
36904 149/300 Read block 178 len 24576
36905 150/300 Read block 2430 len 36864
36906 151/300 Read block 4180 len 20480
36907 152/300 Read block 2838 len 20480
36908 153/300 Read block 876 len 24576
36909 154/300 Read block 3824 len 16384
36910 155/300 Write block 4838 len 24576 data: 7 7 6 7 6 5
36911 156/300 Read block 1889 len 28672
36912 157/300 Flush
36913 158/300 Write block 3965 len 40960 data: 7 7 6 6 5 4 5 4 4 8
36914 159/300 Write block 3365 len 12288 data: 3 4 4
36915 160/300 Write block 194 len 36864 data: 8 8 9 9 8 8 8 7 8
36916 161/300 Write block 1817 len 20480 data: 5 5 4 9 9
36917 162/300 Write block 412 len 12288 data: 7 7 5
36918 163/300 Read block 1159 len 20480
36919 164/300 Read block 4280 len 16384
36920 165/300 Read block 4457 len 8192
36921 166/300 Read block 1580 len 12288
36922 167/300 Read block 2846 len 32768
36923 168/300 Read block 2328 len 32768
36924 169/300 Write block 3845 len 40960 data: 8 9 8 7 5 6 5 6 8 9
36925 170/300 Read block 4337 len 12288
36926 171/300 Write block 1950 len 4096 data: 9
36927 172/300 Read block 617 len 36864
36928 173/300 Write block 4198 len 8192 data: 7 8
36929 174/300 Write block 1960 len 28672 data: 4 5 4 6 5 4 3
36930 175/300 Read block 1894 len 32768
36931 176/300 Read block 1371 len 28672
36932 177/300 Read block 2658 len 16384
36933 178/300 Read block 4385 len 36864
36934 179/300 Read block 4476 len 20480
36935 180/300 Write block 145 len 40960 data: 6 6 5 4 5 4 5 6 6 4
36936 181/300 Read block 4839 len 24576
36937 182/300 Write block 1897 len 36864 data: 4 5 5 6 7 6 7 6 6
36938 183/300 Write block 3378 len 24576 data: 5 7 8 9 11 12
36939 184/300 Flush
36940 185/300 Write block 3825 len 4096 data: 5
36941 186/300 Write block 4580 len 32768 data: 8 8 6 7 6 5 4 5
36942 187/300 Read block 812 len 32768
36943 188/300 Write block 2604 len 16384 data: 6 6 5 6
36944 189/300 Read block 4724 len 8192
36945 190/300 Write block 2902 len 28672 data: 12 8 8 6 5 5 7
36946 191/300 Read block 949 len 20480
36947 192/300 Write block 3790 len 8192 data: 7 8
36948 193/300 Read block 621 len 28672
36949 194/300 Write block 4457 len 32768 data: 4 5 6 5 6 4 6 4
36950 195/300 Write block 3393 len 40960 data: 7 7 6 5 5 8 8 10 8 6
36951 196/300 Write block 1866 len 32768 data: 7 6 6 5 5 3 4 5
36952 197/300 Write block 303 len 4096 data: 5
36953 198/300 Flush
36954 199/300 Read block 4123 len 20480
36955 200/300 Write block 3223 len 36864 data: 2 5 5 6 4 4 4 4 3
36956 201/300 Write block 1846 len 16384 data: 2 2 2 4
36957 202/300 Write block 2096 len 16384 data: 6 7 5 5
36958 203/300 Write block 2922 len 36864 data: 7 9 8 6 5 4 4 5 5
36959 204/300 Read block 746 len 24576
36960 205/300 Read block 2473 len 24576
36961 206/300 Write block 303 len 8192 data: 6 6
36962 207/300 Write block 1174 len 32768 data: 7 8 10 9 8 9 11 10
36963 208/300 Read block 398 len 4096
36964 209/300 Read block 2695 len 28672
36965 210/300 Write block 3478 len 40960 data: 5 5 4 4 5 4 5 5 5 6
36966 211/300 Write block 1049 len 40960 data: 2 2 4 4 4 4 5 5 5 7
36967 212/300 Write block 3731 len 20480 data: 7 8 9 9 8
36968 213/300 Flush
36969 214/300 Write block 259 len 32768 data: 5 6 6 6 6 8 9 10
36970 215/300 Read block 952 len 16384
36971 216/300 Write block 3255 len 36864 data: 7 6 5 7 7 7 4 5 7
36972 217/300 Read block 2892 len 8192
36973 218/300 Read block 4286 len 12288
36974 219/300 Read block 2923 len 28672
36975 220/300 Read block 1864 len 20480
36976 221/300 Write block 1249 len 28672 data: 2 3 3 5 5 6 7
36977 222/300 Read block 2089 len 28672
36978 223/300 Read block 2367 len 24576
36979 224/300 Read block 3107 len 16384
36980 225/300 Write block 4112 len 16384 data: 6 6 6 7
36981 226/300 Write block 933 len 12288 data: 7 9 7
36982 227/300 Read block 1812 len 12288
36983 228/300 Read block 4317 len 16384
36984 229/300 Read block 816 len 16384
36985 230/300 Write block 3431 len 8192 data: 4 4
36986 231/300 Write block 405 len 20480 data: 8 7 7 7 8
36987 232/300 Read block 2099 len 36864
36988 233/300 Write block 4199 len 4096 data: 9
36989 234/300 Write block 1349 len 4096 data: 6
36990 235/300 Read block 2582 len 24576
36991 236/300 Read block 1979 len 4096
36992 237/300 Write block 1357 len 12288 data: 5 6 6
36993 238/300 Write block 2509 len 16384 data: 9 9 9 8
36994 239/300 Read block 3347 len 36864
36995 240/300 Write block 952 len 12288 data: 7 7 7
36996 241/300 Write block 2756 len 32768 data: 5 7 7 7 9 7 6 5
36997 242/300 Read block 2407 len 8192
36998 243/300 Write block 2950 len 16384 data: 8 9 10 9
36999 244/300 Write block 1816 len 28672 data: 4 6 6 5 10 10 8
37000 245/300 Flush
37001 246/300 Write block 4219 len 20480 data: 6 5 6 5 2
37002 247/300 Read block 2085 len 4096
37003 248/300 Write block 2250 len 8192 data: 11 10
37004 249/300 Write block 3068 len 28672 data: 7 6 5 4 5 4 5
37005 250/300 Read block 425 len 20480
37006 251/300 Flush
37007 252/300 Read block 4090 len 20480
37008 253/300 Read block 3387 len 16384
37009 254/300 Write block 4812 len 16384 data: 6 6 6 5
37010 255/300 Write block 392 len 20480 data: 7 5 6 6 4
37011 256/300 Write block 1925 len 28672 data: 8 8 8 9 10 11 9
37012 257/300 Read block 4104 len 28672
37013 258/300 Read block 1206 len 4096
37014 259/300 Read block 286 len 20480
37015 260/300 Write block 235 len 12288 data: 9 8 7
37016 261/300 Write block 61 len 16384 data: 3 3 3 4
37017 262/300 Write block 2220 len 20480 data: 6 6 7 7 8
37018 263/300 Read block 4881 len 8192
37019 264/300 Write block 3601 len 36864 data: 6 4 4 4 7 8 8 7 6
37020 265/300 Read block 2602 len 20480
37021 266/300 Read block 1084 len 4096
37022 267/300 Write block 2170 len 36864 data: 9 9 9 8 6 5 5 2 2
37023 268/300 Read block 2786 len 16384
37024 269/300 Read block 2745 len 32768
37025 270/300 Write block 2855 len 24576 data: 5 4 5 5 4 4
37026 271/300 Write block 4372 len 20480 data: 10 11 14 12 13
37027 272/300 Write block 967 len 16384 data: 5 5 4 6
37028 273/300 Flush
37029 274/300 Write block 4977 len 12288 data: 9 8 9
37030 275/300 Read block 4947 len 36864
37031 276/300 Read block 2457 len 12288
37032 277/300 Read block 4730 len 8192
37033 278/300 Read block 768 len 36864
37034 279/300 Read block 1193 len 36864
37035 280/300 Read block 4522 len 28672
37036 281/300 Read block 64 len 24576
37037 282/300 Read block 2530 len 32768
37038 283/300 Read block 425 len 20480
37039 284/300 Read block 1787 len 40960
37040 285/300 Write block 1969 len 20480 data: 5 5 5 5 6
37041 286/300 Read block 1196 len 20480
37042 287/300 Read block 2663 len 40960
37043 288/300 Read block 1767 len 40960
37044 289/300 Write block 2034 len 16384 data: 8 9 8 11
37045 290/300 Write block 1429 len 24576 data: 7 6 6 5 5 5
37046 291/300 Read block 1326 len 36864
37047 292/300 Read block 4147 len 12288
37048 293/300 Read block 4482 len 24576
37049 294/300 Read block 149 len 4096
37050 295/300 Flush
37051 296/300 Write block 4149 len 24576 data: 12 12 11 8 8 9
37052 297/300 Read block 872 len 24576
37053 298/300 Read block 4388 len 28672
37054 299/300 Write block 2527 len 16384 data: 8 7 2 3
37055 300/300 Write block 4187 len 8192 data: 7 6
37056 301/300 Write block 1390 len 20480 data: 10 11 9 10 9
37057 Main task has work to do, go find it
37058 got dsc Start(2)
37059 start 2
37060 Jan 10 16:43:07.384 INFO request completed, latency_us: 283, response_code: 204, uri: /start/cid/2, method: POST, req_id: ac1937a6-ff45-4836-8842-33c1c81c806a, remote_addr: 127.0.0.1:55917, local_addr: 127.0.0.1:9998
37061 Replay: started 2, returned:Ok(())
37062 ----------------------------------------------------------------
37063 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:301
37064 States: Active Active Offline
37065 JOBID ACK TYPE BKS/EXT DS:0 DS:1 DS:2 REPLAY
37066 10057 Acked Read 10 Done Done Sent false
37067 10058 Acked Write 4 Done Done Sent false
37068 10059 Acked Write 10 Done Done Sent false
37069 10060 Acked Read 2 Done Done Sent false
37070 10061 Acked Write 4 Done Done Sent false
37071 10062 Acked Write 2 Done Done Sent false
37072 10063 Acked Flush 0 Done Done Sent false
37073 10064 Acked Write 8 Done Done Sent false
37074 10065 Acked Write 7 Done Done Sent false
37075 10066 Acked Read 2 Done Done Sent false
37076 10067 Acked Flush 0 Done Done Sent false
37077 10068 Acked Write 5 Done Done Sent false
37078 10069 Acked Read 5 Done Done Sent false
37079 10070 Acked Write 8 Done Done Sent false
37080 10071 Acked Write 10 Done Done Sent false
37081 10072 Acked Read 3 Done Done Sent false
37082 10073 Acked Read 3 Done Done Sent false
37083 10074 Acked Write 3 Done Done Sent false
37084 10075 Acked Read 1 Done Done Sent false
37085 10076 Acked Write 2 Done Done Sent false
37086 10077 Acked Read 8 Done Done Sent false
37087 10078 Acked Read 1 Done Done Sent false
37088 10079 Acked Read 2 Done Done Sent false
37089 10080 Acked Flush 0 Done Done Sent false
37090 10081 Acked Read 8 Done Done Sent false
37091 10082 Acked Write 4 Done Done Sent false
37092 10083 Acked Read 6 Done Done Sent false
37093 10084 Acked Read 8 Done Done Sent false
37094 10085 Acked Read 9 Done Done Sent false
37095 10086 Acked Read 10 Done Done Sent false
37096 10087 Acked Read 7 Done Done Sent false
37097 10088 Acked Read 10 Done Done Sent false
37098 10089 Acked Write 9 Done Done Sent false
37099 10090 Acked Write 10 Done Done Sent false
37100 10091 Acked Read 10 Done Done Sent false
37101 10092 Acked Read 1 Done Done Sent false
37102 10093 Acked Read 7 Done Done Sent false
37103 10094 Acked Write 10 Done Done Sent false
37104 10095 Acked Write 8 Done Done Sent false
37105 10096 Acked Write 8 Done Done Sent false
37106 10097 Acked Flush 0 Done Done Sent false
37107 10098 Acked Write 6 Done Done Sent false
37108 10099 Acked Write 5 Done Done Sent false
37109 10100 Acked Write 9 Done Done Sent false
37110 10101 Acked Write 6 Done Done Sent false
37111 10102 Acked Read 4 Done Done Sent false
37112 10103 Acked Read 2 Done Done Sent false
37113 10104 Acked Read 8 Done Done Sent false
37114 10105 Acked Read 8 Done Done Sent false
37115 10106 Acked Write 1 Done Done Sent false
37116 10107 Acked Read 8 Done Done Sent false
37117 10108 Acked Flush 0 Done Done Sent false
37118 10109 Acked Write 8 Done Done Sent false
37119 10110 Acked Read 7 Done Done Sent false
37120 10111 Acked Write 5 Done Done Sent false
37121 10112 Acked Write 4 Done Done Sent false
37122 10113 Acked Write 6 Done Done Sent false
37123 10114 Acked Read 6 Done Done Sent false
37124 10115 Acked Flush 0 Done Done Sent false
37125 10116 Acked Write 3 Done Done Sent false
37126 10117 Acked Write 9 Done Done Sent false
37127 10118 Acked Read 10 Done Done Sent false
37128 10119 Acked Read 3 Done Done Sent false
37129 10120 Acked Read 1 Done Done Sent false
37130 10121 Acked Read 8 Done Done Sent false
37131 10122 Acked Write 9 Done Done Sent false
37132 10123 Acked Flush 0 Done Done Sent false
37133 10124 Acked Read 6 Done Done Sent false
37134 10125 Acked Write 4 Done Done Sent false
37135 10126 Acked Read 8 Done Done Sent false
37136 10127 Acked Read 4 Done Done Sent false
37137 10128 Acked Write 4 Done Done Sent false
37138 10129 Acked Read 10 Done Done Sent false
37139 10130 Acked Write 9 Done Done Sent false
37140 10131 Acked Read 1 Done Done Sent false
37141 10132 Acked Write 3 Done Done Sent false
37142 10133 Acked Write 10 Done Done Sent false
37143 10134 Acked Read 9 Done Done Sent false
37144 10135 Acked Write 2 Done Done Sent false
37145 10136 Acked Read 8 Done Done Sent false
37146 10137 Acked Read 10 Done Done Sent false
37147 10138 Acked Read 7 Done Done Sent false
37148 10139 Acked Read 10 Done Done Sent false
37149 10140 Acked Read 6 Done Done Sent false
37150 10141 Acked Write 6 Done Done Sent false
37151 10142 Acked Read 1 Done Done Sent false
37152 10143 Acked Write 2 Done Done Sent false
37153 10144 Acked Write 2 Done Done Sent false
37154 10145 Acked Write 7 Done Done Sent false
37155 10146 Acked Write 10 Done Done Sent false
37156 10147 Acked Read 1 Done Done Sent false
37157 10148 Acked Read 7 Done Done Sent false
37158 10149 Acked Read 1 Done Done Sent false
37159 10150 Acked Read 10 Done Done Sent false
37160 10151 Acked Write 10 Done Done Sent false
37161 10152 Acked Read 1 Done Done Sent false
37162 10153 Acked Flush 0 Done Done Sent false
37163 10154 Acked Read 4 Done Done Sent false
37164 10155 Acked Flush 0 Done Done Sent false
37165 10156 Acked Write 4 Done Done Sent false
37166 10157 Acked Write 1 Done Done Sent false
37167 10158 Acked Write 3 Done Done Sent false
37168 10159 Acked Read 10 Done Done Sent false
37169 10160 Acked Read 1 Done Done Sent false
37170 10161 Acked Read 4 Done Done Sent false
37171 10162 Acked Read 5 Done Done Sent false
37172 10163 Acked Read 6 Done Done Sent false
37173 10164 Acked Read 10 Done Done Sent false
37174 10165 Acked Write 1 Done Done Sent false
37175 10166 Acked Write 3 Done Done Sent false
37176 10167 Acked Flush 0 Done Done Sent false
37177 10168 Acked Write 9 Done Done Sent false
37178 10169 Acked Write 1 Done Done Sent false
37179 10170 Acked Read 6 Done Done Sent false
37180 10171 Acked Read 3 Done Done Sent false
37181 10172 Acked Read 1 Done Done Sent false
37182 10173 Acked Read 9 Done Done Sent false
37183 10174 Acked Read 1 Done Done Sent false
37184 10175 Acked Read 3 Done Done Sent false
37185 10176 Acked Flush 0 Done Done Sent false
37186 10177 Acked Read 1 Done Done Sent false
37187 10178 Acked Write 3 Done Done Sent false
37188 10179 Acked Write 9 Done Done Sent false
37189 10180 Acked Write 4 Done Done Sent false
37190 10181 Acked Read 10 Done Done Sent false
37191 10182 Acked Write 1 Done Done Sent false
37192 10183 Acked Read 8 Done Done Sent false
37193 10184 Acked Write 4 Done Done Sent false
37194 10185 Acked Read 4 Done Done Sent false
37195 10186 Acked Flush 0 Done Done Sent false
37196 10187 Acked Read 9 Done Done Sent false
37197 10188 Acked Write 8 Done Done Sent false
37198 10189 Acked Read 1 Done Done Sent false
37199 10190 Acked Write 3 Done Done Sent false
37200 10191 Acked Write 7 Done Done Sent false
37201 10192 Acked Read 5 Done Done Sent false
37202 10193 Acked Read 1 Done Done Sent false
37203 10194 Acked Write 8 Done Done Sent false
37204 10195 Acked Read 9 Done Done Sent false
37205 10196 Acked Read 5 Done Done Sent false
37206 10197 Acked Read 7 Done Done Sent false
37207 10198 Acked Read 4 Done Done Sent false
37208 10199 Acked Read 8 Done Done Sent false
37209 10200 Acked Read 3 Done Done Sent false
37210 10201 Acked Read 10 Done Done Sent false
37211 10202 Acked Read 9 Done Done Sent false
37212 10203 Acked Read 2 Done Done Sent false
37213 10204 Acked Read 10 Done Done Sent false
37214 10205 Acked Read 6 Done Done Sent false
37215 10206 Acked Read 9 Done Done Sent false
37216 10207 Acked Read 5 Done Done Sent false
37217 10208 Acked Read 5 Done Done Sent false
37218 10209 Acked Read 6 Done Done Sent false
37219 10210 Acked Read 4 Done Done Sent false
37220 10211 Acked Write 6 Done Done Sent false
37221 10212 Acked Read 7 Done Done Sent false
37222 10213 Acked Flush 0 Done Done Sent false
37223 10214 Acked Write 10 Done Done Sent false
37224 10215 Acked Write 3 Done Done Sent false
37225 10216 Acked Write 9 Done Done Sent false
37226 10217 Acked Write 5 Done Done Sent false
37227 10218 Acked Write 3 Done Done Sent false
37228 10219 Acked Read 5 Done Done Sent false
37229 10220 Acked Read 4 Done Done Sent false
37230 10221 Acked Read 2 Done Done Sent false
37231 10222 Acked Read 3 Done Done Sent false
37232 10223 Acked Read 8 Done Done Sent false
37233 10224 Acked Read 8 Done Done Sent false
37234 10225 Acked Write 10 Done Done Sent false
37235 10226 Acked Read 3 Done Done Sent false
37236 10227 Acked Write 1 Done Done Sent false
37237 10228 Acked Read 9 Done Done Sent false
37238 10229 Acked Write 2 Done Done Sent false
37239 10230 Acked Write 7 Done Done Sent false
37240 10231 Acked Read 8 Done Done Sent false
37241 10232 Acked Read 7 Done Done Sent false
37242 10233 Acked Read 4 Done Done Sent false
37243 10234 Acked Read 9 Done Done Sent false
37244 10235 Acked Read 5 Done Done Sent false
37245 10236 Acked Write 10 Done Done Sent false
37246 10237 Acked Read 6 Done Done Sent false
37247 10238 Acked Write 9 Done Done Sent false
37248 10239 Acked Write 6 Done Done Sent false
37249 10240 Acked Flush 0 Done Done Sent false
37250 10241 Acked Write 1 Done Done Sent false
37251 10242 Acked Write 8 Done Done Sent false
37252 10243 Acked Read 8 Done Done Sent false
37253 10244 Acked Write 4 Done Done Sent false
37254 10245 Acked Read 2 Done Done Sent false
37255 10246 Acked Write 7 Done Done Sent false
37256 10247 Acked Read 5 Done Done Sent false
37257 10248 Acked Write 2 Done Done Sent false
37258 10249 Acked Read 7 Done Done Sent false
37259 10250 Acked Write 8 Done Done Sent false
37260 10251 Acked Write 10 Done Done Sent false
37261 10252 Acked Write 8 Done Done Sent false
37262 10253 Acked Write 1 Done Done Sent false
37263 10254 Acked Flush 0 Done Done Sent false
37264 10255 Acked Read 5 Done Done Sent false
37265 10256 Acked Write 9 Done Done Sent false
37266 10257 Acked Write 4 Done Done Sent false
37267 10258 Acked Write 4 Done Done Sent false
37268 10259 Acked Write 9 Done Done Sent false
37269 10260 Acked Read 6 Done Done Sent false
37270 10261 Acked Read 6 Done Done Sent false
37271 10262 Acked Write 2 Done Done Sent false
37272 10263 Acked Write 8 Done Done Sent false
37273 10264 Acked Read 1 Done Done Sent false
37274 10265 Acked Read 7 Done Done Sent false
37275 10266 Acked Write 10 Done Done Sent false
37276 10267 Acked Write 10 Done Done Sent false
37277 10268 Acked Write 5 Done Done Sent false
37278 10269 Acked Flush 0 Done Done Sent false
37279 10270 Acked Write 8 Done Done Sent false
37280 10271 Acked Read 4 Done Done Sent false
37281 10272 Acked Write 9 Done Done Sent false
37282 10273 Acked Read 2 Done Done Sent false
37283 10274 Acked Read 3 Done Done Sent false
37284 10275 Acked Read 7 Done Done Sent false
37285 10276 Acked Read 5 Done Done Sent false
37286 10277 Acked Write 7 Done Done Sent false
37287 10278 Acked Read 7 Done Done Sent false
37288 10279 Acked Read 6 Done Done Sent false
37289 10280 Acked Read 4 Done Done Sent false
37290 10281 Acked Write 4 Done Done Sent false
37291 10282 Acked Write 3 Done Done Sent false
37292 10283 Acked Read 3 Done Done Sent false
37293 10284 Acked Read 4 Done Done Sent false
37294 10285 Acked Read 4 Done Done Sent false
37295 10286 Acked Write 2 Done Done Sent false
37296 10287 Acked Write 5 Done Done Sent false
37297 10288 Acked Read 9 Done Done Sent false
37298 10289 Acked Write 1 Done Done Sent false
37299 10290 Acked Write 1 Done Done Sent false
37300 10291 Acked Read 6 Done Done Sent false
37301 10292 Acked Read 1 Done Done Sent false
37302 10293 Acked Write 3 Done Done Sent false
37303 10294 Acked Write 4 Done Done Sent false
37304 10295 Acked Read 9 Done Done Sent false
37305 10296 Acked Write 3 Done Done Sent false
37306 10297 Acked Write 8 Done Done Sent false
37307 10298 Acked Read 2 Done Done Sent false
37308 10299 Acked Write 4 Done Done Sent false
37309 10300 Acked Write 7 Done Done Sent false
37310 10301 Acked Flush 0 Done Done Sent false
37311 10302 Acked Write 5 Done Done Sent false
37312 10303 Acked Read 1 Done Done Sent false
37313 10304 Acked Write 2 Done Done Sent false
37314 10305 Acked Write 7 Done Done Sent false
37315 10306 Acked Read 5 Done Done Sent false
37316 10307 Acked Flush 0 Done Done Sent false
37317 10308 Acked Read 5 Done Done Sent false
37318 10309 Acked Read 4 Done Done Sent false
37319 10310 Acked Write 4 Done Done Sent false
37320 10311 Acked Write 5 Done Done Sent false
37321 10312 Acked Write 7 Done Done Sent false
37322 10313 Acked Read 7 Done Done Sent false
37323 10314 Acked Read 1 Done Done Sent false
37324 10315 Acked Read 5 Done Done Sent false
37325 10316 Acked Write 3 Done Done Sent false
37326 10317 Acked Write 4 Done Done Sent false
37327 10318 Acked Write 5 Done Done Sent false
37328 10319 Acked Read 2 Done Done Sent false
37329 10320 Acked Write 9 Done Done Sent false
37330 10321 Acked Read 5 Done Done Sent false
37331 10322 Acked Read 1 Done Done Sent false
37332 10323 Acked Write 9 Done Done Sent false
37333 10324 Acked Read 4 Done Done Sent false
37334 10325 Acked Read 8 Done Done Sent false
37335 10326 Acked Write 6 Done Done Sent false
37336 10327 Acked Write 5 Done Done Sent false
37337 10328 Acked Write 4 Done Done Sent false
37338 10329 Acked Flush 0 Done Done Sent false
37339 10330 Acked Write 3 Done Done Sent false
37340 10331 Acked Read 9 Done Done Sent false
37341 10332 Acked Read 3 Done Done Sent false
37342 10333 Acked Read 2 Done Done Sent false
37343 10334 Acked Read 9 Done Done Sent false
37344 10335 Acked Read 9 Done Done Sent false
37345 10336 Acked Read 7 Done Done Sent false
37346 10337 Acked Read 6 Done Done Sent false
37347 10338 Acked Read 8 Done Done Sent false
37348 10339 Acked Read 5 Done Done Sent false
37349 10340 Acked Read 10 Done Done Sent false
37350 10341 Acked Write 5 Done Done Sent false
37351 10342 Acked Read 5 Done Done Sent false
37352 10343 Acked Read 10 Done Done Sent false
37353 10344 Acked Read 10 Done Done Sent false
37354 10345 Acked Write 4 Done Done Sent false
37355 10346 Acked Write 6 Done Done Sent false
37356 10347 Acked Read 9 Done Done Sent false
37357 10348 Acked Read 3 Done Done Sent false
37358 10349 Acked Read 6 Done Done Sent false
37359 10350 Acked Read 1 Done Done Sent false
37360 10351 Acked Flush 0 Done Done Sent false
37361 10352 Acked Write 6 Done Done Sent false
37362 10353 Acked Read 6 Done Done Sent false
37363 10354 Acked Read 7 Done Done Sent false
37364 10355 Acked Write 4 Done Done Sent false
37365 10356 Acked Write 2 Done Done Sent false
37366 10357 Acked Write 5 Done Done Sent false
37367 STATES DS:0 DS:1 DS:2 TOTAL
37368 Sent 0 0 301 301
37369 Done 301 301 0 602
37370 Skipped 0 0 0 0
37371 Error 0 0 0 0
37372 Last Flush: 10351 10351 10056
37373 Downstairs last five completed: 10056 10055 10054 10053 10052
37374 Upstairs last five completed: 10357 10356 10355 10354 10353
37375 CLIENT: Up:0 ds:301 act:2
37376 [8830] got start action
37377 [8830] I am going to restart
37378 Starting downstairs at port 8830
37379 Make output file at "/tmp/dsc/downstairs-8830.txt"
37380 [8830][2] reports Starting
37381 Downstairs /var/tmp/dsc/region/8830 port 8830 PID:Some(1233)
37382 [8830][2] reports Running
37383 ----------------------------------------------------------------
37384 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:302
37385 States: Active Active Offline
37386 JOBID ACK TYPE BKS/EXT DS:0 DS:1 DS:2 REPLAY
37387 10057 Acked Read 10 Done Done Sent false
37388 10058 Acked Write 4 Done Done Sent false
37389 10059 Acked Write 10 Done Done Sent false
37390 10060 Acked Read 2 Done Done Sent false
37391 10061 Acked Write 4 Done Done Sent false
37392 10062 Acked Write 2 Done Done Sent false
37393 10063 Acked Flush 0 Done Done Sent false
37394 10064 Acked Write 8 Done Done Sent false
37395 10065 Acked Write 7 Done Done Sent false
37396 10066 Acked Read 2 Done Done Sent false
37397 10067 Acked Flush 0 Done Done Sent false
37398 10068 Acked Write 5 Done Done Sent false
37399 10069 Acked Read 5 Done Done Sent false
37400 10070 Acked Write 8 Done Done Sent false
37401 10071 Acked Write 10 Done Done Sent false
37402 10072 Acked Read 3 Done Done Sent false
37403 10073 Acked Read 3 Done Done Sent false
37404 10074 Acked Write 3 Done Done Sent false
37405 10075 Acked Read 1 Done Done Sent false
37406 10076 Acked Write 2 Done Done Sent false
37407 10077 Acked Read 8 Done Done Sent false
37408 10078 Acked Read 1 Done Done Sent false
37409 10079 Acked Read 2 Done Done Sent false
37410 10080 Acked Flush 0 Done Done Sent false
37411 10081 Acked Read 8 Done Done Sent false
37412 10082 Acked Write 4 Done Done Sent false
37413 10083 Acked Read 6 Done Done Sent false
37414 10084 Acked Read 8 Done Done Sent false
37415 10085 Acked Read 9 Done Done Sent false
37416 10086 Acked Read 10 Done Done Sent false
37417 10087 Acked Read 7 Done Done Sent false
37418 10088 Acked Read 10 Done Done Sent false
37419 10089 Acked Write 9 Done Done Sent false
37420 10090 Acked Write 10 Done Done Sent false
37421 10091 Acked Read 10 Done Done Sent false
37422 10092 Acked Read 1 Done Done Sent false
37423 10093 Acked Read 7 Done Done Sent false
37424 10094 Acked Write 10 Done Done Sent false
37425 10095 Acked Write 8 Done Done Sent false
37426 10096 Acked Write 8 Done Done Sent false
37427 10097 Acked Flush 0 Done Done Sent false
37428 10098 Acked Write 6 Done Done Sent false
37429 10099 Acked Write 5 Done Done Sent false
37430 10100 Acked Write 9 Done Done Sent false
37431 10101 Acked Write 6 Done Done Sent false
37432 10102 Acked Read 4 Done Done Sent false
37433 10103 Acked Read 2 Done Done Sent false
37434 10104 Acked Read 8 Done Done Sent false
37435 10105 Acked Read 8 Done Done Sent false
37436 10106 Acked Write 1 Done Done Sent false
37437 10107 Acked Read 8 Done Done Sent false
37438 10108 Acked Flush 0 Done Done Sent false
37439 10109 Acked Write 8 Done Done Sent false
37440 10110 Acked Read 7 Done Done Sent false
37441 10111 Acked Write 5 Done Done Sent false
37442 10112 Acked Write 4 Done Done Sent false
37443 10113 Acked Write 6 Done Done Sent false
37444 10114 Acked Read 6 Done Done Sent false
37445 10115 Acked Flush 0 Done Done Sent false
37446 10116 Acked Write 3 Done Done Sent false
37447 10117 Acked Write 9 Done Done Sent false
37448 10118 Acked Read 10 Done Done Sent false
37449 10119 Acked Read 3 Done Done Sent false
37450 10120 Acked Read 1 Done Done Sent false
37451 10121 Acked Read 8 Done Done Sent false
37452 10122 Acked Write 9 Done Done Sent false
37453 10123 Acked Flush 0 Done Done Sent false
37454 10124 Acked Read 6 Done Done Sent false
37455 10125 Acked Write 4 Done Done Sent false
37456 10126 Acked Read 8 Done Done Sent false
37457 10127 Acked Read 4 Done Done Sent false
37458 10128 Acked Write 4 Done Done Sent false
37459 10129 Acked Read 10 Done Done Sent false
37460 10130 Acked Write 9 Done Done Sent false
37461 10131 Acked Read 1 Done Done Sent false
37462 10132 Acked Write 3 Done Done Sent false
37463 10133 Acked Write 10 Done Done Sent false
37464 10134 Acked Read 9 Done Done Sent false
37465 10135 Acked Write 2 Done Done Sent false
37466 10136 Acked Read 8 Done Done Sent false
37467 10137 Acked Read 10 Done Done Sent false
37468 10138 Acked Read 7 Done Done Sent false
37469 10139 Acked Read 10 Done Done Sent false
37470 10140 Acked Read 6 Done Done Sent false
37471 10141 Acked Write 6 Done Done Sent false
37472 10142 Acked Read 1 Done Done Sent false
37473 10143 Acked Write 2 Done Done Sent false
37474 10144 Acked Write 2 Done Done Sent false
37475 10145 Acked Write 7 Done Done Sent false
37476 10146 Acked Write 10 Done Done Sent false
37477 10147 Acked Read 1 Done Done Sent false
37478 10148 Acked Read 7 Done Done Sent false
37479 10149 Acked Read 1 Done Done Sent false
37480 10150 Acked Read 10 Done Done Sent false
37481 10151 Acked Write 10 Done Done Sent false
37482 10152 Acked Read 1 Done Done Sent false
37483 10153 Acked Flush 0 Done Done Sent false
37484 10154 Acked Read 4 Done Done Sent false
37485 10155 Acked Flush 0 Done Done Sent false
37486 10156 Acked Write 4 Done Done Sent false
37487 10157 Acked Write 1 Done Done Sent false
37488 10158 Acked Write 3 Done Done Sent false
37489 10159 Acked Read 10 Done Done Sent false
37490 10160 Acked Read 1 Done Done Sent false
37491 10161 Acked Read 4 Done Done Sent false
37492 10162 Acked Read 5 Done Done Sent false
37493 10163 Acked Read 6 Done Done Sent false
37494 10164 Acked Read 10 Done Done Sent false
37495 10165 Acked Write 1 Done Done Sent false
37496 10166 Acked Write 3 Done Done Sent false
37497 10167 Acked Flush 0 Done Done Sent false
37498 10168 Acked Write 9 Done Done Sent false
37499 10169 Acked Write 1 Done Done Sent false
37500 10170 Acked Read 6 Done Done Sent false
37501 10171 Acked Read 3 Done Done Sent false
37502 10172 Acked Read 1 Done Done Sent false
37503 10173 Acked Read 9 Done Done Sent false
37504 10174 Acked Read 1 Done Done Sent false
37505 10175 Acked Read 3 Done Done Sent false
37506 10176 Acked Flush 0 Done Done Sent false
37507 10177 Acked Read 1 Done Done Sent false
37508 10178 Acked Write 3 Done Done Sent false
37509 10179 Acked Write 9 Done Done Sent false
37510 10180 Acked Write 4 Done Done Sent false
37511 10181 Acked Read 10 Done Done Sent false
37512 10182 Acked Write 1 Done Done Sent false
37513 10183 Acked Read 8 Done Done Sent false
37514 10184 Acked Write 4 Done Done Sent false
37515 10185 Acked Read 4 Done Done Sent false
37516 10186 Acked Flush 0 Done Done Sent false
37517 10187 Acked Read 9 Done Done Sent false
37518 10188 Acked Write 8 Done Done Sent false
37519 10189 Acked Read 1 Done Done Sent false
37520 10190 Acked Write 3 Done Done Sent false
37521 10191 Acked Write 7 Done Done Sent false
37522 10192 Acked Read 5 Done Done Sent false
37523 10193 Acked Read 1 Done Done Sent false
37524 10194 Acked Write 8 Done Done Sent false
37525 10195 Acked Read 9 Done Done Sent false
37526 10196 Acked Read 5 Done Done Sent false
37527 10197 Acked Read 7 Done Done Sent false
37528 10198 Acked Read 4 Done Done Sent false
37529 10199 Acked Read 8 Done Done Sent false
37530 10200 Acked Read 3 Done Done Sent false
37531 10201 Acked Read 10 Done Done Sent false
37532 10202 Acked Read 9 Done Done Sent false
37533 10203 Acked Read 2 Done Done Sent false
37534 10204 Acked Read 10 Done Done Sent false
37535 10205 Acked Read 6 Done Done Sent false
37536 10206 Acked Read 9 Done Done Sent false
37537 10207 Acked Read 5 Done Done Sent false
37538 10208 Acked Read 5 Done Done Sent false
37539 10209 Acked Read 6 Done Done Sent false
37540 10210 Acked Read 4 Done Done Sent false
37541 10211 Acked Write 6 Done Done Sent false
37542 10212 Acked Read 7 Done Done Sent false
37543 10213 Acked Flush 0 Done Done Sent false
37544 10214 Acked Write 10 Done Done Sent false
37545 10215 Acked Write 3 Done Done Sent false
37546 10216 Acked Write 9 Done Done Sent false
37547 10217 Acked Write 5 Done Done Sent false
37548 10218 Acked Write 3 Done Done Sent false
37549 10219 Acked Read 5 Done Done Sent false
37550 10220 Acked Read 4 Done Done Sent false
37551 10221 Acked Read 2 Done Done Sent false
37552 10222 Acked Read 3 Done Done Sent false
37553 10223 Acked Read 8 Done Done Sent false
37554 10224 Acked Read 8 Done Done Sent false
37555 10225 Acked Write 10 Done Done Sent false
37556 10226 Acked Read 3 Done Done Sent false
37557 10227 Acked Write 1 Done Done Sent false
37558 10228 Acked Read 9 Done Done Sent false
37559 10229 Acked Write 2 Done Done Sent false
37560 10230 Acked Write 7 Done Done Sent false
37561 10231 Acked Read 8 Done Done Sent false
37562 10232 Acked Read 7 Done Done Sent false
37563 10233 Acked Read 4 Done Done Sent false
37564 10234 Acked Read 9 Done Done Sent false
37565 10235 Acked Read 5 Done Done Sent false
37566 10236 Acked Write 10 Done Done Sent false
37567 10237 Acked Read 6 Done Done Sent false
37568 10238 Acked Write 9 Done Done Sent false
37569 10239 Acked Write 6 Done Done Sent false
37570 10240 Acked Flush 0 Done Done Sent false
37571 10241 Acked Write 1 Done Done Sent false
37572 10242 Acked Write 8 Done Done Sent false
37573 10243 Acked Read 8 Done Done Sent false
37574 10244 Acked Write 4 Done Done Sent false
37575 10245 Acked Read 2 Done Done Sent false
37576 10246 Acked Write 7 Done Done Sent false
37577 10247 Acked Read 5 Done Done Sent false
37578 10248 Acked Write 2 Done Done Sent false
37579 10249 Acked Read 7 Done Done Sent false
37580 10250 Acked Write 8 Done Done Sent false
37581 10251 Acked Write 10 Done Done Sent false
37582 10252 Acked Write 8 Done Done Sent false
37583 10253 Acked Write 1 Done Done Sent false
37584 10254 Acked Flush 0 Done Done Sent false
37585 10255 Acked Read 5 Done Done Sent false
37586 10256 Acked Write 9 Done Done Sent false
37587 10257 Acked Write 4 Done Done Sent false
37588 10258 Acked Write 4 Done Done Sent false
37589 10259 Acked Write 9 Done Done Sent false
37590 10260 Acked Read 6 Done Done Sent false
37591 10261 Acked Read 6 Done Done Sent false
37592 10262 Acked Write 2 Done Done Sent false
37593 10263 Acked Write 8 Done Done Sent false
37594 10264 Acked Read 1 Done Done Sent false
37595 10265 Acked Read 7 Done Done Sent false
37596 10266 Acked Write 10 Done Done Sent false
37597 10267 Acked Write 10 Done Done Sent false
37598 10268 Acked Write 5 Done Done Sent false
37599 10269 Acked Flush 0 Done Done Sent false
37600 10270 Acked Write 8 Done Done Sent false
37601 10271 Acked Read 4 Done Done Sent false
37602 10272 Acked Write 9 Done Done Sent false
37603 10273 Acked Read 2 Done Done Sent false
37604 10274 Acked Read 3 Done Done Sent false
37605 10275 Acked Read 7 Done Done Sent false
37606 10276 Acked Read 5 Done Done Sent false
37607 10277 Acked Write 7 Done Done Sent false
37608 10278 Acked Read 7 Done Done Sent false
37609 10279 Acked Read 6 Done Done Sent false
37610 10280 Acked Read 4 Done Done Sent false
37611 10281 Acked Write 4 Done Done Sent false
37612 10282 Acked Write 3 Done Done Sent false
37613 10283 Acked Read 3 Done Done Sent false
37614 10284 Acked Read 4 Done Done Sent false
37615 10285 Acked Read 4 Done Done Sent false
37616 10286 Acked Write 2 Done Done Sent false
37617 10287 Acked Write 5 Done Done Sent false
37618 10288 Acked Read 9 Done Done Sent false
37619 10289 Acked Write 1 Done Done Sent false
37620 10290 Acked Write 1 Done Done Sent false
37621 10291 Acked Read 6 Done Done Sent false
37622 10292 Acked Read 1 Done Done Sent false
37623 10293 Acked Write 3 Done Done Sent false
37624 10294 Acked Write 4 Done Done Sent false
37625 10295 Acked Read 9 Done Done Sent false
37626 10296 Acked Write 3 Done Done Sent false
37627 10297 Acked Write 8 Done Done Sent false
37628 10298 Acked Read 2 Done Done Sent false
37629 10299 Acked Write 4 Done Done Sent false
37630 10300 Acked Write 7 Done Done Sent false
37631 10301 Acked Flush 0 Done Done Sent false
37632 10302 Acked Write 5 Done Done Sent false
37633 10303 Acked Read 1 Done Done Sent false
37634 10304 Acked Write 2 Done Done Sent false
37635 10305 Acked Write 7 Done Done Sent false
37636 10306 Acked Read 5 Done Done Sent false
37637 10307 Acked Flush 0 Done Done Sent false
37638 10308 Acked Read 5 Done Done Sent false
37639 10309 Acked Read 4 Done Done Sent false
37640 10310 Acked Write 4 Done Done Sent false
37641 10311 Acked Write 5 Done Done Sent false
37642 10312 Acked Write 7 Done Done Sent false
37643 10313 Acked Read 7 Done Done Sent false
37644 10314 Acked Read 1 Done Done Sent false
37645 10315 Acked Read 5 Done Done Sent false
37646 10316 Acked Write 3 Done Done Sent false
37647 10317 Acked Write 4 Done Done Sent false
37648 10318 Acked Write 5 Done Done Sent false
37649 10319 Acked Read 2 Done Done Sent false
37650 10320 Acked Write 9 Done Done Sent false
37651 10321 Acked Read 5 Done Done Sent false
37652 10322 Acked Read 1 Done Done Sent false
37653 10323 Acked Write 9 Done Done Sent false
37654 10324 Acked Read 4 Done Done Sent false
37655 10325 Acked Read 8 Done Done Sent false
37656 10326 Acked Write 6 Done Done Sent false
37657 10327 Acked Write 5 Done Done Sent false
37658 10328 Acked Write 4 Done Done Sent false
37659 10329 Acked Flush 0 Done Done Sent false
37660 10330 Acked Write 3 Done Done Sent false
37661 10331 Acked Read 9 Done Done Sent false
37662 10332 Acked Read 3 Done Done Sent false
37663 10333 Acked Read 2 Done Done Sent false
37664 10334 Acked Read 9 Done Done Sent false
37665 10335 Acked Read 9 Done Done Sent false
37666 10336 Acked Read 7 Done Done Sent false
37667 10337 Acked Read 6 Done Done Sent false
37668 10338 Acked Read 8 Done Done Sent false
37669 10339 Acked Read 5 Done Done Sent false
37670 10340 Acked Read 10 Done Done Sent false
37671 10341 Acked Write 5 Done Done Sent false
37672 10342 Acked Read 5 Done Done Sent false
37673 10343 Acked Read 10 Done Done Sent false
37674 10344 Acked Read 10 Done Done Sent false
37675 10345 Acked Write 4 Done Done Sent false
37676 10346 Acked Write 6 Done Done Sent false
37677 10347 Acked Read 9 Done Done Sent false
37678 10348 Acked Read 3 Done Done Sent false
37679 10349 Acked Read 6 Done Done Sent false
37680 10350 Acked Read 1 Done Done Sent false
37681 10351 Acked Flush 0 Done Done Sent false
37682 10352 Acked Write 6 Done Done Sent false
37683 10353 Acked Read 6 Done Done Sent false
37684 10354 Acked Read 7 Done Done Sent false
37685 10355 Acked Write 4 Done Done Sent false
37686 10356 Acked Write 2 Done Done Sent false
37687 10357 Acked Write 5 Done Done Sent false
37688 10358 Acked Flush 0 Done Done Sent false
37689 STATES DS:0 DS:1 DS:2 TOTAL
37690 Sent 0 0 302 302
37691 Done 302 302 0 604
37692 Skipped 0 0 0 0
37693 Error 0 0 0 0
37694 Last Flush: 10358 10358 10056
37695 Downstairs last five completed: 10056 10055 10054 10053 10052
37696 Upstairs last five completed: 10358 10357 10356 10355 10354
37697 CLIENT: Up:0 ds:302 act:2
376982025-01-10T16:43:13.142ZINFOcrucible: connecting to 127.0.0.1:8830 = io task client = 2 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
376992025-01-10T16:43:13.142ZINFOcrucible: ds_connection connected from Ok(127.0.0.1:43012) = io task client = 2 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
377002025-01-10T16:43:13.143ZWARNcrucible: version negotiation from state Offline = downstairs client = 2 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
377012025-01-10T16:43:13.144ZINFOcrucible: downstairs client at Some(127.0.0.1:8830) has region UUID 12345678-0000-0000-0000-000000008830 = downstairs client = 2 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
377022025-01-10T16:43:13.144ZINFOcrucible: Returning UUID:12345678-0000-0000-0000-000000008830 matches = downstairs client = 2 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
377032025-01-10T16:43:13.144ZINFOcrucible: send last flush ID to this DS: 10056 = downstairs client = 2 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
377042025-01-10T16:43:13.144ZINFOcrucible: Replied this last flush ID: 10056 = downstairs client = 2 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
377052025-01-10T16:43:13.144ZINFOcrucible: ds_transition from Offline to Active = downstairs client = 2 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
377062025-01-10T16:43:13.144ZINFOcrucible: [2] Transition from Offline to Active = downstairs client = 2 session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
377072025-01-10T16:43:13.144ZINFOcrucible: [2] client re-new 302 jobs since flush 10056 = downstairs session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
377082025-01-10T16:43:13.144ZINFOcrucible: [2] Replayed 302 jobs since flush: 10056 = downstairs session_id = 1df3ca91-4dc9-42d6-9897-461254b5afe2
37709 ----------------------------------------------------------------
37710 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:0
37711 Downstairs last five completed: 10358 10357 10356 10355 10354
37712 Upstairs last five completed: 10358 10357 10356 10355 10354
37713 CLIENT: Up:0 ds:0 act:3
37714 Replay: All jobs finished
37715 Test replay has completed
37716 Wrote out file "/tmp/test_replay_verify.log"
37717 CLIENT: Tests done. All submitted work has been ACK'd
37718 ----------------------------------------------------------------
37719 Crucible gen:2 GIO:true work queues: Upstairs:0 downstairs:0
37720 Downstairs last five completed: 10358 10357 10356 10355 10354
37721 Upstairs last five completed: 10358 10357 10356 10355 10354
37722 CLIENT: Up:0 ds:0 act:3
37723 CLIENT: All jobs finished, all DS active.
37724 Replays:30 time: 7:52
37725 Do final verify
37726 Jan 10 16:43:15.465 INFO accepted connection, remote_addr: 127.0.0.1:41363, local_addr: 127.0.0.1:9998
37727 Jan 10 16:43:15.466 INFO request completed, latency_us: 183, response_code: 200, uri: /regioninfo, method: GET, req_id: f9f20373-a063-4e48-b5a1-f8a0ff5fc946, remote_addr: 127.0.0.1:41363, local_addr: 127.0.0.1:9998
377282025-01-10T16:43:15.466ZINFOcrucible: Use this region info from dsc: RegionExtentInfo { block_size: 4096, blocks_per_extent: 100, extent_count: 50 } task = crutest
37729 Jan 10 16:43:15.466 INFO request completed, latency_us: 80, response_code: 200, uri: /regioncount, method: GET, req_id: 96607fce-9023-4c0b-8726-22f02957df60, remote_addr: 127.0.0.1:41363, local_addr: 127.0.0.1:9998
377302025-01-10T16:43:15.467ZINFOcrucible: dsc has 3 regions. This means 1 sub_volumes task = crutest
37731 Jan 10 16:43:15.467 INFO request completed, latency_us: 100, response_code: 200, uri: /port/cid/0, method: GET, req_id: f2e5c8df-4052-4e74-ae17-a349faf28754, remote_addr: 127.0.0.1:41363, local_addr: 127.0.0.1:9998
37732 Jan 10 16:43:15.467 INFO request completed, latency_us: 86, response_code: 200, uri: /port/cid/1, method: GET, req_id: 8277461b-35c2-4b1f-b8a5-88b14709b370, remote_addr: 127.0.0.1:41363, local_addr: 127.0.0.1:9998
37733 Jan 10 16:43:15.468 INFO request completed, latency_us: 94, response_code: 200, uri: /port/cid/2, method: GET, req_id: ce707abf-7397-495d-8b59-ec6d8f944131, remote_addr: 127.0.0.1:41363, local_addr: 127.0.0.1:9998
377342025-01-10T16:43:15.468ZINFOcrucible: SV 0 has targets: [127.0.0.1:8810, 127.0.0.1:8820, 127.0.0.1:8830] task = crutest
377352025-01-10T16:43:15.468ZINFOcrucible: Upstairs starts
377362025-01-10T16:43:15.468ZINFOcrucible: Crucible Version: BuildInfo { version: "0.0.1", git_sha: "56068760771d58f96ac946e6b2ae83073c18c1b4", git_commit_timestamp: "2025-01-10T16:19:36.000000000Z", git_branch: "alan/rust-1-84-please", rustc_semver: "1.84.0", rustc_channel: "stable", rustc_host_triple: "x86_64-unknown-illumos", rustc_commit_sha: "9fc6b43126469e3858e2fe86cafb4f0fd5068869", cargo_triple: "x86_64-unknown-illumos", debug: true, opt_level: 0, }
377372025-01-10T16:43:15.468ZINFOcrucible: Upstairs <-> Downstairs Message Version: 12
377382025-01-10T16:43:15.468ZINFOcrucible: Using region definition RegionDefinition { block_size: 4096, extent_size: Block { value: 100, shift: 12 }, extent_count: 50, uuid: 00000000-0000-0000-0000-000000000000, encrypted: false, database_read_version: 1, database_write_version: 1 }
377392025-01-10T16:43:15.469ZINFOcrucible: Crucible 98c3e190-0ccf-4e30-bf53-23c62b08e867 has session id: 52023e25-923b-4bc9-8d59-703001808d42 session_id = 52023e25-923b-4bc9-8d59-703001808d42
377402025-01-10T16:43:15.469ZINFOcrucible: Upstairs opts: Upstairs UUID: 98c3e190-0ccf-4e30-bf53-23c62b08e867, Targets: [127.0.0.1:8810, 127.0.0.1:8820, 127.0.0.1:8830], lossy: false, flush_timeout: None, key populated: false, cert_pem populated: false, key_pem populated: false, root_cert_pem populated: false, Control: None, read_only: false session_id = 52023e25-923b-4bc9-8d59-703001808d42
377412025-01-10T16:43:15.469ZINFOcrucible: Crucible stats registered with UUID: 98c3e190-0ccf-4e30-bf53-23c62b08e867 session_id = 52023e25-923b-4bc9-8d59-703001808d42
377422025-01-10T16:43:15.502ZINFOcrucible: Downstairs in volume = 3 task = crutest
377432025-01-10T16:43:15.502ZINFOcrucible: The guest has requested activation with gen:3
377442025-01-10T16:43:15.502ZINFOcrucible: 98c3e190-0ccf-4e30-bf53-23c62b08e867 active request set session_id = 52023e25-923b-4bc9-8d59-703001808d42
377452025-01-10T16:43:15.502ZINFOcrucible: sending connect oneshot to client = downstairs client = 0 session_id = 52023e25-923b-4bc9-8d59-703001808d42
377462025-01-10T16:43:15.502ZINFOcrucible: client set_active_request while in New; waiting... = downstairs client = 0 session_id = 52023e25-923b-4bc9-8d59-703001808d42
377472025-01-10T16:43:15.502ZINFOcrucible: sending connect oneshot to client = downstairs client = 1 session_id = 52023e25-923b-4bc9-8d59-703001808d42
377482025-01-10T16:43:15.502ZINFOcrucible: client set_active_request while in New; waiting... = downstairs client = 1 session_id = 52023e25-923b-4bc9-8d59-703001808d42
377492025-01-10T16:43:15.502ZINFOcrucible: sending connect oneshot to client = downstairs client = 2 session_id = 52023e25-923b-4bc9-8d59-703001808d42
377502025-01-10T16:43:15.502ZINFOcrucible: client set_active_request while in New; waiting... = downstairs client = 2 session_id = 52023e25-923b-4bc9-8d59-703001808d42
377512025-01-10T16:43:15.502ZINFOcrucible: connecting to 127.0.0.1:8830 = io task client = 2 session_id = 52023e25-923b-4bc9-8d59-703001808d42
377522025-01-10T16:43:15.502ZINFOcrucible: connecting to 127.0.0.1:8810 = io task client = 0 session_id = 52023e25-923b-4bc9-8d59-703001808d42
377532025-01-10T16:43:15.502ZINFOcrucible: connecting to 127.0.0.1:8820 = io task client = 1 session_id = 52023e25-923b-4bc9-8d59-703001808d42
377542025-01-10T16:43:15.502ZINFOcrucible: ds_connection connected from Ok(127.0.0.1:59201) = io task client = 1 session_id = 52023e25-923b-4bc9-8d59-703001808d42
377552025-01-10T16:43:15.502ZINFOcrucible: ds_connection connected from Ok(127.0.0.1:39244) = io task client = 2 session_id = 52023e25-923b-4bc9-8d59-703001808d42
377562025-01-10T16:43:15.502ZINFOcrucible: ds_connection connected from Ok(127.0.0.1:57596) = io task client = 0 session_id = 52023e25-923b-4bc9-8d59-703001808d42
377572025-01-10T16:43:15.503ZINFOcrucible: ds_transition from New to WaitActive = downstairs client = 1 session_id = 52023e25-923b-4bc9-8d59-703001808d42
377582025-01-10T16:43:15.503ZINFOcrucible: [1] Transition from New to WaitActive = downstairs client = 1 session_id = 52023e25-923b-4bc9-8d59-703001808d42
377592025-01-10T16:43:15.503ZINFOcrucible: ds_transition from New to WaitActive = downstairs client = 2 session_id = 52023e25-923b-4bc9-8d59-703001808d42
377602025-01-10T16:43:15.503ZINFOcrucible: [2] Transition from New to WaitActive = downstairs client = 2 session_id = 52023e25-923b-4bc9-8d59-703001808d42
377612025-01-10T16:43:15.503ZINFOcrucible: ds_transition from New to WaitActive = downstairs client = 0 session_id = 52023e25-923b-4bc9-8d59-703001808d42
377622025-01-10T16:43:15.503ZINFOcrucible: [0] Transition from New to WaitActive = downstairs client = 0 session_id = 52023e25-923b-4bc9-8d59-703001808d42
377632025-01-10T16:43:15.504ZINFOcrucible: downstairs client at Some(127.0.0.1:8810) has region UUID 12345678-0000-0000-0000-000000008810 = downstairs client = 0 session_id = 52023e25-923b-4bc9-8d59-703001808d42
377642025-01-10T16:43:15.504ZINFOcrucible: downstairs client at Some(127.0.0.1:8830) has region UUID 12345678-0000-0000-0000-000000008830 = downstairs client = 2 session_id = 52023e25-923b-4bc9-8d59-703001808d42
377652025-01-10T16:43:15.504ZINFOcrucible: downstairs client at Some(127.0.0.1:8820) has region UUID 12345678-0000-0000-0000-000000008820 = downstairs client = 1 session_id = 52023e25-923b-4bc9-8d59-703001808d42
377662025-01-10T16:43:15.504ZINFOcrucible: ds_transition from WaitActive to WaitQuorum = downstairs client = 1 session_id = 52023e25-923b-4bc9-8d59-703001808d42
377672025-01-10T16:43:15.504ZINFOcrucible: [1] Transition from WaitActive to WaitQuorum = downstairs client = 1 session_id = 52023e25-923b-4bc9-8d59-703001808d42
377682025-01-10T16:43:15.504ZINFOcrucible: Waiting for more clients to be ready session_id = 52023e25-923b-4bc9-8d59-703001808d42
377692025-01-10T16:43:15.504ZINFOcrucible: ds_transition from WaitActive to WaitQuorum = downstairs client = 0 session_id = 52023e25-923b-4bc9-8d59-703001808d42
377702025-01-10T16:43:15.504ZINFOcrucible: [0] Transition from WaitActive to WaitQuorum = downstairs client = 0 session_id = 52023e25-923b-4bc9-8d59-703001808d42
377712025-01-10T16:43:15.504ZINFOcrucible: Waiting for more clients to be ready session_id = 52023e25-923b-4bc9-8d59-703001808d42
377722025-01-10T16:43:15.504ZINFOcrucible: ds_transition from WaitActive to WaitQuorum = downstairs client = 2 session_id = 52023e25-923b-4bc9-8d59-703001808d42
377732025-01-10T16:43:15.504ZINFOcrucible: [2] Transition from WaitActive to WaitQuorum = downstairs client = 2 session_id = 52023e25-923b-4bc9-8d59-703001808d42
377742025-01-10T16:43:15.504ZINFOcrucible: [0]R flush_numbers[0..12]: [929, 924, 929, 929, 927, 906, 903, 918, 914, 929, 926, 926] = downstairs session_id = 52023e25-923b-4bc9-8d59-703001808d42
377752025-01-10T16:43:15.504ZINFOcrucible: [0]R generation[0..12]: [2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2] = downstairs session_id = 52023e25-923b-4bc9-8d59-703001808d42
377762025-01-10T16:43:15.504ZINFOcrucible: [0]R dirty[0..12]: [false, false, false, false, false, false, false, false, false, false, false, false] = downstairs session_id = 52023e25-923b-4bc9-8d59-703001808d42
377772025-01-10T16:43:15.504ZINFOcrucible: [1]R flush_numbers[0..12]: [929, 924, 929, 929, 927, 906, 903, 918, 914, 929, 926, 926] = downstairs session_id = 52023e25-923b-4bc9-8d59-703001808d42
377782025-01-10T16:43:15.504ZINFOcrucible: [1]R generation[0..12]: [2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2] = downstairs session_id = 52023e25-923b-4bc9-8d59-703001808d42
377792025-01-10T16:43:15.504ZINFOcrucible: [1]R dirty[0..12]: [false, false, false, false, false, false, false, false, false, false, false, false] = downstairs session_id = 52023e25-923b-4bc9-8d59-703001808d42
377802025-01-10T16:43:15.504ZINFOcrucible: [2]R flush_numbers[0..12]: [929, 924, 929, 929, 927, 906, 903, 918, 914, 929, 926, 926] = downstairs session_id = 52023e25-923b-4bc9-8d59-703001808d42
377812025-01-10T16:43:15.504ZINFOcrucible: [2]R generation[0..12]: [2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2] = downstairs session_id = 52023e25-923b-4bc9-8d59-703001808d42
377822025-01-10T16:43:15.504ZINFOcrucible: [2]R dirty[0..12]: [false, false, false, false, false, false, false, false, false, false, false, false] = downstairs session_id = 52023e25-923b-4bc9-8d59-703001808d42
37783 Wait for a query_work_queue command to finish before sending IO
377842025-01-10T16:43:15.505ZINFOcrucible: Max found gen is 3 = downstairs session_id = 52023e25-923b-4bc9-8d59-703001808d42
377852025-01-10T16:43:15.505ZINFOcrucible: Generation requested: 3 >= found:3 = downstairs session_id = 52023e25-923b-4bc9-8d59-703001808d42
377862025-01-10T16:43:15.505ZINFOcrucible: Next flush: 932 = downstairs session_id = 52023e25-923b-4bc9-8d59-703001808d42
377872025-01-10T16:43:15.505ZINFOcrucible: All extents match = downstairs session_id = 52023e25-923b-4bc9-8d59-703001808d42
377882025-01-10T16:43:15.505ZINFOcrucible: No downstairs reconciliation required session_id = 52023e25-923b-4bc9-8d59-703001808d42
377892025-01-10T16:43:15.505ZINFOcrucible: Transition from WaitQuorum to Active = downstairs client = 0 session_id = 52023e25-923b-4bc9-8d59-703001808d42
377902025-01-10T16:43:15.505ZINFOcrucible: Transition from WaitQuorum to Active = downstairs client = 1 session_id = 52023e25-923b-4bc9-8d59-703001808d42
377912025-01-10T16:43:15.505ZINFOcrucible: Transition from WaitQuorum to Active = downstairs client = 2 session_id = 52023e25-923b-4bc9-8d59-703001808d42
377922025-01-10T16:43:15.505ZINFOcrucible: All required reconciliation work is completed session_id = 52023e25-923b-4bc9-8d59-703001808d42
377932025-01-10T16:43:15.505ZINFOcrucible: Set Downstairs and Upstairs active after reconciliation session_id = 52023e25-923b-4bc9-8d59-703001808d42
377942025-01-10T16:43:15.505ZINFOcrucible: 98c3e190-0ccf-4e30-bf53-23c62b08e867 is now active with session: 52023e25-923b-4bc9-8d59-703001808d42 session_id = 52023e25-923b-4bc9-8d59-703001808d42
377952025-01-10T16:43:15.505ZINFOcrucible: Set Active after no reconciliation session_id = 52023e25-923b-4bc9-8d59-703001808d42
377962025-01-10T16:43:15.505ZINFOcrucible: The guest has finished waiting for activation with:3
37797 Disk: sv:1 bs:4096 ts:20480000 tb:5000 max_io:256 or 1048576
37798 Loading write count information from file "/tmp/test_replay_verify.log"
37799 Read and Verify all blocks (0..5000 range:false)
37800 Wrote out file "/tmp/test_replay_verify.log"
37801 Verify test completed
37802 Wrote out file "/tmp/test_replay_verify.log"
37803 CLIENT: Tests done. All submitted work has been ACK'd
37804 ----------------------------------------------------------------
37805 Crucible gen:3 GIO:true work queues: Upstairs:0 downstairs:20
37806 States: Active Active Active
37807 JOBID ACK TYPE BKS/EXT DS:0 DS:1 DS:2 REPLAY
37808 1000 Acked Read 256 Done Done Done false
37809 1001 Acked Read 256 Done Done Done false
37810 1002 Acked Read 256 Done Done Done false
37811 1003 Acked Read 256 Done Done Done false
37812 1004 Acked Read 256 Done Done Done false
37813 1005 Acked Read 256 Done Done Done false
37814 1006 Acked Read 256 Done Done Done false
37815 1007 Acked Read 256 Done Done Done false
37816 1008 Acked Read 256 Done Done Done false
37817 1009 Acked Read 256 Done Done Done false
37818 1010 Acked Read 256 Done Done Done false
37819 1011 Acked Read 256 Done Done Done false
37820 1012 Acked Read 256 Done Done Done false
37821 1013 Acked Read 256 Done Done Done false
37822 1014 Acked Read 256 Done Done Done false
37823 1015 Acked Read 256 Done Done Done false
37824 1016 Acked Read 256 Done Done Done false
37825 1017 Acked Read 136 Done Done Done false
37826 1018 Acked Read 256 Done Done Done false
37827 1019 Acked Read 256 Done Done Done false
37828 STATES DS:0 DS:1 DS:2 TOTAL
37829 Sent 0 0 0 0
37830 Done 20 20 20 60
37831 Skipped 0 0 0 0
37832 Error 0 0 0 0
37833 Last Flush: 0 0 0
37834 Downstairs last five completed:
37835 Upstairs last five completed: 1019 1018 1017 1016 1015
37836 CLIENT: Up:0 ds:20 act:3
37837 ----------------------------------------------------------------
37838 Crucible gen:3 GIO:true work queues: Upstairs:0 downstairs:0
37839 Downstairs last five completed: 1020 1019 1018 1017 1016
37840 Upstairs last five completed: 1020 1019 1018 1017 1016
37841 CLIENT: Up:0 ds:0 act:3
37842 CLIENT: All crucible jobs finished, exiting program
378432025-01-10T16:43:19.882ZWARNcrucible: Guest handle has been dropped
37844 Jan 10 16:43:19.947 INFO accepted connection, remote_addr: 127.0.0.1:41856, local_addr: 127.0.0.1:9998
37845 Main task has work to do, go find it
37846 got dsc Shutdown
37847 Shutdown
37848 Jan 10 16:43:19.948 INFO request completed, latency_usShut it down
37849 : 167, response_code: [8810] Disable keep_running
37850 204[8810] Got stop action so:false kr:false
37851 , uri: /shutdown, method: POST, req_id: e1124df4-0c6f-4b1c-82ea-133abec98a42, remote_addr: 127.0.0.1:41856, local_addr: 127.0.0.1:9998
37852 [8820] Disable keep_running
37853 [8830] Disable keep_running
37854 [8820] Got stop action so:false kr:false
37855 [8830] Got stop action so:false kr:false
37856 [8810] Exited with: ExitStatus(unix_wait_status(9))
37857 [8830] Exited with: ExitStatus(unix_wait_status(9))
37858 [8810][0] reports Exit
37859 [8830][2] reports Exit
37860 [8820] Exited with: ExitStatus(unix_wait_status(9))
37861 [8820][1] reports Exit
37862 January 10, 2025 at 04:43:24 PM UTC Test ends with 0