Max level shown:
1 [ Mar 24 17:58:27 Disabled. ]
2 [ Mar 24 17:58:27 Rereading configuration. ]
3 [ Mar 24 17:58:32 Enabled. ]
4 [ Mar 24 17:58:33 Rereading configuration. ]
5 [ Mar 24 17:58:40 Executing start method ("/opt/oxide/pantry/bin/crucible-pantry run -l [fd00:1122:3344:101::11]:17000"). ]
6 note: configured to log to "/dev/stdout"
72026-03-24T17:58:41.076ZINFOcrucible-pantry: Crucible Version: Crucible Version: 0.0.1 Commit SHA: 7103cd3a3d7b0112d2949dd135db06fef0c156bb Commit timestamp: 2025-11-10T22:24:53.000000000Z branch: main rustc: 1.90.0 stable x86_64-unknown-illumos Cargo: x86_64-unknown-illumos Debug: false Opt level: 3
82026-03-24T17:58:41.106ZINFOcrucible-pantry (dropshot): listening local_addr = [fd00:1122:3344:101::11]:17000
92026-03-24T17:58:41.323ZINFOcrucible-pantry: listen IP: [fd00:1122:3344:101::11]:17000
102026-03-24T17:58:49.049ZINFOcrucible-pantry (dropshot): accepted connection local_addr = [fd00:1122:3344:101::11]:17000 remote_addr = [fd00:1122:3344:101::a]:33475
112026-03-24T17:58:49.082ZINFOcrucible-pantry (dropshot): request completed latency_us = 12755 local_addr = [fd00:1122:3344:101::11]:17000 method = GET remote_addr = [fd00:1122:3344:101::a]:33475 req_id = 06140455-de43-473a-bcae-d8f83c4bf0b8 response_code = 200 uri = /crucible/pantry/0
122026-03-24T17:58:49.255ZINFOcrucible-pantry (dropshot): accepted connection local_addr = [fd00:1122:3344:101::11]:17000 remote_addr = [fd00:1122:3344:101::a]:36760
132026-03-24T17:58:49.255ZINFOcrucible-pantry (dropshot): request completed latency_us = 44 local_addr = [fd00:1122:3344:101::11]:17000 method = GET remote_addr = [fd00:1122:3344:101::a]:36760 req_id = 0eacd59e-9c9a-4d6e-8ae4-0da1d9b0c978 response_code = 200 uri = /crucible/pantry/0
142026-03-24T17:58:49.347ZINFOcrucible-pantry (dropshot): accepted connection local_addr = [fd00:1122:3344:101::11]:17000 remote_addr = [fd00:1122:3344:101::a]:45060
152026-03-24T17:58:49.347ZINFOcrucible-pantry (dropshot): request completed latency_us = 44 local_addr = [fd00:1122:3344:101::11]:17000 method = GET remote_addr = [fd00:1122:3344:101::a]:45060 req_id = df66c045-f2df-4474-9b8e-8a6d0f8a878e response_code = 200 uri = /crucible/pantry/0
162026-03-24T17:58:51.227ZINFOcrucible-pantry (dropshot): accepted connection local_addr = [fd00:1122:3344:101::11]:17000 remote_addr = [fd00:1122:3344:101::c]:56161
172026-03-24T17:58:51.230ZINFOcrucible-pantry (dropshot): request completed latency_us = 59 local_addr = [fd00:1122:3344:101::11]:17000 method = GET remote_addr = [fd00:1122:3344:101::c]:56161 req_id = fc6b4eec-7462-4b6f-9818-f0e0d2708c98 response_code = 200 uri = /crucible/pantry/0
182026-03-24T17:58:51.454ZINFOcrucible-pantry (dropshot): accepted connection local_addr = [fd00:1122:3344:101::11]:17000 remote_addr = [fd00:1122:3344:101::c]:52860
192026-03-24T17:58:51.454ZINFOcrucible-pantry (dropshot): request completed latency_us = 45 local_addr = [fd00:1122:3344:101::11]:17000 method = GET remote_addr = [fd00:1122:3344:101::c]:52860 req_id = d718fe9e-cde0-4403-9aec-81301f946090 response_code = 200 uri = /crucible/pantry/0
202026-03-24T17:58:51.504ZINFOcrucible-pantry (dropshot): accepted connection local_addr = [fd00:1122:3344:101::11]:17000 remote_addr = [fd00:1122:3344:101::c]:36305
212026-03-24T17:58:51.505ZINFOcrucible-pantry (dropshot): request completed latency_us = 21 local_addr = [fd00:1122:3344:101::11]:17000 method = GET remote_addr = [fd00:1122:3344:101::c]:36305 req_id = f07ea5bb-73dc-47c7-838b-ad12feb136b8 response_code = 200 uri = /crucible/pantry/0
222026-03-24T17:58:51.724ZINFOcrucible-pantry (dropshot): accepted connection local_addr = [fd00:1122:3344:101::11]:17000 remote_addr = [fd00:1122:3344:101::b]:58947
232026-03-24T17:58:51.724ZINFOcrucible-pantry (dropshot): request completed latency_us = 63 local_addr = [fd00:1122:3344:101::11]:17000 method = GET remote_addr = [fd00:1122:3344:101::b]:58947 req_id = d40e8ada-bd54-4c08-868b-4e3a024e0759 response_code = 200 uri = /crucible/pantry/0
242026-03-24T17:58:52.099ZINFOcrucible-pantry (dropshot): accepted connection local_addr = [fd00:1122:3344:101::11]:17000 remote_addr = [fd00:1122:3344:101::b]:42174
252026-03-24T17:58:52.170ZINFOcrucible-pantry (dropshot): accepted connection local_addr = [fd00:1122:3344:101::11]:17000 remote_addr = [fd00:1122:3344:101::b]:48173
262026-03-24T17:58:52.170ZINFOcrucible-pantry (dropshot): request completed latency_us = 48 local_addr = [fd00:1122:3344:101::11]:17000 method = GET remote_addr = [fd00:1122:3344:101::b]:48173 req_id = 5a290753-56ce-4b3a-af5a-38c45c616f64 response_code = 200 uri = /crucible/pantry/0
272026-03-24T17:58:52.202ZINFOcrucible-pantry (dropshot): accepted connection local_addr = [fd00:1122:3344:101::11]:17000 remote_addr = [fd00:1122:3344:101::b]:34821
282026-03-24T17:58:52.202ZINFOcrucible-pantry (dropshot): request completed latency_us = 40 local_addr = [fd00:1122:3344:101::11]:17000 method = GET remote_addr = [fd00:1122:3344:101::b]:34821 req_id = 8719735f-95d6-48d0-91f1-b9675d02b868 response_code = 200 uri = /crucible/pantry/0
292026-03-24T17:59:19.092ZINFOcrucible-pantry (dropshot): accepted connection local_addr = [fd00:1122:3344:101::11]:17000 remote_addr = [fd00:1122:3344:101::a]:34760
302026-03-24T17:59:19.093ZINFOcrucible-pantry (dropshot): request completed latency_us = 34 local_addr = [fd00:1122:3344:101::11]:17000 method = GET remote_addr = [fd00:1122:3344:101::a]:34760 req_id = 86483d33-6209-491e-8118-f95a0b649bcc response_code = 200 uri = /crucible/pantry/0
312026-03-24T17:59:19.271ZINFOcrucible-pantry (dropshot): accepted connection local_addr = [fd00:1122:3344:101::11]:17000 remote_addr = [fd00:1122:3344:101::a]:59012
322026-03-24T17:59:19.272ZINFOcrucible-pantry (dropshot): request completed latency_us = 72 local_addr = [fd00:1122:3344:101::11]:17000 method = GET remote_addr = [fd00:1122:3344:101::a]:59012 req_id = e29ebc2a-c823-4264-92f7-73c7da2c7aff response_code = 200 uri = /crucible/pantry/0
332026-03-24T17:59:19.351ZINFOcrucible-pantry (dropshot): accepted connection local_addr = [fd00:1122:3344:101::11]:17000 remote_addr = [fd00:1122:3344:101::a]:64268
342026-03-24T17:59:19.351ZINFOcrucible-pantry (dropshot): request completed latency_us = 27 local_addr = [fd00:1122:3344:101::11]:17000 method = GET remote_addr = [fd00:1122:3344:101::a]:64268 req_id = e005af0c-25db-4048-9960-e90731204a5e response_code = 200 uri = /crucible/pantry/0
352026-03-24T17:59:21.260ZINFOcrucible-pantry (dropshot): accepted connection local_addr = [fd00:1122:3344:101::11]:17000 remote_addr = [fd00:1122:3344:101::c]:43412
362026-03-24T17:59:21.260ZINFOcrucible-pantry (dropshot): request completed latency_us = 49 local_addr = [fd00:1122:3344:101::11]:17000 method = GET remote_addr = [fd00:1122:3344:101::c]:43412 req_id = e7f16bb2-be0e-4a87-872e-16b4afc2420c response_code = 200 uri = /crucible/pantry/0
372026-03-24T17:59:21.471ZINFOcrucible-pantry (dropshot): accepted connection local_addr = [fd00:1122:3344:101::11]:17000 remote_addr = [fd00:1122:3344:101::c]:48755
382026-03-24T17:59:21.471ZINFOcrucible-pantry (dropshot): request completed latency_us = 30 local_addr = [fd00:1122:3344:101::11]:17000 method = GET remote_addr = [fd00:1122:3344:101::c]:48755 req_id = 2a532dd6-eaa6-4470-8366-9b009729328e response_code = 200 uri = /crucible/pantry/0
392026-03-24T17:59:21.525ZINFOcrucible-pantry (dropshot): accepted connection local_addr = [fd00:1122:3344:101::11]:17000 remote_addr = [fd00:1122:3344:101::c]:64390
402026-03-24T17:59:21.525ZINFOcrucible-pantry (dropshot): request completed latency_us = 19 local_addr = [fd00:1122:3344:101::11]:17000 method = GET remote_addr = [fd00:1122:3344:101::c]:64390 req_id = 150033d3-00af-4691-8846-dba3009ab809 response_code = 200 uri = /crucible/pantry/0
412026-03-24T17:59:21.760ZINFOcrucible-pantry (dropshot): accepted connection local_addr = [fd00:1122:3344:101::11]:17000 remote_addr = [fd00:1122:3344:101::b]:57025
422026-03-24T17:59:21.760ZINFOcrucible-pantry (dropshot): request completed latency_us = 32 local_addr = [fd00:1122:3344:101::11]:17000 method = GET remote_addr = [fd00:1122:3344:101::b]:57025 req_id = a6374425-ef17-4430-a4c5-68c0c28841ac response_code = 200 uri = /crucible/pantry/0
432026-03-24T17:59:22.173ZINFOcrucible-pantry (dropshot): accepted connection local_addr = [fd00:1122:3344:101::11]:17000 remote_addr = [fd00:1122:3344:101::b]:63286
442026-03-24T17:59:22.173ZINFOcrucible-pantry (dropshot): request completed latency_us = 26 local_addr = [fd00:1122:3344:101::11]:17000 method = GET remote_addr = [fd00:1122:3344:101::b]:63286 req_id = 2be5ae87-1da0-4957-a5da-b9b7a1ee7891 response_code = 200 uri = /crucible/pantry/0
452026-03-24T17:59:22.211ZINFOcrucible-pantry (dropshot): accepted connection local_addr = [fd00:1122:3344:101::11]:17000 remote_addr = [fd00:1122:3344:101::b]:39436
462026-03-24T17:59:22.211ZINFOcrucible-pantry (dropshot): request completed latency_us = 17 local_addr = [fd00:1122:3344:101::11]:17000 method = GET remote_addr = [fd00:1122:3344:101::b]:39436 req_id = b9335964-3a5d-494c-ac8c-8e130dc625d4 response_code = 200 uri = /crucible/pantry/0
472026-03-24T17:59:41.098ZINFOcrucible-pantry (dropshot): request completed latency_us = 50 local_addr = [fd00:1122:3344:101::11]:17000 method = GET remote_addr = [fd00:1122:3344:101::b]:57025 req_id = bf08a8f2-fd2d-4081-95db-a8adf4f64b2d response_code = 200 uri = /crucible/pantry/0
482026-03-24T17:59:41.207ZINFOcrucible-pantry (dropshot): accepted connection local_addr = [fd00:1122:3344:101::11]:17000 remote_addr = [fd00:1122:3344:101::b]:54194
492026-03-24T17:59:41.224ZINFOcrucible-pantry (datafile): no entry exists for volume aeece583-ed61-4b04-8987-f7d64ce34257, constructing...
502026-03-24T17:59:41.242ZINFOcrucible-pantry (datafile): Upstairs starts
512026-03-24T17:59:41.242ZINFOcrucible-pantry (datafile): Crucible Version: BuildInfo { version: "0.0.1", git_sha: "7103cd3a3d7b0112d2949dd135db06fef0c156bb", git_commit_timestamp: "2025-11-10T22:24:53.000000000Z", git_branch: "main", rustc_semver: "1.90.0", rustc_channel: "stable", rustc_host_triple: "x86_64-unknown-illumos", rustc_commit_sha: "1159e78c4747b02ef996e55082b704c09b970588", cargo_triple: "x86_64-unknown-illumos", debug: false, opt_level: 3, }
522026-03-24T17:59:41.242ZINFOcrucible-pantry (datafile): Upstairs <-> Downstairs Message Version: 13
532026-03-24T17:59:41.242ZINFOcrucible-pantry (datafile): Using region definition RegionDefinition { block_size: 512, extent_size: Block { value: 131072, shift: 9 }, extent_count: 32, uuid: 00000000-0000-0000-0000-000000000000, encrypted: true, database_read_version: 1, database_write_version: 1 }
542026-03-24T17:59:41.263ZINFOcrucible-pantry (datafile): Crucible aeece583-ed61-4b04-8987-f7d64ce34257 has session id: bfa5b33c-5715-46a9-8900-e2db11f3ae3a session_id = bfa5b33c-5715-46a9-8900-e2db11f3ae3a
552026-03-24T17:59:41.265ZINFOcrucible-pantry (datafile): Upstairs opts: Upstairs UUID: aeece583-ed61-4b04-8987-f7d64ce34257, Targets: [[fd00:1122:3344:101::17]:19000, [fd00:1122:3344:101::12]:19000, [fd00:1122:3344:101::1a]:19000], lossy: false, flush_timeout: None, key populated: true, cert_pem populated: false, key_pem populated: false, root_cert_pem populated: false, Control: None, read_only: false session_id = bfa5b33c-5715-46a9-8900-e2db11f3ae3a
562026-03-24T17:59:41.265ZINFOcrucible-pantry (datafile): Crucible stats registered with UUID: aeece583-ed61-4b04-8987-f7d64ce34257 session_id = bfa5b33c-5715-46a9-8900-e2db11f3ae3a
572026-03-24T17:59:41.272ZINFOcrucible-pantry (datafile): notify_task started job = notify session_id = bfa5b33c-5715-46a9-8900-e2db11f3ae3a
582026-03-24T17:59:41.272ZINFOcrucible-pantry (datafile): client is waiting for oneshot = io task client = 1 session_id = bfa5b33c-5715-46a9-8900-e2db11f3ae3a
592026-03-24T17:59:41.272ZINFOcrucible-pantry (datafile): client is waiting for oneshot = io task client = 0 session_id = bfa5b33c-5715-46a9-8900-e2db11f3ae3a
602026-03-24T17:59:41.274ZINFOcrucible-pantry (datafile): client is waiting for oneshot = io task client = 2 session_id = bfa5b33c-5715-46a9-8900-e2db11f3ae3a
612026-03-24T17:59:41.276ZINFOcrucible-pantry (datafile): volume aeece583-ed61-4b04-8987-f7d64ce34257 constructed ok
622026-03-24T17:59:41.276ZINFOcrucible-pantry (datafile): The guest has requested activation
632026-03-24T17:59:41.276ZINFOcrucible-pantry (datafile): aeece583-ed61-4b04-8987-f7d64ce34257 active request set session_id = bfa5b33c-5715-46a9-8900-e2db11f3ae3a
642026-03-24T17:59:41.276ZINFOcrucible-pantry (datafile): sending connect oneshot to client = downstairs client = 0 session_id = bfa5b33c-5715-46a9-8900-e2db11f3ae3a
652026-03-24T17:59:41.277ZINFOcrucible-pantry (datafile): sending connect oneshot to client = downstairs client = 1 session_id = bfa5b33c-5715-46a9-8900-e2db11f3ae3a
662026-03-24T17:59:41.277ZINFOcrucible-pantry (datafile): sending connect oneshot to client = downstairs client = 2 session_id = bfa5b33c-5715-46a9-8900-e2db11f3ae3a
672026-03-24T17:59:41.277ZINFOcrucible-pantry (datafile): connecting to [fd00:1122:3344:101::1a]:19000 = io task client = 2 session_id = bfa5b33c-5715-46a9-8900-e2db11f3ae3a
682026-03-24T17:59:41.277ZINFOcrucible-pantry (datafile): connecting to [fd00:1122:3344:101::17]:19000 = io task client = 0 session_id = bfa5b33c-5715-46a9-8900-e2db11f3ae3a
692026-03-24T17:59:41.277ZINFOcrucible-pantry (datafile): connecting to [fd00:1122:3344:101::12]:19000 = io task client = 1 session_id = bfa5b33c-5715-46a9-8900-e2db11f3ae3a
702026-03-24T17:59:41.277ZINFOcrucible-pantry (datafile): ds_connection connected from Ok([fd00:1122:3344:101::11]:61537) = io task client = 2 session_id = bfa5b33c-5715-46a9-8900-e2db11f3ae3a
712026-03-24T17:59:41.277ZINFOcrucible-pantry (datafile): ds_connection connected from Ok([fd00:1122:3344:101::11]:62029) = io task client = 1 session_id = bfa5b33c-5715-46a9-8900-e2db11f3ae3a
722026-03-24T17:59:41.277ZINFOcrucible-pantry (datafile): ds_connection connected from Ok([fd00:1122:3344:101::11]:38129) = io task client = 0 session_id = bfa5b33c-5715-46a9-8900-e2db11f3ae3a
732026-03-24T17:59:41.280ZINFOcrucible-pantry (datafile): downstairs client at Some([fd00:1122:3344:101::1a]:19000) has region UUID 63566eea-c951-455c-a371-642807b44f13 = downstairs client = 2 session_id = bfa5b33c-5715-46a9-8900-e2db11f3ae3a
742026-03-24T17:59:41.280ZINFOcrucible-pantry (datafile): downstairs client at Some([fd00:1122:3344:101::12]:19000) has region UUID 3f796b11-b103-4585-aee9-a1878b120734 = downstairs client = 1 session_id = bfa5b33c-5715-46a9-8900-e2db11f3ae3a
752026-03-24T17:59:41.280ZINFOcrucible-pantry (datafile): Waiting for more clients to be ready session_id = bfa5b33c-5715-46a9-8900-e2db11f3ae3a
762026-03-24T17:59:41.280ZINFOcrucible-pantry (datafile): Waiting for more clients to be ready session_id = bfa5b33c-5715-46a9-8900-e2db11f3ae3a
772026-03-24T17:59:41.280ZINFOcrucible-pantry (datafile): downstairs client at Some([fd00:1122:3344:101::17]:19000) has region UUID cab83ceb-4dc3-403d-bdd8-ed555487cd33 = downstairs client = 0 session_id = bfa5b33c-5715-46a9-8900-e2db11f3ae3a
782026-03-24T17:59:41.280ZINFOcrucible-pantry (datafile): [0]R flush_numbers[0..12]: [0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0] = downstairs session_id = bfa5b33c-5715-46a9-8900-e2db11f3ae3a
792026-03-24T17:59:41.281ZINFOcrucible-pantry (datafile): [0]R generation[0..12]: [0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0] = downstairs session_id = bfa5b33c-5715-46a9-8900-e2db11f3ae3a
802026-03-24T17:59:41.281ZINFOcrucible-pantry (datafile): [0]R dirty[0..12]: [false, false, false, false, false, false, false, false, false, false, false, false] = downstairs session_id = bfa5b33c-5715-46a9-8900-e2db11f3ae3a
812026-03-24T17:59:41.281ZINFOcrucible-pantry (datafile): [1]R flush_numbers[0..12]: [0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0] = downstairs session_id = bfa5b33c-5715-46a9-8900-e2db11f3ae3a
822026-03-24T17:59:41.281ZINFOcrucible-pantry (datafile): [1]R generation[0..12]: [0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0] = downstairs session_id = bfa5b33c-5715-46a9-8900-e2db11f3ae3a
832026-03-24T17:59:41.281ZINFOcrucible-pantry (datafile): [1]R dirty[0..12]: [false, false, false, false, false, false, false, false, false, false, false, false] = downstairs session_id = bfa5b33c-5715-46a9-8900-e2db11f3ae3a
842026-03-24T17:59:41.281ZINFOcrucible-pantry (datafile): [2]R flush_numbers[0..12]: [0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0] = downstairs session_id = bfa5b33c-5715-46a9-8900-e2db11f3ae3a
852026-03-24T17:59:41.281ZINFOcrucible-pantry (datafile): [2]R generation[0..12]: [0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0] = downstairs session_id = bfa5b33c-5715-46a9-8900-e2db11f3ae3a
862026-03-24T17:59:41.281ZINFOcrucible-pantry (datafile): [2]R dirty[0..12]: [false, false, false, false, false, false, false, false, false, false, false, false] = downstairs session_id = bfa5b33c-5715-46a9-8900-e2db11f3ae3a
872026-03-24T17:59:41.281ZINFOcrucible-pantry (datafile): Max found gen is 1 = downstairs session_id = bfa5b33c-5715-46a9-8900-e2db11f3ae3a
882026-03-24T17:59:41.281ZINFOcrucible-pantry (datafile): Generation requested: 1 >= found:1 = downstairs session_id = bfa5b33c-5715-46a9-8900-e2db11f3ae3a
892026-03-24T17:59:41.281ZINFOcrucible-pantry (datafile): Next flush: 1 = downstairs session_id = bfa5b33c-5715-46a9-8900-e2db11f3ae3a
902026-03-24T17:59:41.281ZINFOcrucible-pantry (datafile): All extents match = downstairs session_id = bfa5b33c-5715-46a9-8900-e2db11f3ae3a
912026-03-24T17:59:41.281ZINFOcrucible-pantry (datafile): No downstairs reconciliation required session_id = bfa5b33c-5715-46a9-8900-e2db11f3ae3a
922026-03-24T17:59:41.281ZINFOcrucible-pantry (datafile): Transition from WaitQuorum to Active = downstairs client = 0 session_id = bfa5b33c-5715-46a9-8900-e2db11f3ae3a
932026-03-24T17:59:41.281ZINFOcrucible-pantry (datafile): Transition from WaitQuorum to Active = downstairs client = 1 session_id = bfa5b33c-5715-46a9-8900-e2db11f3ae3a
942026-03-24T17:59:41.281ZINFOcrucible-pantry (datafile): Transition from WaitQuorum to Active = downstairs client = 2 session_id = bfa5b33c-5715-46a9-8900-e2db11f3ae3a
952026-03-24T17:59:41.281ZINFOcrucible-pantry (datafile): All required reconciliation work is completed session_id = bfa5b33c-5715-46a9-8900-e2db11f3ae3a
962026-03-24T17:59:41.281ZINFOcrucible-pantry (datafile): Set Downstairs and Upstairs active after reconciliation session_id = bfa5b33c-5715-46a9-8900-e2db11f3ae3a
972026-03-24T17:59:41.281ZINFOcrucible-pantry (datafile): aeece583-ed61-4b04-8987-f7d64ce34257 is now active with session: bfa5b33c-5715-46a9-8900-e2db11f3ae3a session_id = bfa5b33c-5715-46a9-8900-e2db11f3ae3a
982026-03-24T17:59:41.281ZINFOcrucible-pantry (datafile): Set Active after no reconciliation session_id = bfa5b33c-5715-46a9-8900-e2db11f3ae3a
992026-03-24T17:59:41.283ZINFOcrucible-pantry (datafile): The guest has finished waiting for activation
1002026-03-24T17:59:41.283ZINFOcrucible-pantry (datafile): Activated sub_volume aeece583-ed61-4b04-8987-f7d64ce34257
1012026-03-24T17:59:41.283ZINFOcrucible-pantry (datafile): Activated sub_volume 7139e5f7-7b9d-4c6c-acc1-87e4f82102db
1022026-03-24T17:59:41.283ZINFOcrucible-pantry (datafile): volume aeece583-ed61-4b04-8987-f7d64ce34257 activated ok
1032026-03-24T17:59:41.283ZINFOcrucible-pantry (datafile): volume aeece583-ed61-4b04-8987-f7d64ce34257 constructed and inserted ok
1042026-03-24T17:59:41.283ZINFOcrucible-pantry (dropshot): request completed latency_us = 73435 local_addr = [fd00:1122:3344:101::11]:17000 method = POST remote_addr = [fd00:1122:3344:101::b]:54194 req_id = 183d656d-7676-4c46-b20b-6de9ba853c09 response_code = 200 uri = /crucible/pantry/0/volume/aeece583-ed61-4b04-8987-f7d64ce34257
1052026-03-24T17:59:41.970ZINFOcrucible-pantry (dropshot): accepted connection local_addr = [fd00:1122:3344:101::11]:17000 remote_addr = [fd00:1122:3344:101::b]:55155
1062026-03-24T17:59:41.975ZINFOcrucible-pantry (dropshot): request completed latency_us = 5489 local_addr = [fd00:1122:3344:101::11]:17000 method = POST remote_addr = [fd00:1122:3344:101::b]:55155 req_id = c4c9234c-c9dc-4f71-8953-cc082216e6b5 response_code = 204 uri = /crucible/pantry/0/volume/aeece583-ed61-4b04-8987-f7d64ce34257/bulk-write
1072026-03-24T17:59:42.532ZINFOcrucible-pantry (dropshot): request completed latency_us = 1748 local_addr = [fd00:1122:3344:101::11]:17000 method = POST remote_addr = [fd00:1122:3344:101::b]:55155 req_id = e0e2d061-b659-4de8-8c86-65e180a7da39 response_code = 204 uri = /crucible/pantry/0/volume/aeece583-ed61-4b04-8987-f7d64ce34257/bulk-write
1082026-03-24T17:59:43.141ZINFOcrucible-pantry (dropshot): request completed latency_us = 1508 local_addr = [fd00:1122:3344:101::11]:17000 method = POST remote_addr = [fd00:1122:3344:101::b]:55155 req_id = 863149c5-3aa1-436d-a768-82baa474e861 response_code = 204 uri = /crucible/pantry/0/volume/aeece583-ed61-4b04-8987-f7d64ce34257/bulk-write
1092026-03-24T17:59:43.635ZINFOcrucible-pantry (dropshot): request completed latency_us = 1732 local_addr = [fd00:1122:3344:101::11]:17000 method = POST remote_addr = [fd00:1122:3344:101::b]:55155 req_id = 5a02b2a8-7f41-4754-8ebf-516db60d00eb response_code = 204 uri = /crucible/pantry/0/volume/aeece583-ed61-4b04-8987-f7d64ce34257/bulk-write
1102026-03-24T17:59:44.122ZINFOcrucible-pantry (dropshot): request completed latency_us = 1060 local_addr = [fd00:1122:3344:101::11]:17000 method = POST remote_addr = [fd00:1122:3344:101::b]:55155 req_id = 3b4e01f6-ca20-4ee4-913c-62e6144c8aea response_code = 204 uri = /crucible/pantry/0/volume/aeece583-ed61-4b04-8987-f7d64ce34257/bulk-write
1112026-03-24T17:59:44.604ZINFOcrucible-pantry (dropshot): request completed latency_us = 1466 local_addr = [fd00:1122:3344:101::11]:17000 method = POST remote_addr = [fd00:1122:3344:101::b]:55155 req_id = fc18a853-42c2-4b6c-9c19-c19efcc46476 response_code = 204 uri = /crucible/pantry/0/volume/aeece583-ed61-4b04-8987-f7d64ce34257/bulk-write
1122026-03-24T17:59:45.096ZINFOcrucible-pantry (dropshot): request completed latency_us = 1747 local_addr = [fd00:1122:3344:101::11]:17000 method = POST remote_addr = [fd00:1122:3344:101::b]:55155 req_id = ab39dc6a-8ca4-4edb-8bbb-a44f6ec68304 response_code = 204 uri = /crucible/pantry/0/volume/aeece583-ed61-4b04-8987-f7d64ce34257/bulk-write
1132026-03-24T17:59:45.595ZINFOcrucible-pantry (dropshot): request completed latency_us = 1274 local_addr = [fd00:1122:3344:101::11]:17000 method = POST remote_addr = [fd00:1122:3344:101::b]:55155 req_id = 1a44bedf-31c8-4f93-ab5d-aee8a1b2c2c6 response_code = 204 uri = /crucible/pantry/0/volume/aeece583-ed61-4b04-8987-f7d64ce34257/bulk-write
1142026-03-24T17:59:46.077ZINFOcrucible-pantry (dropshot): request completed latency_us = 1604 local_addr = [fd00:1122:3344:101::11]:17000 method = POST remote_addr = [fd00:1122:3344:101::b]:55155 req_id = 36395f14-15a2-43c6-97b7-2def9a0e2c21 response_code = 204 uri = /crucible/pantry/0/volume/aeece583-ed61-4b04-8987-f7d64ce34257/bulk-write
1152026-03-24T17:59:46.568ZINFOcrucible-pantry (dropshot): request completed latency_us = 1740 local_addr = [fd00:1122:3344:101::11]:17000 method = POST remote_addr = [fd00:1122:3344:101::b]:55155 req_id = 71f0fa42-0c03-431c-9885-64d34e3d80b2 response_code = 204 uri = /crucible/pantry/0/volume/aeece583-ed61-4b04-8987-f7d64ce34257/bulk-write
1162026-03-24T17:59:47.058ZINFOcrucible-pantry (dropshot): request completed latency_us = 1114 local_addr = [fd00:1122:3344:101::11]:17000 method = POST remote_addr = [fd00:1122:3344:101::b]:55155 req_id = 687b33de-e1cf-4ac6-971d-dc41b54d002b response_code = 204 uri = /crucible/pantry/0/volume/aeece583-ed61-4b04-8987-f7d64ce34257/bulk-write
1172026-03-24T17:59:47.540ZINFOcrucible-pantry (dropshot): request completed latency_us = 1386 local_addr = [fd00:1122:3344:101::11]:17000 method = POST remote_addr = [fd00:1122:3344:101::b]:55155 req_id = 98e033b6-facd-417e-826a-3c482394d952 response_code = 204 uri = /crucible/pantry/0/volume/aeece583-ed61-4b04-8987-f7d64ce34257/bulk-write
1182026-03-24T17:59:48.023ZINFOcrucible-pantry (dropshot): request completed latency_us = 1480 local_addr = [fd00:1122:3344:101::11]:17000 method = POST remote_addr = [fd00:1122:3344:101::b]:55155 req_id = 7cdb839e-6c41-4378-a3f0-ee8aaa00ad26 response_code = 204 uri = /crucible/pantry/0/volume/aeece583-ed61-4b04-8987-f7d64ce34257/bulk-write
1192026-03-24T17:59:48.499ZINFOcrucible-pantry (dropshot): request completed latency_us = 1559 local_addr = [fd00:1122:3344:101::11]:17000 method = POST remote_addr = [fd00:1122:3344:101::b]:55155 req_id = b3e6d691-37b2-4d1a-916b-0d55fcf5bf3a response_code = 204 uri = /crucible/pantry/0/volume/aeece583-ed61-4b04-8987-f7d64ce34257/bulk-write
1202026-03-24T17:59:48.979ZINFOcrucible-pantry (dropshot): request completed latency_us = 1243 local_addr = [fd00:1122:3344:101::11]:17000 method = POST remote_addr = [fd00:1122:3344:101::b]:55155 req_id = 87b8f157-1e06-402f-88c9-a67bad6c40eb response_code = 204 uri = /crucible/pantry/0/volume/aeece583-ed61-4b04-8987-f7d64ce34257/bulk-write
1212026-03-24T17:59:49.097ZINFOcrucible-pantry (dropshot): accepted connection local_addr = [fd00:1122:3344:101::11]:17000 remote_addr = [fd00:1122:3344:101::a]:39589
1222026-03-24T17:59:49.097ZINFOcrucible-pantry (dropshot): request completed latency_us = 35 local_addr = [fd00:1122:3344:101::11]:17000 method = GET remote_addr = [fd00:1122:3344:101::a]:39589 req_id = 7337d2ec-2d79-4ee0-8c18-f04b7ab1f0a6 response_code = 200 uri = /crucible/pantry/0
1232026-03-24T17:59:49.287ZINFOcrucible-pantry (dropshot): accepted connection local_addr = [fd00:1122:3344:101::11]:17000 remote_addr = [fd00:1122:3344:101::a]:54862
1242026-03-24T17:59:49.287ZINFOcrucible-pantry (dropshot): request completed latency_us = 32 local_addr = [fd00:1122:3344:101::11]:17000 method = GET remote_addr = [fd00:1122:3344:101::a]:54862 req_id = 84fe4306-37ce-41cf-a580-8695b00e9fc7 response_code = 200 uri = /crucible/pantry/0
1252026-03-24T17:59:49.390ZINFOcrucible-pantry (dropshot): accepted connection local_addr = [fd00:1122:3344:101::11]:17000 remote_addr = [fd00:1122:3344:101::a]:47607
1262026-03-24T17:59:49.390ZINFOcrucible-pantry (dropshot): request completed latency_us = 22 local_addr = [fd00:1122:3344:101::11]:17000 method = GET remote_addr = [fd00:1122:3344:101::a]:47607 req_id = c85d1148-a38a-4db2-b0c8-c5d3497dae09 response_code = 200 uri = /crucible/pantry/0
1272026-03-24T17:59:49.473ZINFOcrucible-pantry (dropshot): request completed latency_us = 1195 local_addr = [fd00:1122:3344:101::11]:17000 method = POST remote_addr = [fd00:1122:3344:101::b]:55155 req_id = 0e769a0f-e16a-4129-ae5b-2877bab18fb7 response_code = 204 uri = /crucible/pantry/0/volume/aeece583-ed61-4b04-8987-f7d64ce34257/bulk-write
1282026-03-24T17:59:49.954ZINFOcrucible-pantry (dropshot): request completed latency_us = 1778 local_addr = [fd00:1122:3344:101::11]:17000 method = POST remote_addr = [fd00:1122:3344:101::b]:55155 req_id = 433bf022-5b10-4f0a-a350-b6d62fc1a9c4 response_code = 204 uri = /crucible/pantry/0/volume/aeece583-ed61-4b04-8987-f7d64ce34257/bulk-write
1292026-03-24T17:59:50.443ZINFOcrucible-pantry (dropshot): request completed latency_us = 873 local_addr = [fd00:1122:3344:101::11]:17000 method = POST remote_addr = [fd00:1122:3344:101::b]:55155 req_id = 0d782a56-4d5c-4329-bfa3-9d2276f837da response_code = 204 uri = /crucible/pantry/0/volume/aeece583-ed61-4b04-8987-f7d64ce34257/bulk-write
1302026-03-24T17:59:50.928ZINFOcrucible-pantry (dropshot): request completed latency_us = 1523 local_addr = [fd00:1122:3344:101::11]:17000 method = POST remote_addr = [fd00:1122:3344:101::b]:55155 req_id = 3aa5119f-9784-4f88-ab23-7709abec8914 response_code = 204 uri = /crucible/pantry/0/volume/aeece583-ed61-4b04-8987-f7d64ce34257/bulk-write
1312026-03-24T17:59:51.262ZINFOcrucible-pantry (dropshot): accepted connection local_addr = [fd00:1122:3344:101::11]:17000 remote_addr = [fd00:1122:3344:101::c]:54667
1322026-03-24T17:59:51.262ZINFOcrucible-pantry (dropshot): request completed latency_us = 34 local_addr = [fd00:1122:3344:101::11]:17000 method = GET remote_addr = [fd00:1122:3344:101::c]:54667 req_id = 0d5c4c2a-55a2-40c9-b532-77d8a9909f9f response_code = 200 uri = /crucible/pantry/0
1332026-03-24T17:59:51.410ZINFOcrucible-pantry (dropshot): request completed latency_us = 1628 local_addr = [fd00:1122:3344:101::11]:17000 method = POST remote_addr = [fd00:1122:3344:101::b]:55155 req_id = 58584096-beeb-4e18-9502-70ac26e03ea1 response_code = 204 uri = /crucible/pantry/0/volume/aeece583-ed61-4b04-8987-f7d64ce34257/bulk-write
1342026-03-24T17:59:51.477ZINFOcrucible-pantry (dropshot): accepted connection local_addr = [fd00:1122:3344:101::11]:17000 remote_addr = [fd00:1122:3344:101::c]:59229
1352026-03-24T17:59:51.477ZINFOcrucible-pantry (dropshot): request completed latency_us = 37 local_addr = [fd00:1122:3344:101::11]:17000 method = GET remote_addr = [fd00:1122:3344:101::c]:59229 req_id = 6bb4e248-28a2-4c32-8953-7c5b01974b0f response_code = 200 uri = /crucible/pantry/0
1362026-03-24T17:59:51.527ZINFOcrucible-pantry (dropshot): accepted connection local_addr = [fd00:1122:3344:101::11]:17000 remote_addr = [fd00:1122:3344:101::c]:61052
1372026-03-24T17:59:51.527ZINFOcrucible-pantry (dropshot): request completed latency_us = 22 local_addr = [fd00:1122:3344:101::11]:17000 method = GET remote_addr = [fd00:1122:3344:101::c]:61052 req_id = fdc74bd5-f29d-4f68-a819-ce8defb6fac2 response_code = 200 uri = /crucible/pantry/0
1382026-03-24T17:59:51.780ZINFOcrucible-pantry (dropshot): request completed latency_us = 48 local_addr = [fd00:1122:3344:101::11]:17000 method = GET remote_addr = [fd00:1122:3344:101::b]:57025 req_id = e8a91137-cb0c-44dd-a645-7fb2ba20f2ec response_code = 200 uri = /crucible/pantry/0
1392026-03-24T17:59:51.900ZINFOcrucible-pantry (dropshot): request completed latency_us = 1119 local_addr = [fd00:1122:3344:101::11]:17000 method = POST remote_addr = [fd00:1122:3344:101::b]:55155 req_id = b1e40f6a-e612-4fa7-b46f-116987fcaa01 response_code = 204 uri = /crucible/pantry/0/volume/aeece583-ed61-4b04-8987-f7d64ce34257/bulk-write
1402026-03-24T17:59:52.181ZINFOcrucible-pantry (dropshot): accepted connection local_addr = [fd00:1122:3344:101::11]:17000 remote_addr = [fd00:1122:3344:101::b]:46523
1412026-03-24T17:59:52.181ZINFOcrucible-pantry (dropshot): request completed latency_us = 63 local_addr = [fd00:1122:3344:101::11]:17000 method = GET remote_addr = [fd00:1122:3344:101::b]:46523 req_id = f829d7b7-4299-4412-9cf6-1acdb25180f1 response_code = 200 uri = /crucible/pantry/0
1422026-03-24T17:59:52.215ZINFOcrucible-pantry (dropshot): accepted connection local_addr = [fd00:1122:3344:101::11]:17000 remote_addr = [fd00:1122:3344:101::b]:47087
1432026-03-24T17:59:52.215ZINFOcrucible-pantry (dropshot): request completed latency_us = 26 local_addr = [fd00:1122:3344:101::11]:17000 method = GET remote_addr = [fd00:1122:3344:101::b]:47087 req_id = bfdee037-d8af-4e59-9c0a-0cd0f6d35ae4 response_code = 200 uri = /crucible/pantry/0
1442026-03-24T17:59:52.382ZINFOcrucible-pantry (dropshot): request completed latency_us = 1827 local_addr = [fd00:1122:3344:101::11]:17000 method = POST remote_addr = [fd00:1122:3344:101::b]:55155 req_id = 93df2445-d47c-4d6f-9665-ec2c90d06d84 response_code = 204 uri = /crucible/pantry/0/volume/aeece583-ed61-4b04-8987-f7d64ce34257/bulk-write
1452026-03-24T17:59:52.913ZINFOcrucible-pantry (dropshot): request completed latency_us = 1831 local_addr = [fd00:1122:3344:101::11]:17000 method = POST remote_addr = [fd00:1122:3344:101::b]:55155 req_id = c5e38852-b840-4e18-bc51-3217c4441674 response_code = 204 uri = /crucible/pantry/0/volume/aeece583-ed61-4b04-8987-f7d64ce34257/bulk-write
1462026-03-24T17:59:53.395ZINFOcrucible-pantry (dropshot): request completed latency_us = 1067 local_addr = [fd00:1122:3344:101::11]:17000 method = POST remote_addr = [fd00:1122:3344:101::b]:55155 req_id = a4c13051-8782-4e5a-8aa0-1fb11a7e0aa3 response_code = 204 uri = /crucible/pantry/0/volume/aeece583-ed61-4b04-8987-f7d64ce34257/bulk-write
1472026-03-24T17:59:53.870ZINFOcrucible-pantry (dropshot): request completed latency_us = 918 local_addr = [fd00:1122:3344:101::11]:17000 method = POST remote_addr = [fd00:1122:3344:101::b]:55155 req_id = ebb6a944-9fca-4c4a-9549-e659d2949950 response_code = 204 uri = /crucible/pantry/0/volume/aeece583-ed61-4b04-8987-f7d64ce34257/bulk-write
1482026-03-24T17:59:54.350ZINFOcrucible-pantry (dropshot): request completed latency_us = 947 local_addr = [fd00:1122:3344:101::11]:17000 method = POST remote_addr = [fd00:1122:3344:101::b]:55155 req_id = cbca5830-8327-4f4c-9017-12c44ff1c233 response_code = 204 uri = /crucible/pantry/0/volume/aeece583-ed61-4b04-8987-f7d64ce34257/bulk-write
1492026-03-24T17:59:54.828ZINFOcrucible-pantry (dropshot): request completed latency_us = 1041 local_addr = [fd00:1122:3344:101::11]:17000 method = POST remote_addr = [fd00:1122:3344:101::b]:55155 req_id = fdfdf5d2-dd56-48f7-a2ad-d467f385dc90 response_code = 204 uri = /crucible/pantry/0/volume/aeece583-ed61-4b04-8987-f7d64ce34257/bulk-write
1502026-03-24T17:59:55.308ZINFOcrucible-pantry (dropshot): request completed latency_us = 1114 local_addr = [fd00:1122:3344:101::11]:17000 method = POST remote_addr = [fd00:1122:3344:101::b]:55155 req_id = 6ca59186-c69b-470f-ab59-9804b2d8addf response_code = 204 uri = /crucible/pantry/0/volume/aeece583-ed61-4b04-8987-f7d64ce34257/bulk-write
1512026-03-24T17:59:55.792ZINFOcrucible-pantry (dropshot): request completed latency_us = 945 local_addr = [fd00:1122:3344:101::11]:17000 method = POST remote_addr = [fd00:1122:3344:101::b]:55155 req_id = 5307ea5e-4274-4fc2-8824-a57917299604 response_code = 204 uri = /crucible/pantry/0/volume/aeece583-ed61-4b04-8987-f7d64ce34257/bulk-write
1522026-03-24T17:59:56.272ZINFOcrucible-pantry (dropshot): request completed latency_us = 1177 local_addr = [fd00:1122:3344:101::11]:17000 method = POST remote_addr = [fd00:1122:3344:101::b]:55155 req_id = 9091da96-15a3-4e7b-9fa5-9b095708a628 response_code = 204 uri = /crucible/pantry/0/volume/aeece583-ed61-4b04-8987-f7d64ce34257/bulk-write
1532026-03-24T17:59:56.748ZINFOcrucible-pantry (dropshot): request completed latency_us = 883 local_addr = [fd00:1122:3344:101::11]:17000 method = POST remote_addr = [fd00:1122:3344:101::b]:55155 req_id = d298bd4c-8456-496c-b4d0-73cd374a0086 response_code = 204 uri = /crucible/pantry/0/volume/aeece583-ed61-4b04-8987-f7d64ce34257/bulk-write
1542026-03-24T17:59:56.881ZINFOcrucible-pantry (dropshot): request completed latency_us = 1234 local_addr = [fd00:1122:3344:101::11]:17000 method = POST remote_addr = [fd00:1122:3344:101::b]:55155 req_id = 0c8ff480-2d70-4c3c-a1f9-79c82c840d0e response_code = 204 uri = /crucible/pantry/0/volume/aeece583-ed61-4b04-8987-f7d64ce34257/bulk-write
1552026-03-24T17:59:57.373ZINFOcrucible-pantry (dropshot): request completed latency_us = 1128 local_addr = [fd00:1122:3344:101::11]:17000 method = POST remote_addr = [fd00:1122:3344:101::b]:55155 req_id = a7002d9f-00a6-4bda-8ab6-00137966528a response_code = 204 uri = /crucible/pantry/0/volume/aeece583-ed61-4b04-8987-f7d64ce34257/bulk-write
1562026-03-24T17:59:57.970ZINFOcrucible-pantry (dropshot): request completed latency_us = 1584 local_addr = [fd00:1122:3344:101::11]:17000 method = POST remote_addr = [fd00:1122:3344:101::b]:55155 req_id = 73cbe948-42ae-4f34-853c-a8e35b58f766 response_code = 204 uri = /crucible/pantry/0/volume/aeece583-ed61-4b04-8987-f7d64ce34257/bulk-write
1572026-03-24T17:59:58.541ZINFOcrucible-pantry (dropshot): request completed latency_us = 1029 local_addr = [fd00:1122:3344:101::11]:17000 method = POST remote_addr = [fd00:1122:3344:101::b]:55155 req_id = 78630ffb-7d54-4977-9b30-12b08649e9c1 response_code = 204 uri = /crucible/pantry/0/volume/aeece583-ed61-4b04-8987-f7d64ce34257/bulk-write
1582026-03-24T17:59:58.679ZINFOcrucible-pantry (dropshot): request completed latency_us = 1064 local_addr = [fd00:1122:3344:101::11]:17000 method = POST remote_addr = [fd00:1122:3344:101::b]:55155 req_id = 69422973-7edd-45ec-98ca-2701c4a99cc5 response_code = 204 uri = /crucible/pantry/0/volume/aeece583-ed61-4b04-8987-f7d64ce34257/bulk-write
1592026-03-24T17:59:59.189ZINFOcrucible-pantry (dropshot): request completed latency_us = 988 local_addr = [fd00:1122:3344:101::11]:17000 method = POST remote_addr = [fd00:1122:3344:101::b]:55155 req_id = 3f837751-e6fe-4a2f-adde-5ebe0e757a0f response_code = 204 uri = /crucible/pantry/0/volume/aeece583-ed61-4b04-8987-f7d64ce34257/bulk-write
1602026-03-24T17:59:59.330ZINFOcrucible-pantry (dropshot): request completed latency_us = 1060 local_addr = [fd00:1122:3344:101::11]:17000 method = POST remote_addr = [fd00:1122:3344:101::b]:55155 req_id = 52603b29-bb65-42bd-aa3b-66906a6ab2fc response_code = 204 uri = /crucible/pantry/0/volume/aeece583-ed61-4b04-8987-f7d64ce34257/bulk-write
1612026-03-24T17:59:59.478ZINFOcrucible-pantry (dropshot): request completed latency_us = 941 local_addr = [fd00:1122:3344:101::11]:17000 method = POST remote_addr = [fd00:1122:3344:101::b]:55155 req_id = 43ff8077-76a0-487f-88d5-c9c5c91b1ed9 response_code = 204 uri = /crucible/pantry/0/volume/aeece583-ed61-4b04-8987-f7d64ce34257/bulk-write
1622026-03-24T17:59:59.951ZINFOcrucible-pantry (dropshot): request completed latency_us = 969 local_addr = [fd00:1122:3344:101::11]:17000 method = POST remote_addr = [fd00:1122:3344:101::b]:55155 req_id = 0c84be89-a663-4cea-9b19-f6fbc0d0e72b response_code = 204 uri = /crucible/pantry/0/volume/aeece583-ed61-4b04-8987-f7d64ce34257/bulk-write