Max level shown:
1 [ Jan 12 09:28:36 Disabled. ]
2 [ Jan 12 09:28:36 Rereading configuration. ]
3 [ Jan 12 09:28:38 Enabled. ]
4 [ Jan 12 09:28:38 Rereading configuration. ]
5 [ Jan 12 09:28:42 Executing start method ("/opt/oxide/pantry/bin/crucible-pantry run -l [fd00:1122:3344:101::11]:17000"). ]
6 note: configured to log to "/dev/stdout"
72026-01-12T09:28:42.901ZINFOcrucible-pantry: Crucible Version: Crucible Version: 0.0.1 Commit SHA: 7103cd3a3d7b0112d2949dd135db06fef0c156bb Commit timestamp: 2025-11-10T22:24:53.000000000Z branch: main rustc: 1.90.0 stable x86_64-unknown-illumos Cargo: x86_64-unknown-illumos Debug: false Opt level: 3
82026-01-12T09:28:42.921ZINFOcrucible-pantry (dropshot): listening local_addr = [fd00:1122:3344:101::11]:17000
92026-01-12T09:28:42.978ZINFOcrucible-pantry: listen IP: [fd00:1122:3344:101::11]:17000
102026-01-12T09:28:50.758ZINFOcrucible-pantry (dropshot): accepted connection local_addr = [fd00:1122:3344:101::11]:17000 remote_addr = [fd00:1122:3344:101::c]:63191
112026-01-12T09:28:50.774ZINFOcrucible-pantry (dropshot): request completed latency_us = 9384 local_addr = [fd00:1122:3344:101::11]:17000 method = GET remote_addr = [fd00:1122:3344:101::c]:63191 req_id = 1ea8de81-8e79-4e2e-9ca3-b700a5ac4536 response_code = 200 uri = /crucible/pantry/0
122026-01-12T09:28:51.183ZINFOcrucible-pantry (dropshot): accepted connection local_addr = [fd00:1122:3344:101::11]:17000 remote_addr = [fd00:1122:3344:101::c]:39109
132026-01-12T09:28:51.183ZINFOcrucible-pantry (dropshot): request completed latency_us = 43 local_addr = [fd00:1122:3344:101::11]:17000 method = GET remote_addr = [fd00:1122:3344:101::c]:39109 req_id = 332871a0-996d-46d9-acc8-9db3e6638951 response_code = 200 uri = /crucible/pantry/0
142026-01-12T09:28:51.280ZINFOcrucible-pantry (dropshot): accepted connection local_addr = [fd00:1122:3344:101::11]:17000 remote_addr = [fd00:1122:3344:101::c]:46794
152026-01-12T09:28:51.280ZINFOcrucible-pantry (dropshot): request completed latency_us = 51 local_addr = [fd00:1122:3344:101::11]:17000 method = GET remote_addr = [fd00:1122:3344:101::c]:46794 req_id = 3a7d7b55-8735-41e2-b2b3-60fb3cb283e3 response_code = 200 uri = /crucible/pantry/0
162026-01-12T09:28:52.019ZINFOcrucible-pantry (dropshot): accepted connection local_addr = [fd00:1122:3344:101::11]:17000 remote_addr = [fd00:1122:3344:101::a]:55457
172026-01-12T09:28:52.025ZINFOcrucible-pantry (dropshot): request completed latency_us = 53 local_addr = [fd00:1122:3344:101::11]:17000 method = GET remote_addr = [fd00:1122:3344:101::a]:55457 req_id = 6fb94c65-e109-4e80-bf99-10f28f2df60c response_code = 200 uri = /crucible/pantry/0
182026-01-12T09:28:52.031ZINFOcrucible-pantry (dropshot): accepted connection local_addr = [fd00:1122:3344:101::11]:17000 remote_addr = [fd00:1122:3344:101::b]:53850
192026-01-12T09:28:52.031ZINFOcrucible-pantry (dropshot): request completed latency_us = 25 local_addr = [fd00:1122:3344:101::11]:17000 method = GET remote_addr = [fd00:1122:3344:101::b]:53850 req_id = cf6ca34c-8f76-414c-86ce-509d897f82ec response_code = 200 uri = /crucible/pantry/0
202026-01-12T09:28:52.240ZINFOcrucible-pantry (dropshot): accepted connection local_addr = [fd00:1122:3344:101::11]:17000 remote_addr = [fd00:1122:3344:101::a]:39979
212026-01-12T09:28:52.240ZINFOcrucible-pantry (dropshot): request completed latency_us = 37 local_addr = [fd00:1122:3344:101::11]:17000 method = GET remote_addr = [fd00:1122:3344:101::a]:39979 req_id = 1b6dc001-f67a-4083-89e9-1f7c9acaad13 response_code = 200 uri = /crucible/pantry/0
222026-01-12T09:28:52.288ZINFOcrucible-pantry (dropshot): accepted connection local_addr = [fd00:1122:3344:101::11]:17000 remote_addr = [fd00:1122:3344:101::a]:62063
232026-01-12T09:28:52.288ZINFOcrucible-pantry (dropshot): request completed latency_us = 54 local_addr = [fd00:1122:3344:101::11]:17000 method = GET remote_addr = [fd00:1122:3344:101::a]:62063 req_id = 19a5f31b-4162-4fba-9fda-898e0f02e678 response_code = 200 uri = /crucible/pantry/0
242026-01-12T09:28:52.459ZINFOcrucible-pantry (dropshot): accepted connection local_addr = [fd00:1122:3344:101::11]:17000 remote_addr = [fd00:1122:3344:101::b]:41629
252026-01-12T09:28:52.459ZINFOcrucible-pantry (dropshot): request completed latency_us = 52 local_addr = [fd00:1122:3344:101::11]:17000 method = GET remote_addr = [fd00:1122:3344:101::b]:41629 req_id = 801ffaf2-6748-45d2-900c-9c9d994d989f response_code = 200 uri = /crucible/pantry/0
262026-01-12T09:28:52.506ZINFOcrucible-pantry (dropshot): accepted connection local_addr = [fd00:1122:3344:101::11]:17000 remote_addr = [fd00:1122:3344:101::b]:41653
272026-01-12T09:28:52.506ZINFOcrucible-pantry (dropshot): request completed latency_us = 34 local_addr = [fd00:1122:3344:101::11]:17000 method = GET remote_addr = [fd00:1122:3344:101::b]:41653 req_id = c6e200bf-c1de-4dc2-b440-4cd72211661b response_code = 200 uri = /crucible/pantry/0
282026-01-12T09:29:20.794ZINFOcrucible-pantry (dropshot): accepted connection local_addr = [fd00:1122:3344:101::11]:17000 remote_addr = [fd00:1122:3344:101::c]:55661
292026-01-12T09:29:20.795ZINFOcrucible-pantry (dropshot): request completed latency_us = 40 local_addr = [fd00:1122:3344:101::11]:17000 method = GET remote_addr = [fd00:1122:3344:101::c]:55661 req_id = d3529707-40db-4aeb-89c7-13512f3a0adc response_code = 200 uri = /crucible/pantry/0
302026-01-12T09:29:21.197ZINFOcrucible-pantry (dropshot): accepted connection local_addr = [fd00:1122:3344:101::11]:17000 remote_addr = [fd00:1122:3344:101::c]:34398
312026-01-12T09:29:21.197ZINFOcrucible-pantry (dropshot): request completed latency_us = 34 local_addr = [fd00:1122:3344:101::11]:17000 method = GET remote_addr = [fd00:1122:3344:101::c]:34398 req_id = 8c9ea382-5342-4f2e-81e4-0780e9357878 response_code = 200 uri = /crucible/pantry/0
322026-01-12T09:29:21.294ZINFOcrucible-pantry (dropshot): accepted connection local_addr = [fd00:1122:3344:101::11]:17000 remote_addr = [fd00:1122:3344:101::c]:63489
332026-01-12T09:29:21.294ZINFOcrucible-pantry (dropshot): request completed latency_us = 52 local_addr = [fd00:1122:3344:101::11]:17000 method = GET remote_addr = [fd00:1122:3344:101::c]:63489 req_id = aea4454a-24b5-4129-8760-b702e45b15bd response_code = 200 uri = /crucible/pantry/0
342026-01-12T09:29:22.049ZINFOcrucible-pantry (dropshot): accepted connection local_addr = [fd00:1122:3344:101::11]:17000 remote_addr = [fd00:1122:3344:101::b]:61824
352026-01-12T09:29:22.049ZINFOcrucible-pantry (dropshot): request completed latency_us = 72 local_addr = [fd00:1122:3344:101::11]:17000 method = GET remote_addr = [fd00:1122:3344:101::b]:61824 req_id = 68328e41-dcb6-4546-870c-597e2816ece2 response_code = 200 uri = /crucible/pantry/0
362026-01-12T09:29:22.062ZINFOcrucible-pantry (dropshot): accepted connection local_addr = [fd00:1122:3344:101::11]:17000 remote_addr = [fd00:1122:3344:101::a]:64298
372026-01-12T09:29:22.062ZINFOcrucible-pantry (dropshot): request completed latency_us = 20 local_addr = [fd00:1122:3344:101::11]:17000 method = GET remote_addr = [fd00:1122:3344:101::a]:64298 req_id = e949e467-a4bc-4eff-b5fa-0885b1c43048 response_code = 200 uri = /crucible/pantry/0
382026-01-12T09:29:22.251ZINFOcrucible-pantry (dropshot): accepted connection local_addr = [fd00:1122:3344:101::11]:17000 remote_addr = [fd00:1122:3344:101::a]:62490
392026-01-12T09:29:22.251ZINFOcrucible-pantry (dropshot): request completed latency_us = 36 local_addr = [fd00:1122:3344:101::11]:17000 method = GET remote_addr = [fd00:1122:3344:101::a]:62490 req_id = b9013404-57dc-4874-ab37-1b12c92afb61 response_code = 200 uri = /crucible/pantry/0
402026-01-12T09:29:22.306ZINFOcrucible-pantry (dropshot): accepted connection local_addr = [fd00:1122:3344:101::11]:17000 remote_addr = [fd00:1122:3344:101::a]:48169
412026-01-12T09:29:22.307ZINFOcrucible-pantry (dropshot): request completed latency_us = 30 local_addr = [fd00:1122:3344:101::11]:17000 method = GET remote_addr = [fd00:1122:3344:101::a]:48169 req_id = 38de7f4b-79ed-41f4-8f2e-0320249ae639 response_code = 200 uri = /crucible/pantry/0
422026-01-12T09:29:22.471ZINFOcrucible-pantry (dropshot): accepted connection local_addr = [fd00:1122:3344:101::11]:17000 remote_addr = [fd00:1122:3344:101::b]:64561
432026-01-12T09:29:22.471ZINFOcrucible-pantry (dropshot): request completed latency_us = 33 local_addr = [fd00:1122:3344:101::11]:17000 method = GET remote_addr = [fd00:1122:3344:101::b]:64561 req_id = 73397489-d03d-4d83-8590-dfb010c01ab5 response_code = 200 uri = /crucible/pantry/0
442026-01-12T09:29:22.526ZINFOcrucible-pantry (dropshot): accepted connection local_addr = [fd00:1122:3344:101::11]:17000 remote_addr = [fd00:1122:3344:101::b]:60006
452026-01-12T09:29:22.526ZINFOcrucible-pantry (dropshot): request completed latency_us = 29 local_addr = [fd00:1122:3344:101::11]:17000 method = GET remote_addr = [fd00:1122:3344:101::b]:60006 req_id = c5050ddb-cfd3-4ef2-9300-f0ea4d645db8 response_code = 200 uri = /crucible/pantry/0
462026-01-12T09:29:46.993ZINFOcrucible-pantry (dropshot): request completed latency_us = 53 local_addr = [fd00:1122:3344:101::11]:17000 method = GET remote_addr = [fd00:1122:3344:101::c]:55661 req_id = f4ff966c-abdf-4678-9b90-680bea9c5c2a response_code = 200 uri = /crucible/pantry/0
472026-01-12T09:29:47.099ZINFOcrucible-pantry (dropshot): accepted connection local_addr = [fd00:1122:3344:101::11]:17000 remote_addr = [fd00:1122:3344:101::c]:60779
482026-01-12T09:29:47.119ZINFOcrucible-pantry (datafile): no entry exists for volume d4dbbbcd-0591-4069-986c-2f36408bee61, constructing...
492026-01-12T09:29:47.138ZINFOcrucible-pantry (datafile): Upstairs starts
502026-01-12T09:29:47.138ZINFOcrucible-pantry (datafile): Crucible Version: BuildInfo { version: "0.0.1", git_sha: "7103cd3a3d7b0112d2949dd135db06fef0c156bb", git_commit_timestamp: "2025-11-10T22:24:53.000000000Z", git_branch: "main", rustc_semver: "1.90.0", rustc_channel: "stable", rustc_host_triple: "x86_64-unknown-illumos", rustc_commit_sha: "1159e78c4747b02ef996e55082b704c09b970588", cargo_triple: "x86_64-unknown-illumos", debug: false, opt_level: 3, }
512026-01-12T09:29:47.138ZINFOcrucible-pantry (datafile): Upstairs <-> Downstairs Message Version: 13
522026-01-12T09:29:47.138ZINFOcrucible-pantry (datafile): Using region definition RegionDefinition { block_size: 512, extent_size: Block { value: 131072, shift: 9 }, extent_count: 32, uuid: 00000000-0000-0000-0000-000000000000, encrypted: true, database_read_version: 1, database_write_version: 1 }
532026-01-12T09:29:47.162ZINFOcrucible-pantry (datafile): Crucible d4dbbbcd-0591-4069-986c-2f36408bee61 has session id: aa431178-9e98-4cd5-8fa2-adff7092c9a7 session_id = aa431178-9e98-4cd5-8fa2-adff7092c9a7
542026-01-12T09:29:47.162ZINFOcrucible-pantry (datafile): Upstairs opts: Upstairs UUID: d4dbbbcd-0591-4069-986c-2f36408bee61, Targets: [[fd00:1122:3344:101::19]:19000, [fd00:1122:3344:101::1a]:19000, [fd00:1122:3344:101::12]:19000], lossy: false, flush_timeout: None, key populated: true, cert_pem populated: false, key_pem populated: false, root_cert_pem populated: false, Control: None, read_only: false session_id = aa431178-9e98-4cd5-8fa2-adff7092c9a7
552026-01-12T09:29:47.162ZINFOcrucible-pantry (datafile): Crucible stats registered with UUID: d4dbbbcd-0591-4069-986c-2f36408bee61 session_id = aa431178-9e98-4cd5-8fa2-adff7092c9a7
562026-01-12T09:29:47.166ZINFOcrucible-pantry (datafile): notify_task started job = notify session_id = aa431178-9e98-4cd5-8fa2-adff7092c9a7
572026-01-12T09:29:47.166ZINFOcrucible-pantry (datafile): client is waiting for oneshot = io task client = 0 session_id = aa431178-9e98-4cd5-8fa2-adff7092c9a7
582026-01-12T09:29:47.166ZINFOcrucible-pantry (datafile): client is waiting for oneshot = io task client = 1 session_id = aa431178-9e98-4cd5-8fa2-adff7092c9a7
592026-01-12T09:29:47.170ZINFOcrucible-pantry (datafile): client is waiting for oneshot = io task client = 2 session_id = aa431178-9e98-4cd5-8fa2-adff7092c9a7
602026-01-12T09:29:47.172ZINFOcrucible-pantry (datafile): volume d4dbbbcd-0591-4069-986c-2f36408bee61 constructed ok
612026-01-12T09:29:47.172ZINFOcrucible-pantry (datafile): The guest has requested activation
622026-01-12T09:29:47.172ZINFOcrucible-pantry (datafile): d4dbbbcd-0591-4069-986c-2f36408bee61 active request set session_id = aa431178-9e98-4cd5-8fa2-adff7092c9a7
632026-01-12T09:29:47.172ZINFOcrucible-pantry (datafile): sending connect oneshot to client = downstairs client = 0 session_id = aa431178-9e98-4cd5-8fa2-adff7092c9a7
642026-01-12T09:29:47.172ZINFOcrucible-pantry (datafile): sending connect oneshot to client = downstairs client = 1 session_id = aa431178-9e98-4cd5-8fa2-adff7092c9a7
652026-01-12T09:29:47.172ZINFOcrucible-pantry (datafile): sending connect oneshot to client = downstairs client = 2 session_id = aa431178-9e98-4cd5-8fa2-adff7092c9a7
662026-01-12T09:29:47.172ZINFOcrucible-pantry (datafile): connecting to [fd00:1122:3344:101::12]:19000 = io task client = 2 session_id = aa431178-9e98-4cd5-8fa2-adff7092c9a7
672026-01-12T09:29:47.172ZINFOcrucible-pantry (datafile): connecting to [fd00:1122:3344:101::19]:19000 = io task client = 0 session_id = aa431178-9e98-4cd5-8fa2-adff7092c9a7
682026-01-12T09:29:47.172ZINFOcrucible-pantry (datafile): connecting to [fd00:1122:3344:101::1a]:19000 = io task client = 1 session_id = aa431178-9e98-4cd5-8fa2-adff7092c9a7
692026-01-12T09:29:47.173ZINFOcrucible-pantry (datafile): ds_connection connected from Ok([fd00:1122:3344:101::11]:59982) = io task client = 0 session_id = aa431178-9e98-4cd5-8fa2-adff7092c9a7
702026-01-12T09:29:47.173ZINFOcrucible-pantry (datafile): ds_connection connected from Ok([fd00:1122:3344:101::11]:57220) = io task client = 1 session_id = aa431178-9e98-4cd5-8fa2-adff7092c9a7
712026-01-12T09:29:47.173ZINFOcrucible-pantry (datafile): ds_connection connected from Ok([fd00:1122:3344:101::11]:51548) = io task client = 2 session_id = aa431178-9e98-4cd5-8fa2-adff7092c9a7
722026-01-12T09:29:47.178ZINFOcrucible-pantry (datafile): downstairs client at Some([fd00:1122:3344:101::1a]:19000) has region UUID f493d81a-2a4f-46a4-b151-9452ce926acc = downstairs client = 1 session_id = aa431178-9e98-4cd5-8fa2-adff7092c9a7
732026-01-12T09:29:47.178ZINFOcrucible-pantry (datafile): downstairs client at Some([fd00:1122:3344:101::19]:19000) has region UUID 9ccdd5c3-d889-46a1-bc48-7e2f9e36b086 = downstairs client = 0 session_id = aa431178-9e98-4cd5-8fa2-adff7092c9a7
742026-01-12T09:29:47.178ZINFOcrucible-pantry (datafile): Waiting for more clients to be ready session_id = aa431178-9e98-4cd5-8fa2-adff7092c9a7
752026-01-12T09:29:47.178ZINFOcrucible-pantry (datafile): Waiting for more clients to be ready session_id = aa431178-9e98-4cd5-8fa2-adff7092c9a7
762026-01-12T09:29:47.180ZINFOcrucible-pantry (datafile): downstairs client at Some([fd00:1122:3344:101::12]:19000) has region UUID e6e7c006-3d1e-4c15-8760-36476acd7534 = downstairs client = 2 session_id = aa431178-9e98-4cd5-8fa2-adff7092c9a7
772026-01-12T09:29:47.180ZINFOcrucible-pantry (datafile): [0]R flush_numbers[0..12]: [0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0] = downstairs session_id = aa431178-9e98-4cd5-8fa2-adff7092c9a7
782026-01-12T09:29:47.180ZINFOcrucible-pantry (datafile): [0]R generation[0..12]: [0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0] = downstairs session_id = aa431178-9e98-4cd5-8fa2-adff7092c9a7
792026-01-12T09:29:47.180ZINFOcrucible-pantry (datafile): [0]R dirty[0..12]: [false, false, false, false, false, false, false, false, false, false, false, false] = downstairs session_id = aa431178-9e98-4cd5-8fa2-adff7092c9a7
802026-01-12T09:29:47.180ZINFOcrucible-pantry (datafile): [1]R flush_numbers[0..12]: [0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0] = downstairs session_id = aa431178-9e98-4cd5-8fa2-adff7092c9a7
812026-01-12T09:29:47.180ZINFOcrucible-pantry (datafile): [1]R generation[0..12]: [0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0] = downstairs session_id = aa431178-9e98-4cd5-8fa2-adff7092c9a7
822026-01-12T09:29:47.180ZINFOcrucible-pantry (datafile): [1]R dirty[0..12]: [false, false, false, false, false, false, false, false, false, false, false, false] = downstairs session_id = aa431178-9e98-4cd5-8fa2-adff7092c9a7
832026-01-12T09:29:47.180ZINFOcrucible-pantry (datafile): [2]R flush_numbers[0..12]: [0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0] = downstairs session_id = aa431178-9e98-4cd5-8fa2-adff7092c9a7
842026-01-12T09:29:47.180ZINFOcrucible-pantry (datafile): [2]R generation[0..12]: [0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0] = downstairs session_id = aa431178-9e98-4cd5-8fa2-adff7092c9a7
852026-01-12T09:29:47.180ZINFOcrucible-pantry (datafile): [2]R dirty[0..12]: [false, false, false, false, false, false, false, false, false, false, false, false] = downstairs session_id = aa431178-9e98-4cd5-8fa2-adff7092c9a7
862026-01-12T09:29:47.180ZINFOcrucible-pantry (datafile): Max found gen is 1 = downstairs session_id = aa431178-9e98-4cd5-8fa2-adff7092c9a7
872026-01-12T09:29:47.180ZINFOcrucible-pantry (datafile): Generation requested: 1 >= found:1 = downstairs session_id = aa431178-9e98-4cd5-8fa2-adff7092c9a7
882026-01-12T09:29:47.180ZINFOcrucible-pantry (datafile): Next flush: 1 = downstairs session_id = aa431178-9e98-4cd5-8fa2-adff7092c9a7
892026-01-12T09:29:47.180ZINFOcrucible-pantry (datafile): All extents match = downstairs session_id = aa431178-9e98-4cd5-8fa2-adff7092c9a7
902026-01-12T09:29:47.180ZINFOcrucible-pantry (datafile): No downstairs reconciliation required session_id = aa431178-9e98-4cd5-8fa2-adff7092c9a7
912026-01-12T09:29:47.180ZINFOcrucible-pantry (datafile): Transition from WaitQuorum to Active = downstairs client = 0 session_id = aa431178-9e98-4cd5-8fa2-adff7092c9a7
922026-01-12T09:29:47.180ZINFOcrucible-pantry (datafile): Transition from WaitQuorum to Active = downstairs client = 1 session_id = aa431178-9e98-4cd5-8fa2-adff7092c9a7
932026-01-12T09:29:47.180ZINFOcrucible-pantry (datafile): Transition from WaitQuorum to Active = downstairs client = 2 session_id = aa431178-9e98-4cd5-8fa2-adff7092c9a7
942026-01-12T09:29:47.180ZINFOcrucible-pantry (datafile): All required reconciliation work is completed session_id = aa431178-9e98-4cd5-8fa2-adff7092c9a7
952026-01-12T09:29:47.180ZINFOcrucible-pantry (datafile): Set Downstairs and Upstairs active after reconciliation session_id = aa431178-9e98-4cd5-8fa2-adff7092c9a7
962026-01-12T09:29:47.180ZINFOcrucible-pantry (datafile): d4dbbbcd-0591-4069-986c-2f36408bee61 is now active with session: aa431178-9e98-4cd5-8fa2-adff7092c9a7 session_id = aa431178-9e98-4cd5-8fa2-adff7092c9a7
972026-01-12T09:29:47.180ZINFOcrucible-pantry (datafile): Set Active after no reconciliation session_id = aa431178-9e98-4cd5-8fa2-adff7092c9a7
982026-01-12T09:29:47.182ZINFOcrucible-pantry (datafile): The guest has finished waiting for activation
992026-01-12T09:29:47.182ZINFOcrucible-pantry (datafile): Activated sub_volume d4dbbbcd-0591-4069-986c-2f36408bee61
1002026-01-12T09:29:47.182ZINFOcrucible-pantry (datafile): Activated sub_volume 2ad519e5-ccdc-4342-9ca6-3b7f982e3b50
1012026-01-12T09:29:47.182ZINFOcrucible-pantry (datafile): volume d4dbbbcd-0591-4069-986c-2f36408bee61 activated ok
1022026-01-12T09:29:47.182ZINFOcrucible-pantry (datafile): volume d4dbbbcd-0591-4069-986c-2f36408bee61 constructed and inserted ok
1032026-01-12T09:29:47.182ZINFOcrucible-pantry (dropshot): request completed latency_us = 80773 local_addr = [fd00:1122:3344:101::11]:17000 method = POST remote_addr = [fd00:1122:3344:101::c]:60779 req_id = 1a695e9f-d5b8-408f-86ec-d085970f9780 response_code = 200 uri = /crucible/pantry/0/volume/d4dbbbcd-0591-4069-986c-2f36408bee61
1042026-01-12T09:29:48.607ZINFOcrucible-pantry (dropshot): accepted connection local_addr = [fd00:1122:3344:101::11]:17000 remote_addr = [fd00:1122:3344:101::c]:65047
1052026-01-12T09:29:48.613ZINFOcrucible-pantry (dropshot): request completed latency_us = 5591 local_addr = [fd00:1122:3344:101::11]:17000 method = POST remote_addr = [fd00:1122:3344:101::c]:65047 req_id = b389f2e6-a86b-4306-8786-3a23676cf8a3 response_code = 204 uri = /crucible/pantry/0/volume/d4dbbbcd-0591-4069-986c-2f36408bee61/bulk-write
1062026-01-12T09:29:49.636ZINFOcrucible-pantry (dropshot): request completed latency_us = 1520 local_addr = [fd00:1122:3344:101::11]:17000 method = POST remote_addr = [fd00:1122:3344:101::c]:65047 req_id = 82f12e0d-b968-4dbc-b5c8-761e323df147 response_code = 204 uri = /crucible/pantry/0/volume/d4dbbbcd-0591-4069-986c-2f36408bee61/bulk-write
1072026-01-12T09:29:50.207ZINFOcrucible-pantry (dropshot): request completed latency_us = 910 local_addr = [fd00:1122:3344:101::11]:17000 method = POST remote_addr = [fd00:1122:3344:101::c]:65047 req_id = b0a8e9e0-4003-4fc0-80bb-ccb249cdeb0f response_code = 204 uri = /crucible/pantry/0/volume/d4dbbbcd-0591-4069-986c-2f36408bee61/bulk-write
1082026-01-12T09:29:50.707ZINFOcrucible-pantry (dropshot): request completed latency_us = 874 local_addr = [fd00:1122:3344:101::11]:17000 method = POST remote_addr = [fd00:1122:3344:101::c]:65047 req_id = 068e4ae6-795d-4b1e-9303-3796fc544cbb response_code = 204 uri = /crucible/pantry/0/volume/d4dbbbcd-0591-4069-986c-2f36408bee61/bulk-write
1092026-01-12T09:29:50.798ZINFOcrucible-pantry (dropshot): request completed latency_us = 44 local_addr = [fd00:1122:3344:101::11]:17000 method = GET remote_addr = [fd00:1122:3344:101::c]:55661 req_id = f49346b7-aede-409c-a469-aa7b353e0743 response_code = 200 uri = /crucible/pantry/0
1102026-01-12T09:29:51.187ZINFOcrucible-pantry (dropshot): request completed latency_us = 2068 local_addr = [fd00:1122:3344:101::11]:17000 method = POST remote_addr = [fd00:1122:3344:101::c]:65047 req_id = 328b11f9-57b7-4bd6-aabc-2625da785377 response_code = 204 uri = /crucible/pantry/0/volume/d4dbbbcd-0591-4069-986c-2f36408bee61/bulk-write
1112026-01-12T09:29:51.214ZINFOcrucible-pantry (dropshot): accepted connection local_addr = [fd00:1122:3344:101::11]:17000 remote_addr = [fd00:1122:3344:101::c]:63966
1122026-01-12T09:29:51.214ZINFOcrucible-pantry (dropshot): request completed latency_us = 38 local_addr = [fd00:1122:3344:101::11]:17000 method = GET remote_addr = [fd00:1122:3344:101::c]:63966 req_id = 724b173f-448b-44de-b63e-b5e7c6f0f8b8 response_code = 200 uri = /crucible/pantry/0
1132026-01-12T09:29:51.311ZINFOcrucible-pantry (dropshot): accepted connection local_addr = [fd00:1122:3344:101::11]:17000 remote_addr = [fd00:1122:3344:101::c]:52646
1142026-01-12T09:29:51.311ZINFOcrucible-pantry (dropshot): request completed latency_us = 29 local_addr = [fd00:1122:3344:101::11]:17000 method = GET remote_addr = [fd00:1122:3344:101::c]:52646 req_id = 1ef59734-7493-4e34-8236-271ceb5cc913 response_code = 200 uri = /crucible/pantry/0
1152026-01-12T09:29:51.680ZINFOcrucible-pantry (dropshot): request completed latency_us = 1663 local_addr = [fd00:1122:3344:101::11]:17000 method = POST remote_addr = [fd00:1122:3344:101::c]:65047 req_id = e6f5e151-bf4a-4bb5-91dc-d24311c241ac response_code = 204 uri = /crucible/pantry/0/volume/d4dbbbcd-0591-4069-986c-2f36408bee61/bulk-write
1162026-01-12T09:29:52.059ZINFOcrucible-pantry (dropshot): accepted connection local_addr = [fd00:1122:3344:101::11]:17000 remote_addr = [fd00:1122:3344:101::b]:54953
1172026-01-12T09:29:52.059ZINFOcrucible-pantry (dropshot): request completed latency_us = 41 local_addr = [fd00:1122:3344:101::11]:17000 method = GET remote_addr = [fd00:1122:3344:101::b]:54953 req_id = 61c4bd4f-28bd-4a65-9f93-41b1e095457d response_code = 200 uri = /crucible/pantry/0
1182026-01-12T09:29:52.067ZINFOcrucible-pantry (dropshot): accepted connection local_addr = [fd00:1122:3344:101::11]:17000 remote_addr = [fd00:1122:3344:101::a]:54297
1192026-01-12T09:29:52.067ZINFOcrucible-pantry (dropshot): request completed latency_us = 27 local_addr = [fd00:1122:3344:101::11]:17000 method = GET remote_addr = [fd00:1122:3344:101::a]:54297 req_id = 138f34b4-09d6-4868-8bff-60de85a56a64 response_code = 200 uri = /crucible/pantry/0
1202026-01-12T09:29:52.154ZINFOcrucible-pantry (dropshot): request completed latency_us = 1784 local_addr = [fd00:1122:3344:101::11]:17000 method = POST remote_addr = [fd00:1122:3344:101::c]:65047 req_id = 919b857a-1a3e-4300-bac1-f3bec87ce080 response_code = 204 uri = /crucible/pantry/0/volume/d4dbbbcd-0591-4069-986c-2f36408bee61/bulk-write
1212026-01-12T09:29:52.257ZINFOcrucible-pantry (dropshot): accepted connection local_addr = [fd00:1122:3344:101::11]:17000 remote_addr = [fd00:1122:3344:101::a]:62395
1222026-01-12T09:29:52.257ZINFOcrucible-pantry (dropshot): request completed latency_us = 47 local_addr = [fd00:1122:3344:101::11]:17000 method = GET remote_addr = [fd00:1122:3344:101::a]:62395 req_id = d6f3f64e-4ac9-4a94-b7dd-3b71b7df2ead response_code = 200 uri = /crucible/pantry/0
1232026-01-12T09:29:52.325ZINFOcrucible-pantry (dropshot): accepted connection local_addr = [fd00:1122:3344:101::11]:17000 remote_addr = [fd00:1122:3344:101::a]:34962
1242026-01-12T09:29:52.325ZINFOcrucible-pantry (dropshot): request completed latency_us = 35 local_addr = [fd00:1122:3344:101::11]:17000 method = GET remote_addr = [fd00:1122:3344:101::a]:34962 req_id = 71015a22-7c56-4b4c-872c-7c438feb670e response_code = 200 uri = /crucible/pantry/0
1252026-01-12T09:29:52.489ZINFOcrucible-pantry (dropshot): accepted connection local_addr = [fd00:1122:3344:101::11]:17000 remote_addr = [fd00:1122:3344:101::b]:60713
1262026-01-12T09:29:52.490ZINFOcrucible-pantry (dropshot): request completed latency_us = 29 local_addr = [fd00:1122:3344:101::11]:17000 method = GET remote_addr = [fd00:1122:3344:101::b]:60713 req_id = 652b52c5-60c9-4a3e-bfa5-6a72bba74768 response_code = 200 uri = /crucible/pantry/0
1272026-01-12T09:29:52.542ZINFOcrucible-pantry (dropshot): accepted connection local_addr = [fd00:1122:3344:101::11]:17000 remote_addr = [fd00:1122:3344:101::b]:46521
1282026-01-12T09:29:52.542ZINFOcrucible-pantry (dropshot): request completed latency_us = 30 local_addr = [fd00:1122:3344:101::11]:17000 method = GET remote_addr = [fd00:1122:3344:101::b]:46521 req_id = a19f16c6-f161-49f3-8dba-df9ed12196a9 response_code = 200 uri = /crucible/pantry/0
1292026-01-12T09:29:52.637ZINFOcrucible-pantry (dropshot): request completed latency_us = 1159 local_addr = [fd00:1122:3344:101::11]:17000 method = POST remote_addr = [fd00:1122:3344:101::c]:65047 req_id = b88f1f14-b6c6-4a13-94ca-e667f666c074 response_code = 204 uri = /crucible/pantry/0/volume/d4dbbbcd-0591-4069-986c-2f36408bee61/bulk-write
1302026-01-12T09:29:53.115ZINFOcrucible-pantry (dropshot): request completed latency_us = 1482 local_addr = [fd00:1122:3344:101::11]:17000 method = POST remote_addr = [fd00:1122:3344:101::c]:65047 req_id = e8eb7709-16a8-4562-b6fe-6c261d718258 response_code = 204 uri = /crucible/pantry/0/volume/d4dbbbcd-0591-4069-986c-2f36408bee61/bulk-write
1312026-01-12T09:29:53.601ZINFOcrucible-pantry (dropshot): request completed latency_us = 1293 local_addr = [fd00:1122:3344:101::11]:17000 method = POST remote_addr = [fd00:1122:3344:101::c]:65047 req_id = cd722148-010d-4872-b6e8-d08e61522e0e response_code = 204 uri = /crucible/pantry/0/volume/d4dbbbcd-0591-4069-986c-2f36408bee61/bulk-write
1322026-01-12T09:29:54.078ZINFOcrucible-pantry (dropshot): request completed latency_us = 1711 local_addr = [fd00:1122:3344:101::11]:17000 method = POST remote_addr = [fd00:1122:3344:101::c]:65047 req_id = 23a3716b-b4e6-46cc-be2e-eba5b81b7eff response_code = 204 uri = /crucible/pantry/0/volume/d4dbbbcd-0591-4069-986c-2f36408bee61/bulk-write
1332026-01-12T09:29:54.558ZINFOcrucible-pantry (dropshot): request completed latency_us = 1676 local_addr = [fd00:1122:3344:101::11]:17000 method = POST remote_addr = [fd00:1122:3344:101::c]:65047 req_id = 953847e8-a92e-4172-86c9-65b3f95f728c response_code = 204 uri = /crucible/pantry/0/volume/d4dbbbcd-0591-4069-986c-2f36408bee61/bulk-write
1342026-01-12T09:29:55.035ZINFOcrucible-pantry (dropshot): request completed latency_us = 1590 local_addr = [fd00:1122:3344:101::11]:17000 method = POST remote_addr = [fd00:1122:3344:101::c]:65047 req_id = b82f82df-baef-456f-bef7-a2912b9215f1 response_code = 204 uri = /crucible/pantry/0/volume/d4dbbbcd-0591-4069-986c-2f36408bee61/bulk-write
1352026-01-12T09:29:55.517ZINFOcrucible-pantry (dropshot): request completed latency_us = 1078 local_addr = [fd00:1122:3344:101::11]:17000 method = POST remote_addr = [fd00:1122:3344:101::c]:65047 req_id = 5c80875a-c0d2-4aa3-9f54-f44699afcf8b response_code = 204 uri = /crucible/pantry/0/volume/d4dbbbcd-0591-4069-986c-2f36408bee61/bulk-write
1362026-01-12T09:29:55.996ZINFOcrucible-pantry (dropshot): request completed latency_us = 966 local_addr = [fd00:1122:3344:101::11]:17000 method = POST remote_addr = [fd00:1122:3344:101::c]:65047 req_id = beac58b0-486d-4d29-9318-56864cc881c9 response_code = 204 uri = /crucible/pantry/0/volume/d4dbbbcd-0591-4069-986c-2f36408bee61/bulk-write
1372026-01-12T09:29:56.483ZINFOcrucible-pantry (dropshot): request completed latency_us = 1677 local_addr = [fd00:1122:3344:101::11]:17000 method = POST remote_addr = [fd00:1122:3344:101::c]:65047 req_id = 4fa4a314-56dc-406c-9a7b-b176eae9c68c response_code = 204 uri = /crucible/pantry/0/volume/d4dbbbcd-0591-4069-986c-2f36408bee61/bulk-write
1382026-01-12T09:29:57.003ZINFOcrucible-pantry (dropshot): request completed latency_us = 1250 local_addr = [fd00:1122:3344:101::11]:17000 method = POST remote_addr = [fd00:1122:3344:101::c]:65047 req_id = 3dac4991-c5fb-4343-96bf-9f07fa6c254a response_code = 204 uri = /crucible/pantry/0/volume/d4dbbbcd-0591-4069-986c-2f36408bee61/bulk-write
1392026-01-12T09:29:57.496ZINFOcrucible-pantry (dropshot): request completed latency_us = 923 local_addr = [fd00:1122:3344:101::11]:17000 method = POST remote_addr = [fd00:1122:3344:101::c]:65047 req_id = 415f17d1-bb58-4fef-a84f-daa4b483ced7 response_code = 204 uri = /crucible/pantry/0/volume/d4dbbbcd-0591-4069-986c-2f36408bee61/bulk-write
1402026-01-12T09:29:58.148ZINFOcrucible-pantry (dropshot): request completed latency_us = 1359 local_addr = [fd00:1122:3344:101::11]:17000 method = POST remote_addr = [fd00:1122:3344:101::c]:65047 req_id = 9f3c80f0-2b61-4f9f-8504-9b6cb6651786 response_code = 204 uri = /crucible/pantry/0/volume/d4dbbbcd-0591-4069-986c-2f36408bee61/bulk-write
1412026-01-12T09:29:58.630ZINFOcrucible-pantry (dropshot): request completed latency_us = 1099 local_addr = [fd00:1122:3344:101::11]:17000 method = POST remote_addr = [fd00:1122:3344:101::c]:65047 req_id = efeb8591-5d59-4c75-9806-031f65f3ab1e response_code = 204 uri = /crucible/pantry/0/volume/d4dbbbcd-0591-4069-986c-2f36408bee61/bulk-write
1422026-01-12T09:29:58.793ZINFOcrucible-pantry (dropshot): request completed latency_us = 1587 local_addr = [fd00:1122:3344:101::11]:17000 method = POST remote_addr = [fd00:1122:3344:101::c]:65047 req_id = 92eef516-544e-43e9-b23f-095ce8dc34ab response_code = 204 uri = /crucible/pantry/0/volume/d4dbbbcd-0591-4069-986c-2f36408bee61/bulk-write
1432026-01-12T09:29:59.688ZINFOcrucible-pantry (dropshot): request completed latency_us = 983 local_addr = [fd00:1122:3344:101::11]:17000 method = POST remote_addr = [fd00:1122:3344:101::c]:65047 req_id = cc7d0604-2836-427f-8e97-b0dc5f13c6af response_code = 204 uri = /crucible/pantry/0/volume/d4dbbbcd-0591-4069-986c-2f36408bee61/bulk-write
1442026-01-12T09:30:00.177ZINFOcrucible-pantry (dropshot): request completed latency_us = 1002 local_addr = [fd00:1122:3344:101::11]:17000 method = POST remote_addr = [fd00:1122:3344:101::c]:65047 req_id = afced7f2-90d6-4bd9-9763-e6aa322a5948 response_code = 204 uri = /crucible/pantry/0/volume/d4dbbbcd-0591-4069-986c-2f36408bee61/bulk-write
1452026-01-12T09:30:00.675ZINFOcrucible-pantry (dropshot): request completed latency_us = 1285 local_addr = [fd00:1122:3344:101::11]:17000 method = POST remote_addr = [fd00:1122:3344:101::c]:65047 req_id = eb777ac3-83d0-42e4-83db-c8c4be8b270a response_code = 204 uri = /crucible/pantry/0/volume/d4dbbbcd-0591-4069-986c-2f36408bee61/bulk-write
1462026-01-12T09:30:01.172ZINFOcrucible-pantry (dropshot): request completed latency_us = 1037 local_addr = [fd00:1122:3344:101::11]:17000 method = POST remote_addr = [fd00:1122:3344:101::c]:65047 req_id = 12f3e0f0-cabe-44f7-8630-8923c2859b56 response_code = 204 uri = /crucible/pantry/0/volume/d4dbbbcd-0591-4069-986c-2f36408bee61/bulk-write
1472026-01-12T09:30:01.664ZINFOcrucible-pantry (dropshot): request completed latency_us = 1011 local_addr = [fd00:1122:3344:101::11]:17000 method = POST remote_addr = [fd00:1122:3344:101::c]:65047 req_id = 3097f23a-07a1-475c-aa2c-943b853b44f7 response_code = 204 uri = /crucible/pantry/0/volume/d4dbbbcd-0591-4069-986c-2f36408bee61/bulk-write
1482026-01-12T09:30:01.817ZINFOcrucible-pantry (dropshot): request completed latency_us = 1073 local_addr = [fd00:1122:3344:101::11]:17000 method = POST remote_addr = [fd00:1122:3344:101::c]:65047 req_id = 8884ccfd-24d6-4c6c-a146-c68c7270944e response_code = 204 uri = /crucible/pantry/0/volume/d4dbbbcd-0591-4069-986c-2f36408bee61/bulk-write
1492026-01-12T09:30:01.959ZINFOcrucible-pantry (dropshot): request completed latency_us = 1109 local_addr = [fd00:1122:3344:101::11]:17000 method = POST remote_addr = [fd00:1122:3344:101::c]:65047 req_id = b255017f-09a3-4b6c-9900-a788301b7ae2 response_code = 204 uri = /crucible/pantry/0/volume/d4dbbbcd-0591-4069-986c-2f36408bee61/bulk-write
1502026-01-12T09:30:02.107ZINFOcrucible-pantry (dropshot): request completed latency_us = 1021 local_addr = [fd00:1122:3344:101::11]:17000 method = POST remote_addr = [fd00:1122:3344:101::c]:65047 req_id = ab368d94-b1a9-4085-9b36-e7c3fc48171d response_code = 204 uri = /crucible/pantry/0/volume/d4dbbbcd-0591-4069-986c-2f36408bee61/bulk-write
1512026-01-12T09:30:02.598ZINFOcrucible-pantry (dropshot): request completed latency_us = 1176 local_addr = [fd00:1122:3344:101::11]:17000 method = POST remote_addr = [fd00:1122:3344:101::c]:65047 req_id = c99f6c16-7f43-49a2-b4d2-1baf204b3aba response_code = 204 uri = /crucible/pantry/0/volume/d4dbbbcd-0591-4069-986c-2f36408bee61/bulk-write