Max level shown:
12026-05-04T16:05:42.569ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::16]:32345 remote_addr = [fd00:1122:3344:101::b]:58736
22026-05-04T16:05:42.569ZINFOcrucible-agent (datafile): region c5d0760a-a321-4405-8274-cf3535b45df5 state: Requested
32026-05-04T16:05:42.570ZINFOcrucible-agent (dropshot): request completed latency_us = 640 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:58736 req_id = d38cbe3a-6e54-4d2d-8660-50c9a35ceae0 response_code = 200 uri = /crucible/0/regions
42026-05-04T16:05:42.570ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
52026-05-04T16:05:42.581ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_13b4c688-ba63-4252-9bf6-21050f27c0bb/crucible/regions/c5d0760a-a321-4405-8274-cf3535b45df5
62026-05-04T16:05:42.581ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_13b4c688-ba63-4252-9bf6-21050f27c0bb/crucible/regions/c5d0760a-a321-4405-8274-cf3535b45df5
72026-05-04T16:05:42.647ZINFOcrucible-agent (worker): creating region Region { id: RegionId("c5d0760a-a321-4405-8274-cf3535b45df5"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/c5d0760a-a321-4405-8274-cf3535b45df5" region = c5d0760a-a321-4405-8274-cf3535b45df5
82026-05-04T16:05:42.647ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "c5d0760a-a321-4405-8274-cf3535b45df5" "--data" "/data/regions/c5d0760a-a321-4405-8274-cf3535b45df5" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = c5d0760a-a321-4405-8274-cf3535b45df5
92026-05-04T16:05:42.822ZINFOcrucible-agent (worker): region files created ok region = c5d0760a-a321-4405-8274-cf3535b45df5
102026-05-04T16:05:42.822ZINFOcrucible-agent (datafile): region c5d0760a-a321-4405-8274-cf3535b45df5 state: Requested -> Created
112026-05-04T16:05:42.822ZINFOcrucible-agent (worker): applying SMF actions post create...
122026-05-04T16:05:42.822ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-c5d0760a-a321-4405-8274-cf3535b45df5
132026-05-04T16:05:42.834ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-c5d0760a-a321-4405-8274-cf3535b45df5
142026-05-04T16:05:42.853ZINFOcrucible-agent (worker): creating config property group
152026-05-04T16:05:42.855ZINFOcrucible-agent (dropshot): request completed latency_us = 55 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:58736 req_id = 2a2c54b5-fd4c-4f32-a109-9461676acf41 response_code = 200 uri = /crucible/0/regions
162026-05-04T16:05:42.858ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-c5d0760a-a321-4405-8274-cf3535b45df5
172026-05-04T16:05:42.859ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/c5d0760a-a321-4405-8274-cf3535b45df5
182026-05-04T16:05:42.859ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
192026-05-04T16:05:42.859ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::16
202026-05-04T16:05:42.859ZINFOcrucible-agent (worker): commit
212026-05-04T16:05:42.863ZINFOcrucible-agent (worker): ok!
222026-05-04T16:05:42.880ZINFOcrucible-agent (worker): SMF ok!
232026-05-04T16:05:43.710ZINFOcrucible-agent (dropshot): request completed latency_us = 78 local_addr = [fd00:1122:3344:101::16]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:58736 req_id = fa55b879-d899-4167-8893-089ae5ca7a7f response_code = 200 uri = /crucible/0/regions/e10c490b-ccf4-442c-bc42-2ab0afb2498a
242026-05-04T16:05:43.715ZINFOcrucible-agent (datafile): path is "/data/regions/e10c490b-ccf4-442c-bc42-2ab0afb2498a"
252026-05-04T16:05:43.721ZINFOcrucible-agent (datafile): dataset is oxp_13b4c688-ba63-4252-9bf6-21050f27c0bb/crucible/regions/e10c490b-ccf4-442c-bc42-2ab0afb2498a
262026-05-04T16:05:43.727ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_13b4c688-ba63-4252-9bf6-21050f27c0bb/crucible/regions/e10c490b-ccf4-442c-bc42-2ab0afb2498a@6eea5b10-951c-4a5f-8465-bffe923520e7
272026-05-04T16:05:43.727ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_13b4c688-ba63-4252-9bf6-21050f27c0bb/crucible/regions/e10c490b-ccf4-442c-bc42-2ab0afb2498a", "6eea5b10-951c-4a5f-8465-bffe923520e7"]
282026-05-04T16:05:43.735ZINFOcrucible-agent (dropshot): request completed latency_us = 19731 local_addr = [fd00:1122:3344:101::16]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:58736 req_id = 41598218-5560-42c7-916f-a166df4eb762 response_code = 200 uri = /crucible/0/regions/e10c490b-ccf4-442c-bc42-2ab0afb2498a/snapshots/6eea5b10-951c-4a5f-8465-bffe923520e7
292026-05-04T16:05:43.742ZINFOcrucible-agent (datafile): path is "/data/regions/e10c490b-ccf4-442c-bc42-2ab0afb2498a"
302026-05-04T16:05:43.748ZINFOcrucible-agent (datafile): dataset is oxp_13b4c688-ba63-4252-9bf6-21050f27c0bb/crucible/regions/e10c490b-ccf4-442c-bc42-2ab0afb2498a
312026-05-04T16:05:43.754ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_13b4c688-ba63-4252-9bf6-21050f27c0bb/crucible/regions/e10c490b-ccf4-442c-bc42-2ab0afb2498a@6eea5b10-951c-4a5f-8465-bffe923520e7
322026-05-04T16:05:43.754ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_13b4c688-ba63-4252-9bf6-21050f27c0bb/crucible/regions/e10c490b-ccf4-442c-bc42-2ab0afb2498a", "6eea5b10-951c-4a5f-8465-bffe923520e7"]
332026-05-04T16:05:43.760ZINFOcrucible-agent (datafile): requesting running snapshot e10c490b-ccf4-442c-bc42-2ab0afb2498a-6eea5b10-951c-4a5f-8465-bffe923520e7 state: Requested
342026-05-04T16:05:43.760ZINFOcrucible-agent (dropshot): request completed latency_us = 17928 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:58736 req_id = 8b8c18b5-d5da-46e9-91c1-34a2ba9c68ae response_code = 200 uri = /crucible/0/regions/e10c490b-ccf4-442c-bc42-2ab0afb2498a/snapshots/6eea5b10-951c-4a5f-8465-bffe923520e7/run
352026-05-04T16:05:43.760ZINFOcrucible-agent (worker): applying SMF actions for region e10c490b-ccf4-442c-bc42-2ab0afb2498a running snapshot 6eea5b10-951c-4a5f-8465-bffe923520e7 (state Requested)...
362026-05-04T16:05:43.765ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-e10c490b-ccf4-442c-bc42-2ab0afb2498a-6eea5b10-951c-4a5f-8465-bffe923520e7
372026-05-04T16:05:43.773ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-e10c490b-ccf4-442c-bc42-2ab0afb2498a-6eea5b10-951c-4a5f-8465-bffe923520e7
382026-05-04T16:05:43.783ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-e10c490b-ccf4-442c-bc42-2ab0afb2498a-6eea5b10-951c-4a5f-8465-bffe923520e7
392026-05-04T16:05:43.783ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/e10c490b-ccf4-442c-bc42-2ab0afb2498a/.zfs/snapshot/6eea5b10-951c-4a5f-8465-bffe923520e7
402026-05-04T16:05:43.783ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19002
412026-05-04T16:05:43.783ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
422026-05-04T16:05:43.783ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::16
432026-05-04T16:05:43.783ZINFOcrucible-agent (worker): commit
442026-05-04T16:05:43.787ZINFOcrucible-agent (worker): ok!
452026-05-04T16:05:43.792ZINFOcrucible-agent (worker): SMF ok!
462026-05-04T16:05:43.792ZINFOcrucible-agent (datafile): region e10c490b-ccf4-442c-bc42-2ab0afb2498a running snapshot 6eea5b10-951c-4a5f-8465-bffe923520e7 state: Requested -> Created
472026-05-04T16:05:44.055ZINFOcrucible-agent (datafile): path is "/data/regions/e10c490b-ccf4-442c-bc42-2ab0afb2498a"
482026-05-04T16:05:44.062ZINFOcrucible-agent (datafile): dataset is oxp_13b4c688-ba63-4252-9bf6-21050f27c0bb/crucible/regions/e10c490b-ccf4-442c-bc42-2ab0afb2498a
492026-05-04T16:05:44.068ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_13b4c688-ba63-4252-9bf6-21050f27c0bb/crucible/regions/e10c490b-ccf4-442c-bc42-2ab0afb2498a@6eea5b10-951c-4a5f-8465-bffe923520e7
502026-05-04T16:05:44.068ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_13b4c688-ba63-4252-9bf6-21050f27c0bb/crucible/regions/e10c490b-ccf4-442c-bc42-2ab0afb2498a", "6eea5b10-951c-4a5f-8465-bffe923520e7"]
512026-05-04T16:05:44.073ZINFOcrucible-agent (dropshot): request completed latency_us = 17651 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:58736 req_id = 9fff529d-7187-4716-b785-1439a221fa07 response_code = 200 uri = /crucible/0/regions/e10c490b-ccf4-442c-bc42-2ab0afb2498a/snapshots/6eea5b10-951c-4a5f-8465-bffe923520e7/run