Max level shown:
12026-09-04T23:15:42.208ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::17]:32345 remote_addr = [fd00:1122:3344:101::c]:49800
22026-09-04T23:15:42.242ZINFOcrucible-agent (datafile): region 878ab425-73f0-4e98-ba51-d919a594cd87 state: Requested
32026-09-04T23:15:42.246ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
42026-09-04T23:15:42.250ZINFOcrucible-agent (dropshot): request completed latency_us = 15477 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:49800 req_id = 86db2c7f-571e-4729-ade2-23ef5f75dd62 response_code = 200 uri = /crucible/0/regions
52026-09-04T23:15:42.255ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_68e8ffcb-f300-4fe7-a579-67aa0ffffd1e/crucible/regions/878ab425-73f0-4e98-ba51-d919a594cd87
62026-09-04T23:15:42.255ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_68e8ffcb-f300-4fe7-a579-67aa0ffffd1e/crucible/regions/878ab425-73f0-4e98-ba51-d919a594cd87
72026-09-04T23:15:42.296ZINFOcrucible-agent (worker): creating region Region { id: RegionId("878ab425-73f0-4e98-ba51-d919a594cd87"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/878ab425-73f0-4e98-ba51-d919a594cd87" region = 878ab425-73f0-4e98-ba51-d919a594cd87
82026-09-04T23:15:42.298ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "878ab425-73f0-4e98-ba51-d919a594cd87" "--data" "/data/regions/878ab425-73f0-4e98-ba51-d919a594cd87" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 878ab425-73f0-4e98-ba51-d919a594cd87
92026-09-04T23:15:42.444ZINFOcrucible-agent (dropshot): request completed latency_us = 60 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:49800 req_id = 8cd1a3b3-40fb-4bc5-b2b4-0040ba254670 response_code = 200 uri = /crucible/0/regions
102026-09-04T23:15:42.545ZINFOcrucible-agent (worker): region files created ok region = 878ab425-73f0-4e98-ba51-d919a594cd87
112026-09-04T23:15:42.550ZINFOcrucible-agent (datafile): region 878ab425-73f0-4e98-ba51-d919a594cd87 state: Requested -> Created
122026-09-04T23:15:42.550ZINFOcrucible-agent (worker): applying SMF actions post create...
132026-09-04T23:15:42.552ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-878ab425-73f0-4e98-ba51-d919a594cd87
142026-09-04T23:15:42.559ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-878ab425-73f0-4e98-ba51-d919a594cd87
152026-09-04T23:15:42.569ZINFOcrucible-agent (worker): creating config property group
162026-09-04T23:15:42.570ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-878ab425-73f0-4e98-ba51-d919a594cd87
172026-09-04T23:15:42.571ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/878ab425-73f0-4e98-ba51-d919a594cd87
182026-09-04T23:15:42.571ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
192026-09-04T23:15:42.571ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::17
202026-09-04T23:15:42.571ZINFOcrucible-agent (worker): commit
212026-09-04T23:15:42.573ZINFOcrucible-agent (worker): ok!
222026-09-04T23:15:42.576ZINFOcrucible-agent (worker): SMF ok!
232026-09-04T23:15:42.727ZINFOcrucible-agent (dropshot): request completed latency_us = 85 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:49800 req_id = 97d2f8ef-d350-4414-8f53-30d9a21350a4 response_code = 200 uri = /crucible/0/regions
242026-09-04T23:26:51.775ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::17]:32345 remote_addr = [fd00:1122:3344:101::c]:47478
252026-09-04T23:26:51.775ZINFOcrucible-agent (dropshot): request completed latency_us = 46 local_addr = [fd00:1122:3344:101::17]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:47478 req_id = 24d0308d-2596-4583-956a-04f40175ad16 response_code = 200 uri = /crucible/0/regions/878ab425-73f0-4e98-ba51-d919a594cd87
262026-09-04T23:26:51.778ZINFOcrucible-agent (datafile): path is "/data/regions/878ab425-73f0-4e98-ba51-d919a594cd87"
272026-09-04T23:26:51.785ZINFOcrucible-agent (datafile): dataset is oxp_68e8ffcb-f300-4fe7-a579-67aa0ffffd1e/crucible/regions/878ab425-73f0-4e98-ba51-d919a594cd87
282026-09-04T23:26:51.791ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_68e8ffcb-f300-4fe7-a579-67aa0ffffd1e/crucible/regions/878ab425-73f0-4e98-ba51-d919a594cd87@a39726d7-daa5-49ea-a1ad-2b8262d21461
292026-09-04T23:26:51.791ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_68e8ffcb-f300-4fe7-a579-67aa0ffffd1e/crucible/regions/878ab425-73f0-4e98-ba51-d919a594cd87", "a39726d7-daa5-49ea-a1ad-2b8262d21461"]
302026-09-04T23:26:51.804ZINFOcrucible-agent (dropshot): request completed latency_us = 25409 local_addr = [fd00:1122:3344:101::17]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:47478 req_id = 7ebedb27-4be7-4b47-beca-4fab7337c3df response_code = 200 uri = /crucible/0/regions/878ab425-73f0-4e98-ba51-d919a594cd87/snapshots/a39726d7-daa5-49ea-a1ad-2b8262d21461
312026-09-04T23:26:51.812ZINFOcrucible-agent (datafile): path is "/data/regions/878ab425-73f0-4e98-ba51-d919a594cd87"
322026-09-04T23:26:51.818ZINFOcrucible-agent (datafile): dataset is oxp_68e8ffcb-f300-4fe7-a579-67aa0ffffd1e/crucible/regions/878ab425-73f0-4e98-ba51-d919a594cd87
332026-09-04T23:26:51.825ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_68e8ffcb-f300-4fe7-a579-67aa0ffffd1e/crucible/regions/878ab425-73f0-4e98-ba51-d919a594cd87@a39726d7-daa5-49ea-a1ad-2b8262d21461
342026-09-04T23:26:51.825ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_68e8ffcb-f300-4fe7-a579-67aa0ffffd1e/crucible/regions/878ab425-73f0-4e98-ba51-d919a594cd87", "a39726d7-daa5-49ea-a1ad-2b8262d21461"]
352026-09-04T23:26:51.831ZINFOcrucible-agent (datafile): requesting running snapshot 878ab425-73f0-4e98-ba51-d919a594cd87-a39726d7-daa5-49ea-a1ad-2b8262d21461 state: Requested
362026-09-04T23:26:51.837ZINFOcrucible-agent (worker): applying SMF actions for region 878ab425-73f0-4e98-ba51-d919a594cd87 running snapshot a39726d7-daa5-49ea-a1ad-2b8262d21461 (state Requested)...
372026-09-04T23:26:51.837ZINFOcrucible-agent (dropshot): request completed latency_us = 24823 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:47478 req_id = f20f2201-9d1d-4a2e-9b2b-21d5aecc132c response_code = 200 uri = /crucible/0/regions/878ab425-73f0-4e98-ba51-d919a594cd87/snapshots/a39726d7-daa5-49ea-a1ad-2b8262d21461/run
382026-09-04T23:26:51.844ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-878ab425-73f0-4e98-ba51-d919a594cd87-a39726d7-daa5-49ea-a1ad-2b8262d21461
392026-09-04T23:26:51.846ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-878ab425-73f0-4e98-ba51-d919a594cd87-a39726d7-daa5-49ea-a1ad-2b8262d21461
402026-09-04T23:26:51.853ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-878ab425-73f0-4e98-ba51-d919a594cd87-a39726d7-daa5-49ea-a1ad-2b8262d21461
412026-09-04T23:26:51.853ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/878ab425-73f0-4e98-ba51-d919a594cd87/.zfs/snapshot/a39726d7-daa5-49ea-a1ad-2b8262d21461
422026-09-04T23:26:51.853ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
432026-09-04T23:26:51.853ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
442026-09-04T23:26:51.853ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::17
452026-09-04T23:26:51.853ZINFOcrucible-agent (worker): commit
462026-09-04T23:26:51.855ZINFOcrucible-agent (worker): ok!
472026-09-04T23:26:51.858ZINFOcrucible-agent (worker): SMF ok!
482026-09-04T23:26:51.858ZINFOcrucible-agent (datafile): region 878ab425-73f0-4e98-ba51-d919a594cd87 running snapshot a39726d7-daa5-49ea-a1ad-2b8262d21461 state: Requested -> Created
492026-09-04T23:26:52.160ZINFOcrucible-agent (datafile): path is "/data/regions/878ab425-73f0-4e98-ba51-d919a594cd87"
502026-09-04T23:26:52.166ZINFOcrucible-agent (datafile): dataset is oxp_68e8ffcb-f300-4fe7-a579-67aa0ffffd1e/crucible/regions/878ab425-73f0-4e98-ba51-d919a594cd87
512026-09-04T23:26:52.172ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_68e8ffcb-f300-4fe7-a579-67aa0ffffd1e/crucible/regions/878ab425-73f0-4e98-ba51-d919a594cd87@a39726d7-daa5-49ea-a1ad-2b8262d21461
522026-09-04T23:26:52.172ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_68e8ffcb-f300-4fe7-a579-67aa0ffffd1e/crucible/regions/878ab425-73f0-4e98-ba51-d919a594cd87", "a39726d7-daa5-49ea-a1ad-2b8262d21461"]
532026-09-04T23:26:52.178ZINFOcrucible-agent (dropshot): request completed latency_us = 18776 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:47478 req_id = 3681747e-fc09-40ce-ae6f-ff0675199c8e response_code = 200 uri = /crucible/0/regions/878ab425-73f0-4e98-ba51-d919a594cd87/snapshots/a39726d7-daa5-49ea-a1ad-2b8262d21461/run