Max level shown:
12026-01-30T21:15:01.995ZINFOcrucible-agent (datafile): region 5448f777-5850-4b40-a432-bcad0dbe739d state: Requested
22026-01-30T21:15:01.995ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
32026-01-30T21:15:01.995ZINFOcrucible-agent (dropshot): request completed latency_us = 238 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:51064 req_id = c1a4a7b1-ed9a-4ece-8b71-50cb23dfd9e6 response_code = 200 uri = /crucible/0/regions
42026-01-30T21:15:02.002ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_f2c2ca2d-da84-4298-98a4-72b729be75e5/crucible/regions/5448f777-5850-4b40-a432-bcad0dbe739d
52026-01-30T21:15:02.002ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_f2c2ca2d-da84-4298-98a4-72b729be75e5/crucible/regions/5448f777-5850-4b40-a432-bcad0dbe739d
62026-01-30T21:15:02.151ZINFOcrucible-agent (worker): creating region Region { id: RegionId("5448f777-5850-4b40-a432-bcad0dbe739d"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/5448f777-5850-4b40-a432-bcad0dbe739d" region = 5448f777-5850-4b40-a432-bcad0dbe739d
72026-01-30T21:15:02.151ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "5448f777-5850-4b40-a432-bcad0dbe739d" "--data" "/data/regions/5448f777-5850-4b40-a432-bcad0dbe739d" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 5448f777-5850-4b40-a432-bcad0dbe739d
82026-01-30T21:15:02.250ZINFOcrucible-agent (worker): region files created ok region = 5448f777-5850-4b40-a432-bcad0dbe739d
92026-01-30T21:15:02.250ZINFOcrucible-agent (datafile): region 5448f777-5850-4b40-a432-bcad0dbe739d state: Requested -> Created
102026-01-30T21:15:02.250ZINFOcrucible-agent (worker): applying SMF actions post create...
112026-01-30T21:15:02.252ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-5448f777-5850-4b40-a432-bcad0dbe739d
122026-01-30T21:15:02.255ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-5448f777-5850-4b40-a432-bcad0dbe739d
132026-01-30T21:15:02.264ZINFOcrucible-agent (worker): creating config property group
142026-01-30T21:15:02.267ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-5448f777-5850-4b40-a432-bcad0dbe739d
152026-01-30T21:15:02.267ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/5448f777-5850-4b40-a432-bcad0dbe739d
162026-01-30T21:15:02.268ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
172026-01-30T21:15:02.268ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::13
182026-01-30T21:15:02.268ZINFOcrucible-agent (worker): commit
192026-01-30T21:15:02.272ZINFOcrucible-agent (worker): ok!
202026-01-30T21:15:02.277ZINFOcrucible-agent (worker): SMF ok!
212026-01-30T21:15:02.366ZINFOcrucible-agent (dropshot): request completed latency_us = 61 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:51064 req_id = 21a7107b-b37a-418c-b0b3-5a1b8f0e6767 response_code = 200 uri = /crucible/0/regions
222026-01-30T21:26:34.337ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::13]:32345 remote_addr = [fd00:1122:3344:101::a]:33927
232026-01-30T21:26:34.338ZINFOcrucible-agent (dropshot): request completed latency_us = 47 local_addr = [fd00:1122:3344:101::13]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:33927 req_id = 0fbd5325-a616-42d3-a034-59752e7693b6 response_code = 200 uri = /crucible/0/regions/5448f777-5850-4b40-a432-bcad0dbe739d
242026-01-30T21:26:34.341ZINFOcrucible-agent (datafile): path is "/data/regions/5448f777-5850-4b40-a432-bcad0dbe739d"
252026-01-30T21:26:34.347ZINFOcrucible-agent (datafile): dataset is oxp_f2c2ca2d-da84-4298-98a4-72b729be75e5/crucible/regions/5448f777-5850-4b40-a432-bcad0dbe739d
262026-01-30T21:26:34.353ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_f2c2ca2d-da84-4298-98a4-72b729be75e5/crucible/regions/5448f777-5850-4b40-a432-bcad0dbe739d@27eb188d-9d22-462d-b2a2-e898021fd1f0
272026-01-30T21:26:34.353ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_f2c2ca2d-da84-4298-98a4-72b729be75e5/crucible/regions/5448f777-5850-4b40-a432-bcad0dbe739d", "27eb188d-9d22-462d-b2a2-e898021fd1f0"]
282026-01-30T21:26:34.365ZINFOcrucible-agent (dropshot): request completed latency_us = 23836 local_addr = [fd00:1122:3344:101::13]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:33927 req_id = c53116bd-6a83-44b8-8278-81176eb51a59 response_code = 200 uri = /crucible/0/regions/5448f777-5850-4b40-a432-bcad0dbe739d/snapshots/27eb188d-9d22-462d-b2a2-e898021fd1f0
292026-01-30T21:26:34.368ZINFOcrucible-agent (datafile): path is "/data/regions/5448f777-5850-4b40-a432-bcad0dbe739d"
302026-01-30T21:26:34.374ZINFOcrucible-agent (datafile): dataset is oxp_f2c2ca2d-da84-4298-98a4-72b729be75e5/crucible/regions/5448f777-5850-4b40-a432-bcad0dbe739d
312026-01-30T21:26:34.379ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_f2c2ca2d-da84-4298-98a4-72b729be75e5/crucible/regions/5448f777-5850-4b40-a432-bcad0dbe739d@27eb188d-9d22-462d-b2a2-e898021fd1f0
322026-01-30T21:26:34.379ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_f2c2ca2d-da84-4298-98a4-72b729be75e5/crucible/regions/5448f777-5850-4b40-a432-bcad0dbe739d", "27eb188d-9d22-462d-b2a2-e898021fd1f0"]
332026-01-30T21:26:34.386ZINFOcrucible-agent (datafile): requesting running snapshot 5448f777-5850-4b40-a432-bcad0dbe739d-27eb188d-9d22-462d-b2a2-e898021fd1f0 state: Requested
342026-01-30T21:26:34.387ZINFOcrucible-agent (dropshot): request completed latency_us = 19062 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:33927 req_id = 3aafa35d-10d5-4865-811e-8f2541a65d14 response_code = 200 uri = /crucible/0/regions/5448f777-5850-4b40-a432-bcad0dbe739d/snapshots/27eb188d-9d22-462d-b2a2-e898021fd1f0/run
352026-01-30T21:26:34.387ZINFOcrucible-agent (worker): applying SMF actions for region 5448f777-5850-4b40-a432-bcad0dbe739d running snapshot 27eb188d-9d22-462d-b2a2-e898021fd1f0 (state Requested)...
362026-01-30T21:26:34.411ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-5448f777-5850-4b40-a432-bcad0dbe739d-27eb188d-9d22-462d-b2a2-e898021fd1f0
372026-01-30T21:26:34.426ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-5448f777-5850-4b40-a432-bcad0dbe739d-27eb188d-9d22-462d-b2a2-e898021fd1f0
382026-01-30T21:26:34.440ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-5448f777-5850-4b40-a432-bcad0dbe739d-27eb188d-9d22-462d-b2a2-e898021fd1f0
392026-01-30T21:26:34.441ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/5448f777-5850-4b40-a432-bcad0dbe739d/.zfs/snapshot/27eb188d-9d22-462d-b2a2-e898021fd1f0
402026-01-30T21:26:34.441ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
412026-01-30T21:26:34.441ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
422026-01-30T21:26:34.441ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::13
432026-01-30T21:26:34.441ZINFOcrucible-agent (worker): commit
442026-01-30T21:26:34.446ZINFOcrucible-agent (worker): ok!
452026-01-30T21:26:34.450ZINFOcrucible-agent (worker): SMF ok!
462026-01-30T21:26:34.450ZINFOcrucible-agent (datafile): region 5448f777-5850-4b40-a432-bcad0dbe739d running snapshot 27eb188d-9d22-462d-b2a2-e898021fd1f0 state: Requested -> Created
472026-01-30T21:26:34.569ZINFOcrucible-agent (datafile): path is "/data/regions/5448f777-5850-4b40-a432-bcad0dbe739d"
482026-01-30T21:26:34.576ZINFOcrucible-agent (datafile): dataset is oxp_f2c2ca2d-da84-4298-98a4-72b729be75e5/crucible/regions/5448f777-5850-4b40-a432-bcad0dbe739d
492026-01-30T21:26:34.583ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_f2c2ca2d-da84-4298-98a4-72b729be75e5/crucible/regions/5448f777-5850-4b40-a432-bcad0dbe739d@27eb188d-9d22-462d-b2a2-e898021fd1f0
502026-01-30T21:26:34.583ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_f2c2ca2d-da84-4298-98a4-72b729be75e5/crucible/regions/5448f777-5850-4b40-a432-bcad0dbe739d", "27eb188d-9d22-462d-b2a2-e898021fd1f0"]
512026-01-30T21:26:34.589ZINFOcrucible-agent (dropshot): request completed latency_us = 19785 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:33927 req_id = ed0a7b33-273b-45c4-ae7d-963500644bcc response_code = 200 uri = /crucible/0/regions/5448f777-5850-4b40-a432-bcad0dbe739d/snapshots/27eb188d-9d22-462d-b2a2-e898021fd1f0/run