Max level shown:
12026-04-17T16:20:53.931ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::14]:32345 remote_addr = [fd00:1122:3344:101::b]:46116
22026-04-17T16:20:53.931ZINFOcrucible-agent (datafile): region b04c4f50-c2b6-49dd-a783-1ef5aa944b23 state: Requested
32026-04-17T16:20:53.932ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
42026-04-17T16:20:53.932ZINFOcrucible-agent (dropshot): request completed latency_us = 963 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:46116 req_id = eb9ec820-79cd-4e9b-9dc1-d825c841e80d response_code = 200 uri = /crucible/0/regions
52026-04-17T16:20:53.941ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_2e2e57e2-e806-42df-ae98-74281e3ab877/crucible/regions/b04c4f50-c2b6-49dd-a783-1ef5aa944b23
62026-04-17T16:20:53.941ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_2e2e57e2-e806-42df-ae98-74281e3ab877/crucible/regions/b04c4f50-c2b6-49dd-a783-1ef5aa944b23
72026-04-17T16:20:54.012ZINFOcrucible-agent (worker): creating region Region { id: RegionId("b04c4f50-c2b6-49dd-a783-1ef5aa944b23"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/b04c4f50-c2b6-49dd-a783-1ef5aa944b23" region = b04c4f50-c2b6-49dd-a783-1ef5aa944b23
82026-04-17T16:20:54.013ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "b04c4f50-c2b6-49dd-a783-1ef5aa944b23" "--data" "/data/regions/b04c4f50-c2b6-49dd-a783-1ef5aa944b23" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = b04c4f50-c2b6-49dd-a783-1ef5aa944b23
92026-04-17T16:20:54.109ZINFOcrucible-agent (dropshot): request completed latency_us = 58 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:46116 req_id = 4e1efab7-7c29-4b42-9337-2597b3dba848 response_code = 200 uri = /crucible/0/regions
102026-04-17T16:20:54.132ZINFOcrucible-agent (worker): region files created ok region = b04c4f50-c2b6-49dd-a783-1ef5aa944b23
112026-04-17T16:20:54.132ZINFOcrucible-agent (datafile): region b04c4f50-c2b6-49dd-a783-1ef5aa944b23 state: Requested -> Created
122026-04-17T16:20:54.132ZINFOcrucible-agent (worker): applying SMF actions post create...
132026-04-17T16:20:54.133ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-b04c4f50-c2b6-49dd-a783-1ef5aa944b23
142026-04-17T16:20:54.146ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-b04c4f50-c2b6-49dd-a783-1ef5aa944b23
152026-04-17T16:20:54.180ZINFOcrucible-agent (worker): creating config property group
162026-04-17T16:20:54.193ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-b04c4f50-c2b6-49dd-a783-1ef5aa944b23
172026-04-17T16:20:54.193ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/b04c4f50-c2b6-49dd-a783-1ef5aa944b23
182026-04-17T16:20:54.193ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
192026-04-17T16:20:54.193ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::14
202026-04-17T16:20:54.193ZINFOcrucible-agent (worker): commit
212026-04-17T16:20:54.203ZINFOcrucible-agent (worker): ok!
222026-04-17T16:20:54.223ZINFOcrucible-agent (worker): SMF ok!
232026-04-17T16:20:54.679ZINFOcrucible-agent (dropshot): request completed latency_us = 66 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:46116 req_id = 4116ecce-7382-458c-b244-83424792b0cc response_code = 200 uri = /crucible/0/regions
242026-04-17T16:20:55.539ZINFOcrucible-agent (dropshot): request completed latency_us = 81 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:46116 req_id = f0e76843-2201-4e78-b461-366f9ce3bb54 response_code = 200 uri = /crucible/0/regions/fd01967b-cd9f-45b3-b8a0-0d1c8424d811
252026-04-17T16:20:55.542ZINFOcrucible-agent (datafile): path is "/data/regions/fd01967b-cd9f-45b3-b8a0-0d1c8424d811"
262026-04-17T16:20:55.549ZINFOcrucible-agent (datafile): dataset is oxp_2e2e57e2-e806-42df-ae98-74281e3ab877/crucible/regions/fd01967b-cd9f-45b3-b8a0-0d1c8424d811
272026-04-17T16:20:55.555ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_2e2e57e2-e806-42df-ae98-74281e3ab877/crucible/regions/fd01967b-cd9f-45b3-b8a0-0d1c8424d811@f9218b91-efee-48e2-92a8-d1c0c8709394
282026-04-17T16:20:55.555ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_2e2e57e2-e806-42df-ae98-74281e3ab877/crucible/regions/fd01967b-cd9f-45b3-b8a0-0d1c8424d811", "f9218b91-efee-48e2-92a8-d1c0c8709394"]
292026-04-17T16:20:55.562ZINFOcrucible-agent (dropshot): request completed latency_us = 19601 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:46116 req_id = 10c7d504-6538-4b0b-8c02-07e52a1264fb response_code = 200 uri = /crucible/0/regions/fd01967b-cd9f-45b3-b8a0-0d1c8424d811/snapshots/f9218b91-efee-48e2-92a8-d1c0c8709394
302026-04-17T16:20:55.566ZINFOcrucible-agent (datafile): path is "/data/regions/fd01967b-cd9f-45b3-b8a0-0d1c8424d811"
312026-04-17T16:20:55.572ZINFOcrucible-agent (datafile): dataset is oxp_2e2e57e2-e806-42df-ae98-74281e3ab877/crucible/regions/fd01967b-cd9f-45b3-b8a0-0d1c8424d811
322026-04-17T16:20:55.578ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_2e2e57e2-e806-42df-ae98-74281e3ab877/crucible/regions/fd01967b-cd9f-45b3-b8a0-0d1c8424d811@f9218b91-efee-48e2-92a8-d1c0c8709394
332026-04-17T16:20:55.578ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_2e2e57e2-e806-42df-ae98-74281e3ab877/crucible/regions/fd01967b-cd9f-45b3-b8a0-0d1c8424d811", "f9218b91-efee-48e2-92a8-d1c0c8709394"]
342026-04-17T16:20:55.587ZINFOcrucible-agent (datafile): requesting running snapshot fd01967b-cd9f-45b3-b8a0-0d1c8424d811-f9218b91-efee-48e2-92a8-d1c0c8709394 state: Requested
352026-04-17T16:20:55.587ZINFOcrucible-agent (dropshot): request completed latency_us = 21596 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:46116 req_id = d1132f70-9f21-4db5-83fa-01330e308c3a response_code = 200 uri = /crucible/0/regions/fd01967b-cd9f-45b3-b8a0-0d1c8424d811/snapshots/f9218b91-efee-48e2-92a8-d1c0c8709394/run
362026-04-17T16:20:55.587ZINFOcrucible-agent (worker): applying SMF actions for region fd01967b-cd9f-45b3-b8a0-0d1c8424d811 running snapshot f9218b91-efee-48e2-92a8-d1c0c8709394 (state Requested)...
372026-04-17T16:20:55.592ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-fd01967b-cd9f-45b3-b8a0-0d1c8424d811-f9218b91-efee-48e2-92a8-d1c0c8709394
382026-04-17T16:20:55.608ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-fd01967b-cd9f-45b3-b8a0-0d1c8424d811-f9218b91-efee-48e2-92a8-d1c0c8709394
392026-04-17T16:20:55.624ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-fd01967b-cd9f-45b3-b8a0-0d1c8424d811-f9218b91-efee-48e2-92a8-d1c0c8709394
402026-04-17T16:20:55.624ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/fd01967b-cd9f-45b3-b8a0-0d1c8424d811/.zfs/snapshot/f9218b91-efee-48e2-92a8-d1c0c8709394
412026-04-17T16:20:55.624ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19002
422026-04-17T16:20:55.624ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
432026-04-17T16:20:55.624ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::14
442026-04-17T16:20:55.624ZINFOcrucible-agent (worker): commit
452026-04-17T16:20:55.629ZINFOcrucible-agent (worker): ok!
462026-04-17T16:20:55.640ZINFOcrucible-agent (worker): SMF ok!
472026-04-17T16:20:55.640ZINFOcrucible-agent (datafile): region fd01967b-cd9f-45b3-b8a0-0d1c8424d811 running snapshot f9218b91-efee-48e2-92a8-d1c0c8709394 state: Requested -> Created
482026-04-17T16:20:55.842ZINFOcrucible-agent (datafile): path is "/data/regions/fd01967b-cd9f-45b3-b8a0-0d1c8424d811"
492026-04-17T16:20:55.849ZINFOcrucible-agent (datafile): dataset is oxp_2e2e57e2-e806-42df-ae98-74281e3ab877/crucible/regions/fd01967b-cd9f-45b3-b8a0-0d1c8424d811
502026-04-17T16:20:55.855ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_2e2e57e2-e806-42df-ae98-74281e3ab877/crucible/regions/fd01967b-cd9f-45b3-b8a0-0d1c8424d811@f9218b91-efee-48e2-92a8-d1c0c8709394
512026-04-17T16:20:55.855ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_2e2e57e2-e806-42df-ae98-74281e3ab877/crucible/regions/fd01967b-cd9f-45b3-b8a0-0d1c8424d811", "f9218b91-efee-48e2-92a8-d1c0c8709394"]
522026-04-17T16:20:55.862ZINFOcrucible-agent (dropshot): request completed latency_us = 19494 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:46116 req_id = 5178d193-bfbe-41b7-a4a0-1ef7a3e95662 response_code = 200 uri = /crucible/0/regions/fd01967b-cd9f-45b3-b8a0-0d1c8424d811/snapshots/f9218b91-efee-48e2-92a8-d1c0c8709394/run