Max level shown:
12026-05-01T04:20:25.203ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::18]:32345 remote_addr = [fd00:1122:3344:101::b]:44853
22026-05-01T04:20:25.203ZINFOcrucible-agent (datafile): region dd9eea38-90c1-4fe9-a9e1-e1dd3ff67c6e state: Requested
32026-05-01T04:20:25.204ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
42026-05-01T04:20:25.204ZINFOcrucible-agent (dropshot): request completed latency_us = 670 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:44853 req_id = e12fef29-38c6-4ad6-9004-837f0be6d27e response_code = 200 uri = /crucible/0/regions
52026-05-01T04:20:25.213ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_9296efd4-5999-454d-8abb-7b3ea68c8104/crucible/regions/dd9eea38-90c1-4fe9-a9e1-e1dd3ff67c6e
62026-05-01T04:20:25.213ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_9296efd4-5999-454d-8abb-7b3ea68c8104/crucible/regions/dd9eea38-90c1-4fe9-a9e1-e1dd3ff67c6e
72026-05-01T04:20:25.257ZINFOcrucible-agent (worker): creating region Region { id: RegionId("dd9eea38-90c1-4fe9-a9e1-e1dd3ff67c6e"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/dd9eea38-90c1-4fe9-a9e1-e1dd3ff67c6e" region = dd9eea38-90c1-4fe9-a9e1-e1dd3ff67c6e
82026-05-01T04:20:25.257ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "dd9eea38-90c1-4fe9-a9e1-e1dd3ff67c6e" "--data" "/data/regions/dd9eea38-90c1-4fe9-a9e1-e1dd3ff67c6e" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = dd9eea38-90c1-4fe9-a9e1-e1dd3ff67c6e
92026-05-01T04:20:25.334ZINFOcrucible-agent (worker): region files created ok region = dd9eea38-90c1-4fe9-a9e1-e1dd3ff67c6e
102026-05-01T04:20:25.334ZINFOcrucible-agent (datafile): region dd9eea38-90c1-4fe9-a9e1-e1dd3ff67c6e state: Requested -> Created
112026-05-01T04:20:25.334ZINFOcrucible-agent (worker): applying SMF actions post create...
122026-05-01T04:20:25.352ZINFOcrucible-agent (dropshot): request completed latency_us = 56 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:44853 req_id = 69736b2a-a1c6-4b0b-8635-dde6a284ab4f response_code = 200 uri = /crucible/0/regions
132026-05-01T04:20:25.354ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-dd9eea38-90c1-4fe9-a9e1-e1dd3ff67c6e
142026-05-01T04:20:25.366ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-dd9eea38-90c1-4fe9-a9e1-e1dd3ff67c6e
152026-05-01T04:20:25.373ZINFOcrucible-agent (worker): creating config property group
162026-05-01T04:20:25.376ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-dd9eea38-90c1-4fe9-a9e1-e1dd3ff67c6e
172026-05-01T04:20:25.376ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/dd9eea38-90c1-4fe9-a9e1-e1dd3ff67c6e
182026-05-01T04:20:25.376ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
192026-05-01T04:20:25.376ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::18
202026-05-01T04:20:25.376ZINFOcrucible-agent (worker): commit
212026-05-01T04:20:25.380ZINFOcrucible-agent (worker): ok!
222026-05-01T04:20:25.385ZINFOcrucible-agent (worker): SMF ok!
232026-05-01T04:20:26.682ZINFOcrucible-agent (dropshot): request completed latency_us = 51 local_addr = [fd00:1122:3344:101::18]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:44853 req_id = 983d5d1e-f2b2-41c7-aa64-e6245fd7e9bf response_code = 200 uri = /crucible/0/regions/14bd0f4d-a975-4532-bf46-ae92b0816e2f
242026-05-01T04:20:26.686ZINFOcrucible-agent (datafile): path is "/data/regions/14bd0f4d-a975-4532-bf46-ae92b0816e2f"
252026-05-01T04:20:26.692ZINFOcrucible-agent (datafile): dataset is oxp_9296efd4-5999-454d-8abb-7b3ea68c8104/crucible/regions/14bd0f4d-a975-4532-bf46-ae92b0816e2f
262026-05-01T04:20:26.698ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_9296efd4-5999-454d-8abb-7b3ea68c8104/crucible/regions/14bd0f4d-a975-4532-bf46-ae92b0816e2f@7c9b0e9e-e6cb-47e3-99f1-cb516411cd9a
272026-05-01T04:20:26.698ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_9296efd4-5999-454d-8abb-7b3ea68c8104/crucible/regions/14bd0f4d-a975-4532-bf46-ae92b0816e2f", "7c9b0e9e-e6cb-47e3-99f1-cb516411cd9a"]
282026-05-01T04:20:26.708ZINFOcrucible-agent (dropshot): request completed latency_us = 21812 local_addr = [fd00:1122:3344:101::18]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:44853 req_id = 116bf83f-25cd-44bc-b16e-7ed3e2b7c5d8 response_code = 200 uri = /crucible/0/regions/14bd0f4d-a975-4532-bf46-ae92b0816e2f/snapshots/7c9b0e9e-e6cb-47e3-99f1-cb516411cd9a
292026-05-01T04:20:26.711ZINFOcrucible-agent (datafile): path is "/data/regions/14bd0f4d-a975-4532-bf46-ae92b0816e2f"
302026-05-01T04:20:26.717ZINFOcrucible-agent (datafile): dataset is oxp_9296efd4-5999-454d-8abb-7b3ea68c8104/crucible/regions/14bd0f4d-a975-4532-bf46-ae92b0816e2f
312026-05-01T04:20:26.723ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_9296efd4-5999-454d-8abb-7b3ea68c8104/crucible/regions/14bd0f4d-a975-4532-bf46-ae92b0816e2f@7c9b0e9e-e6cb-47e3-99f1-cb516411cd9a
322026-05-01T04:20:26.723ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_9296efd4-5999-454d-8abb-7b3ea68c8104/crucible/regions/14bd0f4d-a975-4532-bf46-ae92b0816e2f", "7c9b0e9e-e6cb-47e3-99f1-cb516411cd9a"]
332026-05-01T04:20:26.731ZINFOcrucible-agent (datafile): requesting running snapshot 14bd0f4d-a975-4532-bf46-ae92b0816e2f-7c9b0e9e-e6cb-47e3-99f1-cb516411cd9a state: Requested
342026-05-01T04:20:26.731ZINFOcrucible-agent (dropshot): request completed latency_us = 19598 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:44853 req_id = eef13803-7065-4c07-8404-e67fe880b43c response_code = 200 uri = /crucible/0/regions/14bd0f4d-a975-4532-bf46-ae92b0816e2f/snapshots/7c9b0e9e-e6cb-47e3-99f1-cb516411cd9a/run
352026-05-01T04:20:26.731ZINFOcrucible-agent (worker): applying SMF actions for region 14bd0f4d-a975-4532-bf46-ae92b0816e2f running snapshot 7c9b0e9e-e6cb-47e3-99f1-cb516411cd9a (state Requested)...
362026-05-01T04:20:26.736ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-14bd0f4d-a975-4532-bf46-ae92b0816e2f-7c9b0e9e-e6cb-47e3-99f1-cb516411cd9a
372026-05-01T04:20:26.739ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-14bd0f4d-a975-4532-bf46-ae92b0816e2f-7c9b0e9e-e6cb-47e3-99f1-cb516411cd9a
382026-05-01T04:20:26.749ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-14bd0f4d-a975-4532-bf46-ae92b0816e2f-7c9b0e9e-e6cb-47e3-99f1-cb516411cd9a
392026-05-01T04:20:26.750ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/14bd0f4d-a975-4532-bf46-ae92b0816e2f/.zfs/snapshot/7c9b0e9e-e6cb-47e3-99f1-cb516411cd9a
402026-05-01T04:20:26.750ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19002
412026-05-01T04:20:26.750ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
422026-05-01T04:20:26.750ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::18
432026-05-01T04:20:26.750ZINFOcrucible-agent (worker): commit
442026-05-01T04:20:26.754ZINFOcrucible-agent (worker): ok!
452026-05-01T04:20:26.758ZINFOcrucible-agent (worker): SMF ok!
462026-05-01T04:20:26.758ZINFOcrucible-agent (datafile): region 14bd0f4d-a975-4532-bf46-ae92b0816e2f running snapshot 7c9b0e9e-e6cb-47e3-99f1-cb516411cd9a state: Requested -> Created
472026-05-01T04:20:26.863ZINFOcrucible-agent (datafile): path is "/data/regions/14bd0f4d-a975-4532-bf46-ae92b0816e2f"
482026-05-01T04:20:26.869ZINFOcrucible-agent (datafile): dataset is oxp_9296efd4-5999-454d-8abb-7b3ea68c8104/crucible/regions/14bd0f4d-a975-4532-bf46-ae92b0816e2f
492026-05-01T04:20:26.875ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_9296efd4-5999-454d-8abb-7b3ea68c8104/crucible/regions/14bd0f4d-a975-4532-bf46-ae92b0816e2f@7c9b0e9e-e6cb-47e3-99f1-cb516411cd9a
502026-05-01T04:20:26.875ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_9296efd4-5999-454d-8abb-7b3ea68c8104/crucible/regions/14bd0f4d-a975-4532-bf46-ae92b0816e2f", "7c9b0e9e-e6cb-47e3-99f1-cb516411cd9a"]
512026-05-01T04:20:26.882ZINFOcrucible-agent (dropshot): request completed latency_us = 19037 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:44853 req_id = 73f229b7-461a-495f-8a22-a9a0d3daabd7 response_code = 200 uri = /crucible/0/regions/14bd0f4d-a975-4532-bf46-ae92b0816e2f/snapshots/7c9b0e9e-e6cb-47e3-99f1-cb516411cd9a/run