Max level shown:
12026-02-24T15:56:32.739ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::15]:32345 remote_addr = [fd00:1122:3344:101::b]:39855
22026-02-24T15:56:32.739ZINFOcrucible-agent (datafile): region a3f884ed-7b4d-4427-8043-03773b9cd03e state: Requested
32026-02-24T15:56:32.740ZINFOcrucible-agent (dropshot): request completed latency_us = 598 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:39855 req_id = d587cf72-7dd6-4c2f-b5b0-c67461a09b13 response_code = 200 uri = /crucible/0/regions
42026-02-24T15:56:32.740ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
52026-02-24T15:56:32.749ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_fb85517c-5aaa-4c9c-b8b0-45f544e31ac3/crucible/regions/a3f884ed-7b4d-4427-8043-03773b9cd03e
62026-02-24T15:56:32.749ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_fb85517c-5aaa-4c9c-b8b0-45f544e31ac3/crucible/regions/a3f884ed-7b4d-4427-8043-03773b9cd03e
72026-02-24T15:56:32.799ZINFOcrucible-agent (worker): creating region Region { id: RegionId("a3f884ed-7b4d-4427-8043-03773b9cd03e"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/a3f884ed-7b4d-4427-8043-03773b9cd03e" region = a3f884ed-7b4d-4427-8043-03773b9cd03e
82026-02-24T15:56:32.799ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "a3f884ed-7b4d-4427-8043-03773b9cd03e" "--data" "/data/regions/a3f884ed-7b4d-4427-8043-03773b9cd03e" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = a3f884ed-7b4d-4427-8043-03773b9cd03e
92026-02-24T15:56:32.879ZINFOcrucible-agent (worker): region files created ok region = a3f884ed-7b4d-4427-8043-03773b9cd03e
102026-02-24T15:56:32.880ZINFOcrucible-agent (datafile): region a3f884ed-7b4d-4427-8043-03773b9cd03e state: Requested -> Created
112026-02-24T15:56:32.880ZINFOcrucible-agent (worker): applying SMF actions post create...
122026-02-24T15:56:32.880ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-a3f884ed-7b4d-4427-8043-03773b9cd03e
132026-02-24T15:56:32.889ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-a3f884ed-7b4d-4427-8043-03773b9cd03e
142026-02-24T15:56:32.916ZINFOcrucible-agent (worker): creating config property group
152026-02-24T15:56:32.929ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-a3f884ed-7b4d-4427-8043-03773b9cd03e
162026-02-24T15:56:32.930ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/a3f884ed-7b4d-4427-8043-03773b9cd03e
172026-02-24T15:56:32.930ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
182026-02-24T15:56:32.930ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::15
192026-02-24T15:56:32.930ZINFOcrucible-agent (worker): commit
202026-02-24T15:56:32.941ZINFOcrucible-agent (worker): ok!
212026-02-24T15:56:32.956ZINFOcrucible-agent (worker): SMF ok!
222026-02-24T15:56:33.112ZINFOcrucible-agent (dropshot): request completed latency_us = 81 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:39855 req_id = ec2a69db-43b3-494e-ac3b-0499352f0b9e response_code = 200 uri = /crucible/0/regions
232026-02-24T15:56:34.438ZINFOcrucible-agent (dropshot): request completed latency_us = 70 local_addr = [fd00:1122:3344:101::15]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:39855 req_id = b991b9f5-3a46-4c0a-96a9-40926b4cb787 response_code = 200 uri = /crucible/0/regions/b3cf5acf-f25c-437e-b2ba-82da7ae0539e
242026-02-24T15:56:34.441ZINFOcrucible-agent (datafile): path is "/data/regions/b3cf5acf-f25c-437e-b2ba-82da7ae0539e"
252026-02-24T15:56:34.447ZINFOcrucible-agent (datafile): dataset is oxp_fb85517c-5aaa-4c9c-b8b0-45f544e31ac3/crucible/regions/b3cf5acf-f25c-437e-b2ba-82da7ae0539e
262026-02-24T15:56:34.452ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_fb85517c-5aaa-4c9c-b8b0-45f544e31ac3/crucible/regions/b3cf5acf-f25c-437e-b2ba-82da7ae0539e@69cc3626-8876-418a-9e2f-97cfab78608a
272026-02-24T15:56:34.452ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_fb85517c-5aaa-4c9c-b8b0-45f544e31ac3/crucible/regions/b3cf5acf-f25c-437e-b2ba-82da7ae0539e", "69cc3626-8876-418a-9e2f-97cfab78608a"]
282026-02-24T15:56:34.462ZINFOcrucible-agent (dropshot): request completed latency_us = 20154 local_addr = [fd00:1122:3344:101::15]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:39855 req_id = 50f1e149-48c4-4da7-a686-b12edc6c3954 response_code = 200 uri = /crucible/0/regions/b3cf5acf-f25c-437e-b2ba-82da7ae0539e/snapshots/69cc3626-8876-418a-9e2f-97cfab78608a
292026-02-24T15:56:34.465ZINFOcrucible-agent (datafile): path is "/data/regions/b3cf5acf-f25c-437e-b2ba-82da7ae0539e"
302026-02-24T15:56:34.471ZINFOcrucible-agent (datafile): dataset is oxp_fb85517c-5aaa-4c9c-b8b0-45f544e31ac3/crucible/regions/b3cf5acf-f25c-437e-b2ba-82da7ae0539e
312026-02-24T15:56:34.477ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_fb85517c-5aaa-4c9c-b8b0-45f544e31ac3/crucible/regions/b3cf5acf-f25c-437e-b2ba-82da7ae0539e@69cc3626-8876-418a-9e2f-97cfab78608a
322026-02-24T15:56:34.477ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_fb85517c-5aaa-4c9c-b8b0-45f544e31ac3/crucible/regions/b3cf5acf-f25c-437e-b2ba-82da7ae0539e", "69cc3626-8876-418a-9e2f-97cfab78608a"]
332026-02-24T15:56:34.486ZINFOcrucible-agent (datafile): requesting running snapshot b3cf5acf-f25c-437e-b2ba-82da7ae0539e-69cc3626-8876-418a-9e2f-97cfab78608a state: Requested
342026-02-24T15:56:34.486ZINFOcrucible-agent (dropshot): request completed latency_us = 20909 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:39855 req_id = dd5c1510-8842-47f6-af4f-a324ae0697e1 response_code = 200 uri = /crucible/0/regions/b3cf5acf-f25c-437e-b2ba-82da7ae0539e/snapshots/69cc3626-8876-418a-9e2f-97cfab78608a/run
352026-02-24T15:56:34.486ZINFOcrucible-agent (worker): applying SMF actions for region b3cf5acf-f25c-437e-b2ba-82da7ae0539e running snapshot 69cc3626-8876-418a-9e2f-97cfab78608a (state Requested)...
362026-02-24T15:56:34.490ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-b3cf5acf-f25c-437e-b2ba-82da7ae0539e-69cc3626-8876-418a-9e2f-97cfab78608a
372026-02-24T15:56:34.504ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-b3cf5acf-f25c-437e-b2ba-82da7ae0539e-69cc3626-8876-418a-9e2f-97cfab78608a
382026-02-24T15:56:34.513ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-b3cf5acf-f25c-437e-b2ba-82da7ae0539e-69cc3626-8876-418a-9e2f-97cfab78608a
392026-02-24T15:56:34.513ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/b3cf5acf-f25c-437e-b2ba-82da7ae0539e/.zfs/snapshot/69cc3626-8876-418a-9e2f-97cfab78608a
402026-02-24T15:56:34.513ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19002
412026-02-24T15:56:34.513ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
422026-02-24T15:56:34.514ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::15
432026-02-24T15:56:34.514ZINFOcrucible-agent (worker): commit
442026-02-24T15:56:34.517ZINFOcrucible-agent (worker): ok!
452026-02-24T15:56:34.521ZINFOcrucible-agent (worker): SMF ok!
462026-02-24T15:56:34.521ZINFOcrucible-agent (datafile): region b3cf5acf-f25c-437e-b2ba-82da7ae0539e running snapshot 69cc3626-8876-418a-9e2f-97cfab78608a state: Requested -> Created
472026-02-24T15:56:34.863ZINFOcrucible-agent (datafile): path is "/data/regions/b3cf5acf-f25c-437e-b2ba-82da7ae0539e"
482026-02-24T15:56:34.869ZINFOcrucible-agent (datafile): dataset is oxp_fb85517c-5aaa-4c9c-b8b0-45f544e31ac3/crucible/regions/b3cf5acf-f25c-437e-b2ba-82da7ae0539e
492026-02-24T15:56:34.874ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_fb85517c-5aaa-4c9c-b8b0-45f544e31ac3/crucible/regions/b3cf5acf-f25c-437e-b2ba-82da7ae0539e@69cc3626-8876-418a-9e2f-97cfab78608a
502026-02-24T15:56:34.874ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_fb85517c-5aaa-4c9c-b8b0-45f544e31ac3/crucible/regions/b3cf5acf-f25c-437e-b2ba-82da7ae0539e", "69cc3626-8876-418a-9e2f-97cfab78608a"]
512026-02-24T15:56:34.880ZINFOcrucible-agent (dropshot): request completed latency_us = 17015 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:39855 req_id = 4820a2f4-27ea-48cf-8bc1-d05e4400aa8d response_code = 200 uri = /crucible/0/regions/b3cf5acf-f25c-437e-b2ba-82da7ae0539e/snapshots/69cc3626-8876-418a-9e2f-97cfab78608a/run