Max level shown:
12026-03-14T21:03:39.446ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::18]:32345 remote_addr = [fd00:1122:3344:101::b]:54054
22026-03-14T21:03:39.446ZINFOcrucible-agent (datafile): region c19ebdc5-0144-4b28-8e89-2f3b6631292a state: Requested
32026-03-14T21:03:39.447ZINFOcrucible-agent (dropshot): request completed latency_us = 684 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:54054 req_id = 59ca9f32-0a54-4e94-94d3-ff18391f4abc response_code = 200 uri = /crucible/0/regions
42026-03-14T21:03:39.447ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
52026-03-14T21:03:39.456ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_a5860664-64ad-4219-bd22-105038406fab/crucible/regions/c19ebdc5-0144-4b28-8e89-2f3b6631292a
62026-03-14T21:03:39.456ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_a5860664-64ad-4219-bd22-105038406fab/crucible/regions/c19ebdc5-0144-4b28-8e89-2f3b6631292a
72026-03-14T21:03:39.516ZINFOcrucible-agent (worker): creating region Region { id: RegionId("c19ebdc5-0144-4b28-8e89-2f3b6631292a"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/c19ebdc5-0144-4b28-8e89-2f3b6631292a" region = c19ebdc5-0144-4b28-8e89-2f3b6631292a
82026-03-14T21:03:39.516ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "c19ebdc5-0144-4b28-8e89-2f3b6631292a" "--data" "/data/regions/c19ebdc5-0144-4b28-8e89-2f3b6631292a" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = c19ebdc5-0144-4b28-8e89-2f3b6631292a
92026-03-14T21:03:39.595ZINFOcrucible-agent (worker): region files created ok region = c19ebdc5-0144-4b28-8e89-2f3b6631292a
102026-03-14T21:03:39.595ZINFOcrucible-agent (datafile): region c19ebdc5-0144-4b28-8e89-2f3b6631292a state: Requested -> Created
112026-03-14T21:03:39.596ZINFOcrucible-agent (worker): applying SMF actions post create...
122026-03-14T21:03:39.616ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-c19ebdc5-0144-4b28-8e89-2f3b6631292a
132026-03-14T21:03:39.628ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-c19ebdc5-0144-4b28-8e89-2f3b6631292a
142026-03-14T21:03:39.636ZINFOcrucible-agent (worker): creating config property group
152026-03-14T21:03:39.640ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-c19ebdc5-0144-4b28-8e89-2f3b6631292a
162026-03-14T21:03:39.641ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/c19ebdc5-0144-4b28-8e89-2f3b6631292a
172026-03-14T21:03:39.641ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
182026-03-14T21:03:39.641ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::18
192026-03-14T21:03:39.641ZINFOcrucible-agent (worker): commit
202026-03-14T21:03:39.644ZINFOcrucible-agent (worker): ok!
212026-03-14T21:03:39.649ZINFOcrucible-agent (worker): SMF ok!
222026-03-14T21:03:39.657ZINFOcrucible-agent (dropshot): request completed latency_us = 71 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:54054 req_id = 45c38ab3-b571-4896-a8c1-ced6c6d84236 response_code = 200 uri = /crucible/0/regions
232026-03-14T21:03:40.922ZINFOcrucible-agent (dropshot): request completed latency_us = 55 local_addr = [fd00:1122:3344:101::18]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:54054 req_id = ec25c06d-ec37-481c-863f-b0ee297ef53a response_code = 200 uri = /crucible/0/regions/a012b24e-3f67-487f-9f38-0077730c8c60
242026-03-14T21:03:40.928ZINFOcrucible-agent (datafile): path is "/data/regions/a012b24e-3f67-487f-9f38-0077730c8c60"
252026-03-14T21:03:40.934ZINFOcrucible-agent (datafile): dataset is oxp_a5860664-64ad-4219-bd22-105038406fab/crucible/regions/a012b24e-3f67-487f-9f38-0077730c8c60
262026-03-14T21:03:40.942ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_a5860664-64ad-4219-bd22-105038406fab/crucible/regions/a012b24e-3f67-487f-9f38-0077730c8c60@63324c0d-82e8-471d-9692-36d9098aef78
272026-03-14T21:03:40.942ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_a5860664-64ad-4219-bd22-105038406fab/crucible/regions/a012b24e-3f67-487f-9f38-0077730c8c60", "63324c0d-82e8-471d-9692-36d9098aef78"]
282026-03-14T21:03:40.950ZINFOcrucible-agent (dropshot): request completed latency_us = 22426 local_addr = [fd00:1122:3344:101::18]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:54054 req_id = 1e4343c0-6a5b-47f5-836a-c50e09b6a5dc response_code = 200 uri = /crucible/0/regions/a012b24e-3f67-487f-9f38-0077730c8c60/snapshots/63324c0d-82e8-471d-9692-36d9098aef78
292026-03-14T21:03:40.953ZINFOcrucible-agent (datafile): path is "/data/regions/a012b24e-3f67-487f-9f38-0077730c8c60"
302026-03-14T21:03:40.960ZINFOcrucible-agent (datafile): dataset is oxp_a5860664-64ad-4219-bd22-105038406fab/crucible/regions/a012b24e-3f67-487f-9f38-0077730c8c60
312026-03-14T21:03:40.967ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_a5860664-64ad-4219-bd22-105038406fab/crucible/regions/a012b24e-3f67-487f-9f38-0077730c8c60@63324c0d-82e8-471d-9692-36d9098aef78
322026-03-14T21:03:40.967ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_a5860664-64ad-4219-bd22-105038406fab/crucible/regions/a012b24e-3f67-487f-9f38-0077730c8c60", "63324c0d-82e8-471d-9692-36d9098aef78"]
332026-03-14T21:03:40.974ZINFOcrucible-agent (datafile): requesting running snapshot a012b24e-3f67-487f-9f38-0077730c8c60-63324c0d-82e8-471d-9692-36d9098aef78 state: Requested
342026-03-14T21:03:40.975ZINFOcrucible-agent (dropshot): request completed latency_us = 21744 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:54054 req_id = 791ce36e-9d4e-4620-844b-005807cfe66a response_code = 200 uri = /crucible/0/regions/a012b24e-3f67-487f-9f38-0077730c8c60/snapshots/63324c0d-82e8-471d-9692-36d9098aef78/run
352026-03-14T21:03:40.975ZINFOcrucible-agent (worker): applying SMF actions for region a012b24e-3f67-487f-9f38-0077730c8c60 running snapshot 63324c0d-82e8-471d-9692-36d9098aef78 (state Requested)...
362026-03-14T21:03:40.979ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-a012b24e-3f67-487f-9f38-0077730c8c60-63324c0d-82e8-471d-9692-36d9098aef78
372026-03-14T21:03:40.988ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-a012b24e-3f67-487f-9f38-0077730c8c60-63324c0d-82e8-471d-9692-36d9098aef78
382026-03-14T21:03:40.998ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-a012b24e-3f67-487f-9f38-0077730c8c60-63324c0d-82e8-471d-9692-36d9098aef78
392026-03-14T21:03:40.998ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/a012b24e-3f67-487f-9f38-0077730c8c60/.zfs/snapshot/63324c0d-82e8-471d-9692-36d9098aef78
402026-03-14T21:03:40.998ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19002
412026-03-14T21:03:40.998ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
422026-03-14T21:03:40.998ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::18
432026-03-14T21:03:40.998ZINFOcrucible-agent (worker): commit
442026-03-14T21:03:41.002ZINFOcrucible-agent (worker): ok!
452026-03-14T21:03:41.006ZINFOcrucible-agent (worker): SMF ok!
462026-03-14T21:03:41.006ZINFOcrucible-agent (datafile): region a012b24e-3f67-487f-9f38-0077730c8c60 running snapshot 63324c0d-82e8-471d-9692-36d9098aef78 state: Requested -> Created
472026-03-14T21:03:41.202ZINFOcrucible-agent (datafile): path is "/data/regions/a012b24e-3f67-487f-9f38-0077730c8c60"
482026-03-14T21:03:41.209ZINFOcrucible-agent (datafile): dataset is oxp_a5860664-64ad-4219-bd22-105038406fab/crucible/regions/a012b24e-3f67-487f-9f38-0077730c8c60
492026-03-14T21:03:41.216ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_a5860664-64ad-4219-bd22-105038406fab/crucible/regions/a012b24e-3f67-487f-9f38-0077730c8c60@63324c0d-82e8-471d-9692-36d9098aef78
502026-03-14T21:03:41.216ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_a5860664-64ad-4219-bd22-105038406fab/crucible/regions/a012b24e-3f67-487f-9f38-0077730c8c60", "63324c0d-82e8-471d-9692-36d9098aef78"]
512026-03-14T21:03:41.221ZINFOcrucible-agent (dropshot): request completed latency_us = 19378 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:54054 req_id = 835bbcc6-8043-45bd-aaec-934cd841bd0c response_code = 200 uri = /crucible/0/regions/a012b24e-3f67-487f-9f38-0077730c8c60/snapshots/63324c0d-82e8-471d-9692-36d9098aef78/run