Max level shown:
12026-09-02T04:45:44.649ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::14]:32345 remote_addr = [fd00:1122:3344:101::b]:43645
22026-09-02T04:45:44.649ZINFOcrucible-agent (datafile): region 7fb0ab41-1529-4c34-8e7e-1e10cbae1fcd state: Requested
32026-09-02T04:45:44.650ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
42026-09-02T04:45:44.650ZINFOcrucible-agent (dropshot): request completed latency_us = 765 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:43645 req_id = 567f3e1d-1b8b-4a8a-bfe7-50747fbcc756 response_code = 200 uri = /crucible/0/regions
52026-09-02T04:45:44.657ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_d735fea6-140b-4f8a-b58d-8ec2fd80fb28/crucible/regions/7fb0ab41-1529-4c34-8e7e-1e10cbae1fcd
62026-09-02T04:45:44.658ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_d735fea6-140b-4f8a-b58d-8ec2fd80fb28/crucible/regions/7fb0ab41-1529-4c34-8e7e-1e10cbae1fcd
72026-09-02T04:45:44.719ZINFOcrucible-agent (worker): creating region Region { id: RegionId("7fb0ab41-1529-4c34-8e7e-1e10cbae1fcd"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/7fb0ab41-1529-4c34-8e7e-1e10cbae1fcd" region = 7fb0ab41-1529-4c34-8e7e-1e10cbae1fcd
82026-09-02T04:45:44.719ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "7fb0ab41-1529-4c34-8e7e-1e10cbae1fcd" "--data" "/data/regions/7fb0ab41-1529-4c34-8e7e-1e10cbae1fcd" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 7fb0ab41-1529-4c34-8e7e-1e10cbae1fcd
92026-09-02T04:45:44.828ZINFOcrucible-agent (worker): region files created ok region = 7fb0ab41-1529-4c34-8e7e-1e10cbae1fcd
102026-09-02T04:45:44.828ZINFOcrucible-agent (datafile): region 7fb0ab41-1529-4c34-8e7e-1e10cbae1fcd state: Requested -> Created
112026-09-02T04:45:44.829ZINFOcrucible-agent (worker): applying SMF actions post create...
122026-09-02T04:45:44.842ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-7fb0ab41-1529-4c34-8e7e-1e10cbae1fcd
132026-09-02T04:45:44.847ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-7fb0ab41-1529-4c34-8e7e-1e10cbae1fcd
142026-09-02T04:45:44.863ZINFOcrucible-agent (worker): creating config property group
152026-09-02T04:45:44.868ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-7fb0ab41-1529-4c34-8e7e-1e10cbae1fcd
162026-09-02T04:45:44.868ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/7fb0ab41-1529-4c34-8e7e-1e10cbae1fcd
172026-09-02T04:45:44.868ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
182026-09-02T04:45:44.868ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::14
192026-09-02T04:45:44.868ZINFOcrucible-agent (worker): commit
202026-09-02T04:45:44.875ZINFOcrucible-agent (worker): ok!
212026-09-02T04:45:44.887ZINFOcrucible-agent (worker): SMF ok!
222026-09-02T04:45:44.992ZINFOcrucible-agent (dropshot): request completed latency_us = 55 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:43645 req_id = f5248b0f-b950-4d1d-8acc-bd92b00283a7 response_code = 200 uri = /crucible/0/regions
232026-09-02T04:45:46.779ZINFOcrucible-agent (dropshot): request completed latency_us = 80 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:43645 req_id = 642139ea-9d9e-471d-93f8-3e1772ca6639 response_code = 200 uri = /crucible/0/regions/2e79b844-3abe-4cc8-9edd-d31d3e975745
242026-09-02T04:45:46.782ZINFOcrucible-agent (datafile): path is "/data/regions/2e79b844-3abe-4cc8-9edd-d31d3e975745"
252026-09-02T04:45:46.788ZINFOcrucible-agent (datafile): dataset is oxp_d735fea6-140b-4f8a-b58d-8ec2fd80fb28/crucible/regions/2e79b844-3abe-4cc8-9edd-d31d3e975745
262026-09-02T04:45:46.794ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_d735fea6-140b-4f8a-b58d-8ec2fd80fb28/crucible/regions/2e79b844-3abe-4cc8-9edd-d31d3e975745@48c9baba-2bc9-4726-bc88-d810ff929b53
272026-09-02T04:45:46.794ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_d735fea6-140b-4f8a-b58d-8ec2fd80fb28/crucible/regions/2e79b844-3abe-4cc8-9edd-d31d3e975745", "48c9baba-2bc9-4726-bc88-d810ff929b53"]
282026-09-02T04:45:46.806ZINFOcrucible-agent (dropshot): request completed latency_us = 23756 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:43645 req_id = 2a188748-0081-4e08-a5a7-d0920f5a4bbf response_code = 200 uri = /crucible/0/regions/2e79b844-3abe-4cc8-9edd-d31d3e975745/snapshots/48c9baba-2bc9-4726-bc88-d810ff929b53
292026-09-02T04:45:46.809ZINFOcrucible-agent (datafile): path is "/data/regions/2e79b844-3abe-4cc8-9edd-d31d3e975745"
302026-09-02T04:45:46.815ZINFOcrucible-agent (datafile): dataset is oxp_d735fea6-140b-4f8a-b58d-8ec2fd80fb28/crucible/regions/2e79b844-3abe-4cc8-9edd-d31d3e975745
312026-09-02T04:45:46.820ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_d735fea6-140b-4f8a-b58d-8ec2fd80fb28/crucible/regions/2e79b844-3abe-4cc8-9edd-d31d3e975745@48c9baba-2bc9-4726-bc88-d810ff929b53
322026-09-02T04:45:46.820ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_d735fea6-140b-4f8a-b58d-8ec2fd80fb28/crucible/regions/2e79b844-3abe-4cc8-9edd-d31d3e975745", "48c9baba-2bc9-4726-bc88-d810ff929b53"]
332026-09-02T04:45:46.827ZINFOcrucible-agent (datafile): requesting running snapshot 2e79b844-3abe-4cc8-9edd-d31d3e975745-48c9baba-2bc9-4726-bc88-d810ff929b53 state: Requested
342026-09-02T04:45:46.831ZINFOcrucible-agent (worker): applying SMF actions for region 2e79b844-3abe-4cc8-9edd-d31d3e975745 running snapshot 48c9baba-2bc9-4726-bc88-d810ff929b53 (state Requested)...
352026-09-02T04:45:46.831ZINFOcrucible-agent (dropshot): request completed latency_us = 22144 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:43645 req_id = 33e2fbb5-f1a4-4505-b494-825fb89c3dc6 response_code = 200 uri = /crucible/0/regions/2e79b844-3abe-4cc8-9edd-d31d3e975745/snapshots/48c9baba-2bc9-4726-bc88-d810ff929b53/run
362026-09-02T04:45:46.834ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-2e79b844-3abe-4cc8-9edd-d31d3e975745-48c9baba-2bc9-4726-bc88-d810ff929b53
372026-09-02T04:45:46.847ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-2e79b844-3abe-4cc8-9edd-d31d3e975745-48c9baba-2bc9-4726-bc88-d810ff929b53
382026-09-02T04:45:46.864ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-2e79b844-3abe-4cc8-9edd-d31d3e975745-48c9baba-2bc9-4726-bc88-d810ff929b53
392026-09-02T04:45:46.864ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/2e79b844-3abe-4cc8-9edd-d31d3e975745/.zfs/snapshot/48c9baba-2bc9-4726-bc88-d810ff929b53
402026-09-02T04:45:46.864ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19002
412026-09-02T04:45:46.864ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
422026-09-02T04:45:46.864ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::14
432026-09-02T04:45:46.864ZINFOcrucible-agent (worker): commit
442026-09-02T04:45:46.869ZINFOcrucible-agent (worker): ok!
452026-09-02T04:45:46.874ZINFOcrucible-agent (worker): SMF ok!
462026-09-02T04:45:46.874ZINFOcrucible-agent (datafile): region 2e79b844-3abe-4cc8-9edd-d31d3e975745 running snapshot 48c9baba-2bc9-4726-bc88-d810ff929b53 state: Requested -> Created
472026-09-02T04:45:46.999ZINFOcrucible-agent (datafile): path is "/data/regions/2e79b844-3abe-4cc8-9edd-d31d3e975745"
482026-09-02T04:45:47.005ZINFOcrucible-agent (datafile): dataset is oxp_d735fea6-140b-4f8a-b58d-8ec2fd80fb28/crucible/regions/2e79b844-3abe-4cc8-9edd-d31d3e975745
492026-09-02T04:45:47.010ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_d735fea6-140b-4f8a-b58d-8ec2fd80fb28/crucible/regions/2e79b844-3abe-4cc8-9edd-d31d3e975745@48c9baba-2bc9-4726-bc88-d810ff929b53
502026-09-02T04:45:47.010ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_d735fea6-140b-4f8a-b58d-8ec2fd80fb28/crucible/regions/2e79b844-3abe-4cc8-9edd-d31d3e975745", "48c9baba-2bc9-4726-bc88-d810ff929b53"]
512026-09-02T04:45:47.016ZINFOcrucible-agent (dropshot): request completed latency_us = 17675 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:43645 req_id = 911ba4ee-4f20-4137-9ea1-a659d865992d response_code = 200 uri = /crucible/0/regions/2e79b844-3abe-4cc8-9edd-d31d3e975745/snapshots/48c9baba-2bc9-4726-bc88-d810ff929b53/run