Max level shown:
12026-09-08T18:15:56.975ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::16]:32345 remote_addr = [fd00:1122:3344:101::b]:44665
22026-09-08T18:15:56.975ZINFOcrucible-agent (datafile): region 000115f2-0ce5-47c9-8cb0-ae3ede40db1d state: Requested
32026-09-08T18:15:56.976ZINFOcrucible-agent (dropshot): request completed latency_us = 898 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:44665 req_id = cd570efc-1324-4d1a-8bad-d87fbf86c085 response_code = 200 uri = /crucible/0/regions
42026-09-08T18:15:56.976ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
52026-09-08T18:15:56.982ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_eb1ead9a-26cd-40c2-8c44-c254e7d8e2b2/crucible/regions/000115f2-0ce5-47c9-8cb0-ae3ede40db1d
62026-09-08T18:15:56.982ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_eb1ead9a-26cd-40c2-8c44-c254e7d8e2b2/crucible/regions/000115f2-0ce5-47c9-8cb0-ae3ede40db1d
72026-09-08T18:15:57.021ZINFOcrucible-agent (worker): creating region Region { id: RegionId("000115f2-0ce5-47c9-8cb0-ae3ede40db1d"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/000115f2-0ce5-47c9-8cb0-ae3ede40db1d" region = 000115f2-0ce5-47c9-8cb0-ae3ede40db1d
82026-09-08T18:15:57.021ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "000115f2-0ce5-47c9-8cb0-ae3ede40db1d" "--data" "/data/regions/000115f2-0ce5-47c9-8cb0-ae3ede40db1d" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 000115f2-0ce5-47c9-8cb0-ae3ede40db1d
92026-09-08T18:15:57.075ZINFOcrucible-agent (worker): region files created ok region = 000115f2-0ce5-47c9-8cb0-ae3ede40db1d
102026-09-08T18:15:57.075ZINFOcrucible-agent (datafile): region 000115f2-0ce5-47c9-8cb0-ae3ede40db1d state: Requested -> Created
112026-09-08T18:15:57.075ZINFOcrucible-agent (worker): applying SMF actions post create...
122026-09-08T18:15:57.075ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-000115f2-0ce5-47c9-8cb0-ae3ede40db1d
132026-09-08T18:15:57.081ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-000115f2-0ce5-47c9-8cb0-ae3ede40db1d
142026-09-08T18:15:57.098ZINFOcrucible-agent (worker): creating config property group
152026-09-08T18:15:57.100ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-000115f2-0ce5-47c9-8cb0-ae3ede40db1d
162026-09-08T18:15:57.100ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/000115f2-0ce5-47c9-8cb0-ae3ede40db1d
172026-09-08T18:15:57.100ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
182026-09-08T18:15:57.100ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::16
192026-09-08T18:15:57.100ZINFOcrucible-agent (worker): commit
202026-09-08T18:15:57.102ZINFOcrucible-agent (worker): ok!
212026-09-08T18:15:57.106ZINFOcrucible-agent (worker): SMF ok!
222026-09-08T18:15:57.192ZINFOcrucible-agent (dropshot): request completed latency_us = 59 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:44665 req_id = f5a801e9-8603-4c06-8044-a3ed94fa794e response_code = 200 uri = /crucible/0/regions
232026-09-08T18:15:58.844ZINFOcrucible-agent (dropshot): request completed latency_us = 70 local_addr = [fd00:1122:3344:101::16]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:44665 req_id = 7b7c29e3-5987-4229-83d5-8995225ea68a response_code = 200 uri = /crucible/0/regions/65fa44ff-acb6-43a0-9e06-4ff21dfbdadc
242026-09-08T18:15:58.848ZINFOcrucible-agent (datafile): path is "/data/regions/65fa44ff-acb6-43a0-9e06-4ff21dfbdadc"
252026-09-08T18:15:58.854ZINFOcrucible-agent (datafile): dataset is oxp_eb1ead9a-26cd-40c2-8c44-c254e7d8e2b2/crucible/regions/65fa44ff-acb6-43a0-9e06-4ff21dfbdadc
262026-09-08T18:15:58.860ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_eb1ead9a-26cd-40c2-8c44-c254e7d8e2b2/crucible/regions/65fa44ff-acb6-43a0-9e06-4ff21dfbdadc@419d7d07-9634-4083-8ed6-2836c8653650
272026-09-08T18:15:58.860ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_eb1ead9a-26cd-40c2-8c44-c254e7d8e2b2/crucible/regions/65fa44ff-acb6-43a0-9e06-4ff21dfbdadc", "419d7d07-9634-4083-8ed6-2836c8653650"]
282026-09-08T18:15:58.870ZINFOcrucible-agent (dropshot): request completed latency_us = 22846 local_addr = [fd00:1122:3344:101::16]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:44665 req_id = a04c52b5-ea40-4335-bb20-9f32e023dc31 response_code = 200 uri = /crucible/0/regions/65fa44ff-acb6-43a0-9e06-4ff21dfbdadc/snapshots/419d7d07-9634-4083-8ed6-2836c8653650
292026-09-08T18:15:58.873ZINFOcrucible-agent (datafile): path is "/data/regions/65fa44ff-acb6-43a0-9e06-4ff21dfbdadc"
302026-09-08T18:15:58.878ZINFOcrucible-agent (datafile): dataset is oxp_eb1ead9a-26cd-40c2-8c44-c254e7d8e2b2/crucible/regions/65fa44ff-acb6-43a0-9e06-4ff21dfbdadc
312026-09-08T18:15:58.884ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_eb1ead9a-26cd-40c2-8c44-c254e7d8e2b2/crucible/regions/65fa44ff-acb6-43a0-9e06-4ff21dfbdadc@419d7d07-9634-4083-8ed6-2836c8653650
322026-09-08T18:15:58.884ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_eb1ead9a-26cd-40c2-8c44-c254e7d8e2b2/crucible/regions/65fa44ff-acb6-43a0-9e06-4ff21dfbdadc", "419d7d07-9634-4083-8ed6-2836c8653650"]
332026-09-08T18:15:58.890ZINFOcrucible-agent (datafile): requesting running snapshot 65fa44ff-acb6-43a0-9e06-4ff21dfbdadc-419d7d07-9634-4083-8ed6-2836c8653650 state: Requested
342026-09-08T18:15:58.895ZINFOcrucible-agent (worker): applying SMF actions for region 65fa44ff-acb6-43a0-9e06-4ff21dfbdadc running snapshot 419d7d07-9634-4083-8ed6-2836c8653650 (state Requested)...
352026-09-08T18:15:58.895ZINFOcrucible-agent (dropshot): request completed latency_us = 22025 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:44665 req_id = a1ba1991-74bd-4dd5-9e1b-c42dc9ca1f81 response_code = 200 uri = /crucible/0/regions/65fa44ff-acb6-43a0-9e06-4ff21dfbdadc/snapshots/419d7d07-9634-4083-8ed6-2836c8653650/run
362026-09-08T18:15:58.897ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-65fa44ff-acb6-43a0-9e06-4ff21dfbdadc-419d7d07-9634-4083-8ed6-2836c8653650
372026-09-08T18:15:58.907ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-65fa44ff-acb6-43a0-9e06-4ff21dfbdadc-419d7d07-9634-4083-8ed6-2836c8653650
382026-09-08T18:15:58.912ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-65fa44ff-acb6-43a0-9e06-4ff21dfbdadc-419d7d07-9634-4083-8ed6-2836c8653650
392026-09-08T18:15:58.912ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/65fa44ff-acb6-43a0-9e06-4ff21dfbdadc/.zfs/snapshot/419d7d07-9634-4083-8ed6-2836c8653650
402026-09-08T18:15:58.912ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19002
412026-09-08T18:15:58.912ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
422026-09-08T18:15:58.912ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::16
432026-09-08T18:15:58.913ZINFOcrucible-agent (worker): commit
442026-09-08T18:15:58.914ZINFOcrucible-agent (worker): ok!
452026-09-08T18:15:58.917ZINFOcrucible-agent (worker): SMF ok!
462026-09-08T18:15:58.917ZINFOcrucible-agent (datafile): region 65fa44ff-acb6-43a0-9e06-4ff21dfbdadc running snapshot 419d7d07-9634-4083-8ed6-2836c8653650 state: Requested -> Created
472026-09-08T18:15:59.130ZINFOcrucible-agent (datafile): path is "/data/regions/65fa44ff-acb6-43a0-9e06-4ff21dfbdadc"
482026-09-08T18:15:59.136ZINFOcrucible-agent (datafile): dataset is oxp_eb1ead9a-26cd-40c2-8c44-c254e7d8e2b2/crucible/regions/65fa44ff-acb6-43a0-9e06-4ff21dfbdadc
492026-09-08T18:15:59.142ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_eb1ead9a-26cd-40c2-8c44-c254e7d8e2b2/crucible/regions/65fa44ff-acb6-43a0-9e06-4ff21dfbdadc@419d7d07-9634-4083-8ed6-2836c8653650
502026-09-08T18:15:59.142ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_eb1ead9a-26cd-40c2-8c44-c254e7d8e2b2/crucible/regions/65fa44ff-acb6-43a0-9e06-4ff21dfbdadc", "419d7d07-9634-4083-8ed6-2836c8653650"]
512026-09-08T18:15:59.147ZINFOcrucible-agent (dropshot): request completed latency_us = 17821 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:44665 req_id = 6e6e21af-21c4-4497-b7c4-558429ce204e response_code = 200 uri = /crucible/0/regions/65fa44ff-acb6-43a0-9e06-4ff21dfbdadc/snapshots/419d7d07-9634-4083-8ed6-2836c8653650/run