Max level shown:
12026-08-24T20:51:59.724ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::15]:32345 remote_addr = [fd00:1122:3344:101::b]:64707
22026-08-24T20:51:59.724ZINFOcrucible-agent (datafile): region aab497ce-55be-481e-9a46-f53b342840eb state: Requested
32026-08-24T20:51:59.725ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
42026-08-24T20:51:59.725ZINFOcrucible-agent (dropshot): request completed latency_us = 681 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:64707 req_id = 4322d5f1-8d2f-4419-a79d-188d88e895ae response_code = 200 uri = /crucible/0/regions
52026-08-24T20:51:59.734ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_4e251d85-5985-4615-a83e-ec2ab626cdee/crucible/regions/aab497ce-55be-481e-9a46-f53b342840eb
62026-08-24T20:51:59.734ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_4e251d85-5985-4615-a83e-ec2ab626cdee/crucible/regions/aab497ce-55be-481e-9a46-f53b342840eb
72026-08-24T20:51:59.778ZINFOcrucible-agent (worker): creating region Region { id: RegionId("aab497ce-55be-481e-9a46-f53b342840eb"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/aab497ce-55be-481e-9a46-f53b342840eb" region = aab497ce-55be-481e-9a46-f53b342840eb
82026-08-24T20:51:59.778ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "aab497ce-55be-481e-9a46-f53b342840eb" "--data" "/data/regions/aab497ce-55be-481e-9a46-f53b342840eb" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = aab497ce-55be-481e-9a46-f53b342840eb
92026-08-24T20:51:59.827ZINFOcrucible-agent (worker): region files created ok region = aab497ce-55be-481e-9a46-f53b342840eb
102026-08-24T20:51:59.827ZINFOcrucible-agent (datafile): region aab497ce-55be-481e-9a46-f53b342840eb state: Requested -> Created
112026-08-24T20:51:59.827ZINFOcrucible-agent (worker): applying SMF actions post create...
122026-08-24T20:51:59.827ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-aab497ce-55be-481e-9a46-f53b342840eb
132026-08-24T20:51:59.830ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-aab497ce-55be-481e-9a46-f53b342840eb
142026-08-24T20:51:59.842ZINFOcrucible-agent (worker): creating config property group
152026-08-24T20:51:59.843ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-aab497ce-55be-481e-9a46-f53b342840eb
162026-08-24T20:51:59.844ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/aab497ce-55be-481e-9a46-f53b342840eb
172026-08-24T20:51:59.844ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
182026-08-24T20:51:59.844ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::15
192026-08-24T20:51:59.844ZINFOcrucible-agent (worker): commit
202026-08-24T20:51:59.846ZINFOcrucible-agent (worker): ok!
212026-08-24T20:51:59.850ZINFOcrucible-agent (worker): SMF ok!
222026-08-24T20:51:59.897ZINFOcrucible-agent (dropshot): request completed latency_us = 61 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:64707 req_id = 97525669-4681-4937-9630-81f4cdd6bb61 response_code = 200 uri = /crucible/0/regions
232026-08-24T20:52:01.332ZINFOcrucible-agent (dropshot): request completed latency_us = 76 local_addr = [fd00:1122:3344:101::15]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:64707 req_id = e90a4514-2088-4c9e-ae30-75ef0820e215 response_code = 200 uri = /crucible/0/regions/e67554f5-02a4-44ea-a956-858102c7dacd
242026-08-24T20:52:01.336ZINFOcrucible-agent (datafile): path is "/data/regions/e67554f5-02a4-44ea-a956-858102c7dacd"
252026-08-24T20:52:01.342ZINFOcrucible-agent (datafile): dataset is oxp_4e251d85-5985-4615-a83e-ec2ab626cdee/crucible/regions/e67554f5-02a4-44ea-a956-858102c7dacd
262026-08-24T20:52:01.349ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_4e251d85-5985-4615-a83e-ec2ab626cdee/crucible/regions/e67554f5-02a4-44ea-a956-858102c7dacd@8818fff8-9b9e-4a81-9ba1-c8ed23368561
272026-08-24T20:52:01.349ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_4e251d85-5985-4615-a83e-ec2ab626cdee/crucible/regions/e67554f5-02a4-44ea-a956-858102c7dacd", "8818fff8-9b9e-4a81-9ba1-c8ed23368561"]
282026-08-24T20:52:01.358ZINFOcrucible-agent (dropshot): request completed latency_us = 22382 local_addr = [fd00:1122:3344:101::15]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:64707 req_id = 15fc0794-4e9b-4c58-8288-982f700b4944 response_code = 200 uri = /crucible/0/regions/e67554f5-02a4-44ea-a956-858102c7dacd/snapshots/8818fff8-9b9e-4a81-9ba1-c8ed23368561
292026-08-24T20:52:01.362ZINFOcrucible-agent (datafile): path is "/data/regions/e67554f5-02a4-44ea-a956-858102c7dacd"
302026-08-24T20:52:01.368ZINFOcrucible-agent (datafile): dataset is oxp_4e251d85-5985-4615-a83e-ec2ab626cdee/crucible/regions/e67554f5-02a4-44ea-a956-858102c7dacd
312026-08-24T20:52:01.375ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_4e251d85-5985-4615-a83e-ec2ab626cdee/crucible/regions/e67554f5-02a4-44ea-a956-858102c7dacd@8818fff8-9b9e-4a81-9ba1-c8ed23368561
322026-08-24T20:52:01.375ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_4e251d85-5985-4615-a83e-ec2ab626cdee/crucible/regions/e67554f5-02a4-44ea-a956-858102c7dacd", "8818fff8-9b9e-4a81-9ba1-c8ed23368561"]
332026-08-24T20:52:01.383ZINFOcrucible-agent (datafile): requesting running snapshot e67554f5-02a4-44ea-a956-858102c7dacd-8818fff8-9b9e-4a81-9ba1-c8ed23368561 state: Requested
342026-08-24T20:52:01.388ZINFOcrucible-agent (worker): applying SMF actions for region e67554f5-02a4-44ea-a956-858102c7dacd running snapshot 8818fff8-9b9e-4a81-9ba1-c8ed23368561 (state Requested)...
352026-08-24T20:52:01.388ZINFOcrucible-agent (dropshot): request completed latency_us = 25585 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:64707 req_id = 32c85710-b42c-4399-8642-0b09a2ff60c7 response_code = 200 uri = /crucible/0/regions/e67554f5-02a4-44ea-a956-858102c7dacd/snapshots/8818fff8-9b9e-4a81-9ba1-c8ed23368561/run
362026-08-24T20:52:01.390ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-e67554f5-02a4-44ea-a956-858102c7dacd-8818fff8-9b9e-4a81-9ba1-c8ed23368561
372026-08-24T20:52:01.398ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-e67554f5-02a4-44ea-a956-858102c7dacd-8818fff8-9b9e-4a81-9ba1-c8ed23368561
382026-08-24T20:52:01.404ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-e67554f5-02a4-44ea-a956-858102c7dacd-8818fff8-9b9e-4a81-9ba1-c8ed23368561
392026-08-24T20:52:01.404ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/e67554f5-02a4-44ea-a956-858102c7dacd/.zfs/snapshot/8818fff8-9b9e-4a81-9ba1-c8ed23368561
402026-08-24T20:52:01.404ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19002
412026-08-24T20:52:01.404ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
422026-08-24T20:52:01.404ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::15
432026-08-24T20:52:01.404ZINFOcrucible-agent (worker): commit
442026-08-24T20:52:01.406ZINFOcrucible-agent (worker): ok!
452026-08-24T20:52:01.412ZINFOcrucible-agent (worker): SMF ok!
462026-08-24T20:52:01.412ZINFOcrucible-agent (datafile): region e67554f5-02a4-44ea-a956-858102c7dacd running snapshot 8818fff8-9b9e-4a81-9ba1-c8ed23368561 state: Requested -> Created
472026-08-24T20:52:01.715ZINFOcrucible-agent (datafile): path is "/data/regions/e67554f5-02a4-44ea-a956-858102c7dacd"
482026-08-24T20:52:01.722ZINFOcrucible-agent (datafile): dataset is oxp_4e251d85-5985-4615-a83e-ec2ab626cdee/crucible/regions/e67554f5-02a4-44ea-a956-858102c7dacd
492026-08-24T20:52:01.728ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_4e251d85-5985-4615-a83e-ec2ab626cdee/crucible/regions/e67554f5-02a4-44ea-a956-858102c7dacd@8818fff8-9b9e-4a81-9ba1-c8ed23368561
502026-08-24T20:52:01.728ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_4e251d85-5985-4615-a83e-ec2ab626cdee/crucible/regions/e67554f5-02a4-44ea-a956-858102c7dacd", "8818fff8-9b9e-4a81-9ba1-c8ed23368561"]
512026-08-24T20:52:01.734ZINFOcrucible-agent (dropshot): request completed latency_us = 18823 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:64707 req_id = c26702d0-ab1d-44f7-8194-707d2a712f7e response_code = 200 uri = /crucible/0/regions/e67554f5-02a4-44ea-a956-858102c7dacd/snapshots/8818fff8-9b9e-4a81-9ba1-c8ed23368561/run