Max level shown:
12026-05-20T17:20:42.238ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::13]:32345 remote_addr = [fd00:1122:3344:101::c]:65462
22026-05-20T17:20:42.238ZINFOcrucible-agent (datafile): region ab6caa28-6897-41d8-9778-b5893ac44f54 state: Requested
32026-05-20T17:20:42.243ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
42026-05-20T17:20:42.243ZINFOcrucible-agent (dropshot): request completed latency_us = 4490 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:65462 req_id = 7b9bc6cd-e4cc-44ce-acf5-2bf7b105d776 response_code = 200 uri = /crucible/0/regions
52026-05-20T17:20:42.252ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_f1308e29-83e9-437f-bba2-7c0c1b5ad446/crucible/regions/ab6caa28-6897-41d8-9778-b5893ac44f54
62026-05-20T17:20:42.252ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_f1308e29-83e9-437f-bba2-7c0c1b5ad446/crucible/regions/ab6caa28-6897-41d8-9778-b5893ac44f54
72026-05-20T17:20:42.304ZINFOcrucible-agent (worker): creating region Region { id: RegionId("ab6caa28-6897-41d8-9778-b5893ac44f54"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/ab6caa28-6897-41d8-9778-b5893ac44f54" region = ab6caa28-6897-41d8-9778-b5893ac44f54
82026-05-20T17:20:42.304ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "ab6caa28-6897-41d8-9778-b5893ac44f54" "--data" "/data/regions/ab6caa28-6897-41d8-9778-b5893ac44f54" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = ab6caa28-6897-41d8-9778-b5893ac44f54
92026-05-20T17:20:42.377ZINFOcrucible-agent (worker): region files created ok region = ab6caa28-6897-41d8-9778-b5893ac44f54
102026-05-20T17:20:42.377ZINFOcrucible-agent (datafile): region ab6caa28-6897-41d8-9778-b5893ac44f54 state: Requested -> Created
112026-05-20T17:20:42.377ZINFOcrucible-agent (worker): applying SMF actions post create...
122026-05-20T17:20:42.378ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-ab6caa28-6897-41d8-9778-b5893ac44f54
132026-05-20T17:20:42.388ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-ab6caa28-6897-41d8-9778-b5893ac44f54
142026-05-20T17:20:42.409ZINFOcrucible-agent (worker): creating config property group
152026-05-20T17:20:42.412ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-ab6caa28-6897-41d8-9778-b5893ac44f54
162026-05-20T17:20:42.413ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/ab6caa28-6897-41d8-9778-b5893ac44f54
172026-05-20T17:20:42.413ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
182026-05-20T17:20:42.413ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::13
192026-05-20T17:20:42.413ZINFOcrucible-agent (worker): commit
202026-05-20T17:20:42.417ZINFOcrucible-agent (worker): ok!
212026-05-20T17:20:42.422ZINFOcrucible-agent (worker): SMF ok!
222026-05-20T17:20:42.560ZINFOcrucible-agent (dropshot): request completed latency_us = 78 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:65462 req_id = 28e9f180-25af-4349-86c0-b5d720b3444d response_code = 200 uri = /crucible/0/regions
232026-05-20T17:20:49.193ZINFOcrucible-agent (datafile): region 812d3a33-4080-4f32-8cc7-1db460594753 state: Requested
242026-05-20T17:20:49.193ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
252026-05-20T17:20:49.193ZINFOcrucible-agent (dropshot): request completed latency_us = 228 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:65462 req_id = 684f4270-b50e-41e3-b414-e8ca210c2a8f response_code = 200 uri = /crucible/0/regions
262026-05-20T17:20:49.199ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_f1308e29-83e9-437f-bba2-7c0c1b5ad446/crucible/regions/812d3a33-4080-4f32-8cc7-1db460594753
272026-05-20T17:20:49.199ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_f1308e29-83e9-437f-bba2-7c0c1b5ad446/crucible/regions/812d3a33-4080-4f32-8cc7-1db460594753
282026-05-20T17:20:49.247ZINFOcrucible-agent (worker): creating region Region { id: RegionId("812d3a33-4080-4f32-8cc7-1db460594753"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/812d3a33-4080-4f32-8cc7-1db460594753" region = 812d3a33-4080-4f32-8cc7-1db460594753
292026-05-20T17:20:49.247ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "812d3a33-4080-4f32-8cc7-1db460594753" "--data" "/data/regions/812d3a33-4080-4f32-8cc7-1db460594753" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 812d3a33-4080-4f32-8cc7-1db460594753
302026-05-20T17:20:49.327ZINFOcrucible-agent (worker): region files created ok region = 812d3a33-4080-4f32-8cc7-1db460594753
312026-05-20T17:20:49.327ZINFOcrucible-agent (datafile): region 812d3a33-4080-4f32-8cc7-1db460594753 state: Requested -> Created
322026-05-20T17:20:49.327ZINFOcrucible-agent (worker): applying SMF actions post create...
332026-05-20T17:20:49.328ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-812d3a33-4080-4f32-8cc7-1db460594753
342026-05-20T17:20:49.333ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-812d3a33-4080-4f32-8cc7-1db460594753
352026-05-20T17:20:49.341ZINFOcrucible-agent (worker): creating config property group
362026-05-20T17:20:49.344ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-812d3a33-4080-4f32-8cc7-1db460594753
372026-05-20T17:20:49.344ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/812d3a33-4080-4f32-8cc7-1db460594753
382026-05-20T17:20:49.344ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
392026-05-20T17:20:49.345ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::13
402026-05-20T17:20:49.345ZINFOcrucible-agent (worker): commit
412026-05-20T17:20:49.348ZINFOcrucible-agent (worker): ok!
422026-05-20T17:20:49.354ZINFOcrucible-agent (worker): SMF ok!
432026-05-20T17:20:49.464ZINFOcrucible-agent (dropshot): request completed latency_us = 75 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:65462 req_id = 7e0826cf-a9d4-45af-a992-062850b60fb1 response_code = 200 uri = /crucible/0/regions
442026-05-20T17:21:17.662ZINFOcrucible-agent (dropshot): request completed latency_us = 53 local_addr = [fd00:1122:3344:101::13]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:65462 req_id = a251d6e6-2d94-498d-8cab-90eb05728a6e response_code = 200 uri = /crucible/0/regions/812d3a33-4080-4f32-8cc7-1db460594753
452026-05-20T17:21:17.666ZINFOcrucible-agent (datafile): path is "/data/regions/812d3a33-4080-4f32-8cc7-1db460594753"
462026-05-20T17:21:17.677ZINFOcrucible-agent (datafile): dataset is oxp_f1308e29-83e9-437f-bba2-7c0c1b5ad446/crucible/regions/812d3a33-4080-4f32-8cc7-1db460594753
472026-05-20T17:21:17.684ZINFOcrucible-agent (datafile): region 812d3a33-4080-4f32-8cc7-1db460594753 state: Created -> Tombstoned
482026-05-20T17:21:17.685ZINFOcrucible-agent (worker): applying SMF actions before removal...
492026-05-20T17:21:17.685ZINFOcrucible-agent (dropshot): request completed latency_us = 19212 local_addr = [fd00:1122:3344:101::13]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::c]:65462 req_id = 7c35e958-6646-4c99-9ec1-d2fbe86c80b9 response_code = 204 uri = /crucible/0/regions/812d3a33-4080-4f32-8cc7-1db460594753
502026-05-20T17:21:17.686ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-812d3a33-4080-4f32-8cc7-1db460594753 (instance states: (Some(Online), None))
512026-05-20T17:21:17.688ZINFOcrucible-agent (dropshot): request completed latency_us = 27 local_addr = [fd00:1122:3344:101::13]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:65462 req_id = 244b0242-7ba1-4b7a-a231-bce02a84f5d6 response_code = 200 uri = /crucible/0/regions/812d3a33-4080-4f32-8cc7-1db460594753
522026-05-20T17:21:17.697ZINFOcrucible-agent (worker): SMF ok!
532026-05-20T17:21:17.704ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_f1308e29-83e9-437f-bba2-7c0c1b5ad446/crucible/regions/812d3a33-4080-4f32-8cc7-1db460594753" region = 812d3a33-4080-4f32-8cc7-1db460594753
542026-05-20T17:21:17.803ZINFOcrucible-agent (datafile): region 812d3a33-4080-4f32-8cc7-1db460594753 state: Tombstoned -> Destroyed
552026-05-20T17:21:17.811ZINFOcrucible-agent (dropshot): request completed latency_us = 47 local_addr = [fd00:1122:3344:101::13]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:65462 req_id = fbecb078-ea09-40ed-9e43-901c5c774a4b response_code = 200 uri = /crucible/0/regions/812d3a33-4080-4f32-8cc7-1db460594753