Max level shown:
12026-05-19T22:20:21.202ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::14]:32345 remote_addr = [fd00:1122:3344:101::a]:47698
22026-05-19T22:20:21.202ZINFOcrucible-agent (datafile): region 5d447bff-761e-4e44-911f-420c71fda1da state: Requested
32026-05-19T22:20:21.203ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
42026-05-19T22:20:21.203ZINFOcrucible-agent (dropshot): request completed latency_us = 633 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:47698 req_id = a4758e3e-03ba-4488-b5f1-63f9d4635902 response_code = 200 uri = /crucible/0/regions
52026-05-19T22:20:21.212ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_2274da57-5589-4b5d-aa37-c2b43363cd28/crucible/regions/5d447bff-761e-4e44-911f-420c71fda1da
62026-05-19T22:20:21.212ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_2274da57-5589-4b5d-aa37-c2b43363cd28/crucible/regions/5d447bff-761e-4e44-911f-420c71fda1da
72026-05-19T22:20:21.277ZINFOcrucible-agent (worker): creating region Region { id: RegionId("5d447bff-761e-4e44-911f-420c71fda1da"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/5d447bff-761e-4e44-911f-420c71fda1da" region = 5d447bff-761e-4e44-911f-420c71fda1da
82026-05-19T22:20:21.277ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "5d447bff-761e-4e44-911f-420c71fda1da" "--data" "/data/regions/5d447bff-761e-4e44-911f-420c71fda1da" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 5d447bff-761e-4e44-911f-420c71fda1da
92026-05-19T22:20:21.328ZINFOcrucible-agent (worker): region files created ok region = 5d447bff-761e-4e44-911f-420c71fda1da
102026-05-19T22:20:21.328ZINFOcrucible-agent (datafile): region 5d447bff-761e-4e44-911f-420c71fda1da state: Requested -> Created
112026-05-19T22:20:21.328ZINFOcrucible-agent (worker): applying SMF actions post create...
122026-05-19T22:20:21.329ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-5d447bff-761e-4e44-911f-420c71fda1da
132026-05-19T22:20:21.340ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-5d447bff-761e-4e44-911f-420c71fda1da
142026-05-19T22:20:21.360ZINFOcrucible-agent (worker): creating config property group
152026-05-19T22:20:21.361ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-5d447bff-761e-4e44-911f-420c71fda1da
162026-05-19T22:20:21.361ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/5d447bff-761e-4e44-911f-420c71fda1da
172026-05-19T22:20:21.361ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
182026-05-19T22:20:21.361ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::14
192026-05-19T22:20:21.361ZINFOcrucible-agent (worker): commit
202026-05-19T22:20:21.363ZINFOcrucible-agent (worker): ok!
212026-05-19T22:20:21.366ZINFOcrucible-agent (worker): SMF ok!
222026-05-19T22:20:21.512ZINFOcrucible-agent (dropshot): request completed latency_us = 64 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:47698 req_id = 3ad8f5b5-94f2-492a-978c-2515bbab1514 response_code = 200 uri = /crucible/0/regions
232026-05-19T22:20:27.347ZINFOcrucible-agent (datafile): region 9974dfaf-0067-4e8d-972a-dc92de3d40bd state: Requested
242026-05-19T22:20:27.348ZINFOcrucible-agent (dropshot): request completed latency_us = 260 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:47698 req_id = 284d10d3-3173-4a43-9de0-37f60900d47a response_code = 200 uri = /crucible/0/regions
252026-05-19T22:20:27.348ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
262026-05-19T22:20:27.354ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_2274da57-5589-4b5d-aa37-c2b43363cd28/crucible/regions/9974dfaf-0067-4e8d-972a-dc92de3d40bd
272026-05-19T22:20:27.354ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_2274da57-5589-4b5d-aa37-c2b43363cd28/crucible/regions/9974dfaf-0067-4e8d-972a-dc92de3d40bd
282026-05-19T22:20:27.407ZINFOcrucible-agent (worker): creating region Region { id: RegionId("9974dfaf-0067-4e8d-972a-dc92de3d40bd"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/9974dfaf-0067-4e8d-972a-dc92de3d40bd" region = 9974dfaf-0067-4e8d-972a-dc92de3d40bd
292026-05-19T22:20:27.407ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "9974dfaf-0067-4e8d-972a-dc92de3d40bd" "--data" "/data/regions/9974dfaf-0067-4e8d-972a-dc92de3d40bd" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 9974dfaf-0067-4e8d-972a-dc92de3d40bd
302026-05-19T22:20:27.457ZINFOcrucible-agent (worker): region files created ok region = 9974dfaf-0067-4e8d-972a-dc92de3d40bd
312026-05-19T22:20:27.457ZINFOcrucible-agent (datafile): region 9974dfaf-0067-4e8d-972a-dc92de3d40bd state: Requested -> Created
322026-05-19T22:20:27.457ZINFOcrucible-agent (worker): applying SMF actions post create...
332026-05-19T22:20:27.462ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-9974dfaf-0067-4e8d-972a-dc92de3d40bd
342026-05-19T22:20:27.466ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-9974dfaf-0067-4e8d-972a-dc92de3d40bd
352026-05-19T22:20:27.469ZINFOcrucible-agent (worker): creating config property group
362026-05-19T22:20:27.471ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-9974dfaf-0067-4e8d-972a-dc92de3d40bd
372026-05-19T22:20:27.471ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/9974dfaf-0067-4e8d-972a-dc92de3d40bd
382026-05-19T22:20:27.471ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
392026-05-19T22:20:27.471ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::14
402026-05-19T22:20:27.471ZINFOcrucible-agent (worker): commit
412026-05-19T22:20:27.473ZINFOcrucible-agent (worker): ok!
422026-05-19T22:20:27.476ZINFOcrucible-agent (worker): SMF ok!
432026-05-19T22:20:27.608ZINFOcrucible-agent (dropshot): request completed latency_us = 59 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:47698 req_id = aea94f39-e0d4-4818-9008-0f7cb9851485 response_code = 200 uri = /crucible/0/regions
442026-05-19T22:20:53.286ZINFOcrucible-agent (dropshot): request completed latency_us = 53 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:47698 req_id = 9c34e9ef-9336-4f55-8634-e1a5e4c3cdc2 response_code = 200 uri = /crucible/0/regions/9974dfaf-0067-4e8d-972a-dc92de3d40bd
452026-05-19T22:20:53.289ZINFOcrucible-agent (datafile): path is "/data/regions/9974dfaf-0067-4e8d-972a-dc92de3d40bd"
462026-05-19T22:20:53.299ZINFOcrucible-agent (datafile): dataset is oxp_2274da57-5589-4b5d-aa37-c2b43363cd28/crucible/regions/9974dfaf-0067-4e8d-972a-dc92de3d40bd
472026-05-19T22:20:53.306ZINFOcrucible-agent (datafile): region 9974dfaf-0067-4e8d-972a-dc92de3d40bd state: Created -> Tombstoned
482026-05-19T22:20:53.306ZINFOcrucible-agent (dropshot): request completed latency_us = 16736 local_addr = [fd00:1122:3344:101::14]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::a]:47698 req_id = 5a7587f0-a2d2-481d-916d-44496e711a03 response_code = 204 uri = /crucible/0/regions/9974dfaf-0067-4e8d-972a-dc92de3d40bd
492026-05-19T22:20:53.306ZINFOcrucible-agent (worker): applying SMF actions before removal...
502026-05-19T22:20:53.308ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-9974dfaf-0067-4e8d-972a-dc92de3d40bd (instance states: (Some(Online), None))
512026-05-19T22:20:53.310ZINFOcrucible-agent (dropshot): request completed latency_us = 44 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:47698 req_id = 4f127d2d-6034-4d5c-abc8-1053ec9f939f response_code = 200 uri = /crucible/0/regions/9974dfaf-0067-4e8d-972a-dc92de3d40bd
522026-05-19T22:20:53.311ZINFOcrucible-agent (worker): SMF ok!
532026-05-19T22:20:53.319ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_2274da57-5589-4b5d-aa37-c2b43363cd28/crucible/regions/9974dfaf-0067-4e8d-972a-dc92de3d40bd" region = 9974dfaf-0067-4e8d-972a-dc92de3d40bd
542026-05-19T22:20:53.371ZINFOcrucible-agent (datafile): region 9974dfaf-0067-4e8d-972a-dc92de3d40bd state: Tombstoned -> Destroyed
552026-05-19T22:20:53.459ZINFOcrucible-agent (dropshot): request completed latency_us = 57 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:47698 req_id = e264dec9-1cfd-46ae-b14e-8f3663221e19 response_code = 200 uri = /crucible/0/regions/9974dfaf-0067-4e8d-972a-dc92de3d40bd