Max level shown:
12026-08-05T05:18:33.774ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::12]:32345 remote_addr = [fd00:1122:3344:101::b]:61248
22026-08-05T05:18:33.819ZINFOcrucible-agent (datafile): region d5827c5a-0cad-47e7-85a3-274768cd947d state: Requested
32026-08-05T05:18:33.822ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
42026-08-05T05:18:33.828ZINFOcrucible-agent (dropshot): request completed latency_us = 20680 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:61248 req_id = 7b56048b-1d85-4a12-8ff6-807e574621ad response_code = 200 uri = /crucible/0/regions
52026-08-05T05:18:33.836ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_02647adf-34c6-42a9-9e62-33d1f18ac803/crucible/regions/d5827c5a-0cad-47e7-85a3-274768cd947d
62026-08-05T05:18:33.836ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_02647adf-34c6-42a9-9e62-33d1f18ac803/crucible/regions/d5827c5a-0cad-47e7-85a3-274768cd947d
72026-08-05T05:18:33.888ZINFOcrucible-agent (worker): creating region Region { id: RegionId("d5827c5a-0cad-47e7-85a3-274768cd947d"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/d5827c5a-0cad-47e7-85a3-274768cd947d" region = d5827c5a-0cad-47e7-85a3-274768cd947d
82026-08-05T05:18:33.890ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "d5827c5a-0cad-47e7-85a3-274768cd947d" "--data" "/data/regions/d5827c5a-0cad-47e7-85a3-274768cd947d" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = d5827c5a-0cad-47e7-85a3-274768cd947d
92026-08-05T05:18:33.981ZINFOcrucible-agent (dropshot): request completed latency_us = 88 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:61248 req_id = 95891171-d26b-4006-ae28-2382a1475543 response_code = 200 uri = /crucible/0/regions
102026-08-05T05:18:34.284ZINFOcrucible-agent (worker): region files created ok region = d5827c5a-0cad-47e7-85a3-274768cd947d
112026-08-05T05:18:34.290ZINFOcrucible-agent (datafile): region d5827c5a-0cad-47e7-85a3-274768cd947d state: Requested -> Created
122026-08-05T05:18:34.290ZINFOcrucible-agent (worker): applying SMF actions post create...
132026-08-05T05:18:34.293ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-d5827c5a-0cad-47e7-85a3-274768cd947d
142026-08-05T05:18:34.304ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-d5827c5a-0cad-47e7-85a3-274768cd947d
152026-08-05T05:18:34.315ZINFOcrucible-agent (worker): creating config property group
162026-08-05T05:18:34.317ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-d5827c5a-0cad-47e7-85a3-274768cd947d
172026-08-05T05:18:34.318ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/d5827c5a-0cad-47e7-85a3-274768cd947d
182026-08-05T05:18:34.318ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
192026-08-05T05:18:34.318ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::12
202026-08-05T05:18:34.318ZINFOcrucible-agent (worker): commit
212026-08-05T05:18:34.321ZINFOcrucible-agent (worker): ok!
222026-08-05T05:18:34.323ZINFOcrucible-agent (worker): SMF ok!
232026-08-05T05:18:34.427ZINFOcrucible-agent (dropshot): request completed latency_us = 69 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:61248 req_id = 495960d4-040a-4e83-b14c-1ab571ebb1fd response_code = 200 uri = /crucible/0/regions
242026-08-05T05:18:40.268ZINFOcrucible-agent (datafile): region 5db7218c-a484-4c59-8566-4f6f3ba1e2d1 state: Requested
252026-08-05T05:18:40.269ZINFOcrucible-agent (dropshot): request completed latency_us = 223 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:61248 req_id = 35ea29b2-82cb-47dc-851a-c5c7630d0df1 response_code = 200 uri = /crucible/0/regions
262026-08-05T05:18:40.269ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
272026-08-05T05:18:40.275ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_02647adf-34c6-42a9-9e62-33d1f18ac803/crucible/regions/5db7218c-a484-4c59-8566-4f6f3ba1e2d1
282026-08-05T05:18:40.275ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_02647adf-34c6-42a9-9e62-33d1f18ac803/crucible/regions/5db7218c-a484-4c59-8566-4f6f3ba1e2d1
292026-08-05T05:18:40.318ZINFOcrucible-agent (worker): creating region Region { id: RegionId("5db7218c-a484-4c59-8566-4f6f3ba1e2d1"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/5db7218c-a484-4c59-8566-4f6f3ba1e2d1" region = 5db7218c-a484-4c59-8566-4f6f3ba1e2d1
302026-08-05T05:18:40.318ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "5db7218c-a484-4c59-8566-4f6f3ba1e2d1" "--data" "/data/regions/5db7218c-a484-4c59-8566-4f6f3ba1e2d1" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 5db7218c-a484-4c59-8566-4f6f3ba1e2d1
312026-08-05T05:18:40.363ZINFOcrucible-agent (worker): region files created ok region = 5db7218c-a484-4c59-8566-4f6f3ba1e2d1
322026-08-05T05:18:40.363ZINFOcrucible-agent (datafile): region 5db7218c-a484-4c59-8566-4f6f3ba1e2d1 state: Requested -> Created
332026-08-05T05:18:40.364ZINFOcrucible-agent (worker): applying SMF actions post create...
342026-08-05T05:18:40.364ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-5db7218c-a484-4c59-8566-4f6f3ba1e2d1
352026-08-05T05:18:40.365ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-5db7218c-a484-4c59-8566-4f6f3ba1e2d1
362026-08-05T05:18:40.369ZINFOcrucible-agent (worker): creating config property group
372026-08-05T05:18:40.370ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-5db7218c-a484-4c59-8566-4f6f3ba1e2d1
382026-08-05T05:18:40.371ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/5db7218c-a484-4c59-8566-4f6f3ba1e2d1
392026-08-05T05:18:40.371ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
402026-08-05T05:18:40.371ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::12
412026-08-05T05:18:40.371ZINFOcrucible-agent (worker): commit
422026-08-05T05:18:40.372ZINFOcrucible-agent (worker): ok!
432026-08-05T05:18:40.376ZINFOcrucible-agent (worker): SMF ok!
442026-08-05T05:18:40.496ZINFOcrucible-agent (dropshot): request completed latency_us = 57 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:61248 req_id = 082ce835-06ab-45c3-9ef4-d651e0958153 response_code = 200 uri = /crucible/0/regions
452026-08-05T05:19:06.019ZINFOcrucible-agent (dropshot): request completed latency_us = 76 local_addr = [fd00:1122:3344:101::12]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:61248 req_id = bcfb9a8b-59a0-45f6-a919-5c1ba379d9a7 response_code = 200 uri = /crucible/0/regions/5db7218c-a484-4c59-8566-4f6f3ba1e2d1
462026-08-05T05:19:06.023ZINFOcrucible-agent (datafile): path is "/data/regions/5db7218c-a484-4c59-8566-4f6f3ba1e2d1"
472026-08-05T05:19:06.032ZINFOcrucible-agent (datafile): dataset is oxp_02647adf-34c6-42a9-9e62-33d1f18ac803/crucible/regions/5db7218c-a484-4c59-8566-4f6f3ba1e2d1
482026-08-05T05:19:06.039ZINFOcrucible-agent (datafile): region 5db7218c-a484-4c59-8566-4f6f3ba1e2d1 state: Created -> Tombstoned
492026-08-05T05:19:06.039ZINFOcrucible-agent (worker): applying SMF actions before removal...
502026-08-05T05:19:06.039ZINFOcrucible-agent (dropshot): request completed latency_us = 15879 local_addr = [fd00:1122:3344:101::12]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::b]:61248 req_id = 2f2ab65e-bc39-49f7-af6f-0cd66f3e8124 response_code = 204 uri = /crucible/0/regions/5db7218c-a484-4c59-8566-4f6f3ba1e2d1
512026-08-05T05:19:06.040ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-5db7218c-a484-4c59-8566-4f6f3ba1e2d1 (instance states: (Some(Online), None))
522026-08-05T05:19:06.043ZINFOcrucible-agent (dropshot): request completed latency_us = 48 local_addr = [fd00:1122:3344:101::12]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:61248 req_id = e028355b-c75c-494e-b0ae-1aa8f0a69e29 response_code = 200 uri = /crucible/0/regions/5db7218c-a484-4c59-8566-4f6f3ba1e2d1
532026-08-05T05:19:06.043ZINFOcrucible-agent (worker): SMF ok!
542026-08-05T05:19:06.051ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_02647adf-34c6-42a9-9e62-33d1f18ac803/crucible/regions/5db7218c-a484-4c59-8566-4f6f3ba1e2d1" region = 5db7218c-a484-4c59-8566-4f6f3ba1e2d1
552026-08-05T05:19:06.100ZINFOcrucible-agent (datafile): region 5db7218c-a484-4c59-8566-4f6f3ba1e2d1 state: Tombstoned -> Destroyed
562026-08-05T05:19:06.101ZINFOcrucible-agent (dropshot): request completed latency_us = 48 local_addr = [fd00:1122:3344:101::12]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:61248 req_id = 5fc1003e-465e-468b-b73b-a5484fff836c response_code = 200 uri = /crucible/0/regions/5db7218c-a484-4c59-8566-4f6f3ba1e2d1