Max level shown:
12026-01-12T18:05:33.346ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::14]:32345 remote_addr = [fd00:1122:3344:101::a]:35418
22026-01-12T18:05:33.397ZINFOcrucible-agent (datafile): region f4d9c02a-c5b5-4f35-89e5-4ec483b21d51 state: Requested
32026-01-12T18:05:33.402ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
42026-01-12T18:05:33.402ZINFOcrucible-agent (dropshot): request completed latency_us = 23271 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:35418 req_id = e76a36ce-0a87-463a-840e-10714689af94 response_code = 200 uri = /crucible/0/regions
52026-01-12T18:05:33.412ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_732f2f12-c756-48d5-81fb-1b090effa249/crucible/regions/f4d9c02a-c5b5-4f35-89e5-4ec483b21d51
62026-01-12T18:05:33.412ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_732f2f12-c756-48d5-81fb-1b090effa249/crucible/regions/f4d9c02a-c5b5-4f35-89e5-4ec483b21d51
72026-01-12T18:05:33.492ZINFOcrucible-agent (worker): creating region Region { id: RegionId("f4d9c02a-c5b5-4f35-89e5-4ec483b21d51"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/f4d9c02a-c5b5-4f35-89e5-4ec483b21d51" region = f4d9c02a-c5b5-4f35-89e5-4ec483b21d51
82026-01-12T18:05:33.494ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "f4d9c02a-c5b5-4f35-89e5-4ec483b21d51" "--data" "/data/regions/f4d9c02a-c5b5-4f35-89e5-4ec483b21d51" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = f4d9c02a-c5b5-4f35-89e5-4ec483b21d51
92026-01-12T18:05:33.778ZINFOcrucible-agent (dropshot): request completed latency_us = 66 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:35418 req_id = e1319e45-a359-4fe8-a082-18f7102a09dd response_code = 200 uri = /crucible/0/regions
102026-01-12T18:05:33.942ZINFOcrucible-agent (worker): region files created ok region = f4d9c02a-c5b5-4f35-89e5-4ec483b21d51
112026-01-12T18:05:33.942ZINFOcrucible-agent (datafile): region f4d9c02a-c5b5-4f35-89e5-4ec483b21d51 state: Requested -> Created
122026-01-12T18:05:33.942ZINFOcrucible-agent (worker): applying SMF actions post create...
132026-01-12T18:05:33.942ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-f4d9c02a-c5b5-4f35-89e5-4ec483b21d51
142026-01-12T18:05:33.954ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-f4d9c02a-c5b5-4f35-89e5-4ec483b21d51
152026-01-12T18:05:33.972ZINFOcrucible-agent (worker): creating config property group
162026-01-12T18:05:33.975ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-f4d9c02a-c5b5-4f35-89e5-4ec483b21d51
172026-01-12T18:05:33.976ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/f4d9c02a-c5b5-4f35-89e5-4ec483b21d51
182026-01-12T18:05:33.976ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
192026-01-12T18:05:33.976ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::14
202026-01-12T18:05:33.976ZINFOcrucible-agent (worker): commit
212026-01-12T18:05:33.980ZINFOcrucible-agent (worker): ok!
222026-01-12T18:05:33.984ZINFOcrucible-agent (worker): SMF ok!
232026-01-12T18:05:34.298ZINFOcrucible-agent (dropshot): request completed latency_us = 56 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:35418 req_id = 70af08bd-0736-405e-9ce3-de2671e04711 response_code = 200 uri = /crucible/0/regions
242026-01-12T18:05:40.433ZINFOcrucible-agent (datafile): region dae19dfd-a044-47e8-b303-0d8c66591d3b state: Requested
252026-01-12T18:05:40.433ZINFOcrucible-agent (dropshot): request completed latency_us = 207 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:35418 req_id = f9bce866-84c2-4e38-af38-a250182429dc response_code = 200 uri = /crucible/0/regions
262026-01-12T18:05:40.433ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
272026-01-12T18:05:40.440ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_732f2f12-c756-48d5-81fb-1b090effa249/crucible/regions/dae19dfd-a044-47e8-b303-0d8c66591d3b
282026-01-12T18:05:40.440ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_732f2f12-c756-48d5-81fb-1b090effa249/crucible/regions/dae19dfd-a044-47e8-b303-0d8c66591d3b
292026-01-12T18:05:40.504ZINFOcrucible-agent (worker): creating region Region { id: RegionId("dae19dfd-a044-47e8-b303-0d8c66591d3b"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/dae19dfd-a044-47e8-b303-0d8c66591d3b" region = dae19dfd-a044-47e8-b303-0d8c66591d3b
302026-01-12T18:05:40.504ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "dae19dfd-a044-47e8-b303-0d8c66591d3b" "--data" "/data/regions/dae19dfd-a044-47e8-b303-0d8c66591d3b" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = dae19dfd-a044-47e8-b303-0d8c66591d3b
312026-01-12T18:05:40.579ZINFOcrucible-agent (worker): region files created ok region = dae19dfd-a044-47e8-b303-0d8c66591d3b
322026-01-12T18:05:40.579ZINFOcrucible-agent (datafile): region dae19dfd-a044-47e8-b303-0d8c66591d3b state: Requested -> Created
332026-01-12T18:05:40.580ZINFOcrucible-agent (worker): applying SMF actions post create...
342026-01-12T18:05:40.580ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-dae19dfd-a044-47e8-b303-0d8c66591d3b
352026-01-12T18:05:40.584ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-dae19dfd-a044-47e8-b303-0d8c66591d3b
362026-01-12T18:05:40.591ZINFOcrucible-agent (worker): creating config property group
372026-01-12T18:05:40.594ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-dae19dfd-a044-47e8-b303-0d8c66591d3b
382026-01-12T18:05:40.594ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/dae19dfd-a044-47e8-b303-0d8c66591d3b
392026-01-12T18:05:40.594ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
402026-01-12T18:05:40.594ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::14
412026-01-12T18:05:40.594ZINFOcrucible-agent (worker): commit
422026-01-12T18:05:40.598ZINFOcrucible-agent (worker): ok!
432026-01-12T18:05:40.609ZINFOcrucible-agent (worker): SMF ok!
442026-01-12T18:05:40.722ZINFOcrucible-agent (dropshot): request completed latency_us = 58 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:35418 req_id = b43df729-c208-4b60-b4bc-31202c12894c response_code = 200 uri = /crucible/0/regions
452026-01-12T18:06:07.408ZINFOcrucible-agent (dropshot): request completed latency_us = 73 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:35418 req_id = b4557675-c08d-4a50-8372-63cb55bd63e7 response_code = 200 uri = /crucible/0/regions/dae19dfd-a044-47e8-b303-0d8c66591d3b
462026-01-12T18:06:07.411ZINFOcrucible-agent (datafile): path is "/data/regions/dae19dfd-a044-47e8-b303-0d8c66591d3b"
472026-01-12T18:06:07.420ZINFOcrucible-agent (datafile): dataset is oxp_732f2f12-c756-48d5-81fb-1b090effa249/crucible/regions/dae19dfd-a044-47e8-b303-0d8c66591d3b
482026-01-12T18:06:07.426ZINFOcrucible-agent (datafile): region dae19dfd-a044-47e8-b303-0d8c66591d3b state: Created -> Tombstoned
492026-01-12T18:06:07.426ZINFOcrucible-agent (dropshot): request completed latency_us = 15123 local_addr = [fd00:1122:3344:101::14]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::a]:35418 req_id = c757392f-6b87-48cf-8f23-a076ff79f29b response_code = 204 uri = /crucible/0/regions/dae19dfd-a044-47e8-b303-0d8c66591d3b
502026-01-12T18:06:07.426ZINFOcrucible-agent (worker): applying SMF actions before removal...
512026-01-12T18:06:07.427ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-dae19dfd-a044-47e8-b303-0d8c66591d3b (instance states: (Some(Online), None))
522026-01-12T18:06:07.429ZINFOcrucible-agent (dropshot): request completed latency_us = 26 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:35418 req_id = 1fb35470-bcd5-41d0-8c42-f2e789d55d83 response_code = 200 uri = /crucible/0/regions/dae19dfd-a044-47e8-b303-0d8c66591d3b
532026-01-12T18:06:07.440ZINFOcrucible-agent (worker): SMF ok!
542026-01-12T18:06:07.447ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_732f2f12-c756-48d5-81fb-1b090effa249/crucible/regions/dae19dfd-a044-47e8-b303-0d8c66591d3b" region = dae19dfd-a044-47e8-b303-0d8c66591d3b
552026-01-12T18:06:07.497ZINFOcrucible-agent (datafile): region dae19dfd-a044-47e8-b303-0d8c66591d3b state: Tombstoned -> Destroyed
562026-01-12T18:06:07.524ZINFOcrucible-agent (dropshot): request completed latency_us = 48 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:35418 req_id = 8af622d1-c572-4272-a9c0-02cdb23ac2e4 response_code = 200 uri = /crucible/0/regions/dae19dfd-a044-47e8-b303-0d8c66591d3b