Max level shown:
12026-01-04T04:19:01.546ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::12]:32345 remote_addr = [fd00:1122:3344:101::a]:37149
22026-01-04T04:19:01.546ZINFOcrucible-agent (datafile): region 30f07052-8a40-4c70-a79c-748795498b08 state: Requested
32026-01-04T04:19:01.547ZINFOcrucible-agent (dropshot): request completed latency_us = 776 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:37149 req_id = 1cfa2d2b-367b-4454-ab2c-e6755f0969b6 response_code = 200 uri = /crucible/0/regions
42026-01-04T04:19:01.547ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
52026-01-04T04:19:01.554ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_42638f0e-b960-419a-b955-d3925448d01c/crucible/regions/30f07052-8a40-4c70-a79c-748795498b08
62026-01-04T04:19:01.554ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_42638f0e-b960-419a-b955-d3925448d01c/crucible/regions/30f07052-8a40-4c70-a79c-748795498b08
72026-01-04T04:19:01.626ZINFOcrucible-agent (worker): creating region Region { id: RegionId("30f07052-8a40-4c70-a79c-748795498b08"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/30f07052-8a40-4c70-a79c-748795498b08" region = 30f07052-8a40-4c70-a79c-748795498b08
82026-01-04T04:19:01.626ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "30f07052-8a40-4c70-a79c-748795498b08" "--data" "/data/regions/30f07052-8a40-4c70-a79c-748795498b08" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 30f07052-8a40-4c70-a79c-748795498b08
92026-01-04T04:19:01.706ZINFOcrucible-agent (worker): region files created ok region = 30f07052-8a40-4c70-a79c-748795498b08
102026-01-04T04:19:01.706ZINFOcrucible-agent (datafile): region 30f07052-8a40-4c70-a79c-748795498b08 state: Requested -> Created
112026-01-04T04:19:01.706ZINFOcrucible-agent (worker): applying SMF actions post create...
122026-01-04T04:19:01.707ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-30f07052-8a40-4c70-a79c-748795498b08
132026-01-04T04:19:01.716ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-30f07052-8a40-4c70-a79c-748795498b08
142026-01-04T04:19:01.739ZINFOcrucible-agent (worker): creating config property group
152026-01-04T04:19:01.743ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-30f07052-8a40-4c70-a79c-748795498b08
162026-01-04T04:19:01.743ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/30f07052-8a40-4c70-a79c-748795498b08
172026-01-04T04:19:01.743ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
182026-01-04T04:19:01.743ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::12
192026-01-04T04:19:01.743ZINFOcrucible-agent (worker): commit
202026-01-04T04:19:01.748ZINFOcrucible-agent (worker): ok!
212026-01-04T04:19:01.753ZINFOcrucible-agent (worker): SMF ok!
222026-01-04T04:19:01.803ZINFOcrucible-agent (dropshot): request completed latency_us = 56 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:37149 req_id = c0e3742a-40be-484d-9ad5-29c3f97c4834 response_code = 200 uri = /crucible/0/regions
232026-01-04T04:19:08.119ZINFOcrucible-agent (datafile): region 4722c387-b3e6-48f0-8e70-ee4c7a476327 state: Requested
242026-01-04T04:19:08.119ZINFOcrucible-agent (dropshot): request completed latency_us = 246 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:37149 req_id = 63d72b2b-5526-4f32-b068-f61498714308 response_code = 200 uri = /crucible/0/regions
252026-01-04T04:19:08.119ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
262026-01-04T04:19:08.125ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_42638f0e-b960-419a-b955-d3925448d01c/crucible/regions/4722c387-b3e6-48f0-8e70-ee4c7a476327
272026-01-04T04:19:08.125ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_42638f0e-b960-419a-b955-d3925448d01c/crucible/regions/4722c387-b3e6-48f0-8e70-ee4c7a476327
282026-01-04T04:19:08.174ZINFOcrucible-agent (worker): creating region Region { id: RegionId("4722c387-b3e6-48f0-8e70-ee4c7a476327"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/4722c387-b3e6-48f0-8e70-ee4c7a476327" region = 4722c387-b3e6-48f0-8e70-ee4c7a476327
292026-01-04T04:19:08.174ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "4722c387-b3e6-48f0-8e70-ee4c7a476327" "--data" "/data/regions/4722c387-b3e6-48f0-8e70-ee4c7a476327" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 4722c387-b3e6-48f0-8e70-ee4c7a476327
302026-01-04T04:19:08.259ZINFOcrucible-agent (worker): region files created ok region = 4722c387-b3e6-48f0-8e70-ee4c7a476327
312026-01-04T04:19:08.259ZINFOcrucible-agent (datafile): region 4722c387-b3e6-48f0-8e70-ee4c7a476327 state: Requested -> Created
322026-01-04T04:19:08.259ZINFOcrucible-agent (worker): applying SMF actions post create...
332026-01-04T04:19:08.265ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-4722c387-b3e6-48f0-8e70-ee4c7a476327
342026-01-04T04:19:08.275ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-4722c387-b3e6-48f0-8e70-ee4c7a476327
352026-01-04T04:19:08.285ZINFOcrucible-agent (worker): creating config property group
362026-01-04T04:19:08.289ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-4722c387-b3e6-48f0-8e70-ee4c7a476327
372026-01-04T04:19:08.289ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/4722c387-b3e6-48f0-8e70-ee4c7a476327
382026-01-04T04:19:08.289ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
392026-01-04T04:19:08.289ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::12
402026-01-04T04:19:08.289ZINFOcrucible-agent (worker): commit
412026-01-04T04:19:08.294ZINFOcrucible-agent (worker): ok!
422026-01-04T04:19:08.300ZINFOcrucible-agent (worker): SMF ok!
432026-01-04T04:19:08.396ZINFOcrucible-agent (dropshot): request completed latency_us = 55 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:37149 req_id = 7995ed65-0337-412f-a57c-eadd03e67870 response_code = 200 uri = /crucible/0/regions
442026-01-04T04:19:35.937ZINFOcrucible-agent (dropshot): request completed latency_us = 59 local_addr = [fd00:1122:3344:101::12]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:37149 req_id = 93e2902f-d156-4bb8-bad5-acc06dcd4c7d response_code = 200 uri = /crucible/0/regions/4722c387-b3e6-48f0-8e70-ee4c7a476327
452026-01-04T04:19:35.941ZINFOcrucible-agent (datafile): path is "/data/regions/4722c387-b3e6-48f0-8e70-ee4c7a476327"
462026-01-04T04:19:35.952ZINFOcrucible-agent (datafile): dataset is oxp_42638f0e-b960-419a-b955-d3925448d01c/crucible/regions/4722c387-b3e6-48f0-8e70-ee4c7a476327
472026-01-04T04:19:35.959ZINFOcrucible-agent (datafile): region 4722c387-b3e6-48f0-8e70-ee4c7a476327 state: Created -> Tombstoned
482026-01-04T04:19:35.960ZINFOcrucible-agent (dropshot): request completed latency_us = 18420 local_addr = [fd00:1122:3344:101::12]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::a]:37149 req_id = a44cc452-fbf7-46f6-a5c3-3e0e9cb8d77b response_code = 204 uri = /crucible/0/regions/4722c387-b3e6-48f0-8e70-ee4c7a476327
492026-01-04T04:19:35.960ZINFOcrucible-agent (worker): applying SMF actions before removal...
502026-01-04T04:19:35.961ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-4722c387-b3e6-48f0-8e70-ee4c7a476327 (instance states: (Some(Online), None))
512026-01-04T04:19:35.962ZINFOcrucible-agent (dropshot): request completed latency_us = 40 local_addr = [fd00:1122:3344:101::12]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:37149 req_id = 0f948236-9958-46bf-92f6-22014d7e1a3b response_code = 200 uri = /crucible/0/regions/4722c387-b3e6-48f0-8e70-ee4c7a476327
522026-01-04T04:19:35.971ZINFOcrucible-agent (worker): SMF ok!
532026-01-04T04:19:35.978ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_42638f0e-b960-419a-b955-d3925448d01c/crucible/regions/4722c387-b3e6-48f0-8e70-ee4c7a476327" region = 4722c387-b3e6-48f0-8e70-ee4c7a476327
542026-01-04T04:19:36.031ZINFOcrucible-agent (dropshot): request completed latency_us = 34 local_addr = [fd00:1122:3344:101::12]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:37149 req_id = 497c3f50-3a66-47e0-9c55-31afd602d3b1 response_code = 200 uri = /crucible/0/regions/4722c387-b3e6-48f0-8e70-ee4c7a476327
552026-01-04T04:19:36.037ZINFOcrucible-agent (datafile): region 4722c387-b3e6-48f0-8e70-ee4c7a476327 state: Tombstoned -> Destroyed
562026-01-04T04:19:36.177ZINFOcrucible-agent (dropshot): request completed latency_us = 43 local_addr = [fd00:1122:3344:101::12]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:37149 req_id = d293dbf5-184b-4c08-b0de-8cd3bed104f3 response_code = 200 uri = /crucible/0/regions/4722c387-b3e6-48f0-8e70-ee4c7a476327