Max level shown:
12026-01-21T23:54:41.121ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::1a]:32345 remote_addr = [fd00:1122:3344:101::b]:52939
22026-01-21T23:54:41.170ZINFOcrucible-agent (datafile): region 5a7dad9b-14b9-4450-9fff-d96f7828ee35 state: Requested
32026-01-21T23:54:41.176ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
42026-01-21T23:54:41.176ZINFOcrucible-agent (dropshot): request completed latency_us = 21715 local_addr = [fd00:1122:3344:101::1a]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:52939 req_id = ea29aca7-2139-452f-a810-d61a1bb0d179 response_code = 200 uri = /crucible/0/regions
52026-01-21T23:54:41.184ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_d925c709-054b-499a-8a63-d6059f2c81d6/crucible/regions/5a7dad9b-14b9-4450-9fff-d96f7828ee35
62026-01-21T23:54:41.184ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_d925c709-054b-499a-8a63-d6059f2c81d6/crucible/regions/5a7dad9b-14b9-4450-9fff-d96f7828ee35
72026-01-21T23:54:41.231ZINFOcrucible-agent (worker): creating region Region { id: RegionId("5a7dad9b-14b9-4450-9fff-d96f7828ee35"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/5a7dad9b-14b9-4450-9fff-d96f7828ee35" region = 5a7dad9b-14b9-4450-9fff-d96f7828ee35
82026-01-21T23:54:41.234ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "5a7dad9b-14b9-4450-9fff-d96f7828ee35" "--data" "/data/regions/5a7dad9b-14b9-4450-9fff-d96f7828ee35" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 5a7dad9b-14b9-4450-9fff-d96f7828ee35
92026-01-21T23:54:41.518ZINFOcrucible-agent (dropshot): request completed latency_us = 79 local_addr = [fd00:1122:3344:101::1a]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:52939 req_id = 08947f6d-a0bc-4d35-b7ec-2c3be73fe3e9 response_code = 200 uri = /crucible/0/regions
102026-01-21T23:54:41.653ZINFOcrucible-agent (worker): region files created ok region = 5a7dad9b-14b9-4450-9fff-d96f7828ee35
112026-01-21T23:54:41.653ZINFOcrucible-agent (datafile): region 5a7dad9b-14b9-4450-9fff-d96f7828ee35 state: Requested -> Created
122026-01-21T23:54:41.653ZINFOcrucible-agent (worker): applying SMF actions post create...
132026-01-21T23:54:41.653ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-5a7dad9b-14b9-4450-9fff-d96f7828ee35
142026-01-21T23:54:41.667ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-5a7dad9b-14b9-4450-9fff-d96f7828ee35
152026-01-21T23:54:41.688ZINFOcrucible-agent (worker): creating config property group
162026-01-21T23:54:41.691ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-5a7dad9b-14b9-4450-9fff-d96f7828ee35
172026-01-21T23:54:41.692ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/5a7dad9b-14b9-4450-9fff-d96f7828ee35
182026-01-21T23:54:41.692ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
192026-01-21T23:54:41.692ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::1a
202026-01-21T23:54:41.692ZINFOcrucible-agent (worker): commit
212026-01-21T23:54:41.697ZINFOcrucible-agent (worker): ok!
222026-01-21T23:54:41.701ZINFOcrucible-agent (worker): SMF ok!
232026-01-21T23:54:41.816ZINFOcrucible-agent (dropshot): request completed latency_us = 55 local_addr = [fd00:1122:3344:101::1a]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:52939 req_id = 27b75fa1-103f-4a47-bfcb-a962e8b0869b response_code = 200 uri = /crucible/0/regions
242026-01-21T23:54:48.544ZINFOcrucible-agent (datafile): region 028491fb-1953-4d5d-829b-2083b43ab650 state: Requested
252026-01-21T23:54:48.544ZINFOcrucible-agent (dropshot): request completed latency_us = 235 local_addr = [fd00:1122:3344:101::1a]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:52939 req_id = e972a0b8-25e0-4440-a001-953c8f84fd12 response_code = 200 uri = /crucible/0/regions
262026-01-21T23:54:48.545ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
272026-01-21T23:54:48.552ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_d925c709-054b-499a-8a63-d6059f2c81d6/crucible/regions/028491fb-1953-4d5d-829b-2083b43ab650
282026-01-21T23:54:48.552ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_d925c709-054b-499a-8a63-d6059f2c81d6/crucible/regions/028491fb-1953-4d5d-829b-2083b43ab650
292026-01-21T23:54:48.612ZINFOcrucible-agent (worker): creating region Region { id: RegionId("028491fb-1953-4d5d-829b-2083b43ab650"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/028491fb-1953-4d5d-829b-2083b43ab650" region = 028491fb-1953-4d5d-829b-2083b43ab650
302026-01-21T23:54:48.612ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "028491fb-1953-4d5d-829b-2083b43ab650" "--data" "/data/regions/028491fb-1953-4d5d-829b-2083b43ab650" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 028491fb-1953-4d5d-829b-2083b43ab650
312026-01-21T23:54:48.691ZINFOcrucible-agent (worker): region files created ok region = 028491fb-1953-4d5d-829b-2083b43ab650
322026-01-21T23:54:48.691ZINFOcrucible-agent (datafile): region 028491fb-1953-4d5d-829b-2083b43ab650 state: Requested -> Created
332026-01-21T23:54:48.692ZINFOcrucible-agent (worker): applying SMF actions post create...
342026-01-21T23:54:48.692ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-028491fb-1953-4d5d-829b-2083b43ab650
352026-01-21T23:54:48.696ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-028491fb-1953-4d5d-829b-2083b43ab650
362026-01-21T23:54:48.706ZINFOcrucible-agent (worker): creating config property group
372026-01-21T23:54:48.711ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-028491fb-1953-4d5d-829b-2083b43ab650
382026-01-21T23:54:48.711ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/028491fb-1953-4d5d-829b-2083b43ab650
392026-01-21T23:54:48.711ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
402026-01-21T23:54:48.711ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::1a
412026-01-21T23:54:48.711ZINFOcrucible-agent (worker): commit
422026-01-21T23:54:48.715ZINFOcrucible-agent (worker): ok!
432026-01-21T23:54:48.727ZINFOcrucible-agent (worker): SMF ok!
442026-01-21T23:54:48.830ZINFOcrucible-agent (dropshot): request completed latency_us = 58 local_addr = [fd00:1122:3344:101::1a]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:52939 req_id = ff9d6616-05fb-4772-b2a4-c19e1e6b21ba response_code = 200 uri = /crucible/0/regions
452026-01-21T23:55:15.279ZINFOcrucible-agent (dropshot): request completed latency_us = 72 local_addr = [fd00:1122:3344:101::1a]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:52939 req_id = 0f47aa6d-30af-4b55-b658-b094b17ac9e6 response_code = 200 uri = /crucible/0/regions/028491fb-1953-4d5d-829b-2083b43ab650
462026-01-21T23:55:15.281ZINFOcrucible-agent (datafile): path is "/data/regions/028491fb-1953-4d5d-829b-2083b43ab650"
472026-01-21T23:55:15.291ZINFOcrucible-agent (datafile): dataset is oxp_d925c709-054b-499a-8a63-d6059f2c81d6/crucible/regions/028491fb-1953-4d5d-829b-2083b43ab650
482026-01-21T23:55:15.299ZINFOcrucible-agent (datafile): region 028491fb-1953-4d5d-829b-2083b43ab650 state: Created -> Tombstoned
492026-01-21T23:55:15.299ZINFOcrucible-agent (dropshot): request completed latency_us = 17862 local_addr = [fd00:1122:3344:101::1a]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::b]:52939 req_id = 09111427-3a7c-4671-80d9-fdb944cbe11d response_code = 204 uri = /crucible/0/regions/028491fb-1953-4d5d-829b-2083b43ab650
502026-01-21T23:55:15.299ZINFOcrucible-agent (worker): applying SMF actions before removal...
512026-01-21T23:55:15.300ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-028491fb-1953-4d5d-829b-2083b43ab650 (instance states: (Some(Online), None))
522026-01-21T23:55:15.302ZINFOcrucible-agent (dropshot): request completed latency_us = 35 local_addr = [fd00:1122:3344:101::1a]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:52939 req_id = 6b7e8b18-276d-4ad4-a2aa-dc29b231b8a9 response_code = 200 uri = /crucible/0/regions/028491fb-1953-4d5d-829b-2083b43ab650
532026-01-21T23:55:15.310ZINFOcrucible-agent (worker): SMF ok!
542026-01-21T23:55:15.317ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_d925c709-054b-499a-8a63-d6059f2c81d6/crucible/regions/028491fb-1953-4d5d-829b-2083b43ab650" region = 028491fb-1953-4d5d-829b-2083b43ab650
552026-01-21T23:55:15.370ZINFOcrucible-agent (datafile): region 028491fb-1953-4d5d-829b-2083b43ab650 state: Tombstoned -> Destroyed
562026-01-21T23:55:15.418ZINFOcrucible-agent (dropshot): request completed latency_us = 49 local_addr = [fd00:1122:3344:101::1a]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:52939 req_id = 780e9b44-ce49-4104-aea9-fa77a2024e72 response_code = 200 uri = /crucible/0/regions/028491fb-1953-4d5d-829b-2083b43ab650