Max level shown:
12026-05-22T22:07:43.202ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::14]:32345 remote_addr = [fd00:1122:3344:101::b]:41622
22026-05-22T22:07:43.202ZINFOcrucible-agent (datafile): region 4ffe31c8-bcd0-41d4-994d-ff87c3526feb state: Requested
32026-05-22T22:07:43.203ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
42026-05-22T22:07:43.203ZINFOcrucible-agent (dropshot): request completed latency_us = 979 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:41622 req_id = 067dc734-c585-4dce-a984-4c49f343b6b5 response_code = 200 uri = /crucible/0/regions
52026-05-22T22:07:43.214ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_801a87fa-21d0-48f9-8b62-72f340f5e88b/crucible/regions/4ffe31c8-bcd0-41d4-994d-ff87c3526feb
62026-05-22T22:07:43.214ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_801a87fa-21d0-48f9-8b62-72f340f5e88b/crucible/regions/4ffe31c8-bcd0-41d4-994d-ff87c3526feb
72026-05-22T22:07:43.256ZINFOcrucible-agent (worker): creating region Region { id: RegionId("4ffe31c8-bcd0-41d4-994d-ff87c3526feb"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/4ffe31c8-bcd0-41d4-994d-ff87c3526feb" region = 4ffe31c8-bcd0-41d4-994d-ff87c3526feb
82026-05-22T22:07:43.256ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "4ffe31c8-bcd0-41d4-994d-ff87c3526feb" "--data" "/data/regions/4ffe31c8-bcd0-41d4-994d-ff87c3526feb" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 4ffe31c8-bcd0-41d4-994d-ff87c3526feb
92026-05-22T22:07:43.309ZINFOcrucible-agent (worker): region files created ok region = 4ffe31c8-bcd0-41d4-994d-ff87c3526feb
102026-05-22T22:07:43.309ZINFOcrucible-agent (datafile): region 4ffe31c8-bcd0-41d4-994d-ff87c3526feb state: Requested -> Created
112026-05-22T22:07:43.309ZINFOcrucible-agent (worker): applying SMF actions post create...
122026-05-22T22:07:43.310ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-4ffe31c8-bcd0-41d4-994d-ff87c3526feb
132026-05-22T22:07:43.320ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-4ffe31c8-bcd0-41d4-994d-ff87c3526feb
142026-05-22T22:07:43.334ZINFOcrucible-agent (worker): creating config property group
152026-05-22T22:07:43.335ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-4ffe31c8-bcd0-41d4-994d-ff87c3526feb
162026-05-22T22:07:43.335ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/4ffe31c8-bcd0-41d4-994d-ff87c3526feb
172026-05-22T22:07:43.335ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
182026-05-22T22:07:43.335ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::14
192026-05-22T22:07:43.335ZINFOcrucible-agent (worker): commit
202026-05-22T22:07:43.337ZINFOcrucible-agent (worker): ok!
212026-05-22T22:07:43.340ZINFOcrucible-agent (worker): SMF ok!
222026-05-22T22:07:43.541ZINFOcrucible-agent (dropshot): request completed latency_us = 62 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:41622 req_id = 4202f41a-4ad3-4bc2-8821-c946d5571bb5 response_code = 200 uri = /crucible/0/regions
232026-05-22T22:07:49.317ZINFOcrucible-agent (datafile): region dd38b8a6-929b-4d38-b609-a7d3f14196ec state: Requested
242026-05-22T22:07:49.317ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
252026-05-22T22:07:49.317ZINFOcrucible-agent (dropshot): request completed latency_us = 287 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:41622 req_id = 90f09d92-d2d6-48c9-8636-13a89b4d4039 response_code = 200 uri = /crucible/0/regions
262026-05-22T22:07:49.324ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_801a87fa-21d0-48f9-8b62-72f340f5e88b/crucible/regions/dd38b8a6-929b-4d38-b609-a7d3f14196ec
272026-05-22T22:07:49.325ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_801a87fa-21d0-48f9-8b62-72f340f5e88b/crucible/regions/dd38b8a6-929b-4d38-b609-a7d3f14196ec
282026-05-22T22:07:49.367ZINFOcrucible-agent (worker): creating region Region { id: RegionId("dd38b8a6-929b-4d38-b609-a7d3f14196ec"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/dd38b8a6-929b-4d38-b609-a7d3f14196ec" region = dd38b8a6-929b-4d38-b609-a7d3f14196ec
292026-05-22T22:07:49.367ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "dd38b8a6-929b-4d38-b609-a7d3f14196ec" "--data" "/data/regions/dd38b8a6-929b-4d38-b609-a7d3f14196ec" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = dd38b8a6-929b-4d38-b609-a7d3f14196ec
302026-05-22T22:07:49.426ZINFOcrucible-agent (worker): region files created ok region = dd38b8a6-929b-4d38-b609-a7d3f14196ec
312026-05-22T22:07:49.426ZINFOcrucible-agent (datafile): region dd38b8a6-929b-4d38-b609-a7d3f14196ec state: Requested -> Created
322026-05-22T22:07:49.426ZINFOcrucible-agent (worker): applying SMF actions post create...
332026-05-22T22:07:49.431ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-dd38b8a6-929b-4d38-b609-a7d3f14196ec
342026-05-22T22:07:49.439ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-dd38b8a6-929b-4d38-b609-a7d3f14196ec
352026-05-22T22:07:49.442ZINFOcrucible-agent (worker): creating config property group
362026-05-22T22:07:49.444ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-dd38b8a6-929b-4d38-b609-a7d3f14196ec
372026-05-22T22:07:49.444ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/dd38b8a6-929b-4d38-b609-a7d3f14196ec
382026-05-22T22:07:49.444ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
392026-05-22T22:07:49.444ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::14
402026-05-22T22:07:49.444ZINFOcrucible-agent (worker): commit
412026-05-22T22:07:49.446ZINFOcrucible-agent (worker): ok!
422026-05-22T22:07:49.449ZINFOcrucible-agent (worker): SMF ok!
432026-05-22T22:07:49.605ZINFOcrucible-agent (dropshot): request completed latency_us = 72 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:41622 req_id = 65225445-f4b7-48be-bbab-736e9b400033 response_code = 200 uri = /crucible/0/regions
442026-05-22T22:08:14.386ZINFOcrucible-agent (dropshot): request completed latency_us = 56 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:41622 req_id = e1981731-0d50-471d-8feb-a032ad13cdd8 response_code = 200 uri = /crucible/0/regions/dd38b8a6-929b-4d38-b609-a7d3f14196ec
452026-05-22T22:08:14.389ZINFOcrucible-agent (datafile): path is "/data/regions/dd38b8a6-929b-4d38-b609-a7d3f14196ec"
462026-05-22T22:08:14.401ZINFOcrucible-agent (datafile): dataset is oxp_801a87fa-21d0-48f9-8b62-72f340f5e88b/crucible/regions/dd38b8a6-929b-4d38-b609-a7d3f14196ec
472026-05-22T22:08:14.408ZINFOcrucible-agent (datafile): region dd38b8a6-929b-4d38-b609-a7d3f14196ec state: Created -> Tombstoned
482026-05-22T22:08:14.408ZINFOcrucible-agent (worker): applying SMF actions before removal...
492026-05-22T22:08:14.408ZINFOcrucible-agent (dropshot): request completed latency_us = 19072 local_addr = [fd00:1122:3344:101::14]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::b]:41622 req_id = 40227730-a1ff-4f69-bb12-37a701d08ada response_code = 204 uri = /crucible/0/regions/dd38b8a6-929b-4d38-b609-a7d3f14196ec
502026-05-22T22:08:14.409ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-dd38b8a6-929b-4d38-b609-a7d3f14196ec (instance states: (Some(Online), None))
512026-05-22T22:08:14.412ZINFOcrucible-agent (dropshot): request completed latency_us = 54 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:41622 req_id = 8623b3f2-c2ff-485c-9874-d74d4a65b932 response_code = 200 uri = /crucible/0/regions/dd38b8a6-929b-4d38-b609-a7d3f14196ec
522026-05-22T22:08:14.413ZINFOcrucible-agent (worker): SMF ok!
532026-05-22T22:08:14.422ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_801a87fa-21d0-48f9-8b62-72f340f5e88b/crucible/regions/dd38b8a6-929b-4d38-b609-a7d3f14196ec" region = dd38b8a6-929b-4d38-b609-a7d3f14196ec
542026-05-22T22:08:14.464ZINFOcrucible-agent (datafile): region dd38b8a6-929b-4d38-b609-a7d3f14196ec state: Tombstoned -> Destroyed
552026-05-22T22:08:14.483ZINFOcrucible-agent (dropshot): request completed latency_us = 49 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:41622 req_id = b3703c62-fbcb-4abc-9ea9-875b99b19abd response_code = 200 uri = /crucible/0/regions/dd38b8a6-929b-4d38-b609-a7d3f14196ec