Max level shown:
12026-05-14T16:08:34.149ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::14]:32345 remote_addr = [fd00:1122:3344:101::a]:37254
22026-05-14T16:08:34.202ZINFOcrucible-agent (datafile): region 989837d2-c065-4b57-b0db-027e2f701be7 state: Requested
32026-05-14T16:08:34.204ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
42026-05-14T16:08:34.204ZINFOcrucible-agent (dropshot): request completed latency_us = 24444 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:37254 req_id = d45c7e3f-8ecd-4f70-b416-7256cdcd461d response_code = 200 uri = /crucible/0/regions
52026-05-14T16:08:34.216ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_4afd88bc-aa32-4807-b142-ad870c37fa65/crucible/regions/989837d2-c065-4b57-b0db-027e2f701be7
62026-05-14T16:08:34.216ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_4afd88bc-aa32-4807-b142-ad870c37fa65/crucible/regions/989837d2-c065-4b57-b0db-027e2f701be7
72026-05-14T16:08:34.263ZINFOcrucible-agent (worker): creating region Region { id: RegionId("989837d2-c065-4b57-b0db-027e2f701be7"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/989837d2-c065-4b57-b0db-027e2f701be7" region = 989837d2-c065-4b57-b0db-027e2f701be7
82026-05-14T16:08:34.265ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "989837d2-c065-4b57-b0db-027e2f701be7" "--data" "/data/regions/989837d2-c065-4b57-b0db-027e2f701be7" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 989837d2-c065-4b57-b0db-027e2f701be7
92026-05-14T16:08:34.511ZINFOcrucible-agent (dropshot): request completed latency_us = 65 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:37254 req_id = d858306f-86a0-4aaa-8561-bbcf808bdcda response_code = 200 uri = /crucible/0/regions
102026-05-14T16:08:34.653ZINFOcrucible-agent (worker): region files created ok region = 989837d2-c065-4b57-b0db-027e2f701be7
112026-05-14T16:08:34.653ZINFOcrucible-agent (datafile): region 989837d2-c065-4b57-b0db-027e2f701be7 state: Requested -> Created
122026-05-14T16:08:34.653ZINFOcrucible-agent (worker): applying SMF actions post create...
132026-05-14T16:08:34.654ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-989837d2-c065-4b57-b0db-027e2f701be7
142026-05-14T16:08:34.663ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-989837d2-c065-4b57-b0db-027e2f701be7
152026-05-14T16:08:34.675ZINFOcrucible-agent (worker): creating config property group
162026-05-14T16:08:34.676ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-989837d2-c065-4b57-b0db-027e2f701be7
172026-05-14T16:08:34.677ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/989837d2-c065-4b57-b0db-027e2f701be7
182026-05-14T16:08:34.677ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
192026-05-14T16:08:34.677ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::14
202026-05-14T16:08:34.677ZINFOcrucible-agent (worker): commit
212026-05-14T16:08:34.679ZINFOcrucible-agent (worker): ok!
222026-05-14T16:08:34.682ZINFOcrucible-agent (worker): SMF ok!
232026-05-14T16:08:35.143ZINFOcrucible-agent (dropshot): request completed latency_us = 60 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:37254 req_id = da420544-d272-469d-8150-3ee7cb7beaba response_code = 200 uri = /crucible/0/regions
242026-05-14T16:08:40.743ZINFOcrucible-agent (datafile): region b4349307-5de4-4c50-8f0f-19db00d2d68d state: Requested
252026-05-14T16:08:40.743ZINFOcrucible-agent (dropshot): request completed latency_us = 219 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:37254 req_id = a96a20c2-130e-4696-8dd2-a06541ad5de6 response_code = 200 uri = /crucible/0/regions
262026-05-14T16:08:40.743ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
272026-05-14T16:08:40.750ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_4afd88bc-aa32-4807-b142-ad870c37fa65/crucible/regions/b4349307-5de4-4c50-8f0f-19db00d2d68d
282026-05-14T16:08:40.750ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_4afd88bc-aa32-4807-b142-ad870c37fa65/crucible/regions/b4349307-5de4-4c50-8f0f-19db00d2d68d
292026-05-14T16:08:40.797ZINFOcrucible-agent (worker): creating region Region { id: RegionId("b4349307-5de4-4c50-8f0f-19db00d2d68d"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/b4349307-5de4-4c50-8f0f-19db00d2d68d" region = b4349307-5de4-4c50-8f0f-19db00d2d68d
302026-05-14T16:08:40.797ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "b4349307-5de4-4c50-8f0f-19db00d2d68d" "--data" "/data/regions/b4349307-5de4-4c50-8f0f-19db00d2d68d" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = b4349307-5de4-4c50-8f0f-19db00d2d68d
312026-05-14T16:08:40.844ZINFOcrucible-agent (worker): region files created ok region = b4349307-5de4-4c50-8f0f-19db00d2d68d
322026-05-14T16:08:40.844ZINFOcrucible-agent (datafile): region b4349307-5de4-4c50-8f0f-19db00d2d68d state: Requested -> Created
332026-05-14T16:08:40.844ZINFOcrucible-agent (worker): applying SMF actions post create...
342026-05-14T16:08:40.849ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-b4349307-5de4-4c50-8f0f-19db00d2d68d
352026-05-14T16:08:40.851ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-b4349307-5de4-4c50-8f0f-19db00d2d68d
362026-05-14T16:08:40.854ZINFOcrucible-agent (worker): creating config property group
372026-05-14T16:08:40.855ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-b4349307-5de4-4c50-8f0f-19db00d2d68d
382026-05-14T16:08:40.856ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/b4349307-5de4-4c50-8f0f-19db00d2d68d
392026-05-14T16:08:40.856ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
402026-05-14T16:08:40.856ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::14
412026-05-14T16:08:40.856ZINFOcrucible-agent (worker): commit
422026-05-14T16:08:40.858ZINFOcrucible-agent (worker): ok!
432026-05-14T16:08:40.861ZINFOcrucible-agent (worker): SMF ok!
442026-05-14T16:08:41.002ZINFOcrucible-agent (dropshot): request completed latency_us = 60 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:37254 req_id = fed0111e-010a-4f37-926d-95aebbfabf12 response_code = 200 uri = /crucible/0/regions
452026-05-14T16:09:05.468ZINFOcrucible-agent (dropshot): request completed latency_us = 73 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:37254 req_id = 5eeda815-11de-409f-bbe2-042af2d5d70e response_code = 200 uri = /crucible/0/regions/b4349307-5de4-4c50-8f0f-19db00d2d68d
462026-05-14T16:09:05.472ZINFOcrucible-agent (datafile): path is "/data/regions/b4349307-5de4-4c50-8f0f-19db00d2d68d"
472026-05-14T16:09:05.481ZINFOcrucible-agent (datafile): dataset is oxp_4afd88bc-aa32-4807-b142-ad870c37fa65/crucible/regions/b4349307-5de4-4c50-8f0f-19db00d2d68d
482026-05-14T16:09:05.488ZINFOcrucible-agent (datafile): region b4349307-5de4-4c50-8f0f-19db00d2d68d state: Created -> Tombstoned
492026-05-14T16:09:05.489ZINFOcrucible-agent (worker): applying SMF actions before removal...
502026-05-14T16:09:05.489ZINFOcrucible-agent (dropshot): request completed latency_us = 16395 local_addr = [fd00:1122:3344:101::14]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::a]:37254 req_id = 4876d84f-364f-4f9c-8fc6-055f0527cd8c response_code = 204 uri = /crucible/0/regions/b4349307-5de4-4c50-8f0f-19db00d2d68d
512026-05-14T16:09:05.489ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-b4349307-5de4-4c50-8f0f-19db00d2d68d (instance states: (Some(Online), None))
522026-05-14T16:09:05.492ZINFOcrucible-agent (dropshot): request completed latency_us = 45 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:37254 req_id = 717fea71-3146-43ee-a5da-52067ceff464 response_code = 200 uri = /crucible/0/regions/b4349307-5de4-4c50-8f0f-19db00d2d68d
532026-05-14T16:09:05.493ZINFOcrucible-agent (worker): SMF ok!
542026-05-14T16:09:05.502ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_4afd88bc-aa32-4807-b142-ad870c37fa65/crucible/regions/b4349307-5de4-4c50-8f0f-19db00d2d68d" region = b4349307-5de4-4c50-8f0f-19db00d2d68d
552026-05-14T16:09:05.551ZINFOcrucible-agent (datafile): region b4349307-5de4-4c50-8f0f-19db00d2d68d state: Tombstoned -> Destroyed
562026-05-14T16:09:05.562ZINFOcrucible-agent (dropshot): request completed latency_us = 157 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:37254 req_id = dd1ba54d-a630-4e55-be1f-40356d1c4cd8 response_code = 200 uri = /crucible/0/regions/b4349307-5de4-4c50-8f0f-19db00d2d68d