Max level shown:
12026-03-14T21:03:39.446ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::19]:32345 remote_addr = [fd00:1122:3344:101::b]:41123
22026-03-14T21:03:39.446ZINFOcrucible-agent (datafile): region 945a5332-0400-4e8c-b51f-180da0eedebe state: Requested
32026-03-14T21:03:39.446ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
42026-03-14T21:03:39.446ZINFOcrucible-agent (dropshot): request completed latency_us = 602 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:41123 req_id = 69edd9ff-4c55-43aa-89a3-434d83299e5b response_code = 200 uri = /crucible/0/regions
52026-03-14T21:03:39.455ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_952e3287-b729-4d8a-8e1f-26f3135e67c4/crucible/regions/945a5332-0400-4e8c-b51f-180da0eedebe
62026-03-14T21:03:39.455ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_952e3287-b729-4d8a-8e1f-26f3135e67c4/crucible/regions/945a5332-0400-4e8c-b51f-180da0eedebe
72026-03-14T21:03:39.505ZINFOcrucible-agent (worker): creating region Region { id: RegionId("945a5332-0400-4e8c-b51f-180da0eedebe"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/945a5332-0400-4e8c-b51f-180da0eedebe" region = 945a5332-0400-4e8c-b51f-180da0eedebe
82026-03-14T21:03:39.505ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "945a5332-0400-4e8c-b51f-180da0eedebe" "--data" "/data/regions/945a5332-0400-4e8c-b51f-180da0eedebe" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 945a5332-0400-4e8c-b51f-180da0eedebe
92026-03-14T21:03:39.584ZINFOcrucible-agent (worker): region files created ok region = 945a5332-0400-4e8c-b51f-180da0eedebe
102026-03-14T21:03:39.584ZINFOcrucible-agent (datafile): region 945a5332-0400-4e8c-b51f-180da0eedebe state: Requested -> Created
112026-03-14T21:03:39.584ZINFOcrucible-agent (worker): applying SMF actions post create...
122026-03-14T21:03:39.585ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-945a5332-0400-4e8c-b51f-180da0eedebe
132026-03-14T21:03:39.595ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-945a5332-0400-4e8c-b51f-180da0eedebe
142026-03-14T21:03:39.616ZINFOcrucible-agent (worker): creating config property group
152026-03-14T21:03:39.619ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-945a5332-0400-4e8c-b51f-180da0eedebe
162026-03-14T21:03:39.619ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/945a5332-0400-4e8c-b51f-180da0eedebe
172026-03-14T21:03:39.619ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
182026-03-14T21:03:39.620ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::19
192026-03-14T21:03:39.620ZINFOcrucible-agent (worker): commit
202026-03-14T21:03:39.623ZINFOcrucible-agent (worker): ok!
212026-03-14T21:03:39.628ZINFOcrucible-agent (worker): SMF ok!
222026-03-14T21:03:39.757ZINFOcrucible-agent (dropshot): request completed latency_us = 61 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:41123 req_id = c0e97917-e43a-49bc-88ae-75143d22ecb6 response_code = 200 uri = /crucible/0/regions
232026-03-14T21:03:46.428ZINFOcrucible-agent (datafile): region 74f990ce-05ed-4d41-a91b-ec68b268fbbf state: Requested
242026-03-14T21:03:46.428ZINFOcrucible-agent (dropshot): request completed latency_us = 228 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:41123 req_id = 7c9b0177-ecf1-4076-a2c5-24932e465280 response_code = 200 uri = /crucible/0/regions
252026-03-14T21:03:46.428ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
262026-03-14T21:03:46.434ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_952e3287-b729-4d8a-8e1f-26f3135e67c4/crucible/regions/74f990ce-05ed-4d41-a91b-ec68b268fbbf
272026-03-14T21:03:46.434ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_952e3287-b729-4d8a-8e1f-26f3135e67c4/crucible/regions/74f990ce-05ed-4d41-a91b-ec68b268fbbf
282026-03-14T21:03:46.477ZINFOcrucible-agent (worker): creating region Region { id: RegionId("74f990ce-05ed-4d41-a91b-ec68b268fbbf"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/74f990ce-05ed-4d41-a91b-ec68b268fbbf" region = 74f990ce-05ed-4d41-a91b-ec68b268fbbf
292026-03-14T21:03:46.477ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "74f990ce-05ed-4d41-a91b-ec68b268fbbf" "--data" "/data/regions/74f990ce-05ed-4d41-a91b-ec68b268fbbf" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 74f990ce-05ed-4d41-a91b-ec68b268fbbf
302026-03-14T21:03:46.558ZINFOcrucible-agent (worker): region files created ok region = 74f990ce-05ed-4d41-a91b-ec68b268fbbf
312026-03-14T21:03:46.558ZINFOcrucible-agent (datafile): region 74f990ce-05ed-4d41-a91b-ec68b268fbbf state: Requested -> Created
322026-03-14T21:03:46.558ZINFOcrucible-agent (worker): applying SMF actions post create...
332026-03-14T21:03:46.559ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-74f990ce-05ed-4d41-a91b-ec68b268fbbf
342026-03-14T21:03:46.567ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-74f990ce-05ed-4d41-a91b-ec68b268fbbf
352026-03-14T21:03:46.574ZINFOcrucible-agent (worker): creating config property group
362026-03-14T21:03:46.578ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-74f990ce-05ed-4d41-a91b-ec68b268fbbf
372026-03-14T21:03:46.578ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/74f990ce-05ed-4d41-a91b-ec68b268fbbf
382026-03-14T21:03:46.578ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
392026-03-14T21:03:46.578ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::19
402026-03-14T21:03:46.578ZINFOcrucible-agent (worker): commit
412026-03-14T21:03:46.582ZINFOcrucible-agent (worker): ok!
422026-03-14T21:03:46.592ZINFOcrucible-agent (worker): SMF ok!
432026-03-14T21:03:46.615ZINFOcrucible-agent (dropshot): request completed latency_us = 122 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:41123 req_id = de6a735e-421c-498f-a9f4-51ab4c964a55 response_code = 200 uri = /crucible/0/regions
442026-03-14T21:04:12.255ZINFOcrucible-agent (dropshot): request completed latency_us = 46 local_addr = [fd00:1122:3344:101::19]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:41123 req_id = e6263dec-6d95-484d-9f42-12fd8d7d7a38 response_code = 200 uri = /crucible/0/regions/74f990ce-05ed-4d41-a91b-ec68b268fbbf
452026-03-14T21:04:12.259ZINFOcrucible-agent (datafile): path is "/data/regions/74f990ce-05ed-4d41-a91b-ec68b268fbbf"
462026-03-14T21:04:12.270ZINFOcrucible-agent (datafile): dataset is oxp_952e3287-b729-4d8a-8e1f-26f3135e67c4/crucible/regions/74f990ce-05ed-4d41-a91b-ec68b268fbbf
472026-03-14T21:04:12.276ZINFOcrucible-agent (datafile): region 74f990ce-05ed-4d41-a91b-ec68b268fbbf state: Created -> Tombstoned
482026-03-14T21:04:12.277ZINFOcrucible-agent (dropshot): request completed latency_us = 18534 local_addr = [fd00:1122:3344:101::19]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::b]:41123 req_id = 3a1e20b4-aca8-4dd9-922d-08911962e692 response_code = 204 uri = /crucible/0/regions/74f990ce-05ed-4d41-a91b-ec68b268fbbf
492026-03-14T21:04:12.277ZINFOcrucible-agent (worker): applying SMF actions before removal...
502026-03-14T21:04:12.279ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-74f990ce-05ed-4d41-a91b-ec68b268fbbf (instance states: (Some(Online), None))
512026-03-14T21:04:12.280ZINFOcrucible-agent (dropshot): request completed latency_us = 44 local_addr = [fd00:1122:3344:101::19]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:41123 req_id = 17731609-2e2f-494d-8d98-275d2013199b response_code = 200 uri = /crucible/0/regions/74f990ce-05ed-4d41-a91b-ec68b268fbbf
522026-03-14T21:04:12.291ZINFOcrucible-agent (worker): SMF ok!
532026-03-14T21:04:12.300ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_952e3287-b729-4d8a-8e1f-26f3135e67c4/crucible/regions/74f990ce-05ed-4d41-a91b-ec68b268fbbf" region = 74f990ce-05ed-4d41-a91b-ec68b268fbbf
542026-03-14T21:04:12.349ZINFOcrucible-agent (datafile): region 74f990ce-05ed-4d41-a91b-ec68b268fbbf state: Tombstoned -> Destroyed
552026-03-14T21:04:12.423ZINFOcrucible-agent (dropshot): request completed latency_us = 54 local_addr = [fd00:1122:3344:101::19]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:41123 req_id = 485d9621-d031-4ac4-8a63-38a80eab6913 response_code = 200 uri = /crucible/0/regions/74f990ce-05ed-4d41-a91b-ec68b268fbbf