Max level shown:
12025-12-16T01:30:15.145ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::14]:32345 remote_addr = [fd00:1122:3344:101::b]:55269
22025-12-16T01:30:15.203ZINFOcrucible-agent (datafile): region 2c6d5cdc-737c-4a38-b2d3-c035adb4ce88 state: Requested
32025-12-16T01:30:15.208ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
42025-12-16T01:30:15.208ZINFOcrucible-agent (dropshot): request completed latency_us = 23246 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:55269 req_id = 144e778b-ba40-429a-a742-8918f478e646 response_code = 200 uri = /crucible/0/regions
52025-12-16T01:30:15.218ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_77a4f83b-559b-49c7-8cdc-3af9bd88c7df/crucible/regions/2c6d5cdc-737c-4a38-b2d3-c035adb4ce88
62025-12-16T01:30:15.218ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_77a4f83b-559b-49c7-8cdc-3af9bd88c7df/crucible/regions/2c6d5cdc-737c-4a38-b2d3-c035adb4ce88
72025-12-16T01:30:15.276ZINFOcrucible-agent (worker): creating region Region { id: RegionId("2c6d5cdc-737c-4a38-b2d3-c035adb4ce88"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/2c6d5cdc-737c-4a38-b2d3-c035adb4ce88" region = 2c6d5cdc-737c-4a38-b2d3-c035adb4ce88
82025-12-16T01:30:15.279ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "2c6d5cdc-737c-4a38-b2d3-c035adb4ce88" "--data" "/data/regions/2c6d5cdc-737c-4a38-b2d3-c035adb4ce88" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 2c6d5cdc-737c-4a38-b2d3-c035adb4ce88
92025-12-16T01:30:15.427ZINFOcrucible-agent (dropshot): request completed latency_us = 61 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:55269 req_id = 6b3397e7-e35d-409d-9f16-b70006367a59 response_code = 200 uri = /crucible/0/regions
102025-12-16T01:30:15.721ZINFOcrucible-agent (worker): region files created ok region = 2c6d5cdc-737c-4a38-b2d3-c035adb4ce88
112025-12-16T01:30:15.721ZINFOcrucible-agent (datafile): region 2c6d5cdc-737c-4a38-b2d3-c035adb4ce88 state: Requested -> Created
122025-12-16T01:30:15.721ZINFOcrucible-agent (worker): applying SMF actions post create...
132025-12-16T01:30:15.721ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-2c6d5cdc-737c-4a38-b2d3-c035adb4ce88
142025-12-16T01:30:15.733ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-2c6d5cdc-737c-4a38-b2d3-c035adb4ce88
152025-12-16T01:30:15.762ZINFOcrucible-agent (worker): creating config property group
162025-12-16T01:30:15.767ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-2c6d5cdc-737c-4a38-b2d3-c035adb4ce88
172025-12-16T01:30:15.768ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/2c6d5cdc-737c-4a38-b2d3-c035adb4ce88
182025-12-16T01:30:15.768ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
192025-12-16T01:30:15.768ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::14
202025-12-16T01:30:15.768ZINFOcrucible-agent (worker): commit
212025-12-16T01:30:15.776ZINFOcrucible-agent (worker): ok!
222025-12-16T01:30:15.780ZINFOcrucible-agent (dropshot): request completed latency_us = 62 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:55269 req_id = 596564f5-44a5-48f6-8036-61f807ecdedd response_code = 200 uri = /crucible/0/regions
232025-12-16T01:30:15.783ZINFOcrucible-agent (worker): SMF ok!
242025-12-16T01:30:22.024ZINFOcrucible-agent (datafile): region 6e59ec36-b14a-4d29-b358-da0590e4aa3b state: Requested
252025-12-16T01:30:22.024ZINFOcrucible-agent (dropshot): request completed latency_us = 224 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:55269 req_id = 23a06c03-17b8-43fd-bff7-8280b058a24d response_code = 200 uri = /crucible/0/regions
262025-12-16T01:30:22.024ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
272025-12-16T01:30:22.030ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_77a4f83b-559b-49c7-8cdc-3af9bd88c7df/crucible/regions/6e59ec36-b14a-4d29-b358-da0590e4aa3b
282025-12-16T01:30:22.030ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_77a4f83b-559b-49c7-8cdc-3af9bd88c7df/crucible/regions/6e59ec36-b14a-4d29-b358-da0590e4aa3b
292025-12-16T01:30:22.090ZINFOcrucible-agent (worker): creating region Region { id: RegionId("6e59ec36-b14a-4d29-b358-da0590e4aa3b"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/6e59ec36-b14a-4d29-b358-da0590e4aa3b" region = 6e59ec36-b14a-4d29-b358-da0590e4aa3b
302025-12-16T01:30:22.090ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "6e59ec36-b14a-4d29-b358-da0590e4aa3b" "--data" "/data/regions/6e59ec36-b14a-4d29-b358-da0590e4aa3b" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 6e59ec36-b14a-4d29-b358-da0590e4aa3b
312025-12-16T01:30:22.207ZINFOcrucible-agent (worker): region files created ok region = 6e59ec36-b14a-4d29-b358-da0590e4aa3b
322025-12-16T01:30:22.207ZINFOcrucible-agent (datafile): region 6e59ec36-b14a-4d29-b358-da0590e4aa3b state: Requested -> Created
332025-12-16T01:30:22.207ZINFOcrucible-agent (worker): applying SMF actions post create...
342025-12-16T01:30:22.211ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-6e59ec36-b14a-4d29-b358-da0590e4aa3b
352025-12-16T01:30:22.216ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-6e59ec36-b14a-4d29-b358-da0590e4aa3b
362025-12-16T01:30:22.229ZINFOcrucible-agent (worker): creating config property group
372025-12-16T01:30:22.234ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-6e59ec36-b14a-4d29-b358-da0590e4aa3b
382025-12-16T01:30:22.234ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/6e59ec36-b14a-4d29-b358-da0590e4aa3b
392025-12-16T01:30:22.234ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
402025-12-16T01:30:22.234ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::14
412025-12-16T01:30:22.234ZINFOcrucible-agent (worker): commit
422025-12-16T01:30:22.242ZINFOcrucible-agent (worker): ok!
432025-12-16T01:30:22.251ZINFOcrucible-agent (worker): SMF ok!
442025-12-16T01:30:22.305ZINFOcrucible-agent (dropshot): request completed latency_us = 62 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:55269 req_id = 3458ccec-b41f-4446-bc42-29b39a13d930 response_code = 200 uri = /crucible/0/regions
452025-12-16T01:30:49.938ZINFOcrucible-agent (dropshot): request completed latency_us = 80 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:55269 req_id = 0f5323ee-3072-429c-b3a7-9877fe6714bc response_code = 200 uri = /crucible/0/regions/6e59ec36-b14a-4d29-b358-da0590e4aa3b
462025-12-16T01:30:49.943ZINFOcrucible-agent (datafile): path is "/data/regions/6e59ec36-b14a-4d29-b358-da0590e4aa3b"
472025-12-16T01:30:49.954ZINFOcrucible-agent (datafile): dataset is oxp_77a4f83b-559b-49c7-8cdc-3af9bd88c7df/crucible/regions/6e59ec36-b14a-4d29-b358-da0590e4aa3b
482025-12-16T01:30:49.962ZINFOcrucible-agent (datafile): region 6e59ec36-b14a-4d29-b358-da0590e4aa3b state: Created -> Tombstoned
492025-12-16T01:30:49.962ZINFOcrucible-agent (dropshot): request completed latency_us = 19403 local_addr = [fd00:1122:3344:101::14]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::b]:55269 req_id = f1285761-2bfd-49b7-b9b8-7d125dca623b response_code = 204 uri = /crucible/0/regions/6e59ec36-b14a-4d29-b358-da0590e4aa3b
502025-12-16T01:30:49.962ZINFOcrucible-agent (worker): applying SMF actions before removal...
512025-12-16T01:30:49.963ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-6e59ec36-b14a-4d29-b358-da0590e4aa3b (instance states: (Some(Online), None))
522025-12-16T01:30:49.964ZINFOcrucible-agent (dropshot): request completed latency_us = 28 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:55269 req_id = e63459f1-c851-499b-a559-0601d91eeb18 response_code = 200 uri = /crucible/0/regions/6e59ec36-b14a-4d29-b358-da0590e4aa3b
532025-12-16T01:30:49.978ZINFOcrucible-agent (worker): SMF ok!
542025-12-16T01:30:49.988ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_77a4f83b-559b-49c7-8cdc-3af9bd88c7df/crucible/regions/6e59ec36-b14a-4d29-b358-da0590e4aa3b" region = 6e59ec36-b14a-4d29-b358-da0590e4aa3b
552025-12-16T01:30:50.050ZINFOcrucible-agent (datafile): region 6e59ec36-b14a-4d29-b358-da0590e4aa3b state: Tombstoned -> Destroyed
562025-12-16T01:30:50.059ZINFOcrucible-agent (dropshot): request completed latency_us = 54 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:55269 req_id = 08c83572-de4e-44ef-9cd6-228958ba599a response_code = 200 uri = /crucible/0/regions/6e59ec36-b14a-4d29-b358-da0590e4aa3b