Max level shown:
12025-12-23T22:01:27.120ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::18]:32345 remote_addr = [fd00:1122:3344:101::a]:36798
22025-12-23T22:01:27.120ZINFOcrucible-agent (datafile): region 20cd63c8-47a1-43ac-9170-96aaaa7c4dbb state: Requested
32025-12-23T22:01:27.120ZINFOcrucible-agent (dropshot): request completed latency_us = 637 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:36798 req_id = b17d438d-c469-4976-96a1-cebf0cbb124d response_code = 200 uri = /crucible/0/regions
42025-12-23T22:01:27.120ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
52025-12-23T22:01:27.128ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_9e52b281-c843-4207-97fd-eadc663c2c4f/crucible/regions/20cd63c8-47a1-43ac-9170-96aaaa7c4dbb
62025-12-23T22:01:27.128ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_9e52b281-c843-4207-97fd-eadc663c2c4f/crucible/regions/20cd63c8-47a1-43ac-9170-96aaaa7c4dbb
72025-12-23T22:01:27.187ZINFOcrucible-agent (worker): creating region Region { id: RegionId("20cd63c8-47a1-43ac-9170-96aaaa7c4dbb"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/20cd63c8-47a1-43ac-9170-96aaaa7c4dbb" region = 20cd63c8-47a1-43ac-9170-96aaaa7c4dbb
82025-12-23T22:01:27.187ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "20cd63c8-47a1-43ac-9170-96aaaa7c4dbb" "--data" "/data/regions/20cd63c8-47a1-43ac-9170-96aaaa7c4dbb" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 20cd63c8-47a1-43ac-9170-96aaaa7c4dbb
92025-12-23T22:01:27.268ZINFOcrucible-agent (worker): region files created ok region = 20cd63c8-47a1-43ac-9170-96aaaa7c4dbb
102025-12-23T22:01:27.268ZINFOcrucible-agent (datafile): region 20cd63c8-47a1-43ac-9170-96aaaa7c4dbb state: Requested -> Created
112025-12-23T22:01:27.268ZINFOcrucible-agent (worker): applying SMF actions post create...
122025-12-23T22:01:27.269ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-20cd63c8-47a1-43ac-9170-96aaaa7c4dbb
132025-12-23T22:01:27.278ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-20cd63c8-47a1-43ac-9170-96aaaa7c4dbb
142025-12-23T22:01:27.299ZINFOcrucible-agent (worker): creating config property group
152025-12-23T22:01:27.302ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-20cd63c8-47a1-43ac-9170-96aaaa7c4dbb
162025-12-23T22:01:27.302ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/20cd63c8-47a1-43ac-9170-96aaaa7c4dbb
172025-12-23T22:01:27.302ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
182025-12-23T22:01:27.302ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::18
192025-12-23T22:01:27.302ZINFOcrucible-agent (worker): commit
202025-12-23T22:01:27.305ZINFOcrucible-agent (worker): ok!
212025-12-23T22:01:27.309ZINFOcrucible-agent (worker): SMF ok!
222025-12-23T22:01:27.350ZINFOcrucible-agent (dropshot): request completed latency_us = 63 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:36798 req_id = 6f70a577-6265-434c-835a-fb85d160d198 response_code = 200 uri = /crucible/0/regions
232025-12-23T22:01:33.946ZINFOcrucible-agent (datafile): region 870d1df8-95c9-42ee-8aca-9bd40baf9bde state: Requested
242025-12-23T22:01:33.946ZINFOcrucible-agent (dropshot): request completed latency_us = 232 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:36798 req_id = 6b3bf67c-5a7d-4715-97ae-fe167187a10e response_code = 200 uri = /crucible/0/regions
252025-12-23T22:01:33.946ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
262025-12-23T22:01:33.953ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_9e52b281-c843-4207-97fd-eadc663c2c4f/crucible/regions/870d1df8-95c9-42ee-8aca-9bd40baf9bde
272025-12-23T22:01:33.953ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_9e52b281-c843-4207-97fd-eadc663c2c4f/crucible/regions/870d1df8-95c9-42ee-8aca-9bd40baf9bde
282025-12-23T22:01:34.001ZINFOcrucible-agent (worker): creating region Region { id: RegionId("870d1df8-95c9-42ee-8aca-9bd40baf9bde"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/870d1df8-95c9-42ee-8aca-9bd40baf9bde" region = 870d1df8-95c9-42ee-8aca-9bd40baf9bde
292025-12-23T22:01:34.001ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "870d1df8-95c9-42ee-8aca-9bd40baf9bde" "--data" "/data/regions/870d1df8-95c9-42ee-8aca-9bd40baf9bde" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 870d1df8-95c9-42ee-8aca-9bd40baf9bde
302025-12-23T22:01:34.076ZINFOcrucible-agent (worker): region files created ok region = 870d1df8-95c9-42ee-8aca-9bd40baf9bde
312025-12-23T22:01:34.076ZINFOcrucible-agent (datafile): region 870d1df8-95c9-42ee-8aca-9bd40baf9bde state: Requested -> Created
322025-12-23T22:01:34.076ZINFOcrucible-agent (worker): applying SMF actions post create...
332025-12-23T22:01:34.082ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-870d1df8-95c9-42ee-8aca-9bd40baf9bde
342025-12-23T22:01:34.091ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-870d1df8-95c9-42ee-8aca-9bd40baf9bde
352025-12-23T22:01:34.098ZINFOcrucible-agent (worker): creating config property group
362025-12-23T22:01:34.101ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-870d1df8-95c9-42ee-8aca-9bd40baf9bde
372025-12-23T22:01:34.101ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/870d1df8-95c9-42ee-8aca-9bd40baf9bde
382025-12-23T22:01:34.101ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
392025-12-23T22:01:34.101ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::18
402025-12-23T22:01:34.101ZINFOcrucible-agent (worker): commit
412025-12-23T22:01:34.105ZINFOcrucible-agent (worker): ok!
422025-12-23T22:01:34.110ZINFOcrucible-agent (worker): SMF ok!
432025-12-23T22:01:34.130ZINFOcrucible-agent (dropshot): request completed latency_us = 76 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:36798 req_id = 2de3760e-cd01-4a8f-a618-91a5223b65fb response_code = 200 uri = /crucible/0/regions
442025-12-23T22:01:59.748ZINFOcrucible-agent (dropshot): request completed latency_us = 58 local_addr = [fd00:1122:3344:101::18]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:36798 req_id = 43296217-cf2a-447b-bc21-94084de34c1b response_code = 200 uri = /crucible/0/regions/870d1df8-95c9-42ee-8aca-9bd40baf9bde
452025-12-23T22:01:59.751ZINFOcrucible-agent (datafile): path is "/data/regions/870d1df8-95c9-42ee-8aca-9bd40baf9bde"
462025-12-23T22:01:59.764ZINFOcrucible-agent (datafile): dataset is oxp_9e52b281-c843-4207-97fd-eadc663c2c4f/crucible/regions/870d1df8-95c9-42ee-8aca-9bd40baf9bde
472025-12-23T22:01:59.771ZINFOcrucible-agent (datafile): region 870d1df8-95c9-42ee-8aca-9bd40baf9bde state: Created -> Tombstoned
482025-12-23T22:01:59.771ZINFOcrucible-agent (dropshot): request completed latency_us = 19579 local_addr = [fd00:1122:3344:101::18]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::a]:36798 req_id = 137a943c-b115-444d-ac8d-739d1f63820f response_code = 204 uri = /crucible/0/regions/870d1df8-95c9-42ee-8aca-9bd40baf9bde
492025-12-23T22:01:59.771ZINFOcrucible-agent (worker): applying SMF actions before removal...
502025-12-23T22:01:59.773ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-870d1df8-95c9-42ee-8aca-9bd40baf9bde (instance states: (Some(Online), None))
512025-12-23T22:01:59.775ZINFOcrucible-agent (dropshot): request completed latency_us = 54 local_addr = [fd00:1122:3344:101::18]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:36798 req_id = 786c97ad-a2b6-4ef6-a6b6-12f536d87893 response_code = 200 uri = /crucible/0/regions/870d1df8-95c9-42ee-8aca-9bd40baf9bde
522025-12-23T22:01:59.781ZINFOcrucible-agent (worker): SMF ok!
532025-12-23T22:01:59.789ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_9e52b281-c843-4207-97fd-eadc663c2c4f/crucible/regions/870d1df8-95c9-42ee-8aca-9bd40baf9bde" region = 870d1df8-95c9-42ee-8aca-9bd40baf9bde
542025-12-23T22:01:59.846ZINFOcrucible-agent (datafile): region 870d1df8-95c9-42ee-8aca-9bd40baf9bde state: Tombstoned -> Destroyed
552025-12-23T22:01:59.861ZINFOcrucible-agent (dropshot): request completed latency_us = 56 local_addr = [fd00:1122:3344:101::18]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:36798 req_id = d0937348-f6f5-46fe-84f6-06bf16dfe1f5 response_code = 200 uri = /crucible/0/regions/870d1df8-95c9-42ee-8aca-9bd40baf9bde