Max level shown:
12025-07-10T17:16:51.991ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::1a]:32345 remote_addr = [fd00:1122:3344:101::a]:50465
22025-07-10T17:16:51.992ZINFOcrucible-agent (datafile): region 8d3b6b68-9f24-4328-8dbd-eaf40b7a8bee state: Requested
32025-07-10T17:16:51.992ZINFOcrucible-agent (dropshot): request completed latency_us = 644 local_addr = [fd00:1122:3344:101::1a]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:50465 req_id = 30e056a8-b06d-4a5c-8404-9ebbade3dd4f response_code = 200 uri = /crucible/0/regions
42025-07-10T17:16:51.992ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
52025-07-10T17:16:52.004ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_18c2da04-2ffc-438b-a7cc-bdd931f92959/crucible/regions/8d3b6b68-9f24-4328-8dbd-eaf40b7a8bee
62025-07-10T17:16:52.004ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_18c2da04-2ffc-438b-a7cc-bdd931f92959/crucible/regions/8d3b6b68-9f24-4328-8dbd-eaf40b7a8bee
72025-07-10T17:16:52.060ZINFOcrucible-agent (worker): creating region Region { id: RegionId("8d3b6b68-9f24-4328-8dbd-eaf40b7a8bee"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/8d3b6b68-9f24-4328-8dbd-eaf40b7a8bee" region = 8d3b6b68-9f24-4328-8dbd-eaf40b7a8bee
82025-07-10T17:16:52.061ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "8d3b6b68-9f24-4328-8dbd-eaf40b7a8bee" "--data" "/data/regions/8d3b6b68-9f24-4328-8dbd-eaf40b7a8bee" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 8d3b6b68-9f24-4328-8dbd-eaf40b7a8bee
92025-07-10T17:16:52.145ZINFOcrucible-agent (worker): region files created ok region = 8d3b6b68-9f24-4328-8dbd-eaf40b7a8bee
102025-07-10T17:16:52.145ZINFOcrucible-agent (datafile): region 8d3b6b68-9f24-4328-8dbd-eaf40b7a8bee state: Requested -> Created
112025-07-10T17:16:52.145ZINFOcrucible-agent (worker): applying SMF actions post create...
122025-07-10T17:16:52.160ZINFOcrucible-agent (dropshot): request completed latency_us = 68 local_addr = [fd00:1122:3344:101::1a]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:50465 req_id = 746369cb-be9b-4c9c-8808-a0485171db82 response_code = 200 uri = /crucible/0/regions
132025-07-10T17:16:52.165ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-8d3b6b68-9f24-4328-8dbd-eaf40b7a8bee
142025-07-10T17:16:52.175ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-8d3b6b68-9f24-4328-8dbd-eaf40b7a8bee
152025-07-10T17:16:52.187ZINFOcrucible-agent (worker): creating config property group
162025-07-10T17:16:52.190ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-8d3b6b68-9f24-4328-8dbd-eaf40b7a8bee
172025-07-10T17:16:52.191ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/8d3b6b68-9f24-4328-8dbd-eaf40b7a8bee
182025-07-10T17:16:52.191ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
192025-07-10T17:16:52.191ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::1a
202025-07-10T17:16:52.191ZINFOcrucible-agent (worker): commit
212025-07-10T17:16:52.195ZINFOcrucible-agent (worker): ok!
222025-07-10T17:16:52.201ZINFOcrucible-agent (worker): SMF ok!
232025-07-10T17:16:53.952ZINFOcrucible-agent (dropshot): request completed latency_us = 2455 local_addr = [fd00:1122:3344:101::1a]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:50465 req_id = 39861923-2b8b-4e3b-a5df-a2d1c4553d84 response_code = 200 uri = /crucible/0/regions/71700b80-dded-436a-aa5e-7e3ba21fa2c1
242025-07-10T17:16:53.955ZINFOcrucible-agent (datafile): path is "/data/regions/71700b80-dded-436a-aa5e-7e3ba21fa2c1"
252025-07-10T17:16:53.965ZINFOcrucible-agent (datafile): dataset is oxp_18c2da04-2ffc-438b-a7cc-bdd931f92959/crucible/regions/71700b80-dded-436a-aa5e-7e3ba21fa2c1
262025-07-10T17:16:53.973ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_18c2da04-2ffc-438b-a7cc-bdd931f92959/crucible/regions/71700b80-dded-436a-aa5e-7e3ba21fa2c1@4dc67cfa-e043-4b37-b4b9-91bfc3069ad4
272025-07-10T17:16:53.973ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_18c2da04-2ffc-438b-a7cc-bdd931f92959/crucible/regions/71700b80-dded-436a-aa5e-7e3ba21fa2c1", "4dc67cfa-e043-4b37-b4b9-91bfc3069ad4"]
282025-07-10T17:16:53.984ZINFOcrucible-agent (dropshot): request completed latency_us = 28865 local_addr = [fd00:1122:3344:101::1a]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:50465 req_id = 234cc3a9-7d79-46a4-8092-3cb73845f29b response_code = 200 uri = /crucible/0/regions/71700b80-dded-436a-aa5e-7e3ba21fa2c1/snapshots/4dc67cfa-e043-4b37-b4b9-91bfc3069ad4
292025-07-10T17:16:53.988ZINFOcrucible-agent (datafile): path is "/data/regions/71700b80-dded-436a-aa5e-7e3ba21fa2c1"
302025-07-10T17:16:53.996ZINFOcrucible-agent (datafile): dataset is oxp_18c2da04-2ffc-438b-a7cc-bdd931f92959/crucible/regions/71700b80-dded-436a-aa5e-7e3ba21fa2c1
312025-07-10T17:16:54.005ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_18c2da04-2ffc-438b-a7cc-bdd931f92959/crucible/regions/71700b80-dded-436a-aa5e-7e3ba21fa2c1@4dc67cfa-e043-4b37-b4b9-91bfc3069ad4
322025-07-10T17:16:54.005ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_18c2da04-2ffc-438b-a7cc-bdd931f92959/crucible/regions/71700b80-dded-436a-aa5e-7e3ba21fa2c1", "4dc67cfa-e043-4b37-b4b9-91bfc3069ad4"]
332025-07-10T17:16:54.014ZINFOcrucible-agent (datafile): requesting running snapshot 71700b80-dded-436a-aa5e-7e3ba21fa2c1-4dc67cfa-e043-4b37-b4b9-91bfc3069ad4 state: Requested
342025-07-10T17:16:54.014ZINFOcrucible-agent (worker): applying SMF actions for region 71700b80-dded-436a-aa5e-7e3ba21fa2c1 running snapshot 4dc67cfa-e043-4b37-b4b9-91bfc3069ad4 (state Requested)...
352025-07-10T17:16:54.014ZINFOcrucible-agent (dropshot): request completed latency_us = 26289 local_addr = [fd00:1122:3344:101::1a]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:50465 req_id = 2d0195f9-1596-4efd-b6bb-31d740c5711c response_code = 200 uri = /crucible/0/regions/71700b80-dded-436a-aa5e-7e3ba21fa2c1/snapshots/4dc67cfa-e043-4b37-b4b9-91bfc3069ad4/run
362025-07-10T17:16:54.016ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-71700b80-dded-436a-aa5e-7e3ba21fa2c1-4dc67cfa-e043-4b37-b4b9-91bfc3069ad4
372025-07-10T17:16:54.025ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-71700b80-dded-436a-aa5e-7e3ba21fa2c1-4dc67cfa-e043-4b37-b4b9-91bfc3069ad4
382025-07-10T17:16:54.034ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-71700b80-dded-436a-aa5e-7e3ba21fa2c1-4dc67cfa-e043-4b37-b4b9-91bfc3069ad4
392025-07-10T17:16:54.034ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/71700b80-dded-436a-aa5e-7e3ba21fa2c1/.zfs/snapshot/4dc67cfa-e043-4b37-b4b9-91bfc3069ad4
402025-07-10T17:16:54.034ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19002
412025-07-10T17:16:54.034ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
422025-07-10T17:16:54.034ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::1a
432025-07-10T17:16:54.034ZINFOcrucible-agent (worker): commit
442025-07-10T17:16:54.038ZINFOcrucible-agent (worker): ok!
452025-07-10T17:16:54.042ZINFOcrucible-agent (worker): SMF ok!
462025-07-10T17:16:54.042ZINFOcrucible-agent (datafile): region 71700b80-dded-436a-aa5e-7e3ba21fa2c1 running snapshot 4dc67cfa-e043-4b37-b4b9-91bfc3069ad4 state: Requested -> Created
472025-07-10T17:16:54.266ZINFOcrucible-agent (datafile): path is "/data/regions/71700b80-dded-436a-aa5e-7e3ba21fa2c1"
482025-07-10T17:16:54.275ZINFOcrucible-agent (datafile): dataset is oxp_18c2da04-2ffc-438b-a7cc-bdd931f92959/crucible/regions/71700b80-dded-436a-aa5e-7e3ba21fa2c1
492025-07-10T17:16:54.283ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_18c2da04-2ffc-438b-a7cc-bdd931f92959/crucible/regions/71700b80-dded-436a-aa5e-7e3ba21fa2c1@4dc67cfa-e043-4b37-b4b9-91bfc3069ad4
502025-07-10T17:16:54.283ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_18c2da04-2ffc-438b-a7cc-bdd931f92959/crucible/regions/71700b80-dded-436a-aa5e-7e3ba21fa2c1", "4dc67cfa-e043-4b37-b4b9-91bfc3069ad4"]
512025-07-10T17:16:54.292ZINFOcrucible-agent (dropshot): request completed latency_us = 25752 local_addr = [fd00:1122:3344:101::1a]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:50465 req_id = 7ad73b8a-09b6-4a47-8a9c-9769790bb8e0 response_code = 200 uri = /crucible/0/regions/71700b80-dded-436a-aa5e-7e3ba21fa2c1/snapshots/4dc67cfa-e043-4b37-b4b9-91bfc3069ad4/run