Max level shown:
12025-12-19T20:09:28.688ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::1a]:32345 remote_addr = [fd00:1122:3344:101::a]:43506
22025-12-19T20:09:28.688ZINFOcrucible-agent (datafile): region daf8dcab-33b5-4c3f-bd8b-e8cdd5ebf618 state: Requested
32025-12-19T20:09:28.689ZINFOcrucible-agent (dropshot): request completed latency_us = 714 local_addr = [fd00:1122:3344:101::1a]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:43506 req_id = 8da37aee-4af7-44e7-ac76-7bad5bcc1cf7 response_code = 200 uri = /crucible/0/regions
42025-12-19T20:09:28.689ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
52025-12-19T20:09:28.710ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_356312ea-a422-4f82-814c-5c77fe94a53b/crucible/regions/daf8dcab-33b5-4c3f-bd8b-e8cdd5ebf618
62025-12-19T20:09:28.710ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_356312ea-a422-4f82-814c-5c77fe94a53b/crucible/regions/daf8dcab-33b5-4c3f-bd8b-e8cdd5ebf618
72025-12-19T20:09:28.830ZINFOcrucible-agent (worker): creating region Region { id: RegionId("daf8dcab-33b5-4c3f-bd8b-e8cdd5ebf618"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/daf8dcab-33b5-4c3f-bd8b-e8cdd5ebf618" region = daf8dcab-33b5-4c3f-bd8b-e8cdd5ebf618
82025-12-19T20:09:28.830ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "daf8dcab-33b5-4c3f-bd8b-e8cdd5ebf618" "--data" "/data/regions/daf8dcab-33b5-4c3f-bd8b-e8cdd5ebf618" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = daf8dcab-33b5-4c3f-bd8b-e8cdd5ebf618
92025-12-19T20:09:29.046ZINFOcrucible-agent (dropshot): request completed latency_us = 59 local_addr = [fd00:1122:3344:101::1a]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:43506 req_id = 261d460b-cff6-413c-a7bb-1f855fa144bf response_code = 200 uri = /crucible/0/regions
102025-12-19T20:09:29.186ZINFOcrucible-agent (worker): region files created ok region = daf8dcab-33b5-4c3f-bd8b-e8cdd5ebf618
112025-12-19T20:09:29.186ZINFOcrucible-agent (datafile): region daf8dcab-33b5-4c3f-bd8b-e8cdd5ebf618 state: Requested -> Created
122025-12-19T20:09:29.186ZINFOcrucible-agent (worker): applying SMF actions post create...
132025-12-19T20:09:29.228ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-daf8dcab-33b5-4c3f-bd8b-e8cdd5ebf618
142025-12-19T20:09:29.253ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-daf8dcab-33b5-4c3f-bd8b-e8cdd5ebf618
152025-12-19T20:09:29.290ZINFOcrucible-agent (worker): creating config property group
162025-12-19T20:09:29.315ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-daf8dcab-33b5-4c3f-bd8b-e8cdd5ebf618
172025-12-19T20:09:29.316ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/daf8dcab-33b5-4c3f-bd8b-e8cdd5ebf618
182025-12-19T20:09:29.316ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
192025-12-19T20:09:29.316ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::1a
202025-12-19T20:09:29.316ZINFOcrucible-agent (worker): commit
212025-12-19T20:09:29.327ZINFOcrucible-agent (worker): ok!
222025-12-19T20:09:29.341ZINFOcrucible-agent (worker): SMF ok!
232025-12-19T20:09:29.680ZINFOcrucible-agent (dropshot): request completed latency_us = 66 local_addr = [fd00:1122:3344:101::1a]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:43506 req_id = 416e8ec5-8608-423a-8bde-6af97065cb83 response_code = 200 uri = /crucible/0/regions
242025-12-19T20:09:32.935ZINFOcrucible-agent (dropshot): request completed latency_us = 64 local_addr = [fd00:1122:3344:101::1a]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:43506 req_id = 37c9f81f-a163-45c9-b737-86cdcd100872 response_code = 200 uri = /crucible/0/regions/144a4b65-5d5d-40e4-8882-94e41a0ae187
252025-12-19T20:09:32.938ZINFOcrucible-agent (datafile): path is "/data/regions/144a4b65-5d5d-40e4-8882-94e41a0ae187"
262025-12-19T20:09:32.945ZINFOcrucible-agent (datafile): dataset is oxp_356312ea-a422-4f82-814c-5c77fe94a53b/crucible/regions/144a4b65-5d5d-40e4-8882-94e41a0ae187
272025-12-19T20:09:32.952ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_356312ea-a422-4f82-814c-5c77fe94a53b/crucible/regions/144a4b65-5d5d-40e4-8882-94e41a0ae187@54c316d0-f5c4-4825-9d26-25898ffc2575
282025-12-19T20:09:32.952ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_356312ea-a422-4f82-814c-5c77fe94a53b/crucible/regions/144a4b65-5d5d-40e4-8882-94e41a0ae187", "54c316d0-f5c4-4825-9d26-25898ffc2575"]
292025-12-19T20:09:32.966ZINFOcrucible-agent (dropshot): request completed latency_us = 27847 local_addr = [fd00:1122:3344:101::1a]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:43506 req_id = d95c8c20-4895-488a-ab22-6a1227f3b6d7 response_code = 200 uri = /crucible/0/regions/144a4b65-5d5d-40e4-8882-94e41a0ae187/snapshots/54c316d0-f5c4-4825-9d26-25898ffc2575
302025-12-19T20:09:32.970ZINFOcrucible-agent (datafile): path is "/data/regions/144a4b65-5d5d-40e4-8882-94e41a0ae187"
312025-12-19T20:09:32.976ZINFOcrucible-agent (datafile): dataset is oxp_356312ea-a422-4f82-814c-5c77fe94a53b/crucible/regions/144a4b65-5d5d-40e4-8882-94e41a0ae187
322025-12-19T20:09:32.983ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_356312ea-a422-4f82-814c-5c77fe94a53b/crucible/regions/144a4b65-5d5d-40e4-8882-94e41a0ae187@54c316d0-f5c4-4825-9d26-25898ffc2575
332025-12-19T20:09:32.983ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_356312ea-a422-4f82-814c-5c77fe94a53b/crucible/regions/144a4b65-5d5d-40e4-8882-94e41a0ae187", "54c316d0-f5c4-4825-9d26-25898ffc2575"]
342025-12-19T20:09:32.990ZINFOcrucible-agent (datafile): requesting running snapshot 144a4b65-5d5d-40e4-8882-94e41a0ae187-54c316d0-f5c4-4825-9d26-25898ffc2575 state: Requested
352025-12-19T20:09:32.991ZINFOcrucible-agent (dropshot): request completed latency_us = 20633 local_addr = [fd00:1122:3344:101::1a]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:43506 req_id = 6b7c1e82-54b0-4f6d-8655-d8d33fe70ce3 response_code = 200 uri = /crucible/0/regions/144a4b65-5d5d-40e4-8882-94e41a0ae187/snapshots/54c316d0-f5c4-4825-9d26-25898ffc2575/run
362025-12-19T20:09:32.991ZINFOcrucible-agent (worker): applying SMF actions for region 144a4b65-5d5d-40e4-8882-94e41a0ae187 running snapshot 54c316d0-f5c4-4825-9d26-25898ffc2575 (state Requested)...
372025-12-19T20:09:32.996ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-144a4b65-5d5d-40e4-8882-94e41a0ae187-54c316d0-f5c4-4825-9d26-25898ffc2575
382025-12-19T20:09:33.003ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-144a4b65-5d5d-40e4-8882-94e41a0ae187-54c316d0-f5c4-4825-9d26-25898ffc2575
392025-12-19T20:09:33.042ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-144a4b65-5d5d-40e4-8882-94e41a0ae187-54c316d0-f5c4-4825-9d26-25898ffc2575
402025-12-19T20:09:33.042ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/144a4b65-5d5d-40e4-8882-94e41a0ae187/.zfs/snapshot/54c316d0-f5c4-4825-9d26-25898ffc2575
412025-12-19T20:09:33.042ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19002
422025-12-19T20:09:33.042ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
432025-12-19T20:09:33.042ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::1a
442025-12-19T20:09:33.042ZINFOcrucible-agent (worker): commit
452025-12-19T20:09:33.066ZINFOcrucible-agent (worker): ok!
462025-12-19T20:09:33.090ZINFOcrucible-agent (worker): SMF ok!
472025-12-19T20:09:33.090ZINFOcrucible-agent (datafile): region 144a4b65-5d5d-40e4-8882-94e41a0ae187 running snapshot 54c316d0-f5c4-4825-9d26-25898ffc2575 state: Requested -> Created
482025-12-19T20:09:33.225ZINFOcrucible-agent (datafile): path is "/data/regions/144a4b65-5d5d-40e4-8882-94e41a0ae187"
492025-12-19T20:09:33.231ZINFOcrucible-agent (datafile): dataset is oxp_356312ea-a422-4f82-814c-5c77fe94a53b/crucible/regions/144a4b65-5d5d-40e4-8882-94e41a0ae187
502025-12-19T20:09:33.237ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_356312ea-a422-4f82-814c-5c77fe94a53b/crucible/regions/144a4b65-5d5d-40e4-8882-94e41a0ae187@54c316d0-f5c4-4825-9d26-25898ffc2575
512025-12-19T20:09:33.237ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_356312ea-a422-4f82-814c-5c77fe94a53b/crucible/regions/144a4b65-5d5d-40e4-8882-94e41a0ae187", "54c316d0-f5c4-4825-9d26-25898ffc2575"]
522025-12-19T20:09:33.242ZINFOcrucible-agent (dropshot): request completed latency_us = 16970 local_addr = [fd00:1122:3344:101::1a]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:43506 req_id = 461d58da-7a2d-4da7-beec-b2a08e282a7f response_code = 200 uri = /crucible/0/regions/144a4b65-5d5d-40e4-8882-94e41a0ae187/snapshots/54c316d0-f5c4-4825-9d26-25898ffc2575/run