Max level shown:
12025-12-19T07:45:16.967ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::12]:32345 remote_addr = [fd00:1122:3344:101::a]:63539
22025-12-19T07:45:16.967ZINFOcrucible-agent (datafile): region bd0715ea-ce1d-4a68-900e-f70ba1c5d9f3 state: Requested
32025-12-19T07:45:16.967ZINFOcrucible-agent (dropshot): request completed latency_us = 607 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:63539 req_id = 5814fe40-6e7e-4026-837b-d7a826709717 response_code = 200 uri = /crucible/0/regions
42025-12-19T07:45:16.967ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
52025-12-19T07:45:16.975ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_1920b066-df0e-44e3-b2ad-0e8fb72ed30a/crucible/regions/bd0715ea-ce1d-4a68-900e-f70ba1c5d9f3
62025-12-19T07:45:16.975ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_1920b066-df0e-44e3-b2ad-0e8fb72ed30a/crucible/regions/bd0715ea-ce1d-4a68-900e-f70ba1c5d9f3
72025-12-19T07:45:17.035ZINFOcrucible-agent (worker): creating region Region { id: RegionId("bd0715ea-ce1d-4a68-900e-f70ba1c5d9f3"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/bd0715ea-ce1d-4a68-900e-f70ba1c5d9f3" region = bd0715ea-ce1d-4a68-900e-f70ba1c5d9f3
82025-12-19T07:45:17.035ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "bd0715ea-ce1d-4a68-900e-f70ba1c5d9f3" "--data" "/data/regions/bd0715ea-ce1d-4a68-900e-f70ba1c5d9f3" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = bd0715ea-ce1d-4a68-900e-f70ba1c5d9f3
92025-12-19T07:45:17.111ZINFOcrucible-agent (dropshot): request completed latency_us = 59 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:63539 req_id = 78a723c3-63e4-4187-8d71-27497214a61f response_code = 200 uri = /crucible/0/regions
102025-12-19T07:45:17.147ZINFOcrucible-agent (worker): region files created ok region = bd0715ea-ce1d-4a68-900e-f70ba1c5d9f3
112025-12-19T07:45:17.147ZINFOcrucible-agent (datafile): region bd0715ea-ce1d-4a68-900e-f70ba1c5d9f3 state: Requested -> Created
122025-12-19T07:45:17.147ZINFOcrucible-agent (worker): applying SMF actions post create...
132025-12-19T07:45:17.148ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-bd0715ea-ce1d-4a68-900e-f70ba1c5d9f3
142025-12-19T07:45:17.157ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-bd0715ea-ce1d-4a68-900e-f70ba1c5d9f3
152025-12-19T07:45:17.179ZINFOcrucible-agent (worker): creating config property group
162025-12-19T07:45:17.182ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-bd0715ea-ce1d-4a68-900e-f70ba1c5d9f3
172025-12-19T07:45:17.182ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/bd0715ea-ce1d-4a68-900e-f70ba1c5d9f3
182025-12-19T07:45:17.182ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
192025-12-19T07:45:17.182ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::12
202025-12-19T07:45:17.183ZINFOcrucible-agent (worker): commit
212025-12-19T07:45:17.186ZINFOcrucible-agent (worker): ok!
222025-12-19T07:45:17.204ZINFOcrucible-agent (worker): SMF ok!
232025-12-19T07:45:17.385ZINFOcrucible-agent (dropshot): request completed latency_us = 64 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:63539 req_id = ac4cec5e-e121-4eac-b78f-102a6eb7b5da response_code = 200 uri = /crucible/0/regions
242025-12-19T07:45:19.059ZINFOcrucible-agent (dropshot): request completed latency_us = 78 local_addr = [fd00:1122:3344:101::12]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:63539 req_id = cac9798a-32e1-4d78-bb23-e4c5f032a251 response_code = 200 uri = /crucible/0/regions/d1bcdcd3-d64c-4e89-a513-e4c645ec2bd5
252025-12-19T07:45:19.062ZINFOcrucible-agent (datafile): path is "/data/regions/d1bcdcd3-d64c-4e89-a513-e4c645ec2bd5"
262025-12-19T07:45:19.068ZINFOcrucible-agent (datafile): dataset is oxp_1920b066-df0e-44e3-b2ad-0e8fb72ed30a/crucible/regions/d1bcdcd3-d64c-4e89-a513-e4c645ec2bd5
272025-12-19T07:45:19.074ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_1920b066-df0e-44e3-b2ad-0e8fb72ed30a/crucible/regions/d1bcdcd3-d64c-4e89-a513-e4c645ec2bd5@c6d7b29f-de7c-44d4-865b-e9006c2f1aaf
282025-12-19T07:45:19.074ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_1920b066-df0e-44e3-b2ad-0e8fb72ed30a/crucible/regions/d1bcdcd3-d64c-4e89-a513-e4c645ec2bd5", "c6d7b29f-de7c-44d4-865b-e9006c2f1aaf"]
292025-12-19T07:45:19.083ZINFOcrucible-agent (dropshot): request completed latency_us = 21015 local_addr = [fd00:1122:3344:101::12]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:63539 req_id = 4f897a9c-03cc-4d9a-9203-395e9549e737 response_code = 200 uri = /crucible/0/regions/d1bcdcd3-d64c-4e89-a513-e4c645ec2bd5/snapshots/c6d7b29f-de7c-44d4-865b-e9006c2f1aaf
302025-12-19T07:45:19.086ZINFOcrucible-agent (datafile): path is "/data/regions/d1bcdcd3-d64c-4e89-a513-e4c645ec2bd5"
312025-12-19T07:45:19.091ZINFOcrucible-agent (datafile): dataset is oxp_1920b066-df0e-44e3-b2ad-0e8fb72ed30a/crucible/regions/d1bcdcd3-d64c-4e89-a513-e4c645ec2bd5
322025-12-19T07:45:19.099ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_1920b066-df0e-44e3-b2ad-0e8fb72ed30a/crucible/regions/d1bcdcd3-d64c-4e89-a513-e4c645ec2bd5@c6d7b29f-de7c-44d4-865b-e9006c2f1aaf
332025-12-19T07:45:19.099ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_1920b066-df0e-44e3-b2ad-0e8fb72ed30a/crucible/regions/d1bcdcd3-d64c-4e89-a513-e4c645ec2bd5", "c6d7b29f-de7c-44d4-865b-e9006c2f1aaf"]
342025-12-19T07:45:19.107ZINFOcrucible-agent (datafile): requesting running snapshot d1bcdcd3-d64c-4e89-a513-e4c645ec2bd5-c6d7b29f-de7c-44d4-865b-e9006c2f1aaf state: Requested
352025-12-19T07:45:19.107ZINFOcrucible-agent (dropshot): request completed latency_us = 21097 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:63539 req_id = c0397712-5993-417c-a3fc-2396815577fd response_code = 200 uri = /crucible/0/regions/d1bcdcd3-d64c-4e89-a513-e4c645ec2bd5/snapshots/c6d7b29f-de7c-44d4-865b-e9006c2f1aaf/run
362025-12-19T07:45:19.107ZINFOcrucible-agent (worker): applying SMF actions for region d1bcdcd3-d64c-4e89-a513-e4c645ec2bd5 running snapshot c6d7b29f-de7c-44d4-865b-e9006c2f1aaf (state Requested)...
372025-12-19T07:45:19.112ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-d1bcdcd3-d64c-4e89-a513-e4c645ec2bd5-c6d7b29f-de7c-44d4-865b-e9006c2f1aaf
382025-12-19T07:45:19.119ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-d1bcdcd3-d64c-4e89-a513-e4c645ec2bd5-c6d7b29f-de7c-44d4-865b-e9006c2f1aaf
392025-12-19T07:45:19.129ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-d1bcdcd3-d64c-4e89-a513-e4c645ec2bd5-c6d7b29f-de7c-44d4-865b-e9006c2f1aaf
402025-12-19T07:45:19.130ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/d1bcdcd3-d64c-4e89-a513-e4c645ec2bd5/.zfs/snapshot/c6d7b29f-de7c-44d4-865b-e9006c2f1aaf
412025-12-19T07:45:19.130ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19002
422025-12-19T07:45:19.130ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
432025-12-19T07:45:19.130ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::12
442025-12-19T07:45:19.130ZINFOcrucible-agent (worker): commit
452025-12-19T07:45:19.133ZINFOcrucible-agent (worker): ok!
462025-12-19T07:45:19.138ZINFOcrucible-agent (worker): SMF ok!
472025-12-19T07:45:19.138ZINFOcrucible-agent (datafile): region d1bcdcd3-d64c-4e89-a513-e4c645ec2bd5 running snapshot c6d7b29f-de7c-44d4-865b-e9006c2f1aaf state: Requested -> Created
482025-12-19T07:45:19.336ZINFOcrucible-agent (datafile): path is "/data/regions/d1bcdcd3-d64c-4e89-a513-e4c645ec2bd5"
492025-12-19T07:45:19.343ZINFOcrucible-agent (datafile): dataset is oxp_1920b066-df0e-44e3-b2ad-0e8fb72ed30a/crucible/regions/d1bcdcd3-d64c-4e89-a513-e4c645ec2bd5
502025-12-19T07:45:19.349ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_1920b066-df0e-44e3-b2ad-0e8fb72ed30a/crucible/regions/d1bcdcd3-d64c-4e89-a513-e4c645ec2bd5@c6d7b29f-de7c-44d4-865b-e9006c2f1aaf
512025-12-19T07:45:19.349ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_1920b066-df0e-44e3-b2ad-0e8fb72ed30a/crucible/regions/d1bcdcd3-d64c-4e89-a513-e4c645ec2bd5", "c6d7b29f-de7c-44d4-865b-e9006c2f1aaf"]
522025-12-19T07:45:19.355ZINFOcrucible-agent (dropshot): request completed latency_us = 18740 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:63539 req_id = 83331a40-9fad-4bec-852e-28c4c09cd621 response_code = 200 uri = /crucible/0/regions/d1bcdcd3-d64c-4e89-a513-e4c645ec2bd5/snapshots/c6d7b29f-de7c-44d4-865b-e9006c2f1aaf/run