Max level shown:
12025-01-11T05:35:12.138ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::13]:32345 remote_addr = [fd00:1122:3344:101::a]:60972
22025-01-11T05:35:12.139ZINFOcrucible-agent (datafile): region 1d00d378-42d6-418b-a144-a2f7f96dc57f state: Requested
32025-01-11T05:35:12.139ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
42025-01-11T05:35:12.139ZINFOcrucible-agent (dropshot): request completed latency_us = 1286 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:60972 req_id = 62063740-f7d8-4495-a7bf-cb14f5a5b542 response_code = 200 uri = /crucible/0/regions
52025-01-11T05:35:12.150ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_ec9ad497-e429-48cd-995d-1528d20edba6/crucible/regions/1d00d378-42d6-418b-a144-a2f7f96dc57f
62025-01-11T05:35:12.150ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_ec9ad497-e429-48cd-995d-1528d20edba6/crucible/regions/1d00d378-42d6-418b-a144-a2f7f96dc57f
72025-01-11T05:35:12.226ZINFOcrucible-agent (worker): creating region Region { id: RegionId("1d00d378-42d6-418b-a144-a2f7f96dc57f"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/1d00d378-42d6-418b-a144-a2f7f96dc57f" region = 1d00d378-42d6-418b-a144-a2f7f96dc57f
82025-01-11T05:35:12.226ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "1d00d378-42d6-418b-a144-a2f7f96dc57f" "--data" "/data/regions/1d00d378-42d6-418b-a144-a2f7f96dc57f" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 1d00d378-42d6-418b-a144-a2f7f96dc57f
92025-01-11T05:35:12.381ZINFOcrucible-agent (worker): region files created ok region = 1d00d378-42d6-418b-a144-a2f7f96dc57f
102025-01-11T05:35:12.381ZINFOcrucible-agent (datafile): region 1d00d378-42d6-418b-a144-a2f7f96dc57f state: Requested -> Created
112025-01-11T05:35:12.381ZINFOcrucible-agent (worker): applying SMF actions post create...
122025-01-11T05:35:12.382ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-1d00d378-42d6-418b-a144-a2f7f96dc57f
132025-01-11T05:35:12.401ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-1d00d378-42d6-418b-a144-a2f7f96dc57f
142025-01-11T05:35:12.428ZINFOcrucible-agent (worker): creating config property group
152025-01-11T05:35:12.431ZINFOcrucible-agent (dropshot): request completed latency_us = 120 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:60972 req_id = 2aa82a69-1586-44f5-bf78-305709341380 response_code = 200 uri = /crucible/0/regions
162025-01-11T05:35:12.437ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-1d00d378-42d6-418b-a144-a2f7f96dc57f
172025-01-11T05:35:12.437ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/1d00d378-42d6-418b-a144-a2f7f96dc57f
182025-01-11T05:35:12.437ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
192025-01-11T05:35:12.437ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::13
202025-01-11T05:35:12.437ZINFOcrucible-agent (worker): commit
212025-01-11T05:35:12.457ZINFOcrucible-agent (worker): ok!
222025-01-11T05:35:12.473ZINFOcrucible-agent (worker): SMF ok!
232025-01-11T05:35:13.436ZINFOcrucible-agent (dropshot): request completed latency_us = 108 local_addr = [fd00:1122:3344:101::13]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:60972 req_id = 38d9e0c0-74d0-4a38-b736-36ebc7deeadc response_code = 200 uri = /crucible/0/regions/641fa2e4-05f8-454b-b4ed-52ffcf107cc4
242025-01-11T05:35:13.439ZINFOcrucible-agent (datafile): path is "/data/regions/641fa2e4-05f8-454b-b4ed-52ffcf107cc4"
252025-01-11T05:35:13.449ZINFOcrucible-agent (datafile): dataset is oxp_ec9ad497-e429-48cd-995d-1528d20edba6/crucible/regions/641fa2e4-05f8-454b-b4ed-52ffcf107cc4
262025-01-11T05:35:13.458ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_ec9ad497-e429-48cd-995d-1528d20edba6/crucible/regions/641fa2e4-05f8-454b-b4ed-52ffcf107cc4@107e84c5-79f6-4307-8f8c-0a9bcd4a7a25
272025-01-11T05:35:13.458ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_ec9ad497-e429-48cd-995d-1528d20edba6/crucible/regions/641fa2e4-05f8-454b-b4ed-52ffcf107cc4", "107e84c5-79f6-4307-8f8c-0a9bcd4a7a25"]
282025-01-11T05:35:13.467ZINFOcrucible-agent (dropshot): request completed latency_us = 28583 local_addr = [fd00:1122:3344:101::13]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:60972 req_id = 27728e7d-5835-4770-9e09-4f888183c1bf response_code = 200 uri = /crucible/0/regions/641fa2e4-05f8-454b-b4ed-52ffcf107cc4/snapshots/107e84c5-79f6-4307-8f8c-0a9bcd4a7a25
292025-01-11T05:35:13.473ZINFOcrucible-agent (datafile): path is "/data/regions/641fa2e4-05f8-454b-b4ed-52ffcf107cc4"
302025-01-11T05:35:13.483ZINFOcrucible-agent (datafile): dataset is oxp_ec9ad497-e429-48cd-995d-1528d20edba6/crucible/regions/641fa2e4-05f8-454b-b4ed-52ffcf107cc4
312025-01-11T05:35:13.491ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_ec9ad497-e429-48cd-995d-1528d20edba6/crucible/regions/641fa2e4-05f8-454b-b4ed-52ffcf107cc4@107e84c5-79f6-4307-8f8c-0a9bcd4a7a25
322025-01-11T05:35:13.491ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_ec9ad497-e429-48cd-995d-1528d20edba6/crucible/regions/641fa2e4-05f8-454b-b4ed-52ffcf107cc4", "107e84c5-79f6-4307-8f8c-0a9bcd4a7a25"]
332025-01-11T05:35:13.500ZINFOcrucible-agent (datafile): requesting running snapshot 641fa2e4-05f8-454b-b4ed-52ffcf107cc4-107e84c5-79f6-4307-8f8c-0a9bcd4a7a25 state: Requested
342025-01-11T05:35:13.500ZINFOcrucible-agent (worker): applying SMF actions for region 641fa2e4-05f8-454b-b4ed-52ffcf107cc4 running snapshot 107e84c5-79f6-4307-8f8c-0a9bcd4a7a25 (state Requested)...
352025-01-11T05:35:13.500ZINFOcrucible-agent (dropshot): request completed latency_us = 27083 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:60972 req_id = 361c3a68-6dc4-46dc-a9ac-984610f3699a response_code = 200 uri = /crucible/0/regions/641fa2e4-05f8-454b-b4ed-52ffcf107cc4/snapshots/107e84c5-79f6-4307-8f8c-0a9bcd4a7a25/run
362025-01-11T05:35:13.503ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-641fa2e4-05f8-454b-b4ed-52ffcf107cc4-107e84c5-79f6-4307-8f8c-0a9bcd4a7a25
372025-01-11T05:35:13.508ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-641fa2e4-05f8-454b-b4ed-52ffcf107cc4-107e84c5-79f6-4307-8f8c-0a9bcd4a7a25
382025-01-11T05:35:13.524ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-641fa2e4-05f8-454b-b4ed-52ffcf107cc4-107e84c5-79f6-4307-8f8c-0a9bcd4a7a25
392025-01-11T05:35:13.525ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/641fa2e4-05f8-454b-b4ed-52ffcf107cc4/.zfs/snapshot/107e84c5-79f6-4307-8f8c-0a9bcd4a7a25
402025-01-11T05:35:13.525ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19002
412025-01-11T05:35:13.525ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
422025-01-11T05:35:13.525ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::13
432025-01-11T05:35:13.525ZINFOcrucible-agent (worker): commit
442025-01-11T05:35:13.530ZINFOcrucible-agent (worker): ok!
452025-01-11T05:35:13.538ZINFOcrucible-agent (worker): SMF ok!
462025-01-11T05:35:13.538ZINFOcrucible-agent (datafile): region 641fa2e4-05f8-454b-b4ed-52ffcf107cc4 running snapshot 107e84c5-79f6-4307-8f8c-0a9bcd4a7a25 state: Requested -> Created
472025-01-11T05:35:13.839ZINFOcrucible-agent (datafile): path is "/data/regions/641fa2e4-05f8-454b-b4ed-52ffcf107cc4"
482025-01-11T05:35:13.847ZINFOcrucible-agent (datafile): dataset is oxp_ec9ad497-e429-48cd-995d-1528d20edba6/crucible/regions/641fa2e4-05f8-454b-b4ed-52ffcf107cc4
492025-01-11T05:35:13.856ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_ec9ad497-e429-48cd-995d-1528d20edba6/crucible/regions/641fa2e4-05f8-454b-b4ed-52ffcf107cc4@107e84c5-79f6-4307-8f8c-0a9bcd4a7a25
502025-01-11T05:35:13.856ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_ec9ad497-e429-48cd-995d-1528d20edba6/crucible/regions/641fa2e4-05f8-454b-b4ed-52ffcf107cc4", "107e84c5-79f6-4307-8f8c-0a9bcd4a7a25"]
512025-01-11T05:35:13.864ZINFOcrucible-agent (dropshot): request completed latency_us = 25632 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:60972 req_id = 6d3c20b0-ffda-429b-83e3-b4ce86c71dcb response_code = 200 uri = /crucible/0/regions/641fa2e4-05f8-454b-b4ed-52ffcf107cc4/snapshots/107e84c5-79f6-4307-8f8c-0a9bcd4a7a25/run