Max level shown:
12025-12-11T18:15:16.131ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::18]:32345 remote_addr = [fd00:1122:3344:101::a]:43891
22025-12-11T18:15:16.161ZINFOcrucible-agent (datafile): region 9b8067a8-7f6f-4e1f-9020-fe5a34a43153 state: Requested
32025-12-11T18:15:16.164ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
42025-12-11T18:15:16.164ZINFOcrucible-agent (dropshot): request completed latency_us = 16673 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:43891 req_id = a018d410-da3a-410d-8a29-9165016fffc5 response_code = 200 uri = /crucible/0/regions
52025-12-11T18:15:16.174ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_e7d2d7ca-2ca6-4dab-ad71-505d79ea9003/crucible/regions/9b8067a8-7f6f-4e1f-9020-fe5a34a43153
62025-12-11T18:15:16.174ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_e7d2d7ca-2ca6-4dab-ad71-505d79ea9003/crucible/regions/9b8067a8-7f6f-4e1f-9020-fe5a34a43153
72025-12-11T18:15:16.252ZINFOcrucible-agent (worker): creating region Region { id: RegionId("9b8067a8-7f6f-4e1f-9020-fe5a34a43153"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/9b8067a8-7f6f-4e1f-9020-fe5a34a43153" region = 9b8067a8-7f6f-4e1f-9020-fe5a34a43153
82025-12-11T18:15:16.255ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "9b8067a8-7f6f-4e1f-9020-fe5a34a43153" "--data" "/data/regions/9b8067a8-7f6f-4e1f-9020-fe5a34a43153" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 9b8067a8-7f6f-4e1f-9020-fe5a34a43153
92025-12-11T18:15:16.603ZINFOcrucible-agent (dropshot): request completed latency_us = 57 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:43891 req_id = b51d0ccb-cec7-4a6c-b3a2-8e013c1d4c13 response_code = 200 uri = /crucible/0/regions
102025-12-11T18:15:16.626ZINFOcrucible-agent (worker): region files created ok region = 9b8067a8-7f6f-4e1f-9020-fe5a34a43153
112025-12-11T18:15:16.626ZINFOcrucible-agent (datafile): region 9b8067a8-7f6f-4e1f-9020-fe5a34a43153 state: Requested -> Created
122025-12-11T18:15:16.626ZINFOcrucible-agent (worker): applying SMF actions post create...
132025-12-11T18:15:16.627ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-9b8067a8-7f6f-4e1f-9020-fe5a34a43153
142025-12-11T18:15:16.634ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-9b8067a8-7f6f-4e1f-9020-fe5a34a43153
152025-12-11T18:15:16.650ZINFOcrucible-agent (worker): creating config property group
162025-12-11T18:15:16.654ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-9b8067a8-7f6f-4e1f-9020-fe5a34a43153
172025-12-11T18:15:16.655ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/9b8067a8-7f6f-4e1f-9020-fe5a34a43153
182025-12-11T18:15:16.655ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
192025-12-11T18:15:16.655ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::18
202025-12-11T18:15:16.655ZINFOcrucible-agent (worker): commit
212025-12-11T18:15:16.660ZINFOcrucible-agent (worker): ok!
222025-12-11T18:15:16.664ZINFOcrucible-agent (worker): SMF ok!
232025-12-11T18:15:17.265ZINFOcrucible-agent (dropshot): request completed latency_us = 83 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:43891 req_id = 8d72f407-9f6d-4f50-bfae-31b7d1032779 response_code = 200 uri = /crucible/0/regions
242025-12-11T18:26:28.053ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::18]:32345 remote_addr = [fd00:1122:3344:101::a]:56694
252025-12-11T18:26:28.053ZINFOcrucible-agent (dropshot): request completed latency_us = 64 local_addr = [fd00:1122:3344:101::18]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:56694 req_id = 2baa62d6-8cf7-4dcc-8b53-f9a2d4e80a34 response_code = 200 uri = /crucible/0/regions/9b8067a8-7f6f-4e1f-9020-fe5a34a43153
262025-12-11T18:26:28.055ZINFOcrucible-agent (datafile): path is "/data/regions/9b8067a8-7f6f-4e1f-9020-fe5a34a43153"
272025-12-11T18:26:28.062ZINFOcrucible-agent (datafile): dataset is oxp_e7d2d7ca-2ca6-4dab-ad71-505d79ea9003/crucible/regions/9b8067a8-7f6f-4e1f-9020-fe5a34a43153
282025-12-11T18:26:28.069ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_e7d2d7ca-2ca6-4dab-ad71-505d79ea9003/crucible/regions/9b8067a8-7f6f-4e1f-9020-fe5a34a43153@0e0f4494-ece2-4d3c-9361-167a8c5e41fa
292025-12-11T18:26:28.069ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_e7d2d7ca-2ca6-4dab-ad71-505d79ea9003/crucible/regions/9b8067a8-7f6f-4e1f-9020-fe5a34a43153", "0e0f4494-ece2-4d3c-9361-167a8c5e41fa"]
302025-12-11T18:26:28.079ZINFOcrucible-agent (dropshot): request completed latency_us = 23274 local_addr = [fd00:1122:3344:101::18]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:56694 req_id = 10b206eb-b554-4cac-87a2-d0571e6a19fd response_code = 200 uri = /crucible/0/regions/9b8067a8-7f6f-4e1f-9020-fe5a34a43153/snapshots/0e0f4494-ece2-4d3c-9361-167a8c5e41fa
312025-12-11T18:26:28.082ZINFOcrucible-agent (datafile): path is "/data/regions/9b8067a8-7f6f-4e1f-9020-fe5a34a43153"
322025-12-11T18:26:28.088ZINFOcrucible-agent (datafile): dataset is oxp_e7d2d7ca-2ca6-4dab-ad71-505d79ea9003/crucible/regions/9b8067a8-7f6f-4e1f-9020-fe5a34a43153
332025-12-11T18:26:28.095ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_e7d2d7ca-2ca6-4dab-ad71-505d79ea9003/crucible/regions/9b8067a8-7f6f-4e1f-9020-fe5a34a43153@0e0f4494-ece2-4d3c-9361-167a8c5e41fa
342025-12-11T18:26:28.095ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_e7d2d7ca-2ca6-4dab-ad71-505d79ea9003/crucible/regions/9b8067a8-7f6f-4e1f-9020-fe5a34a43153", "0e0f4494-ece2-4d3c-9361-167a8c5e41fa"]
352025-12-11T18:26:28.103ZINFOcrucible-agent (datafile): requesting running snapshot 9b8067a8-7f6f-4e1f-9020-fe5a34a43153-0e0f4494-ece2-4d3c-9361-167a8c5e41fa state: Requested
362025-12-11T18:26:28.103ZINFOcrucible-agent (dropshot): request completed latency_us = 21046 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:56694 req_id = bbc5f127-e04a-4ea7-a823-161c9423c389 response_code = 200 uri = /crucible/0/regions/9b8067a8-7f6f-4e1f-9020-fe5a34a43153/snapshots/0e0f4494-ece2-4d3c-9361-167a8c5e41fa/run
372025-12-11T18:26:28.103ZINFOcrucible-agent (worker): applying SMF actions for region 9b8067a8-7f6f-4e1f-9020-fe5a34a43153 running snapshot 0e0f4494-ece2-4d3c-9361-167a8c5e41fa (state Requested)...
382025-12-11T18:26:28.124ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-9b8067a8-7f6f-4e1f-9020-fe5a34a43153-0e0f4494-ece2-4d3c-9361-167a8c5e41fa
392025-12-11T18:26:28.136ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-9b8067a8-7f6f-4e1f-9020-fe5a34a43153-0e0f4494-ece2-4d3c-9361-167a8c5e41fa
402025-12-11T18:26:28.152ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-9b8067a8-7f6f-4e1f-9020-fe5a34a43153-0e0f4494-ece2-4d3c-9361-167a8c5e41fa
412025-12-11T18:26:28.152ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/9b8067a8-7f6f-4e1f-9020-fe5a34a43153/.zfs/snapshot/0e0f4494-ece2-4d3c-9361-167a8c5e41fa
422025-12-11T18:26:28.152ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
432025-12-11T18:26:28.152ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
442025-12-11T18:26:28.152ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::18
452025-12-11T18:26:28.152ZINFOcrucible-agent (worker): commit
462025-12-11T18:26:28.156ZINFOcrucible-agent (worker): ok!
472025-12-11T18:26:28.161ZINFOcrucible-agent (worker): SMF ok!
482025-12-11T18:26:28.161ZINFOcrucible-agent (datafile): region 9b8067a8-7f6f-4e1f-9020-fe5a34a43153 running snapshot 0e0f4494-ece2-4d3c-9361-167a8c5e41fa state: Requested -> Created
492025-12-11T18:26:28.292ZINFOcrucible-agent (datafile): path is "/data/regions/9b8067a8-7f6f-4e1f-9020-fe5a34a43153"
502025-12-11T18:26:28.298ZINFOcrucible-agent (datafile): dataset is oxp_e7d2d7ca-2ca6-4dab-ad71-505d79ea9003/crucible/regions/9b8067a8-7f6f-4e1f-9020-fe5a34a43153
512025-12-11T18:26:28.305ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_e7d2d7ca-2ca6-4dab-ad71-505d79ea9003/crucible/regions/9b8067a8-7f6f-4e1f-9020-fe5a34a43153@0e0f4494-ece2-4d3c-9361-167a8c5e41fa
522025-12-11T18:26:28.305ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_e7d2d7ca-2ca6-4dab-ad71-505d79ea9003/crucible/regions/9b8067a8-7f6f-4e1f-9020-fe5a34a43153", "0e0f4494-ece2-4d3c-9361-167a8c5e41fa"]
532025-12-11T18:26:28.311ZINFOcrucible-agent (dropshot): request completed latency_us = 19376 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:56694 req_id = 7b237437-e9b4-4725-97c1-1a5320c1aed9 response_code = 200 uri = /crucible/0/regions/9b8067a8-7f6f-4e1f-9020-fe5a34a43153/snapshots/0e0f4494-ece2-4d3c-9361-167a8c5e41fa/run