Max level shown:
12025-02-28T23:20:31.892ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::1a]:32345 remote_addr = [fd00:1122:3344:101::a]:51830
22025-02-28T23:20:31.892ZINFOcrucible-agent (datafile): region 2ab8d2c2-1af0-40f7-a41c-099633252929 state: Requested
32025-02-28T23:20:31.892ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
42025-02-28T23:20:31.892ZINFOcrucible-agent (dropshot): request completed latency_us = 607 local_addr = [fd00:1122:3344:101::1a]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:51830 req_id = cba73f13-97de-4e99-b661-0282549454a3 response_code = 200 uri = /crucible/0/regions
52025-02-28T23:20:31.905ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_d5534d82-e391-4535-be4a-591aedf1d99f/crucible/regions/2ab8d2c2-1af0-40f7-a41c-099633252929
62025-02-28T23:20:31.905ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_d5534d82-e391-4535-be4a-591aedf1d99f/crucible/regions/2ab8d2c2-1af0-40f7-a41c-099633252929
72025-02-28T23:20:31.951ZINFOcrucible-agent (worker): creating region Region { id: RegionId("2ab8d2c2-1af0-40f7-a41c-099633252929"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/2ab8d2c2-1af0-40f7-a41c-099633252929" region = 2ab8d2c2-1af0-40f7-a41c-099633252929
82025-02-28T23:20:31.951ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "2ab8d2c2-1af0-40f7-a41c-099633252929" "--data" "/data/regions/2ab8d2c2-1af0-40f7-a41c-099633252929" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 2ab8d2c2-1af0-40f7-a41c-099633252929
92025-02-28T23:20:32.032ZINFOcrucible-agent (worker): region files created ok region = 2ab8d2c2-1af0-40f7-a41c-099633252929
102025-02-28T23:20:32.032ZINFOcrucible-agent (datafile): region 2ab8d2c2-1af0-40f7-a41c-099633252929 state: Requested -> Created
112025-02-28T23:20:32.032ZINFOcrucible-agent (worker): applying SMF actions post create...
122025-02-28T23:20:32.033ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-2ab8d2c2-1af0-40f7-a41c-099633252929
132025-02-28T23:20:32.039ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-2ab8d2c2-1af0-40f7-a41c-099633252929
142025-02-28T23:20:32.052ZINFOcrucible-agent (worker): creating config property group
152025-02-28T23:20:32.056ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-2ab8d2c2-1af0-40f7-a41c-099633252929
162025-02-28T23:20:32.056ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/2ab8d2c2-1af0-40f7-a41c-099633252929
172025-02-28T23:20:32.056ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
182025-02-28T23:20:32.056ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::1a
192025-02-28T23:20:32.056ZINFOcrucible-agent (worker): commit
202025-02-28T23:20:32.060ZINFOcrucible-agent (worker): ok!
212025-02-28T23:20:32.065ZINFOcrucible-agent (worker): SMF ok!
222025-02-28T23:20:32.074ZINFOcrucible-agent (dropshot): request completed latency_us = 67 local_addr = [fd00:1122:3344:101::1a]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:51830 req_id = 36a351b1-5d6a-4ecf-95b7-70ffaea5cd22 response_code = 200 uri = /crucible/0/regions
232025-02-28T23:20:33.469ZINFOcrucible-agent (dropshot): request completed latency_us = 3682 local_addr = [fd00:1122:3344:101::1a]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:51830 req_id = 8fb00a93-911d-4194-9ac3-e1213e518b92 response_code = 200 uri = /crucible/0/regions/77d4b7ac-ee09-4293-b14a-8ac3ae71e828
242025-02-28T23:20:33.476ZINFOcrucible-agent (datafile): path is "/data/regions/77d4b7ac-ee09-4293-b14a-8ac3ae71e828"
252025-02-28T23:20:33.490ZINFOcrucible-agent (datafile): dataset is oxp_d5534d82-e391-4535-be4a-591aedf1d99f/crucible/regions/77d4b7ac-ee09-4293-b14a-8ac3ae71e828
262025-02-28T23:20:33.502ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_d5534d82-e391-4535-be4a-591aedf1d99f/crucible/regions/77d4b7ac-ee09-4293-b14a-8ac3ae71e828@72c97549-8bc9-4780-ad0f-369ae089f235
272025-02-28T23:20:33.502ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_d5534d82-e391-4535-be4a-591aedf1d99f/crucible/regions/77d4b7ac-ee09-4293-b14a-8ac3ae71e828", "72c97549-8bc9-4780-ad0f-369ae089f235"]
282025-02-28T23:20:33.517ZINFOcrucible-agent (dropshot): request completed latency_us = 43812 local_addr = [fd00:1122:3344:101::1a]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:51830 req_id = 07a99e04-bd40-49a8-917c-fd54f77e8242 response_code = 200 uri = /crucible/0/regions/77d4b7ac-ee09-4293-b14a-8ac3ae71e828/snapshots/72c97549-8bc9-4780-ad0f-369ae089f235
292025-02-28T23:20:33.522ZINFOcrucible-agent (datafile): path is "/data/regions/77d4b7ac-ee09-4293-b14a-8ac3ae71e828"
302025-02-28T23:20:33.534ZINFOcrucible-agent (datafile): dataset is oxp_d5534d82-e391-4535-be4a-591aedf1d99f/crucible/regions/77d4b7ac-ee09-4293-b14a-8ac3ae71e828
312025-02-28T23:20:33.547ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_d5534d82-e391-4535-be4a-591aedf1d99f/crucible/regions/77d4b7ac-ee09-4293-b14a-8ac3ae71e828@72c97549-8bc9-4780-ad0f-369ae089f235
322025-02-28T23:20:33.547ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_d5534d82-e391-4535-be4a-591aedf1d99f/crucible/regions/77d4b7ac-ee09-4293-b14a-8ac3ae71e828", "72c97549-8bc9-4780-ad0f-369ae089f235"]
332025-02-28T23:20:33.560ZINFOcrucible-agent (datafile): requesting running snapshot 77d4b7ac-ee09-4293-b14a-8ac3ae71e828-72c97549-8bc9-4780-ad0f-369ae089f235 state: Requested
342025-02-28T23:20:33.560ZINFOcrucible-agent (worker): applying SMF actions for region 77d4b7ac-ee09-4293-b14a-8ac3ae71e828 running snapshot 72c97549-8bc9-4780-ad0f-369ae089f235 (state Requested)...
352025-02-28T23:20:33.560ZINFOcrucible-agent (dropshot): request completed latency_us = 38223 local_addr = [fd00:1122:3344:101::1a]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:51830 req_id = 342ee795-e034-4295-b4e1-6d6c7376a23a response_code = 200 uri = /crucible/0/regions/77d4b7ac-ee09-4293-b14a-8ac3ae71e828/snapshots/72c97549-8bc9-4780-ad0f-369ae089f235/run
362025-02-28T23:20:33.563ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-77d4b7ac-ee09-4293-b14a-8ac3ae71e828-72c97549-8bc9-4780-ad0f-369ae089f235
372025-02-28T23:20:33.569ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-77d4b7ac-ee09-4293-b14a-8ac3ae71e828-72c97549-8bc9-4780-ad0f-369ae089f235
382025-02-28T23:20:33.580ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-77d4b7ac-ee09-4293-b14a-8ac3ae71e828-72c97549-8bc9-4780-ad0f-369ae089f235
392025-02-28T23:20:33.580ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/77d4b7ac-ee09-4293-b14a-8ac3ae71e828/.zfs/snapshot/72c97549-8bc9-4780-ad0f-369ae089f235
402025-02-28T23:20:33.580ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19002
412025-02-28T23:20:33.580ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
422025-02-28T23:20:33.580ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::1a
432025-02-28T23:20:33.580ZINFOcrucible-agent (worker): commit
442025-02-28T23:20:33.585ZINFOcrucible-agent (worker): ok!
452025-02-28T23:20:33.589ZINFOcrucible-agent (worker): SMF ok!
462025-02-28T23:20:33.589ZINFOcrucible-agent (datafile): region 77d4b7ac-ee09-4293-b14a-8ac3ae71e828 running snapshot 72c97549-8bc9-4780-ad0f-369ae089f235 state: Requested -> Created
472025-02-28T23:20:33.907ZINFOcrucible-agent (datafile): path is "/data/regions/77d4b7ac-ee09-4293-b14a-8ac3ae71e828"
482025-02-28T23:20:33.917ZINFOcrucible-agent (datafile): dataset is oxp_d5534d82-e391-4535-be4a-591aedf1d99f/crucible/regions/77d4b7ac-ee09-4293-b14a-8ac3ae71e828
492025-02-28T23:20:33.926ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_d5534d82-e391-4535-be4a-591aedf1d99f/crucible/regions/77d4b7ac-ee09-4293-b14a-8ac3ae71e828@72c97549-8bc9-4780-ad0f-369ae089f235
502025-02-28T23:20:33.926ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_d5534d82-e391-4535-be4a-591aedf1d99f/crucible/regions/77d4b7ac-ee09-4293-b14a-8ac3ae71e828", "72c97549-8bc9-4780-ad0f-369ae089f235"]
512025-02-28T23:20:33.935ZINFOcrucible-agent (dropshot): request completed latency_us = 28819 local_addr = [fd00:1122:3344:101::1a]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:51830 req_id = d89f84a4-dd5c-4e5f-b77b-8a426019efc6 response_code = 200 uri = /crucible/0/regions/77d4b7ac-ee09-4293-b14a-8ac3ae71e828/snapshots/72c97549-8bc9-4780-ad0f-369ae089f235/run