Max level shown:
12025-04-19T00:37:13.393ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::1a]:32345 remote_addr = [fd00:1122:3344:101::b]:48866
22025-04-19T00:37:13.393ZINFOcrucible-agent (datafile): region bac27fc0-b8ef-4c83-8770-0cad56e63055 state: Requested
32025-04-19T00:37:13.393ZINFOcrucible-agent (dropshot): request completed latency_us = 630 local_addr = [fd00:1122:3344:101::1a]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:48866 req_id = 057b789e-55b8-4992-9e6b-2a283813410a response_code = 200 uri = /crucible/0/regions
42025-04-19T00:37:13.393ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
52025-04-19T00:37:13.406ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_3f2edde9-e2ff-4d0c-a239-0bb032d10a78/crucible/regions/bac27fc0-b8ef-4c83-8770-0cad56e63055
62025-04-19T00:37:13.406ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_3f2edde9-e2ff-4d0c-a239-0bb032d10a78/crucible/regions/bac27fc0-b8ef-4c83-8770-0cad56e63055
72025-04-19T00:37:13.466ZINFOcrucible-agent (worker): creating region Region { id: RegionId("bac27fc0-b8ef-4c83-8770-0cad56e63055"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/bac27fc0-b8ef-4c83-8770-0cad56e63055" region = bac27fc0-b8ef-4c83-8770-0cad56e63055
82025-04-19T00:37:13.468ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "bac27fc0-b8ef-4c83-8770-0cad56e63055" "--data" "/data/regions/bac27fc0-b8ef-4c83-8770-0cad56e63055" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = bac27fc0-b8ef-4c83-8770-0cad56e63055
92025-04-19T00:37:13.649ZINFOcrucible-agent (worker): region files created ok region = bac27fc0-b8ef-4c83-8770-0cad56e63055
102025-04-19T00:37:13.649ZINFOcrucible-agent (datafile): region bac27fc0-b8ef-4c83-8770-0cad56e63055 state: Requested -> Created
112025-04-19T00:37:13.649ZINFOcrucible-agent (worker): applying SMF actions post create...
122025-04-19T00:37:13.658ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-bac27fc0-b8ef-4c83-8770-0cad56e63055
132025-04-19T00:37:13.675ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-bac27fc0-b8ef-4c83-8770-0cad56e63055
142025-04-19T00:37:13.695ZINFOcrucible-agent (worker): creating config property group
152025-04-19T00:37:13.707ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-bac27fc0-b8ef-4c83-8770-0cad56e63055
162025-04-19T00:37:13.707ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/bac27fc0-b8ef-4c83-8770-0cad56e63055
172025-04-19T00:37:13.707ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
182025-04-19T00:37:13.707ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::1a
192025-04-19T00:37:13.707ZINFOcrucible-agent (worker): commit
202025-04-19T00:37:13.718ZINFOcrucible-agent (worker): ok!
212025-04-19T00:37:13.727ZINFOcrucible-agent (worker): SMF ok!
222025-04-19T00:37:13.747ZINFOcrucible-agent (dropshot): request completed latency_us = 74 local_addr = [fd00:1122:3344:101::1a]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:48866 req_id = cb9aa3dd-7e53-4170-baaf-d641b807dc5a response_code = 200 uri = /crucible/0/regions
232025-04-19T00:37:15.934ZINFOcrucible-agent (dropshot): request completed latency_us = 86 local_addr = [fd00:1122:3344:101::1a]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:48866 req_id = 96d6373b-5acf-41d1-965b-c6cb507bd863 response_code = 200 uri = /crucible/0/regions/22eb6f0f-fc3c-43d2-916e-2327c913f2a9
242025-04-19T00:37:15.949ZINFOcrucible-agent (datafile): path is "/data/regions/22eb6f0f-fc3c-43d2-916e-2327c913f2a9"
252025-04-19T00:37:15.958ZINFOcrucible-agent (datafile): dataset is oxp_3f2edde9-e2ff-4d0c-a239-0bb032d10a78/crucible/regions/22eb6f0f-fc3c-43d2-916e-2327c913f2a9
262025-04-19T00:37:15.966ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_3f2edde9-e2ff-4d0c-a239-0bb032d10a78/crucible/regions/22eb6f0f-fc3c-43d2-916e-2327c913f2a9@8b5b4d39-b876-4e0e-adac-3ff838a80eeb
272025-04-19T00:37:15.966ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_3f2edde9-e2ff-4d0c-a239-0bb032d10a78/crucible/regions/22eb6f0f-fc3c-43d2-916e-2327c913f2a9", "8b5b4d39-b876-4e0e-adac-3ff838a80eeb"]
282025-04-19T00:37:15.975ZINFOcrucible-agent (dropshot): request completed latency_us = 37878 local_addr = [fd00:1122:3344:101::1a]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:48866 req_id = fd1118d3-54e6-4430-82c0-051bfc170348 response_code = 200 uri = /crucible/0/regions/22eb6f0f-fc3c-43d2-916e-2327c913f2a9/snapshots/8b5b4d39-b876-4e0e-adac-3ff838a80eeb
292025-04-19T00:37:15.979ZINFOcrucible-agent (datafile): path is "/data/regions/22eb6f0f-fc3c-43d2-916e-2327c913f2a9"
302025-04-19T00:37:15.988ZINFOcrucible-agent (datafile): dataset is oxp_3f2edde9-e2ff-4d0c-a239-0bb032d10a78/crucible/regions/22eb6f0f-fc3c-43d2-916e-2327c913f2a9
312025-04-19T00:37:15.996ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_3f2edde9-e2ff-4d0c-a239-0bb032d10a78/crucible/regions/22eb6f0f-fc3c-43d2-916e-2327c913f2a9@8b5b4d39-b876-4e0e-adac-3ff838a80eeb
322025-04-19T00:37:15.996ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_3f2edde9-e2ff-4d0c-a239-0bb032d10a78/crucible/regions/22eb6f0f-fc3c-43d2-916e-2327c913f2a9", "8b5b4d39-b876-4e0e-adac-3ff838a80eeb"]
332025-04-19T00:37:16.005ZINFOcrucible-agent (datafile): requesting running snapshot 22eb6f0f-fc3c-43d2-916e-2327c913f2a9-8b5b4d39-b876-4e0e-adac-3ff838a80eeb state: Requested
342025-04-19T00:37:16.005ZINFOcrucible-agent (worker): applying SMF actions for region 22eb6f0f-fc3c-43d2-916e-2327c913f2a9 running snapshot 8b5b4d39-b876-4e0e-adac-3ff838a80eeb (state Requested)...
352025-04-19T00:37:16.005ZINFOcrucible-agent (dropshot): request completed latency_us = 26681 local_addr = [fd00:1122:3344:101::1a]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:48866 req_id = bf0d18e6-d702-432f-9743-33114ef0173f response_code = 200 uri = /crucible/0/regions/22eb6f0f-fc3c-43d2-916e-2327c913f2a9/snapshots/8b5b4d39-b876-4e0e-adac-3ff838a80eeb/run
362025-04-19T00:37:16.008ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-22eb6f0f-fc3c-43d2-916e-2327c913f2a9-8b5b4d39-b876-4e0e-adac-3ff838a80eeb
372025-04-19T00:37:16.022ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-22eb6f0f-fc3c-43d2-916e-2327c913f2a9-8b5b4d39-b876-4e0e-adac-3ff838a80eeb
382025-04-19T00:37:16.051ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-22eb6f0f-fc3c-43d2-916e-2327c913f2a9-8b5b4d39-b876-4e0e-adac-3ff838a80eeb
392025-04-19T00:37:16.051ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/22eb6f0f-fc3c-43d2-916e-2327c913f2a9/.zfs/snapshot/8b5b4d39-b876-4e0e-adac-3ff838a80eeb
402025-04-19T00:37:16.051ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19002
412025-04-19T00:37:16.051ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
422025-04-19T00:37:16.051ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::1a
432025-04-19T00:37:16.051ZINFOcrucible-agent (worker): commit
442025-04-19T00:37:16.063ZINFOcrucible-agent (worker): ok!
452025-04-19T00:37:16.075ZINFOcrucible-agent (worker): SMF ok!
462025-04-19T00:37:16.075ZINFOcrucible-agent (datafile): region 22eb6f0f-fc3c-43d2-916e-2327c913f2a9 running snapshot 8b5b4d39-b876-4e0e-adac-3ff838a80eeb state: Requested -> Created
472025-04-19T00:37:16.164ZINFOcrucible-agent (datafile): path is "/data/regions/22eb6f0f-fc3c-43d2-916e-2327c913f2a9"
482025-04-19T00:37:16.173ZINFOcrucible-agent (datafile): dataset is oxp_3f2edde9-e2ff-4d0c-a239-0bb032d10a78/crucible/regions/22eb6f0f-fc3c-43d2-916e-2327c913f2a9
492025-04-19T00:37:16.181ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_3f2edde9-e2ff-4d0c-a239-0bb032d10a78/crucible/regions/22eb6f0f-fc3c-43d2-916e-2327c913f2a9@8b5b4d39-b876-4e0e-adac-3ff838a80eeb
502025-04-19T00:37:16.181ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_3f2edde9-e2ff-4d0c-a239-0bb032d10a78/crucible/regions/22eb6f0f-fc3c-43d2-916e-2327c913f2a9", "8b5b4d39-b876-4e0e-adac-3ff838a80eeb"]
512025-04-19T00:37:16.189ZINFOcrucible-agent (dropshot): request completed latency_us = 24768 local_addr = [fd00:1122:3344:101::1a]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:48866 req_id = f74ac434-36bf-4014-bf5f-359363c814e2 response_code = 200 uri = /crucible/0/regions/22eb6f0f-fc3c-43d2-916e-2327c913f2a9/snapshots/8b5b4d39-b876-4e0e-adac-3ff838a80eeb/run