Max level shown:
12025-03-25T22:40:06.251ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::13]:32345 remote_addr = [fd00:1122:3344:101::c]:53147
22025-03-25T22:40:06.252ZINFOcrucible-agent (datafile): region b6b97bf9-f214-4f77-aafa-5c7a9f81bf25 state: Requested
32025-03-25T22:40:06.252ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
42025-03-25T22:40:06.252ZINFOcrucible-agent (dropshot): request completed latency_us = 645 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:53147 req_id = a85492c4-0aaa-418f-bcd4-b64bd90470ff response_code = 200 uri = /crucible/0/regions
52025-03-25T22:40:06.265ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_8d24cd0e-128d-487b-8dc6-5eb2b15e2eff/crucible/regions/b6b97bf9-f214-4f77-aafa-5c7a9f81bf25
62025-03-25T22:40:06.265ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_8d24cd0e-128d-487b-8dc6-5eb2b15e2eff/crucible/regions/b6b97bf9-f214-4f77-aafa-5c7a9f81bf25
72025-03-25T22:40:06.341ZINFOcrucible-agent (worker): creating region Region { id: RegionId("b6b97bf9-f214-4f77-aafa-5c7a9f81bf25"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/b6b97bf9-f214-4f77-aafa-5c7a9f81bf25" region = b6b97bf9-f214-4f77-aafa-5c7a9f81bf25
82025-03-25T22:40:06.341ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "b6b97bf9-f214-4f77-aafa-5c7a9f81bf25" "--data" "/data/regions/b6b97bf9-f214-4f77-aafa-5c7a9f81bf25" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = b6b97bf9-f214-4f77-aafa-5c7a9f81bf25
92025-03-25T22:40:06.441ZINFOcrucible-agent (worker): region files created ok region = b6b97bf9-f214-4f77-aafa-5c7a9f81bf25
102025-03-25T22:40:06.442ZINFOcrucible-agent (datafile): region b6b97bf9-f214-4f77-aafa-5c7a9f81bf25 state: Requested -> Created
112025-03-25T22:40:06.442ZINFOcrucible-agent (worker): applying SMF actions post create...
122025-03-25T22:40:06.442ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-b6b97bf9-f214-4f77-aafa-5c7a9f81bf25
132025-03-25T22:40:06.449ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-b6b97bf9-f214-4f77-aafa-5c7a9f81bf25
142025-03-25T22:40:06.468ZINFOcrucible-agent (worker): creating config property group
152025-03-25T22:40:06.472ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-b6b97bf9-f214-4f77-aafa-5c7a9f81bf25
162025-03-25T22:40:06.473ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/b6b97bf9-f214-4f77-aafa-5c7a9f81bf25
172025-03-25T22:40:06.473ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
182025-03-25T22:40:06.473ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::13
192025-03-25T22:40:06.473ZINFOcrucible-agent (worker): commit
202025-03-25T22:40:06.478ZINFOcrucible-agent (worker): ok!
212025-03-25T22:40:06.484ZINFOcrucible-agent (worker): SMF ok!
222025-03-25T22:40:06.631ZINFOcrucible-agent (dropshot): request completed latency_us = 58 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:53147 req_id = 2b39e6a0-2f37-4b60-8a4b-3d5de887ad24 response_code = 200 uri = /crucible/0/regions
232025-03-25T22:40:07.258ZINFOcrucible-agent (dropshot): request completed latency_us = 3687 local_addr = [fd00:1122:3344:101::13]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:53147 req_id = 41084ad9-1c8b-4aff-83fb-1f11f372b08a response_code = 200 uri = /crucible/0/regions/fb454b05-1fa0-426d-b541-e9a180e4d2ba
242025-03-25T22:40:07.263ZINFOcrucible-agent (datafile): path is "/data/regions/fb454b05-1fa0-426d-b541-e9a180e4d2ba"
252025-03-25T22:40:07.273ZINFOcrucible-agent (datafile): dataset is oxp_8d24cd0e-128d-487b-8dc6-5eb2b15e2eff/crucible/regions/fb454b05-1fa0-426d-b541-e9a180e4d2ba
262025-03-25T22:40:07.282ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_8d24cd0e-128d-487b-8dc6-5eb2b15e2eff/crucible/regions/fb454b05-1fa0-426d-b541-e9a180e4d2ba@52750cf1-0fce-4409-90e4-2bbf33898c96
272025-03-25T22:40:07.282ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_8d24cd0e-128d-487b-8dc6-5eb2b15e2eff/crucible/regions/fb454b05-1fa0-426d-b541-e9a180e4d2ba", "52750cf1-0fce-4409-90e4-2bbf33898c96"]
282025-03-25T22:40:07.291ZINFOcrucible-agent (dropshot): request completed latency_us = 30398 local_addr = [fd00:1122:3344:101::13]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:53147 req_id = 6df4f6bd-6ddd-4c86-9b14-579eefd7eb55 response_code = 200 uri = /crucible/0/regions/fb454b05-1fa0-426d-b541-e9a180e4d2ba/snapshots/52750cf1-0fce-4409-90e4-2bbf33898c96
292025-03-25T22:40:07.294ZINFOcrucible-agent (datafile): path is "/data/regions/fb454b05-1fa0-426d-b541-e9a180e4d2ba"
302025-03-25T22:40:07.303ZINFOcrucible-agent (datafile): dataset is oxp_8d24cd0e-128d-487b-8dc6-5eb2b15e2eff/crucible/regions/fb454b05-1fa0-426d-b541-e9a180e4d2ba
312025-03-25T22:40:07.311ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_8d24cd0e-128d-487b-8dc6-5eb2b15e2eff/crucible/regions/fb454b05-1fa0-426d-b541-e9a180e4d2ba@52750cf1-0fce-4409-90e4-2bbf33898c96
322025-03-25T22:40:07.311ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_8d24cd0e-128d-487b-8dc6-5eb2b15e2eff/crucible/regions/fb454b05-1fa0-426d-b541-e9a180e4d2ba", "52750cf1-0fce-4409-90e4-2bbf33898c96"]
332025-03-25T22:40:07.320ZINFOcrucible-agent (datafile): requesting running snapshot fb454b05-1fa0-426d-b541-e9a180e4d2ba-52750cf1-0fce-4409-90e4-2bbf33898c96 state: Requested
342025-03-25T22:40:07.320ZINFOcrucible-agent (worker): applying SMF actions for region fb454b05-1fa0-426d-b541-e9a180e4d2ba running snapshot 52750cf1-0fce-4409-90e4-2bbf33898c96 (state Requested)...
352025-03-25T22:40:07.320ZINFOcrucible-agent (dropshot): request completed latency_us = 25802 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:53147 req_id = 6aa4a350-5da2-4903-9f3a-b271baca6a6b response_code = 200 uri = /crucible/0/regions/fb454b05-1fa0-426d-b541-e9a180e4d2ba/snapshots/52750cf1-0fce-4409-90e4-2bbf33898c96/run
362025-03-25T22:40:07.322ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-fb454b05-1fa0-426d-b541-e9a180e4d2ba-52750cf1-0fce-4409-90e4-2bbf33898c96
372025-03-25T22:40:07.332ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-fb454b05-1fa0-426d-b541-e9a180e4d2ba-52750cf1-0fce-4409-90e4-2bbf33898c96
382025-03-25T22:40:07.344ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-fb454b05-1fa0-426d-b541-e9a180e4d2ba-52750cf1-0fce-4409-90e4-2bbf33898c96
392025-03-25T22:40:07.344ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/fb454b05-1fa0-426d-b541-e9a180e4d2ba/.zfs/snapshot/52750cf1-0fce-4409-90e4-2bbf33898c96
402025-03-25T22:40:07.344ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19002
412025-03-25T22:40:07.344ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
422025-03-25T22:40:07.344ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::13
432025-03-25T22:40:07.344ZINFOcrucible-agent (worker): commit
442025-03-25T22:40:07.348ZINFOcrucible-agent (worker): ok!
452025-03-25T22:40:07.353ZINFOcrucible-agent (worker): SMF ok!
462025-03-25T22:40:07.353ZINFOcrucible-agent (datafile): region fb454b05-1fa0-426d-b541-e9a180e4d2ba running snapshot 52750cf1-0fce-4409-90e4-2bbf33898c96 state: Requested -> Created
472025-03-25T22:40:07.547ZINFOcrucible-agent (datafile): path is "/data/regions/fb454b05-1fa0-426d-b541-e9a180e4d2ba"
482025-03-25T22:40:07.555ZINFOcrucible-agent (datafile): dataset is oxp_8d24cd0e-128d-487b-8dc6-5eb2b15e2eff/crucible/regions/fb454b05-1fa0-426d-b541-e9a180e4d2ba
492025-03-25T22:40:07.563ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_8d24cd0e-128d-487b-8dc6-5eb2b15e2eff/crucible/regions/fb454b05-1fa0-426d-b541-e9a180e4d2ba@52750cf1-0fce-4409-90e4-2bbf33898c96
502025-03-25T22:40:07.563ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_8d24cd0e-128d-487b-8dc6-5eb2b15e2eff/crucible/regions/fb454b05-1fa0-426d-b541-e9a180e4d2ba", "52750cf1-0fce-4409-90e4-2bbf33898c96"]
512025-03-25T22:40:07.571ZINFOcrucible-agent (dropshot): request completed latency_us = 24365 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:53147 req_id = ef225ea0-a7f0-408f-9220-5dd51fb5909d response_code = 200 uri = /crucible/0/regions/fb454b05-1fa0-426d-b541-e9a180e4d2ba/snapshots/52750cf1-0fce-4409-90e4-2bbf33898c96/run