Max level shown:
12026-01-27T18:47:14.168ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::13]:32345 remote_addr = [fd00:1122:3344:101::a]:59028
22026-01-27T18:47:14.169ZINFOcrucible-agent (datafile): region 08a3f91a-8e70-43a4-aaf7-5848c57b9ada state: Requested
32026-01-27T18:47:14.169ZINFOcrucible-agent (dropshot): request completed latency_us = 702 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:59028 req_id = 0f0eedaa-1585-4984-9986-39ff81da1416 response_code = 200 uri = /crucible/0/regions
42026-01-27T18:47:14.169ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
52026-01-27T18:47:14.178ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_972e35b1-ba8b-42cb-b443-4d6989f9cdf6/crucible/regions/08a3f91a-8e70-43a4-aaf7-5848c57b9ada
62026-01-27T18:47:14.178ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_972e35b1-ba8b-42cb-b443-4d6989f9cdf6/crucible/regions/08a3f91a-8e70-43a4-aaf7-5848c57b9ada
72026-01-27T18:47:14.231ZINFOcrucible-agent (worker): creating region Region { id: RegionId("08a3f91a-8e70-43a4-aaf7-5848c57b9ada"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/08a3f91a-8e70-43a4-aaf7-5848c57b9ada" region = 08a3f91a-8e70-43a4-aaf7-5848c57b9ada
82026-01-27T18:47:14.231ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "08a3f91a-8e70-43a4-aaf7-5848c57b9ada" "--data" "/data/regions/08a3f91a-8e70-43a4-aaf7-5848c57b9ada" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 08a3f91a-8e70-43a4-aaf7-5848c57b9ada
92026-01-27T18:47:14.310ZINFOcrucible-agent (worker): region files created ok region = 08a3f91a-8e70-43a4-aaf7-5848c57b9ada
102026-01-27T18:47:14.310ZINFOcrucible-agent (datafile): region 08a3f91a-8e70-43a4-aaf7-5848c57b9ada state: Requested -> Created
112026-01-27T18:47:14.310ZINFOcrucible-agent (worker): applying SMF actions post create...
122026-01-27T18:47:14.311ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-08a3f91a-8e70-43a4-aaf7-5848c57b9ada
132026-01-27T18:47:14.320ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-08a3f91a-8e70-43a4-aaf7-5848c57b9ada
142026-01-27T18:47:14.338ZINFOcrucible-agent (worker): creating config property group
152026-01-27T18:47:14.340ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-08a3f91a-8e70-43a4-aaf7-5848c57b9ada
162026-01-27T18:47:14.341ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/08a3f91a-8e70-43a4-aaf7-5848c57b9ada
172026-01-27T18:47:14.341ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
182026-01-27T18:47:14.341ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::13
192026-01-27T18:47:14.341ZINFOcrucible-agent (worker): commit
202026-01-27T18:47:14.345ZINFOcrucible-agent (worker): ok!
212026-01-27T18:47:14.359ZINFOcrucible-agent (worker): SMF ok!
222026-01-27T18:47:14.533ZINFOcrucible-agent (dropshot): request completed latency_us = 73 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:59028 req_id = 51e8c2a1-a3f4-4d18-8ca9-f37c4423cc76 response_code = 200 uri = /crucible/0/regions
232026-01-27T18:47:16.122ZINFOcrucible-agent (dropshot): request completed latency_us = 66 local_addr = [fd00:1122:3344:101::13]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:59028 req_id = 42575b90-0ff5-4c0c-aab6-2567d417edff response_code = 200 uri = /crucible/0/regions/cd93eee3-962e-4ad5-8bb4-b5ae88b1c200
242026-01-27T18:47:16.126ZINFOcrucible-agent (datafile): path is "/data/regions/cd93eee3-962e-4ad5-8bb4-b5ae88b1c200"
252026-01-27T18:47:16.132ZINFOcrucible-agent (datafile): dataset is oxp_972e35b1-ba8b-42cb-b443-4d6989f9cdf6/crucible/regions/cd93eee3-962e-4ad5-8bb4-b5ae88b1c200
262026-01-27T18:47:16.138ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_972e35b1-ba8b-42cb-b443-4d6989f9cdf6/crucible/regions/cd93eee3-962e-4ad5-8bb4-b5ae88b1c200@57d65ce1-68ad-4c8f-a7de-4e9f656098d9
272026-01-27T18:47:16.138ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_972e35b1-ba8b-42cb-b443-4d6989f9cdf6/crucible/regions/cd93eee3-962e-4ad5-8bb4-b5ae88b1c200", "57d65ce1-68ad-4c8f-a7de-4e9f656098d9"]
282026-01-27T18:47:16.146ZINFOcrucible-agent (dropshot): request completed latency_us = 20636 local_addr = [fd00:1122:3344:101::13]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:59028 req_id = 4647e6f8-4150-44c6-84f2-60f86469f470 response_code = 200 uri = /crucible/0/regions/cd93eee3-962e-4ad5-8bb4-b5ae88b1c200/snapshots/57d65ce1-68ad-4c8f-a7de-4e9f656098d9
292026-01-27T18:47:16.150ZINFOcrucible-agent (datafile): path is "/data/regions/cd93eee3-962e-4ad5-8bb4-b5ae88b1c200"
302026-01-27T18:47:16.156ZINFOcrucible-agent (datafile): dataset is oxp_972e35b1-ba8b-42cb-b443-4d6989f9cdf6/crucible/regions/cd93eee3-962e-4ad5-8bb4-b5ae88b1c200
312026-01-27T18:47:16.161ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_972e35b1-ba8b-42cb-b443-4d6989f9cdf6/crucible/regions/cd93eee3-962e-4ad5-8bb4-b5ae88b1c200@57d65ce1-68ad-4c8f-a7de-4e9f656098d9
322026-01-27T18:47:16.161ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_972e35b1-ba8b-42cb-b443-4d6989f9cdf6/crucible/regions/cd93eee3-962e-4ad5-8bb4-b5ae88b1c200", "57d65ce1-68ad-4c8f-a7de-4e9f656098d9"]
332026-01-27T18:47:16.169ZINFOcrucible-agent (datafile): requesting running snapshot cd93eee3-962e-4ad5-8bb4-b5ae88b1c200-57d65ce1-68ad-4c8f-a7de-4e9f656098d9 state: Requested
342026-01-27T18:47:16.169ZINFOcrucible-agent (dropshot): request completed latency_us = 19364 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:59028 req_id = f71b0205-8ed2-423f-b2b8-744d0b369b61 response_code = 200 uri = /crucible/0/regions/cd93eee3-962e-4ad5-8bb4-b5ae88b1c200/snapshots/57d65ce1-68ad-4c8f-a7de-4e9f656098d9/run
352026-01-27T18:47:16.169ZINFOcrucible-agent (worker): applying SMF actions for region cd93eee3-962e-4ad5-8bb4-b5ae88b1c200 running snapshot 57d65ce1-68ad-4c8f-a7de-4e9f656098d9 (state Requested)...
362026-01-27T18:47:16.174ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-cd93eee3-962e-4ad5-8bb4-b5ae88b1c200-57d65ce1-68ad-4c8f-a7de-4e9f656098d9
372026-01-27T18:47:16.184ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-cd93eee3-962e-4ad5-8bb4-b5ae88b1c200-57d65ce1-68ad-4c8f-a7de-4e9f656098d9
382026-01-27T18:47:16.193ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-cd93eee3-962e-4ad5-8bb4-b5ae88b1c200-57d65ce1-68ad-4c8f-a7de-4e9f656098d9
392026-01-27T18:47:16.193ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/cd93eee3-962e-4ad5-8bb4-b5ae88b1c200/.zfs/snapshot/57d65ce1-68ad-4c8f-a7de-4e9f656098d9
402026-01-27T18:47:16.194ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19002
412026-01-27T18:47:16.194ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
422026-01-27T18:47:16.194ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::13
432026-01-27T18:47:16.194ZINFOcrucible-agent (worker): commit
442026-01-27T18:47:16.197ZINFOcrucible-agent (worker): ok!
452026-01-27T18:47:16.201ZINFOcrucible-agent (worker): SMF ok!
462026-01-27T18:47:16.201ZINFOcrucible-agent (datafile): region cd93eee3-962e-4ad5-8bb4-b5ae88b1c200 running snapshot 57d65ce1-68ad-4c8f-a7de-4e9f656098d9 state: Requested -> Created
472026-01-27T18:47:16.331ZINFOcrucible-agent (datafile): path is "/data/regions/cd93eee3-962e-4ad5-8bb4-b5ae88b1c200"
482026-01-27T18:47:16.337ZINFOcrucible-agent (datafile): dataset is oxp_972e35b1-ba8b-42cb-b443-4d6989f9cdf6/crucible/regions/cd93eee3-962e-4ad5-8bb4-b5ae88b1c200
492026-01-27T18:47:16.343ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_972e35b1-ba8b-42cb-b443-4d6989f9cdf6/crucible/regions/cd93eee3-962e-4ad5-8bb4-b5ae88b1c200@57d65ce1-68ad-4c8f-a7de-4e9f656098d9
502026-01-27T18:47:16.343ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_972e35b1-ba8b-42cb-b443-4d6989f9cdf6/crucible/regions/cd93eee3-962e-4ad5-8bb4-b5ae88b1c200", "57d65ce1-68ad-4c8f-a7de-4e9f656098d9"]
512026-01-27T18:47:16.348ZINFOcrucible-agent (dropshot): request completed latency_us = 17246 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:59028 req_id = cd22fd98-f83f-47e2-86da-b2c6a8390f49 response_code = 200 uri = /crucible/0/regions/cd93eee3-962e-4ad5-8bb4-b5ae88b1c200/snapshots/57d65ce1-68ad-4c8f-a7de-4e9f656098d9/run