Max level shown:
12026-09-11T01:10:47.163ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::12]:32345 remote_addr = [fd00:1122:3344:101::b]:60526
22026-09-11T01:10:47.163ZINFOcrucible-agent (datafile): region 603107cc-8c99-4fb1-9a12-1d8997f068b9 state: Requested
32026-09-11T01:10:47.164ZINFOcrucible-agent (dropshot): request completed latency_us = 870 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:60526 req_id = 1221988c-7bed-43dc-ad71-6b78ebae208e response_code = 200 uri = /crucible/0/regions
42026-09-11T01:10:47.164ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
52026-09-11T01:10:47.175ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_c62f275c-2a61-458a-8802-a8ca31e0fb86/crucible/regions/603107cc-8c99-4fb1-9a12-1d8997f068b9
62026-09-11T01:10:47.175ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_c62f275c-2a61-458a-8802-a8ca31e0fb86/crucible/regions/603107cc-8c99-4fb1-9a12-1d8997f068b9
72026-09-11T01:10:47.267ZINFOcrucible-agent (worker): creating region Region { id: RegionId("603107cc-8c99-4fb1-9a12-1d8997f068b9"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/603107cc-8c99-4fb1-9a12-1d8997f068b9" region = 603107cc-8c99-4fb1-9a12-1d8997f068b9
82026-09-11T01:10:47.267ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "603107cc-8c99-4fb1-9a12-1d8997f068b9" "--data" "/data/regions/603107cc-8c99-4fb1-9a12-1d8997f068b9" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 603107cc-8c99-4fb1-9a12-1d8997f068b9
92026-09-11T01:10:47.299ZINFOcrucible-agent (dropshot): request completed latency_us = 61 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:60526 req_id = ba986a39-e118-4e12-a27d-2a398a9ad6e3 response_code = 200 uri = /crucible/0/regions
102026-09-11T01:10:47.351ZINFOcrucible-agent (worker): region files created ok region = 603107cc-8c99-4fb1-9a12-1d8997f068b9
112026-09-11T01:10:47.351ZINFOcrucible-agent (datafile): region 603107cc-8c99-4fb1-9a12-1d8997f068b9 state: Requested -> Created
122026-09-11T01:10:47.351ZINFOcrucible-agent (worker): applying SMF actions post create...
132026-09-11T01:10:47.352ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-603107cc-8c99-4fb1-9a12-1d8997f068b9
142026-09-11T01:10:47.356ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-603107cc-8c99-4fb1-9a12-1d8997f068b9
152026-09-11T01:10:47.373ZINFOcrucible-agent (worker): creating config property group
162026-09-11T01:10:47.378ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-603107cc-8c99-4fb1-9a12-1d8997f068b9
172026-09-11T01:10:47.378ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/603107cc-8c99-4fb1-9a12-1d8997f068b9
182026-09-11T01:10:47.378ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
192026-09-11T01:10:47.378ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::12
202026-09-11T01:10:47.378ZINFOcrucible-agent (worker): commit
212026-09-11T01:10:47.382ZINFOcrucible-agent (worker): ok!
222026-09-11T01:10:47.388ZINFOcrucible-agent (worker): SMF ok!
232026-09-11T01:10:47.633ZINFOcrucible-agent (dropshot): request completed latency_us = 77 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:60526 req_id = d48fa5e9-48ce-4d2a-a226-bcd0624ad5a1 response_code = 200 uri = /crucible/0/regions
242026-09-11T01:10:49.314ZINFOcrucible-agent (dropshot): request completed latency_us = 80 local_addr = [fd00:1122:3344:101::12]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:60526 req_id = 2f059d19-fa43-4af8-af24-5a4b68775fa0 response_code = 200 uri = /crucible/0/regions/819d75f1-8be7-4b0a-9b51-b54650e2e849
252026-09-11T01:10:49.318ZINFOcrucible-agent (datafile): path is "/data/regions/819d75f1-8be7-4b0a-9b51-b54650e2e849"
262026-09-11T01:10:49.325ZINFOcrucible-agent (datafile): dataset is oxp_c62f275c-2a61-458a-8802-a8ca31e0fb86/crucible/regions/819d75f1-8be7-4b0a-9b51-b54650e2e849
272026-09-11T01:10:49.331ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_c62f275c-2a61-458a-8802-a8ca31e0fb86/crucible/regions/819d75f1-8be7-4b0a-9b51-b54650e2e849@324677d9-12d0-45ca-86f0-f5392b4e7009
282026-09-11T01:10:49.331ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_c62f275c-2a61-458a-8802-a8ca31e0fb86/crucible/regions/819d75f1-8be7-4b0a-9b51-b54650e2e849", "324677d9-12d0-45ca-86f0-f5392b4e7009"]
292026-09-11T01:10:49.341ZINFOcrucible-agent (dropshot): request completed latency_us = 22943 local_addr = [fd00:1122:3344:101::12]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:60526 req_id = 9905b310-3d70-4528-9a15-fea444229fee response_code = 200 uri = /crucible/0/regions/819d75f1-8be7-4b0a-9b51-b54650e2e849/snapshots/324677d9-12d0-45ca-86f0-f5392b4e7009
302026-09-11T01:10:49.345ZINFOcrucible-agent (datafile): path is "/data/regions/819d75f1-8be7-4b0a-9b51-b54650e2e849"
312026-09-11T01:10:49.352ZINFOcrucible-agent (datafile): dataset is oxp_c62f275c-2a61-458a-8802-a8ca31e0fb86/crucible/regions/819d75f1-8be7-4b0a-9b51-b54650e2e849
322026-09-11T01:10:49.358ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_c62f275c-2a61-458a-8802-a8ca31e0fb86/crucible/regions/819d75f1-8be7-4b0a-9b51-b54650e2e849@324677d9-12d0-45ca-86f0-f5392b4e7009
332026-09-11T01:10:49.358ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_c62f275c-2a61-458a-8802-a8ca31e0fb86/crucible/regions/819d75f1-8be7-4b0a-9b51-b54650e2e849", "324677d9-12d0-45ca-86f0-f5392b4e7009"]
342026-09-11T01:10:49.365ZINFOcrucible-agent (datafile): requesting running snapshot 819d75f1-8be7-4b0a-9b51-b54650e2e849-324677d9-12d0-45ca-86f0-f5392b4e7009 state: Requested
352026-09-11T01:10:49.370ZINFOcrucible-agent (dropshot): request completed latency_us = 24953 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:60526 req_id = 63e6efc6-b5b9-4ac6-af24-b482c55afe9a response_code = 200 uri = /crucible/0/regions/819d75f1-8be7-4b0a-9b51-b54650e2e849/snapshots/324677d9-12d0-45ca-86f0-f5392b4e7009/run
362026-09-11T01:10:49.370ZINFOcrucible-agent (worker): applying SMF actions for region 819d75f1-8be7-4b0a-9b51-b54650e2e849 running snapshot 324677d9-12d0-45ca-86f0-f5392b4e7009 (state Requested)...
372026-09-11T01:10:49.372ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-819d75f1-8be7-4b0a-9b51-b54650e2e849-324677d9-12d0-45ca-86f0-f5392b4e7009
382026-09-11T01:10:49.377ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-819d75f1-8be7-4b0a-9b51-b54650e2e849-324677d9-12d0-45ca-86f0-f5392b4e7009
392026-09-11T01:10:49.387ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-819d75f1-8be7-4b0a-9b51-b54650e2e849-324677d9-12d0-45ca-86f0-f5392b4e7009
402026-09-11T01:10:49.388ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/819d75f1-8be7-4b0a-9b51-b54650e2e849/.zfs/snapshot/324677d9-12d0-45ca-86f0-f5392b4e7009
412026-09-11T01:10:49.388ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19002
422026-09-11T01:10:49.388ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
432026-09-11T01:10:49.388ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::12
442026-09-11T01:10:49.388ZINFOcrucible-agent (worker): commit
452026-09-11T01:10:49.392ZINFOcrucible-agent (worker): ok!
462026-09-11T01:10:49.396ZINFOcrucible-agent (worker): SMF ok!
472026-09-11T01:10:49.396ZINFOcrucible-agent (datafile): region 819d75f1-8be7-4b0a-9b51-b54650e2e849 running snapshot 324677d9-12d0-45ca-86f0-f5392b4e7009 state: Requested -> Created
482026-09-11T01:10:49.671ZINFOcrucible-agent (datafile): path is "/data/regions/819d75f1-8be7-4b0a-9b51-b54650e2e849"
492026-09-11T01:10:49.678ZINFOcrucible-agent (datafile): dataset is oxp_c62f275c-2a61-458a-8802-a8ca31e0fb86/crucible/regions/819d75f1-8be7-4b0a-9b51-b54650e2e849
502026-09-11T01:10:49.685ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_c62f275c-2a61-458a-8802-a8ca31e0fb86/crucible/regions/819d75f1-8be7-4b0a-9b51-b54650e2e849@324677d9-12d0-45ca-86f0-f5392b4e7009
512026-09-11T01:10:49.685ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_c62f275c-2a61-458a-8802-a8ca31e0fb86/crucible/regions/819d75f1-8be7-4b0a-9b51-b54650e2e849", "324677d9-12d0-45ca-86f0-f5392b4e7009"]
522026-09-11T01:10:49.690ZINFOcrucible-agent (dropshot): request completed latency_us = 19294 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:60526 req_id = de71e1a5-73c5-48e4-9c93-92919546876a response_code = 200 uri = /crucible/0/regions/819d75f1-8be7-4b0a-9b51-b54650e2e849/snapshots/324677d9-12d0-45ca-86f0-f5392b4e7009/run