Max level shown:
12026-09-04T23:15:42.209ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::15]:32345 remote_addr = [fd00:1122:3344:101::c]:40989
22026-09-04T23:15:42.244ZINFOcrucible-agent (datafile): region b6a7e2b9-25f9-4e8a-8477-9e442e950a65 state: Requested
32026-09-04T23:15:42.249ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
42026-09-04T23:15:42.253ZINFOcrucible-agent (dropshot): request completed latency_us = 16667 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:40989 req_id = 4caec815-b6d8-4344-baaf-2f3e54ebdc34 response_code = 200 uri = /crucible/0/regions
52026-09-04T23:15:42.259ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_8955476c-f2fd-4440-924f-2face196a612/crucible/regions/b6a7e2b9-25f9-4e8a-8477-9e442e950a65
62026-09-04T23:15:42.259ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_8955476c-f2fd-4440-924f-2face196a612/crucible/regions/b6a7e2b9-25f9-4e8a-8477-9e442e950a65
72026-09-04T23:15:42.302ZINFOcrucible-agent (worker): creating region Region { id: RegionId("b6a7e2b9-25f9-4e8a-8477-9e442e950a65"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/b6a7e2b9-25f9-4e8a-8477-9e442e950a65" region = b6a7e2b9-25f9-4e8a-8477-9e442e950a65
82026-09-04T23:15:42.304ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "b6a7e2b9-25f9-4e8a-8477-9e442e950a65" "--data" "/data/regions/b6a7e2b9-25f9-4e8a-8477-9e442e950a65" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = b6a7e2b9-25f9-4e8a-8477-9e442e950a65
92026-09-04T23:15:42.392ZINFOcrucible-agent (dropshot): request completed latency_us = 63 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:40989 req_id = cfb0ae0c-9d83-4ac4-b63f-ed82bed5729b response_code = 200 uri = /crucible/0/regions
102026-09-04T23:15:42.455ZINFOcrucible-agent (worker): region files created ok region = b6a7e2b9-25f9-4e8a-8477-9e442e950a65
112026-09-04T23:15:42.459ZINFOcrucible-agent (datafile): region b6a7e2b9-25f9-4e8a-8477-9e442e950a65 state: Requested -> Created
122026-09-04T23:15:42.460ZINFOcrucible-agent (worker): applying SMF actions post create...
132026-09-04T23:15:42.462ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-b6a7e2b9-25f9-4e8a-8477-9e442e950a65
142026-09-04T23:15:42.469ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-b6a7e2b9-25f9-4e8a-8477-9e442e950a65
152026-09-04T23:15:42.477ZINFOcrucible-agent (worker): creating config property group
162026-09-04T23:15:42.479ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-b6a7e2b9-25f9-4e8a-8477-9e442e950a65
172026-09-04T23:15:42.479ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/b6a7e2b9-25f9-4e8a-8477-9e442e950a65
182026-09-04T23:15:42.480ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
192026-09-04T23:15:42.480ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::15
202026-09-04T23:15:42.480ZINFOcrucible-agent (worker): commit
212026-09-04T23:15:42.482ZINFOcrucible-agent (worker): ok!
222026-09-04T23:15:42.484ZINFOcrucible-agent (worker): SMF ok!
232026-09-04T23:15:42.865ZINFOcrucible-agent (dropshot): request completed latency_us = 68 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:40989 req_id = 2167ca72-d628-4814-a08a-339e804c20fc response_code = 200 uri = /crucible/0/regions
242026-09-04T23:26:52.187ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::15]:32345 remote_addr = [fd00:1122:3344:101::c]:58576
252026-09-04T23:26:52.187ZINFOcrucible-agent (dropshot): request completed latency_us = 57 local_addr = [fd00:1122:3344:101::15]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:58576 req_id = a3ef4464-b712-41f4-aa04-937bca84887f response_code = 200 uri = /crucible/0/regions/b6a7e2b9-25f9-4e8a-8477-9e442e950a65
262026-09-04T23:26:52.191ZINFOcrucible-agent (datafile): path is "/data/regions/b6a7e2b9-25f9-4e8a-8477-9e442e950a65"
272026-09-04T23:26:52.197ZINFOcrucible-agent (datafile): dataset is oxp_8955476c-f2fd-4440-924f-2face196a612/crucible/regions/b6a7e2b9-25f9-4e8a-8477-9e442e950a65
282026-09-04T23:26:52.204ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_8955476c-f2fd-4440-924f-2face196a612/crucible/regions/b6a7e2b9-25f9-4e8a-8477-9e442e950a65@a39726d7-daa5-49ea-a1ad-2b8262d21461
292026-09-04T23:26:52.204ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_8955476c-f2fd-4440-924f-2face196a612/crucible/regions/b6a7e2b9-25f9-4e8a-8477-9e442e950a65", "a39726d7-daa5-49ea-a1ad-2b8262d21461"]
302026-09-04T23:26:52.216ZINFOcrucible-agent (dropshot): request completed latency_us = 25313 local_addr = [fd00:1122:3344:101::15]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:58576 req_id = fa6e5c23-a6d6-4b5b-bf38-798d45e86209 response_code = 200 uri = /crucible/0/regions/b6a7e2b9-25f9-4e8a-8477-9e442e950a65/snapshots/a39726d7-daa5-49ea-a1ad-2b8262d21461
312026-09-04T23:26:52.220ZINFOcrucible-agent (datafile): path is "/data/regions/b6a7e2b9-25f9-4e8a-8477-9e442e950a65"
322026-09-04T23:26:52.225ZINFOcrucible-agent (datafile): dataset is oxp_8955476c-f2fd-4440-924f-2face196a612/crucible/regions/b6a7e2b9-25f9-4e8a-8477-9e442e950a65
332026-09-04T23:26:52.231ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_8955476c-f2fd-4440-924f-2face196a612/crucible/regions/b6a7e2b9-25f9-4e8a-8477-9e442e950a65@a39726d7-daa5-49ea-a1ad-2b8262d21461
342026-09-04T23:26:52.231ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_8955476c-f2fd-4440-924f-2face196a612/crucible/regions/b6a7e2b9-25f9-4e8a-8477-9e442e950a65", "a39726d7-daa5-49ea-a1ad-2b8262d21461"]
352026-09-04T23:26:52.237ZINFOcrucible-agent (datafile): requesting running snapshot b6a7e2b9-25f9-4e8a-8477-9e442e950a65-a39726d7-daa5-49ea-a1ad-2b8262d21461 state: Requested
362026-09-04T23:26:52.242ZINFOcrucible-agent (dropshot): request completed latency_us = 21893 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:58576 req_id = 5d39cd4b-2183-4820-9b6b-707721a7f602 response_code = 200 uri = /crucible/0/regions/b6a7e2b9-25f9-4e8a-8477-9e442e950a65/snapshots/a39726d7-daa5-49ea-a1ad-2b8262d21461/run
372026-09-04T23:26:52.242ZINFOcrucible-agent (worker): applying SMF actions for region b6a7e2b9-25f9-4e8a-8477-9e442e950a65 running snapshot a39726d7-daa5-49ea-a1ad-2b8262d21461 (state Requested)...
382026-09-04T23:26:52.248ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-b6a7e2b9-25f9-4e8a-8477-9e442e950a65-a39726d7-daa5-49ea-a1ad-2b8262d21461
392026-09-04T23:26:52.251ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-b6a7e2b9-25f9-4e8a-8477-9e442e950a65-a39726d7-daa5-49ea-a1ad-2b8262d21461
402026-09-04T23:26:52.258ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-b6a7e2b9-25f9-4e8a-8477-9e442e950a65-a39726d7-daa5-49ea-a1ad-2b8262d21461
412026-09-04T23:26:52.259ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/b6a7e2b9-25f9-4e8a-8477-9e442e950a65/.zfs/snapshot/a39726d7-daa5-49ea-a1ad-2b8262d21461
422026-09-04T23:26:52.259ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
432026-09-04T23:26:52.259ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
442026-09-04T23:26:52.259ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::15
452026-09-04T23:26:52.259ZINFOcrucible-agent (worker): commit
462026-09-04T23:26:52.260ZINFOcrucible-agent (worker): ok!
472026-09-04T23:26:52.263ZINFOcrucible-agent (worker): SMF ok!
482026-09-04T23:26:52.263ZINFOcrucible-agent (datafile): region b6a7e2b9-25f9-4e8a-8477-9e442e950a65 running snapshot a39726d7-daa5-49ea-a1ad-2b8262d21461 state: Requested -> Created
492026-09-04T23:26:52.466ZINFOcrucible-agent (datafile): path is "/data/regions/b6a7e2b9-25f9-4e8a-8477-9e442e950a65"
502026-09-04T23:26:52.473ZINFOcrucible-agent (datafile): dataset is oxp_8955476c-f2fd-4440-924f-2face196a612/crucible/regions/b6a7e2b9-25f9-4e8a-8477-9e442e950a65
512026-09-04T23:26:52.478ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_8955476c-f2fd-4440-924f-2face196a612/crucible/regions/b6a7e2b9-25f9-4e8a-8477-9e442e950a65@a39726d7-daa5-49ea-a1ad-2b8262d21461
522026-09-04T23:26:52.478ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_8955476c-f2fd-4440-924f-2face196a612/crucible/regions/b6a7e2b9-25f9-4e8a-8477-9e442e950a65", "a39726d7-daa5-49ea-a1ad-2b8262d21461"]
532026-09-04T23:26:52.482ZINFOcrucible-agent (dropshot): request completed latency_us = 15807 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:58576 req_id = d8ac1bd3-393d-439a-b4a6-46605f92660f response_code = 200 uri = /crucible/0/regions/b6a7e2b9-25f9-4e8a-8477-9e442e950a65/snapshots/a39726d7-daa5-49ea-a1ad-2b8262d21461/run