Max level shown:
12026-01-21T18:37:02.037ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::14]:32345 remote_addr = [fd00:1122:3344:101::b]:39768
22026-01-21T18:37:02.037ZINFOcrucible-agent (datafile): region 0a48e4d0-a6b7-4668-84cc-7005aef35902 state: Requested
32026-01-21T18:37:02.037ZINFOcrucible-agent (dropshot): request completed latency_us = 563 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:39768 req_id = d8b25b32-fe88-4ff0-96b3-7837fcf6c930 response_code = 200 uri = /crucible/0/regions
42026-01-21T18:37:02.037ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
52026-01-21T18:37:02.046ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_4b88dfe0-3e99-432f-b25f-ed49224188d6/crucible/regions/0a48e4d0-a6b7-4668-84cc-7005aef35902
62026-01-21T18:37:02.046ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_4b88dfe0-3e99-432f-b25f-ed49224188d6/crucible/regions/0a48e4d0-a6b7-4668-84cc-7005aef35902
72026-01-21T18:37:02.099ZINFOcrucible-agent (worker): creating region Region { id: RegionId("0a48e4d0-a6b7-4668-84cc-7005aef35902"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/0a48e4d0-a6b7-4668-84cc-7005aef35902" region = 0a48e4d0-a6b7-4668-84cc-7005aef35902
82026-01-21T18:37:02.099ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "0a48e4d0-a6b7-4668-84cc-7005aef35902" "--data" "/data/regions/0a48e4d0-a6b7-4668-84cc-7005aef35902" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 0a48e4d0-a6b7-4668-84cc-7005aef35902
92026-01-21T18:37:02.216ZINFOcrucible-agent (worker): region files created ok region = 0a48e4d0-a6b7-4668-84cc-7005aef35902
102026-01-21T18:37:02.216ZINFOcrucible-agent (datafile): region 0a48e4d0-a6b7-4668-84cc-7005aef35902 state: Requested -> Created
112026-01-21T18:37:02.217ZINFOcrucible-agent (worker): applying SMF actions post create...
122026-01-21T18:37:02.217ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-0a48e4d0-a6b7-4668-84cc-7005aef35902
132026-01-21T18:37:02.230ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-0a48e4d0-a6b7-4668-84cc-7005aef35902
142026-01-21T18:37:02.250ZINFOcrucible-agent (worker): creating config property group
152026-01-21T18:37:02.250ZINFOcrucible-agent (dropshot): request completed latency_us = 90 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:39768 req_id = 94209b08-a799-44a1-b623-408ff3b3f9f4 response_code = 200 uri = /crucible/0/regions
162026-01-21T18:37:02.253ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-0a48e4d0-a6b7-4668-84cc-7005aef35902
172026-01-21T18:37:02.254ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/0a48e4d0-a6b7-4668-84cc-7005aef35902
182026-01-21T18:37:02.254ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
192026-01-21T18:37:02.254ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::14
202026-01-21T18:37:02.254ZINFOcrucible-agent (worker): commit
212026-01-21T18:37:02.259ZINFOcrucible-agent (worker): ok!
222026-01-21T18:37:02.286ZINFOcrucible-agent (worker): SMF ok!
232026-01-21T18:37:03.408ZINFOcrucible-agent (dropshot): request completed latency_us = 75 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:39768 req_id = 141458f5-00ce-4367-a5e9-0121c0afc6da response_code = 200 uri = /crucible/0/regions/fd45b695-da3e-4fb8-a739-4611ba35b99b
242026-01-21T18:37:03.414ZINFOcrucible-agent (datafile): path is "/data/regions/fd45b695-da3e-4fb8-a739-4611ba35b99b"
252026-01-21T18:37:03.421ZINFOcrucible-agent (datafile): dataset is oxp_4b88dfe0-3e99-432f-b25f-ed49224188d6/crucible/regions/fd45b695-da3e-4fb8-a739-4611ba35b99b
262026-01-21T18:37:03.427ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_4b88dfe0-3e99-432f-b25f-ed49224188d6/crucible/regions/fd45b695-da3e-4fb8-a739-4611ba35b99b@8de5a7c1-b81b-4f10-b189-5254ed97ed60
272026-01-21T18:37:03.427ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_4b88dfe0-3e99-432f-b25f-ed49224188d6/crucible/regions/fd45b695-da3e-4fb8-a739-4611ba35b99b", "8de5a7c1-b81b-4f10-b189-5254ed97ed60"]
282026-01-21T18:37:03.434ZINFOcrucible-agent (dropshot): request completed latency_us = 20113 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:39768 req_id = b6652fbd-190f-4918-9adf-8d83486811e1 response_code = 200 uri = /crucible/0/regions/fd45b695-da3e-4fb8-a739-4611ba35b99b/snapshots/8de5a7c1-b81b-4f10-b189-5254ed97ed60
292026-01-21T18:37:03.442ZINFOcrucible-agent (datafile): path is "/data/regions/fd45b695-da3e-4fb8-a739-4611ba35b99b"
302026-01-21T18:37:03.448ZINFOcrucible-agent (datafile): dataset is oxp_4b88dfe0-3e99-432f-b25f-ed49224188d6/crucible/regions/fd45b695-da3e-4fb8-a739-4611ba35b99b
312026-01-21T18:37:03.455ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_4b88dfe0-3e99-432f-b25f-ed49224188d6/crucible/regions/fd45b695-da3e-4fb8-a739-4611ba35b99b@8de5a7c1-b81b-4f10-b189-5254ed97ed60
322026-01-21T18:37:03.455ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_4b88dfe0-3e99-432f-b25f-ed49224188d6/crucible/regions/fd45b695-da3e-4fb8-a739-4611ba35b99b", "8de5a7c1-b81b-4f10-b189-5254ed97ed60"]
332026-01-21T18:37:03.461ZINFOcrucible-agent (datafile): requesting running snapshot fd45b695-da3e-4fb8-a739-4611ba35b99b-8de5a7c1-b81b-4f10-b189-5254ed97ed60 state: Requested
342026-01-21T18:37:03.462ZINFOcrucible-agent (dropshot): request completed latency_us = 19540 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:39768 req_id = e505a9e7-a1ab-4ae3-b4ea-fe630fc2fd13 response_code = 200 uri = /crucible/0/regions/fd45b695-da3e-4fb8-a739-4611ba35b99b/snapshots/8de5a7c1-b81b-4f10-b189-5254ed97ed60/run
352026-01-21T18:37:03.462ZINFOcrucible-agent (worker): applying SMF actions for region fd45b695-da3e-4fb8-a739-4611ba35b99b running snapshot 8de5a7c1-b81b-4f10-b189-5254ed97ed60 (state Requested)...
362026-01-21T18:37:03.466ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-fd45b695-da3e-4fb8-a739-4611ba35b99b-8de5a7c1-b81b-4f10-b189-5254ed97ed60
372026-01-21T18:37:03.477ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-fd45b695-da3e-4fb8-a739-4611ba35b99b-8de5a7c1-b81b-4f10-b189-5254ed97ed60
382026-01-21T18:37:03.486ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-fd45b695-da3e-4fb8-a739-4611ba35b99b-8de5a7c1-b81b-4f10-b189-5254ed97ed60
392026-01-21T18:37:03.487ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/fd45b695-da3e-4fb8-a739-4611ba35b99b/.zfs/snapshot/8de5a7c1-b81b-4f10-b189-5254ed97ed60
402026-01-21T18:37:03.487ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19002
412026-01-21T18:37:03.487ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
422026-01-21T18:37:03.487ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::14
432026-01-21T18:37:03.487ZINFOcrucible-agent (worker): commit
442026-01-21T18:37:03.491ZINFOcrucible-agent (worker): ok!
452026-01-21T18:37:03.495ZINFOcrucible-agent (worker): SMF ok!
462026-01-21T18:37:03.496ZINFOcrucible-agent (datafile): region fd45b695-da3e-4fb8-a739-4611ba35b99b running snapshot 8de5a7c1-b81b-4f10-b189-5254ed97ed60 state: Requested -> Created
472026-01-21T18:37:03.783ZINFOcrucible-agent (datafile): path is "/data/regions/fd45b695-da3e-4fb8-a739-4611ba35b99b"
482026-01-21T18:37:03.790ZINFOcrucible-agent (datafile): dataset is oxp_4b88dfe0-3e99-432f-b25f-ed49224188d6/crucible/regions/fd45b695-da3e-4fb8-a739-4611ba35b99b
492026-01-21T18:37:03.795ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_4b88dfe0-3e99-432f-b25f-ed49224188d6/crucible/regions/fd45b695-da3e-4fb8-a739-4611ba35b99b@8de5a7c1-b81b-4f10-b189-5254ed97ed60
502026-01-21T18:37:03.795ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_4b88dfe0-3e99-432f-b25f-ed49224188d6/crucible/regions/fd45b695-da3e-4fb8-a739-4611ba35b99b", "8de5a7c1-b81b-4f10-b189-5254ed97ed60"]
512026-01-21T18:37:03.800ZINFOcrucible-agent (dropshot): request completed latency_us = 16821 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:39768 req_id = 7d25eae0-1fba-4f80-a50e-771d0a40dab8 response_code = 200 uri = /crucible/0/regions/fd45b695-da3e-4fb8-a739-4611ba35b99b/snapshots/8de5a7c1-b81b-4f10-b189-5254ed97ed60/run