Max level shown:
12026-01-12T18:05:33.343ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::17]:32345 remote_addr = [fd00:1122:3344:101::a]:49433
22026-01-12T18:05:33.343ZINFOcrucible-agent (datafile): region 6f20aa56-43ab-4a14-91eb-527fd67990d3 state: Requested
32026-01-12T18:05:33.344ZINFOcrucible-agent (dropshot): request completed latency_us = 1007 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:49433 req_id = 1fc62817-a359-4dd6-b1ee-ae011c80c447 response_code = 200 uri = /crucible/0/regions
42026-01-12T18:05:33.344ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
52026-01-12T18:05:33.352ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_84f9bc19-d3e3-412a-902c-8868a6ef72b7/crucible/regions/6f20aa56-43ab-4a14-91eb-527fd67990d3
62026-01-12T18:05:33.352ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_84f9bc19-d3e3-412a-902c-8868a6ef72b7/crucible/regions/6f20aa56-43ab-4a14-91eb-527fd67990d3
72026-01-12T18:05:33.411ZINFOcrucible-agent (worker): creating region Region { id: RegionId("6f20aa56-43ab-4a14-91eb-527fd67990d3"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/6f20aa56-43ab-4a14-91eb-527fd67990d3" region = 6f20aa56-43ab-4a14-91eb-527fd67990d3
82026-01-12T18:05:33.411ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "6f20aa56-43ab-4a14-91eb-527fd67990d3" "--data" "/data/regions/6f20aa56-43ab-4a14-91eb-527fd67990d3" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 6f20aa56-43ab-4a14-91eb-527fd67990d3
92026-01-12T18:05:33.519ZINFOcrucible-agent (dropshot): request completed latency_us = 59 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:49433 req_id = a49bacb1-a7f3-48e0-9abe-ab3ab7f8ff46 response_code = 200 uri = /crucible/0/regions
102026-01-12T18:05:33.549ZINFOcrucible-agent (worker): region files created ok region = 6f20aa56-43ab-4a14-91eb-527fd67990d3
112026-01-12T18:05:33.549ZINFOcrucible-agent (datafile): region 6f20aa56-43ab-4a14-91eb-527fd67990d3 state: Requested -> Created
122026-01-12T18:05:33.549ZINFOcrucible-agent (worker): applying SMF actions post create...
132026-01-12T18:05:33.550ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-6f20aa56-43ab-4a14-91eb-527fd67990d3
142026-01-12T18:05:33.562ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-6f20aa56-43ab-4a14-91eb-527fd67990d3
152026-01-12T18:05:33.587ZINFOcrucible-agent (worker): creating config property group
162026-01-12T18:05:33.592ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-6f20aa56-43ab-4a14-91eb-527fd67990d3
172026-01-12T18:05:33.592ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/6f20aa56-43ab-4a14-91eb-527fd67990d3
182026-01-12T18:05:33.592ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
192026-01-12T18:05:33.592ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::17
202026-01-12T18:05:33.592ZINFOcrucible-agent (worker): commit
212026-01-12T18:05:33.597ZINFOcrucible-agent (worker): ok!
222026-01-12T18:05:33.624ZINFOcrucible-agent (worker): SMF ok!
232026-01-12T18:05:34.178ZINFOcrucible-agent (dropshot): request completed latency_us = 56 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:49433 req_id = c0483708-7bbf-421d-a939-9ab212982d6c response_code = 200 uri = /crucible/0/regions
242026-01-12T18:05:35.545ZINFOcrucible-agent (dropshot): request completed latency_us = 78 local_addr = [fd00:1122:3344:101::17]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:49433 req_id = 998b96b6-79e4-4833-920c-44fb0c0c315a response_code = 200 uri = /crucible/0/regions/924cef1f-4c13-4b2f-b71b-ab7197116334
252026-01-12T18:05:35.548ZINFOcrucible-agent (datafile): path is "/data/regions/924cef1f-4c13-4b2f-b71b-ab7197116334"
262026-01-12T18:05:35.554ZINFOcrucible-agent (datafile): dataset is oxp_84f9bc19-d3e3-412a-902c-8868a6ef72b7/crucible/regions/924cef1f-4c13-4b2f-b71b-ab7197116334
272026-01-12T18:05:35.561ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_84f9bc19-d3e3-412a-902c-8868a6ef72b7/crucible/regions/924cef1f-4c13-4b2f-b71b-ab7197116334@dbc51ac0-e224-4c67-83a2-e09166ccd5d5
282026-01-12T18:05:35.561ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_84f9bc19-d3e3-412a-902c-8868a6ef72b7/crucible/regions/924cef1f-4c13-4b2f-b71b-ab7197116334", "dbc51ac0-e224-4c67-83a2-e09166ccd5d5"]
292026-01-12T18:05:35.569ZINFOcrucible-agent (dropshot): request completed latency_us = 20493 local_addr = [fd00:1122:3344:101::17]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:49433 req_id = d807d932-afcd-4375-b56b-01400bf78bf8 response_code = 200 uri = /crucible/0/regions/924cef1f-4c13-4b2f-b71b-ab7197116334/snapshots/dbc51ac0-e224-4c67-83a2-e09166ccd5d5
302026-01-12T18:05:35.573ZINFOcrucible-agent (datafile): path is "/data/regions/924cef1f-4c13-4b2f-b71b-ab7197116334"
312026-01-12T18:05:35.579ZINFOcrucible-agent (datafile): dataset is oxp_84f9bc19-d3e3-412a-902c-8868a6ef72b7/crucible/regions/924cef1f-4c13-4b2f-b71b-ab7197116334
322026-01-12T18:05:35.585ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_84f9bc19-d3e3-412a-902c-8868a6ef72b7/crucible/regions/924cef1f-4c13-4b2f-b71b-ab7197116334@dbc51ac0-e224-4c67-83a2-e09166ccd5d5
332026-01-12T18:05:35.585ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_84f9bc19-d3e3-412a-902c-8868a6ef72b7/crucible/regions/924cef1f-4c13-4b2f-b71b-ab7197116334", "dbc51ac0-e224-4c67-83a2-e09166ccd5d5"]
342026-01-12T18:05:35.592ZINFOcrucible-agent (datafile): requesting running snapshot 924cef1f-4c13-4b2f-b71b-ab7197116334-dbc51ac0-e224-4c67-83a2-e09166ccd5d5 state: Requested
352026-01-12T18:05:35.593ZINFOcrucible-agent (dropshot): request completed latency_us = 20003 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:49433 req_id = 3dcd607c-0141-432e-ba90-83b13cb8e415 response_code = 200 uri = /crucible/0/regions/924cef1f-4c13-4b2f-b71b-ab7197116334/snapshots/dbc51ac0-e224-4c67-83a2-e09166ccd5d5/run
362026-01-12T18:05:35.593ZINFOcrucible-agent (worker): applying SMF actions for region 924cef1f-4c13-4b2f-b71b-ab7197116334 running snapshot dbc51ac0-e224-4c67-83a2-e09166ccd5d5 (state Requested)...
372026-01-12T18:05:35.598ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-924cef1f-4c13-4b2f-b71b-ab7197116334-dbc51ac0-e224-4c67-83a2-e09166ccd5d5
382026-01-12T18:05:35.608ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-924cef1f-4c13-4b2f-b71b-ab7197116334-dbc51ac0-e224-4c67-83a2-e09166ccd5d5
392026-01-12T18:05:35.618ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-924cef1f-4c13-4b2f-b71b-ab7197116334-dbc51ac0-e224-4c67-83a2-e09166ccd5d5
402026-01-12T18:05:35.618ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/924cef1f-4c13-4b2f-b71b-ab7197116334/.zfs/snapshot/dbc51ac0-e224-4c67-83a2-e09166ccd5d5
412026-01-12T18:05:35.618ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19002
422026-01-12T18:05:35.618ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
432026-01-12T18:05:35.618ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::17
442026-01-12T18:05:35.618ZINFOcrucible-agent (worker): commit
452026-01-12T18:05:35.622ZINFOcrucible-agent (worker): ok!
462026-01-12T18:05:35.627ZINFOcrucible-agent (worker): SMF ok!
472026-01-12T18:05:35.627ZINFOcrucible-agent (datafile): region 924cef1f-4c13-4b2f-b71b-ab7197116334 running snapshot dbc51ac0-e224-4c67-83a2-e09166ccd5d5 state: Requested -> Created
482026-01-12T18:05:35.728ZINFOcrucible-agent (datafile): path is "/data/regions/924cef1f-4c13-4b2f-b71b-ab7197116334"
492026-01-12T18:05:35.734ZINFOcrucible-agent (datafile): dataset is oxp_84f9bc19-d3e3-412a-902c-8868a6ef72b7/crucible/regions/924cef1f-4c13-4b2f-b71b-ab7197116334
502026-01-12T18:05:35.739ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_84f9bc19-d3e3-412a-902c-8868a6ef72b7/crucible/regions/924cef1f-4c13-4b2f-b71b-ab7197116334@dbc51ac0-e224-4c67-83a2-e09166ccd5d5
512026-01-12T18:05:35.739ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_84f9bc19-d3e3-412a-902c-8868a6ef72b7/crucible/regions/924cef1f-4c13-4b2f-b71b-ab7197116334", "dbc51ac0-e224-4c67-83a2-e09166ccd5d5"]
522026-01-12T18:05:35.744ZINFOcrucible-agent (dropshot): request completed latency_us = 16600 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:49433 req_id = c4f781c3-228a-4f10-878b-86f34ae6ea06 response_code = 200 uri = /crucible/0/regions/924cef1f-4c13-4b2f-b71b-ab7197116334/snapshots/dbc51ac0-e224-4c67-83a2-e09166ccd5d5/run