Max level shown:
12026-01-23T15:39:34.605ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::13]:32345 remote_addr = [fd00:1122:3344:101::b]:38140
22026-01-23T15:39:34.605ZINFOcrucible-agent (datafile): region 514be51a-ace7-43f6-9386-c081280497b0 state: Requested
32026-01-23T15:39:34.606ZINFOcrucible-agent (dropshot): request completed latency_us = 625 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:38140 req_id = d339c1de-a223-4b6c-a790-88b54e8dbf7b response_code = 200 uri = /crucible/0/regions
42026-01-23T15:39:34.606ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
52026-01-23T15:39:34.614ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_1ae6275c-f4fa-44c2-87de-ff050d749b24/crucible/regions/514be51a-ace7-43f6-9386-c081280497b0
62026-01-23T15:39:34.614ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_1ae6275c-f4fa-44c2-87de-ff050d749b24/crucible/regions/514be51a-ace7-43f6-9386-c081280497b0
72026-01-23T15:39:34.658ZINFOcrucible-agent (worker): creating region Region { id: RegionId("514be51a-ace7-43f6-9386-c081280497b0"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/514be51a-ace7-43f6-9386-c081280497b0" region = 514be51a-ace7-43f6-9386-c081280497b0
82026-01-23T15:39:34.658ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "514be51a-ace7-43f6-9386-c081280497b0" "--data" "/data/regions/514be51a-ace7-43f6-9386-c081280497b0" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 514be51a-ace7-43f6-9386-c081280497b0
92026-01-23T15:39:34.779ZINFOcrucible-agent (worker): region files created ok region = 514be51a-ace7-43f6-9386-c081280497b0
102026-01-23T15:39:34.779ZINFOcrucible-agent (datafile): region 514be51a-ace7-43f6-9386-c081280497b0 state: Requested -> Created
112026-01-23T15:39:34.780ZINFOcrucible-agent (worker): applying SMF actions post create...
122026-01-23T15:39:34.780ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-514be51a-ace7-43f6-9386-c081280497b0
132026-01-23T15:39:34.790ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-514be51a-ace7-43f6-9386-c081280497b0
142026-01-23T15:39:34.810ZINFOcrucible-agent (worker): creating config property group
152026-01-23T15:39:34.813ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-514be51a-ace7-43f6-9386-c081280497b0
162026-01-23T15:39:34.813ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/514be51a-ace7-43f6-9386-c081280497b0
172026-01-23T15:39:34.813ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
182026-01-23T15:39:34.813ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::13
192026-01-23T15:39:34.813ZINFOcrucible-agent (worker): commit
202026-01-23T15:39:34.816ZINFOcrucible-agent (worker): ok!
212026-01-23T15:39:34.831ZINFOcrucible-agent (worker): SMF ok!
222026-01-23T15:39:34.978ZINFOcrucible-agent (dropshot): request completed latency_us = 62 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:38140 req_id = 88d6bc02-aae5-4f0e-8a02-433ea3e50579 response_code = 200 uri = /crucible/0/regions
232026-01-23T15:39:36.453ZINFOcrucible-agent (dropshot): request completed latency_us = 67 local_addr = [fd00:1122:3344:101::13]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:38140 req_id = 6fdd4e46-9264-4e92-8637-d585f8b05523 response_code = 200 uri = /crucible/0/regions/7925bf7d-553a-4e82-a105-71a5a9c44aaa
242026-01-23T15:39:36.456ZINFOcrucible-agent (datafile): path is "/data/regions/7925bf7d-553a-4e82-a105-71a5a9c44aaa"
252026-01-23T15:39:36.463ZINFOcrucible-agent (datafile): dataset is oxp_1ae6275c-f4fa-44c2-87de-ff050d749b24/crucible/regions/7925bf7d-553a-4e82-a105-71a5a9c44aaa
262026-01-23T15:39:36.470ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_1ae6275c-f4fa-44c2-87de-ff050d749b24/crucible/regions/7925bf7d-553a-4e82-a105-71a5a9c44aaa@33e06d3d-f963-41b7-bc01-4cdd2bdad922
272026-01-23T15:39:36.470ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_1ae6275c-f4fa-44c2-87de-ff050d749b24/crucible/regions/7925bf7d-553a-4e82-a105-71a5a9c44aaa", "33e06d3d-f963-41b7-bc01-4cdd2bdad922"]
282026-01-23T15:39:36.478ZINFOcrucible-agent (dropshot): request completed latency_us = 21350 local_addr = [fd00:1122:3344:101::13]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:38140 req_id = a4376f71-a886-44bb-818c-e165e5c4ea24 response_code = 200 uri = /crucible/0/regions/7925bf7d-553a-4e82-a105-71a5a9c44aaa/snapshots/33e06d3d-f963-41b7-bc01-4cdd2bdad922
292026-01-23T15:39:36.481ZINFOcrucible-agent (datafile): path is "/data/regions/7925bf7d-553a-4e82-a105-71a5a9c44aaa"
302026-01-23T15:39:36.488ZINFOcrucible-agent (datafile): dataset is oxp_1ae6275c-f4fa-44c2-87de-ff050d749b24/crucible/regions/7925bf7d-553a-4e82-a105-71a5a9c44aaa
312026-01-23T15:39:36.495ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_1ae6275c-f4fa-44c2-87de-ff050d749b24/crucible/regions/7925bf7d-553a-4e82-a105-71a5a9c44aaa@33e06d3d-f963-41b7-bc01-4cdd2bdad922
322026-01-23T15:39:36.495ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_1ae6275c-f4fa-44c2-87de-ff050d749b24/crucible/regions/7925bf7d-553a-4e82-a105-71a5a9c44aaa", "33e06d3d-f963-41b7-bc01-4cdd2bdad922"]
332026-01-23T15:39:36.503ZINFOcrucible-agent (datafile): requesting running snapshot 7925bf7d-553a-4e82-a105-71a5a9c44aaa-33e06d3d-f963-41b7-bc01-4cdd2bdad922 state: Requested
342026-01-23T15:39:36.503ZINFOcrucible-agent (dropshot): request completed latency_us = 21337 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:38140 req_id = 1abce18d-43bd-41e6-89e4-ab80f9bafd54 response_code = 200 uri = /crucible/0/regions/7925bf7d-553a-4e82-a105-71a5a9c44aaa/snapshots/33e06d3d-f963-41b7-bc01-4cdd2bdad922/run
352026-01-23T15:39:36.503ZINFOcrucible-agent (worker): applying SMF actions for region 7925bf7d-553a-4e82-a105-71a5a9c44aaa running snapshot 33e06d3d-f963-41b7-bc01-4cdd2bdad922 (state Requested)...
362026-01-23T15:39:36.507ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-7925bf7d-553a-4e82-a105-71a5a9c44aaa-33e06d3d-f963-41b7-bc01-4cdd2bdad922
372026-01-23T15:39:36.517ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-7925bf7d-553a-4e82-a105-71a5a9c44aaa-33e06d3d-f963-41b7-bc01-4cdd2bdad922
382026-01-23T15:39:36.527ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-7925bf7d-553a-4e82-a105-71a5a9c44aaa-33e06d3d-f963-41b7-bc01-4cdd2bdad922
392026-01-23T15:39:36.527ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/7925bf7d-553a-4e82-a105-71a5a9c44aaa/.zfs/snapshot/33e06d3d-f963-41b7-bc01-4cdd2bdad922
402026-01-23T15:39:36.527ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19002
412026-01-23T15:39:36.527ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
422026-01-23T15:39:36.527ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::13
432026-01-23T15:39:36.527ZINFOcrucible-agent (worker): commit
442026-01-23T15:39:36.530ZINFOcrucible-agent (worker): ok!
452026-01-23T15:39:36.535ZINFOcrucible-agent (worker): SMF ok!
462026-01-23T15:39:36.535ZINFOcrucible-agent (datafile): region 7925bf7d-553a-4e82-a105-71a5a9c44aaa running snapshot 33e06d3d-f963-41b7-bc01-4cdd2bdad922 state: Requested -> Created
472026-01-23T15:39:36.857ZINFOcrucible-agent (datafile): path is "/data/regions/7925bf7d-553a-4e82-a105-71a5a9c44aaa"
482026-01-23T15:39:36.867ZINFOcrucible-agent (datafile): dataset is oxp_1ae6275c-f4fa-44c2-87de-ff050d749b24/crucible/regions/7925bf7d-553a-4e82-a105-71a5a9c44aaa
492026-01-23T15:39:36.878ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_1ae6275c-f4fa-44c2-87de-ff050d749b24/crucible/regions/7925bf7d-553a-4e82-a105-71a5a9c44aaa@33e06d3d-f963-41b7-bc01-4cdd2bdad922
502026-01-23T15:39:36.878ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_1ae6275c-f4fa-44c2-87de-ff050d749b24/crucible/regions/7925bf7d-553a-4e82-a105-71a5a9c44aaa", "33e06d3d-f963-41b7-bc01-4cdd2bdad922"]
512026-01-23T15:39:36.886ZINFOcrucible-agent (dropshot): request completed latency_us = 28904 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:38140 req_id = 0d911b35-4ae5-4497-8ca9-3ab6edf763df response_code = 200 uri = /crucible/0/regions/7925bf7d-553a-4e82-a105-71a5a9c44aaa/snapshots/33e06d3d-f963-41b7-bc01-4cdd2bdad922/run