Max level shown:
12026-01-24T01:05:08.238ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::17]:32345 remote_addr = [fd00:1122:3344:101::c]:42776
22026-01-24T01:05:08.238ZINFOcrucible-agent (datafile): region cf337f6b-eb3c-406e-9da1-52d150598644 state: Requested
32026-01-24T01:05:08.242ZINFOcrucible-agent (dropshot): request completed latency_us = 4647 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:42776 req_id = 8c77ad8b-313c-4033-8659-533074fd10fd response_code = 200 uri = /crucible/0/regions
42026-01-24T01:05:08.242ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
52026-01-24T01:05:08.250ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_ba0c4ed4-98e4-47b3-943a-950bafcd8977/crucible/regions/cf337f6b-eb3c-406e-9da1-52d150598644
62026-01-24T01:05:08.250ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_ba0c4ed4-98e4-47b3-943a-950bafcd8977/crucible/regions/cf337f6b-eb3c-406e-9da1-52d150598644
72026-01-24T01:05:08.399ZINFOcrucible-agent (worker): creating region Region { id: RegionId("cf337f6b-eb3c-406e-9da1-52d150598644"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/cf337f6b-eb3c-406e-9da1-52d150598644" region = cf337f6b-eb3c-406e-9da1-52d150598644
82026-01-24T01:05:08.399ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "cf337f6b-eb3c-406e-9da1-52d150598644" "--data" "/data/regions/cf337f6b-eb3c-406e-9da1-52d150598644" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = cf337f6b-eb3c-406e-9da1-52d150598644
92026-01-24T01:05:08.552ZINFOcrucible-agent (dropshot): request completed latency_us = 53 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:42776 req_id = 6925f217-421f-4f1c-bae2-0d4d799e6252 response_code = 200 uri = /crucible/0/regions
102026-01-24T01:05:08.781ZINFOcrucible-agent (worker): region files created ok region = cf337f6b-eb3c-406e-9da1-52d150598644
112026-01-24T01:05:08.781ZINFOcrucible-agent (datafile): region cf337f6b-eb3c-406e-9da1-52d150598644 state: Requested -> Created
122026-01-24T01:05:08.781ZINFOcrucible-agent (worker): applying SMF actions post create...
132026-01-24T01:05:08.807ZINFOcrucible-agent (dropshot): request completed latency_us = 45 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:42776 req_id = 9ddc02a3-d0af-4c04-91d9-91caeb1570b5 response_code = 200 uri = /crucible/0/regions
142026-01-24T01:05:08.814ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-cf337f6b-eb3c-406e-9da1-52d150598644
152026-01-24T01:05:08.851ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-cf337f6b-eb3c-406e-9da1-52d150598644
162026-01-24T01:05:08.920ZINFOcrucible-agent (worker): creating config property group
172026-01-24T01:05:08.925ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-cf337f6b-eb3c-406e-9da1-52d150598644
182026-01-24T01:05:08.925ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/cf337f6b-eb3c-406e-9da1-52d150598644
192026-01-24T01:05:08.925ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
202026-01-24T01:05:08.925ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::17
212026-01-24T01:05:08.925ZINFOcrucible-agent (worker): commit
222026-01-24T01:05:08.946ZINFOcrucible-agent (worker): ok!
232026-01-24T01:05:08.970ZINFOcrucible-agent (worker): SMF ok!
242026-01-24T01:05:11.511ZINFOcrucible-agent (dropshot): request completed latency_us = 77 local_addr = [fd00:1122:3344:101::17]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:42776 req_id = b24c2b89-6925-4038-ad0b-e755afbd9e68 response_code = 200 uri = /crucible/0/regions/b2bd26a5-ca46-48d7-9c85-82e88fbf0987
252026-01-24T01:05:11.514ZINFOcrucible-agent (datafile): path is "/data/regions/b2bd26a5-ca46-48d7-9c85-82e88fbf0987"
262026-01-24T01:05:11.521ZINFOcrucible-agent (datafile): dataset is oxp_ba0c4ed4-98e4-47b3-943a-950bafcd8977/crucible/regions/b2bd26a5-ca46-48d7-9c85-82e88fbf0987
272026-01-24T01:05:11.528ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_ba0c4ed4-98e4-47b3-943a-950bafcd8977/crucible/regions/b2bd26a5-ca46-48d7-9c85-82e88fbf0987@fa3dff89-d21d-4076-a16c-92032f16992c
282026-01-24T01:05:11.528ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_ba0c4ed4-98e4-47b3-943a-950bafcd8977/crucible/regions/b2bd26a5-ca46-48d7-9c85-82e88fbf0987", "fa3dff89-d21d-4076-a16c-92032f16992c"]
292026-01-24T01:05:11.537ZINFOcrucible-agent (dropshot): request completed latency_us = 23290 local_addr = [fd00:1122:3344:101::17]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:42776 req_id = fba771de-058f-4693-8ea4-ec4b344166eb response_code = 200 uri = /crucible/0/regions/b2bd26a5-ca46-48d7-9c85-82e88fbf0987/snapshots/fa3dff89-d21d-4076-a16c-92032f16992c
302026-01-24T01:05:11.541ZINFOcrucible-agent (datafile): path is "/data/regions/b2bd26a5-ca46-48d7-9c85-82e88fbf0987"
312026-01-24T01:05:11.547ZINFOcrucible-agent (datafile): dataset is oxp_ba0c4ed4-98e4-47b3-943a-950bafcd8977/crucible/regions/b2bd26a5-ca46-48d7-9c85-82e88fbf0987
322026-01-24T01:05:11.553ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_ba0c4ed4-98e4-47b3-943a-950bafcd8977/crucible/regions/b2bd26a5-ca46-48d7-9c85-82e88fbf0987@fa3dff89-d21d-4076-a16c-92032f16992c
332026-01-24T01:05:11.553ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_ba0c4ed4-98e4-47b3-943a-950bafcd8977/crucible/regions/b2bd26a5-ca46-48d7-9c85-82e88fbf0987", "fa3dff89-d21d-4076-a16c-92032f16992c"]
342026-01-24T01:05:11.560ZINFOcrucible-agent (datafile): requesting running snapshot b2bd26a5-ca46-48d7-9c85-82e88fbf0987-fa3dff89-d21d-4076-a16c-92032f16992c state: Requested
352026-01-24T01:05:11.560ZINFOcrucible-agent (dropshot): request completed latency_us = 18529 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:42776 req_id = bd75146a-303a-44ca-a8cf-0a973dd439e2 response_code = 200 uri = /crucible/0/regions/b2bd26a5-ca46-48d7-9c85-82e88fbf0987/snapshots/fa3dff89-d21d-4076-a16c-92032f16992c/run
362026-01-24T01:05:11.560ZINFOcrucible-agent (worker): applying SMF actions for region b2bd26a5-ca46-48d7-9c85-82e88fbf0987 running snapshot fa3dff89-d21d-4076-a16c-92032f16992c (state Requested)...
372026-01-24T01:05:11.564ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-b2bd26a5-ca46-48d7-9c85-82e88fbf0987-fa3dff89-d21d-4076-a16c-92032f16992c
382026-01-24T01:05:11.576ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-b2bd26a5-ca46-48d7-9c85-82e88fbf0987-fa3dff89-d21d-4076-a16c-92032f16992c
392026-01-24T01:05:11.615ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-b2bd26a5-ca46-48d7-9c85-82e88fbf0987-fa3dff89-d21d-4076-a16c-92032f16992c
402026-01-24T01:05:11.615ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/b2bd26a5-ca46-48d7-9c85-82e88fbf0987/.zfs/snapshot/fa3dff89-d21d-4076-a16c-92032f16992c
412026-01-24T01:05:11.615ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19002
422026-01-24T01:05:11.615ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
432026-01-24T01:05:11.615ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::17
442026-01-24T01:05:11.615ZINFOcrucible-agent (worker): commit
452026-01-24T01:05:11.619ZINFOcrucible-agent (worker): ok!
462026-01-24T01:05:11.631ZINFOcrucible-agent (worker): SMF ok!
472026-01-24T01:05:11.631ZINFOcrucible-agent (datafile): region b2bd26a5-ca46-48d7-9c85-82e88fbf0987 running snapshot fa3dff89-d21d-4076-a16c-92032f16992c state: Requested -> Created
482026-01-24T01:05:11.773ZINFOcrucible-agent (datafile): path is "/data/regions/b2bd26a5-ca46-48d7-9c85-82e88fbf0987"
492026-01-24T01:05:11.779ZINFOcrucible-agent (datafile): dataset is oxp_ba0c4ed4-98e4-47b3-943a-950bafcd8977/crucible/regions/b2bd26a5-ca46-48d7-9c85-82e88fbf0987
502026-01-24T01:05:11.786ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_ba0c4ed4-98e4-47b3-943a-950bafcd8977/crucible/regions/b2bd26a5-ca46-48d7-9c85-82e88fbf0987@fa3dff89-d21d-4076-a16c-92032f16992c
512026-01-24T01:05:11.786ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_ba0c4ed4-98e4-47b3-943a-950bafcd8977/crucible/regions/b2bd26a5-ca46-48d7-9c85-82e88fbf0987", "fa3dff89-d21d-4076-a16c-92032f16992c"]
522026-01-24T01:05:11.792ZINFOcrucible-agent (dropshot): request completed latency_us = 18939 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:42776 req_id = 0210838f-8017-4cc1-ac4e-5d5081db079a response_code = 200 uri = /crucible/0/regions/b2bd26a5-ca46-48d7-9c85-82e88fbf0987/snapshots/fa3dff89-d21d-4076-a16c-92032f16992c/run