Max level shown:
12026-03-24T15:09:50.938ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::17]:32345 remote_addr = [fd00:1122:3344:101::a]:59965
22026-03-24T15:09:50.938ZINFOcrucible-agent (datafile): region ec35473c-c507-4b80-8865-f326f1368243 state: Requested
32026-03-24T15:09:50.938ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
42026-03-24T15:09:50.938ZINFOcrucible-agent (dropshot): request completed latency_us = 647 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:59965 req_id = 347660ed-5906-43d4-b15b-62d481f6693a response_code = 200 uri = /crucible/0/regions
52026-03-24T15:09:50.946ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_662efebd-c6f9-44e6-a4f6-0e03a171d496/crucible/regions/ec35473c-c507-4b80-8865-f326f1368243
62026-03-24T15:09:50.946ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_662efebd-c6f9-44e6-a4f6-0e03a171d496/crucible/regions/ec35473c-c507-4b80-8865-f326f1368243
72026-03-24T15:09:51.010ZINFOcrucible-agent (worker): creating region Region { id: RegionId("ec35473c-c507-4b80-8865-f326f1368243"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/ec35473c-c507-4b80-8865-f326f1368243" region = ec35473c-c507-4b80-8865-f326f1368243
82026-03-24T15:09:51.010ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "ec35473c-c507-4b80-8865-f326f1368243" "--data" "/data/regions/ec35473c-c507-4b80-8865-f326f1368243" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = ec35473c-c507-4b80-8865-f326f1368243
92026-03-24T15:09:51.088ZINFOcrucible-agent (worker): region files created ok region = ec35473c-c507-4b80-8865-f326f1368243
102026-03-24T15:09:51.088ZINFOcrucible-agent (datafile): region ec35473c-c507-4b80-8865-f326f1368243 state: Requested -> Created
112026-03-24T15:09:51.089ZINFOcrucible-agent (worker): applying SMF actions post create...
122026-03-24T15:09:51.107ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-ec35473c-c507-4b80-8865-f326f1368243
132026-03-24T15:09:51.114ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-ec35473c-c507-4b80-8865-f326f1368243
142026-03-24T15:09:51.123ZINFOcrucible-agent (worker): creating config property group
152026-03-24T15:09:51.126ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-ec35473c-c507-4b80-8865-f326f1368243
162026-03-24T15:09:51.127ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/ec35473c-c507-4b80-8865-f326f1368243
172026-03-24T15:09:51.127ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
182026-03-24T15:09:51.127ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::17
192026-03-24T15:09:51.127ZINFOcrucible-agent (worker): commit
202026-03-24T15:09:51.130ZINFOcrucible-agent (worker): ok!
212026-03-24T15:09:51.135ZINFOcrucible-agent (worker): SMF ok!
222026-03-24T15:09:51.201ZINFOcrucible-agent (dropshot): request completed latency_us = 58 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:59965 req_id = 80472953-ee6b-4a41-a09c-f8b6bab34db0 response_code = 200 uri = /crucible/0/regions
232026-03-24T15:09:51.846ZINFOcrucible-agent (dropshot): request completed latency_us = 79 local_addr = [fd00:1122:3344:101::17]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:59965 req_id = 4bb3c066-67c1-43e1-8f4e-bf80cdc9d586 response_code = 200 uri = /crucible/0/regions/eb204076-9da9-473c-9557-edd56bb3b191
242026-03-24T15:09:51.850ZINFOcrucible-agent (datafile): path is "/data/regions/eb204076-9da9-473c-9557-edd56bb3b191"
252026-03-24T15:09:51.857ZINFOcrucible-agent (datafile): dataset is oxp_662efebd-c6f9-44e6-a4f6-0e03a171d496/crucible/regions/eb204076-9da9-473c-9557-edd56bb3b191
262026-03-24T15:09:51.863ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_662efebd-c6f9-44e6-a4f6-0e03a171d496/crucible/regions/eb204076-9da9-473c-9557-edd56bb3b191@59b869e9-d619-481e-af11-38a32bffb721
272026-03-24T15:09:51.863ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_662efebd-c6f9-44e6-a4f6-0e03a171d496/crucible/regions/eb204076-9da9-473c-9557-edd56bb3b191", "59b869e9-d619-481e-af11-38a32bffb721"]
282026-03-24T15:09:51.872ZINFOcrucible-agent (dropshot): request completed latency_us = 21425 local_addr = [fd00:1122:3344:101::17]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:59965 req_id = a44e75f2-4ba5-469f-8eaf-9a4c9ce456ce response_code = 200 uri = /crucible/0/regions/eb204076-9da9-473c-9557-edd56bb3b191/snapshots/59b869e9-d619-481e-af11-38a32bffb721
292026-03-24T15:09:51.875ZINFOcrucible-agent (datafile): path is "/data/regions/eb204076-9da9-473c-9557-edd56bb3b191"
302026-03-24T15:09:51.881ZINFOcrucible-agent (datafile): dataset is oxp_662efebd-c6f9-44e6-a4f6-0e03a171d496/crucible/regions/eb204076-9da9-473c-9557-edd56bb3b191
312026-03-24T15:09:51.887ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_662efebd-c6f9-44e6-a4f6-0e03a171d496/crucible/regions/eb204076-9da9-473c-9557-edd56bb3b191@59b869e9-d619-481e-af11-38a32bffb721
322026-03-24T15:09:51.887ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_662efebd-c6f9-44e6-a4f6-0e03a171d496/crucible/regions/eb204076-9da9-473c-9557-edd56bb3b191", "59b869e9-d619-481e-af11-38a32bffb721"]
332026-03-24T15:09:51.895ZINFOcrucible-agent (datafile): requesting running snapshot eb204076-9da9-473c-9557-edd56bb3b191-59b869e9-d619-481e-af11-38a32bffb721 state: Requested
342026-03-24T15:09:51.895ZINFOcrucible-agent (dropshot): request completed latency_us = 19759 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:59965 req_id = ec65f8ce-c9ee-4d4b-af71-be0f91fedaee response_code = 200 uri = /crucible/0/regions/eb204076-9da9-473c-9557-edd56bb3b191/snapshots/59b869e9-d619-481e-af11-38a32bffb721/run
352026-03-24T15:09:51.895ZINFOcrucible-agent (worker): applying SMF actions for region eb204076-9da9-473c-9557-edd56bb3b191 running snapshot 59b869e9-d619-481e-af11-38a32bffb721 (state Requested)...
362026-03-24T15:09:51.899ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-eb204076-9da9-473c-9557-edd56bb3b191-59b869e9-d619-481e-af11-38a32bffb721
372026-03-24T15:09:51.913ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-eb204076-9da9-473c-9557-edd56bb3b191-59b869e9-d619-481e-af11-38a32bffb721
382026-03-24T15:09:51.922ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-eb204076-9da9-473c-9557-edd56bb3b191-59b869e9-d619-481e-af11-38a32bffb721
392026-03-24T15:09:51.922ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/eb204076-9da9-473c-9557-edd56bb3b191/.zfs/snapshot/59b869e9-d619-481e-af11-38a32bffb721
402026-03-24T15:09:51.922ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19002
412026-03-24T15:09:51.922ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
422026-03-24T15:09:51.922ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::17
432026-03-24T15:09:51.922ZINFOcrucible-agent (worker): commit
442026-03-24T15:09:51.926ZINFOcrucible-agent (worker): ok!
452026-03-24T15:09:51.930ZINFOcrucible-agent (worker): SMF ok!
462026-03-24T15:09:51.930ZINFOcrucible-agent (datafile): region eb204076-9da9-473c-9557-edd56bb3b191 running snapshot 59b869e9-d619-481e-af11-38a32bffb721 state: Requested -> Created
472026-03-24T15:09:52.050ZINFOcrucible-agent (datafile): path is "/data/regions/eb204076-9da9-473c-9557-edd56bb3b191"
482026-03-24T15:09:52.056ZINFOcrucible-agent (datafile): dataset is oxp_662efebd-c6f9-44e6-a4f6-0e03a171d496/crucible/regions/eb204076-9da9-473c-9557-edd56bb3b191
492026-03-24T15:09:52.062ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_662efebd-c6f9-44e6-a4f6-0e03a171d496/crucible/regions/eb204076-9da9-473c-9557-edd56bb3b191@59b869e9-d619-481e-af11-38a32bffb721
502026-03-24T15:09:52.062ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_662efebd-c6f9-44e6-a4f6-0e03a171d496/crucible/regions/eb204076-9da9-473c-9557-edd56bb3b191", "59b869e9-d619-481e-af11-38a32bffb721"]
512026-03-24T15:09:52.067ZINFOcrucible-agent (dropshot): request completed latency_us = 17323 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:59965 req_id = 432b38ad-e2c9-44a9-a4d7-6cb05a8fd5fc response_code = 200 uri = /crucible/0/regions/eb204076-9da9-473c-9557-edd56bb3b191/snapshots/59b869e9-d619-481e-af11-38a32bffb721/run