Max level shown:
12026-07-10T23:34:26.262ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::12]:32345 remote_addr = [fd00:1122:3344:101::c]:37031
22026-07-10T23:34:26.262ZINFOcrucible-agent (datafile): region c27fb4ad-043d-4481-be2e-e5b7f74be5de state: Requested
32026-07-10T23:34:26.263ZINFOcrucible-agent (dropshot): request completed latency_us = 600 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:37031 req_id = b7f08680-c8ac-43ce-b587-5f080dfd8341 response_code = 200 uri = /crucible/0/regions
42026-07-10T23:34:26.263ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
52026-07-10T23:34:26.272ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_94f11b14-133f-4cde-b068-1cb7291ddc17/crucible/regions/c27fb4ad-043d-4481-be2e-e5b7f74be5de
62026-07-10T23:34:26.272ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_94f11b14-133f-4cde-b068-1cb7291ddc17/crucible/regions/c27fb4ad-043d-4481-be2e-e5b7f74be5de
72026-07-10T23:34:26.359ZINFOcrucible-agent (worker): creating region Region { id: RegionId("c27fb4ad-043d-4481-be2e-e5b7f74be5de"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/c27fb4ad-043d-4481-be2e-e5b7f74be5de" region = c27fb4ad-043d-4481-be2e-e5b7f74be5de
82026-07-10T23:34:26.359ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "c27fb4ad-043d-4481-be2e-e5b7f74be5de" "--data" "/data/regions/c27fb4ad-043d-4481-be2e-e5b7f74be5de" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = c27fb4ad-043d-4481-be2e-e5b7f74be5de
92026-07-10T23:34:26.442ZINFOcrucible-agent (dropshot): request completed latency_us = 54 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:37031 req_id = faaad612-ab34-4140-94fd-029e521770ba response_code = 200 uri = /crucible/0/regions
102026-07-10T23:34:26.495ZINFOcrucible-agent (worker): region files created ok region = c27fb4ad-043d-4481-be2e-e5b7f74be5de
112026-07-10T23:34:26.495ZINFOcrucible-agent (datafile): region c27fb4ad-043d-4481-be2e-e5b7f74be5de state: Requested -> Created
122026-07-10T23:34:26.495ZINFOcrucible-agent (worker): applying SMF actions post create...
132026-07-10T23:34:26.506ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-c27fb4ad-043d-4481-be2e-e5b7f74be5de
142026-07-10T23:34:26.530ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-c27fb4ad-043d-4481-be2e-e5b7f74be5de
152026-07-10T23:34:26.561ZINFOcrucible-agent (worker): creating config property group
162026-07-10T23:34:26.573ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-c27fb4ad-043d-4481-be2e-e5b7f74be5de
172026-07-10T23:34:26.574ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/c27fb4ad-043d-4481-be2e-e5b7f74be5de
182026-07-10T23:34:26.574ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
192026-07-10T23:34:26.574ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::12
202026-07-10T23:34:26.574ZINFOcrucible-agent (worker): commit
212026-07-10T23:34:26.581ZINFOcrucible-agent (worker): ok!
222026-07-10T23:34:26.595ZINFOcrucible-agent (worker): SMF ok!
232026-07-10T23:34:26.780ZINFOcrucible-agent (dropshot): request completed latency_us = 61 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:37031 req_id = 7721369c-8876-4b82-bb62-001750597166 response_code = 200 uri = /crucible/0/regions
242026-07-10T23:34:27.789ZINFOcrucible-agent (dropshot): request completed latency_us = 77 local_addr = [fd00:1122:3344:101::12]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:37031 req_id = 28837381-f967-42d9-80e6-b70ca96bfd78 response_code = 200 uri = /crucible/0/regions/98961b12-e8af-4cbc-ba35-6bde918b776a
252026-07-10T23:34:27.792ZINFOcrucible-agent (datafile): path is "/data/regions/98961b12-e8af-4cbc-ba35-6bde918b776a"
262026-07-10T23:34:27.799ZINFOcrucible-agent (datafile): dataset is oxp_94f11b14-133f-4cde-b068-1cb7291ddc17/crucible/regions/98961b12-e8af-4cbc-ba35-6bde918b776a
272026-07-10T23:34:27.805ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_94f11b14-133f-4cde-b068-1cb7291ddc17/crucible/regions/98961b12-e8af-4cbc-ba35-6bde918b776a@bfbf616e-88f9-4934-8427-f74febb8a9da
282026-07-10T23:34:27.805ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_94f11b14-133f-4cde-b068-1cb7291ddc17/crucible/regions/98961b12-e8af-4cbc-ba35-6bde918b776a", "bfbf616e-88f9-4934-8427-f74febb8a9da"]
292026-07-10T23:34:27.815ZINFOcrucible-agent (dropshot): request completed latency_us = 22862 local_addr = [fd00:1122:3344:101::12]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:37031 req_id = 2706fe29-7d1d-4e14-8480-82910ff9cee4 response_code = 200 uri = /crucible/0/regions/98961b12-e8af-4cbc-ba35-6bde918b776a/snapshots/bfbf616e-88f9-4934-8427-f74febb8a9da
302026-07-10T23:34:27.819ZINFOcrucible-agent (datafile): path is "/data/regions/98961b12-e8af-4cbc-ba35-6bde918b776a"
312026-07-10T23:34:27.826ZINFOcrucible-agent (datafile): dataset is oxp_94f11b14-133f-4cde-b068-1cb7291ddc17/crucible/regions/98961b12-e8af-4cbc-ba35-6bde918b776a
322026-07-10T23:34:27.833ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_94f11b14-133f-4cde-b068-1cb7291ddc17/crucible/regions/98961b12-e8af-4cbc-ba35-6bde918b776a@bfbf616e-88f9-4934-8427-f74febb8a9da
332026-07-10T23:34:27.833ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_94f11b14-133f-4cde-b068-1cb7291ddc17/crucible/regions/98961b12-e8af-4cbc-ba35-6bde918b776a", "bfbf616e-88f9-4934-8427-f74febb8a9da"]
342026-07-10T23:34:27.840ZINFOcrucible-agent (datafile): requesting running snapshot 98961b12-e8af-4cbc-ba35-6bde918b776a-bfbf616e-88f9-4934-8427-f74febb8a9da state: Requested
352026-07-10T23:34:27.843ZINFOcrucible-agent (worker): applying SMF actions for region 98961b12-e8af-4cbc-ba35-6bde918b776a running snapshot bfbf616e-88f9-4934-8427-f74febb8a9da (state Requested)...
362026-07-10T23:34:27.843ZINFOcrucible-agent (dropshot): request completed latency_us = 23909 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:37031 req_id = 0189be3b-fb78-4318-aaf2-39e8103b82a9 response_code = 200 uri = /crucible/0/regions/98961b12-e8af-4cbc-ba35-6bde918b776a/snapshots/bfbf616e-88f9-4934-8427-f74febb8a9da/run
372026-07-10T23:34:27.848ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-98961b12-e8af-4cbc-ba35-6bde918b776a-bfbf616e-88f9-4934-8427-f74febb8a9da
382026-07-10T23:34:27.855ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-98961b12-e8af-4cbc-ba35-6bde918b776a-bfbf616e-88f9-4934-8427-f74febb8a9da
392026-07-10T23:34:27.881ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-98961b12-e8af-4cbc-ba35-6bde918b776a-bfbf616e-88f9-4934-8427-f74febb8a9da
402026-07-10T23:34:27.881ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/98961b12-e8af-4cbc-ba35-6bde918b776a/.zfs/snapshot/bfbf616e-88f9-4934-8427-f74febb8a9da
412026-07-10T23:34:27.881ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19002
422026-07-10T23:34:27.881ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
432026-07-10T23:34:27.881ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::12
442026-07-10T23:34:27.881ZINFOcrucible-agent (worker): commit
452026-07-10T23:34:27.890ZINFOcrucible-agent (worker): ok!
462026-07-10T23:34:27.899ZINFOcrucible-agent (worker): SMF ok!
472026-07-10T23:34:27.899ZINFOcrucible-agent (datafile): region 98961b12-e8af-4cbc-ba35-6bde918b776a running snapshot bfbf616e-88f9-4934-8427-f74febb8a9da state: Requested -> Created
482026-07-10T23:34:28.010ZINFOcrucible-agent (datafile): path is "/data/regions/98961b12-e8af-4cbc-ba35-6bde918b776a"
492026-07-10T23:34:28.017ZINFOcrucible-agent (datafile): dataset is oxp_94f11b14-133f-4cde-b068-1cb7291ddc17/crucible/regions/98961b12-e8af-4cbc-ba35-6bde918b776a
502026-07-10T23:34:28.022ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_94f11b14-133f-4cde-b068-1cb7291ddc17/crucible/regions/98961b12-e8af-4cbc-ba35-6bde918b776a@bfbf616e-88f9-4934-8427-f74febb8a9da
512026-07-10T23:34:28.022ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_94f11b14-133f-4cde-b068-1cb7291ddc17/crucible/regions/98961b12-e8af-4cbc-ba35-6bde918b776a", "bfbf616e-88f9-4934-8427-f74febb8a9da"]
522026-07-10T23:34:28.028ZINFOcrucible-agent (dropshot): request completed latency_us = 18575 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:37031 req_id = 972bb85f-e1e1-4158-a23c-5178495c28fb response_code = 200 uri = /crucible/0/regions/98961b12-e8af-4cbc-ba35-6bde918b776a/snapshots/bfbf616e-88f9-4934-8427-f74febb8a9da/run