Max level shown:
12026-07-02T21:46:05.739ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::19]:32345 remote_addr = [fd00:1122:3344:101::b]:40472
22026-07-02T21:46:05.773ZINFOcrucible-agent (datafile): region 7c913613-eef9-41f0-bd46-842aae495135 state: Requested
32026-07-02T21:46:05.778ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
42026-07-02T21:46:05.780ZINFOcrucible-agent (dropshot): request completed latency_us = 16654 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:40472 req_id = a27ac1cc-666d-410a-8b72-472fd02d4030 response_code = 200 uri = /crucible/0/regions
52026-07-02T21:46:05.786ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_75daa714-26d2-4c7b-a53c-8e584d892b67/crucible/regions/7c913613-eef9-41f0-bd46-842aae495135
62026-07-02T21:46:05.786ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_75daa714-26d2-4c7b-a53c-8e584d892b67/crucible/regions/7c913613-eef9-41f0-bd46-842aae495135
72026-07-02T21:46:05.832ZINFOcrucible-agent (worker): creating region Region { id: RegionId("7c913613-eef9-41f0-bd46-842aae495135"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/7c913613-eef9-41f0-bd46-842aae495135" region = 7c913613-eef9-41f0-bd46-842aae495135
82026-07-02T21:46:05.834ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "7c913613-eef9-41f0-bd46-842aae495135" "--data" "/data/regions/7c913613-eef9-41f0-bd46-842aae495135" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 7c913613-eef9-41f0-bd46-842aae495135
92026-07-02T21:46:06.011ZINFOcrucible-agent (worker): region files created ok region = 7c913613-eef9-41f0-bd46-842aae495135
102026-07-02T21:46:06.013ZINFOcrucible-agent (datafile): region 7c913613-eef9-41f0-bd46-842aae495135 state: Requested -> Created
112026-07-02T21:46:06.013ZINFOcrucible-agent (worker): applying SMF actions post create...
122026-07-02T21:46:06.016ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-7c913613-eef9-41f0-bd46-842aae495135
132026-07-02T21:46:06.021ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-7c913613-eef9-41f0-bd46-842aae495135
142026-07-02T21:46:06.033ZINFOcrucible-agent (worker): creating config property group
152026-07-02T21:46:06.034ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-7c913613-eef9-41f0-bd46-842aae495135
162026-07-02T21:46:06.035ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/7c913613-eef9-41f0-bd46-842aae495135
172026-07-02T21:46:06.037ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
182026-07-02T21:46:06.037ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::19
192026-07-02T21:46:06.037ZINFOcrucible-agent (worker): commit
202026-07-02T21:46:06.044ZINFOcrucible-agent (worker): ok!
212026-07-02T21:46:06.047ZINFOcrucible-agent (worker): SMF ok!
222026-07-02T21:46:06.076ZINFOcrucible-agent (dropshot): request completed latency_us = 79 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:40472 req_id = 409ad4e2-120b-4d85-996d-f756b8326b66 response_code = 200 uri = /crucible/0/regions
232026-07-02T21:57:16.913ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::19]:32345 remote_addr = [fd00:1122:3344:101::b]:40971
242026-07-02T21:57:16.913ZINFOcrucible-agent (dropshot): request completed latency_us = 58 local_addr = [fd00:1122:3344:101::19]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:40971 req_id = 5722794f-c8e5-403b-9e1b-61c6f6a2d6ee response_code = 200 uri = /crucible/0/regions/7c913613-eef9-41f0-bd46-842aae495135
252026-07-02T21:57:16.917ZINFOcrucible-agent (datafile): path is "/data/regions/7c913613-eef9-41f0-bd46-842aae495135"
262026-07-02T21:57:16.923ZINFOcrucible-agent (datafile): dataset is oxp_75daa714-26d2-4c7b-a53c-8e584d892b67/crucible/regions/7c913613-eef9-41f0-bd46-842aae495135
272026-07-02T21:57:16.930ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_75daa714-26d2-4c7b-a53c-8e584d892b67/crucible/regions/7c913613-eef9-41f0-bd46-842aae495135@d2f97121-c40c-4d44-ac8d-f835aea2eca9
282026-07-02T21:57:16.930ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_75daa714-26d2-4c7b-a53c-8e584d892b67/crucible/regions/7c913613-eef9-41f0-bd46-842aae495135", "d2f97121-c40c-4d44-ac8d-f835aea2eca9"]
292026-07-02T21:57:16.942ZINFOcrucible-agent (dropshot): request completed latency_us = 24992 local_addr = [fd00:1122:3344:101::19]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:40971 req_id = 4754ea78-229a-4304-9889-5e38cf759509 response_code = 200 uri = /crucible/0/regions/7c913613-eef9-41f0-bd46-842aae495135/snapshots/d2f97121-c40c-4d44-ac8d-f835aea2eca9
302026-07-02T21:57:16.946ZINFOcrucible-agent (datafile): path is "/data/regions/7c913613-eef9-41f0-bd46-842aae495135"
312026-07-02T21:57:16.954ZINFOcrucible-agent (datafile): dataset is oxp_75daa714-26d2-4c7b-a53c-8e584d892b67/crucible/regions/7c913613-eef9-41f0-bd46-842aae495135
322026-07-02T21:57:16.961ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_75daa714-26d2-4c7b-a53c-8e584d892b67/crucible/regions/7c913613-eef9-41f0-bd46-842aae495135@d2f97121-c40c-4d44-ac8d-f835aea2eca9
332026-07-02T21:57:16.961ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_75daa714-26d2-4c7b-a53c-8e584d892b67/crucible/regions/7c913613-eef9-41f0-bd46-842aae495135", "d2f97121-c40c-4d44-ac8d-f835aea2eca9"]
342026-07-02T21:57:16.970ZINFOcrucible-agent (datafile): requesting running snapshot 7c913613-eef9-41f0-bd46-842aae495135-d2f97121-c40c-4d44-ac8d-f835aea2eca9 state: Requested
352026-07-02T21:57:16.973ZINFOcrucible-agent (dropshot): request completed latency_us = 27493 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:40971 req_id = 20aca832-ccb9-4bb7-8313-35dd7e7f663f response_code = 200 uri = /crucible/0/regions/7c913613-eef9-41f0-bd46-842aae495135/snapshots/d2f97121-c40c-4d44-ac8d-f835aea2eca9/run
362026-07-02T21:57:16.974ZINFOcrucible-agent (worker): applying SMF actions for region 7c913613-eef9-41f0-bd46-842aae495135 running snapshot d2f97121-c40c-4d44-ac8d-f835aea2eca9 (state Requested)...
372026-07-02T21:57:16.986ZINFOcrucible-agent (worker): existing directory value /dev/null does not match /data/regions/7c913613-eef9-41f0-bd46-842aae495135
382026-07-02T21:57:16.986ZINFOcrucible-agent (worker): existing port value 0 does not match 19000
392026-07-02T21:57:16.986ZINFOcrucible-agent (worker): existing address value 0.0.0.0 does not match fd00:1122:3344:101::19
402026-07-02T21:57:16.986ZINFOcrucible-agent (worker): reconfig required
412026-07-02T21:57:16.986ZINFOcrucible-agent (worker): using existing config property group
422026-07-02T21:57:16.986ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-7c913613-eef9-41f0-bd46-842aae495135
432026-07-02T21:57:16.986ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/7c913613-eef9-41f0-bd46-842aae495135
442026-07-02T21:57:16.986ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
452026-07-02T21:57:16.986ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::19
462026-07-02T21:57:16.986ZINFOcrucible-agent (worker): commit
472026-07-02T21:57:16.993ZINFOcrucible-agent (worker): ok!
482026-07-02T21:57:16.996ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-7c913613-eef9-41f0-bd46-842aae495135-d2f97121-c40c-4d44-ac8d-f835aea2eca9
492026-07-02T21:57:16.998ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-7c913613-eef9-41f0-bd46-842aae495135-d2f97121-c40c-4d44-ac8d-f835aea2eca9
502026-07-02T21:57:17.007ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-7c913613-eef9-41f0-bd46-842aae495135-d2f97121-c40c-4d44-ac8d-f835aea2eca9
512026-07-02T21:57:17.007ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/7c913613-eef9-41f0-bd46-842aae495135/.zfs/snapshot/d2f97121-c40c-4d44-ac8d-f835aea2eca9
522026-07-02T21:57:17.007ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
532026-07-02T21:57:17.007ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
542026-07-02T21:57:17.007ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::19
552026-07-02T21:57:17.007ZINFOcrucible-agent (worker): commit
562026-07-02T21:57:17.009ZINFOcrucible-agent (worker): ok!
572026-07-02T21:57:17.012ZINFOcrucible-agent (worker): SMF ok!
582026-07-02T21:57:17.012ZINFOcrucible-agent (datafile): region 7c913613-eef9-41f0-bd46-842aae495135 running snapshot d2f97121-c40c-4d44-ac8d-f835aea2eca9 state: Requested -> Created
592026-07-02T21:57:17.153ZINFOcrucible-agent (datafile): path is "/data/regions/7c913613-eef9-41f0-bd46-842aae495135"
602026-07-02T21:57:17.160ZINFOcrucible-agent (datafile): dataset is oxp_75daa714-26d2-4c7b-a53c-8e584d892b67/crucible/regions/7c913613-eef9-41f0-bd46-842aae495135
612026-07-02T21:57:17.166ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_75daa714-26d2-4c7b-a53c-8e584d892b67/crucible/regions/7c913613-eef9-41f0-bd46-842aae495135@d2f97121-c40c-4d44-ac8d-f835aea2eca9
622026-07-02T21:57:17.166ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_75daa714-26d2-4c7b-a53c-8e584d892b67/crucible/regions/7c913613-eef9-41f0-bd46-842aae495135", "d2f97121-c40c-4d44-ac8d-f835aea2eca9"]
632026-07-02T21:57:17.171ZINFOcrucible-agent (dropshot): request completed latency_us = 18218 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:40971 req_id = 259d65c1-4a69-4d05-b98f-6e69b846eb82 response_code = 200 uri = /crucible/0/regions/7c913613-eef9-41f0-bd46-842aae495135/snapshots/d2f97121-c40c-4d44-ac8d-f835aea2eca9/run