Max level shown:
12026-03-05T18:02:25.863ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::17]:32345 remote_addr = [fd00:1122:3344:101::a]:56228
22026-03-05T18:02:25.863ZINFOcrucible-agent (datafile): region ccbd6e9c-28e7-4a65-afb1-9f8efba5131c state: Requested
32026-03-05T18:02:25.864ZINFOcrucible-agent (dropshot): request completed latency_us = 1461 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:56228 req_id = 30f4e8ee-44d3-4ac3-8963-350925ed4c65 response_code = 200 uri = /crucible/0/regions
42026-03-05T18:02:25.864ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
52026-03-05T18:02:25.872ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_8c3ec323-d394-4321-bc2d-b36b3cb9868d/crucible/regions/ccbd6e9c-28e7-4a65-afb1-9f8efba5131c
62026-03-05T18:02:25.872ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_8c3ec323-d394-4321-bc2d-b36b3cb9868d/crucible/regions/ccbd6e9c-28e7-4a65-afb1-9f8efba5131c
72026-03-05T18:02:25.954ZINFOcrucible-agent (worker): creating region Region { id: RegionId("ccbd6e9c-28e7-4a65-afb1-9f8efba5131c"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/ccbd6e9c-28e7-4a65-afb1-9f8efba5131c" region = ccbd6e9c-28e7-4a65-afb1-9f8efba5131c
82026-03-05T18:02:25.954ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "ccbd6e9c-28e7-4a65-afb1-9f8efba5131c" "--data" "/data/regions/ccbd6e9c-28e7-4a65-afb1-9f8efba5131c" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = ccbd6e9c-28e7-4a65-afb1-9f8efba5131c
92026-03-05T18:02:26.027ZINFOcrucible-agent (dropshot): request completed latency_us = 49 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:56228 req_id = 260894bf-b873-4527-a9b4-b4e6aca4a41c response_code = 200 uri = /crucible/0/regions
102026-03-05T18:02:26.174ZINFOcrucible-agent (worker): region files created ok region = ccbd6e9c-28e7-4a65-afb1-9f8efba5131c
112026-03-05T18:02:26.174ZINFOcrucible-agent (datafile): region ccbd6e9c-28e7-4a65-afb1-9f8efba5131c state: Requested -> Created
122026-03-05T18:02:26.174ZINFOcrucible-agent (worker): applying SMF actions post create...
132026-03-05T18:02:26.174ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-ccbd6e9c-28e7-4a65-afb1-9f8efba5131c
142026-03-05T18:02:26.192ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-ccbd6e9c-28e7-4a65-afb1-9f8efba5131c
152026-03-05T18:02:26.233ZINFOcrucible-agent (worker): creating config property group
162026-03-05T18:02:26.244ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-ccbd6e9c-28e7-4a65-afb1-9f8efba5131c
172026-03-05T18:02:26.244ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/ccbd6e9c-28e7-4a65-afb1-9f8efba5131c
182026-03-05T18:02:26.244ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
192026-03-05T18:02:26.244ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::17
202026-03-05T18:02:26.244ZINFOcrucible-agent (worker): commit
212026-03-05T18:02:26.249ZINFOcrucible-agent (worker): ok!
222026-03-05T18:02:26.288ZINFOcrucible-agent (worker): SMF ok!
232026-03-05T18:02:26.677ZINFOcrucible-agent (dropshot): request completed latency_us = 61 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:56228 req_id = c00a0164-888a-4a2f-81e5-1a5d2aebe3eb response_code = 200 uri = /crucible/0/regions
242026-03-05T18:02:27.702ZINFOcrucible-agent (dropshot): request completed latency_us = 72 local_addr = [fd00:1122:3344:101::17]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:56228 req_id = 4b489e91-6ac0-46b7-a192-1af586399854 response_code = 200 uri = /crucible/0/regions/df088b1c-35c7-4145-a2b9-ca25b65dc853
252026-03-05T18:02:27.705ZINFOcrucible-agent (datafile): path is "/data/regions/df088b1c-35c7-4145-a2b9-ca25b65dc853"
262026-03-05T18:02:27.712ZINFOcrucible-agent (datafile): dataset is oxp_8c3ec323-d394-4321-bc2d-b36b3cb9868d/crucible/regions/df088b1c-35c7-4145-a2b9-ca25b65dc853
272026-03-05T18:02:27.718ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_8c3ec323-d394-4321-bc2d-b36b3cb9868d/crucible/regions/df088b1c-35c7-4145-a2b9-ca25b65dc853@943e7588-f544-420d-994f-04a46104d1ac
282026-03-05T18:02:27.718ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_8c3ec323-d394-4321-bc2d-b36b3cb9868d/crucible/regions/df088b1c-35c7-4145-a2b9-ca25b65dc853", "943e7588-f544-420d-994f-04a46104d1ac"]
292026-03-05T18:02:27.726ZINFOcrucible-agent (dropshot): request completed latency_us = 21232 local_addr = [fd00:1122:3344:101::17]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:56228 req_id = fd7a12d2-dd0f-4353-a2e0-089123f67569 response_code = 200 uri = /crucible/0/regions/df088b1c-35c7-4145-a2b9-ca25b65dc853/snapshots/943e7588-f544-420d-994f-04a46104d1ac
302026-03-05T18:02:27.730ZINFOcrucible-agent (datafile): path is "/data/regions/df088b1c-35c7-4145-a2b9-ca25b65dc853"
312026-03-05T18:02:27.736ZINFOcrucible-agent (datafile): dataset is oxp_8c3ec323-d394-4321-bc2d-b36b3cb9868d/crucible/regions/df088b1c-35c7-4145-a2b9-ca25b65dc853
322026-03-05T18:02:27.742ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_8c3ec323-d394-4321-bc2d-b36b3cb9868d/crucible/regions/df088b1c-35c7-4145-a2b9-ca25b65dc853@943e7588-f544-420d-994f-04a46104d1ac
332026-03-05T18:02:27.742ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_8c3ec323-d394-4321-bc2d-b36b3cb9868d/crucible/regions/df088b1c-35c7-4145-a2b9-ca25b65dc853", "943e7588-f544-420d-994f-04a46104d1ac"]
342026-03-05T18:02:27.750ZINFOcrucible-agent (datafile): requesting running snapshot df088b1c-35c7-4145-a2b9-ca25b65dc853-943e7588-f544-420d-994f-04a46104d1ac state: Requested
352026-03-05T18:02:27.750ZINFOcrucible-agent (dropshot): request completed latency_us = 20146 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:56228 req_id = 2b7539ce-9c32-4981-bed9-f024ed620e88 response_code = 200 uri = /crucible/0/regions/df088b1c-35c7-4145-a2b9-ca25b65dc853/snapshots/943e7588-f544-420d-994f-04a46104d1ac/run
362026-03-05T18:02:27.750ZINFOcrucible-agent (worker): applying SMF actions for region df088b1c-35c7-4145-a2b9-ca25b65dc853 running snapshot 943e7588-f544-420d-994f-04a46104d1ac (state Requested)...
372026-03-05T18:02:27.754ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-df088b1c-35c7-4145-a2b9-ca25b65dc853-943e7588-f544-420d-994f-04a46104d1ac
382026-03-05T18:02:27.771ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-df088b1c-35c7-4145-a2b9-ca25b65dc853-943e7588-f544-420d-994f-04a46104d1ac
392026-03-05T18:02:27.792ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-df088b1c-35c7-4145-a2b9-ca25b65dc853-943e7588-f544-420d-994f-04a46104d1ac
402026-03-05T18:02:27.792ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/df088b1c-35c7-4145-a2b9-ca25b65dc853/.zfs/snapshot/943e7588-f544-420d-994f-04a46104d1ac
412026-03-05T18:02:27.792ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19002
422026-03-05T18:02:27.792ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
432026-03-05T18:02:27.792ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::17
442026-03-05T18:02:27.792ZINFOcrucible-agent (worker): commit
452026-03-05T18:02:27.800ZINFOcrucible-agent (worker): ok!
462026-03-05T18:02:27.809ZINFOcrucible-agent (worker): SMF ok!
472026-03-05T18:02:27.809ZINFOcrucible-agent (datafile): region df088b1c-35c7-4145-a2b9-ca25b65dc853 running snapshot 943e7588-f544-420d-994f-04a46104d1ac state: Requested -> Created
482026-03-05T18:02:28.040ZINFOcrucible-agent (datafile): path is "/data/regions/df088b1c-35c7-4145-a2b9-ca25b65dc853"
492026-03-05T18:02:28.046ZINFOcrucible-agent (datafile): dataset is oxp_8c3ec323-d394-4321-bc2d-b36b3cb9868d/crucible/regions/df088b1c-35c7-4145-a2b9-ca25b65dc853
502026-03-05T18:02:28.052ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_8c3ec323-d394-4321-bc2d-b36b3cb9868d/crucible/regions/df088b1c-35c7-4145-a2b9-ca25b65dc853@943e7588-f544-420d-994f-04a46104d1ac
512026-03-05T18:02:28.052ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_8c3ec323-d394-4321-bc2d-b36b3cb9868d/crucible/regions/df088b1c-35c7-4145-a2b9-ca25b65dc853", "943e7588-f544-420d-994f-04a46104d1ac"]
522026-03-05T18:02:28.057ZINFOcrucible-agent (dropshot): request completed latency_us = 17350 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:56228 req_id = 83e33ffa-aa1a-4ac1-be4a-9d6dd890bffd response_code = 200 uri = /crucible/0/regions/df088b1c-35c7-4145-a2b9-ca25b65dc853/snapshots/943e7588-f544-420d-994f-04a46104d1ac/run