Max level shown:
12026-09-02T23:54:53.052ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::18]:32345 remote_addr = [fd00:1122:3344:101::c]:54523
22026-09-02T23:54:53.052ZINFOcrucible-agent (datafile): region 5442f890-f059-421e-9604-65e977588ffd state: Requested
32026-09-02T23:54:53.057ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
42026-09-02T23:54:53.057ZINFOcrucible-agent (dropshot): request completed latency_us = 4659 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:54523 req_id = 31f7ac86-4e91-4bab-a91a-8201e11e85ea response_code = 200 uri = /crucible/0/regions
52026-09-02T23:54:53.066ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_7165f9fd-3b69-4174-bd0c-b5d4293b06c6/crucible/regions/5442f890-f059-421e-9604-65e977588ffd
62026-09-02T23:54:53.066ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_7165f9fd-3b69-4174-bd0c-b5d4293b06c6/crucible/regions/5442f890-f059-421e-9604-65e977588ffd
72026-09-02T23:54:53.169ZINFOcrucible-agent (worker): creating region Region { id: RegionId("5442f890-f059-421e-9604-65e977588ffd"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/5442f890-f059-421e-9604-65e977588ffd" region = 5442f890-f059-421e-9604-65e977588ffd
82026-09-02T23:54:53.169ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "5442f890-f059-421e-9604-65e977588ffd" "--data" "/data/regions/5442f890-f059-421e-9604-65e977588ffd" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 5442f890-f059-421e-9604-65e977588ffd
92026-09-02T23:54:53.249ZINFOcrucible-agent (dropshot): request completed latency_us = 58 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:54523 req_id = 2b9a491e-ed8e-4728-9eed-2203e20e9dd7 response_code = 200 uri = /crucible/0/regions
102026-09-02T23:54:53.568ZINFOcrucible-agent (worker): region files created ok region = 5442f890-f059-421e-9604-65e977588ffd
112026-09-02T23:54:53.568ZINFOcrucible-agent (datafile): region 5442f890-f059-421e-9604-65e977588ffd state: Requested -> Created
122026-09-02T23:54:53.569ZINFOcrucible-agent (worker): applying SMF actions post create...
132026-09-02T23:54:53.569ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-5442f890-f059-421e-9604-65e977588ffd
142026-09-02T23:54:53.585ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-5442f890-f059-421e-9604-65e977588ffd
152026-09-02T23:54:53.622ZINFOcrucible-agent (worker): creating config property group
162026-09-02T23:54:53.644ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-5442f890-f059-421e-9604-65e977588ffd
172026-09-02T23:54:53.645ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/5442f890-f059-421e-9604-65e977588ffd
182026-09-02T23:54:53.645ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
192026-09-02T23:54:53.645ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::18
202026-09-02T23:54:53.645ZINFOcrucible-agent (worker): commit
212026-09-02T23:54:53.659ZINFOcrucible-agent (worker): ok!
222026-09-02T23:54:53.681ZINFOcrucible-agent (worker): SMF ok!
232026-09-02T23:54:53.883ZINFOcrucible-agent (dropshot): request completed latency_us = 60 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:54523 req_id = 5ef9c1d2-96b3-47bf-b36b-b0cc74d59fff response_code = 200 uri = /crucible/0/regions
242026-09-02T23:54:56.298ZINFOcrucible-agent (dropshot): request completed latency_us = 78 local_addr = [fd00:1122:3344:101::18]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:54523 req_id = 8d98c07a-e4eb-4beb-bea8-b4b9c2a7e000 response_code = 200 uri = /crucible/0/regions/a469bfee-889e-4eba-869f-7a6a9e910c3e
252026-09-02T23:54:56.302ZINFOcrucible-agent (datafile): path is "/data/regions/a469bfee-889e-4eba-869f-7a6a9e910c3e"
262026-09-02T23:54:56.309ZINFOcrucible-agent (datafile): dataset is oxp_7165f9fd-3b69-4174-bd0c-b5d4293b06c6/crucible/regions/a469bfee-889e-4eba-869f-7a6a9e910c3e
272026-09-02T23:54:56.314ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_7165f9fd-3b69-4174-bd0c-b5d4293b06c6/crucible/regions/a469bfee-889e-4eba-869f-7a6a9e910c3e@02a1b208-51ac-4489-98eb-cbaab35b7bf7
282026-09-02T23:54:56.314ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_7165f9fd-3b69-4174-bd0c-b5d4293b06c6/crucible/regions/a469bfee-889e-4eba-869f-7a6a9e910c3e", "02a1b208-51ac-4489-98eb-cbaab35b7bf7"]
292026-09-02T23:54:56.324ZINFOcrucible-agent (dropshot): request completed latency_us = 21788 local_addr = [fd00:1122:3344:101::18]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:54523 req_id = a1949ffc-8a76-49c4-897b-a22bcb9761e6 response_code = 200 uri = /crucible/0/regions/a469bfee-889e-4eba-869f-7a6a9e910c3e/snapshots/02a1b208-51ac-4489-98eb-cbaab35b7bf7
302026-09-02T23:54:56.338ZINFOcrucible-agent (datafile): path is "/data/regions/a469bfee-889e-4eba-869f-7a6a9e910c3e"
312026-09-02T23:54:56.345ZINFOcrucible-agent (datafile): dataset is oxp_7165f9fd-3b69-4174-bd0c-b5d4293b06c6/crucible/regions/a469bfee-889e-4eba-869f-7a6a9e910c3e
322026-09-02T23:54:56.351ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_7165f9fd-3b69-4174-bd0c-b5d4293b06c6/crucible/regions/a469bfee-889e-4eba-869f-7a6a9e910c3e@02a1b208-51ac-4489-98eb-cbaab35b7bf7
332026-09-02T23:54:56.351ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_7165f9fd-3b69-4174-bd0c-b5d4293b06c6/crucible/regions/a469bfee-889e-4eba-869f-7a6a9e910c3e", "02a1b208-51ac-4489-98eb-cbaab35b7bf7"]
342026-09-02T23:54:56.358ZINFOcrucible-agent (datafile): requesting running snapshot a469bfee-889e-4eba-869f-7a6a9e910c3e-02a1b208-51ac-4489-98eb-cbaab35b7bf7 state: Requested
352026-09-02T23:54:56.368ZINFOcrucible-agent (dropshot): request completed latency_us = 30364 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:54523 req_id = a1ceddf9-c0e2-4174-bb85-ed1993fd68d9 response_code = 200 uri = /crucible/0/regions/a469bfee-889e-4eba-869f-7a6a9e910c3e/snapshots/02a1b208-51ac-4489-98eb-cbaab35b7bf7/run
362026-09-02T23:54:56.368ZINFOcrucible-agent (worker): applying SMF actions for region a469bfee-889e-4eba-869f-7a6a9e910c3e running snapshot 02a1b208-51ac-4489-98eb-cbaab35b7bf7 (state Requested)...
372026-09-02T23:54:56.370ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-a469bfee-889e-4eba-869f-7a6a9e910c3e-02a1b208-51ac-4489-98eb-cbaab35b7bf7
382026-09-02T23:54:56.395ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-a469bfee-889e-4eba-869f-7a6a9e910c3e-02a1b208-51ac-4489-98eb-cbaab35b7bf7
392026-09-02T23:54:56.470ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-a469bfee-889e-4eba-869f-7a6a9e910c3e-02a1b208-51ac-4489-98eb-cbaab35b7bf7
402026-09-02T23:54:56.471ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/a469bfee-889e-4eba-869f-7a6a9e910c3e/.zfs/snapshot/02a1b208-51ac-4489-98eb-cbaab35b7bf7
412026-09-02T23:54:56.471ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19002
422026-09-02T23:54:56.471ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
432026-09-02T23:54:56.471ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::18
442026-09-02T23:54:56.471ZINFOcrucible-agent (worker): commit
452026-09-02T23:54:56.484ZINFOcrucible-agent (worker): ok!
462026-09-02T23:54:56.498ZINFOcrucible-agent (worker): SMF ok!
472026-09-02T23:54:56.498ZINFOcrucible-agent (datafile): region a469bfee-889e-4eba-869f-7a6a9e910c3e running snapshot 02a1b208-51ac-4489-98eb-cbaab35b7bf7 state: Requested -> Created
482026-09-02T23:54:56.697ZINFOcrucible-agent (datafile): path is "/data/regions/a469bfee-889e-4eba-869f-7a6a9e910c3e"
492026-09-02T23:54:56.703ZINFOcrucible-agent (datafile): dataset is oxp_7165f9fd-3b69-4174-bd0c-b5d4293b06c6/crucible/regions/a469bfee-889e-4eba-869f-7a6a9e910c3e
502026-09-02T23:54:56.709ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_7165f9fd-3b69-4174-bd0c-b5d4293b06c6/crucible/regions/a469bfee-889e-4eba-869f-7a6a9e910c3e@02a1b208-51ac-4489-98eb-cbaab35b7bf7
512026-09-02T23:54:56.709ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_7165f9fd-3b69-4174-bd0c-b5d4293b06c6/crucible/regions/a469bfee-889e-4eba-869f-7a6a9e910c3e", "02a1b208-51ac-4489-98eb-cbaab35b7bf7"]
522026-09-02T23:54:56.716ZINFOcrucible-agent (dropshot): request completed latency_us = 19153 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:54523 req_id = f3f2eae2-aa5a-4bfb-aca1-3598781ed593 response_code = 200 uri = /crucible/0/regions/a469bfee-889e-4eba-869f-7a6a9e910c3e/snapshots/02a1b208-51ac-4489-98eb-cbaab35b7bf7/run