Max level shown:
12026-08-31T16:30:42.079ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::1a]:32345 remote_addr = [fd00:1122:3344:101::c]:55197
22026-08-31T16:30:42.114ZINFOcrucible-agent (datafile): region f1ea393c-dbe0-412b-93e1-f7e5ffe89bfa state: Requested
32026-08-31T16:30:42.119ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
42026-08-31T16:30:42.123ZINFOcrucible-agent (dropshot): request completed latency_us = 16162 local_addr = [fd00:1122:3344:101::1a]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:55197 req_id = 11079117-0c33-406b-a889-3acfcb663b92 response_code = 200 uri = /crucible/0/regions
52026-08-31T16:30:42.127ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_a7481840-5663-40dc-91b0-96a6469b36c1/crucible/regions/f1ea393c-dbe0-412b-93e1-f7e5ffe89bfa
62026-08-31T16:30:42.127ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_a7481840-5663-40dc-91b0-96a6469b36c1/crucible/regions/f1ea393c-dbe0-412b-93e1-f7e5ffe89bfa
72026-08-31T16:30:42.187ZINFOcrucible-agent (worker): creating region Region { id: RegionId("f1ea393c-dbe0-412b-93e1-f7e5ffe89bfa"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/f1ea393c-dbe0-412b-93e1-f7e5ffe89bfa" region = f1ea393c-dbe0-412b-93e1-f7e5ffe89bfa
82026-08-31T16:30:42.189ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "f1ea393c-dbe0-412b-93e1-f7e5ffe89bfa" "--data" "/data/regions/f1ea393c-dbe0-412b-93e1-f7e5ffe89bfa" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = f1ea393c-dbe0-412b-93e1-f7e5ffe89bfa
92026-08-31T16:30:42.335ZINFOcrucible-agent (worker): region files created ok region = f1ea393c-dbe0-412b-93e1-f7e5ffe89bfa
102026-08-31T16:30:42.340ZINFOcrucible-agent (datafile): region f1ea393c-dbe0-412b-93e1-f7e5ffe89bfa state: Requested -> Created
112026-08-31T16:30:42.340ZINFOcrucible-agent (worker): applying SMF actions post create...
122026-08-31T16:30:42.342ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-f1ea393c-dbe0-412b-93e1-f7e5ffe89bfa
132026-08-31T16:30:42.347ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-f1ea393c-dbe0-412b-93e1-f7e5ffe89bfa
142026-08-31T16:30:42.358ZINFOcrucible-agent (worker): creating config property group
152026-08-31T16:30:42.359ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-f1ea393c-dbe0-412b-93e1-f7e5ffe89bfa
162026-08-31T16:30:42.360ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/f1ea393c-dbe0-412b-93e1-f7e5ffe89bfa
172026-08-31T16:30:42.360ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
182026-08-31T16:30:42.360ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::1a
192026-08-31T16:30:42.360ZINFOcrucible-agent (worker): commit
202026-08-31T16:30:42.363ZINFOcrucible-agent (worker): ok!
212026-08-31T16:30:42.366ZINFOcrucible-agent (worker): SMF ok!
222026-08-31T16:30:42.507ZINFOcrucible-agent (dropshot): request completed latency_us = 73 local_addr = [fd00:1122:3344:101::1a]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:55197 req_id = 65b93fa0-8837-47fa-94b7-65f340a490dd response_code = 200 uri = /crucible/0/regions
232026-08-31T16:41:56.910ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::1a]:32345 remote_addr = [fd00:1122:3344:101::c]:58269
242026-08-31T16:41:56.910ZINFOcrucible-agent (dropshot): request completed latency_us = 57 local_addr = [fd00:1122:3344:101::1a]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:58269 req_id = 2f96c1ab-63a5-49cb-96c8-98baf9577bf0 response_code = 200 uri = /crucible/0/regions/f1ea393c-dbe0-412b-93e1-f7e5ffe89bfa
252026-08-31T16:41:56.914ZINFOcrucible-agent (datafile): path is "/data/regions/f1ea393c-dbe0-412b-93e1-f7e5ffe89bfa"
262026-08-31T16:41:56.920ZINFOcrucible-agent (datafile): dataset is oxp_a7481840-5663-40dc-91b0-96a6469b36c1/crucible/regions/f1ea393c-dbe0-412b-93e1-f7e5ffe89bfa
272026-08-31T16:41:56.927ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_a7481840-5663-40dc-91b0-96a6469b36c1/crucible/regions/f1ea393c-dbe0-412b-93e1-f7e5ffe89bfa@a8e3c4ed-4c4b-4003-b62d-986126ead7c9
282026-08-31T16:41:56.927ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_a7481840-5663-40dc-91b0-96a6469b36c1/crucible/regions/f1ea393c-dbe0-412b-93e1-f7e5ffe89bfa", "a8e3c4ed-4c4b-4003-b62d-986126ead7c9"]
292026-08-31T16:41:56.938ZINFOcrucible-agent (dropshot): request completed latency_us = 24451 local_addr = [fd00:1122:3344:101::1a]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:58269 req_id = b47ec2aa-1e86-4f70-a238-889d29d9dc3b response_code = 200 uri = /crucible/0/regions/f1ea393c-dbe0-412b-93e1-f7e5ffe89bfa/snapshots/a8e3c4ed-4c4b-4003-b62d-986126ead7c9
302026-08-31T16:41:56.942ZINFOcrucible-agent (datafile): path is "/data/regions/f1ea393c-dbe0-412b-93e1-f7e5ffe89bfa"
312026-08-31T16:41:56.948ZINFOcrucible-agent (datafile): dataset is oxp_a7481840-5663-40dc-91b0-96a6469b36c1/crucible/regions/f1ea393c-dbe0-412b-93e1-f7e5ffe89bfa
322026-08-31T16:41:56.953ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_a7481840-5663-40dc-91b0-96a6469b36c1/crucible/regions/f1ea393c-dbe0-412b-93e1-f7e5ffe89bfa@a8e3c4ed-4c4b-4003-b62d-986126ead7c9
332026-08-31T16:41:56.953ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_a7481840-5663-40dc-91b0-96a6469b36c1/crucible/regions/f1ea393c-dbe0-412b-93e1-f7e5ffe89bfa", "a8e3c4ed-4c4b-4003-b62d-986126ead7c9"]
342026-08-31T16:41:56.960ZINFOcrucible-agent (datafile): requesting running snapshot f1ea393c-dbe0-412b-93e1-f7e5ffe89bfa-a8e3c4ed-4c4b-4003-b62d-986126ead7c9 state: Requested
352026-08-31T16:41:56.966ZINFOcrucible-agent (dropshot): request completed latency_us = 23893 local_addr = [fd00:1122:3344:101::1a]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:58269 req_id = 38c9e09d-5fcd-4915-856a-ec7dc99fdcaf response_code = 200 uri = /crucible/0/regions/f1ea393c-dbe0-412b-93e1-f7e5ffe89bfa/snapshots/a8e3c4ed-4c4b-4003-b62d-986126ead7c9/run
362026-08-31T16:41:56.966ZINFOcrucible-agent (worker): applying SMF actions for region f1ea393c-dbe0-412b-93e1-f7e5ffe89bfa running snapshot a8e3c4ed-4c4b-4003-b62d-986126ead7c9 (state Requested)...
372026-08-31T16:41:56.974ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-f1ea393c-dbe0-412b-93e1-f7e5ffe89bfa-a8e3c4ed-4c4b-4003-b62d-986126ead7c9
382026-08-31T16:41:56.976ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-f1ea393c-dbe0-412b-93e1-f7e5ffe89bfa-a8e3c4ed-4c4b-4003-b62d-986126ead7c9
392026-08-31T16:41:56.984ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-f1ea393c-dbe0-412b-93e1-f7e5ffe89bfa-a8e3c4ed-4c4b-4003-b62d-986126ead7c9
402026-08-31T16:41:56.984ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/f1ea393c-dbe0-412b-93e1-f7e5ffe89bfa/.zfs/snapshot/a8e3c4ed-4c4b-4003-b62d-986126ead7c9
412026-08-31T16:41:56.984ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
422026-08-31T16:41:56.984ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
432026-08-31T16:41:56.984ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::1a
442026-08-31T16:41:56.984ZINFOcrucible-agent (worker): commit
452026-08-31T16:41:56.986ZINFOcrucible-agent (worker): ok!
462026-08-31T16:41:56.989ZINFOcrucible-agent (worker): SMF ok!
472026-08-31T16:41:56.989ZINFOcrucible-agent (datafile): region f1ea393c-dbe0-412b-93e1-f7e5ffe89bfa running snapshot a8e3c4ed-4c4b-4003-b62d-986126ead7c9 state: Requested -> Created
482026-08-31T16:41:57.122ZINFOcrucible-agent (datafile): path is "/data/regions/f1ea393c-dbe0-412b-93e1-f7e5ffe89bfa"
492026-08-31T16:41:57.128ZINFOcrucible-agent (datafile): dataset is oxp_a7481840-5663-40dc-91b0-96a6469b36c1/crucible/regions/f1ea393c-dbe0-412b-93e1-f7e5ffe89bfa
502026-08-31T16:41:57.135ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_a7481840-5663-40dc-91b0-96a6469b36c1/crucible/regions/f1ea393c-dbe0-412b-93e1-f7e5ffe89bfa@a8e3c4ed-4c4b-4003-b62d-986126ead7c9
512026-08-31T16:41:57.135ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_a7481840-5663-40dc-91b0-96a6469b36c1/crucible/regions/f1ea393c-dbe0-412b-93e1-f7e5ffe89bfa", "a8e3c4ed-4c4b-4003-b62d-986126ead7c9"]
522026-08-31T16:41:57.141ZINFOcrucible-agent (dropshot): request completed latency_us = 19508 local_addr = [fd00:1122:3344:101::1a]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:58269 req_id = 7d56a1eb-2667-425b-9d53-bef1484ae9eb response_code = 200 uri = /crucible/0/regions/f1ea393c-dbe0-412b-93e1-f7e5ffe89bfa/snapshots/a8e3c4ed-4c4b-4003-b62d-986126ead7c9/run