Max level shown:
12026-08-20T04:46:06.664ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::16]:32345 remote_addr = [fd00:1122:3344:101::a]:58164
22026-08-20T04:46:06.697ZINFOcrucible-agent (datafile): region a7ec83f9-2224-47a8-92e3-de0fc93e193e state: Requested
32026-08-20T04:46:06.701ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
42026-08-20T04:46:06.705ZINFOcrucible-agent (dropshot): request completed latency_us = 15782 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:58164 req_id = d5734f64-948e-4bae-ba10-324215dc950f response_code = 200 uri = /crucible/0/regions
52026-08-20T04:46:06.711ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_45b335dd-26a5-4bb1-a3ec-d7da617e04e3/crucible/regions/a7ec83f9-2224-47a8-92e3-de0fc93e193e
62026-08-20T04:46:06.711ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_45b335dd-26a5-4bb1-a3ec-d7da617e04e3/crucible/regions/a7ec83f9-2224-47a8-92e3-de0fc93e193e
72026-08-20T04:46:06.758ZINFOcrucible-agent (worker): creating region Region { id: RegionId("a7ec83f9-2224-47a8-92e3-de0fc93e193e"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/a7ec83f9-2224-47a8-92e3-de0fc93e193e" region = a7ec83f9-2224-47a8-92e3-de0fc93e193e
82026-08-20T04:46:06.760ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "a7ec83f9-2224-47a8-92e3-de0fc93e193e" "--data" "/data/regions/a7ec83f9-2224-47a8-92e3-de0fc93e193e" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = a7ec83f9-2224-47a8-92e3-de0fc93e193e
92026-08-20T04:46:07.041ZINFOcrucible-agent (dropshot): request completed latency_us = 65 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:58164 req_id = e7116b06-0de6-496f-bc12-608916fa1b88 response_code = 200 uri = /crucible/0/regions
102026-08-20T04:46:07.043ZINFOcrucible-agent (worker): region files created ok region = a7ec83f9-2224-47a8-92e3-de0fc93e193e
112026-08-20T04:46:07.048ZINFOcrucible-agent (datafile): region a7ec83f9-2224-47a8-92e3-de0fc93e193e state: Requested -> Created
122026-08-20T04:46:07.048ZINFOcrucible-agent (worker): applying SMF actions post create...
132026-08-20T04:46:07.050ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-a7ec83f9-2224-47a8-92e3-de0fc93e193e
142026-08-20T04:46:07.057ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-a7ec83f9-2224-47a8-92e3-de0fc93e193e
152026-08-20T04:46:07.066ZINFOcrucible-agent (worker): creating config property group
162026-08-20T04:46:07.067ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-a7ec83f9-2224-47a8-92e3-de0fc93e193e
172026-08-20T04:46:07.068ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/a7ec83f9-2224-47a8-92e3-de0fc93e193e
182026-08-20T04:46:07.068ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
192026-08-20T04:46:07.068ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::16
202026-08-20T04:46:07.068ZINFOcrucible-agent (worker): commit
212026-08-20T04:46:07.071ZINFOcrucible-agent (worker): ok!
222026-08-20T04:46:07.074ZINFOcrucible-agent (worker): SMF ok!
232026-08-20T04:46:07.694ZINFOcrucible-agent (dropshot): request completed latency_us = 91 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:58164 req_id = 0a43d00c-1300-473b-a6aa-47dfee3771d4 response_code = 200 uri = /crucible/0/regions
242026-08-20T04:57:04.498ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::16]:32345 remote_addr = [fd00:1122:3344:101::a]:58326
252026-08-20T04:57:04.498ZINFOcrucible-agent (dropshot): request completed latency_us = 59 local_addr = [fd00:1122:3344:101::16]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:58326 req_id = 9a96ce1d-d865-4f78-b05d-dcfe886b61ec response_code = 200 uri = /crucible/0/regions/a7ec83f9-2224-47a8-92e3-de0fc93e193e
262026-08-20T04:57:04.504ZINFOcrucible-agent (datafile): path is "/data/regions/a7ec83f9-2224-47a8-92e3-de0fc93e193e"
272026-08-20T04:57:04.510ZINFOcrucible-agent (datafile): dataset is oxp_45b335dd-26a5-4bb1-a3ec-d7da617e04e3/crucible/regions/a7ec83f9-2224-47a8-92e3-de0fc93e193e
282026-08-20T04:57:04.517ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_45b335dd-26a5-4bb1-a3ec-d7da617e04e3/crucible/regions/a7ec83f9-2224-47a8-92e3-de0fc93e193e@8d6d8f5f-0f12-428b-b35e-96498a6a9377
292026-08-20T04:57:04.517ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_45b335dd-26a5-4bb1-a3ec-d7da617e04e3/crucible/regions/a7ec83f9-2224-47a8-92e3-de0fc93e193e", "8d6d8f5f-0f12-428b-b35e-96498a6a9377"]
302026-08-20T04:57:04.530ZINFOcrucible-agent (dropshot): request completed latency_us = 25964 local_addr = [fd00:1122:3344:101::16]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:58326 req_id = 017edad0-b2a9-451a-9ab5-4a69c00c1b41 response_code = 200 uri = /crucible/0/regions/a7ec83f9-2224-47a8-92e3-de0fc93e193e/snapshots/8d6d8f5f-0f12-428b-b35e-96498a6a9377
312026-08-20T04:57:04.538ZINFOcrucible-agent (datafile): path is "/data/regions/a7ec83f9-2224-47a8-92e3-de0fc93e193e"
322026-08-20T04:57:04.545ZINFOcrucible-agent (datafile): dataset is oxp_45b335dd-26a5-4bb1-a3ec-d7da617e04e3/crucible/regions/a7ec83f9-2224-47a8-92e3-de0fc93e193e
332026-08-20T04:57:04.550ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_45b335dd-26a5-4bb1-a3ec-d7da617e04e3/crucible/regions/a7ec83f9-2224-47a8-92e3-de0fc93e193e@8d6d8f5f-0f12-428b-b35e-96498a6a9377
342026-08-20T04:57:04.550ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_45b335dd-26a5-4bb1-a3ec-d7da617e04e3/crucible/regions/a7ec83f9-2224-47a8-92e3-de0fc93e193e", "8d6d8f5f-0f12-428b-b35e-96498a6a9377"]
352026-08-20T04:57:04.557ZINFOcrucible-agent (datafile): requesting running snapshot a7ec83f9-2224-47a8-92e3-de0fc93e193e-8d6d8f5f-0f12-428b-b35e-96498a6a9377 state: Requested
362026-08-20T04:57:04.563ZINFOcrucible-agent (dropshot): request completed latency_us = 25102 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:58326 req_id = 2e6bcfa7-14e0-4351-9f71-406245d34e2f response_code = 200 uri = /crucible/0/regions/a7ec83f9-2224-47a8-92e3-de0fc93e193e/snapshots/8d6d8f5f-0f12-428b-b35e-96498a6a9377/run
372026-08-20T04:57:04.563ZINFOcrucible-agent (worker): applying SMF actions for region a7ec83f9-2224-47a8-92e3-de0fc93e193e running snapshot 8d6d8f5f-0f12-428b-b35e-96498a6a9377 (state Requested)...
382026-08-20T04:57:04.571ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-a7ec83f9-2224-47a8-92e3-de0fc93e193e-8d6d8f5f-0f12-428b-b35e-96498a6a9377
392026-08-20T04:57:04.574ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-a7ec83f9-2224-47a8-92e3-de0fc93e193e-8d6d8f5f-0f12-428b-b35e-96498a6a9377
402026-08-20T04:57:04.582ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-a7ec83f9-2224-47a8-92e3-de0fc93e193e-8d6d8f5f-0f12-428b-b35e-96498a6a9377
412026-08-20T04:57:04.582ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/a7ec83f9-2224-47a8-92e3-de0fc93e193e/.zfs/snapshot/8d6d8f5f-0f12-428b-b35e-96498a6a9377
422026-08-20T04:57:04.582ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
432026-08-20T04:57:04.582ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
442026-08-20T04:57:04.582ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::16
452026-08-20T04:57:04.582ZINFOcrucible-agent (worker): commit
462026-08-20T04:57:04.584ZINFOcrucible-agent (worker): ok!
472026-08-20T04:57:04.587ZINFOcrucible-agent (worker): SMF ok!
482026-08-20T04:57:04.587ZINFOcrucible-agent (datafile): region a7ec83f9-2224-47a8-92e3-de0fc93e193e running snapshot 8d6d8f5f-0f12-428b-b35e-96498a6a9377 state: Requested -> Created
492026-08-20T04:57:04.763ZINFOcrucible-agent (datafile): path is "/data/regions/a7ec83f9-2224-47a8-92e3-de0fc93e193e"
502026-08-20T04:57:04.770ZINFOcrucible-agent (datafile): dataset is oxp_45b335dd-26a5-4bb1-a3ec-d7da617e04e3/crucible/regions/a7ec83f9-2224-47a8-92e3-de0fc93e193e
512026-08-20T04:57:04.775ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_45b335dd-26a5-4bb1-a3ec-d7da617e04e3/crucible/regions/a7ec83f9-2224-47a8-92e3-de0fc93e193e@8d6d8f5f-0f12-428b-b35e-96498a6a9377
522026-08-20T04:57:04.775ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_45b335dd-26a5-4bb1-a3ec-d7da617e04e3/crucible/regions/a7ec83f9-2224-47a8-92e3-de0fc93e193e", "8d6d8f5f-0f12-428b-b35e-96498a6a9377"]
532026-08-20T04:57:04.779ZINFOcrucible-agent (dropshot): request completed latency_us = 16214 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:58326 req_id = 0b468267-16a7-4800-9dee-5405307566e3 response_code = 200 uri = /crucible/0/regions/a7ec83f9-2224-47a8-92e3-de0fc93e193e/snapshots/8d6d8f5f-0f12-428b-b35e-96498a6a9377/run