Max level shown:
12026-05-19T00:00:07.710ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::14]:32345 remote_addr = [fd00:1122:3344:101::a]:37232
22026-05-19T00:00:07.748ZINFOcrucible-agent (datafile): region 87592280-13fa-4efb-97e0-4e3776dc71bf state: Requested
32026-05-19T00:00:07.749ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
42026-05-19T00:00:07.749ZINFOcrucible-agent (dropshot): request completed latency_us = 13630 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:37232 req_id = 8abcde23-3949-4e5b-ba46-47a0a7c83c88 response_code = 200 uri = /crucible/0/regions
52026-05-19T00:00:07.760ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_c0d8594a-9076-45ff-96ed-5b05d0e21d9c/crucible/regions/87592280-13fa-4efb-97e0-4e3776dc71bf
62026-05-19T00:00:07.760ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_c0d8594a-9076-45ff-96ed-5b05d0e21d9c/crucible/regions/87592280-13fa-4efb-97e0-4e3776dc71bf
72026-05-19T00:00:07.804ZINFOcrucible-agent (worker): creating region Region { id: RegionId("87592280-13fa-4efb-97e0-4e3776dc71bf"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/87592280-13fa-4efb-97e0-4e3776dc71bf" region = 87592280-13fa-4efb-97e0-4e3776dc71bf
82026-05-19T00:00:07.806ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "87592280-13fa-4efb-97e0-4e3776dc71bf" "--data" "/data/regions/87592280-13fa-4efb-97e0-4e3776dc71bf" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 87592280-13fa-4efb-97e0-4e3776dc71bf
92026-05-19T00:00:07.961ZINFOcrucible-agent (dropshot): request completed latency_us = 57 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:37232 req_id = 8cce18e3-b858-477b-89ca-eef9e17cf660 response_code = 200 uri = /crucible/0/regions
102026-05-19T00:00:08.120ZINFOcrucible-agent (worker): region files created ok region = 87592280-13fa-4efb-97e0-4e3776dc71bf
112026-05-19T00:00:08.120ZINFOcrucible-agent (datafile): region 87592280-13fa-4efb-97e0-4e3776dc71bf state: Requested -> Created
122026-05-19T00:00:08.120ZINFOcrucible-agent (worker): applying SMF actions post create...
132026-05-19T00:00:08.120ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-87592280-13fa-4efb-97e0-4e3776dc71bf
142026-05-19T00:00:08.126ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-87592280-13fa-4efb-97e0-4e3776dc71bf
152026-05-19T00:00:08.136ZINFOcrucible-agent (worker): creating config property group
162026-05-19T00:00:08.137ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-87592280-13fa-4efb-97e0-4e3776dc71bf
172026-05-19T00:00:08.138ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/87592280-13fa-4efb-97e0-4e3776dc71bf
182026-05-19T00:00:08.138ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
192026-05-19T00:00:08.138ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::14
202026-05-19T00:00:08.138ZINFOcrucible-agent (worker): commit
212026-05-19T00:00:08.140ZINFOcrucible-agent (worker): ok!
222026-05-19T00:00:08.143ZINFOcrucible-agent (worker): SMF ok!
232026-05-19T00:00:08.594ZINFOcrucible-agent (dropshot): request completed latency_us = 58 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:37232 req_id = e27262e7-9214-44a2-ae13-279e44f480b6 response_code = 200 uri = /crucible/0/regions
242026-05-19T00:11:13.390ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::14]:32345 remote_addr = [fd00:1122:3344:101::a]:63547
252026-05-19T00:11:13.390ZINFOcrucible-agent (dropshot): request completed latency_us = 76 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:63547 req_id = 14aee206-a612-4b59-9b8a-ac7124f64b7e response_code = 200 uri = /crucible/0/regions/87592280-13fa-4efb-97e0-4e3776dc71bf
262026-05-19T00:11:13.403ZINFOcrucible-agent (datafile): path is "/data/regions/87592280-13fa-4efb-97e0-4e3776dc71bf"
272026-05-19T00:11:13.411ZINFOcrucible-agent (datafile): dataset is oxp_c0d8594a-9076-45ff-96ed-5b05d0e21d9c/crucible/regions/87592280-13fa-4efb-97e0-4e3776dc71bf
282026-05-19T00:11:13.418ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_c0d8594a-9076-45ff-96ed-5b05d0e21d9c/crucible/regions/87592280-13fa-4efb-97e0-4e3776dc71bf@bb8e8d19-d8ae-479e-9cea-8198c6ddf4aa
292026-05-19T00:11:13.418ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_c0d8594a-9076-45ff-96ed-5b05d0e21d9c/crucible/regions/87592280-13fa-4efb-97e0-4e3776dc71bf", "bb8e8d19-d8ae-479e-9cea-8198c6ddf4aa"]
302026-05-19T00:11:13.428ZINFOcrucible-agent (dropshot): request completed latency_us = 24966 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:63547 req_id = addb8765-2e59-4dab-8bb3-87e4788bb32e response_code = 200 uri = /crucible/0/regions/87592280-13fa-4efb-97e0-4e3776dc71bf/snapshots/bb8e8d19-d8ae-479e-9cea-8198c6ddf4aa
312026-05-19T00:11:13.434ZINFOcrucible-agent (datafile): path is "/data/regions/87592280-13fa-4efb-97e0-4e3776dc71bf"
322026-05-19T00:11:13.441ZINFOcrucible-agent (datafile): dataset is oxp_c0d8594a-9076-45ff-96ed-5b05d0e21d9c/crucible/regions/87592280-13fa-4efb-97e0-4e3776dc71bf
332026-05-19T00:11:13.448ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_c0d8594a-9076-45ff-96ed-5b05d0e21d9c/crucible/regions/87592280-13fa-4efb-97e0-4e3776dc71bf@bb8e8d19-d8ae-479e-9cea-8198c6ddf4aa
342026-05-19T00:11:13.448ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_c0d8594a-9076-45ff-96ed-5b05d0e21d9c/crucible/regions/87592280-13fa-4efb-97e0-4e3776dc71bf", "bb8e8d19-d8ae-479e-9cea-8198c6ddf4aa"]
352026-05-19T00:11:13.455ZINFOcrucible-agent (datafile): requesting running snapshot 87592280-13fa-4efb-97e0-4e3776dc71bf-bb8e8d19-d8ae-479e-9cea-8198c6ddf4aa state: Requested
362026-05-19T00:11:13.456ZINFOcrucible-agent (worker): applying SMF actions for region 87592280-13fa-4efb-97e0-4e3776dc71bf running snapshot bb8e8d19-d8ae-479e-9cea-8198c6ddf4aa (state Requested)...
372026-05-19T00:11:13.456ZINFOcrucible-agent (dropshot): request completed latency_us = 21365 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:63547 req_id = e9f6927a-c311-48e8-864e-7dd3386f6efb response_code = 200 uri = /crucible/0/regions/87592280-13fa-4efb-97e0-4e3776dc71bf/snapshots/bb8e8d19-d8ae-479e-9cea-8198c6ddf4aa/run
382026-05-19T00:11:13.468ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-87592280-13fa-4efb-97e0-4e3776dc71bf-bb8e8d19-d8ae-479e-9cea-8198c6ddf4aa
392026-05-19T00:11:13.471ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-87592280-13fa-4efb-97e0-4e3776dc71bf-bb8e8d19-d8ae-479e-9cea-8198c6ddf4aa
402026-05-19T00:11:13.479ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-87592280-13fa-4efb-97e0-4e3776dc71bf-bb8e8d19-d8ae-479e-9cea-8198c6ddf4aa
412026-05-19T00:11:13.479ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/87592280-13fa-4efb-97e0-4e3776dc71bf/.zfs/snapshot/bb8e8d19-d8ae-479e-9cea-8198c6ddf4aa
422026-05-19T00:11:13.479ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
432026-05-19T00:11:13.480ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
442026-05-19T00:11:13.480ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::14
452026-05-19T00:11:13.480ZINFOcrucible-agent (worker): commit
462026-05-19T00:11:13.482ZINFOcrucible-agent (worker): ok!
472026-05-19T00:11:13.485ZINFOcrucible-agent (worker): SMF ok!
482026-05-19T00:11:13.485ZINFOcrucible-agent (datafile): region 87592280-13fa-4efb-97e0-4e3776dc71bf running snapshot bb8e8d19-d8ae-479e-9cea-8198c6ddf4aa state: Requested -> Created
492026-05-19T00:11:13.594ZINFOcrucible-agent (datafile): path is "/data/regions/87592280-13fa-4efb-97e0-4e3776dc71bf"
502026-05-19T00:11:13.602ZINFOcrucible-agent (datafile): dataset is oxp_c0d8594a-9076-45ff-96ed-5b05d0e21d9c/crucible/regions/87592280-13fa-4efb-97e0-4e3776dc71bf
512026-05-19T00:11:13.609ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_c0d8594a-9076-45ff-96ed-5b05d0e21d9c/crucible/regions/87592280-13fa-4efb-97e0-4e3776dc71bf@bb8e8d19-d8ae-479e-9cea-8198c6ddf4aa
522026-05-19T00:11:13.609ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_c0d8594a-9076-45ff-96ed-5b05d0e21d9c/crucible/regions/87592280-13fa-4efb-97e0-4e3776dc71bf", "bb8e8d19-d8ae-479e-9cea-8198c6ddf4aa"]
532026-05-19T00:11:13.616ZINFOcrucible-agent (dropshot): request completed latency_us = 21499 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:63547 req_id = d5148a07-4cf8-4c44-b014-8fa5f57c563e response_code = 200 uri = /crucible/0/regions/87592280-13fa-4efb-97e0-4e3776dc71bf/snapshots/bb8e8d19-d8ae-479e-9cea-8198c6ddf4aa/run