Max level shown:
12026-06-22T23:01:31.264ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::13]:32345 remote_addr = [fd00:1122:3344:101::c]:54491
22026-06-22T23:01:31.264ZINFOcrucible-agent (datafile): region 5cd70ba1-6b35-4367-ada9-929c1d6f477d state: Requested
32026-06-22T23:01:31.265ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
42026-06-22T23:01:31.265ZINFOcrucible-agent (dropshot): request completed latency_us = 634 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:54491 req_id = f3c3c855-136c-4a17-87c3-1cf3c64e1614 response_code = 200 uri = /crucible/0/regions
52026-06-22T23:01:31.271ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_87bc329c-186b-44f7-82c9-cb72f0a12216/crucible/regions/5cd70ba1-6b35-4367-ada9-929c1d6f477d
62026-06-22T23:01:31.271ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_87bc329c-186b-44f7-82c9-cb72f0a12216/crucible/regions/5cd70ba1-6b35-4367-ada9-929c1d6f477d
72026-06-22T23:01:31.327ZINFOcrucible-agent (worker): creating region Region { id: RegionId("5cd70ba1-6b35-4367-ada9-929c1d6f477d"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/5cd70ba1-6b35-4367-ada9-929c1d6f477d" region = 5cd70ba1-6b35-4367-ada9-929c1d6f477d
82026-06-22T23:01:31.327ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "5cd70ba1-6b35-4367-ada9-929c1d6f477d" "--data" "/data/regions/5cd70ba1-6b35-4367-ada9-929c1d6f477d" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 5cd70ba1-6b35-4367-ada9-929c1d6f477d
92026-06-22T23:01:31.400ZINFOcrucible-agent (worker): region files created ok region = 5cd70ba1-6b35-4367-ada9-929c1d6f477d
102026-06-22T23:01:31.400ZINFOcrucible-agent (datafile): region 5cd70ba1-6b35-4367-ada9-929c1d6f477d state: Requested -> Created
112026-06-22T23:01:31.400ZINFOcrucible-agent (worker): applying SMF actions post create...
122026-06-22T23:01:31.407ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-5cd70ba1-6b35-4367-ada9-929c1d6f477d
132026-06-22T23:01:31.414ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-5cd70ba1-6b35-4367-ada9-929c1d6f477d
142026-06-22T23:01:31.423ZINFOcrucible-agent (worker): creating config property group
152026-06-22T23:01:31.427ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-5cd70ba1-6b35-4367-ada9-929c1d6f477d
162026-06-22T23:01:31.427ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/5cd70ba1-6b35-4367-ada9-929c1d6f477d
172026-06-22T23:01:31.427ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
182026-06-22T23:01:31.427ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::13
192026-06-22T23:01:31.427ZINFOcrucible-agent (worker): commit
202026-06-22T23:01:31.431ZINFOcrucible-agent (worker): ok!
212026-06-22T23:01:31.435ZINFOcrucible-agent (worker): SMF ok!
222026-06-22T23:01:31.561ZINFOcrucible-agent (dropshot): request completed latency_us = 59 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:54491 req_id = c10d8742-9334-4576-8d4f-df4691f669f4 response_code = 200 uri = /crucible/0/regions
232026-06-22T23:01:32.793ZINFOcrucible-agent (dropshot): request completed latency_us = 52 local_addr = [fd00:1122:3344:101::13]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:54491 req_id = 2f04925f-7d8e-440b-b7cc-7f94e358e296 response_code = 200 uri = /crucible/0/regions/57440c20-21d7-4169-b945-bbd6396aa0cc
242026-06-22T23:01:32.796ZINFOcrucible-agent (datafile): path is "/data/regions/57440c20-21d7-4169-b945-bbd6396aa0cc"
252026-06-22T23:01:32.802ZINFOcrucible-agent (datafile): dataset is oxp_87bc329c-186b-44f7-82c9-cb72f0a12216/crucible/regions/57440c20-21d7-4169-b945-bbd6396aa0cc
262026-06-22T23:01:32.808ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_87bc329c-186b-44f7-82c9-cb72f0a12216/crucible/regions/57440c20-21d7-4169-b945-bbd6396aa0cc@e0d9752c-6f56-4c5a-b838-3b844c871955
272026-06-22T23:01:32.808ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_87bc329c-186b-44f7-82c9-cb72f0a12216/crucible/regions/57440c20-21d7-4169-b945-bbd6396aa0cc", "e0d9752c-6f56-4c5a-b838-3b844c871955"]
282026-06-22T23:01:32.817ZINFOcrucible-agent (dropshot): request completed latency_us = 21571 local_addr = [fd00:1122:3344:101::13]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:54491 req_id = 069c221e-8b87-4e94-8fac-810c8ed3e700 response_code = 200 uri = /crucible/0/regions/57440c20-21d7-4169-b945-bbd6396aa0cc/snapshots/e0d9752c-6f56-4c5a-b838-3b844c871955
292026-06-22T23:01:32.821ZINFOcrucible-agent (datafile): path is "/data/regions/57440c20-21d7-4169-b945-bbd6396aa0cc"
302026-06-22T23:01:32.827ZINFOcrucible-agent (datafile): dataset is oxp_87bc329c-186b-44f7-82c9-cb72f0a12216/crucible/regions/57440c20-21d7-4169-b945-bbd6396aa0cc
312026-06-22T23:01:32.833ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_87bc329c-186b-44f7-82c9-cb72f0a12216/crucible/regions/57440c20-21d7-4169-b945-bbd6396aa0cc@e0d9752c-6f56-4c5a-b838-3b844c871955
322026-06-22T23:01:32.833ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_87bc329c-186b-44f7-82c9-cb72f0a12216/crucible/regions/57440c20-21d7-4169-b945-bbd6396aa0cc", "e0d9752c-6f56-4c5a-b838-3b844c871955"]
332026-06-22T23:01:32.840ZINFOcrucible-agent (datafile): requesting running snapshot 57440c20-21d7-4169-b945-bbd6396aa0cc-e0d9752c-6f56-4c5a-b838-3b844c871955 state: Requested
342026-06-22T23:01:32.840ZINFOcrucible-agent (dropshot): request completed latency_us = 18660 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:54491 req_id = e5d64668-1afb-4588-9f40-b9a16ccfcb6c response_code = 200 uri = /crucible/0/regions/57440c20-21d7-4169-b945-bbd6396aa0cc/snapshots/e0d9752c-6f56-4c5a-b838-3b844c871955/run
352026-06-22T23:01:32.840ZINFOcrucible-agent (worker): applying SMF actions for region 57440c20-21d7-4169-b945-bbd6396aa0cc running snapshot e0d9752c-6f56-4c5a-b838-3b844c871955 (state Requested)...
362026-06-22T23:01:32.845ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-57440c20-21d7-4169-b945-bbd6396aa0cc-e0d9752c-6f56-4c5a-b838-3b844c871955
372026-06-22T23:01:32.848ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-57440c20-21d7-4169-b945-bbd6396aa0cc-e0d9752c-6f56-4c5a-b838-3b844c871955
382026-06-22T23:01:32.858ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-57440c20-21d7-4169-b945-bbd6396aa0cc-e0d9752c-6f56-4c5a-b838-3b844c871955
392026-06-22T23:01:32.859ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/57440c20-21d7-4169-b945-bbd6396aa0cc/.zfs/snapshot/e0d9752c-6f56-4c5a-b838-3b844c871955
402026-06-22T23:01:32.859ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19002
412026-06-22T23:01:32.859ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
422026-06-22T23:01:32.859ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::13
432026-06-22T23:01:32.859ZINFOcrucible-agent (worker): commit
442026-06-22T23:01:32.863ZINFOcrucible-agent (worker): ok!
452026-06-22T23:01:32.867ZINFOcrucible-agent (worker): SMF ok!
462026-06-22T23:01:32.867ZINFOcrucible-agent (datafile): region 57440c20-21d7-4169-b945-bbd6396aa0cc running snapshot e0d9752c-6f56-4c5a-b838-3b844c871955 state: Requested -> Created
472026-06-22T23:01:33.100ZINFOcrucible-agent (datafile): path is "/data/regions/57440c20-21d7-4169-b945-bbd6396aa0cc"
482026-06-22T23:01:33.106ZINFOcrucible-agent (datafile): dataset is oxp_87bc329c-186b-44f7-82c9-cb72f0a12216/crucible/regions/57440c20-21d7-4169-b945-bbd6396aa0cc
492026-06-22T23:01:33.113ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_87bc329c-186b-44f7-82c9-cb72f0a12216/crucible/regions/57440c20-21d7-4169-b945-bbd6396aa0cc@e0d9752c-6f56-4c5a-b838-3b844c871955
502026-06-22T23:01:33.113ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_87bc329c-186b-44f7-82c9-cb72f0a12216/crucible/regions/57440c20-21d7-4169-b945-bbd6396aa0cc", "e0d9752c-6f56-4c5a-b838-3b844c871955"]
512026-06-22T23:01:33.121ZINFOcrucible-agent (dropshot): request completed latency_us = 21092 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:54491 req_id = 29522640-bf2f-4bb6-a506-b1ec61c41101 response_code = 200 uri = /crucible/0/regions/57440c20-21d7-4169-b945-bbd6396aa0cc/snapshots/e0d9752c-6f56-4c5a-b838-3b844c871955/run