Max level shown:
12026-02-06T00:46:05.538ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::12]:32345 remote_addr = [fd00:1122:3344:101::a]:50355
22026-02-06T00:46:05.538ZINFOcrucible-agent (datafile): region 3b82f94b-1630-447c-90bf-f471eedcc132 state: Requested
32026-02-06T00:46:05.539ZINFOcrucible-agent (dropshot): request completed latency_us = 783 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:50355 req_id = 13cc2c57-42be-4918-98dd-0e8335d5c656 response_code = 200 uri = /crucible/0/regions
42026-02-06T00:46:05.539ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
52026-02-06T00:46:05.547ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_c51e58bd-01f8-48f0-99dd-59a3a179418f/crucible/regions/3b82f94b-1630-447c-90bf-f471eedcc132
62026-02-06T00:46:05.547ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_c51e58bd-01f8-48f0-99dd-59a3a179418f/crucible/regions/3b82f94b-1630-447c-90bf-f471eedcc132
72026-02-06T00:46:05.722ZINFOcrucible-agent (dropshot): request completed latency_us = 59 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:50355 req_id = 3abbbd3c-483b-44c5-ae88-578f15e4811e response_code = 200 uri = /crucible/0/regions
82026-02-06T00:46:05.799ZINFOcrucible-agent (worker): creating region Region { id: RegionId("3b82f94b-1630-447c-90bf-f471eedcc132"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/3b82f94b-1630-447c-90bf-f471eedcc132" region = 3b82f94b-1630-447c-90bf-f471eedcc132
92026-02-06T00:46:05.799ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "3b82f94b-1630-447c-90bf-f471eedcc132" "--data" "/data/regions/3b82f94b-1630-447c-90bf-f471eedcc132" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 3b82f94b-1630-447c-90bf-f471eedcc132
102026-02-06T00:46:06.229ZINFOcrucible-agent (worker): region files created ok region = 3b82f94b-1630-447c-90bf-f471eedcc132
112026-02-06T00:46:06.229ZINFOcrucible-agent (datafile): region 3b82f94b-1630-447c-90bf-f471eedcc132 state: Requested -> Created
122026-02-06T00:46:06.230ZINFOcrucible-agent (worker): applying SMF actions post create...
132026-02-06T00:46:06.230ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-3b82f94b-1630-447c-90bf-f471eedcc132
142026-02-06T00:46:06.323ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-3b82f94b-1630-447c-90bf-f471eedcc132
152026-02-06T00:46:06.378ZINFOcrucible-agent (dropshot): request completed latency_us = 59 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:50355 req_id = 87e81602-4bd2-4a2a-ad6a-f21d5c32d77a response_code = 200 uri = /crucible/0/regions
162026-02-06T00:46:06.430ZINFOcrucible-agent (worker): creating config property group
172026-02-06T00:46:06.449ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-3b82f94b-1630-447c-90bf-f471eedcc132
182026-02-06T00:46:06.449ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/3b82f94b-1630-447c-90bf-f471eedcc132
192026-02-06T00:46:06.449ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
202026-02-06T00:46:06.449ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::12
212026-02-06T00:46:06.449ZINFOcrucible-agent (worker): commit
222026-02-06T00:46:06.498ZINFOcrucible-agent (worker): ok!
232026-02-06T00:46:06.545ZINFOcrucible-agent (worker): SMF ok!
242026-02-06T00:46:09.212ZINFOcrucible-agent (dropshot): request completed latency_us = 69 local_addr = [fd00:1122:3344:101::12]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:50355 req_id = d51be95d-eb56-4a92-a883-63e0701160b5 response_code = 200 uri = /crucible/0/regions/d934f5dd-cf8e-45f1-b130-932202990ccd
252026-02-06T00:46:09.215ZINFOcrucible-agent (datafile): path is "/data/regions/d934f5dd-cf8e-45f1-b130-932202990ccd"
262026-02-06T00:46:09.222ZINFOcrucible-agent (datafile): dataset is oxp_c51e58bd-01f8-48f0-99dd-59a3a179418f/crucible/regions/d934f5dd-cf8e-45f1-b130-932202990ccd
272026-02-06T00:46:09.229ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_c51e58bd-01f8-48f0-99dd-59a3a179418f/crucible/regions/d934f5dd-cf8e-45f1-b130-932202990ccd@fafad149-e28e-4656-9682-a95872bfa17f
282026-02-06T00:46:09.229ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_c51e58bd-01f8-48f0-99dd-59a3a179418f/crucible/regions/d934f5dd-cf8e-45f1-b130-932202990ccd", "fafad149-e28e-4656-9682-a95872bfa17f"]
292026-02-06T00:46:09.240ZINFOcrucible-agent (dropshot): request completed latency_us = 24828 local_addr = [fd00:1122:3344:101::12]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:50355 req_id = 7c70e511-34bc-46a9-9411-de855a514e89 response_code = 200 uri = /crucible/0/regions/d934f5dd-cf8e-45f1-b130-932202990ccd/snapshots/fafad149-e28e-4656-9682-a95872bfa17f
302026-02-06T00:46:09.244ZINFOcrucible-agent (datafile): path is "/data/regions/d934f5dd-cf8e-45f1-b130-932202990ccd"
312026-02-06T00:46:09.251ZINFOcrucible-agent (datafile): dataset is oxp_c51e58bd-01f8-48f0-99dd-59a3a179418f/crucible/regions/d934f5dd-cf8e-45f1-b130-932202990ccd
322026-02-06T00:46:09.256ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_c51e58bd-01f8-48f0-99dd-59a3a179418f/crucible/regions/d934f5dd-cf8e-45f1-b130-932202990ccd@fafad149-e28e-4656-9682-a95872bfa17f
332026-02-06T00:46:09.256ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_c51e58bd-01f8-48f0-99dd-59a3a179418f/crucible/regions/d934f5dd-cf8e-45f1-b130-932202990ccd", "fafad149-e28e-4656-9682-a95872bfa17f"]
342026-02-06T00:46:09.263ZINFOcrucible-agent (datafile): requesting running snapshot d934f5dd-cf8e-45f1-b130-932202990ccd-fafad149-e28e-4656-9682-a95872bfa17f state: Requested
352026-02-06T00:46:09.263ZINFOcrucible-agent (dropshot): request completed latency_us = 18446 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:50355 req_id = cd4ef794-b81b-4bb3-99bf-9ef4c83d964a response_code = 200 uri = /crucible/0/regions/d934f5dd-cf8e-45f1-b130-932202990ccd/snapshots/fafad149-e28e-4656-9682-a95872bfa17f/run
362026-02-06T00:46:09.263ZINFOcrucible-agent (worker): applying SMF actions for region d934f5dd-cf8e-45f1-b130-932202990ccd running snapshot fafad149-e28e-4656-9682-a95872bfa17f (state Requested)...
372026-02-06T00:46:09.267ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-d934f5dd-cf8e-45f1-b130-932202990ccd-fafad149-e28e-4656-9682-a95872bfa17f
382026-02-06T00:46:09.293ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-d934f5dd-cf8e-45f1-b130-932202990ccd-fafad149-e28e-4656-9682-a95872bfa17f
392026-02-06T00:46:09.363ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-d934f5dd-cf8e-45f1-b130-932202990ccd-fafad149-e28e-4656-9682-a95872bfa17f
402026-02-06T00:46:09.364ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/d934f5dd-cf8e-45f1-b130-932202990ccd/.zfs/snapshot/fafad149-e28e-4656-9682-a95872bfa17f
412026-02-06T00:46:09.364ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19002
422026-02-06T00:46:09.364ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
432026-02-06T00:46:09.364ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::12
442026-02-06T00:46:09.364ZINFOcrucible-agent (worker): commit
452026-02-06T00:46:09.382ZINFOcrucible-agent (worker): ok!
462026-02-06T00:46:09.398ZINFOcrucible-agent (worker): SMF ok!
472026-02-06T00:46:09.398ZINFOcrucible-agent (datafile): region d934f5dd-cf8e-45f1-b130-932202990ccd running snapshot fafad149-e28e-4656-9682-a95872bfa17f state: Requested -> Created
482026-02-06T00:46:09.428ZINFOcrucible-agent (datafile): path is "/data/regions/d934f5dd-cf8e-45f1-b130-932202990ccd"
492026-02-06T00:46:09.435ZINFOcrucible-agent (datafile): dataset is oxp_c51e58bd-01f8-48f0-99dd-59a3a179418f/crucible/regions/d934f5dd-cf8e-45f1-b130-932202990ccd
502026-02-06T00:46:09.442ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_c51e58bd-01f8-48f0-99dd-59a3a179418f/crucible/regions/d934f5dd-cf8e-45f1-b130-932202990ccd@fafad149-e28e-4656-9682-a95872bfa17f
512026-02-06T00:46:09.442ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_c51e58bd-01f8-48f0-99dd-59a3a179418f/crucible/regions/d934f5dd-cf8e-45f1-b130-932202990ccd", "fafad149-e28e-4656-9682-a95872bfa17f"]
522026-02-06T00:46:09.447ZINFOcrucible-agent (dropshot): request completed latency_us = 19166 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:50355 req_id = 47dd990a-819e-4b13-ab4d-76be5244ef0f response_code = 200 uri = /crucible/0/regions/d934f5dd-cf8e-45f1-b130-932202990ccd/snapshots/fafad149-e28e-4656-9682-a95872bfa17f/run