Max level shown:
12026-03-31T02:07:48.832ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::14]:32345 remote_addr = [fd00:1122:3344:101::c]:43663
22026-03-31T02:07:48.832ZINFOcrucible-agent (datafile): region 9c632236-9036-402c-be82-190478039adb state: Requested
32026-03-31T02:07:48.834ZINFOcrucible-agent (dropshot): request completed latency_us = 1404 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:43663 req_id = 03f9f072-a7ee-4d92-ae04-8ea6f9966d41 response_code = 200 uri = /crucible/0/regions
42026-03-31T02:07:48.834ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
52026-03-31T02:07:48.843ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_ecb18f39-3ed8-440f-b4a8-1c69c14d689b/crucible/regions/9c632236-9036-402c-be82-190478039adb
62026-03-31T02:07:48.843ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_ecb18f39-3ed8-440f-b4a8-1c69c14d689b/crucible/regions/9c632236-9036-402c-be82-190478039adb
72026-03-31T02:07:48.933ZINFOcrucible-agent (worker): creating region Region { id: RegionId("9c632236-9036-402c-be82-190478039adb"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/9c632236-9036-402c-be82-190478039adb" region = 9c632236-9036-402c-be82-190478039adb
82026-03-31T02:07:48.933ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "9c632236-9036-402c-be82-190478039adb" "--data" "/data/regions/9c632236-9036-402c-be82-190478039adb" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 9c632236-9036-402c-be82-190478039adb
92026-03-31T02:07:49.042ZINFOcrucible-agent (dropshot): request completed latency_us = 114 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:43663 req_id = b630e981-b7c2-42fc-894d-41cadf1ea04f response_code = 200 uri = /crucible/0/regions
102026-03-31T02:07:49.220ZINFOcrucible-agent (worker): region files created ok region = 9c632236-9036-402c-be82-190478039adb
112026-03-31T02:07:49.220ZINFOcrucible-agent (datafile): region 9c632236-9036-402c-be82-190478039adb state: Requested -> Created
122026-03-31T02:07:49.221ZINFOcrucible-agent (worker): applying SMF actions post create...
132026-03-31T02:07:49.250ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-9c632236-9036-402c-be82-190478039adb
142026-03-31T02:07:49.276ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-9c632236-9036-402c-be82-190478039adb
152026-03-31T02:07:49.311ZINFOcrucible-agent (worker): creating config property group
162026-03-31T02:07:49.319ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-9c632236-9036-402c-be82-190478039adb
172026-03-31T02:07:49.319ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/9c632236-9036-402c-be82-190478039adb
182026-03-31T02:07:49.319ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
192026-03-31T02:07:49.319ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::14
202026-03-31T02:07:49.319ZINFOcrucible-agent (worker): commit
212026-03-31T02:07:49.327ZINFOcrucible-agent (worker): ok!
222026-03-31T02:07:49.336ZINFOcrucible-agent (dropshot): request completed latency_us = 52 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:43663 req_id = 19d85422-1a4b-471e-9feb-3075e836a5f5 response_code = 200 uri = /crucible/0/regions
232026-03-31T02:07:49.349ZINFOcrucible-agent (worker): SMF ok!
242026-03-31T02:07:51.777ZINFOcrucible-agent (dropshot): request completed latency_us = 52 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:43663 req_id = 044c7373-b105-4388-bdd3-fbfceab5adc8 response_code = 200 uri = /crucible/0/regions/0bab5f8c-b30b-4c03-841f-0ad01bedb070
252026-03-31T02:07:51.780ZINFOcrucible-agent (datafile): path is "/data/regions/0bab5f8c-b30b-4c03-841f-0ad01bedb070"
262026-03-31T02:07:51.787ZINFOcrucible-agent (datafile): dataset is oxp_ecb18f39-3ed8-440f-b4a8-1c69c14d689b/crucible/regions/0bab5f8c-b30b-4c03-841f-0ad01bedb070
272026-03-31T02:07:51.793ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_ecb18f39-3ed8-440f-b4a8-1c69c14d689b/crucible/regions/0bab5f8c-b30b-4c03-841f-0ad01bedb070@3e8641c6-9aa7-4c84-94b7-f0f81ba42887
282026-03-31T02:07:51.793ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_ecb18f39-3ed8-440f-b4a8-1c69c14d689b/crucible/regions/0bab5f8c-b30b-4c03-841f-0ad01bedb070", "3e8641c6-9aa7-4c84-94b7-f0f81ba42887"]
292026-03-31T02:07:51.805ZINFOcrucible-agent (dropshot): request completed latency_us = 25525 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:43663 req_id = fb2743a2-61e9-43a6-aeef-bef715e4dfc5 response_code = 200 uri = /crucible/0/regions/0bab5f8c-b30b-4c03-841f-0ad01bedb070/snapshots/3e8641c6-9aa7-4c84-94b7-f0f81ba42887
302026-03-31T02:07:51.809ZINFOcrucible-agent (datafile): path is "/data/regions/0bab5f8c-b30b-4c03-841f-0ad01bedb070"
312026-03-31T02:07:51.814ZINFOcrucible-agent (datafile): dataset is oxp_ecb18f39-3ed8-440f-b4a8-1c69c14d689b/crucible/regions/0bab5f8c-b30b-4c03-841f-0ad01bedb070
322026-03-31T02:07:51.820ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_ecb18f39-3ed8-440f-b4a8-1c69c14d689b/crucible/regions/0bab5f8c-b30b-4c03-841f-0ad01bedb070@3e8641c6-9aa7-4c84-94b7-f0f81ba42887
332026-03-31T02:07:51.820ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_ecb18f39-3ed8-440f-b4a8-1c69c14d689b/crucible/regions/0bab5f8c-b30b-4c03-841f-0ad01bedb070", "3e8641c6-9aa7-4c84-94b7-f0f81ba42887"]
342026-03-31T02:07:51.833ZINFOcrucible-agent (datafile): requesting running snapshot 0bab5f8c-b30b-4c03-841f-0ad01bedb070-3e8641c6-9aa7-4c84-94b7-f0f81ba42887 state: Requested
352026-03-31T02:07:51.833ZINFOcrucible-agent (dropshot): request completed latency_us = 24332 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:43663 req_id = 17b50d39-840a-4453-9ed2-51f54ce16315 response_code = 200 uri = /crucible/0/regions/0bab5f8c-b30b-4c03-841f-0ad01bedb070/snapshots/3e8641c6-9aa7-4c84-94b7-f0f81ba42887/run
362026-03-31T02:07:51.833ZINFOcrucible-agent (worker): applying SMF actions for region 0bab5f8c-b30b-4c03-841f-0ad01bedb070 running snapshot 3e8641c6-9aa7-4c84-94b7-f0f81ba42887 (state Requested)...
372026-03-31T02:07:51.838ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-0bab5f8c-b30b-4c03-841f-0ad01bedb070-3e8641c6-9aa7-4c84-94b7-f0f81ba42887
382026-03-31T02:07:51.848ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-0bab5f8c-b30b-4c03-841f-0ad01bedb070-3e8641c6-9aa7-4c84-94b7-f0f81ba42887
392026-03-31T02:07:51.879ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-0bab5f8c-b30b-4c03-841f-0ad01bedb070-3e8641c6-9aa7-4c84-94b7-f0f81ba42887
402026-03-31T02:07:51.879ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/0bab5f8c-b30b-4c03-841f-0ad01bedb070/.zfs/snapshot/3e8641c6-9aa7-4c84-94b7-f0f81ba42887
412026-03-31T02:07:51.879ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19002
422026-03-31T02:07:51.880ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
432026-03-31T02:07:51.880ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::14
442026-03-31T02:07:51.880ZINFOcrucible-agent (worker): commit
452026-03-31T02:07:51.891ZINFOcrucible-agent (worker): ok!
462026-03-31T02:07:51.923ZINFOcrucible-agent (worker): SMF ok!
472026-03-31T02:07:51.923ZINFOcrucible-agent (datafile): region 0bab5f8c-b30b-4c03-841f-0ad01bedb070 running snapshot 3e8641c6-9aa7-4c84-94b7-f0f81ba42887 state: Requested -> Created
482026-03-31T02:07:52.007ZINFOcrucible-agent (datafile): path is "/data/regions/0bab5f8c-b30b-4c03-841f-0ad01bedb070"
492026-03-31T02:07:52.013ZINFOcrucible-agent (datafile): dataset is oxp_ecb18f39-3ed8-440f-b4a8-1c69c14d689b/crucible/regions/0bab5f8c-b30b-4c03-841f-0ad01bedb070
502026-03-31T02:07:52.021ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_ecb18f39-3ed8-440f-b4a8-1c69c14d689b/crucible/regions/0bab5f8c-b30b-4c03-841f-0ad01bedb070@3e8641c6-9aa7-4c84-94b7-f0f81ba42887
512026-03-31T02:07:52.021ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_ecb18f39-3ed8-440f-b4a8-1c69c14d689b/crucible/regions/0bab5f8c-b30b-4c03-841f-0ad01bedb070", "3e8641c6-9aa7-4c84-94b7-f0f81ba42887"]
522026-03-31T02:07:52.027ZINFOcrucible-agent (dropshot): request completed latency_us = 20346 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:43663 req_id = e5455ab2-9b45-4ac6-b1dc-7568ed00b3f1 response_code = 200 uri = /crucible/0/regions/0bab5f8c-b30b-4c03-841f-0ad01bedb070/snapshots/3e8641c6-9aa7-4c84-94b7-f0f81ba42887/run