Max level shown:
12026-01-20T22:26:15.723ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::14]:32345 remote_addr = [fd00:1122:3344:101::c]:33099
22026-01-20T22:26:15.723ZINFOcrucible-agent (datafile): region ba39c300-aed0-4273-a85a-124364a70e22 state: Requested
32026-01-20T22:26:15.724ZINFOcrucible-agent (dropshot): request completed latency_us = 669 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:33099 req_id = a4d75be4-c2e4-45fe-9d45-20b095462262 response_code = 200 uri = /crucible/0/regions
42026-01-20T22:26:15.724ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
52026-01-20T22:26:15.733ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_fb3af205-9d7f-4aaa-85eb-80b63bb98dc4/crucible/regions/ba39c300-aed0-4273-a85a-124364a70e22
62026-01-20T22:26:15.733ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_fb3af205-9d7f-4aaa-85eb-80b63bb98dc4/crucible/regions/ba39c300-aed0-4273-a85a-124364a70e22
72026-01-20T22:26:15.807ZINFOcrucible-agent (worker): creating region Region { id: RegionId("ba39c300-aed0-4273-a85a-124364a70e22"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/ba39c300-aed0-4273-a85a-124364a70e22" region = ba39c300-aed0-4273-a85a-124364a70e22
82026-01-20T22:26:15.807ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "ba39c300-aed0-4273-a85a-124364a70e22" "--data" "/data/regions/ba39c300-aed0-4273-a85a-124364a70e22" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = ba39c300-aed0-4273-a85a-124364a70e22
92026-01-20T22:26:15.950ZINFOcrucible-agent (dropshot): request completed latency_us = 56 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:33099 req_id = 8ce23ae2-61f2-48d5-a363-150fffb98599 response_code = 200 uri = /crucible/0/regions
102026-01-20T22:26:16.019ZINFOcrucible-agent (worker): region files created ok region = ba39c300-aed0-4273-a85a-124364a70e22
112026-01-20T22:26:16.019ZINFOcrucible-agent (datafile): region ba39c300-aed0-4273-a85a-124364a70e22 state: Requested -> Created
122026-01-20T22:26:16.019ZINFOcrucible-agent (worker): applying SMF actions post create...
132026-01-20T22:26:16.020ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-ba39c300-aed0-4273-a85a-124364a70e22
142026-01-20T22:26:16.031ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-ba39c300-aed0-4273-a85a-124364a70e22
152026-01-20T22:26:16.059ZINFOcrucible-agent (worker): creating config property group
162026-01-20T22:26:16.069ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-ba39c300-aed0-4273-a85a-124364a70e22
172026-01-20T22:26:16.069ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/ba39c300-aed0-4273-a85a-124364a70e22
182026-01-20T22:26:16.069ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
192026-01-20T22:26:16.069ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::14
202026-01-20T22:26:16.069ZINFOcrucible-agent (worker): commit
212026-01-20T22:26:16.077ZINFOcrucible-agent (worker): ok!
222026-01-20T22:26:16.104ZINFOcrucible-agent (worker): SMF ok!
232026-01-20T22:26:16.543ZINFOcrucible-agent (dropshot): request completed latency_us = 62 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:33099 req_id = 214b8c5b-ef69-4369-be46-27b535f4d29e response_code = 200 uri = /crucible/0/regions
242026-01-20T22:26:18.101ZINFOcrucible-agent (dropshot): request completed latency_us = 76 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:33099 req_id = 598d883d-d7db-4cd3-b332-cbf650ba145f response_code = 200 uri = /crucible/0/regions/eb8f12dd-2723-4b4b-b00a-08a5c728cc9f
252026-01-20T22:26:18.105ZINFOcrucible-agent (datafile): path is "/data/regions/eb8f12dd-2723-4b4b-b00a-08a5c728cc9f"
262026-01-20T22:26:18.112ZINFOcrucible-agent (datafile): dataset is oxp_fb3af205-9d7f-4aaa-85eb-80b63bb98dc4/crucible/regions/eb8f12dd-2723-4b4b-b00a-08a5c728cc9f
272026-01-20T22:26:18.118ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_fb3af205-9d7f-4aaa-85eb-80b63bb98dc4/crucible/regions/eb8f12dd-2723-4b4b-b00a-08a5c728cc9f@094cffd9-500b-430a-a1cb-72188c8c19e1
282026-01-20T22:26:18.118ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_fb3af205-9d7f-4aaa-85eb-80b63bb98dc4/crucible/regions/eb8f12dd-2723-4b4b-b00a-08a5c728cc9f", "094cffd9-500b-430a-a1cb-72188c8c19e1"]
292026-01-20T22:26:18.126ZINFOcrucible-agent (dropshot): request completed latency_us = 21643 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:33099 req_id = e1460508-c356-4b4d-9796-03e88a8aaa6d response_code = 200 uri = /crucible/0/regions/eb8f12dd-2723-4b4b-b00a-08a5c728cc9f/snapshots/094cffd9-500b-430a-a1cb-72188c8c19e1
302026-01-20T22:26:18.130ZINFOcrucible-agent (datafile): path is "/data/regions/eb8f12dd-2723-4b4b-b00a-08a5c728cc9f"
312026-01-20T22:26:18.135ZINFOcrucible-agent (datafile): dataset is oxp_fb3af205-9d7f-4aaa-85eb-80b63bb98dc4/crucible/regions/eb8f12dd-2723-4b4b-b00a-08a5c728cc9f
322026-01-20T22:26:18.140ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_fb3af205-9d7f-4aaa-85eb-80b63bb98dc4/crucible/regions/eb8f12dd-2723-4b4b-b00a-08a5c728cc9f@094cffd9-500b-430a-a1cb-72188c8c19e1
332026-01-20T22:26:18.140ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_fb3af205-9d7f-4aaa-85eb-80b63bb98dc4/crucible/regions/eb8f12dd-2723-4b4b-b00a-08a5c728cc9f", "094cffd9-500b-430a-a1cb-72188c8c19e1"]
342026-01-20T22:26:18.147ZINFOcrucible-agent (datafile): requesting running snapshot eb8f12dd-2723-4b4b-b00a-08a5c728cc9f-094cffd9-500b-430a-a1cb-72188c8c19e1 state: Requested
352026-01-20T22:26:18.147ZINFOcrucible-agent (dropshot): request completed latency_us = 17374 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:33099 req_id = 436a761c-0f66-4c35-82fb-cb432aac9b78 response_code = 200 uri = /crucible/0/regions/eb8f12dd-2723-4b4b-b00a-08a5c728cc9f/snapshots/094cffd9-500b-430a-a1cb-72188c8c19e1/run
362026-01-20T22:26:18.147ZINFOcrucible-agent (worker): applying SMF actions for region eb8f12dd-2723-4b4b-b00a-08a5c728cc9f running snapshot 094cffd9-500b-430a-a1cb-72188c8c19e1 (state Requested)...
372026-01-20T22:26:18.152ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-eb8f12dd-2723-4b4b-b00a-08a5c728cc9f-094cffd9-500b-430a-a1cb-72188c8c19e1
382026-01-20T22:26:18.176ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-eb8f12dd-2723-4b4b-b00a-08a5c728cc9f-094cffd9-500b-430a-a1cb-72188c8c19e1
392026-01-20T22:26:18.201ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-eb8f12dd-2723-4b4b-b00a-08a5c728cc9f-094cffd9-500b-430a-a1cb-72188c8c19e1
402026-01-20T22:26:18.202ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/eb8f12dd-2723-4b4b-b00a-08a5c728cc9f/.zfs/snapshot/094cffd9-500b-430a-a1cb-72188c8c19e1
412026-01-20T22:26:18.202ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19002
422026-01-20T22:26:18.202ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
432026-01-20T22:26:18.202ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::14
442026-01-20T22:26:18.202ZINFOcrucible-agent (worker): commit
452026-01-20T22:26:18.209ZINFOcrucible-agent (worker): ok!
462026-01-20T22:26:18.216ZINFOcrucible-agent (worker): SMF ok!
472026-01-20T22:26:18.216ZINFOcrucible-agent (datafile): region eb8f12dd-2723-4b4b-b00a-08a5c728cc9f running snapshot 094cffd9-500b-430a-a1cb-72188c8c19e1 state: Requested -> Created
482026-01-20T22:26:18.441ZINFOcrucible-agent (datafile): path is "/data/regions/eb8f12dd-2723-4b4b-b00a-08a5c728cc9f"
492026-01-20T22:26:18.447ZINFOcrucible-agent (datafile): dataset is oxp_fb3af205-9d7f-4aaa-85eb-80b63bb98dc4/crucible/regions/eb8f12dd-2723-4b4b-b00a-08a5c728cc9f
502026-01-20T22:26:18.453ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_fb3af205-9d7f-4aaa-85eb-80b63bb98dc4/crucible/regions/eb8f12dd-2723-4b4b-b00a-08a5c728cc9f@094cffd9-500b-430a-a1cb-72188c8c19e1
512026-01-20T22:26:18.453ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_fb3af205-9d7f-4aaa-85eb-80b63bb98dc4/crucible/regions/eb8f12dd-2723-4b4b-b00a-08a5c728cc9f", "094cffd9-500b-430a-a1cb-72188c8c19e1"]
522026-01-20T22:26:18.459ZINFOcrucible-agent (dropshot): request completed latency_us = 18783 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:33099 req_id = b32cb475-8909-45e8-abc1-5d336c2b908e response_code = 200 uri = /crucible/0/regions/eb8f12dd-2723-4b4b-b00a-08a5c728cc9f/snapshots/094cffd9-500b-430a-a1cb-72188c8c19e1/run