Max level shown:
12026-02-12T06:51:55.813ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::15]:32345 remote_addr = [fd00:1122:3344:101::a]:52974
22026-02-12T06:51:55.813ZINFOcrucible-agent (datafile): region f8624893-c930-4cee-a79c-2ad31831fc8d state: Requested
32026-02-12T06:51:55.814ZINFOcrucible-agent (dropshot): request completed latency_us = 908 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:52974 req_id = 0c9c1f68-2984-44d4-959b-5080b475a9d7 response_code = 200 uri = /crucible/0/regions
42026-02-12T06:51:55.814ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
52026-02-12T06:51:55.823ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_e2c81a1b-dcea-4841-9753-90ab02be3d70/crucible/regions/f8624893-c930-4cee-a79c-2ad31831fc8d
62026-02-12T06:51:55.823ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_e2c81a1b-dcea-4841-9753-90ab02be3d70/crucible/regions/f8624893-c930-4cee-a79c-2ad31831fc8d
72026-02-12T06:51:55.873ZINFOcrucible-agent (worker): creating region Region { id: RegionId("f8624893-c930-4cee-a79c-2ad31831fc8d"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/f8624893-c930-4cee-a79c-2ad31831fc8d" region = f8624893-c930-4cee-a79c-2ad31831fc8d
82026-02-12T06:51:55.873ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "f8624893-c930-4cee-a79c-2ad31831fc8d" "--data" "/data/regions/f8624893-c930-4cee-a79c-2ad31831fc8d" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = f8624893-c930-4cee-a79c-2ad31831fc8d
92026-02-12T06:51:55.959ZINFOcrucible-agent (worker): region files created ok region = f8624893-c930-4cee-a79c-2ad31831fc8d
102026-02-12T06:51:55.959ZINFOcrucible-agent (datafile): region f8624893-c930-4cee-a79c-2ad31831fc8d state: Requested -> Created
112026-02-12T06:51:55.959ZINFOcrucible-agent (worker): applying SMF actions post create...
122026-02-12T06:51:55.981ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-f8624893-c930-4cee-a79c-2ad31831fc8d
132026-02-12T06:51:55.988ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-f8624893-c930-4cee-a79c-2ad31831fc8d
142026-02-12T06:51:55.998ZINFOcrucible-agent (worker): creating config property group
152026-02-12T06:51:56.002ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-f8624893-c930-4cee-a79c-2ad31831fc8d
162026-02-12T06:51:56.002ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/f8624893-c930-4cee-a79c-2ad31831fc8d
172026-02-12T06:51:56.002ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
182026-02-12T06:51:56.002ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::15
192026-02-12T06:51:56.002ZINFOcrucible-agent (worker): commit
202026-02-12T06:51:56.006ZINFOcrucible-agent (worker): ok!
212026-02-12T06:51:56.010ZINFOcrucible-agent (worker): SMF ok!
222026-02-12T06:51:56.026ZINFOcrucible-agent (dropshot): request completed latency_us = 63 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:52974 req_id = de8e4ebf-3a45-47db-8235-c030ef1a2b09 response_code = 200 uri = /crucible/0/regions
232026-02-12T06:51:57.219ZINFOcrucible-agent (dropshot): request completed latency_us = 74 local_addr = [fd00:1122:3344:101::15]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:52974 req_id = 3e35ccea-0689-42f4-a303-9b4bc9a58b50 response_code = 200 uri = /crucible/0/regions/842be38d-d1dd-400a-bd8b-7005744b38db
242026-02-12T06:51:57.223ZINFOcrucible-agent (datafile): path is "/data/regions/842be38d-d1dd-400a-bd8b-7005744b38db"
252026-02-12T06:51:57.229ZINFOcrucible-agent (datafile): dataset is oxp_e2c81a1b-dcea-4841-9753-90ab02be3d70/crucible/regions/842be38d-d1dd-400a-bd8b-7005744b38db
262026-02-12T06:51:57.234ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_e2c81a1b-dcea-4841-9753-90ab02be3d70/crucible/regions/842be38d-d1dd-400a-bd8b-7005744b38db@c55a4f1a-58f4-48b8-a21d-44400b45c78a
272026-02-12T06:51:57.234ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_e2c81a1b-dcea-4841-9753-90ab02be3d70/crucible/regions/842be38d-d1dd-400a-bd8b-7005744b38db", "c55a4f1a-58f4-48b8-a21d-44400b45c78a"]
282026-02-12T06:51:57.241ZINFOcrucible-agent (dropshot): request completed latency_us = 17613 local_addr = [fd00:1122:3344:101::15]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:52974 req_id = da9dd4d4-9ba5-4994-acad-38ce84b18200 response_code = 200 uri = /crucible/0/regions/842be38d-d1dd-400a-bd8b-7005744b38db/snapshots/c55a4f1a-58f4-48b8-a21d-44400b45c78a
292026-02-12T06:51:57.244ZINFOcrucible-agent (datafile): path is "/data/regions/842be38d-d1dd-400a-bd8b-7005744b38db"
302026-02-12T06:51:57.249ZINFOcrucible-agent (datafile): dataset is oxp_e2c81a1b-dcea-4841-9753-90ab02be3d70/crucible/regions/842be38d-d1dd-400a-bd8b-7005744b38db
312026-02-12T06:51:57.253ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_e2c81a1b-dcea-4841-9753-90ab02be3d70/crucible/regions/842be38d-d1dd-400a-bd8b-7005744b38db@c55a4f1a-58f4-48b8-a21d-44400b45c78a
322026-02-12T06:51:57.253ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_e2c81a1b-dcea-4841-9753-90ab02be3d70/crucible/regions/842be38d-d1dd-400a-bd8b-7005744b38db", "c55a4f1a-58f4-48b8-a21d-44400b45c78a"]
332026-02-12T06:51:57.262ZINFOcrucible-agent (datafile): requesting running snapshot 842be38d-d1dd-400a-bd8b-7005744b38db-c55a4f1a-58f4-48b8-a21d-44400b45c78a state: Requested
342026-02-12T06:51:57.262ZINFOcrucible-agent (dropshot): request completed latency_us = 17603 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:52974 req_id = ee4be53f-e1f2-4134-aec9-e533530f5577 response_code = 200 uri = /crucible/0/regions/842be38d-d1dd-400a-bd8b-7005744b38db/snapshots/c55a4f1a-58f4-48b8-a21d-44400b45c78a/run
352026-02-12T06:51:57.262ZINFOcrucible-agent (worker): applying SMF actions for region 842be38d-d1dd-400a-bd8b-7005744b38db running snapshot c55a4f1a-58f4-48b8-a21d-44400b45c78a (state Requested)...
362026-02-12T06:51:57.266ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-842be38d-d1dd-400a-bd8b-7005744b38db-c55a4f1a-58f4-48b8-a21d-44400b45c78a
372026-02-12T06:51:57.280ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-842be38d-d1dd-400a-bd8b-7005744b38db-c55a4f1a-58f4-48b8-a21d-44400b45c78a
382026-02-12T06:51:57.290ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-842be38d-d1dd-400a-bd8b-7005744b38db-c55a4f1a-58f4-48b8-a21d-44400b45c78a
392026-02-12T06:51:57.291ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/842be38d-d1dd-400a-bd8b-7005744b38db/.zfs/snapshot/c55a4f1a-58f4-48b8-a21d-44400b45c78a
402026-02-12T06:51:57.291ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19002
412026-02-12T06:51:57.291ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
422026-02-12T06:51:57.291ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::15
432026-02-12T06:51:57.291ZINFOcrucible-agent (worker): commit
442026-02-12T06:51:57.295ZINFOcrucible-agent (worker): ok!
452026-02-12T06:51:57.299ZINFOcrucible-agent (worker): SMF ok!
462026-02-12T06:51:57.299ZINFOcrucible-agent (datafile): region 842be38d-d1dd-400a-bd8b-7005744b38db running snapshot c55a4f1a-58f4-48b8-a21d-44400b45c78a state: Requested -> Created
472026-02-12T06:51:57.634ZINFOcrucible-agent (datafile): path is "/data/regions/842be38d-d1dd-400a-bd8b-7005744b38db"
482026-02-12T06:51:57.641ZINFOcrucible-agent (datafile): dataset is oxp_e2c81a1b-dcea-4841-9753-90ab02be3d70/crucible/regions/842be38d-d1dd-400a-bd8b-7005744b38db
492026-02-12T06:51:57.647ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_e2c81a1b-dcea-4841-9753-90ab02be3d70/crucible/regions/842be38d-d1dd-400a-bd8b-7005744b38db@c55a4f1a-58f4-48b8-a21d-44400b45c78a
502026-02-12T06:51:57.647ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_e2c81a1b-dcea-4841-9753-90ab02be3d70/crucible/regions/842be38d-d1dd-400a-bd8b-7005744b38db", "c55a4f1a-58f4-48b8-a21d-44400b45c78a"]
512026-02-12T06:51:57.653ZINFOcrucible-agent (dropshot): request completed latency_us = 19437 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:52974 req_id = c7c8af9b-0f6d-43eb-8ca3-c71a213e467f response_code = 200 uri = /crucible/0/regions/842be38d-d1dd-400a-bd8b-7005744b38db/snapshots/c55a4f1a-58f4-48b8-a21d-44400b45c78a/run