Max level shown:
12026-01-06T02:01:10.490ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::17]:32345 remote_addr = [fd00:1122:3344:101::c]:52084
22026-01-06T02:01:10.490ZINFOcrucible-agent (datafile): region ac4bf33b-129e-4a55-924b-e9a622177ab4 state: Requested
32026-01-06T02:01:10.491ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
42026-01-06T02:01:10.491ZINFOcrucible-agent (dropshot): request completed latency_us = 589 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:52084 req_id = ade74a1a-b076-4ff9-8b75-c27cbcf402ad response_code = 200 uri = /crucible/0/regions
52026-01-06T02:01:10.500ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_db595418-f246-4363-9891-59f47d3ae442/crucible/regions/ac4bf33b-129e-4a55-924b-e9a622177ab4
62026-01-06T02:01:10.500ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_db595418-f246-4363-9891-59f47d3ae442/crucible/regions/ac4bf33b-129e-4a55-924b-e9a622177ab4
72026-01-06T02:01:10.543ZINFOcrucible-agent (worker): creating region Region { id: RegionId("ac4bf33b-129e-4a55-924b-e9a622177ab4"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/ac4bf33b-129e-4a55-924b-e9a622177ab4" region = ac4bf33b-129e-4a55-924b-e9a622177ab4
82026-01-06T02:01:10.543ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "ac4bf33b-129e-4a55-924b-e9a622177ab4" "--data" "/data/regions/ac4bf33b-129e-4a55-924b-e9a622177ab4" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = ac4bf33b-129e-4a55-924b-e9a622177ab4
92026-01-06T02:01:10.623ZINFOcrucible-agent (worker): region files created ok region = ac4bf33b-129e-4a55-924b-e9a622177ab4
102026-01-06T02:01:10.623ZINFOcrucible-agent (datafile): region ac4bf33b-129e-4a55-924b-e9a622177ab4 state: Requested -> Created
112026-01-06T02:01:10.623ZINFOcrucible-agent (worker): applying SMF actions post create...
122026-01-06T02:01:10.639ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-ac4bf33b-129e-4a55-924b-e9a622177ab4
132026-01-06T02:01:10.645ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-ac4bf33b-129e-4a55-924b-e9a622177ab4
142026-01-06T02:01:10.657ZINFOcrucible-agent (worker): creating config property group
152026-01-06T02:01:10.660ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-ac4bf33b-129e-4a55-924b-e9a622177ab4
162026-01-06T02:01:10.660ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/ac4bf33b-129e-4a55-924b-e9a622177ab4
172026-01-06T02:01:10.660ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
182026-01-06T02:01:10.660ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::17
192026-01-06T02:01:10.660ZINFOcrucible-agent (worker): commit
202026-01-06T02:01:10.665ZINFOcrucible-agent (worker): ok!
212026-01-06T02:01:10.671ZINFOcrucible-agent (worker): SMF ok!
222026-01-06T02:01:10.744ZINFOcrucible-agent (dropshot): request completed latency_us = 57 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:52084 req_id = 84212047-6ecd-4cd8-bbed-0e03a1aaf3ca response_code = 200 uri = /crucible/0/regions
232026-01-06T02:01:11.829ZINFOcrucible-agent (dropshot): request completed latency_us = 72 local_addr = [fd00:1122:3344:101::17]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:52084 req_id = e928dedd-e489-4261-b878-4561dfe07055 response_code = 200 uri = /crucible/0/regions/5f49434b-eba7-4caa-bd53-1b12247ef32f
242026-01-06T02:01:11.832ZINFOcrucible-agent (datafile): path is "/data/regions/5f49434b-eba7-4caa-bd53-1b12247ef32f"
252026-01-06T02:01:11.838ZINFOcrucible-agent (datafile): dataset is oxp_db595418-f246-4363-9891-59f47d3ae442/crucible/regions/5f49434b-eba7-4caa-bd53-1b12247ef32f
262026-01-06T02:01:11.845ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_db595418-f246-4363-9891-59f47d3ae442/crucible/regions/5f49434b-eba7-4caa-bd53-1b12247ef32f@dccc1d94-360c-4d66-b204-8d475c204b3a
272026-01-06T02:01:11.845ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_db595418-f246-4363-9891-59f47d3ae442/crucible/regions/5f49434b-eba7-4caa-bd53-1b12247ef32f", "dccc1d94-360c-4d66-b204-8d475c204b3a"]
282026-01-06T02:01:11.854ZINFOcrucible-agent (dropshot): request completed latency_us = 21492 local_addr = [fd00:1122:3344:101::17]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:52084 req_id = b5bf51ce-b61e-4f08-9acb-39b6978b9076 response_code = 200 uri = /crucible/0/regions/5f49434b-eba7-4caa-bd53-1b12247ef32f/snapshots/dccc1d94-360c-4d66-b204-8d475c204b3a
292026-01-06T02:01:11.857ZINFOcrucible-agent (datafile): path is "/data/regions/5f49434b-eba7-4caa-bd53-1b12247ef32f"
302026-01-06T02:01:11.864ZINFOcrucible-agent (datafile): dataset is oxp_db595418-f246-4363-9891-59f47d3ae442/crucible/regions/5f49434b-eba7-4caa-bd53-1b12247ef32f
312026-01-06T02:01:11.869ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_db595418-f246-4363-9891-59f47d3ae442/crucible/regions/5f49434b-eba7-4caa-bd53-1b12247ef32f@dccc1d94-360c-4d66-b204-8d475c204b3a
322026-01-06T02:01:11.870ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_db595418-f246-4363-9891-59f47d3ae442/crucible/regions/5f49434b-eba7-4caa-bd53-1b12247ef32f", "dccc1d94-360c-4d66-b204-8d475c204b3a"]
332026-01-06T02:01:11.877ZINFOcrucible-agent (datafile): requesting running snapshot 5f49434b-eba7-4caa-bd53-1b12247ef32f-dccc1d94-360c-4d66-b204-8d475c204b3a state: Requested
342026-01-06T02:01:11.877ZINFOcrucible-agent (worker): applying SMF actions for region 5f49434b-eba7-4caa-bd53-1b12247ef32f running snapshot dccc1d94-360c-4d66-b204-8d475c204b3a (state Requested)...
352026-01-06T02:01:11.877ZINFOcrucible-agent (dropshot): request completed latency_us = 20071 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:52084 req_id = e9d12b36-cbf8-42d0-9a22-92b0ca5daabc response_code = 200 uri = /crucible/0/regions/5f49434b-eba7-4caa-bd53-1b12247ef32f/snapshots/dccc1d94-360c-4d66-b204-8d475c204b3a/run
362026-01-06T02:01:11.881ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-5f49434b-eba7-4caa-bd53-1b12247ef32f-dccc1d94-360c-4d66-b204-8d475c204b3a
372026-01-06T02:01:11.890ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-5f49434b-eba7-4caa-bd53-1b12247ef32f-dccc1d94-360c-4d66-b204-8d475c204b3a
382026-01-06T02:01:11.900ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-5f49434b-eba7-4caa-bd53-1b12247ef32f-dccc1d94-360c-4d66-b204-8d475c204b3a
392026-01-06T02:01:11.901ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/5f49434b-eba7-4caa-bd53-1b12247ef32f/.zfs/snapshot/dccc1d94-360c-4d66-b204-8d475c204b3a
402026-01-06T02:01:11.901ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19002
412026-01-06T02:01:11.901ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
422026-01-06T02:01:11.901ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::17
432026-01-06T02:01:11.901ZINFOcrucible-agent (worker): commit
442026-01-06T02:01:11.905ZINFOcrucible-agent (worker): ok!
452026-01-06T02:01:11.909ZINFOcrucible-agent (worker): SMF ok!
462026-01-06T02:01:11.909ZINFOcrucible-agent (datafile): region 5f49434b-eba7-4caa-bd53-1b12247ef32f running snapshot dccc1d94-360c-4d66-b204-8d475c204b3a state: Requested -> Created
472026-01-06T02:01:12.169ZINFOcrucible-agent (datafile): path is "/data/regions/5f49434b-eba7-4caa-bd53-1b12247ef32f"
482026-01-06T02:01:12.175ZINFOcrucible-agent (datafile): dataset is oxp_db595418-f246-4363-9891-59f47d3ae442/crucible/regions/5f49434b-eba7-4caa-bd53-1b12247ef32f
492026-01-06T02:01:12.181ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_db595418-f246-4363-9891-59f47d3ae442/crucible/regions/5f49434b-eba7-4caa-bd53-1b12247ef32f@dccc1d94-360c-4d66-b204-8d475c204b3a
502026-01-06T02:01:12.181ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_db595418-f246-4363-9891-59f47d3ae442/crucible/regions/5f49434b-eba7-4caa-bd53-1b12247ef32f", "dccc1d94-360c-4d66-b204-8d475c204b3a"]
512026-01-06T02:01:12.186ZINFOcrucible-agent (dropshot): request completed latency_us = 17292 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:52084 req_id = 4afdeb66-ed17-4df2-b41a-a6bb27cb8cec response_code = 200 uri = /crucible/0/regions/5f49434b-eba7-4caa-bd53-1b12247ef32f/snapshots/dccc1d94-360c-4d66-b204-8d475c204b3a/run