Max level shown:
12026-04-29T21:03:14.058ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::15]:32345 remote_addr = [fd00:1122:3344:101::a]:56467
22026-04-29T21:03:14.059ZINFOcrucible-agent (datafile): region 1301d12f-2e88-4e22-ba6a-0ffc2eb435a4 state: Requested
32026-04-29T21:03:14.059ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
42026-04-29T21:03:14.059ZINFOcrucible-agent (dropshot): request completed latency_us = 678 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:56467 req_id = 73bd63f3-aa2a-4865-a83c-0b4ebec942fb response_code = 200 uri = /crucible/0/regions
52026-04-29T21:03:14.069ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_6ca8cbb9-3d45-4d36-9499-124825ae8f56/crucible/regions/1301d12f-2e88-4e22-ba6a-0ffc2eb435a4
62026-04-29T21:03:14.069ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_6ca8cbb9-3d45-4d36-9499-124825ae8f56/crucible/regions/1301d12f-2e88-4e22-ba6a-0ffc2eb435a4
72026-04-29T21:03:14.139ZINFOcrucible-agent (worker): creating region Region { id: RegionId("1301d12f-2e88-4e22-ba6a-0ffc2eb435a4"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/1301d12f-2e88-4e22-ba6a-0ffc2eb435a4" region = 1301d12f-2e88-4e22-ba6a-0ffc2eb435a4
82026-04-29T21:03:14.139ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "1301d12f-2e88-4e22-ba6a-0ffc2eb435a4" "--data" "/data/regions/1301d12f-2e88-4e22-ba6a-0ffc2eb435a4" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 1301d12f-2e88-4e22-ba6a-0ffc2eb435a4
92026-04-29T21:03:14.227ZINFOcrucible-agent (dropshot): request completed latency_us = 62 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:56467 req_id = 933a26ff-c4e5-4338-9246-0f7134ec7af0 response_code = 200 uri = /crucible/0/regions
102026-04-29T21:03:14.273ZINFOcrucible-agent (worker): region files created ok region = 1301d12f-2e88-4e22-ba6a-0ffc2eb435a4
112026-04-29T21:03:14.273ZINFOcrucible-agent (datafile): region 1301d12f-2e88-4e22-ba6a-0ffc2eb435a4 state: Requested -> Created
122026-04-29T21:03:14.273ZINFOcrucible-agent (worker): applying SMF actions post create...
132026-04-29T21:03:14.274ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-1301d12f-2e88-4e22-ba6a-0ffc2eb435a4
142026-04-29T21:03:14.291ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-1301d12f-2e88-4e22-ba6a-0ffc2eb435a4
152026-04-29T21:03:14.314ZINFOcrucible-agent (worker): creating config property group
162026-04-29T21:03:14.318ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-1301d12f-2e88-4e22-ba6a-0ffc2eb435a4
172026-04-29T21:03:14.319ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/1301d12f-2e88-4e22-ba6a-0ffc2eb435a4
182026-04-29T21:03:14.319ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
192026-04-29T21:03:14.319ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::15
202026-04-29T21:03:14.319ZINFOcrucible-agent (worker): commit
212026-04-29T21:03:14.323ZINFOcrucible-agent (worker): ok!
222026-04-29T21:03:14.340ZINFOcrucible-agent (worker): SMF ok!
232026-04-29T21:03:14.943ZINFOcrucible-agent (dropshot): request completed latency_us = 61 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:56467 req_id = 44cb51e9-c095-4e7a-b322-1838cc6e3ed7 response_code = 200 uri = /crucible/0/regions
242026-04-29T21:03:15.989ZINFOcrucible-agent (dropshot): request completed latency_us = 68 local_addr = [fd00:1122:3344:101::15]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:56467 req_id = 41fa6593-4b4d-4d2e-8f1e-6e251498b444 response_code = 200 uri = /crucible/0/regions/e2c717af-28e0-4f31-a006-d393788ffe77
252026-04-29T21:03:15.993ZINFOcrucible-agent (datafile): path is "/data/regions/e2c717af-28e0-4f31-a006-d393788ffe77"
262026-04-29T21:03:15.999ZINFOcrucible-agent (datafile): dataset is oxp_6ca8cbb9-3d45-4d36-9499-124825ae8f56/crucible/regions/e2c717af-28e0-4f31-a006-d393788ffe77
272026-04-29T21:03:16.005ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_6ca8cbb9-3d45-4d36-9499-124825ae8f56/crucible/regions/e2c717af-28e0-4f31-a006-d393788ffe77@158447a5-554e-4e22-a930-c556d9c8d608
282026-04-29T21:03:16.005ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_6ca8cbb9-3d45-4d36-9499-124825ae8f56/crucible/regions/e2c717af-28e0-4f31-a006-d393788ffe77", "158447a5-554e-4e22-a930-c556d9c8d608"]
292026-04-29T21:03:16.016ZINFOcrucible-agent (dropshot): request completed latency_us = 23299 local_addr = [fd00:1122:3344:101::15]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:56467 req_id = 60beddfd-fcf8-464b-a9b4-3956312f1f4c response_code = 200 uri = /crucible/0/regions/e2c717af-28e0-4f31-a006-d393788ffe77/snapshots/158447a5-554e-4e22-a930-c556d9c8d608
302026-04-29T21:03:16.019ZINFOcrucible-agent (datafile): path is "/data/regions/e2c717af-28e0-4f31-a006-d393788ffe77"
312026-04-29T21:03:16.025ZINFOcrucible-agent (datafile): dataset is oxp_6ca8cbb9-3d45-4d36-9499-124825ae8f56/crucible/regions/e2c717af-28e0-4f31-a006-d393788ffe77
322026-04-29T21:03:16.031ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_6ca8cbb9-3d45-4d36-9499-124825ae8f56/crucible/regions/e2c717af-28e0-4f31-a006-d393788ffe77@158447a5-554e-4e22-a930-c556d9c8d608
332026-04-29T21:03:16.031ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_6ca8cbb9-3d45-4d36-9499-124825ae8f56/crucible/regions/e2c717af-28e0-4f31-a006-d393788ffe77", "158447a5-554e-4e22-a930-c556d9c8d608"]
342026-04-29T21:03:16.040ZINFOcrucible-agent (datafile): requesting running snapshot e2c717af-28e0-4f31-a006-d393788ffe77-158447a5-554e-4e22-a930-c556d9c8d608 state: Requested
352026-04-29T21:03:16.040ZINFOcrucible-agent (dropshot): request completed latency_us = 20682 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:56467 req_id = 7588398e-daed-478e-b160-4c5023621e59 response_code = 200 uri = /crucible/0/regions/e2c717af-28e0-4f31-a006-d393788ffe77/snapshots/158447a5-554e-4e22-a930-c556d9c8d608/run
362026-04-29T21:03:16.040ZINFOcrucible-agent (worker): applying SMF actions for region e2c717af-28e0-4f31-a006-d393788ffe77 running snapshot 158447a5-554e-4e22-a930-c556d9c8d608 (state Requested)...
372026-04-29T21:03:16.045ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-e2c717af-28e0-4f31-a006-d393788ffe77-158447a5-554e-4e22-a930-c556d9c8d608
382026-04-29T21:03:16.048ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-e2c717af-28e0-4f31-a006-d393788ffe77-158447a5-554e-4e22-a930-c556d9c8d608
392026-04-29T21:03:16.060ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-e2c717af-28e0-4f31-a006-d393788ffe77-158447a5-554e-4e22-a930-c556d9c8d608
402026-04-29T21:03:16.060ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/e2c717af-28e0-4f31-a006-d393788ffe77/.zfs/snapshot/158447a5-554e-4e22-a930-c556d9c8d608
412026-04-29T21:03:16.060ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19002
422026-04-29T21:03:16.060ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
432026-04-29T21:03:16.060ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::15
442026-04-29T21:03:16.060ZINFOcrucible-agent (worker): commit
452026-04-29T21:03:16.064ZINFOcrucible-agent (worker): ok!
462026-04-29T21:03:16.069ZINFOcrucible-agent (worker): SMF ok!
472026-04-29T21:03:16.069ZINFOcrucible-agent (datafile): region e2c717af-28e0-4f31-a006-d393788ffe77 running snapshot 158447a5-554e-4e22-a930-c556d9c8d608 state: Requested -> Created
482026-04-29T21:03:16.416ZINFOcrucible-agent (datafile): path is "/data/regions/e2c717af-28e0-4f31-a006-d393788ffe77"
492026-04-29T21:03:16.423ZINFOcrucible-agent (datafile): dataset is oxp_6ca8cbb9-3d45-4d36-9499-124825ae8f56/crucible/regions/e2c717af-28e0-4f31-a006-d393788ffe77
502026-04-29T21:03:16.429ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_6ca8cbb9-3d45-4d36-9499-124825ae8f56/crucible/regions/e2c717af-28e0-4f31-a006-d393788ffe77@158447a5-554e-4e22-a930-c556d9c8d608
512026-04-29T21:03:16.429ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_6ca8cbb9-3d45-4d36-9499-124825ae8f56/crucible/regions/e2c717af-28e0-4f31-a006-d393788ffe77", "158447a5-554e-4e22-a930-c556d9c8d608"]
522026-04-29T21:03:16.435ZINFOcrucible-agent (dropshot): request completed latency_us = 19100 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:56467 req_id = 9775a529-e1e7-4eea-bf72-0582112dc7e2 response_code = 200 uri = /crucible/0/regions/e2c717af-28e0-4f31-a006-d393788ffe77/snapshots/158447a5-554e-4e22-a930-c556d9c8d608/run