Max level shown:
12025-11-18T15:15:50.882ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::13]:32345 remote_addr = [fd00:1122:3344:101::c]:58529
22025-11-18T15:15:50.907ZINFOcrucible-agent (datafile): region 76a2fc7c-e14c-4057-b5f4-c19837d34d87 state: Requested
32025-11-18T15:15:50.910ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
42025-11-18T15:15:50.910ZINFOcrucible-agent (dropshot): request completed latency_us = 13977 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:58529 req_id = 0097c25e-4e04-49ce-a9e4-0e7c03cb535c response_code = 200 uri = /crucible/0/regions
52025-11-18T15:15:50.920ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_318af40a-73dc-4f5f-a998-9ef06d7643c7/crucible/regions/76a2fc7c-e14c-4057-b5f4-c19837d34d87
62025-11-18T15:15:50.920ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_318af40a-73dc-4f5f-a998-9ef06d7643c7/crucible/regions/76a2fc7c-e14c-4057-b5f4-c19837d34d87
72025-11-18T15:15:50.975ZINFOcrucible-agent (worker): creating region Region { id: RegionId("76a2fc7c-e14c-4057-b5f4-c19837d34d87"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/76a2fc7c-e14c-4057-b5f4-c19837d34d87" region = 76a2fc7c-e14c-4057-b5f4-c19837d34d87
82025-11-18T15:15:50.977ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "76a2fc7c-e14c-4057-b5f4-c19837d34d87" "--data" "/data/regions/76a2fc7c-e14c-4057-b5f4-c19837d34d87" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 76a2fc7c-e14c-4057-b5f4-c19837d34d87
92025-11-18T15:15:51.249ZINFOcrucible-agent (dropshot): request completed latency_us = 68 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:58529 req_id = ca89b1e3-3460-489b-aa45-b6aadcd15cbc response_code = 200 uri = /crucible/0/regions
102025-11-18T15:15:51.334ZINFOcrucible-agent (worker): region files created ok region = 76a2fc7c-e14c-4057-b5f4-c19837d34d87
112025-11-18T15:15:51.334ZINFOcrucible-agent (datafile): region 76a2fc7c-e14c-4057-b5f4-c19837d34d87 state: Requested -> Created
122025-11-18T15:15:51.334ZINFOcrucible-agent (worker): applying SMF actions post create...
132025-11-18T15:15:51.334ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-76a2fc7c-e14c-4057-b5f4-c19837d34d87
142025-11-18T15:15:51.339ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-76a2fc7c-e14c-4057-b5f4-c19837d34d87
152025-11-18T15:15:51.355ZINFOcrucible-agent (worker): creating config property group
162025-11-18T15:15:51.358ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-76a2fc7c-e14c-4057-b5f4-c19837d34d87
172025-11-18T15:15:51.359ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/76a2fc7c-e14c-4057-b5f4-c19837d34d87
182025-11-18T15:15:51.359ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
192025-11-18T15:15:51.359ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::13
202025-11-18T15:15:51.359ZINFOcrucible-agent (worker): commit
212025-11-18T15:15:51.363ZINFOcrucible-agent (worker): ok!
222025-11-18T15:15:51.367ZINFOcrucible-agent (worker): SMF ok!
232025-11-18T15:15:51.674ZINFOcrucible-agent (dropshot): request completed latency_us = 63 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:58529 req_id = e21f89f7-8744-449d-989e-85f94c0f8058 response_code = 200 uri = /crucible/0/regions
242025-11-18T15:26:51.627ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::13]:32345 remote_addr = [fd00:1122:3344:101::c]:65312
252025-11-18T15:26:51.627ZINFOcrucible-agent (dropshot): request completed latency_us = 55 local_addr = [fd00:1122:3344:101::13]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:65312 req_id = b54a504c-1ce4-4ded-bff9-8bced630348a response_code = 200 uri = /crucible/0/regions/76a2fc7c-e14c-4057-b5f4-c19837d34d87
262025-11-18T15:26:51.631ZINFOcrucible-agent (datafile): path is "/data/regions/76a2fc7c-e14c-4057-b5f4-c19837d34d87"
272025-11-18T15:26:51.637ZINFOcrucible-agent (datafile): dataset is oxp_318af40a-73dc-4f5f-a998-9ef06d7643c7/crucible/regions/76a2fc7c-e14c-4057-b5f4-c19837d34d87
282025-11-18T15:26:51.642ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_318af40a-73dc-4f5f-a998-9ef06d7643c7/crucible/regions/76a2fc7c-e14c-4057-b5f4-c19837d34d87@3ffbc7d5-1a88-4cbe-b4f1-31247b16b619
292025-11-18T15:26:51.642ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_318af40a-73dc-4f5f-a998-9ef06d7643c7/crucible/regions/76a2fc7c-e14c-4057-b5f4-c19837d34d87", "3ffbc7d5-1a88-4cbe-b4f1-31247b16b619"]
302025-11-18T15:26:51.654ZINFOcrucible-agent (dropshot): request completed latency_us = 23703 local_addr = [fd00:1122:3344:101::13]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:65312 req_id = ab6be6ab-148e-44c2-81d4-fa226e2d3df0 response_code = 200 uri = /crucible/0/regions/76a2fc7c-e14c-4057-b5f4-c19837d34d87/snapshots/3ffbc7d5-1a88-4cbe-b4f1-31247b16b619
312025-11-18T15:26:51.658ZINFOcrucible-agent (datafile): path is "/data/regions/76a2fc7c-e14c-4057-b5f4-c19837d34d87"
322025-11-18T15:26:51.664ZINFOcrucible-agent (datafile): dataset is oxp_318af40a-73dc-4f5f-a998-9ef06d7643c7/crucible/regions/76a2fc7c-e14c-4057-b5f4-c19837d34d87
332025-11-18T15:26:51.670ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_318af40a-73dc-4f5f-a998-9ef06d7643c7/crucible/regions/76a2fc7c-e14c-4057-b5f4-c19837d34d87@3ffbc7d5-1a88-4cbe-b4f1-31247b16b619
342025-11-18T15:26:51.670ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_318af40a-73dc-4f5f-a998-9ef06d7643c7/crucible/regions/76a2fc7c-e14c-4057-b5f4-c19837d34d87", "3ffbc7d5-1a88-4cbe-b4f1-31247b16b619"]
352025-11-18T15:26:51.679ZINFOcrucible-agent (datafile): requesting running snapshot 76a2fc7c-e14c-4057-b5f4-c19837d34d87-3ffbc7d5-1a88-4cbe-b4f1-31247b16b619 state: Requested
362025-11-18T15:26:51.679ZINFOcrucible-agent (dropshot): request completed latency_us = 21709 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:65312 req_id = 45c59c8a-36a8-4098-ac13-adf1b0fb783c response_code = 200 uri = /crucible/0/regions/76a2fc7c-e14c-4057-b5f4-c19837d34d87/snapshots/3ffbc7d5-1a88-4cbe-b4f1-31247b16b619/run
372025-11-18T15:26:51.679ZINFOcrucible-agent (worker): applying SMF actions for region 76a2fc7c-e14c-4057-b5f4-c19837d34d87 running snapshot 3ffbc7d5-1a88-4cbe-b4f1-31247b16b619 (state Requested)...
382025-11-18T15:26:51.700ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-76a2fc7c-e14c-4057-b5f4-c19837d34d87-3ffbc7d5-1a88-4cbe-b4f1-31247b16b619
392025-11-18T15:26:51.718ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-76a2fc7c-e14c-4057-b5f4-c19837d34d87-3ffbc7d5-1a88-4cbe-b4f1-31247b16b619
402025-11-18T15:26:51.740ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-76a2fc7c-e14c-4057-b5f4-c19837d34d87-3ffbc7d5-1a88-4cbe-b4f1-31247b16b619
412025-11-18T15:26:51.740ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/76a2fc7c-e14c-4057-b5f4-c19837d34d87/.zfs/snapshot/3ffbc7d5-1a88-4cbe-b4f1-31247b16b619
422025-11-18T15:26:51.740ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
432025-11-18T15:26:51.740ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
442025-11-18T15:26:51.740ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::13
452025-11-18T15:26:51.740ZINFOcrucible-agent (worker): commit
462025-11-18T15:26:51.750ZINFOcrucible-agent (worker): ok!
472025-11-18T15:26:51.759ZINFOcrucible-agent (worker): SMF ok!
482025-11-18T15:26:51.759ZINFOcrucible-agent (datafile): region 76a2fc7c-e14c-4057-b5f4-c19837d34d87 running snapshot 3ffbc7d5-1a88-4cbe-b4f1-31247b16b619 state: Requested -> Created
492025-11-18T15:26:52.038ZINFOcrucible-agent (datafile): path is "/data/regions/76a2fc7c-e14c-4057-b5f4-c19837d34d87"
502025-11-18T15:26:52.045ZINFOcrucible-agent (datafile): dataset is oxp_318af40a-73dc-4f5f-a998-9ef06d7643c7/crucible/regions/76a2fc7c-e14c-4057-b5f4-c19837d34d87
512025-11-18T15:26:52.052ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_318af40a-73dc-4f5f-a998-9ef06d7643c7/crucible/regions/76a2fc7c-e14c-4057-b5f4-c19837d34d87@3ffbc7d5-1a88-4cbe-b4f1-31247b16b619
522025-11-18T15:26:52.052ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_318af40a-73dc-4f5f-a998-9ef06d7643c7/crucible/regions/76a2fc7c-e14c-4057-b5f4-c19837d34d87", "3ffbc7d5-1a88-4cbe-b4f1-31247b16b619"]
532025-11-18T15:26:52.059ZINFOcrucible-agent (dropshot): request completed latency_us = 21149 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:65312 req_id = 08b9930e-df39-49a2-9f78-241af5950e22 response_code = 200 uri = /crucible/0/regions/76a2fc7c-e14c-4057-b5f4-c19837d34d87/snapshots/3ffbc7d5-1a88-4cbe-b4f1-31247b16b619/run