Max level shown:
12025-08-22T18:23:16.522ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::13]:32345 remote_addr = [fd00:1122:3344:101::c]:38531
22025-08-22T18:23:16.522ZINFOcrucible-agent (datafile): region 803931cf-db69-4819-98e7-8e120b4c0b66 state: Requested
32025-08-22T18:23:16.523ZINFOcrucible-agent (dropshot): request completed latency_us = 644 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:38531 req_id = 57aab45e-899e-4ccd-b051-fa8d913ece61 response_code = 200 uri = /crucible/0/regions
42025-08-22T18:23:16.523ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
52025-08-22T18:23:16.535ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_52652afa-b77d-4301-bdca-6474790f9c3a/crucible/regions/803931cf-db69-4819-98e7-8e120b4c0b66
62025-08-22T18:23:16.535ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_52652afa-b77d-4301-bdca-6474790f9c3a/crucible/regions/803931cf-db69-4819-98e7-8e120b4c0b66
72025-08-22T18:23:16.598ZINFOcrucible-agent (worker): creating region Region { id: RegionId("803931cf-db69-4819-98e7-8e120b4c0b66"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/803931cf-db69-4819-98e7-8e120b4c0b66" region = 803931cf-db69-4819-98e7-8e120b4c0b66
82025-08-22T18:23:16.598ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "803931cf-db69-4819-98e7-8e120b4c0b66" "--data" "/data/regions/803931cf-db69-4819-98e7-8e120b4c0b66" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 803931cf-db69-4819-98e7-8e120b4c0b66
92025-08-22T18:23:16.675ZINFOcrucible-agent (worker): region files created ok region = 803931cf-db69-4819-98e7-8e120b4c0b66
102025-08-22T18:23:16.675ZINFOcrucible-agent (datafile): region 803931cf-db69-4819-98e7-8e120b4c0b66 state: Requested -> Created
112025-08-22T18:23:16.676ZINFOcrucible-agent (worker): applying SMF actions post create...
122025-08-22T18:23:16.694ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-803931cf-db69-4819-98e7-8e120b4c0b66
132025-08-22T18:23:16.705ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-803931cf-db69-4819-98e7-8e120b4c0b66
142025-08-22T18:23:16.717ZINFOcrucible-agent (worker): creating config property group
152025-08-22T18:23:16.719ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-803931cf-db69-4819-98e7-8e120b4c0b66
162025-08-22T18:23:16.720ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/803931cf-db69-4819-98e7-8e120b4c0b66
172025-08-22T18:23:16.720ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
182025-08-22T18:23:16.720ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::13
192025-08-22T18:23:16.720ZINFOcrucible-agent (worker): commit
202025-08-22T18:23:16.723ZINFOcrucible-agent (worker): ok!
212025-08-22T18:23:16.728ZINFOcrucible-agent (worker): SMF ok!
222025-08-22T18:23:16.789ZINFOcrucible-agent (dropshot): request completed latency_us = 59 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:38531 req_id = e185123f-778a-48ca-ba85-701dc75ae4b3 response_code = 200 uri = /crucible/0/regions
232025-08-22T18:23:17.970ZINFOcrucible-agent (dropshot): request completed latency_us = 62 local_addr = [fd00:1122:3344:101::13]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:38531 req_id = 75aab7c4-b0bc-4534-b76c-0def5892800d response_code = 200 uri = /crucible/0/regions/07af008d-d108-4986-b42c-825193bd7577
242025-08-22T18:23:17.973ZINFOcrucible-agent (datafile): path is "/data/regions/07af008d-d108-4986-b42c-825193bd7577"
252025-08-22T18:23:17.983ZINFOcrucible-agent (datafile): dataset is oxp_52652afa-b77d-4301-bdca-6474790f9c3a/crucible/regions/07af008d-d108-4986-b42c-825193bd7577
262025-08-22T18:23:17.992ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_52652afa-b77d-4301-bdca-6474790f9c3a/crucible/regions/07af008d-d108-4986-b42c-825193bd7577@b2e612a5-3b8a-4dc3-9937-ac9bce6dfbce
272025-08-22T18:23:17.992ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_52652afa-b77d-4301-bdca-6474790f9c3a/crucible/regions/07af008d-d108-4986-b42c-825193bd7577", "b2e612a5-3b8a-4dc3-9937-ac9bce6dfbce"]
282025-08-22T18:23:18.004ZINFOcrucible-agent (dropshot): request completed latency_us = 30143 local_addr = [fd00:1122:3344:101::13]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:38531 req_id = 76191a2a-2495-4fc7-a73f-8caff092163e response_code = 200 uri = /crucible/0/regions/07af008d-d108-4986-b42c-825193bd7577/snapshots/b2e612a5-3b8a-4dc3-9937-ac9bce6dfbce
292025-08-22T18:23:18.009ZINFOcrucible-agent (datafile): path is "/data/regions/07af008d-d108-4986-b42c-825193bd7577"
302025-08-22T18:23:18.019ZINFOcrucible-agent (datafile): dataset is oxp_52652afa-b77d-4301-bdca-6474790f9c3a/crucible/regions/07af008d-d108-4986-b42c-825193bd7577
312025-08-22T18:23:18.028ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_52652afa-b77d-4301-bdca-6474790f9c3a/crucible/regions/07af008d-d108-4986-b42c-825193bd7577@b2e612a5-3b8a-4dc3-9937-ac9bce6dfbce
322025-08-22T18:23:18.028ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_52652afa-b77d-4301-bdca-6474790f9c3a/crucible/regions/07af008d-d108-4986-b42c-825193bd7577", "b2e612a5-3b8a-4dc3-9937-ac9bce6dfbce"]
332025-08-22T18:23:18.038ZINFOcrucible-agent (datafile): requesting running snapshot 07af008d-d108-4986-b42c-825193bd7577-b2e612a5-3b8a-4dc3-9937-ac9bce6dfbce state: Requested
342025-08-22T18:23:18.038ZINFOcrucible-agent (worker): applying SMF actions for region 07af008d-d108-4986-b42c-825193bd7577 running snapshot b2e612a5-3b8a-4dc3-9937-ac9bce6dfbce (state Requested)...
352025-08-22T18:23:18.038ZINFOcrucible-agent (dropshot): request completed latency_us = 29323 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:38531 req_id = 947c051c-bb3b-4104-adc4-6930c3ec4152 response_code = 200 uri = /crucible/0/regions/07af008d-d108-4986-b42c-825193bd7577/snapshots/b2e612a5-3b8a-4dc3-9937-ac9bce6dfbce/run
362025-08-22T18:23:18.041ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-07af008d-d108-4986-b42c-825193bd7577-b2e612a5-3b8a-4dc3-9937-ac9bce6dfbce
372025-08-22T18:23:18.043ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-07af008d-d108-4986-b42c-825193bd7577-b2e612a5-3b8a-4dc3-9937-ac9bce6dfbce
382025-08-22T18:23:18.053ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-07af008d-d108-4986-b42c-825193bd7577-b2e612a5-3b8a-4dc3-9937-ac9bce6dfbce
392025-08-22T18:23:18.053ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/07af008d-d108-4986-b42c-825193bd7577/.zfs/snapshot/b2e612a5-3b8a-4dc3-9937-ac9bce6dfbce
402025-08-22T18:23:18.053ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19002
412025-08-22T18:23:18.053ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
422025-08-22T18:23:18.053ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::13
432025-08-22T18:23:18.054ZINFOcrucible-agent (worker): commit
442025-08-22T18:23:18.057ZINFOcrucible-agent (worker): ok!
452025-08-22T18:23:18.061ZINFOcrucible-agent (worker): SMF ok!
462025-08-22T18:23:18.061ZINFOcrucible-agent (datafile): region 07af008d-d108-4986-b42c-825193bd7577 running snapshot b2e612a5-3b8a-4dc3-9937-ac9bce6dfbce state: Requested -> Created
472025-08-22T18:23:18.354ZINFOcrucible-agent (datafile): path is "/data/regions/07af008d-d108-4986-b42c-825193bd7577"
482025-08-22T18:23:18.364ZINFOcrucible-agent (datafile): dataset is oxp_52652afa-b77d-4301-bdca-6474790f9c3a/crucible/regions/07af008d-d108-4986-b42c-825193bd7577
492025-08-22T18:23:18.376ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_52652afa-b77d-4301-bdca-6474790f9c3a/crucible/regions/07af008d-d108-4986-b42c-825193bd7577@b2e612a5-3b8a-4dc3-9937-ac9bce6dfbce
502025-08-22T18:23:18.376ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_52652afa-b77d-4301-bdca-6474790f9c3a/crucible/regions/07af008d-d108-4986-b42c-825193bd7577", "b2e612a5-3b8a-4dc3-9937-ac9bce6dfbce"]
512025-08-22T18:23:18.387ZINFOcrucible-agent (dropshot): request completed latency_us = 33757 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:38531 req_id = afe6d1b3-7244-4f78-80e5-d7bc1aca1c55 response_code = 200 uri = /crucible/0/regions/07af008d-d108-4986-b42c-825193bd7577/snapshots/b2e612a5-3b8a-4dc3-9937-ac9bce6dfbce/run