Max level shown:
12025-07-10T17:16:51.991ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::15]:32345 remote_addr = [fd00:1122:3344:101::a]:51295
22025-07-10T17:16:51.991ZINFOcrucible-agent (datafile): region 4bceb76b-50af-416f-8edc-188039faf397 state: Requested
32025-07-10T17:16:51.992ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
42025-07-10T17:16:51.992ZINFOcrucible-agent (dropshot): request completed latency_us = 640 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:51295 req_id = 50bdcd2f-81c4-488a-94c5-1f00debf8084 response_code = 200 uri = /crucible/0/regions
52025-07-10T17:16:52.004ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_496bcc8d-1e3e-4ccf-a73e-c68b2b0be2b4/crucible/regions/4bceb76b-50af-416f-8edc-188039faf397
62025-07-10T17:16:52.004ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_496bcc8d-1e3e-4ccf-a73e-c68b2b0be2b4/crucible/regions/4bceb76b-50af-416f-8edc-188039faf397
72025-07-10T17:16:52.061ZINFOcrucible-agent (worker): creating region Region { id: RegionId("4bceb76b-50af-416f-8edc-188039faf397"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/4bceb76b-50af-416f-8edc-188039faf397" region = 4bceb76b-50af-416f-8edc-188039faf397
82025-07-10T17:16:52.061ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "4bceb76b-50af-416f-8edc-188039faf397" "--data" "/data/regions/4bceb76b-50af-416f-8edc-188039faf397" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 4bceb76b-50af-416f-8edc-188039faf397
92025-07-10T17:16:52.146ZINFOcrucible-agent (worker): region files created ok region = 4bceb76b-50af-416f-8edc-188039faf397
102025-07-10T17:16:52.146ZINFOcrucible-agent (datafile): region 4bceb76b-50af-416f-8edc-188039faf397 state: Requested -> Created
112025-07-10T17:16:52.146ZINFOcrucible-agent (worker): applying SMF actions post create...
122025-07-10T17:16:52.147ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-4bceb76b-50af-416f-8edc-188039faf397
132025-07-10T17:16:52.170ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-4bceb76b-50af-416f-8edc-188039faf397
142025-07-10T17:16:52.194ZINFOcrucible-agent (worker): creating config property group
152025-07-10T17:16:52.198ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-4bceb76b-50af-416f-8edc-188039faf397
162025-07-10T17:16:52.198ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/4bceb76b-50af-416f-8edc-188039faf397
172025-07-10T17:16:52.198ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
182025-07-10T17:16:52.198ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::15
192025-07-10T17:16:52.198ZINFOcrucible-agent (worker): commit
202025-07-10T17:16:52.202ZINFOcrucible-agent (worker): ok!
212025-07-10T17:16:52.205ZINFOcrucible-agent (dropshot): request completed latency_us = 106 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:51295 req_id = 40b69f32-7a96-4908-99ae-3c07a83832d8 response_code = 200 uri = /crucible/0/regions
222025-07-10T17:16:52.209ZINFOcrucible-agent (worker): SMF ok!
232025-07-10T17:16:53.629ZINFOcrucible-agent (dropshot): request completed latency_us = 48 local_addr = [fd00:1122:3344:101::15]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:51295 req_id = a119dbcc-bcba-4f5f-b4e9-97a9d8ed10fe response_code = 200 uri = /crucible/0/regions/5291ecb0-98ee-4b93-8332-a6cd1c03ce6d
242025-07-10T17:16:53.633ZINFOcrucible-agent (datafile): path is "/data/regions/5291ecb0-98ee-4b93-8332-a6cd1c03ce6d"
252025-07-10T17:16:53.641ZINFOcrucible-agent (datafile): dataset is oxp_496bcc8d-1e3e-4ccf-a73e-c68b2b0be2b4/crucible/regions/5291ecb0-98ee-4b93-8332-a6cd1c03ce6d
262025-07-10T17:16:53.651ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_496bcc8d-1e3e-4ccf-a73e-c68b2b0be2b4/crucible/regions/5291ecb0-98ee-4b93-8332-a6cd1c03ce6d@4dc67cfa-e043-4b37-b4b9-91bfc3069ad4
272025-07-10T17:16:53.651ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_496bcc8d-1e3e-4ccf-a73e-c68b2b0be2b4/crucible/regions/5291ecb0-98ee-4b93-8332-a6cd1c03ce6d", "4dc67cfa-e043-4b37-b4b9-91bfc3069ad4"]
282025-07-10T17:16:53.663ZINFOcrucible-agent (dropshot): request completed latency_us = 30374 local_addr = [fd00:1122:3344:101::15]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:51295 req_id = b2970597-0a1e-48e2-a696-0a0ffbeeb457 response_code = 200 uri = /crucible/0/regions/5291ecb0-98ee-4b93-8332-a6cd1c03ce6d/snapshots/4dc67cfa-e043-4b37-b4b9-91bfc3069ad4
292025-07-10T17:16:53.667ZINFOcrucible-agent (datafile): path is "/data/regions/5291ecb0-98ee-4b93-8332-a6cd1c03ce6d"
302025-07-10T17:16:53.675ZINFOcrucible-agent (datafile): dataset is oxp_496bcc8d-1e3e-4ccf-a73e-c68b2b0be2b4/crucible/regions/5291ecb0-98ee-4b93-8332-a6cd1c03ce6d
312025-07-10T17:16:53.684ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_496bcc8d-1e3e-4ccf-a73e-c68b2b0be2b4/crucible/regions/5291ecb0-98ee-4b93-8332-a6cd1c03ce6d@4dc67cfa-e043-4b37-b4b9-91bfc3069ad4
322025-07-10T17:16:53.684ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_496bcc8d-1e3e-4ccf-a73e-c68b2b0be2b4/crucible/regions/5291ecb0-98ee-4b93-8332-a6cd1c03ce6d", "4dc67cfa-e043-4b37-b4b9-91bfc3069ad4"]
332025-07-10T17:16:53.694ZINFOcrucible-agent (datafile): requesting running snapshot 5291ecb0-98ee-4b93-8332-a6cd1c03ce6d-4dc67cfa-e043-4b37-b4b9-91bfc3069ad4 state: Requested
342025-07-10T17:16:53.694ZINFOcrucible-agent (worker): applying SMF actions for region 5291ecb0-98ee-4b93-8332-a6cd1c03ce6d running snapshot 4dc67cfa-e043-4b37-b4b9-91bfc3069ad4 (state Requested)...
352025-07-10T17:16:53.694ZINFOcrucible-agent (dropshot): request completed latency_us = 27272 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:51295 req_id = 6e09072f-3dff-4b0a-a17e-43ab1074b043 response_code = 200 uri = /crucible/0/regions/5291ecb0-98ee-4b93-8332-a6cd1c03ce6d/snapshots/4dc67cfa-e043-4b37-b4b9-91bfc3069ad4/run
362025-07-10T17:16:53.697ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-5291ecb0-98ee-4b93-8332-a6cd1c03ce6d-4dc67cfa-e043-4b37-b4b9-91bfc3069ad4
372025-07-10T17:16:53.700ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-5291ecb0-98ee-4b93-8332-a6cd1c03ce6d-4dc67cfa-e043-4b37-b4b9-91bfc3069ad4
382025-07-10T17:16:53.709ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-5291ecb0-98ee-4b93-8332-a6cd1c03ce6d-4dc67cfa-e043-4b37-b4b9-91bfc3069ad4
392025-07-10T17:16:53.709ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/5291ecb0-98ee-4b93-8332-a6cd1c03ce6d/.zfs/snapshot/4dc67cfa-e043-4b37-b4b9-91bfc3069ad4
402025-07-10T17:16:53.709ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19002
412025-07-10T17:16:53.709ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
422025-07-10T17:16:53.709ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::15
432025-07-10T17:16:53.709ZINFOcrucible-agent (worker): commit
442025-07-10T17:16:53.713ZINFOcrucible-agent (worker): ok!
452025-07-10T17:16:53.717ZINFOcrucible-agent (worker): SMF ok!
462025-07-10T17:16:53.717ZINFOcrucible-agent (datafile): region 5291ecb0-98ee-4b93-8332-a6cd1c03ce6d running snapshot 4dc67cfa-e043-4b37-b4b9-91bfc3069ad4 state: Requested -> Created
472025-07-10T17:16:53.911ZINFOcrucible-agent (datafile): path is "/data/regions/5291ecb0-98ee-4b93-8332-a6cd1c03ce6d"
482025-07-10T17:16:53.920ZINFOcrucible-agent (datafile): dataset is oxp_496bcc8d-1e3e-4ccf-a73e-c68b2b0be2b4/crucible/regions/5291ecb0-98ee-4b93-8332-a6cd1c03ce6d
492025-07-10T17:16:53.929ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_496bcc8d-1e3e-4ccf-a73e-c68b2b0be2b4/crucible/regions/5291ecb0-98ee-4b93-8332-a6cd1c03ce6d@4dc67cfa-e043-4b37-b4b9-91bfc3069ad4
502025-07-10T17:16:53.929ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_496bcc8d-1e3e-4ccf-a73e-c68b2b0be2b4/crucible/regions/5291ecb0-98ee-4b93-8332-a6cd1c03ce6d", "4dc67cfa-e043-4b37-b4b9-91bfc3069ad4"]
512025-07-10T17:16:53.937ZINFOcrucible-agent (dropshot): request completed latency_us = 26314 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:51295 req_id = b6d91930-c83a-48f5-b965-0c6a126cc5e0 response_code = 200 uri = /crucible/0/regions/5291ecb0-98ee-4b93-8332-a6cd1c03ce6d/snapshots/4dc67cfa-e043-4b37-b4b9-91bfc3069ad4/run