Max level shown:
12025-07-17T11:37:35.239ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::15]:32345 remote_addr = [fd00:1122:3344:101::a]:53498
22025-07-17T11:37:35.239ZINFOcrucible-agent (datafile): region 6c6b6641-5f49-44d5-999d-b60e4d257f59 state: Requested
32025-07-17T11:37:35.240ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
42025-07-17T11:37:35.240ZINFOcrucible-agent (dropshot): request completed latency_us = 754 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:53498 req_id = 90faacf7-254d-4580-98a2-84c3876eb062 response_code = 200 uri = /crucible/0/regions
52025-07-17T11:37:35.253ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_4e731089-319a-4a20-850f-ec8cd59d4a62/crucible/regions/6c6b6641-5f49-44d5-999d-b60e4d257f59
62025-07-17T11:37:35.253ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_4e731089-319a-4a20-850f-ec8cd59d4a62/crucible/regions/6c6b6641-5f49-44d5-999d-b60e4d257f59
72025-07-17T11:37:35.311ZINFOcrucible-agent (worker): creating region Region { id: RegionId("6c6b6641-5f49-44d5-999d-b60e4d257f59"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/6c6b6641-5f49-44d5-999d-b60e4d257f59" region = 6c6b6641-5f49-44d5-999d-b60e4d257f59
82025-07-17T11:37:35.311ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "6c6b6641-5f49-44d5-999d-b60e4d257f59" "--data" "/data/regions/6c6b6641-5f49-44d5-999d-b60e4d257f59" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 6c6b6641-5f49-44d5-999d-b60e4d257f59
92025-07-17T11:37:35.431ZINFOcrucible-agent (worker): region files created ok region = 6c6b6641-5f49-44d5-999d-b60e4d257f59
102025-07-17T11:37:35.431ZINFOcrucible-agent (datafile): region 6c6b6641-5f49-44d5-999d-b60e4d257f59 state: Requested -> Created
112025-07-17T11:37:35.431ZINFOcrucible-agent (worker): applying SMF actions post create...
122025-07-17T11:37:35.432ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-6c6b6641-5f49-44d5-999d-b60e4d257f59
132025-07-17T11:37:35.448ZINFOcrucible-agent (dropshot): request completed latency_us = 108 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:53498 req_id = ae8b16e2-61e2-461a-b3cb-42b12557c94a response_code = 200 uri = /crucible/0/regions
142025-07-17T11:37:35.454ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-6c6b6641-5f49-44d5-999d-b60e4d257f59
152025-07-17T11:37:35.480ZINFOcrucible-agent (worker): creating config property group
162025-07-17T11:37:35.483ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-6c6b6641-5f49-44d5-999d-b60e4d257f59
172025-07-17T11:37:35.484ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/6c6b6641-5f49-44d5-999d-b60e4d257f59
182025-07-17T11:37:35.484ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
192025-07-17T11:37:35.484ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::15
202025-07-17T11:37:35.484ZINFOcrucible-agent (worker): commit
212025-07-17T11:37:35.492ZINFOcrucible-agent (worker): ok!
222025-07-17T11:37:35.500ZINFOcrucible-agent (worker): SMF ok!
232025-07-17T11:37:37.214ZINFOcrucible-agent (dropshot): request completed latency_us = 72 local_addr = [fd00:1122:3344:101::15]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:53498 req_id = 46ecb92f-6cfa-4270-b002-5aaae19a0cba response_code = 200 uri = /crucible/0/regions/d58efed7-deb7-43e3-91f6-adbe5bc5800b
242025-07-17T11:37:37.220ZINFOcrucible-agent (datafile): path is "/data/regions/d58efed7-deb7-43e3-91f6-adbe5bc5800b"
252025-07-17T11:37:37.234ZINFOcrucible-agent (datafile): dataset is oxp_4e731089-319a-4a20-850f-ec8cd59d4a62/crucible/regions/d58efed7-deb7-43e3-91f6-adbe5bc5800b
262025-07-17T11:37:37.246ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_4e731089-319a-4a20-850f-ec8cd59d4a62/crucible/regions/d58efed7-deb7-43e3-91f6-adbe5bc5800b@448d8af7-b4b4-4267-9bf7-6dced3bf96e6
272025-07-17T11:37:37.246ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_4e731089-319a-4a20-850f-ec8cd59d4a62/crucible/regions/d58efed7-deb7-43e3-91f6-adbe5bc5800b", "448d8af7-b4b4-4267-9bf7-6dced3bf96e6"]
282025-07-17T11:37:37.261ZINFOcrucible-agent (dropshot): request completed latency_us = 41742 local_addr = [fd00:1122:3344:101::15]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:53498 req_id = 52a97ac4-676e-4515-8b27-e25fe3e0cf56 response_code = 200 uri = /crucible/0/regions/d58efed7-deb7-43e3-91f6-adbe5bc5800b/snapshots/448d8af7-b4b4-4267-9bf7-6dced3bf96e6
292025-07-17T11:37:37.266ZINFOcrucible-agent (datafile): path is "/data/regions/d58efed7-deb7-43e3-91f6-adbe5bc5800b"
302025-07-17T11:37:37.279ZINFOcrucible-agent (datafile): dataset is oxp_4e731089-319a-4a20-850f-ec8cd59d4a62/crucible/regions/d58efed7-deb7-43e3-91f6-adbe5bc5800b
312025-07-17T11:37:37.290ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_4e731089-319a-4a20-850f-ec8cd59d4a62/crucible/regions/d58efed7-deb7-43e3-91f6-adbe5bc5800b@448d8af7-b4b4-4267-9bf7-6dced3bf96e6
322025-07-17T11:37:37.291ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_4e731089-319a-4a20-850f-ec8cd59d4a62/crucible/regions/d58efed7-deb7-43e3-91f6-adbe5bc5800b", "448d8af7-b4b4-4267-9bf7-6dced3bf96e6"]
332025-07-17T11:37:37.303ZINFOcrucible-agent (datafile): requesting running snapshot d58efed7-deb7-43e3-91f6-adbe5bc5800b-448d8af7-b4b4-4267-9bf7-6dced3bf96e6 state: Requested
342025-07-17T11:37:37.303ZINFOcrucible-agent (worker): applying SMF actions for region d58efed7-deb7-43e3-91f6-adbe5bc5800b running snapshot 448d8af7-b4b4-4267-9bf7-6dced3bf96e6 (state Requested)...
352025-07-17T11:37:37.303ZINFOcrucible-agent (dropshot): request completed latency_us = 37503 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:53498 req_id = f35cdd64-74c4-4290-9de2-e59a185012c5 response_code = 200 uri = /crucible/0/regions/d58efed7-deb7-43e3-91f6-adbe5bc5800b/snapshots/448d8af7-b4b4-4267-9bf7-6dced3bf96e6/run
362025-07-17T11:37:37.307ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-d58efed7-deb7-43e3-91f6-adbe5bc5800b-448d8af7-b4b4-4267-9bf7-6dced3bf96e6
372025-07-17T11:37:37.311ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-d58efed7-deb7-43e3-91f6-adbe5bc5800b-448d8af7-b4b4-4267-9bf7-6dced3bf96e6
382025-07-17T11:37:37.324ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-d58efed7-deb7-43e3-91f6-adbe5bc5800b-448d8af7-b4b4-4267-9bf7-6dced3bf96e6
392025-07-17T11:37:37.325ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/d58efed7-deb7-43e3-91f6-adbe5bc5800b/.zfs/snapshot/448d8af7-b4b4-4267-9bf7-6dced3bf96e6
402025-07-17T11:37:37.325ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19002
412025-07-17T11:37:37.325ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
422025-07-17T11:37:37.325ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::15
432025-07-17T11:37:37.325ZINFOcrucible-agent (worker): commit
442025-07-17T11:37:37.329ZINFOcrucible-agent (worker): ok!
452025-07-17T11:37:37.335ZINFOcrucible-agent (worker): SMF ok!
462025-07-17T11:37:37.335ZINFOcrucible-agent (datafile): region d58efed7-deb7-43e3-91f6-adbe5bc5800b running snapshot 448d8af7-b4b4-4267-9bf7-6dced3bf96e6 state: Requested -> Created
472025-07-17T11:37:37.547ZINFOcrucible-agent (datafile): path is "/data/regions/d58efed7-deb7-43e3-91f6-adbe5bc5800b"
482025-07-17T11:37:37.557ZINFOcrucible-agent (datafile): dataset is oxp_4e731089-319a-4a20-850f-ec8cd59d4a62/crucible/regions/d58efed7-deb7-43e3-91f6-adbe5bc5800b
492025-07-17T11:37:37.566ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_4e731089-319a-4a20-850f-ec8cd59d4a62/crucible/regions/d58efed7-deb7-43e3-91f6-adbe5bc5800b@448d8af7-b4b4-4267-9bf7-6dced3bf96e6
502025-07-17T11:37:37.566ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_4e731089-319a-4a20-850f-ec8cd59d4a62/crucible/regions/d58efed7-deb7-43e3-91f6-adbe5bc5800b", "448d8af7-b4b4-4267-9bf7-6dced3bf96e6"]
512025-07-17T11:37:37.575ZINFOcrucible-agent (dropshot): request completed latency_us = 27268 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:53498 req_id = 43c10422-4d18-42c4-817f-e02035aa2a03 response_code = 200 uri = /crucible/0/regions/d58efed7-deb7-43e3-91f6-adbe5bc5800b/snapshots/448d8af7-b4b4-4267-9bf7-6dced3bf96e6/run