Max level shown:
12025-03-03T05:35:36.508ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::13]:32345 remote_addr = [fd00:1122:3344:101::b]:62106
22025-03-03T05:35:36.508ZINFOcrucible-agent (datafile): region 4d7ee7dd-42dc-4a8c-b943-7a59a490b8cf state: Requested
32025-03-03T05:35:36.509ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
42025-03-03T05:35:36.509ZINFOcrucible-agent (dropshot): request completed latency_us = 620 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:62106 req_id = adab169c-0f4b-4481-82ac-924db3841f9a response_code = 200 uri = /crucible/0/regions
52025-03-03T05:35:36.521ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_527b3e02-90de-4b9d-9c6c-1467b770781a/crucible/regions/4d7ee7dd-42dc-4a8c-b943-7a59a490b8cf
62025-03-03T05:35:36.521ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_527b3e02-90de-4b9d-9c6c-1467b770781a/crucible/regions/4d7ee7dd-42dc-4a8c-b943-7a59a490b8cf
72025-03-03T05:35:36.597ZINFOcrucible-agent (worker): creating region Region { id: RegionId("4d7ee7dd-42dc-4a8c-b943-7a59a490b8cf"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/4d7ee7dd-42dc-4a8c-b943-7a59a490b8cf" region = 4d7ee7dd-42dc-4a8c-b943-7a59a490b8cf
82025-03-03T05:35:36.597ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "4d7ee7dd-42dc-4a8c-b943-7a59a490b8cf" "--data" "/data/regions/4d7ee7dd-42dc-4a8c-b943-7a59a490b8cf" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 4d7ee7dd-42dc-4a8c-b943-7a59a490b8cf
92025-03-03T05:35:36.685ZINFOcrucible-agent (worker): region files created ok region = 4d7ee7dd-42dc-4a8c-b943-7a59a490b8cf
102025-03-03T05:35:36.685ZINFOcrucible-agent (datafile): region 4d7ee7dd-42dc-4a8c-b943-7a59a490b8cf state: Requested -> Created
112025-03-03T05:35:36.685ZINFOcrucible-agent (worker): applying SMF actions post create...
122025-03-03T05:35:36.685ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-4d7ee7dd-42dc-4a8c-b943-7a59a490b8cf
132025-03-03T05:35:36.691ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-4d7ee7dd-42dc-4a8c-b943-7a59a490b8cf
142025-03-03T05:35:36.704ZINFOcrucible-agent (worker): creating config property group
152025-03-03T05:35:36.708ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-4d7ee7dd-42dc-4a8c-b943-7a59a490b8cf
162025-03-03T05:35:36.708ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/4d7ee7dd-42dc-4a8c-b943-7a59a490b8cf
172025-03-03T05:35:36.708ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
182025-03-03T05:35:36.708ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::13
192025-03-03T05:35:36.708ZINFOcrucible-agent (worker): commit
202025-03-03T05:35:36.711ZINFOcrucible-agent (worker): ok!
212025-03-03T05:35:36.717ZINFOcrucible-agent (worker): SMF ok!
222025-03-03T05:35:36.812ZINFOcrucible-agent (dropshot): request completed latency_us = 59 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:62106 req_id = a55265f5-abc0-4aba-87a6-d8372b69cf68 response_code = 200 uri = /crucible/0/regions
232025-03-03T05:35:37.935ZINFOcrucible-agent (dropshot): request completed latency_us = 3064 local_addr = [fd00:1122:3344:101::13]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:62106 req_id = f485deef-4ecc-4f14-8d0e-9cb9b1cfc0fd response_code = 200 uri = /crucible/0/regions/e38205f4-116a-4d9b-b316-ddd84e97fc52
242025-03-03T05:35:37.941ZINFOcrucible-agent (datafile): path is "/data/regions/e38205f4-116a-4d9b-b316-ddd84e97fc52"
252025-03-03T05:35:37.950ZINFOcrucible-agent (datafile): dataset is oxp_527b3e02-90de-4b9d-9c6c-1467b770781a/crucible/regions/e38205f4-116a-4d9b-b316-ddd84e97fc52
262025-03-03T05:35:37.958ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_527b3e02-90de-4b9d-9c6c-1467b770781a/crucible/regions/e38205f4-116a-4d9b-b316-ddd84e97fc52@a66257f2-19e5-45b9-ab36-1aeffae8ef9c
272025-03-03T05:35:37.958ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_527b3e02-90de-4b9d-9c6c-1467b770781a/crucible/regions/e38205f4-116a-4d9b-b316-ddd84e97fc52", "a66257f2-19e5-45b9-ab36-1aeffae8ef9c"]
282025-03-03T05:35:37.966ZINFOcrucible-agent (dropshot): request completed latency_us = 27920 local_addr = [fd00:1122:3344:101::13]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:62106 req_id = e6eb68ff-1ada-4cfe-9d8e-1678ae0a0061 response_code = 200 uri = /crucible/0/regions/e38205f4-116a-4d9b-b316-ddd84e97fc52/snapshots/a66257f2-19e5-45b9-ab36-1aeffae8ef9c
292025-03-03T05:35:37.969ZINFOcrucible-agent (datafile): path is "/data/regions/e38205f4-116a-4d9b-b316-ddd84e97fc52"
302025-03-03T05:35:37.977ZINFOcrucible-agent (datafile): dataset is oxp_527b3e02-90de-4b9d-9c6c-1467b770781a/crucible/regions/e38205f4-116a-4d9b-b316-ddd84e97fc52
312025-03-03T05:35:37.985ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_527b3e02-90de-4b9d-9c6c-1467b770781a/crucible/regions/e38205f4-116a-4d9b-b316-ddd84e97fc52@a66257f2-19e5-45b9-ab36-1aeffae8ef9c
322025-03-03T05:35:37.985ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_527b3e02-90de-4b9d-9c6c-1467b770781a/crucible/regions/e38205f4-116a-4d9b-b316-ddd84e97fc52", "a66257f2-19e5-45b9-ab36-1aeffae8ef9c"]
332025-03-03T05:35:37.993ZINFOcrucible-agent (datafile): requesting running snapshot e38205f4-116a-4d9b-b316-ddd84e97fc52-a66257f2-19e5-45b9-ab36-1aeffae8ef9c state: Requested
342025-03-03T05:35:37.994ZINFOcrucible-agent (worker): applying SMF actions for region e38205f4-116a-4d9b-b316-ddd84e97fc52 running snapshot a66257f2-19e5-45b9-ab36-1aeffae8ef9c (state Requested)...
352025-03-03T05:35:37.994ZINFOcrucible-agent (dropshot): request completed latency_us = 24310 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:62106 req_id = 0e94017d-7737-4fb3-907f-af4176270fdb response_code = 200 uri = /crucible/0/regions/e38205f4-116a-4d9b-b316-ddd84e97fc52/snapshots/a66257f2-19e5-45b9-ab36-1aeffae8ef9c/run
362025-03-03T05:35:37.996ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-e38205f4-116a-4d9b-b316-ddd84e97fc52-a66257f2-19e5-45b9-ab36-1aeffae8ef9c
372025-03-03T05:35:38.002ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-e38205f4-116a-4d9b-b316-ddd84e97fc52-a66257f2-19e5-45b9-ab36-1aeffae8ef9c
382025-03-03T05:35:38.013ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-e38205f4-116a-4d9b-b316-ddd84e97fc52-a66257f2-19e5-45b9-ab36-1aeffae8ef9c
392025-03-03T05:35:38.014ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/e38205f4-116a-4d9b-b316-ddd84e97fc52/.zfs/snapshot/a66257f2-19e5-45b9-ab36-1aeffae8ef9c
402025-03-03T05:35:38.014ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19002
412025-03-03T05:35:38.014ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
422025-03-03T05:35:38.014ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::13
432025-03-03T05:35:38.014ZINFOcrucible-agent (worker): commit
442025-03-03T05:35:38.019ZINFOcrucible-agent (worker): ok!
452025-03-03T05:35:38.024ZINFOcrucible-agent (worker): SMF ok!
462025-03-03T05:35:38.024ZINFOcrucible-agent (datafile): region e38205f4-116a-4d9b-b316-ddd84e97fc52 running snapshot a66257f2-19e5-45b9-ab36-1aeffae8ef9c state: Requested -> Created
472025-03-03T05:35:38.198ZINFOcrucible-agent (datafile): path is "/data/regions/e38205f4-116a-4d9b-b316-ddd84e97fc52"
482025-03-03T05:35:38.206ZINFOcrucible-agent (datafile): dataset is oxp_527b3e02-90de-4b9d-9c6c-1467b770781a/crucible/regions/e38205f4-116a-4d9b-b316-ddd84e97fc52
492025-03-03T05:35:38.214ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_527b3e02-90de-4b9d-9c6c-1467b770781a/crucible/regions/e38205f4-116a-4d9b-b316-ddd84e97fc52@a66257f2-19e5-45b9-ab36-1aeffae8ef9c
502025-03-03T05:35:38.214ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_527b3e02-90de-4b9d-9c6c-1467b770781a/crucible/regions/e38205f4-116a-4d9b-b316-ddd84e97fc52", "a66257f2-19e5-45b9-ab36-1aeffae8ef9c"]
512025-03-03T05:35:38.221ZINFOcrucible-agent (dropshot): request completed latency_us = 23766 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:62106 req_id = 865963a5-ef82-4a42-b56e-6b140e80a0cd response_code = 200 uri = /crucible/0/regions/e38205f4-116a-4d9b-b316-ddd84e97fc52/snapshots/a66257f2-19e5-45b9-ab36-1aeffae8ef9c/run