Max level shown:
12025-08-30T14:39:05.972ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::18]:32345 remote_addr = [fd00:1122:3344:101::b]:38626
22025-08-30T14:39:05.973ZINFOcrucible-agent (datafile): region 2f3e5ee0-4b42-4854-a9be-670adc1798e1 state: Requested
32025-08-30T14:39:05.973ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
42025-08-30T14:39:05.973ZINFOcrucible-agent (dropshot): request completed latency_us = 747 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:38626 req_id = cae5d2f5-8641-48fa-a75a-851437ea933b response_code = 200 uri = /crucible/0/regions
52025-08-30T14:39:05.998ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_54d468b9-9d2a-44a2-a2a9-7bb66ff58d95/crucible/regions/2f3e5ee0-4b42-4854-a9be-670adc1798e1
62025-08-30T14:39:05.998ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_54d468b9-9d2a-44a2-a2a9-7bb66ff58d95/crucible/regions/2f3e5ee0-4b42-4854-a9be-670adc1798e1
72025-08-30T14:39:06.062ZINFOcrucible-agent (worker): creating region Region { id: RegionId("2f3e5ee0-4b42-4854-a9be-670adc1798e1"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/2f3e5ee0-4b42-4854-a9be-670adc1798e1" region = 2f3e5ee0-4b42-4854-a9be-670adc1798e1
82025-08-30T14:39:06.062ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "2f3e5ee0-4b42-4854-a9be-670adc1798e1" "--data" "/data/regions/2f3e5ee0-4b42-4854-a9be-670adc1798e1" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 2f3e5ee0-4b42-4854-a9be-670adc1798e1
92025-08-30T14:39:06.145ZINFOcrucible-agent (worker): region files created ok region = 2f3e5ee0-4b42-4854-a9be-670adc1798e1
102025-08-30T14:39:06.145ZINFOcrucible-agent (datafile): region 2f3e5ee0-4b42-4854-a9be-670adc1798e1 state: Requested -> Created
112025-08-30T14:39:06.145ZINFOcrucible-agent (worker): applying SMF actions post create...
122025-08-30T14:39:06.161ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-2f3e5ee0-4b42-4854-a9be-670adc1798e1
132025-08-30T14:39:06.173ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-2f3e5ee0-4b42-4854-a9be-670adc1798e1
142025-08-30T14:39:06.185ZINFOcrucible-agent (worker): creating config property group
152025-08-30T14:39:06.189ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-2f3e5ee0-4b42-4854-a9be-670adc1798e1
162025-08-30T14:39:06.190ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/2f3e5ee0-4b42-4854-a9be-670adc1798e1
172025-08-30T14:39:06.190ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
182025-08-30T14:39:06.190ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::18
192025-08-30T14:39:06.190ZINFOcrucible-agent (worker): commit
202025-08-30T14:39:06.194ZINFOcrucible-agent (worker): ok!
212025-08-30T14:39:06.199ZINFOcrucible-agent (worker): SMF ok!
222025-08-30T14:39:06.333ZINFOcrucible-agent (dropshot): request completed latency_us = 67 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:38626 req_id = d5a25812-6553-4a3d-91f6-eaeae11e3578 response_code = 200 uri = /crucible/0/regions
232025-08-30T14:39:07.321ZINFOcrucible-agent (dropshot): request completed latency_us = 64 local_addr = [fd00:1122:3344:101::18]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:38626 req_id = a07af806-95ac-4c69-bd24-30d14a1109f4 response_code = 200 uri = /crucible/0/regions/19eb8c9b-1de4-462f-b0f7-1fa0c8f2dceb
242025-08-30T14:39:07.327ZINFOcrucible-agent (datafile): path is "/data/regions/19eb8c9b-1de4-462f-b0f7-1fa0c8f2dceb"
252025-08-30T14:39:07.336ZINFOcrucible-agent (datafile): dataset is oxp_54d468b9-9d2a-44a2-a2a9-7bb66ff58d95/crucible/regions/19eb8c9b-1de4-462f-b0f7-1fa0c8f2dceb
262025-08-30T14:39:07.346ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_54d468b9-9d2a-44a2-a2a9-7bb66ff58d95/crucible/regions/19eb8c9b-1de4-462f-b0f7-1fa0c8f2dceb@36f889c3-9acc-4c22-b06d-e8e7711476c3
272025-08-30T14:39:07.346ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_54d468b9-9d2a-44a2-a2a9-7bb66ff58d95/crucible/regions/19eb8c9b-1de4-462f-b0f7-1fa0c8f2dceb", "36f889c3-9acc-4c22-b06d-e8e7711476c3"]
282025-08-30T14:39:07.357ZINFOcrucible-agent (dropshot): request completed latency_us = 29934 local_addr = [fd00:1122:3344:101::18]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:38626 req_id = 82d641e2-413a-4495-a8c3-76d0d8c8bfef response_code = 200 uri = /crucible/0/regions/19eb8c9b-1de4-462f-b0f7-1fa0c8f2dceb/snapshots/36f889c3-9acc-4c22-b06d-e8e7711476c3
292025-08-30T14:39:07.360ZINFOcrucible-agent (datafile): path is "/data/regions/19eb8c9b-1de4-462f-b0f7-1fa0c8f2dceb"
302025-08-30T14:39:07.368ZINFOcrucible-agent (datafile): dataset is oxp_54d468b9-9d2a-44a2-a2a9-7bb66ff58d95/crucible/regions/19eb8c9b-1de4-462f-b0f7-1fa0c8f2dceb
312025-08-30T14:39:07.377ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_54d468b9-9d2a-44a2-a2a9-7bb66ff58d95/crucible/regions/19eb8c9b-1de4-462f-b0f7-1fa0c8f2dceb@36f889c3-9acc-4c22-b06d-e8e7711476c3
322025-08-30T14:39:07.377ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_54d468b9-9d2a-44a2-a2a9-7bb66ff58d95/crucible/regions/19eb8c9b-1de4-462f-b0f7-1fa0c8f2dceb", "36f889c3-9acc-4c22-b06d-e8e7711476c3"]
332025-08-30T14:39:07.388ZINFOcrucible-agent (datafile): requesting running snapshot 19eb8c9b-1de4-462f-b0f7-1fa0c8f2dceb-36f889c3-9acc-4c22-b06d-e8e7711476c3 state: Requested
342025-08-30T14:39:07.388ZINFOcrucible-agent (worker): applying SMF actions for region 19eb8c9b-1de4-462f-b0f7-1fa0c8f2dceb running snapshot 36f889c3-9acc-4c22-b06d-e8e7711476c3 (state Requested)...
352025-08-30T14:39:07.388ZINFOcrucible-agent (dropshot): request completed latency_us = 28418 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:38626 req_id = eafd0190-a1d4-43eb-9fa7-af78b5bfc4f4 response_code = 200 uri = /crucible/0/regions/19eb8c9b-1de4-462f-b0f7-1fa0c8f2dceb/snapshots/36f889c3-9acc-4c22-b06d-e8e7711476c3/run
362025-08-30T14:39:07.391ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-19eb8c9b-1de4-462f-b0f7-1fa0c8f2dceb-36f889c3-9acc-4c22-b06d-e8e7711476c3
372025-08-30T14:39:07.394ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-19eb8c9b-1de4-462f-b0f7-1fa0c8f2dceb-36f889c3-9acc-4c22-b06d-e8e7711476c3
382025-08-30T14:39:07.404ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-19eb8c9b-1de4-462f-b0f7-1fa0c8f2dceb-36f889c3-9acc-4c22-b06d-e8e7711476c3
392025-08-30T14:39:07.404ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/19eb8c9b-1de4-462f-b0f7-1fa0c8f2dceb/.zfs/snapshot/36f889c3-9acc-4c22-b06d-e8e7711476c3
402025-08-30T14:39:07.404ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19002
412025-08-30T14:39:07.404ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
422025-08-30T14:39:07.404ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::18
432025-08-30T14:39:07.404ZINFOcrucible-agent (worker): commit
442025-08-30T14:39:07.408ZINFOcrucible-agent (worker): ok!
452025-08-30T14:39:07.412ZINFOcrucible-agent (worker): SMF ok!
462025-08-30T14:39:07.412ZINFOcrucible-agent (datafile): region 19eb8c9b-1de4-462f-b0f7-1fa0c8f2dceb running snapshot 36f889c3-9acc-4c22-b06d-e8e7711476c3 state: Requested -> Created
472025-08-30T14:39:07.590ZINFOcrucible-agent (datafile): path is "/data/regions/19eb8c9b-1de4-462f-b0f7-1fa0c8f2dceb"
482025-08-30T14:39:07.600ZINFOcrucible-agent (datafile): dataset is oxp_54d468b9-9d2a-44a2-a2a9-7bb66ff58d95/crucible/regions/19eb8c9b-1de4-462f-b0f7-1fa0c8f2dceb
492025-08-30T14:39:07.610ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_54d468b9-9d2a-44a2-a2a9-7bb66ff58d95/crucible/regions/19eb8c9b-1de4-462f-b0f7-1fa0c8f2dceb@36f889c3-9acc-4c22-b06d-e8e7711476c3
502025-08-30T14:39:07.610ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_54d468b9-9d2a-44a2-a2a9-7bb66ff58d95/crucible/regions/19eb8c9b-1de4-462f-b0f7-1fa0c8f2dceb", "36f889c3-9acc-4c22-b06d-e8e7711476c3"]
512025-08-30T14:39:07.618ZINFOcrucible-agent (dropshot): request completed latency_us = 28562 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:38626 req_id = 13b86514-7b5b-4286-830b-311b869d3649 response_code = 200 uri = /crucible/0/regions/19eb8c9b-1de4-462f-b0f7-1fa0c8f2dceb/snapshots/36f889c3-9acc-4c22-b06d-e8e7711476c3/run