{"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 12876,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 0,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"oxz_cockroachdb_789801a1-b145-4cb3-9f8a-857050b1b5ae.\"),\n ),\n original: Query {\n name: Name(\"oxz_cockroachdb_789801a1-b145-4cb3-9f8a-857050b1b5ae.\"),\n query_type: A,\n query_class: IN,\n },\n },\n ],\n original: [\n 52,\n 111,\n 120,\n 122,\n 95,\n 99,\n 111,\n 99,\n 107,\n 114,\n 111,\n 97,\n 99,\n 104,\n 100,\n 98,\n 95,\n 55,\n 56,\n 57,\n 56,\n 48,\n 49,\n 97,\n 49,\n 45,\n 98,\n 49,\n 52,\n 53,\n 45,\n 52,\n 99,\n 98,\n 51,\n 45,\n 57,\n 102,\n 56,\n 97,\n 45,\n 56,\n 53,\n 55,\n 48,\n 53,\n 48,\n 98,\n 49,\n 98,\n 53,\n 97,\n 101,\n 0,\n 0,\n 1,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: None,\n} SERVFAIL: server is not authoritative for name: \"oxz_cockroachdb_789801a1-b145-4cb3-9f8a-857050b1b5ae.\"","v":0,"name":"dns-server","level":50,"time":"2026-08-25T08:15:00.548884588Z","hostname":"oxz_internal_dns_1669de59-150b-4aa4-8338-0de98a6db60a","pid":5438,"peer_addr":"[fd00:1122:3344:101::3]:64956","req_id":"6e0f0376-f0b5-4d1c-a1f6-145a9458c05f","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 12876,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 0,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"oxz_cockroachdb_789801a1-b145-4cb3-9f8a-857050b1b5ae.\"),\n ),\n original: Query {\n name: Name(\"oxz_cockroachdb_789801a1-b145-4cb3-9f8a-857050b1b5ae.\"),\n query_type: A,\n query_class: IN,\n },\n },\n ],\n original: [\n 52,\n 111,\n 120,\n 122,\n 95,\n 99,\n 111,\n 99,\n 107,\n 114,\n 111,\n 97,\n 99,\n 104,\n 100,\n 98,\n 95,\n 55,\n 56,\n 57,\n 56,\n 48,\n 49,\n 97,\n 49,\n 45,\n 98,\n 49,\n 52,\n 53,\n 45,\n 52,\n 99,\n 98,\n 51,\n 45,\n 57,\n 102,\n 56,\n 97,\n 45,\n 56,\n 53,\n 55,\n 48,\n 53,\n 48,\n 98,\n 49,\n 98,\n 53,\n 97,\n 101,\n 0,\n 0,\n 1,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: None,\n} SERVFAIL: server is not authoritative for name: \"oxz_cockroachdb_789801a1-b145-4cb3-9f8a-857050b1b5ae.\"","v":0,"name":"dns-server","level":50,"time":"2026-08-25T08:15:00.54956792Z","hostname":"oxz_internal_dns_1669de59-150b-4aa4-8338-0de98a6db60a","pid":5438,"peer_addr":"[fd00:1122:3344:101::3]:42866","req_id":"73d8b5cd-0992-412d-9368-26d0ca445919","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 42400,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 0,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"oxz_cockroachdb_2b93f6d3-93be-4805-8786-efac035ede97.\"),\n ),\n original: Query {\n name: Name(\"oxz_cockroachdb_2b93f6d3-93be-4805-8786-efac035ede97.\"),\n query_type: A,\n query_class: IN,\n },\n },\n ],\n original: [\n 52,\n 111,\n 120,\n 122,\n 95,\n 99,\n 111,\n 99,\n 107,\n 114,\n 111,\n 97,\n 99,\n 104,\n 100,\n 98,\n 95,\n 50,\n 98,\n 57,\n 51,\n 102,\n 54,\n 100,\n 51,\n 45,\n 57,\n 51,\n 98,\n 101,\n 45,\n 52,\n 56,\n 48,\n 53,\n 45,\n 56,\n 55,\n 56,\n 54,\n 45,\n 101,\n 102,\n 97,\n 99,\n 48,\n 51,\n 53,\n 101,\n 100,\n 101,\n 57,\n 55,\n 0,\n 0,\n 1,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: None,\n} SERVFAIL: server is not authoritative for name: \"oxz_cockroachdb_2b93f6d3-93be-4805-8786-efac035ede97.\"","v":0,"name":"dns-server","level":50,"time":"2026-08-25T08:15:00.721623939Z","hostname":"oxz_internal_dns_1669de59-150b-4aa4-8338-0de98a6db60a","pid":5438,"peer_addr":"[fd00:1122:3344:101::7]:36583","req_id":"f742292b-cd2f-4d33-bb22-001b4aac91b2","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 42400,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 0,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"oxz_cockroachdb_2b93f6d3-93be-4805-8786-efac035ede97.\"),\n ),\n original: Query {\n name: Name(\"oxz_cockroachdb_2b93f6d3-93be-4805-8786-efac035ede97.\"),\n query_type: A,\n query_class: IN,\n },\n },\n ],\n original: [\n 52,\n 111,\n 120,\n 122,\n 95,\n 99,\n 111,\n 99,\n 107,\n 114,\n 111,\n 97,\n 99,\n 104,\n 100,\n 98,\n 95,\n 50,\n 98,\n 57,\n 51,\n 102,\n 54,\n 100,\n 51,\n 45,\n 57,\n 51,\n 98,\n 101,\n 45,\n 52,\n 56,\n 48,\n 53,\n 45,\n 56,\n 55,\n 56,\n 54,\n 45,\n 101,\n 102,\n 97,\n 99,\n 48,\n 51,\n 53,\n 101,\n 100,\n 101,\n 57,\n 55,\n 0,\n 0,\n 1,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: None,\n} SERVFAIL: server is not authoritative for name: \"oxz_cockroachdb_2b93f6d3-93be-4805-8786-efac035ede97.\"","v":0,"name":"dns-server","level":50,"time":"2026-08-25T08:15:00.722275831Z","hostname":"oxz_internal_dns_1669de59-150b-4aa4-8338-0de98a6db60a","pid":5438,"peer_addr":"[fd00:1122:3344:101::7]:38043","req_id":"f8b8a7d7-e1b3-4eaf-b896-6969d253ac22","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 43877,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 0,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"oxz_cockroachdb_9fbe98f2-3e92-4532-afc0-1ed538a07a91.\"),\n ),\n original: Query {\n name: Name(\"oxz_cockroachdb_9fbe98f2-3e92-4532-afc0-1ed538a07a91.\"),\n query_type: A,\n query_class: IN,\n },\n },\n ],\n original: [\n 52,\n 111,\n 120,\n 122,\n 95,\n 99,\n 111,\n 99,\n 107,\n 114,\n 111,\n 97,\n 99,\n 104,\n 100,\n 98,\n 95,\n 57,\n 102,\n 98,\n 101,\n 57,\n 56,\n 102,\n 50,\n 45,\n 51,\n 101,\n 57,\n 50,\n 45,\n 52,\n 53,\n 51,\n 50,\n 45,\n 97,\n 102,\n 99,\n 48,\n 45,\n 49,\n 101,\n 100,\n 53,\n 51,\n 56,\n 97,\n 48,\n 55,\n 97,\n 57,\n 49,\n 0,\n 0,\n 1,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: None,\n} SERVFAIL: server is not authoritative for name: \"oxz_cockroachdb_9fbe98f2-3e92-4532-afc0-1ed538a07a91.\"","v":0,"name":"dns-server","level":50,"time":"2026-08-25T08:15:00.722565027Z","hostname":"oxz_internal_dns_1669de59-150b-4aa4-8338-0de98a6db60a","pid":5438,"peer_addr":"[fd00:1122:3344:101::6]:36291","req_id":"2b63f9e3-855d-4ce3-b64f-a4583e70b9eb","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 43877,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 0,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"oxz_cockroachdb_9fbe98f2-3e92-4532-afc0-1ed538a07a91.\"),\n ),\n original: Query {\n name: Name(\"oxz_cockroachdb_9fbe98f2-3e92-4532-afc0-1ed538a07a91.\"),\n query_type: A,\n query_class: IN,\n },\n },\n ],\n original: [\n 52,\n 111,\n 120,\n 122,\n 95,\n 99,\n 111,\n 99,\n 107,\n 114,\n 111,\n 97,\n 99,\n 104,\n 100,\n 98,\n 95,\n 57,\n 102,\n 98,\n 101,\n 57,\n 56,\n 102,\n 50,\n 45,\n 51,\n 101,\n 57,\n 50,\n 45,\n 52,\n 53,\n 51,\n 50,\n 45,\n 97,\n 102,\n 99,\n 48,\n 45,\n 49,\n 101,\n 100,\n 53,\n 51,\n 56,\n 97,\n 48,\n 55,\n 97,\n 57,\n 49,\n 0,\n 0,\n 1,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: None,\n} SERVFAIL: server is not authoritative for name: \"oxz_cockroachdb_9fbe98f2-3e92-4532-afc0-1ed538a07a91.\"","v":0,"name":"dns-server","level":50,"time":"2026-08-25T08:15:00.722997255Z","hostname":"oxz_internal_dns_1669de59-150b-4aa4-8338-0de98a6db60a","pid":5438,"peer_addr":"[fd00:1122:3344:101::6]:58645","req_id":"c5f25512-5171-46c4-975c-1f314cb1d38f","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 13547,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 0,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"oxz_cockroachdb_4622d990-9317-483b-b327-8fb8e8ba461c.\"),\n ),\n original: Query {\n name: Name(\"oxz_cockroachdb_4622d990-9317-483b-b327-8fb8e8ba461c.\"),\n query_type: A,\n query_class: IN,\n },\n },\n ],\n original: [\n 52,\n 111,\n 120,\n 122,\n 95,\n 99,\n 111,\n 99,\n 107,\n 114,\n 111,\n 97,\n 99,\n 104,\n 100,\n 98,\n 95,\n 52,\n 54,\n 50,\n 50,\n 100,\n 57,\n 57,\n 48,\n 45,\n 57,\n 51,\n 49,\n 55,\n 45,\n 52,\n 56,\n 51,\n 98,\n 45,\n 98,\n 51,\n 50,\n 55,\n 45,\n 56,\n 102,\n 98,\n 56,\n 101,\n 56,\n 98,\n 97,\n 52,\n 54,\n 49,\n 99,\n 0,\n 0,\n 1,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: None,\n} SERVFAIL: server is not authoritative for name: \"oxz_cockroachdb_4622d990-9317-483b-b327-8fb8e8ba461c.\"","v":0,"name":"dns-server","level":50,"time":"2026-08-25T08:15:00.78476747Z","hostname":"oxz_internal_dns_1669de59-150b-4aa4-8338-0de98a6db60a","pid":5438,"peer_addr":"[fd00:1122:3344:101::4]:63041","req_id":"2aa0df30-49ae-4eab-9b06-09aa4133e376","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 13547,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 0,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"oxz_cockroachdb_4622d990-9317-483b-b327-8fb8e8ba461c.\"),\n ),\n original: Query {\n name: Name(\"oxz_cockroachdb_4622d990-9317-483b-b327-8fb8e8ba461c.\"),\n query_type: A,\n query_class: IN,\n },\n },\n ],\n original: [\n 52,\n 111,\n 120,\n 122,\n 95,\n 99,\n 111,\n 99,\n 107,\n 114,\n 111,\n 97,\n 99,\n 104,\n 100,\n 98,\n 95,\n 52,\n 54,\n 50,\n 50,\n 100,\n 57,\n 57,\n 48,\n 45,\n 57,\n 51,\n 49,\n 55,\n 45,\n 52,\n 56,\n 51,\n 98,\n 45,\n 98,\n 51,\n 50,\n 55,\n 45,\n 56,\n 102,\n 98,\n 56,\n 101,\n 56,\n 98,\n 97,\n 52,\n 54,\n 49,\n 99,\n 0,\n 0,\n 1,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: None,\n} SERVFAIL: server is not authoritative for name: \"oxz_cockroachdb_4622d990-9317-483b-b327-8fb8e8ba461c.\"","v":0,"name":"dns-server","level":50,"time":"2026-08-25T08:15:00.785364421Z","hostname":"oxz_internal_dns_1669de59-150b-4aa4-8338-0de98a6db60a","pid":5438,"peer_addr":"[fd00:1122:3344:101::4]:58588","req_id":"79c734b7-fecb-4361-b93b-ea38fc6b5511","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 26128,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2026-08-25T08:15:09.260698523Z","hostname":"oxz_internal_dns_1669de59-150b-4aa4-8338-0de98a6db60a","pid":5438,"peer_addr":"[fd00:1122:3344:101::d]:60898","req_id":"63a06090-c1dc-4f44-8d31-ece61a804b84","component":"dns"} {"msg":"accepted connection","v":0,"name":"dns-server","level":30,"time":"2026-08-25T08:15:10.251225522Z","hostname":"oxz_internal_dns_1669de59-150b-4aa4-8338-0de98a6db60a","pid":5438,"local_addr":"[fd00:1122:3344:2::1]:5353","component":"http","remote_addr":"[fd00:1122:3344:101::b]:34699"} {"msg":"accepted connection","v":0,"name":"dns-server","level":30,"time":"2026-08-25T08:15:10.254010394Z","hostname":"oxz_internal_dns_1669de59-150b-4aa4-8338-0de98a6db60a","pid":5438,"local_addr":"[fd00:1122:3344:2::1]:5353","component":"http","remote_addr":"[fd00:1122:3344:101::c]:45625"} {"msg":"attempting generation update","v":0,"name":"dns-server","level":30,"time":"2026-08-25T08:15:10.254759888Z","hostname":"oxz_internal_dns_1669de59-150b-4aa4-8338-0de98a6db60a","pid":5438,"new_generation":1,"req_id":"1b1b8efd-7978-4bb3-9708-e778d181ca33","component":"store"} {"msg":"updated generation","v":0,"name":"dns-server","level":30,"time":"2026-08-25T08:15:10.254782628Z","hostname":"oxz_internal_dns_1669de59-150b-4aa4-8338-0de98a6db60a","pid":5438,"new_generation":1,"req_id":"1b1b8efd-7978-4bb3-9708-e778d181ca33","component":"store"} {"msg":"request completed","v":0,"name":"dns-server","level":30,"time":"2026-08-25T08:15:10.254792819Z","hostname":"oxz_internal_dns_1669de59-150b-4aa4-8338-0de98a6db60a","pid":5438,"uri":"/config","method":"PUT","req_id":"1b1b8efd-7978-4bb3-9708-e778d181ca33","remote_addr":"[fd00:1122:3344:101::b]:34699","local_addr":"[fd00:1122:3344:2::1]:5353","component":"http","latency_us":234,"response_code":204} {"msg":"attempting generation update","v":0,"name":"dns-server","level":30,"time":"2026-08-25T08:15:10.256920148Z","hostname":"oxz_internal_dns_1669de59-150b-4aa4-8338-0de98a6db60a","pid":5438,"new_generation":1,"req_id":"bee24e6c-e8fb-4858-b3ec-41236f7ba7ea","component":"store"} {"msg":"updated generation","v":0,"name":"dns-server","level":30,"time":"2026-08-25T08:15:10.256959889Z","hostname":"oxz_internal_dns_1669de59-150b-4aa4-8338-0de98a6db60a","pid":5438,"new_generation":1,"req_id":"bee24e6c-e8fb-4858-b3ec-41236f7ba7ea","component":"store"} {"msg":"request completed","v":0,"name":"dns-server","level":30,"time":"2026-08-25T08:15:10.256971879Z","hostname":"oxz_internal_dns_1669de59-150b-4aa4-8338-0de98a6db60a","pid":5438,"uri":"/config","method":"PUT","req_id":"bee24e6c-e8fb-4858-b3ec-41236f7ba7ea","remote_addr":"[fd00:1122:3344:101::c]:45625","local_addr":"[fd00:1122:3344:2::1]:5353","component":"http","latency_us":205,"response_code":204} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 32590,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-admin-keeper._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-admin-keeper._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 24,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 97,\n 100,\n 109,\n 105,\n 110,\n 45,\n 107,\n 101,\n 101,\n 112,\n 101,\n 114,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2026-08-25T08:15:11.218884017Z","hostname":"oxz_internal_dns_1669de59-150b-4aa4-8338-0de98a6db60a","pid":5438,"peer_addr":"[fd00:1122:3344:101::b]:29680","req_id":"28263490-0aa2-450c-abbb-cf3dbc236157","component":"dns"} {"msg":"accepted connection","v":0,"name":"dns-server","level":30,"time":"2026-08-25T08:15:11.329599609Z","hostname":"oxz_internal_dns_1669de59-150b-4aa4-8338-0de98a6db60a","pid":5438,"local_addr":"[fd00:1122:3344:2::1]:5353","component":"http","remote_addr":"[fd00:1122:3344:101::b]:65134"} {"msg":"request completed","v":0,"name":"dns-server","level":30,"time":"2026-08-25T08:15:11.329859624Z","hostname":"oxz_internal_dns_1669de59-150b-4aa4-8338-0de98a6db60a","pid":5438,"uri":"/config","method":"GET","req_id":"49811f8e-63f3-47d8-b9a8-c725481ddd8e","remote_addr":"[fd00:1122:3344:101::b]:65134","local_addr":"[fd00:1122:3344:2::1]:5353","component":"http","latency_us":200,"response_code":200} {"msg":"accepted connection","v":0,"name":"dns-server","level":30,"time":"2026-08-25T08:15:11.349428056Z","hostname":"oxz_internal_dns_1669de59-150b-4aa4-8338-0de98a6db60a","pid":5438,"local_addr":"[fd00:1122:3344:2::1]:5353","component":"http","remote_addr":"[fd00:1122:3344:101::a]:39515"} {"msg":"attempting generation update","v":0,"name":"dns-server","level":30,"time":"2026-08-25T08:15:11.352520784Z","hostname":"oxz_internal_dns_1669de59-150b-4aa4-8338-0de98a6db60a","pid":5438,"new_generation":1,"req_id":"2e720b6f-19c4-4d9e-9edb-04fdda5983b1","component":"store"} {"msg":"updated generation","v":0,"name":"dns-server","level":30,"time":"2026-08-25T08:15:11.352559785Z","hostname":"oxz_internal_dns_1669de59-150b-4aa4-8338-0de98a6db60a","pid":5438,"new_generation":1,"req_id":"2e720b6f-19c4-4d9e-9edb-04fdda5983b1","component":"store"} {"msg":"request completed","v":0,"name":"dns-server","level":30,"time":"2026-08-25T08:15:11.352573115Z","hostname":"oxz_internal_dns_1669de59-150b-4aa4-8338-0de98a6db60a","pid":5438,"uri":"/config","method":"PUT","req_id":"2e720b6f-19c4-4d9e-9edb-04fdda5983b1","remote_addr":"[fd00:1122:3344:101::a]:39515","local_addr":"[fd00:1122:3344:2::1]:5353","component":"http","latency_us":275,"response_code":204} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 36187,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-admin-keeper._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-admin-keeper._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 24,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 97,\n 100,\n 109,\n 105,\n 110,\n 45,\n 107,\n 101,\n 101,\n 112,\n 101,\n 114,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2026-08-25T08:15:11.912574044Z","hostname":"oxz_internal_dns_1669de59-150b-4aa4-8338-0de98a6db60a","pid":5438,"peer_addr":"[fd00:1122:3344:101::c]:35975","req_id":"bed7dc20-2aa7-4d91-895b-52a1dd7c50a8","component":"dns"} {"msg":"accepted connection","v":0,"name":"dns-server","level":30,"time":"2026-08-25T08:15:12.02779288Z","hostname":"oxz_internal_dns_1669de59-150b-4aa4-8338-0de98a6db60a","pid":5438,"local_addr":"[fd00:1122:3344:2::1]:5353","component":"http","remote_addr":"[fd00:1122:3344:101::c]:63079"} {"msg":"request completed","v":0,"name":"dns-server","level":30,"time":"2026-08-25T08:15:12.028093195Z","hostname":"oxz_internal_dns_1669de59-150b-4aa4-8338-0de98a6db60a","pid":5438,"uri":"/config","method":"GET","req_id":"dd90ba77-4eb8-4334-9415-5b7da39fccdf","remote_addr":"[fd00:1122:3344:101::c]:63079","local_addr":"[fd00:1122:3344:2::1]:5353","component":"http","latency_us":249,"response_code":200} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 278,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-admin-keeper._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-admin-keeper._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 24,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 97,\n 100,\n 109,\n 105,\n 110,\n 45,\n 107,\n 101,\n 101,\n 112,\n 101,\n 114,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2026-08-25T08:15:12.74807116Z","hostname":"oxz_internal_dns_1669de59-150b-4aa4-8338-0de98a6db60a","pid":5438,"peer_addr":"[fd00:1122:3344:101::a]:39166","req_id":"c12ccb96-ca34-41f5-84ac-a5fdd68a89b9","component":"dns"} {"msg":"accepted connection","v":0,"name":"dns-server","level":30,"time":"2026-08-25T08:15:12.938554601Z","hostname":"oxz_internal_dns_1669de59-150b-4aa4-8338-0de98a6db60a","pid":5438,"local_addr":"[fd00:1122:3344:2::1]:5353","component":"http","remote_addr":"[fd00:1122:3344:101::a]:63858"} {"msg":"request completed","v":0,"name":"dns-server","level":30,"time":"2026-08-25T08:15:12.938768974Z","hostname":"oxz_internal_dns_1669de59-150b-4aa4-8338-0de98a6db60a","pid":5438,"uri":"/config","method":"GET","req_id":"51229cb0-a1af-46bf-bd5e-15b3cb35894a","remote_addr":"[fd00:1122:3344:101::a]:63858","local_addr":"[fd00:1122:3344:2::1]:5353","component":"http","latency_us":179,"response_code":200} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 22891,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2026-08-25T08:15:19.262161214Z","hostname":"oxz_internal_dns_1669de59-150b-4aa4-8338-0de98a6db60a","pid":5438,"peer_addr":"[fd00:1122:3344:101::d]:58935","req_id":"42e44dc2-d411-47f2-9fb4-149ab4d0fcb9","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 26779,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2026-08-25T08:15:29.264622472Z","hostname":"oxz_internal_dns_1669de59-150b-4aa4-8338-0de98a6db60a","pid":5438,"peer_addr":"[fd00:1122:3344:101::d]:65325","req_id":"7327dffe-72ff-4dd1-8828-d7f437f1aee1","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 7276,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2026-08-25T08:15:39.266013698Z","hostname":"oxz_internal_dns_1669de59-150b-4aa4-8338-0de98a6db60a","pid":5438,"peer_addr":"[fd00:1122:3344:101::d]:59472","req_id":"eb5955f7-ff95-4d44-bf16-2261bb70b504","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 46167,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2026-08-25T08:15:49.268061075Z","hostname":"oxz_internal_dns_1669de59-150b-4aa4-8338-0de98a6db60a","pid":5438,"peer_addr":"[fd00:1122:3344:101::d]:50600","req_id":"2d72d9d9-a9fb-49dc-963f-531f803dcd44","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 28174,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2026-08-25T08:15:59.271662773Z","hostname":"oxz_internal_dns_1669de59-150b-4aa4-8338-0de98a6db60a","pid":5438,"peer_addr":"[fd00:1122:3344:101::d]:61769","req_id":"2dfc1d8f-3a00-446f-8f08-091bffdad915","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 43913,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2026-08-25T08:16:09.273909316Z","hostname":"oxz_internal_dns_1669de59-150b-4aa4-8338-0de98a6db60a","pid":5438,"peer_addr":"[fd00:1122:3344:101::d]:50498","req_id":"a0fa9ddb-d5f8-4373-9c16-542b0c9920b9","component":"dns"} {"msg":"accepted connection","v":0,"name":"dns-server","level":30,"time":"2026-08-25T08:16:10.25389084Z","hostname":"oxz_internal_dns_1669de59-150b-4aa4-8338-0de98a6db60a","pid":5438,"local_addr":"[fd00:1122:3344:2::1]:5353","component":"http","remote_addr":"[fd00:1122:3344:101::b]:49560"} {"msg":"accepted connection","v":0,"name":"dns-server","level":30,"time":"2026-08-25T08:16:10.256761674Z","hostname":"oxz_internal_dns_1669de59-150b-4aa4-8338-0de98a6db60a","pid":5438,"local_addr":"[fd00:1122:3344:2::1]:5353","component":"http","remote_addr":"[fd00:1122:3344:101::c]:56324"} {"msg":"attempting generation update","v":0,"name":"dns-server","level":30,"time":"2026-08-25T08:16:10.257410576Z","hostname":"oxz_internal_dns_1669de59-150b-4aa4-8338-0de98a6db60a","pid":5438,"new_generation":1,"req_id":"ee499a90-5af3-4fd7-8515-07397c46e68c","component":"store"} {"msg":"updated generation","v":0,"name":"dns-server","level":30,"time":"2026-08-25T08:16:10.257445786Z","hostname":"oxz_internal_dns_1669de59-150b-4aa4-8338-0de98a6db60a","pid":5438,"new_generation":1,"req_id":"ee499a90-5af3-4fd7-8515-07397c46e68c","component":"store"} {"msg":"request completed","v":0,"name":"dns-server","level":30,"time":"2026-08-25T08:16:10.257458096Z","hostname":"oxz_internal_dns_1669de59-150b-4aa4-8338-0de98a6db60a","pid":5438,"uri":"/config","method":"PUT","req_id":"ee499a90-5af3-4fd7-8515-07397c46e68c","remote_addr":"[fd00:1122:3344:101::b]:49560","local_addr":"[fd00:1122:3344:2::1]:5353","component":"http","latency_us":279,"response_code":204} {"msg":"attempting generation update","v":0,"name":"dns-server","level":30,"time":"2026-08-25T08:16:10.260006834Z","hostname":"oxz_internal_dns_1669de59-150b-4aa4-8338-0de98a6db60a","pid":5438,"new_generation":1,"req_id":"a44863ba-3124-477f-9b76-baf39ca5d2f3","component":"store"} {"msg":"updated generation","v":0,"name":"dns-server","level":30,"time":"2026-08-25T08:16:10.260043924Z","hostname":"oxz_internal_dns_1669de59-150b-4aa4-8338-0de98a6db60a","pid":5438,"new_generation":1,"req_id":"a44863ba-3124-477f-9b76-baf39ca5d2f3","component":"store"} {"msg":"request completed","v":0,"name":"dns-server","level":30,"time":"2026-08-25T08:16:10.260055015Z","hostname":"oxz_internal_dns_1669de59-150b-4aa4-8338-0de98a6db60a","pid":5438,"uri":"/config","method":"PUT","req_id":"a44863ba-3124-477f-9b76-baf39ca5d2f3","remote_addr":"[fd00:1122:3344:101::c]:56324","local_addr":"[fd00:1122:3344:2::1]:5353","component":"http","latency_us":245,"response_code":204} {"msg":"accepted connection","v":0,"name":"dns-server","level":30,"time":"2026-08-25T08:16:11.34643078Z","hostname":"oxz_internal_dns_1669de59-150b-4aa4-8338-0de98a6db60a","pid":5438,"local_addr":"[fd00:1122:3344:2::1]:5353","component":"http","remote_addr":"[fd00:1122:3344:101::a]:58538"} {"msg":"attempting generation update","v":0,"name":"dns-server","level":30,"time":"2026-08-25T08:16:11.348975267Z","hostname":"oxz_internal_dns_1669de59-150b-4aa4-8338-0de98a6db60a","pid":5438,"new_generation":1,"req_id":"8ab5f315-815d-4ca6-b562-f8722f378715","component":"store"} {"msg":"updated generation","v":0,"name":"dns-server","level":30,"time":"2026-08-25T08:16:11.349011447Z","hostname":"oxz_internal_dns_1669de59-150b-4aa4-8338-0de98a6db60a","pid":5438,"new_generation":1,"req_id":"8ab5f315-815d-4ca6-b562-f8722f378715","component":"store"} {"msg":"request completed","v":0,"name":"dns-server","level":30,"time":"2026-08-25T08:16:11.349023338Z","hostname":"oxz_internal_dns_1669de59-150b-4aa4-8338-0de98a6db60a","pid":5438,"uri":"/config","method":"PUT","req_id":"8ab5f315-815d-4ca6-b562-f8722f378715","remote_addr":"[fd00:1122:3344:101::a]:58538","local_addr":"[fd00:1122:3344:2::1]:5353","component":"http","latency_us":237,"response_code":204} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 61282,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-admin-keeper._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-admin-keeper._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 24,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 97,\n 100,\n 109,\n 105,\n 110,\n 45,\n 107,\n 101,\n 101,\n 112,\n 101,\n 114,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2026-08-25T08:16:11.465979495Z","hostname":"oxz_internal_dns_1669de59-150b-4aa4-8338-0de98a6db60a","pid":5438,"peer_addr":"[fd00:1122:3344:101::c]:47811","req_id":"3d186d73-8f5e-4964-9ebb-9d7bafb76ae1","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 19948,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-admin-keeper._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-admin-keeper._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 24,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 97,\n 100,\n 109,\n 105,\n 110,\n 45,\n 107,\n 101,\n 101,\n 112,\n 101,\n 114,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2026-08-25T08:16:11.467569075Z","hostname":"oxz_internal_dns_1669de59-150b-4aa4-8338-0de98a6db60a","pid":5438,"peer_addr":"[fd00:1122:3344:101::b]:30331","req_id":"18ae3a1f-8f85-4490-ade1-cbcac8b3b461","component":"dns"} {"msg":"accepted connection","v":0,"name":"dns-server","level":30,"time":"2026-08-25T08:16:11.609106888Z","hostname":"oxz_internal_dns_1669de59-150b-4aa4-8338-0de98a6db60a","pid":5438,"local_addr":"[fd00:1122:3344:2::1]:5353","component":"http","remote_addr":"[fd00:1122:3344:101::c]:44412"} {"msg":"request completed","v":0,"name":"dns-server","level":30,"time":"2026-08-25T08:16:11.609365383Z","hostname":"oxz_internal_dns_1669de59-150b-4aa4-8338-0de98a6db60a","pid":5438,"uri":"/config","method":"GET","req_id":"6e8d779d-6a4c-42b9-abf9-adeb92025a7f","remote_addr":"[fd00:1122:3344:101::c]:44412","local_addr":"[fd00:1122:3344:2::1]:5353","component":"http","latency_us":191,"response_code":200} {"msg":"accepted connection","v":0,"name":"dns-server","level":30,"time":"2026-08-25T08:16:11.664553306Z","hostname":"oxz_internal_dns_1669de59-150b-4aa4-8338-0de98a6db60a","pid":5438,"local_addr":"[fd00:1122:3344:2::1]:5353","component":"http","remote_addr":"[fd00:1122:3344:101::b]:51808"} {"msg":"request completed","v":0,"name":"dns-server","level":30,"time":"2026-08-25T08:16:11.66479666Z","hostname":"oxz_internal_dns_1669de59-150b-4aa4-8338-0de98a6db60a","pid":5438,"uri":"/config","method":"GET","req_id":"0f82ed56-cde6-488a-97b1-5c0a48e03273","remote_addr":"[fd00:1122:3344:101::b]:51808","local_addr":"[fd00:1122:3344:2::1]:5353","component":"http","latency_us":201,"response_code":200} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 50512,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-admin-keeper._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-admin-keeper._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 24,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 97,\n 100,\n 109,\n 105,\n 110,\n 45,\n 107,\n 101,\n 101,\n 112,\n 101,\n 114,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2026-08-25T08:16:12.831392062Z","hostname":"oxz_internal_dns_1669de59-150b-4aa4-8338-0de98a6db60a","pid":5438,"peer_addr":"[fd00:1122:3344:101::a]:30759","req_id":"c4d8cd59-cc01-4459-a215-3b449a8edafd","component":"dns"} {"msg":"accepted connection","v":0,"name":"dns-server","level":30,"time":"2026-08-25T08:16:12.944391237Z","hostname":"oxz_internal_dns_1669de59-150b-4aa4-8338-0de98a6db60a","pid":5438,"local_addr":"[fd00:1122:3344:2::1]:5353","component":"http","remote_addr":"[fd00:1122:3344:101::a]:49047"} {"msg":"request completed","v":0,"name":"dns-server","level":30,"time":"2026-08-25T08:16:12.944669932Z","hostname":"oxz_internal_dns_1669de59-150b-4aa4-8338-0de98a6db60a","pid":5438,"uri":"/config","method":"GET","req_id":"10eced9a-4402-45cb-a8dc-64c52215302d","remote_addr":"[fd00:1122:3344:101::a]:49047","local_addr":"[fd00:1122:3344:2::1]:5353","component":"http","latency_us":235,"response_code":200} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 31714,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2026-08-25T08:16:19.27622063Z","hostname":"oxz_internal_dns_1669de59-150b-4aa4-8338-0de98a6db60a","pid":5438,"peer_addr":"[fd00:1122:3344:101::d]:55986","req_id":"58788eb3-91ff-4a92-a037-cf1bf51b6881","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 42450,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2026-08-25T08:16:29.278243917Z","hostname":"oxz_internal_dns_1669de59-150b-4aa4-8338-0de98a6db60a","pid":5438,"peer_addr":"[fd00:1122:3344:101::d]:56414","req_id":"c881c339-e196-4666-bced-3bb0e26cea5c","component":"dns"}