{"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 33720,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 0,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"oxz_cockroachdb_d70f85e5-ad95-4410-a014-366985e4e5ef.\"),\n ),\n original: Query {\n name: Name(\"oxz_cockroachdb_d70f85e5-ad95-4410-a014-366985e4e5ef.\"),\n query_type: A,\n query_class: IN,\n },\n },\n ],\n original: [\n 52,\n 111,\n 120,\n 122,\n 95,\n 99,\n 111,\n 99,\n 107,\n 114,\n 111,\n 97,\n 99,\n 104,\n 100,\n 98,\n 95,\n 100,\n 55,\n 48,\n 102,\n 56,\n 53,\n 101,\n 53,\n 45,\n 97,\n 100,\n 57,\n 53,\n 45,\n 52,\n 52,\n 49,\n 48,\n 45,\n 97,\n 48,\n 49,\n 52,\n 45,\n 51,\n 54,\n 54,\n 57,\n 56,\n 53,\n 101,\n 52,\n 101,\n 53,\n 101,\n 102,\n 0,\n 0,\n 1,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: None,\n} SERVFAIL: server is not authoritative for name: \"oxz_cockroachdb_d70f85e5-ad95-4410-a014-366985e4e5ef.\"","v":0,"name":"dns-server","level":50,"time":"2025-11-11T21:15:00.90132748Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"peer_addr":"[fd00:1122:3344:101::5]:56805","req_id":"9bf4c863-a0cb-4dc6-ba91-a1bf168b83ea","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 33720,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 0,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"oxz_cockroachdb_d70f85e5-ad95-4410-a014-366985e4e5ef.\"),\n ),\n original: Query {\n name: Name(\"oxz_cockroachdb_d70f85e5-ad95-4410-a014-366985e4e5ef.\"),\n query_type: A,\n query_class: IN,\n },\n },\n ],\n original: [\n 52,\n 111,\n 120,\n 122,\n 95,\n 99,\n 111,\n 99,\n 107,\n 114,\n 111,\n 97,\n 99,\n 104,\n 100,\n 98,\n 95,\n 100,\n 55,\n 48,\n 102,\n 56,\n 53,\n 101,\n 53,\n 45,\n 97,\n 100,\n 57,\n 53,\n 45,\n 52,\n 52,\n 49,\n 48,\n 45,\n 97,\n 48,\n 49,\n 52,\n 45,\n 51,\n 54,\n 54,\n 57,\n 56,\n 53,\n 101,\n 52,\n 101,\n 53,\n 101,\n 102,\n 0,\n 0,\n 1,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: None,\n} SERVFAIL: server is not authoritative for name: \"oxz_cockroachdb_d70f85e5-ad95-4410-a014-366985e4e5ef.\"","v":0,"name":"dns-server","level":50,"time":"2025-11-11T21:15:00.902034001Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"peer_addr":"[fd00:1122:3344:101::5]:33363","req_id":"b1062594-198a-4d2b-837f-bbfaab330790","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 16631,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 0,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"oxz_cockroachdb_681ac2ff-8c33-4bb6-bb49-2c9341df0a93.\"),\n ),\n original: Query {\n name: Name(\"oxz_cockroachdb_681ac2ff-8c33-4bb6-bb49-2c9341df0a93.\"),\n query_type: A,\n query_class: IN,\n },\n },\n ],\n original: [\n 52,\n 111,\n 120,\n 122,\n 95,\n 99,\n 111,\n 99,\n 107,\n 114,\n 111,\n 97,\n 99,\n 104,\n 100,\n 98,\n 95,\n 54,\n 56,\n 49,\n 97,\n 99,\n 50,\n 102,\n 102,\n 45,\n 56,\n 99,\n 51,\n 51,\n 45,\n 52,\n 98,\n 98,\n 54,\n 45,\n 98,\n 98,\n 52,\n 57,\n 45,\n 50,\n 99,\n 57,\n 51,\n 52,\n 49,\n 100,\n 102,\n 48,\n 97,\n 57,\n 51,\n 0,\n 0,\n 1,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: None,\n} SERVFAIL: server is not authoritative for name: \"oxz_cockroachdb_681ac2ff-8c33-4bb6-bb49-2c9341df0a93.\"","v":0,"name":"dns-server","level":50,"time":"2025-11-11T21:15:00.927000241Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"peer_addr":"[fd00:1122:3344:101::7]:34667","req_id":"b3f631aa-f875-484b-acf5-d00086d717a8","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 16631,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 0,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"oxz_cockroachdb_681ac2ff-8c33-4bb6-bb49-2c9341df0a93.\"),\n ),\n original: Query {\n name: Name(\"oxz_cockroachdb_681ac2ff-8c33-4bb6-bb49-2c9341df0a93.\"),\n query_type: A,\n query_class: IN,\n },\n },\n ],\n original: [\n 52,\n 111,\n 120,\n 122,\n 95,\n 99,\n 111,\n 99,\n 107,\n 114,\n 111,\n 97,\n 99,\n 104,\n 100,\n 98,\n 95,\n 54,\n 56,\n 49,\n 97,\n 99,\n 50,\n 102,\n 102,\n 45,\n 56,\n 99,\n 51,\n 51,\n 45,\n 52,\n 98,\n 98,\n 54,\n 45,\n 98,\n 98,\n 52,\n 57,\n 45,\n 50,\n 99,\n 57,\n 51,\n 52,\n 49,\n 100,\n 102,\n 48,\n 97,\n 57,\n 51,\n 0,\n 0,\n 1,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: None,\n} SERVFAIL: server is not authoritative for name: \"oxz_cockroachdb_681ac2ff-8c33-4bb6-bb49-2c9341df0a93.\"","v":0,"name":"dns-server","level":50,"time":"2025-11-11T21:15:00.92759103Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"peer_addr":"[fd00:1122:3344:101::7]:54816","req_id":"50a179a1-d40b-44c4-96a1-c873eba33b10","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 30762,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 0,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"oxz_cockroachdb_c474513d-11d7-4ff8-ae5e-87ce96b18f8e.\"),\n ),\n original: Query {\n name: Name(\"oxz_cockroachdb_c474513d-11d7-4ff8-ae5e-87ce96b18f8e.\"),\n query_type: A,\n query_class: IN,\n },\n },\n ],\n original: [\n 52,\n 111,\n 120,\n 122,\n 95,\n 99,\n 111,\n 99,\n 107,\n 114,\n 111,\n 97,\n 99,\n 104,\n 100,\n 98,\n 95,\n 99,\n 52,\n 55,\n 52,\n 53,\n 49,\n 51,\n 100,\n 45,\n 49,\n 49,\n 100,\n 55,\n 45,\n 52,\n 102,\n 102,\n 56,\n 45,\n 97,\n 101,\n 53,\n 101,\n 45,\n 56,\n 55,\n 99,\n 101,\n 57,\n 54,\n 98,\n 49,\n 56,\n 102,\n 56,\n 101,\n 0,\n 0,\n 1,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: None,\n} SERVFAIL: server is not authoritative for name: \"oxz_cockroachdb_c474513d-11d7-4ff8-ae5e-87ce96b18f8e.\"","v":0,"name":"dns-server","level":50,"time":"2025-11-11T21:15:00.927638711Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"peer_addr":"[fd00:1122:3344:101::3]:64920","req_id":"9fd3056c-78fc-49e5-8899-b62792168431","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 30762,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 0,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"oxz_cockroachdb_c474513d-11d7-4ff8-ae5e-87ce96b18f8e.\"),\n ),\n original: Query {\n name: Name(\"oxz_cockroachdb_c474513d-11d7-4ff8-ae5e-87ce96b18f8e.\"),\n query_type: A,\n query_class: IN,\n },\n },\n ],\n original: [\n 52,\n 111,\n 120,\n 122,\n 95,\n 99,\n 111,\n 99,\n 107,\n 114,\n 111,\n 97,\n 99,\n 104,\n 100,\n 98,\n 95,\n 99,\n 52,\n 55,\n 52,\n 53,\n 49,\n 51,\n 100,\n 45,\n 49,\n 49,\n 100,\n 55,\n 45,\n 52,\n 102,\n 102,\n 56,\n 45,\n 97,\n 101,\n 53,\n 101,\n 45,\n 56,\n 55,\n 99,\n 101,\n 57,\n 54,\n 98,\n 49,\n 56,\n 102,\n 56,\n 101,\n 0,\n 0,\n 1,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: None,\n} SERVFAIL: server is not authoritative for name: \"oxz_cockroachdb_c474513d-11d7-4ff8-ae5e-87ce96b18f8e.\"","v":0,"name":"dns-server","level":50,"time":"2025-11-11T21:15:00.928281312Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"peer_addr":"[fd00:1122:3344:101::3]:63906","req_id":"158e4e48-bf9c-45a5-9036-288cff9e5067","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 6179,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 0,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"oxz_cockroachdb_8bdc1536-6a57-4cbd-82ae-280e0e917a6c.\"),\n ),\n original: Query {\n name: Name(\"oxz_cockroachdb_8bdc1536-6a57-4cbd-82ae-280e0e917a6c.\"),\n query_type: A,\n query_class: IN,\n },\n },\n ],\n original: [\n 52,\n 111,\n 120,\n 122,\n 95,\n 99,\n 111,\n 99,\n 107,\n 114,\n 111,\n 97,\n 99,\n 104,\n 100,\n 98,\n 95,\n 56,\n 98,\n 100,\n 99,\n 49,\n 53,\n 51,\n 54,\n 45,\n 54,\n 97,\n 53,\n 55,\n 45,\n 52,\n 99,\n 98,\n 100,\n 45,\n 56,\n 50,\n 97,\n 101,\n 45,\n 50,\n 56,\n 48,\n 101,\n 48,\n 101,\n 57,\n 49,\n 55,\n 97,\n 54,\n 99,\n 0,\n 0,\n 1,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: None,\n} SERVFAIL: server is not authoritative for name: \"oxz_cockroachdb_8bdc1536-6a57-4cbd-82ae-280e0e917a6c.\"","v":0,"name":"dns-server","level":50,"time":"2025-11-11T21:15:01.016245101Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"peer_addr":"[fd00:1122:3344:101::6]:65307","req_id":"d03589c4-fdd4-4b5a-90b7-3c9681e8f397","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 6179,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 0,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"oxz_cockroachdb_8bdc1536-6a57-4cbd-82ae-280e0e917a6c.\"),\n ),\n original: Query {\n name: Name(\"oxz_cockroachdb_8bdc1536-6a57-4cbd-82ae-280e0e917a6c.\"),\n query_type: A,\n query_class: IN,\n },\n },\n ],\n original: [\n 52,\n 111,\n 120,\n 122,\n 95,\n 99,\n 111,\n 99,\n 107,\n 114,\n 111,\n 97,\n 99,\n 104,\n 100,\n 98,\n 95,\n 56,\n 98,\n 100,\n 99,\n 49,\n 53,\n 51,\n 54,\n 45,\n 54,\n 97,\n 53,\n 55,\n 45,\n 52,\n 99,\n 98,\n 100,\n 45,\n 56,\n 50,\n 97,\n 101,\n 45,\n 50,\n 56,\n 48,\n 101,\n 48,\n 101,\n 57,\n 49,\n 55,\n 97,\n 54,\n 99,\n 0,\n 0,\n 1,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: None,\n} SERVFAIL: server is not authoritative for name: \"oxz_cockroachdb_8bdc1536-6a57-4cbd-82ae-280e0e917a6c.\"","v":0,"name":"dns-server","level":50,"time":"2025-11-11T21:15:01.016885501Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"peer_addr":"[fd00:1122:3344:101::6]:36268","req_id":"1f7a9883-ab12-4b2d-980a-92538ba1ec9c","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 35645,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2025-11-11T21:15:09.129279835Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"peer_addr":"[fd00:1122:3344:101::d]:63207","req_id":"d5eeebe8-e07d-40d7-bc83-8145609cee85","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 41587,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2025-11-11T21:15:19.130499173Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"peer_addr":"[fd00:1122:3344:101::d]:65294","req_id":"d9708bf3-686a-42cd-ae35-e89cf5dcbb95","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 30758,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2025-11-11T21:15:29.131727729Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"peer_addr":"[fd00:1122:3344:101::d]:60447","req_id":"2c5c6cf2-c048-4918-a4f6-4421a893c073","component":"dns"} {"msg":"accepted connection","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:15:38.27585928Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"local_addr":"[fd00:1122:3344:2::1]:5353","component":"http","remote_addr":"[fd00:1122:3344:101::a]:42869"} {"msg":"attempting generation update","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:15:38.580786857Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"new_generation":1,"req_id":"7bfe9cd3-e34e-4f96-aad5-3bc78f84eb98","component":"store"} {"msg":"updated generation","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:15:38.580821407Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"new_generation":1,"req_id":"7bfe9cd3-e34e-4f96-aad5-3bc78f84eb98","component":"store"} {"msg":"request completed","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:15:38.580831568Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"uri":"/config","method":"PUT","req_id":"7bfe9cd3-e34e-4f96-aad5-3bc78f84eb98","remote_addr":"[fd00:1122:3344:101::a]:42869","local_addr":"[fd00:1122:3344:2::1]:5353","component":"http","latency_us":175,"response_code":204} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 849,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2025-11-11T21:15:39.133534025Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"peer_addr":"[fd00:1122:3344:101::d]:53228","req_id":"27bb5339-954b-4c0e-afe4-71b1f70f9e7b","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 53579,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-admin-keeper._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-admin-keeper._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 24,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 97,\n 100,\n 109,\n 105,\n 110,\n 45,\n 107,\n 101,\n 101,\n 112,\n 101,\n 114,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2025-11-11T21:15:39.293138883Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"peer_addr":"[fd00:1122:3344:101::a]:6768","req_id":"66f587a4-5cbb-4463-9ac7-a2ab6803383b","component":"dns"} {"msg":"accepted connection","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:15:39.460031698Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"local_addr":"[fd00:1122:3344:2::1]:5353","component":"http","remote_addr":"[fd00:1122:3344:101::c]:35621"} {"msg":"accepted connection","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:15:39.621872092Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"local_addr":"[fd00:1122:3344:2::1]:5353","component":"http","remote_addr":"[fd00:1122:3344:101::b]:33899"} {"msg":"accepted connection","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:15:39.792588038Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"local_addr":"[fd00:1122:3344:2::1]:5353","component":"http","remote_addr":"[fd00:1122:3344:101::a]:46641"} {"msg":"request completed","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:15:39.792859732Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"uri":"/config","method":"GET","req_id":"9cd0b334-73e6-4c2e-b4f1-2ae6ef807afe","remote_addr":"[fd00:1122:3344:101::a]:46641","local_addr":"[fd00:1122:3344:2::1]:5353","component":"http","latency_us":207,"response_code":200} {"msg":"attempting generation update","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:15:39.836229807Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"new_generation":1,"req_id":"bcb5cd25-508c-4363-a64e-f51213e1042e","component":"store"} {"msg":"updated generation","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:15:39.836260278Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"new_generation":1,"req_id":"bcb5cd25-508c-4363-a64e-f51213e1042e","component":"store"} {"msg":"request completed","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:15:39.836267548Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"uri":"/config","method":"PUT","req_id":"bcb5cd25-508c-4363-a64e-f51213e1042e","remote_addr":"[fd00:1122:3344:101::c]:35621","local_addr":"[fd00:1122:3344:2::1]:5353","component":"http","latency_us":196,"response_code":204} {"msg":"attempting generation update","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:15:39.949147897Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"new_generation":1,"req_id":"b291716b-6271-42a5-8d58-f182c927a2b1","component":"store"} {"msg":"updated generation","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:15:39.949182028Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"new_generation":1,"req_id":"b291716b-6271-42a5-8d58-f182c927a2b1","component":"store"} {"msg":"request completed","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:15:39.949190098Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"uri":"/config","method":"PUT","req_id":"b291716b-6271-42a5-8d58-f182c927a2b1","remote_addr":"[fd00:1122:3344:101::b]:33899","local_addr":"[fd00:1122:3344:2::1]:5353","component":"http","latency_us":234,"response_code":204} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 9530,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-admin-keeper._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-admin-keeper._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 24,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 97,\n 100,\n 109,\n 105,\n 110,\n 45,\n 107,\n 101,\n 101,\n 112,\n 101,\n 114,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2025-11-11T21:15:40.43162384Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"peer_addr":"[fd00:1122:3344:101::b]:45104","req_id":"42455d07-b6c5-43fa-b4f3-ec9e9669a34c","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 39515,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-admin-keeper._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-admin-keeper._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 24,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 97,\n 100,\n 109,\n 105,\n 110,\n 45,\n 107,\n 101,\n 101,\n 112,\n 101,\n 114,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2025-11-11T21:15:40.452775999Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"peer_addr":"[fd00:1122:3344:101::c]:40333","req_id":"c2095cb1-ed48-4049-845d-33d1647072df","component":"dns"} {"msg":"accepted connection","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:15:40.711297302Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"local_addr":"[fd00:1122:3344:2::1]:5353","component":"http","remote_addr":"[fd00:1122:3344:101::b]:58067"} {"msg":"request completed","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:15:40.712075475Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"uri":"/config","method":"GET","req_id":"805656b9-0cdc-49f5-98be-28bc4103c1df","remote_addr":"[fd00:1122:3344:101::b]:58067","local_addr":"[fd00:1122:3344:2::1]:5353","component":"http","latency_us":223,"response_code":200} {"msg":"accepted connection","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:15:40.801771102Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"local_addr":"[fd00:1122:3344:2::1]:5353","component":"http","remote_addr":"[fd00:1122:3344:101::c]:45539"} {"msg":"request completed","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:15:40.802027896Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"uri":"/config","method":"GET","req_id":"65fa212f-b6d3-4985-b842-2d8f7642282b","remote_addr":"[fd00:1122:3344:101::c]:45539","local_addr":"[fd00:1122:3344:2::1]:5353","component":"http","latency_us":193,"response_code":200} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 56196,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2025-11-11T21:15:49.134441006Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"peer_addr":"[fd00:1122:3344:101::d]:60325","req_id":"d672975d-dbad-4c1c-91ac-d574be7df41b","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 12139,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2025-11-11T21:15:59.135769536Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"peer_addr":"[fd00:1122:3344:101::d]:58259","req_id":"a7008c26-4bb7-4a0e-af85-80b899bb9254","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 64119,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 0,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"0.pool.ntp.org.\"),\n ),\n original: Query {\n name: Name(\"0.pool.ntp.org.\"),\n query_type: AAAA,\n query_class: IN,\n },\n },\n ],\n original: [\n 1,\n 48,\n 4,\n 112,\n 111,\n 111,\n 108,\n 3,\n 110,\n 116,\n 112,\n 3,\n 111,\n 114,\n 103,\n 0,\n 0,\n 28,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: None,\n} SERVFAIL: server is not authoritative for name: \"0.pool.ntp.org.\"","v":0,"name":"dns-server","level":50,"time":"2025-11-11T21:16:05.291397279Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"peer_addr":"[fd00:1122:3344:101::1b]:42088","req_id":"0b71ee4c-8456-4146-8ee1-0536376c2c32","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 56601,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 0,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"0.pool.ntp.org.\"),\n ),\n original: Query {\n name: Name(\"0.pool.ntp.org.\"),\n query_type: AAAA,\n query_class: IN,\n },\n },\n ],\n original: [\n 1,\n 48,\n 4,\n 112,\n 111,\n 111,\n 108,\n 3,\n 110,\n 116,\n 112,\n 3,\n 111,\n 114,\n 103,\n 0,\n 0,\n 28,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: None,\n} SERVFAIL: server is not authoritative for name: \"0.pool.ntp.org.\"","v":0,"name":"dns-server","level":50,"time":"2025-11-11T21:16:05.297253532Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"peer_addr":"[fd00:1122:3344:101::1b]:53107","req_id":"1699152c-970e-4b9b-930b-f0ae6235c273","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 14816,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 0,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"0.pool.ntp.org.\"),\n ),\n original: Query {\n name: Name(\"0.pool.ntp.org.\"),\n query_type: A,\n query_class: IN,\n },\n },\n ],\n original: [\n 1,\n 48,\n 4,\n 112,\n 111,\n 111,\n 108,\n 3,\n 110,\n 116,\n 112,\n 3,\n 111,\n 114,\n 103,\n 0,\n 0,\n 1,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: None,\n} SERVFAIL: server is not authoritative for name: \"0.pool.ntp.org.\"","v":0,"name":"dns-server","level":50,"time":"2025-11-11T21:16:05.302644199Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"peer_addr":"[fd00:1122:3344:101::1b]:48162","req_id":"ee9f3d2c-17a8-4485-bd1a-352656d5dcc3","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 11002,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2025-11-11T21:16:09.138277231Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"peer_addr":"[fd00:1122:3344:101::d]:65379","req_id":"096b11a6-aa42-4e7a-9151-517b9c8ce448","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 54611,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2025-11-11T21:16:19.139765384Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"peer_addr":"[fd00:1122:3344:101::d]:53519","req_id":"b2d1ad5f-9694-4cf5-aa5f-cd211e2c6106","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 59937,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2025-11-11T21:16:29.141716069Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"peer_addr":"[fd00:1122:3344:101::d]:63213","req_id":"76236d99-d651-467b-b3ce-4c35c8f0398d","component":"dns"} {"msg":"accepted connection","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:16:37.991242951Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"local_addr":"[fd00:1122:3344:2::1]:5353","component":"http","remote_addr":"[fd00:1122:3344:101::a]:56263"} {"msg":"attempting generation update","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:16:38.470608764Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"new_generation":1,"req_id":"85d04118-07dd-4e86-8f52-511d8fbefeec","component":"store"} {"msg":"updated generation","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:16:38.470646485Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"new_generation":1,"req_id":"85d04118-07dd-4e86-8f52-511d8fbefeec","component":"store"} {"msg":"request completed","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:16:38.470656115Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"uri":"/config","method":"PUT","req_id":"85d04118-07dd-4e86-8f52-511d8fbefeec","remote_addr":"[fd00:1122:3344:101::a]:56263","local_addr":"[fd00:1122:3344:2::1]:5353","component":"http","latency_us":202,"response_code":204} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 41939,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-admin-keeper._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-admin-keeper._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 24,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 97,\n 100,\n 109,\n 105,\n 110,\n 45,\n 107,\n 101,\n 101,\n 112,\n 101,\n 114,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2025-11-11T21:16:39.071476673Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"peer_addr":"[fd00:1122:3344:101::a]:6847","req_id":"73186dc9-7112-4b74-a2f9-3f112fb9adf7","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 55937,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2025-11-11T21:16:39.142332619Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"peer_addr":"[fd00:1122:3344:101::d]:55069","req_id":"e5b6c7ad-bd92-4975-956d-f527a7ce1a50","component":"dns"} {"msg":"accepted connection","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:16:39.524290261Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"local_addr":"[fd00:1122:3344:2::1]:5353","component":"http","remote_addr":"[fd00:1122:3344:101::b]:39425"} {"msg":"accepted connection","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:16:39.548250355Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"local_addr":"[fd00:1122:3344:2::1]:5353","component":"http","remote_addr":"[fd00:1122:3344:101::a]:34488"} {"msg":"request completed","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:16:39.548683752Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"uri":"/config","method":"GET","req_id":"c6ce804e-7fe7-41c6-8f72-3d62bc453e99","remote_addr":"[fd00:1122:3344:101::a]:34488","local_addr":"[fd00:1122:3344:2::1]:5353","component":"http","latency_us":316,"response_code":200} {"msg":"accepted connection","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:16:39.614787271Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"local_addr":"[fd00:1122:3344:2::1]:5353","component":"http","remote_addr":"[fd00:1122:3344:101::c]:43929"} {"msg":"attempting generation update","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:16:39.906358044Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"new_generation":1,"req_id":"b4da54d5-d0ae-42fc-8fe4-57e73fb2dcee","component":"store"} {"msg":"updated generation","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:16:39.906399695Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"new_generation":1,"req_id":"b4da54d5-d0ae-42fc-8fe4-57e73fb2dcee","component":"store"} {"msg":"request completed","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:16:39.906412545Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"uri":"/config","method":"PUT","req_id":"b4da54d5-d0ae-42fc-8fe4-57e73fb2dcee","remote_addr":"[fd00:1122:3344:101::b]:39425","local_addr":"[fd00:1122:3344:2::1]:5353","component":"http","latency_us":256,"response_code":204} {"msg":"attempting generation update","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:16:39.93230547Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"new_generation":1,"req_id":"e2e92eef-5926-48f3-ae39-8d543d772571","component":"store"} {"msg":"updated generation","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:16:39.93234391Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"new_generation":1,"req_id":"e2e92eef-5926-48f3-ae39-8d543d772571","component":"store"} {"msg":"request completed","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:16:39.932357081Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"uri":"/config","method":"PUT","req_id":"e2e92eef-5926-48f3-ae39-8d543d772571","remote_addr":"[fd00:1122:3344:101::c]:43929","local_addr":"[fd00:1122:3344:2::1]:5353","component":"http","latency_us":210,"response_code":204} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 15154,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-admin-keeper._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-admin-keeper._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 24,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 97,\n 100,\n 109,\n 105,\n 110,\n 45,\n 107,\n 101,\n 101,\n 112,\n 101,\n 114,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2025-11-11T21:16:40.417545657Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"peer_addr":"[fd00:1122:3344:101::b]:5508","req_id":"0d0ff6ed-aaaa-4c31-adb0-e71eaf0e503c","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 44070,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-admin-keeper._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-admin-keeper._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 24,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 97,\n 100,\n 109,\n 105,\n 110,\n 45,\n 107,\n 101,\n 101,\n 112,\n 101,\n 114,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2025-11-11T21:16:40.522033701Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"peer_addr":"[fd00:1122:3344:101::c]:22870","req_id":"7091572a-da8c-472d-ab41-f70e7ecb1f12","component":"dns"} {"msg":"accepted connection","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:16:40.703598561Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"local_addr":"[fd00:1122:3344:2::1]:5353","component":"http","remote_addr":"[fd00:1122:3344:101::b]:50053"} {"msg":"request completed","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:16:40.703821315Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"uri":"/config","method":"GET","req_id":"75e6c069-ee92-49a4-a05f-4a82380600ac","remote_addr":"[fd00:1122:3344:101::b]:50053","local_addr":"[fd00:1122:3344:2::1]:5353","component":"http","latency_us":186,"response_code":200} {"msg":"accepted connection","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:16:40.870880792Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"local_addr":"[fd00:1122:3344:2::1]:5353","component":"http","remote_addr":"[fd00:1122:3344:101::c]:59007"} {"msg":"request completed","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:16:40.871156587Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"uri":"/config","method":"GET","req_id":"417cf11d-27aa-4478-afec-b6819f16629c","remote_addr":"[fd00:1122:3344:101::c]:59007","local_addr":"[fd00:1122:3344:2::1]:5353","component":"http","latency_us":215,"response_code":200} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 59895,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2025-11-11T21:16:49.143638943Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"peer_addr":"[fd00:1122:3344:101::d]:51715","req_id":"0485d7a5-0c6e-4c10-8789-306c3d399f6b","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 54972,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2025-11-11T21:16:59.144978644Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"peer_addr":"[fd00:1122:3344:101::d]:65082","req_id":"51c80633-83fc-4794-88c6-7888107ed908","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 36954,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2025-11-11T21:17:09.146415007Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"peer_addr":"[fd00:1122:3344:101::d]:57571","req_id":"d07cfc3c-2a29-4456-90ca-5ca639ad4c8b","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 26547,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2025-11-11T21:17:19.148183582Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"peer_addr":"[fd00:1122:3344:101::d]:63150","req_id":"867be233-eb55-453e-9482-abb270242ac8","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 16969,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2025-11-11T21:17:29.149668732Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"peer_addr":"[fd00:1122:3344:101::d]:53672","req_id":"9c8ec9f2-b447-4c8b-b139-0cf9db47b3bd","component":"dns"} {"msg":"accepted connection","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:17:38.086626881Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"local_addr":"[fd00:1122:3344:2::1]:5353","component":"http","remote_addr":"[fd00:1122:3344:101::a]:45771"} {"msg":"attempting generation update","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:17:38.501602382Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"new_generation":1,"req_id":"6710b867-d1a4-4128-9dcf-d76ecc24243b","component":"store"} {"msg":"updated generation","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:17:38.501629163Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"new_generation":1,"req_id":"6710b867-d1a4-4128-9dcf-d76ecc24243b","component":"store"} {"msg":"request completed","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:17:38.501636193Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"uri":"/config","method":"PUT","req_id":"6710b867-d1a4-4128-9dcf-d76ecc24243b","remote_addr":"[fd00:1122:3344:101::a]:45771","local_addr":"[fd00:1122:3344:2::1]:5353","component":"http","latency_us":180,"response_code":204} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 27597,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-admin-keeper._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-admin-keeper._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 24,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 97,\n 100,\n 109,\n 105,\n 110,\n 45,\n 107,\n 101,\n 101,\n 112,\n 101,\n 114,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2025-11-11T21:17:39.149331504Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"peer_addr":"[fd00:1122:3344:101::a]:16176","req_id":"dee48e84-1f06-4e7c-8181-569f7f631599","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 56636,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2025-11-11T21:17:39.150643215Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"peer_addr":"[fd00:1122:3344:101::d]:50662","req_id":"9d004dd9-6477-4832-9c7f-638899d160b4","component":"dns"} {"msg":"accepted connection","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:17:39.403942975Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"local_addr":"[fd00:1122:3344:2::1]:5353","component":"http","remote_addr":"[fd00:1122:3344:101::c]:52297"} {"msg":"accepted connection","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:17:39.548481981Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"local_addr":"[fd00:1122:3344:2::1]:5353","component":"http","remote_addr":"[fd00:1122:3344:101::a]:57120"} {"msg":"request completed","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:17:39.548832457Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"uri":"/config","method":"GET","req_id":"1a3341af-797a-4a00-8470-e3f2e72bf3d3","remote_addr":"[fd00:1122:3344:101::a]:57120","local_addr":"[fd00:1122:3344:2::1]:5353","component":"http","latency_us":211,"response_code":200} {"msg":"accepted connection","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:17:39.592561228Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"local_addr":"[fd00:1122:3344:2::1]:5353","component":"http","remote_addr":"[fd00:1122:3344:101::b]:53858"} {"msg":"attempting generation update","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:17:39.831976495Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"new_generation":1,"req_id":"6559eda2-c309-4a31-bed1-09cc317397dd","component":"store"} {"msg":"updated generation","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:17:39.832010606Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"new_generation":1,"req_id":"6559eda2-c309-4a31-bed1-09cc317397dd","component":"store"} {"msg":"request completed","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:17:39.832017896Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"uri":"/config","method":"PUT","req_id":"6559eda2-c309-4a31-bed1-09cc317397dd","remote_addr":"[fd00:1122:3344:101::b]:53858","local_addr":"[fd00:1122:3344:2::1]:5353","component":"http","latency_us":229,"response_code":204} {"msg":"attempting generation update","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:17:39.853549821Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"new_generation":1,"req_id":"f1cde669-f0fb-48b6-ba35-4a8fefab3a78","component":"store"} {"msg":"updated generation","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:17:39.853583322Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"new_generation":1,"req_id":"f1cde669-f0fb-48b6-ba35-4a8fefab3a78","component":"store"} {"msg":"request completed","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:17:39.853592102Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"uri":"/config","method":"PUT","req_id":"f1cde669-f0fb-48b6-ba35-4a8fefab3a78","remote_addr":"[fd00:1122:3344:101::c]:52297","local_addr":"[fd00:1122:3344:2::1]:5353","component":"http","latency_us":239,"response_code":204} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 61309,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-admin-keeper._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-admin-keeper._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 24,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 97,\n 100,\n 109,\n 105,\n 110,\n 45,\n 107,\n 101,\n 101,\n 112,\n 101,\n 114,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2025-11-11T21:17:40.356822857Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"peer_addr":"[fd00:1122:3344:101::b]:49064","req_id":"e95f8a5e-956e-48cb-94fb-562917f2dea3","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 20607,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-admin-keeper._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-admin-keeper._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 24,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 97,\n 100,\n 109,\n 105,\n 110,\n 45,\n 107,\n 101,\n 101,\n 112,\n 101,\n 114,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2025-11-11T21:17:40.364449649Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"peer_addr":"[fd00:1122:3344:101::c]:59703","req_id":"03fb0466-4d1a-4fd1-89e3-77198b0ea1b6","component":"dns"} {"msg":"accepted connection","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:17:40.643440641Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"local_addr":"[fd00:1122:3344:2::1]:5353","component":"http","remote_addr":"[fd00:1122:3344:101::b]:38456"} {"msg":"request completed","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:17:40.643700565Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"uri":"/config","method":"GET","req_id":"a39a8b49-a07c-4abc-89d8-ec78d0b6bd31","remote_addr":"[fd00:1122:3344:101::b]:38456","local_addr":"[fd00:1122:3344:2::1]:5353","component":"http","latency_us":202,"response_code":200} {"msg":"accepted connection","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:17:40.678282619Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"local_addr":"[fd00:1122:3344:2::1]:5353","component":"http","remote_addr":"[fd00:1122:3344:101::c]:54728"} {"msg":"request completed","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:17:40.678561543Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"uri":"/config","method":"GET","req_id":"cef6cb63-0606-4cfb-a8bf-e40e9b4443f8","remote_addr":"[fd00:1122:3344:101::c]:54728","local_addr":"[fd00:1122:3344:2::1]:5353","component":"http","latency_us":220,"response_code":200} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 42194,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2025-11-11T21:17:49.152698865Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"peer_addr":"[fd00:1122:3344:101::d]:50215","req_id":"1a3514a1-2388-4e5a-883c-38cef08c5e64","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 58182,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2025-11-11T21:17:59.154558881Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"peer_addr":"[fd00:1122:3344:101::d]:55347","req_id":"a2523d72-5036-4f56-b2ae-8002aa504b1f","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 26827,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 0,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"0.pool.ntp.org.\"),\n ),\n original: Query {\n name: Name(\"0.pool.ntp.org.\"),\n query_type: AAAA,\n query_class: IN,\n },\n },\n ],\n original: [\n 1,\n 48,\n 4,\n 112,\n 111,\n 111,\n 108,\n 3,\n 110,\n 116,\n 112,\n 3,\n 111,\n 114,\n 103,\n 0,\n 0,\n 28,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: None,\n} SERVFAIL: server is not authoritative for name: \"0.pool.ntp.org.\"","v":0,"name":"dns-server","level":50,"time":"2025-11-11T21:18:05.389385816Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"peer_addr":"[fd00:1122:3344:101::1b]:37873","req_id":"ce99b312-3d4d-429a-88ed-cf2c9b45a1b8","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 30757,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 0,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"0.pool.ntp.org.\"),\n ),\n original: Query {\n name: Name(\"0.pool.ntp.org.\"),\n query_type: AAAA,\n query_class: IN,\n },\n },\n ],\n original: [\n 1,\n 48,\n 4,\n 112,\n 111,\n 111,\n 108,\n 3,\n 110,\n 116,\n 112,\n 3,\n 111,\n 114,\n 103,\n 0,\n 0,\n 28,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: None,\n} SERVFAIL: server is not authoritative for name: \"0.pool.ntp.org.\"","v":0,"name":"dns-server","level":50,"time":"2025-11-11T21:18:05.395067367Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"peer_addr":"[fd00:1122:3344:101::1b]:49345","req_id":"2956b733-0229-4cc0-a102-e26b52ad5755","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 8003,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 0,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"0.pool.ntp.org.\"),\n ),\n original: Query {\n name: Name(\"0.pool.ntp.org.\"),\n query_type: A,\n query_class: IN,\n },\n },\n ],\n original: [\n 1,\n 48,\n 4,\n 112,\n 111,\n 111,\n 108,\n 3,\n 110,\n 116,\n 112,\n 3,\n 111,\n 114,\n 103,\n 0,\n 0,\n 1,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: None,\n} SERVFAIL: server is not authoritative for name: \"0.pool.ntp.org.\"","v":0,"name":"dns-server","level":50,"time":"2025-11-11T21:18:05.399480747Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"peer_addr":"[fd00:1122:3344:101::1b]:36965","req_id":"86620426-9a08-41e0-95b7-341bccae7323","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 4881,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2025-11-11T21:18:09.15648559Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"peer_addr":"[fd00:1122:3344:101::d]:61064","req_id":"3f047e5d-6874-4adb-bcc2-0842c210671d","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 28424,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2025-11-11T21:18:19.158629951Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"peer_addr":"[fd00:1122:3344:101::d]:55907","req_id":"ea81faa3-66f9-4f08-a471-207ee28f0641","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 20590,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2025-11-11T21:18:29.160468477Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"peer_addr":"[fd00:1122:3344:101::d]:58075","req_id":"85ee9f05-4a33-4635-bdff-f30bf914978a","component":"dns"} {"msg":"accepted connection","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:18:38.086501733Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"local_addr":"[fd00:1122:3344:2::1]:5353","component":"http","remote_addr":"[fd00:1122:3344:101::a]:64932"} {"msg":"attempting generation update","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:18:38.489111086Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"new_generation":1,"req_id":"bceebae9-bdf6-4b96-bc47-934132389362","component":"store"} {"msg":"updated generation","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:18:38.489153057Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"new_generation":1,"req_id":"bceebae9-bdf6-4b96-bc47-934132389362","component":"store"} {"msg":"request completed","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:18:38.489163186Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"uri":"/config","method":"PUT","req_id":"bceebae9-bdf6-4b96-bc47-934132389362","remote_addr":"[fd00:1122:3344:101::a]:64932","local_addr":"[fd00:1122:3344:2::1]:5353","component":"http","latency_us":171,"response_code":204} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 19805,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2025-11-11T21:18:39.162614539Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"peer_addr":"[fd00:1122:3344:101::d]:56788","req_id":"317d8735-af6f-4ec9-b64b-3c363da2f597","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 55222,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-admin-keeper._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-admin-keeper._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 24,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 97,\n 100,\n 109,\n 105,\n 110,\n 45,\n 107,\n 101,\n 101,\n 112,\n 101,\n 114,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2025-11-11T21:18:39.22256944Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"peer_addr":"[fd00:1122:3344:101::a]:60932","req_id":"f94bf55d-3ab2-42e4-921e-ae5b8d38a54b","component":"dns"} {"msg":"accepted connection","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:18:39.549594632Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"local_addr":"[fd00:1122:3344:2::1]:5353","component":"http","remote_addr":"[fd00:1122:3344:101::c]:54143"} {"msg":"accepted connection","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:18:39.618472616Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"local_addr":"[fd00:1122:3344:2::1]:5353","component":"http","remote_addr":"[fd00:1122:3344:101::a]:61855"} {"msg":"request completed","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:18:39.61873208Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"uri":"/config","method":"GET","req_id":"7eb545a8-ee35-401f-a473-8d105de825cb","remote_addr":"[fd00:1122:3344:101::a]:61855","local_addr":"[fd00:1122:3344:2::1]:5353","component":"http","latency_us":204,"response_code":200} {"msg":"accepted connection","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:18:39.713152053Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"local_addr":"[fd00:1122:3344:2::1]:5353","component":"http","remote_addr":"[fd00:1122:3344:101::b]:61850"} {"msg":"attempting generation update","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:18:39.789894713Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"new_generation":1,"req_id":"4aa98576-d95f-4b93-ae37-295a20d0849a","component":"store"} {"msg":"updated generation","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:18:39.789924633Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"new_generation":1,"req_id":"4aa98576-d95f-4b93-ae37-295a20d0849a","component":"store"} {"msg":"request completed","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:18:39.789932353Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"uri":"/config","method":"PUT","req_id":"4aa98576-d95f-4b93-ae37-295a20d0849a","remote_addr":"[fd00:1122:3344:101::c]:54143","local_addr":"[fd00:1122:3344:2::1]:5353","component":"http","latency_us":195,"response_code":204} {"msg":"attempting generation update","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:18:40.06921673Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"new_generation":1,"req_id":"fdeed528-c27a-4c68-8b3a-8266e64a84ee","component":"store"} {"msg":"updated generation","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:18:40.06925092Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"new_generation":1,"req_id":"fdeed528-c27a-4c68-8b3a-8266e64a84ee","component":"store"} {"msg":"request completed","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:18:40.06925876Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"uri":"/config","method":"PUT","req_id":"fdeed528-c27a-4c68-8b3a-8266e64a84ee","remote_addr":"[fd00:1122:3344:101::b]:61850","local_addr":"[fd00:1122:3344:2::1]:5353","component":"http","latency_us":232,"response_code":204} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 41053,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-admin-keeper._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-admin-keeper._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 24,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 97,\n 100,\n 109,\n 105,\n 110,\n 45,\n 107,\n 101,\n 101,\n 112,\n 101,\n 114,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2025-11-11T21:18:40.299873706Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"peer_addr":"[fd00:1122:3344:101::b]:22171","req_id":"f72e2075-1b27-4575-87cc-01628cd9cbc3","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 34944,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-admin-keeper._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-admin-keeper._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 24,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 97,\n 100,\n 109,\n 105,\n 110,\n 45,\n 107,\n 101,\n 101,\n 112,\n 101,\n 114,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2025-11-11T21:18:40.301405741Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"peer_addr":"[fd00:1122:3344:101::c]:50054","req_id":"1c4ab812-998c-4b9a-a5da-d00dd01411e3","component":"dns"} {"msg":"accepted connection","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:18:40.585938211Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"local_addr":"[fd00:1122:3344:2::1]:5353","component":"http","remote_addr":"[fd00:1122:3344:101::b]:51168"} {"msg":"request completed","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:18:40.586200355Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"uri":"/config","method":"GET","req_id":"bec16641-08bf-4af1-a95e-97db3eee3045","remote_addr":"[fd00:1122:3344:101::b]:51168","local_addr":"[fd00:1122:3344:2::1]:5353","component":"http","latency_us":222,"response_code":200} {"msg":"accepted connection","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:18:40.6532667Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"local_addr":"[fd00:1122:3344:2::1]:5353","component":"http","remote_addr":"[fd00:1122:3344:101::c]:54670"} {"msg":"request completed","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:18:40.653524765Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"uri":"/config","method":"GET","req_id":"f70fa11f-39c1-4ebc-b972-bad1db0ad7b3","remote_addr":"[fd00:1122:3344:101::c]:54670","local_addr":"[fd00:1122:3344:2::1]:5353","component":"http","latency_us":197,"response_code":200} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 45833,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2025-11-11T21:18:49.16405187Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"peer_addr":"[fd00:1122:3344:101::d]:59582","req_id":"70a74ae1-77a0-44f8-8bdc-d87c053175dc","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 9064,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2025-11-11T21:18:59.165348917Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"peer_addr":"[fd00:1122:3344:101::d]:51380","req_id":"bb3435d6-5b4a-4583-979b-cfba1754114d","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 37404,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2025-11-11T21:19:09.16741842Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"peer_addr":"[fd00:1122:3344:101::d]:60326","req_id":"523986c6-a5b2-49ec-930e-f6d629918d3b","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 28877,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2025-11-11T21:19:19.169527989Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"peer_addr":"[fd00:1122:3344:101::d]:56936","req_id":"68be62ba-b614-43f6-b7d7-9fc57fc313c6","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 62011,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2025-11-11T21:19:29.171430475Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"peer_addr":"[fd00:1122:3344:101::d]:49477","req_id":"9288ba10-2f0b-4de1-ac2e-049130411be2","component":"dns"} {"msg":"accepted connection","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:19:38.11120961Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"local_addr":"[fd00:1122:3344:2::1]:5353","component":"http","remote_addr":"[fd00:1122:3344:101::a]:43878"} {"msg":"attempting generation update","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:19:38.478631219Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"new_generation":1,"req_id":"9cc08b72-46c1-41c2-88d6-6ce542602515","component":"store"} {"msg":"updated generation","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:19:38.478670959Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"new_generation":1,"req_id":"9cc08b72-46c1-41c2-88d6-6ce542602515","component":"store"} {"msg":"request completed","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:19:38.478681579Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"uri":"/config","method":"PUT","req_id":"9cc08b72-46c1-41c2-88d6-6ce542602515","remote_addr":"[fd00:1122:3344:101::a]:43878","local_addr":"[fd00:1122:3344:2::1]:5353","component":"http","latency_us":181,"response_code":204} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 41120,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2025-11-11T21:19:39.173117769Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"peer_addr":"[fd00:1122:3344:101::d]:58932","req_id":"b692f2a0-8fad-46fa-a4ac-1cd2fa77ffea","component":"dns"} {"msg":"accepted connection","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:19:39.415619526Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"local_addr":"[fd00:1122:3344:2::1]:5353","component":"http","remote_addr":"[fd00:1122:3344:101::c]:63667"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 3054,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-admin-keeper._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-admin-keeper._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 24,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 97,\n 100,\n 109,\n 105,\n 110,\n 45,\n 107,\n 101,\n 101,\n 112,\n 101,\n 114,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2025-11-11T21:19:39.488536204Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"peer_addr":"[fd00:1122:3344:101::a]:5473","req_id":"e2a770cb-c726-46d3-9772-4c235d9aa88f","component":"dns"} {"msg":"accepted connection","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:19:39.660960308Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"local_addr":"[fd00:1122:3344:2::1]:5353","component":"http","remote_addr":"[fd00:1122:3344:101::b]:50290"} {"msg":"attempting generation update","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:19:39.769524378Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"new_generation":1,"req_id":"20007f26-ad2d-4e56-9b17-ff9479b09d15","component":"store"} {"msg":"updated generation","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:19:39.769552788Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"new_generation":1,"req_id":"20007f26-ad2d-4e56-9b17-ff9479b09d15","component":"store"} {"msg":"request completed","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:19:39.769560038Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"uri":"/config","method":"PUT","req_id":"20007f26-ad2d-4e56-9b17-ff9479b09d15","remote_addr":"[fd00:1122:3344:101::c]:63667","local_addr":"[fd00:1122:3344:2::1]:5353","component":"http","latency_us":196,"response_code":204} {"msg":"accepted connection","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:19:39.822232432Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"local_addr":"[fd00:1122:3344:2::1]:5353","component":"http","remote_addr":"[fd00:1122:3344:101::a]:57411"} {"msg":"request completed","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:19:39.822627929Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"uri":"/config","method":"GET","req_id":"66cf59d3-cb38-48dd-8530-87c04211e670","remote_addr":"[fd00:1122:3344:101::a]:57411","local_addr":"[fd00:1122:3344:2::1]:5353","component":"http","latency_us":301,"response_code":200} {"msg":"attempting generation update","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:19:40.047584534Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"new_generation":1,"req_id":"6cccb8f3-3f6e-4b66-8056-b851598c4481","component":"store"} {"msg":"updated generation","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:19:40.047618545Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"new_generation":1,"req_id":"6cccb8f3-3f6e-4b66-8056-b851598c4481","component":"store"} {"msg":"request completed","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:19:40.047627995Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"uri":"/config","method":"PUT","req_id":"6cccb8f3-3f6e-4b66-8056-b851598c4481","remote_addr":"[fd00:1122:3344:101::b]:50290","local_addr":"[fd00:1122:3344:2::1]:5353","component":"http","latency_us":228,"response_code":204} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 20263,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-admin-keeper._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-admin-keeper._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 24,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 97,\n 100,\n 109,\n 105,\n 110,\n 45,\n 107,\n 101,\n 101,\n 112,\n 101,\n 114,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2025-11-11T21:19:40.527925122Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"peer_addr":"[fd00:1122:3344:101::b]:54049","req_id":"9ae48576-5651-408c-930c-350caafb5a43","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 31693,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-admin-keeper._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-admin-keeper._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 24,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 97,\n 100,\n 109,\n 105,\n 110,\n 45,\n 107,\n 101,\n 101,\n 112,\n 101,\n 114,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2025-11-11T21:19:40.528200327Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"peer_addr":"[fd00:1122:3344:101::c]:46635","req_id":"1064fb3f-72f7-44fa-831c-a0e4787fe043","component":"dns"} {"msg":"accepted connection","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:19:40.811804712Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"local_addr":"[fd00:1122:3344:2::1]:5353","component":"http","remote_addr":"[fd00:1122:3344:101::c]:62373"} {"msg":"request completed","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:19:40.812063987Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"uri":"/config","method":"GET","req_id":"39f145af-e6ea-46bf-8749-0c7d6f21198b","remote_addr":"[fd00:1122:3344:101::c]:62373","local_addr":"[fd00:1122:3344:2::1]:5353","component":"http","latency_us":220,"response_code":200} {"msg":"accepted connection","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:19:40.845081256Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"local_addr":"[fd00:1122:3344:2::1]:5353","component":"http","remote_addr":"[fd00:1122:3344:101::b]:40285"} {"msg":"request completed","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:19:40.845422841Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"uri":"/config","method":"GET","req_id":"bad4de11-07b3-47de-96b3-ef81fa7ee503","remote_addr":"[fd00:1122:3344:101::b]:40285","local_addr":"[fd00:1122:3344:2::1]:5353","component":"http","latency_us":271,"response_code":200} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 51232,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2025-11-11T21:19:49.174249653Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"peer_addr":"[fd00:1122:3344:101::d]:63719","req_id":"63cbc4aa-26e4-4a58-912c-37335e1fa259","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 43895,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2025-11-11T21:19:59.175973198Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"peer_addr":"[fd00:1122:3344:101::d]:61515","req_id":"cf20497a-62d2-4f98-af62-db2ec9367f23","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 58110,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 0,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"0.pool.ntp.org.\"),\n ),\n original: Query {\n name: Name(\"0.pool.ntp.org.\"),\n query_type: AAAA,\n query_class: IN,\n },\n },\n ],\n original: [\n 1,\n 48,\n 4,\n 112,\n 111,\n 111,\n 108,\n 3,\n 110,\n 116,\n 112,\n 3,\n 111,\n 114,\n 103,\n 0,\n 0,\n 28,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: None,\n} SERVFAIL: server is not authoritative for name: \"0.pool.ntp.org.\"","v":0,"name":"dns-server","level":50,"time":"2025-11-11T21:20:05.764037072Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"peer_addr":"[fd00:1122:3344:101::1b]:36039","req_id":"85a022f7-2df3-433b-8f4f-de6f360289ab","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 5541,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 0,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"0.pool.ntp.org.\"),\n ),\n original: Query {\n name: Name(\"0.pool.ntp.org.\"),\n query_type: AAAA,\n query_class: IN,\n },\n },\n ],\n original: [\n 1,\n 48,\n 4,\n 112,\n 111,\n 111,\n 108,\n 3,\n 110,\n 116,\n 112,\n 3,\n 111,\n 114,\n 103,\n 0,\n 0,\n 28,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: None,\n} SERVFAIL: server is not authoritative for name: \"0.pool.ntp.org.\"","v":0,"name":"dns-server","level":50,"time":"2025-11-11T21:20:05.768509863Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"peer_addr":"[fd00:1122:3344:101::1b]:63326","req_id":"fdcff98d-c571-4c1c-9a4a-88fa5322fae6","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 23708,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 0,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"0.pool.ntp.org.\"),\n ),\n original: Query {\n name: Name(\"0.pool.ntp.org.\"),\n query_type: A,\n query_class: IN,\n },\n },\n ],\n original: [\n 1,\n 48,\n 4,\n 112,\n 111,\n 111,\n 108,\n 3,\n 110,\n 116,\n 112,\n 3,\n 111,\n 114,\n 103,\n 0,\n 0,\n 1,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: None,\n} SERVFAIL: server is not authoritative for name: \"0.pool.ntp.org.\"","v":0,"name":"dns-server","level":50,"time":"2025-11-11T21:20:05.772475917Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"peer_addr":"[fd00:1122:3344:101::1b]:63918","req_id":"0df53757-35c2-4b84-b3c7-201a6059b5f2","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 26022,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2025-11-11T21:20:09.177850423Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"peer_addr":"[fd00:1122:3344:101::d]:58416","req_id":"e24f0bda-2be1-4f51-8fb1-511a8c990ca5","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 2434,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2025-11-11T21:20:19.179901723Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"peer_addr":"[fd00:1122:3344:101::d]:65143","req_id":"1db15167-d636-4c38-9045-651d04c78098","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 17237,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2025-11-11T21:20:29.1817654Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"peer_addr":"[fd00:1122:3344:101::d]:57173","req_id":"bec703c9-4f53-4e98-ab88-c6728df27888","component":"dns"} {"msg":"accepted connection","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:20:37.963846548Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"local_addr":"[fd00:1122:3344:2::1]:5353","component":"http","remote_addr":"[fd00:1122:3344:101::a]:61659"} {"msg":"attempting generation update","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:20:38.432618212Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"new_generation":1,"req_id":"bb63f681-a1db-474f-96c8-e6ecd7cbb691","component":"store"} {"msg":"updated generation","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:20:38.432654122Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"new_generation":1,"req_id":"bb63f681-a1db-474f-96c8-e6ecd7cbb691","component":"store"} {"msg":"request completed","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:20:38.432662622Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"uri":"/config","method":"PUT","req_id":"bb63f681-a1db-474f-96c8-e6ecd7cbb691","remote_addr":"[fd00:1122:3344:101::a]:61659","local_addr":"[fd00:1122:3344:2::1]:5353","component":"http","latency_us":199,"response_code":204} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 62351,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-admin-keeper._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-admin-keeper._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 24,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 97,\n 100,\n 109,\n 105,\n 110,\n 45,\n 107,\n 101,\n 101,\n 112,\n 101,\n 114,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2025-11-11T21:20:39.160687949Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"peer_addr":"[fd00:1122:3344:101::a]:35786","req_id":"ef51cb25-3a44-4c8d-96aa-3ab0e5ccbc0e","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 53694,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2025-11-11T21:20:39.183583327Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"peer_addr":"[fd00:1122:3344:101::d]:50242","req_id":"e0057775-8bdc-4ddb-bef3-997cb239c2b5","component":"dns"} {"msg":"accepted connection","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:20:39.438582773Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"local_addr":"[fd00:1122:3344:2::1]:5353","component":"http","remote_addr":"[fd00:1122:3344:101::c]:65495"} {"msg":"accepted connection","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:20:39.445052117Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"local_addr":"[fd00:1122:3344:2::1]:5353","component":"http","remote_addr":"[fd00:1122:3344:101::b]:54815"} {"msg":"accepted connection","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:20:39.622825486Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"local_addr":"[fd00:1122:3344:2::1]:5353","component":"http","remote_addr":"[fd00:1122:3344:101::a]:60044"} {"msg":"request completed","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:20:39.623076319Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"uri":"/config","method":"GET","req_id":"14783ba5-979e-4963-92c4-3ea0e0a1fafa","remote_addr":"[fd00:1122:3344:101::a]:60044","local_addr":"[fd00:1122:3344:2::1]:5353","component":"http","latency_us":227,"response_code":200} {"msg":"attempting generation update","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:20:39.726525988Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"new_generation":1,"req_id":"7577356f-c26b-4bf6-a248-560636ae4963","component":"store"} {"msg":"updated generation","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:20:39.726566209Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"new_generation":1,"req_id":"7577356f-c26b-4bf6-a248-560636ae4963","component":"store"} {"msg":"request completed","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:20:39.726578719Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"uri":"/config","method":"PUT","req_id":"7577356f-c26b-4bf6-a248-560636ae4963","remote_addr":"[fd00:1122:3344:101::b]:54815","local_addr":"[fd00:1122:3344:2::1]:5353","component":"http","latency_us":232,"response_code":204} {"msg":"attempting generation update","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:20:39.991971642Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"new_generation":1,"req_id":"2e6b4820-dd1f-46c2-a4b7-41680b7edb3c","component":"store"} {"msg":"updated generation","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:20:39.992014333Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"new_generation":1,"req_id":"2e6b4820-dd1f-46c2-a4b7-41680b7edb3c","component":"store"} {"msg":"request completed","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:20:39.992025853Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"uri":"/config","method":"PUT","req_id":"2e6b4820-dd1f-46c2-a4b7-41680b7edb3c","remote_addr":"[fd00:1122:3344:101::c]:65495","local_addr":"[fd00:1122:3344:2::1]:5353","component":"http","latency_us":215,"response_code":204} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 44260,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-admin-keeper._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-admin-keeper._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 24,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 97,\n 100,\n 109,\n 105,\n 110,\n 45,\n 107,\n 101,\n 101,\n 112,\n 101,\n 114,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2025-11-11T21:20:40.397943309Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"peer_addr":"[fd00:1122:3344:101::b]:13505","req_id":"ba3db462-5ae7-4d7e-8ac9-76e1aa52be14","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 26523,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-admin-keeper._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-admin-keeper._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 24,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 97,\n 100,\n 109,\n 105,\n 110,\n 45,\n 107,\n 101,\n 101,\n 112,\n 101,\n 114,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2025-11-11T21:20:40.481237174Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"peer_addr":"[fd00:1122:3344:101::c]:35176","req_id":"3e85e643-3359-4785-8d2d-477b119b3218","component":"dns"} {"msg":"accepted connection","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:20:40.672148473Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"local_addr":"[fd00:1122:3344:2::1]:5353","component":"http","remote_addr":"[fd00:1122:3344:101::b]:47126"} {"msg":"request completed","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:20:40.672405708Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"uri":"/config","method":"GET","req_id":"2c0cfbc3-3e4e-4502-a591-5b0f78ea3961","remote_addr":"[fd00:1122:3344:101::b]:47126","local_addr":"[fd00:1122:3344:2::1]:5353","component":"http","latency_us":197,"response_code":200} {"msg":"accepted connection","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:20:40.753204912Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"local_addr":"[fd00:1122:3344:2::1]:5353","component":"http","remote_addr":"[fd00:1122:3344:101::c]:57134"} {"msg":"request completed","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:20:40.753463907Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"uri":"/config","method":"GET","req_id":"cd683d2c-85b3-44d7-9270-49352ccdb797","remote_addr":"[fd00:1122:3344:101::c]:57134","local_addr":"[fd00:1122:3344:2::1]:5353","component":"http","latency_us":200,"response_code":200} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 39189,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2025-11-11T21:20:49.18465422Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"peer_addr":"[fd00:1122:3344:101::d]:62454","req_id":"1ae409be-46f5-4cac-91d2-bd8a9ff01d19","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 38621,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2025-11-11T21:20:59.185820225Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"peer_addr":"[fd00:1122:3344:101::d]:55992","req_id":"b14c30a8-4102-4ac4-ae88-507f40572c2e","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 44922,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2025-11-11T21:21:09.18813562Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"peer_addr":"[fd00:1122:3344:101::d]:62262","req_id":"a86e6c4b-dfd6-4063-9dfc-d80c18ab1ccb","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 43250,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2025-11-11T21:21:19.190405166Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"peer_addr":"[fd00:1122:3344:101::d]:57949","req_id":"c5547e41-918b-42d3-b7e6-a4901ba6ab1c","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 63452,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2025-11-11T21:21:29.192259751Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"peer_addr":"[fd00:1122:3344:101::d]:49170","req_id":"718bcab7-c356-4d1c-9161-ec78728fc8e9","component":"dns"} {"msg":"accepted connection","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:21:38.205548476Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"local_addr":"[fd00:1122:3344:2::1]:5353","component":"http","remote_addr":"[fd00:1122:3344:101::a]:54421"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 17450,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-admin-keeper._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-admin-keeper._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 24,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 97,\n 100,\n 109,\n 105,\n 110,\n 45,\n 107,\n 101,\n 101,\n 112,\n 101,\n 114,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2025-11-11T21:21:38.629888767Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"peer_addr":"[fd00:1122:3344:101::a]:63606","req_id":"d66ecd20-7545-4210-aa9e-b5c33daf730b","component":"dns"} {"msg":"attempting generation update","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:21:38.760844216Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"new_generation":1,"req_id":"54b6e5f0-6e7b-40b3-af15-a25f80da10ce","component":"store"} {"msg":"updated generation","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:21:38.760884277Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"new_generation":1,"req_id":"54b6e5f0-6e7b-40b3-af15-a25f80da10ce","component":"store"} {"msg":"request completed","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:21:38.760907897Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"uri":"/config","method":"PUT","req_id":"54b6e5f0-6e7b-40b3-af15-a25f80da10ce","remote_addr":"[fd00:1122:3344:101::a]:54421","local_addr":"[fd00:1122:3344:2::1]:5353","component":"http","latency_us":221,"response_code":204} {"msg":"accepted connection","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:21:39.004546522Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"local_addr":"[fd00:1122:3344:2::1]:5353","component":"http","remote_addr":"[fd00:1122:3344:101::a]:52817"} {"msg":"request completed","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:21:39.004812026Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"uri":"/config","method":"GET","req_id":"22199efe-91ca-4ddc-9090-ed9596dc9e6c","remote_addr":"[fd00:1122:3344:101::a]:52817","local_addr":"[fd00:1122:3344:2::1]:5353","component":"http","latency_us":222,"response_code":200} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 18415,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2025-11-11T21:21:39.193336377Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"peer_addr":"[fd00:1122:3344:101::d]:55078","req_id":"9646772c-df51-4733-8d37-6582bda0a33b","component":"dns"} {"msg":"accepted connection","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:21:39.528048422Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"local_addr":"[fd00:1122:3344:2::1]:5353","component":"http","remote_addr":"[fd00:1122:3344:101::c]:60633"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 57838,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-admin-keeper._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-admin-keeper._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 24,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 97,\n 100,\n 109,\n 105,\n 110,\n 45,\n 107,\n 101,\n 101,\n 112,\n 101,\n 114,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2025-11-11T21:21:39.533832065Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"peer_addr":"[fd00:1122:3344:101::a]:49174","req_id":"0aba2f68-592d-492c-aea0-46829d720834","component":"dns"} {"msg":"accepted connection","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:21:39.726054255Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"local_addr":"[fd00:1122:3344:2::1]:5353","component":"http","remote_addr":"[fd00:1122:3344:101::b]:50784"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 18918,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-admin-keeper._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-admin-keeper._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 24,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 97,\n 100,\n 109,\n 105,\n 110,\n 45,\n 107,\n 101,\n 101,\n 112,\n 101,\n 114,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2025-11-11T21:21:39.900570812Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"peer_addr":"[fd00:1122:3344:101::c]:45929","req_id":"bb242e88-911d-4998-84d3-fb792f21a990","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 25542,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-admin-keeper._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-admin-keeper._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 24,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 97,\n 100,\n 109,\n 105,\n 110,\n 45,\n 107,\n 101,\n 101,\n 112,\n 101,\n 114,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2025-11-11T21:21:39.908108573Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"peer_addr":"[fd00:1122:3344:101::b]:62258","req_id":"b4ca3d13-63c5-43a5-b5ff-7a049124b05d","component":"dns"} {"msg":"accepted connection","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:21:39.941521868Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"local_addr":"[fd00:1122:3344:2::1]:5353","component":"http","remote_addr":"[fd00:1122:3344:101::a]:41609"} {"msg":"request completed","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:21:39.941845364Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"uri":"/config","method":"GET","req_id":"bf6b845e-9a05-4f14-86ae-bc99c553bb3c","remote_addr":"[fd00:1122:3344:101::a]:41609","local_addr":"[fd00:1122:3344:2::1]:5353","component":"http","latency_us":225,"response_code":200} {"msg":"attempting generation update","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:21:39.970829558Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"new_generation":1,"req_id":"77aa15b4-70a5-47ee-a905-4ba5a8d73a18","component":"store"} {"msg":"updated generation","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:21:39.970865739Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"new_generation":1,"req_id":"77aa15b4-70a5-47ee-a905-4ba5a8d73a18","component":"store"} {"msg":"request completed","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:21:39.970876849Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"uri":"/config","method":"PUT","req_id":"77aa15b4-70a5-47ee-a905-4ba5a8d73a18","remote_addr":"[fd00:1122:3344:101::c]:60633","local_addr":"[fd00:1122:3344:2::1]:5353","component":"http","latency_us":216,"response_code":204} {"msg":"attempting generation update","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:21:40.100326264Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"new_generation":1,"req_id":"1c05ad95-2c49-4a5a-963e-1610e8b7b942","component":"store"} {"msg":"updated generation","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:21:40.100361694Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"new_generation":1,"req_id":"1c05ad95-2c49-4a5a-963e-1610e8b7b942","component":"store"} {"msg":"request completed","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:21:40.100369134Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"uri":"/config","method":"PUT","req_id":"1c05ad95-2c49-4a5a-963e-1610e8b7b942","remote_addr":"[fd00:1122:3344:101::b]:50784","local_addr":"[fd00:1122:3344:2::1]:5353","component":"http","latency_us":285,"response_code":204} {"msg":"accepted connection","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:21:40.374231393Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"local_addr":"[fd00:1122:3344:2::1]:5353","component":"http","remote_addr":"[fd00:1122:3344:101::b]:40201"} {"msg":"request completed","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:21:40.374469047Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"uri":"/config","method":"GET","req_id":"794ea527-cb5e-404d-9d82-816b067bbdce","remote_addr":"[fd00:1122:3344:101::b]:40201","local_addr":"[fd00:1122:3344:2::1]:5353","component":"http","latency_us":196,"response_code":200} {"msg":"accepted connection","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:21:40.494819765Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"local_addr":"[fd00:1122:3344:2::1]:5353","component":"http","remote_addr":"[fd00:1122:3344:101::c]:39001"} {"msg":"request completed","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:21:40.49513576Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"uri":"/config","method":"GET","req_id":"0eb9bd2e-d277-42d3-be7e-0b068749bb2a","remote_addr":"[fd00:1122:3344:101::c]:39001","local_addr":"[fd00:1122:3344:2::1]:5353","component":"http","latency_us":242,"response_code":200} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 7459,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-admin-keeper._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-admin-keeper._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 24,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 97,\n 100,\n 109,\n 105,\n 110,\n 45,\n 107,\n 101,\n 101,\n 112,\n 101,\n 114,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2025-11-11T21:21:41.012109936Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"peer_addr":"[fd00:1122:3344:101::c]:5430","req_id":"d35d0ed8-678b-4591-a705-3cdcc2fd0c87","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 29763,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-admin-keeper._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-admin-keeper._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 24,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 97,\n 100,\n 109,\n 105,\n 110,\n 45,\n 107,\n 101,\n 101,\n 112,\n 101,\n 114,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2025-11-11T21:21:41.014750137Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"peer_addr":"[fd00:1122:3344:101::b]:41508","req_id":"6d8ba469-d610-46da-8a9d-a70423c25fb1","component":"dns"} {"msg":"accepted connection","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:21:41.293684347Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"local_addr":"[fd00:1122:3344:2::1]:5353","component":"http","remote_addr":"[fd00:1122:3344:101::b]:60800"} {"msg":"request completed","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:21:41.293915181Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"uri":"/config","method":"GET","req_id":"711d1650-757f-42ee-a7e5-0616cf021797","remote_addr":"[fd00:1122:3344:101::b]:60800","local_addr":"[fd00:1122:3344:2::1]:5353","component":"http","latency_us":194,"response_code":200} {"msg":"accepted connection","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:21:41.366563155Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"local_addr":"[fd00:1122:3344:2::1]:5353","component":"http","remote_addr":"[fd00:1122:3344:101::c]:60280"} {"msg":"request completed","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:21:41.366824239Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"uri":"/config","method":"GET","req_id":"6c37e666-b89c-4ba8-ad47-2ff0ce452535","remote_addr":"[fd00:1122:3344:101::c]:60280","local_addr":"[fd00:1122:3344:2::1]:5353","component":"http","latency_us":214,"response_code":200} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 132,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2025-11-11T21:21:49.194548833Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"peer_addr":"[fd00:1122:3344:101::d]:57775","req_id":"a120416d-52c1-4e2a-add6-b90ea2380578","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 23428,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2025-11-11T21:21:59.195815467Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"peer_addr":"[fd00:1122:3344:101::d]:63615","req_id":"edff1f07-e737-4ee7-a98a-afd6a5180a67","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 5875,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2025-11-11T21:22:09.19742347Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"peer_addr":"[fd00:1122:3344:101::d]:51350","req_id":"7f09a4ee-1a83-4806-aca8-100e67dcecce","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 29342,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2025-11-11T21:22:19.199145364Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"peer_addr":"[fd00:1122:3344:101::d]:54329","req_id":"a70354c0-0665-4f84-8d57-78e6f692e04a","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 42710,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2025-11-11T21:22:29.201296787Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"peer_addr":"[fd00:1122:3344:101::d]:61400","req_id":"c67ceff5-05bf-4b03-8da6-08c8a4e79d06","component":"dns"} {"msg":"accepted connection","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:22:38.006459792Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"local_addr":"[fd00:1122:3344:2::1]:5353","component":"http","remote_addr":"[fd00:1122:3344:101::a]:47002"} {"msg":"attempting generation update","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:22:38.389934168Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"new_generation":1,"req_id":"e5cecff9-e7bc-4d60-9e3d-3b61004180b2","component":"store"} {"msg":"updated generation","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:22:38.389967009Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"new_generation":1,"req_id":"e5cecff9-e7bc-4d60-9e3d-3b61004180b2","component":"store"} {"msg":"request completed","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:22:38.389975729Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"uri":"/config","method":"PUT","req_id":"e5cecff9-e7bc-4d60-9e3d-3b61004180b2","remote_addr":"[fd00:1122:3344:101::a]:47002","local_addr":"[fd00:1122:3344:2::1]:5353","component":"http","latency_us":184,"response_code":204} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 1019,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-admin-keeper._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-admin-keeper._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 24,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 97,\n 100,\n 109,\n 105,\n 110,\n 45,\n 107,\n 101,\n 101,\n 112,\n 101,\n 114,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2025-11-11T21:22:39.076001073Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"peer_addr":"[fd00:1122:3344:101::a]:56325","req_id":"554a85cc-e8a0-436b-b5b1-fe6749ee1c5a","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 12081,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2025-11-11T21:22:39.202986668Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"peer_addr":"[fd00:1122:3344:101::d]:64872","req_id":"3618820b-a2ee-4a93-ae81-ea2fb16dd8f3","component":"dns"} {"msg":"accepted connection","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:22:39.50382406Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"local_addr":"[fd00:1122:3344:2::1]:5353","component":"http","remote_addr":"[fd00:1122:3344:101::c]:37220"} {"msg":"accepted connection","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:22:39.549000424Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"local_addr":"[fd00:1122:3344:2::1]:5353","component":"http","remote_addr":"[fd00:1122:3344:101::a]:53010"} {"msg":"request completed","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:22:39.549414831Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"uri":"/config","method":"GET","req_id":"eb3423bc-628a-42de-aa8d-7f8df81206a2","remote_addr":"[fd00:1122:3344:101::a]:53010","local_addr":"[fd00:1122:3344:2::1]:5353","component":"http","latency_us":314,"response_code":200} {"msg":"accepted connection","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:22:39.587849367Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"local_addr":"[fd00:1122:3344:2::1]:5353","component":"http","remote_addr":"[fd00:1122:3344:101::b]:55443"} {"msg":"attempting generation update","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:22:39.877861384Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"new_generation":1,"req_id":"7721d5dc-3fd8-4ef0-bda7-1e0fa9bcb887","component":"store"} {"msg":"updated generation","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:22:39.877904735Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"new_generation":1,"req_id":"7721d5dc-3fd8-4ef0-bda7-1e0fa9bcb887","component":"store"} {"msg":"request completed","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:22:39.877918156Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"uri":"/config","method":"PUT","req_id":"7721d5dc-3fd8-4ef0-bda7-1e0fa9bcb887","remote_addr":"[fd00:1122:3344:101::c]:37220","local_addr":"[fd00:1122:3344:2::1]:5353","component":"http","latency_us":220,"response_code":204} {"msg":"attempting generation update","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:22:39.974690266Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"new_generation":1,"req_id":"2317b080-a000-4e4a-b882-42de394c4b73","component":"store"} {"msg":"updated generation","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:22:39.974727157Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"new_generation":1,"req_id":"2317b080-a000-4e4a-b882-42de394c4b73","component":"store"} {"msg":"request completed","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:22:39.974738317Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"uri":"/config","method":"PUT","req_id":"2317b080-a000-4e4a-b882-42de394c4b73","remote_addr":"[fd00:1122:3344:101::b]:55443","local_addr":"[fd00:1122:3344:2::1]:5353","component":"http","latency_us":223,"response_code":204} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 30115,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-admin-keeper._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-admin-keeper._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 24,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 97,\n 100,\n 109,\n 105,\n 110,\n 45,\n 107,\n 101,\n 101,\n 112,\n 101,\n 114,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2025-11-11T21:22:40.427076867Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"peer_addr":"[fd00:1122:3344:101::b]:28885","req_id":"e24c2220-2dec-420d-b264-bb56f2d80ae7","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 33441,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-admin-keeper._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-admin-keeper._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 24,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 97,\n 100,\n 109,\n 105,\n 110,\n 45,\n 107,\n 101,\n 101,\n 112,\n 101,\n 114,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2025-11-11T21:22:40.42791908Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"peer_addr":"[fd00:1122:3344:101::c]:11398","req_id":"4b2a2d22-6e9e-45fa-b414-1e449d466b50","component":"dns"} {"msg":"accepted connection","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:22:40.719587795Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"local_addr":"[fd00:1122:3344:2::1]:5353","component":"http","remote_addr":"[fd00:1122:3344:101::b]:33961"} {"msg":"request completed","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:22:40.719863309Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"uri":"/config","method":"GET","req_id":"1444c5d4-f6df-495a-b310-ee9f6ce664d1","remote_addr":"[fd00:1122:3344:101::b]:33961","local_addr":"[fd00:1122:3344:2::1]:5353","component":"http","latency_us":222,"response_code":200} {"msg":"accepted connection","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:22:40.758400617Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"local_addr":"[fd00:1122:3344:2::1]:5353","component":"http","remote_addr":"[fd00:1122:3344:101::c]:60570"} {"msg":"request completed","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:22:40.758654861Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"uri":"/config","method":"GET","req_id":"beed8ed9-a7ea-403e-8938-824e07353fff","remote_addr":"[fd00:1122:3344:101::c]:60570","local_addr":"[fd00:1122:3344:2::1]:5353","component":"http","latency_us":207,"response_code":200} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 62979,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2025-11-11T21:22:49.203655227Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"peer_addr":"[fd00:1122:3344:101::d]:55469","req_id":"df441f8b-40eb-4e19-a7eb-437647f1496a","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 30641,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2025-11-11T21:22:59.205451875Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"peer_addr":"[fd00:1122:3344:101::d]:65404","req_id":"3e36f70e-4c90-476b-b94d-60b31712f8f2","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 1378,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2025-11-11T21:23:09.207546434Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"peer_addr":"[fd00:1122:3344:101::d]:61037","req_id":"0712b9ec-95b1-44a5-94af-576ee8ce45d6","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 45930,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2025-11-11T21:23:19.209728356Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"peer_addr":"[fd00:1122:3344:101::d]:53427","req_id":"4587be5e-b546-4af6-a8e6-375a7cdf7d96","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 32920,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2025-11-11T21:23:29.211298569Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"peer_addr":"[fd00:1122:3344:101::d]:56143","req_id":"96e24361-477e-4578-a81a-4ca88139ce21","component":"dns"} {"msg":"accepted connection","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:23:38.104771582Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"local_addr":"[fd00:1122:3344:2::1]:5353","component":"http","remote_addr":"[fd00:1122:3344:101::a]:38789"} {"msg":"attempting generation update","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:23:38.492040768Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"new_generation":1,"req_id":"a2c68602-be71-48ef-9a23-8c5fe3118de2","component":"store"} {"msg":"updated generation","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:23:38.492101839Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"new_generation":1,"req_id":"a2c68602-be71-48ef-9a23-8c5fe3118de2","component":"store"} {"msg":"request completed","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:23:38.492115539Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"uri":"/config","method":"PUT","req_id":"a2c68602-be71-48ef-9a23-8c5fe3118de2","remote_addr":"[fd00:1122:3344:101::a]:38789","local_addr":"[fd00:1122:3344:2::1]:5353","component":"http","latency_us":353,"response_code":204} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 10978,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-admin-keeper._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-admin-keeper._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 24,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 97,\n 100,\n 109,\n 105,\n 110,\n 45,\n 107,\n 101,\n 101,\n 112,\n 101,\n 114,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2025-11-11T21:23:39.191686351Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"peer_addr":"[fd00:1122:3344:101::a]:40246","req_id":"dce0ab4d-b6ee-4198-8250-1d17b42764a3","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 40794,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2025-11-11T21:23:39.212789269Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"peer_addr":"[fd00:1122:3344:101::d]:60127","req_id":"727862b5-d431-4bfb-ad8b-d550373e02a9","component":"dns"} {"msg":"accepted connection","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:23:39.33761688Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"local_addr":"[fd00:1122:3344:2::1]:5353","component":"http","remote_addr":"[fd00:1122:3344:101::c]:61679"} {"msg":"accepted connection","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:23:39.541335935Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"local_addr":"[fd00:1122:3344:2::1]:5353","component":"http","remote_addr":"[fd00:1122:3344:101::b]:55973"} {"msg":"accepted connection","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:23:39.677752791Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"local_addr":"[fd00:1122:3344:2::1]:5353","component":"http","remote_addr":"[fd00:1122:3344:101::a]:51067"} {"msg":"request completed","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:23:39.678099037Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"uri":"/config","method":"GET","req_id":"2f406c8d-969f-4965-a071-a563977d2f5d","remote_addr":"[fd00:1122:3344:101::a]:51067","local_addr":"[fd00:1122:3344:2::1]:5353","component":"http","latency_us":252,"response_code":200} {"msg":"attempting generation update","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:23:39.82680975Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"new_generation":1,"req_id":"b692559b-fc5d-471b-9a64-093e18ccb32f","component":"store"} {"msg":"updated generation","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:23:39.826849981Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"new_generation":1,"req_id":"b692559b-fc5d-471b-9a64-093e18ccb32f","component":"store"} {"msg":"request completed","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:23:39.826860881Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"uri":"/config","method":"PUT","req_id":"b692559b-fc5d-471b-9a64-093e18ccb32f","remote_addr":"[fd00:1122:3344:101::c]:61679","local_addr":"[fd00:1122:3344:2::1]:5353","component":"http","latency_us":259,"response_code":204} {"msg":"attempting generation update","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:23:39.940846378Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"new_generation":1,"req_id":"734d7ef1-3c6a-4566-b99d-c38985b2203b","component":"store"} {"msg":"updated generation","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:23:39.940883138Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"new_generation":1,"req_id":"734d7ef1-3c6a-4566-b99d-c38985b2203b","component":"store"} {"msg":"request completed","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:23:39.940894078Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"uri":"/config","method":"PUT","req_id":"734d7ef1-3c6a-4566-b99d-c38985b2203b","remote_addr":"[fd00:1122:3344:101::b]:55973","local_addr":"[fd00:1122:3344:2::1]:5353","component":"http","latency_us":192,"response_code":204} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 59473,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-admin-keeper._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-admin-keeper._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 24,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 97,\n 100,\n 109,\n 105,\n 110,\n 45,\n 107,\n 101,\n 101,\n 112,\n 101,\n 114,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2025-11-11T21:23:40.422102181Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"peer_addr":"[fd00:1122:3344:101::c]:26169","req_id":"e14bbff4-fd92-4013-93e9-7a82cb143eab","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 8817,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-admin-keeper._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-admin-keeper._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 24,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 97,\n 100,\n 109,\n 105,\n 110,\n 45,\n 107,\n 101,\n 101,\n 112,\n 101,\n 114,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2025-11-11T21:23:40.537174585Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"peer_addr":"[fd00:1122:3344:101::b]:29969","req_id":"81d994a1-efae-4648-8634-d4f901872875","component":"dns"} {"msg":"accepted connection","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:23:40.722007267Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"local_addr":"[fd00:1122:3344:2::1]:5353","component":"http","remote_addr":"[fd00:1122:3344:101::c]:42810"} {"msg":"request completed","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:23:40.722282752Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"uri":"/config","method":"GET","req_id":"c6a292c2-6586-4692-ae81-a731ed9e28d2","remote_addr":"[fd00:1122:3344:101::c]:42810","local_addr":"[fd00:1122:3344:2::1]:5353","component":"http","latency_us":194,"response_code":200} {"msg":"accepted connection","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:23:40.834568891Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"local_addr":"[fd00:1122:3344:2::1]:5353","component":"http","remote_addr":"[fd00:1122:3344:101::b]:42595"} {"msg":"request completed","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:23:40.834866086Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"uri":"/config","method":"GET","req_id":"63ebb374-cbf3-43a9-bd06-60ce4285075f","remote_addr":"[fd00:1122:3344:101::b]:42595","local_addr":"[fd00:1122:3344:2::1]:5353","component":"http","latency_us":254,"response_code":200} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 57656,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2025-11-11T21:23:49.214338912Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"peer_addr":"[fd00:1122:3344:101::d]:53547","req_id":"c0795a0c-87bd-4995-9f0f-fa97d529bd0e","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 19297,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2025-11-11T21:23:59.216138927Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"peer_addr":"[fd00:1122:3344:101::d]:60708","req_id":"73bae610-addf-4663-b032-e4e4e4867e4b","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 21874,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 0,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"0.pool.ntp.org.\"),\n ),\n original: Query {\n name: Name(\"0.pool.ntp.org.\"),\n query_type: AAAA,\n query_class: IN,\n },\n },\n ],\n original: [\n 1,\n 48,\n 4,\n 112,\n 111,\n 111,\n 108,\n 3,\n 110,\n 116,\n 112,\n 3,\n 111,\n 114,\n 103,\n 0,\n 0,\n 28,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: None,\n} SERVFAIL: server is not authoritative for name: \"0.pool.ntp.org.\"","v":0,"name":"dns-server","level":50,"time":"2025-11-11T21:24:06.067896337Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"peer_addr":"[fd00:1122:3344:101::1b]:59453","req_id":"7a15dc02-2efd-44c6-981b-0ced9f7c7a6b","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 58894,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 0,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"0.pool.ntp.org.\"),\n ),\n original: Query {\n name: Name(\"0.pool.ntp.org.\"),\n query_type: AAAA,\n query_class: IN,\n },\n },\n ],\n original: [\n 1,\n 48,\n 4,\n 112,\n 111,\n 111,\n 108,\n 3,\n 110,\n 116,\n 112,\n 3,\n 111,\n 114,\n 103,\n 0,\n 0,\n 28,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: None,\n} SERVFAIL: server is not authoritative for name: \"0.pool.ntp.org.\"","v":0,"name":"dns-server","level":50,"time":"2025-11-11T21:24:06.074545233Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"peer_addr":"[fd00:1122:3344:101::1b]:43854","req_id":"9d7699b1-c332-4b18-97b0-7286b407e19a","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 31467,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 0,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"0.pool.ntp.org.\"),\n ),\n original: Query {\n name: Name(\"0.pool.ntp.org.\"),\n query_type: A,\n query_class: IN,\n },\n },\n ],\n original: [\n 1,\n 48,\n 4,\n 112,\n 111,\n 111,\n 108,\n 3,\n 110,\n 116,\n 112,\n 3,\n 111,\n 114,\n 103,\n 0,\n 0,\n 1,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: None,\n} SERVFAIL: server is not authoritative for name: \"0.pool.ntp.org.\"","v":0,"name":"dns-server","level":50,"time":"2025-11-11T21:24:06.07870764Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"peer_addr":"[fd00:1122:3344:101::1b]:63205","req_id":"27a332a0-3ba6-45ae-a691-93e3def53246","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 4412,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2025-11-11T21:24:09.217485615Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"peer_addr":"[fd00:1122:3344:101::d]:55320","req_id":"a03f47c7-8bd9-4511-9f28-0d91a22b3525","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 32819,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2025-11-11T21:24:19.219486236Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"peer_addr":"[fd00:1122:3344:101::d]:55010","req_id":"15e095b1-69a3-4417-96ac-839998a46e38","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 32370,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2025-11-11T21:24:29.222072994Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"peer_addr":"[fd00:1122:3344:101::d]:58212","req_id":"b8fd11d6-6114-4257-9a60-3ae1d8b85d64","component":"dns"} {"msg":"accepted connection","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:24:37.984435057Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"local_addr":"[fd00:1122:3344:2::1]:5353","component":"http","remote_addr":"[fd00:1122:3344:101::a]:51276"} {"msg":"attempting generation update","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:24:38.391703414Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"new_generation":1,"req_id":"83e33e63-ba7a-4f13-9b95-b96187e1706f","component":"store"} {"msg":"updated generation","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:24:38.391740685Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"new_generation":1,"req_id":"83e33e63-ba7a-4f13-9b95-b96187e1706f","component":"store"} {"msg":"request completed","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:24:38.391751735Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"uri":"/config","method":"PUT","req_id":"83e33e63-ba7a-4f13-9b95-b96187e1706f","remote_addr":"[fd00:1122:3344:101::a]:51276","local_addr":"[fd00:1122:3344:2::1]:5353","component":"http","latency_us":164,"response_code":204} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 50202,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-admin-keeper._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-admin-keeper._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 24,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 97,\n 100,\n 109,\n 105,\n 110,\n 45,\n 107,\n 101,\n 101,\n 112,\n 101,\n 114,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2025-11-11T21:24:39.026344285Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"peer_addr":"[fd00:1122:3344:101::a]:24200","req_id":"302cb955-7abe-422a-ab67-74d4634b0b39","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 57889,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2025-11-11T21:24:39.223385143Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"peer_addr":"[fd00:1122:3344:101::d]:63951","req_id":"ec67262a-1103-4b53-9415-c4cde2d773c1","component":"dns"} {"msg":"accepted connection","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:24:39.432647057Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"local_addr":"[fd00:1122:3344:2::1]:5353","component":"http","remote_addr":"[fd00:1122:3344:101::c]:44530"} {"msg":"accepted connection","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:24:39.472985374Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"local_addr":"[fd00:1122:3344:2::1]:5353","component":"http","remote_addr":"[fd00:1122:3344:101::a]:46982"} {"msg":"request completed","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:24:39.473319629Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"uri":"/config","method":"GET","req_id":"6ed8cfff-e50e-40c8-ac50-88f8323c1944","remote_addr":"[fd00:1122:3344:101::a]:46982","local_addr":"[fd00:1122:3344:2::1]:5353","component":"http","latency_us":245,"response_code":200} {"msg":"accepted connection","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:24:39.496039393Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"local_addr":"[fd00:1122:3344:2::1]:5353","component":"http","remote_addr":"[fd00:1122:3344:101::b]:56588"} {"msg":"attempting generation update","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:24:39.720984168Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"new_generation":1,"req_id":"dfd010d0-ba50-48eb-9752-31979564c1f0","component":"store"} {"msg":"updated generation","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:24:39.721014659Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"new_generation":1,"req_id":"dfd010d0-ba50-48eb-9752-31979564c1f0","component":"store"} {"msg":"request completed","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:24:39.721022169Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"uri":"/config","method":"PUT","req_id":"dfd010d0-ba50-48eb-9752-31979564c1f0","remote_addr":"[fd00:1122:3344:101::b]:56588","local_addr":"[fd00:1122:3344:2::1]:5353","component":"http","latency_us":207,"response_code":204} {"msg":"attempting generation update","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:24:39.778154514Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"new_generation":1,"req_id":"db3e2695-c3ca-4ec4-90ab-12a5660478e9","component":"store"} {"msg":"updated generation","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:24:39.778188815Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"new_generation":1,"req_id":"db3e2695-c3ca-4ec4-90ab-12a5660478e9","component":"store"} {"msg":"request completed","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:24:39.778196995Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"uri":"/config","method":"PUT","req_id":"db3e2695-c3ca-4ec4-90ab-12a5660478e9","remote_addr":"[fd00:1122:3344:101::c]:44530","local_addr":"[fd00:1122:3344:2::1]:5353","component":"http","latency_us":191,"response_code":204} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 55770,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-admin-keeper._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-admin-keeper._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 24,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 97,\n 100,\n 109,\n 105,\n 110,\n 45,\n 107,\n 101,\n 101,\n 112,\n 101,\n 114,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2025-11-11T21:24:40.274342137Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"peer_addr":"[fd00:1122:3344:101::c]:14719","req_id":"98fafcf7-04a2-4303-aafd-03d14caadb2d","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 55901,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-admin-keeper._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-admin-keeper._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 24,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 97,\n 100,\n 109,\n 105,\n 110,\n 45,\n 107,\n 101,\n 101,\n 112,\n 101,\n 114,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2025-11-11T21:24:40.31136999Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"peer_addr":"[fd00:1122:3344:101::b]:23788","req_id":"1b628cb8-d2bf-4c68-97eb-874592953d45","component":"dns"} {"msg":"accepted connection","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:24:40.592641788Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"local_addr":"[fd00:1122:3344:2::1]:5353","component":"http","remote_addr":"[fd00:1122:3344:101::c]:35909"} {"msg":"request completed","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:24:40.592898952Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"uri":"/config","method":"GET","req_id":"2450aa72-b6eb-49d3-9539-b76a76a50758","remote_addr":"[fd00:1122:3344:101::c]:35909","local_addr":"[fd00:1122:3344:2::1]:5353","component":"http","latency_us":215,"response_code":200} {"msg":"accepted connection","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:24:40.684006892Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"local_addr":"[fd00:1122:3344:2::1]:5353","component":"http","remote_addr":"[fd00:1122:3344:101::b]:60319"} {"msg":"request completed","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:24:40.684284237Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"uri":"/config","method":"GET","req_id":"61b97f5d-94b1-42cd-ae94-fc432dd768de","remote_addr":"[fd00:1122:3344:101::b]:60319","local_addr":"[fd00:1122:3344:2::1]:5353","component":"http","latency_us":216,"response_code":200} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 53890,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2025-11-11T21:24:49.224517577Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"peer_addr":"[fd00:1122:3344:101::d]:62314","req_id":"41255bca-9083-4b9b-a325-b9468a0fedca","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 32657,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2025-11-11T21:24:59.225902449Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"peer_addr":"[fd00:1122:3344:101::d]:50118","req_id":"98a1b7f5-9d03-4142-a19d-7c95f4bf36f5","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 22178,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2025-11-11T21:25:09.227068749Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"peer_addr":"[fd00:1122:3344:101::d]:60898","req_id":"d58c5a42-8e0e-4d17-b812-7ac4f8ba5270","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 25883,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2025-11-11T21:25:19.228967852Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"peer_addr":"[fd00:1122:3344:101::d]:59965","req_id":"ae6e3bb8-a394-408f-bf2f-1454ae85064f","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 1842,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2025-11-11T21:25:29.230431044Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"peer_addr":"[fd00:1122:3344:101::d]:50453","req_id":"6774165e-fa9b-4abd-ae21-5aa73a45f538","component":"dns"} {"msg":"accepted connection","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:25:38.026590508Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"local_addr":"[fd00:1122:3344:2::1]:5353","component":"http","remote_addr":"[fd00:1122:3344:101::a]:42868"} {"msg":"attempting generation update","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:25:38.446196103Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"new_generation":1,"req_id":"c3d2242f-3201-4572-b430-a897a60a54c9","component":"store"} {"msg":"updated generation","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:25:38.446234844Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"new_generation":1,"req_id":"c3d2242f-3201-4572-b430-a897a60a54c9","component":"store"} {"msg":"request completed","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:25:38.446243404Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"uri":"/config","method":"PUT","req_id":"c3d2242f-3201-4572-b430-a897a60a54c9","remote_addr":"[fd00:1122:3344:101::a]:42868","local_addr":"[fd00:1122:3344:2::1]:5353","component":"http","latency_us":268,"response_code":204} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 16280,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-admin-keeper._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-admin-keeper._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 24,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 97,\n 100,\n 109,\n 105,\n 110,\n 45,\n 107,\n 101,\n 101,\n 112,\n 101,\n 114,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2025-11-11T21:25:39.178620122Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"peer_addr":"[fd00:1122:3344:101::a]:41798","req_id":"68b39124-3afd-4567-97b9-f5966837c3d1","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 26629,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2025-11-11T21:25:39.23220755Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"peer_addr":"[fd00:1122:3344:101::d]:50216","req_id":"93d36d7e-af43-432a-aa9b-0609fb4a7a23","component":"dns"} {"msg":"accepted connection","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:25:39.408834641Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"local_addr":"[fd00:1122:3344:2::1]:5353","component":"http","remote_addr":"[fd00:1122:3344:101::c]:55783"} {"msg":"accepted connection","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:25:39.508884295Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"local_addr":"[fd00:1122:3344:2::1]:5353","component":"http","remote_addr":"[fd00:1122:3344:101::b]:53436"} {"msg":"accepted connection","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:25:39.642690709Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"local_addr":"[fd00:1122:3344:2::1]:5353","component":"http","remote_addr":"[fd00:1122:3344:101::a]:63062"} {"msg":"request completed","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:25:39.642946084Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"uri":"/config","method":"GET","req_id":"bbbaf200-6234-414d-8c0f-cc9960ebebaa","remote_addr":"[fd00:1122:3344:101::a]:63062","local_addr":"[fd00:1122:3344:2::1]:5353","component":"http","latency_us":213,"response_code":200} {"msg":"attempting generation update","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:25:39.785733552Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"new_generation":1,"req_id":"c27a7653-c23a-46a1-b97f-f2716d7310ca","component":"store"} {"msg":"updated generation","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:25:39.785766133Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"new_generation":1,"req_id":"c27a7653-c23a-46a1-b97f-f2716d7310ca","component":"store"} {"msg":"request completed","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:25:39.785774273Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"uri":"/config","method":"PUT","req_id":"c27a7653-c23a-46a1-b97f-f2716d7310ca","remote_addr":"[fd00:1122:3344:101::b]:53436","local_addr":"[fd00:1122:3344:2::1]:5353","component":"http","latency_us":187,"response_code":204} {"msg":"attempting generation update","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:25:39.842549712Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"new_generation":1,"req_id":"6f249a13-70c3-4e91-a346-5a5f91ef0145","component":"store"} {"msg":"updated generation","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:25:39.842583413Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"new_generation":1,"req_id":"6f249a13-70c3-4e91-a346-5a5f91ef0145","component":"store"} {"msg":"request completed","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:25:39.842594563Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"uri":"/config","method":"PUT","req_id":"6f249a13-70c3-4e91-a346-5a5f91ef0145","remote_addr":"[fd00:1122:3344:101::c]:55783","local_addr":"[fd00:1122:3344:2::1]:5353","component":"http","latency_us":184,"response_code":204} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 5309,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-admin-keeper._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-admin-keeper._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 24,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 97,\n 100,\n 109,\n 105,\n 110,\n 45,\n 107,\n 101,\n 101,\n 112,\n 101,\n 114,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2025-11-11T21:25:40.335225138Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"peer_addr":"[fd00:1122:3344:101::b]:52649","req_id":"ace7b2c1-7428-4bd0-ace4-ed5307c23da2","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 37314,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-admin-keeper._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-admin-keeper._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 24,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 97,\n 100,\n 109,\n 105,\n 110,\n 45,\n 107,\n 101,\n 101,\n 112,\n 101,\n 114,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2025-11-11T21:25:40.457718791Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"peer_addr":"[fd00:1122:3344:101::c]:58445","req_id":"542b8ee2-5114-4f64-a1af-e832065d24e4","component":"dns"} {"msg":"accepted connection","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:25:40.624449913Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"local_addr":"[fd00:1122:3344:2::1]:5353","component":"http","remote_addr":"[fd00:1122:3344:101::b]:37091"} {"msg":"request completed","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:25:40.624707357Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"uri":"/config","method":"GET","req_id":"4dc005f0-49a3-4059-88f5-dcc1fe098f4a","remote_addr":"[fd00:1122:3344:101::b]:37091","local_addr":"[fd00:1122:3344:2::1]:5353","component":"http","latency_us":214,"response_code":200} {"msg":"accepted connection","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:25:40.742552206Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"local_addr":"[fd00:1122:3344:2::1]:5353","component":"http","remote_addr":"[fd00:1122:3344:101::c]:61567"} {"msg":"request completed","v":0,"name":"dns-server","level":30,"time":"2025-11-11T21:25:40.74281072Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"uri":"/config","method":"GET","req_id":"8bd3a973-cb69-464b-9ac7-2c9d23e499f6","remote_addr":"[fd00:1122:3344:101::c]:61567","local_addr":"[fd00:1122:3344:2::1]:5353","component":"http","latency_us":192,"response_code":200} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 5291,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2025-11-11T21:25:49.233915665Z","hostname":"oxz_internal_dns_d6e3951a-3810-4762-877b-06ea35f95aa2","pid":5347,"peer_addr":"[fd00:1122:3344:101::d]:60470","req_id":"3de8950a-6964-405c-8b9b-5fc9e3a85256","component":"dns"}