{"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 21615,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 0,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"oxz_ntp_667bafc7-835c-42bb-be84-e3fd5d56fed8.\"),\n ),\n original: Query {\n name: Name(\"oxz_ntp_667bafc7-835c-42bb-be84-e3fd5d56fed8.\"),\n query_type: A,\n query_class: IN,\n },\n },\n ],\n original: [\n 44,\n 111,\n 120,\n 122,\n 95,\n 110,\n 116,\n 112,\n 95,\n 54,\n 54,\n 55,\n 98,\n 97,\n 102,\n 99,\n 55,\n 45,\n 56,\n 51,\n 53,\n 99,\n 45,\n 52,\n 50,\n 98,\n 98,\n 45,\n 98,\n 101,\n 56,\n 52,\n 45,\n 101,\n 51,\n 102,\n 100,\n 53,\n 100,\n 53,\n 54,\n 102,\n 101,\n 100,\n 56,\n 0,\n 0,\n 1,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: None,\n} SERVFAIL: server is not authoritative for name: \"oxz_ntp_667bafc7-835c-42bb-be84-e3fd5d56fed8.\"","v":0,"name":"dns-server","level":50,"time":"2025-09-03T04:15:00.566265366Z","hostname":"oxz_internal_dns_33692814-cb11-4468-bf51-4d6d8418d856","pid":5259,"peer_addr":"[fd00:1122:3344:101::1b]:44460","req_id":"2d820b0a-860c-4b82-ac1e-035bfd6b709a","component":"dns"} {"msg":"accepted connection","v":0,"name":"dns-server","level":30,"time":"2025-09-03T04:15:07.766509291Z","hostname":"oxz_internal_dns_33692814-cb11-4468-bf51-4d6d8418d856","pid":5259,"local_addr":"[fd00:1122:3344:3::1]:5353","component":"http","remote_addr":"[fd00:1122:3344:101::b]:63565"} {"msg":"accepted connection","v":0,"name":"dns-server","level":30,"time":"2025-09-03T04:15:07.786325694Z","hostname":"oxz_internal_dns_33692814-cb11-4468-bf51-4d6d8418d856","pid":5259,"local_addr":"[fd00:1122:3344:3::1]:5353","component":"http","remote_addr":"[fd00:1122:3344:101::c]:45416"} {"msg":"accepted connection","v":0,"name":"dns-server","level":30,"time":"2025-09-03T04:15:07.807946941Z","hostname":"oxz_internal_dns_33692814-cb11-4468-bf51-4d6d8418d856","pid":5259,"local_addr":"[fd00:1122:3344:3::1]:5353","component":"http","remote_addr":"[fd00:1122:3344:101::a]:52962"} {"msg":"attempting generation update","v":0,"name":"dns-server","level":30,"time":"2025-09-03T04:15:07.857679401Z","hostname":"oxz_internal_dns_33692814-cb11-4468-bf51-4d6d8418d856","pid":5259,"new_generation":1,"req_id":"a65acced-0ea4-4317-9256-d2bedd396a15","component":"store"} {"msg":"updated generation","v":0,"name":"dns-server","level":30,"time":"2025-09-03T04:15:07.857699671Z","hostname":"oxz_internal_dns_33692814-cb11-4468-bf51-4d6d8418d856","pid":5259,"new_generation":1,"req_id":"a65acced-0ea4-4317-9256-d2bedd396a15","component":"store"} {"msg":"request completed","v":0,"name":"dns-server","level":30,"time":"2025-09-03T04:15:07.857707771Z","hostname":"oxz_internal_dns_33692814-cb11-4468-bf51-4d6d8418d856","pid":5259,"uri":"/config","method":"PUT","req_id":"a65acced-0ea4-4317-9256-d2bedd396a15","remote_addr":"[fd00:1122:3344:101::c]:45416","local_addr":"[fd00:1122:3344:3::1]:5353","component":"http","latency_us":175,"response_code":204} {"msg":"attempting generation update","v":0,"name":"dns-server","level":30,"time":"2025-09-03T04:15:07.897512729Z","hostname":"oxz_internal_dns_33692814-cb11-4468-bf51-4d6d8418d856","pid":5259,"new_generation":1,"req_id":"0de8fc08-c6d3-4974-9bdc-fa7d7e5496d0","component":"store"} {"msg":"updated generation","v":0,"name":"dns-server","level":30,"time":"2025-09-03T04:15:07.89753402Z","hostname":"oxz_internal_dns_33692814-cb11-4468-bf51-4d6d8418d856","pid":5259,"new_generation":1,"req_id":"0de8fc08-c6d3-4974-9bdc-fa7d7e5496d0","component":"store"} {"msg":"request completed","v":0,"name":"dns-server","level":30,"time":"2025-09-03T04:15:07.897543269Z","hostname":"oxz_internal_dns_33692814-cb11-4468-bf51-4d6d8418d856","pid":5259,"uri":"/config","method":"PUT","req_id":"0de8fc08-c6d3-4974-9bdc-fa7d7e5496d0","remote_addr":"[fd00:1122:3344:101::b]:63565","local_addr":"[fd00:1122:3344:3::1]:5353","component":"http","latency_us":171,"response_code":204} {"msg":"attempting generation update","v":0,"name":"dns-server","level":30,"time":"2025-09-03T04:15:07.904104547Z","hostname":"oxz_internal_dns_33692814-cb11-4468-bf51-4d6d8418d856","pid":5259,"new_generation":1,"req_id":"9e22158c-6c2c-4f94-9533-2cc752b2a3e2","component":"store"} {"msg":"updated generation","v":0,"name":"dns-server","level":30,"time":"2025-09-03T04:15:07.904122757Z","hostname":"oxz_internal_dns_33692814-cb11-4468-bf51-4d6d8418d856","pid":5259,"new_generation":1,"req_id":"9e22158c-6c2c-4f94-9533-2cc752b2a3e2","component":"store"} {"msg":"request completed","v":0,"name":"dns-server","level":30,"time":"2025-09-03T04:15:07.904129907Z","hostname":"oxz_internal_dns_33692814-cb11-4468-bf51-4d6d8418d856","pid":5259,"uri":"/config","method":"PUT","req_id":"9e22158c-6c2c-4f94-9533-2cc752b2a3e2","remote_addr":"[fd00:1122:3344:101::a]:52962","local_addr":"[fd00:1122:3344:3::1]:5353","component":"http","latency_us":142,"response_code":204} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 3429,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2025-09-03T04:15:09.644193116Z","hostname":"oxz_internal_dns_33692814-cb11-4468-bf51-4d6d8418d856","pid":5259,"peer_addr":"[fd00:1122:3344:101::d]:52537","req_id":"6d2b9d4e-f881-4f82-b08e-131b7565aa22","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 59111,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2025-09-03T04:15:19.645425032Z","hostname":"oxz_internal_dns_33692814-cb11-4468-bf51-4d6d8418d856","pid":5259,"peer_addr":"[fd00:1122:3344:101::d]:52832","req_id":"dbaa7ab8-275a-4b79-a856-7191057972ff","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 65314,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2025-09-03T04:15:29.647608595Z","hostname":"oxz_internal_dns_33692814-cb11-4468-bf51-4d6d8418d856","pid":5259,"peer_addr":"[fd00:1122:3344:101::d]:49252","req_id":"25e3620f-00f4-488e-ae6d-2a3bfbac8417","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 33407,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2025-09-03T04:15:39.650347307Z","hostname":"oxz_internal_dns_33692814-cb11-4468-bf51-4d6d8418d856","pid":5259,"peer_addr":"[fd00:1122:3344:101::d]:50414","req_id":"ca82a323-cc9e-4d14-a62a-243309262951","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 56137,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2025-09-03T04:15:49.652132335Z","hostname":"oxz_internal_dns_33692814-cb11-4468-bf51-4d6d8418d856","pid":5259,"peer_addr":"[fd00:1122:3344:101::d]:55836","req_id":"b3f5e496-c2ce-4b96-b6fd-9aa316d66d04","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 44961,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2025-09-03T04:15:59.653949885Z","hostname":"oxz_internal_dns_33692814-cb11-4468-bf51-4d6d8418d856","pid":5259,"peer_addr":"[fd00:1122:3344:101::d]:55712","req_id":"70d9634e-d109-401e-bbac-dc951e441f00","component":"dns"} {"msg":"accepted connection","v":0,"name":"dns-server","level":30,"time":"2025-09-03T04:16:07.691046757Z","hostname":"oxz_internal_dns_33692814-cb11-4468-bf51-4d6d8418d856","pid":5259,"local_addr":"[fd00:1122:3344:3::1]:5353","component":"http","remote_addr":"[fd00:1122:3344:101::c]:54867"} {"msg":"accepted connection","v":0,"name":"dns-server","level":30,"time":"2025-09-03T04:16:07.697374553Z","hostname":"oxz_internal_dns_33692814-cb11-4468-bf51-4d6d8418d856","pid":5259,"local_addr":"[fd00:1122:3344:3::1]:5353","component":"http","remote_addr":"[fd00:1122:3344:101::b]:51381"} {"msg":"attempting generation update","v":0,"name":"dns-server","level":30,"time":"2025-09-03T04:16:07.733504585Z","hostname":"oxz_internal_dns_33692814-cb11-4468-bf51-4d6d8418d856","pid":5259,"new_generation":1,"req_id":"ce7649e5-223b-47a2-83de-1748d0342179","component":"store"} {"msg":"updated generation","v":0,"name":"dns-server","level":30,"time":"2025-09-03T04:16:07.733526025Z","hostname":"oxz_internal_dns_33692814-cb11-4468-bf51-4d6d8418d856","pid":5259,"new_generation":1,"req_id":"ce7649e5-223b-47a2-83de-1748d0342179","component":"store"} {"msg":"request completed","v":0,"name":"dns-server","level":30,"time":"2025-09-03T04:16:07.733534325Z","hostname":"oxz_internal_dns_33692814-cb11-4468-bf51-4d6d8418d856","pid":5259,"uri":"/config","method":"PUT","req_id":"ce7649e5-223b-47a2-83de-1748d0342179","remote_addr":"[fd00:1122:3344:101::c]:54867","local_addr":"[fd00:1122:3344:3::1]:5353","component":"http","latency_us":179,"response_code":204} {"msg":"attempting generation update","v":0,"name":"dns-server","level":30,"time":"2025-09-03T04:16:07.80331748Z","hostname":"oxz_internal_dns_33692814-cb11-4468-bf51-4d6d8418d856","pid":5259,"new_generation":1,"req_id":"b1e9bfe5-db2f-4cb7-9a0c-3332ded64b29","component":"store"} {"msg":"updated generation","v":0,"name":"dns-server","level":30,"time":"2025-09-03T04:16:07.80334558Z","hostname":"oxz_internal_dns_33692814-cb11-4468-bf51-4d6d8418d856","pid":5259,"new_generation":1,"req_id":"b1e9bfe5-db2f-4cb7-9a0c-3332ded64b29","component":"store"} {"msg":"request completed","v":0,"name":"dns-server","level":30,"time":"2025-09-03T04:16:07.80335262Z","hostname":"oxz_internal_dns_33692814-cb11-4468-bf51-4d6d8418d856","pid":5259,"uri":"/config","method":"PUT","req_id":"b1e9bfe5-db2f-4cb7-9a0c-3332ded64b29","remote_addr":"[fd00:1122:3344:101::b]:51381","local_addr":"[fd00:1122:3344:3::1]:5353","component":"http","latency_us":173,"response_code":204} {"msg":"accepted connection","v":0,"name":"dns-server","level":30,"time":"2025-09-03T04:16:07.898440179Z","hostname":"oxz_internal_dns_33692814-cb11-4468-bf51-4d6d8418d856","pid":5259,"local_addr":"[fd00:1122:3344:3::1]:5353","component":"http","remote_addr":"[fd00:1122:3344:101::a]:40545"} {"msg":"attempting generation update","v":0,"name":"dns-server","level":30,"time":"2025-09-03T04:16:07.961315864Z","hostname":"oxz_internal_dns_33692814-cb11-4468-bf51-4d6d8418d856","pid":5259,"new_generation":1,"req_id":"fda5f14f-05f8-4e8d-aa58-aa560b7c3bfb","component":"store"} {"msg":"updated generation","v":0,"name":"dns-server","level":30,"time":"2025-09-03T04:16:07.961343044Z","hostname":"oxz_internal_dns_33692814-cb11-4468-bf51-4d6d8418d856","pid":5259,"new_generation":1,"req_id":"fda5f14f-05f8-4e8d-aa58-aa560b7c3bfb","component":"store"} {"msg":"request completed","v":0,"name":"dns-server","level":30,"time":"2025-09-03T04:16:07.961352084Z","hostname":"oxz_internal_dns_33692814-cb11-4468-bf51-4d6d8418d856","pid":5259,"uri":"/config","method":"PUT","req_id":"fda5f14f-05f8-4e8d-aa58-aa560b7c3bfb","remote_addr":"[fd00:1122:3344:101::a]:40545","local_addr":"[fd00:1122:3344:3::1]:5353","component":"http","latency_us":199,"response_code":204} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 28304,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2025-09-03T04:16:09.654896987Z","hostname":"oxz_internal_dns_33692814-cb11-4468-bf51-4d6d8418d856","pid":5259,"peer_addr":"[fd00:1122:3344:101::d]:64213","req_id":"29d9eb7c-9d83-400c-bc28-d03b797ed1ed","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 54182,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2025-09-03T04:16:19.65586213Z","hostname":"oxz_internal_dns_33692814-cb11-4468-bf51-4d6d8418d856","pid":5259,"peer_addr":"[fd00:1122:3344:101::d]:57685","req_id":"7efeb430-297a-4a58-9659-823bb50ee7e6","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 27565,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2025-09-03T04:16:29.657434218Z","hostname":"oxz_internal_dns_33692814-cb11-4468-bf51-4d6d8418d856","pid":5259,"peer_addr":"[fd00:1122:3344:101::d]:58685","req_id":"2416145d-219d-4e01-9dc3-59c60d42eb44","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 33659,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2025-09-03T04:16:39.659156296Z","hostname":"oxz_internal_dns_33692814-cb11-4468-bf51-4d6d8418d856","pid":5259,"peer_addr":"[fd00:1122:3344:101::d]:59464","req_id":"6c6a688b-7237-421f-8b90-b9d0394178e5","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 51820,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 0,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"0.pool.ntp.org.\"),\n ),\n original: Query {\n name: Name(\"0.pool.ntp.org.\"),\n query_type: AAAA,\n query_class: IN,\n },\n },\n ],\n original: [\n 1,\n 48,\n 4,\n 112,\n 111,\n 111,\n 108,\n 3,\n 110,\n 116,\n 112,\n 3,\n 111,\n 114,\n 103,\n 0,\n 0,\n 28,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: None,\n} SERVFAIL: server is not authoritative for name: \"0.pool.ntp.org.\"","v":0,"name":"dns-server","level":50,"time":"2025-09-03T04:16:45.038561226Z","hostname":"oxz_internal_dns_33692814-cb11-4468-bf51-4d6d8418d856","pid":5259,"peer_addr":"[fd00:1122:3344:101::1b]:64340","req_id":"d443dc2e-4721-4800-9bca-c8c4039767b5","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 46105,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 0,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"0.pool.ntp.org.\"),\n ),\n original: Query {\n name: Name(\"0.pool.ntp.org.\"),\n query_type: AAAA,\n query_class: IN,\n },\n },\n ],\n original: [\n 1,\n 48,\n 4,\n 112,\n 111,\n 111,\n 108,\n 3,\n 110,\n 116,\n 112,\n 3,\n 111,\n 114,\n 103,\n 0,\n 0,\n 28,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: None,\n} SERVFAIL: server is not authoritative for name: \"0.pool.ntp.org.\"","v":0,"name":"dns-server","level":50,"time":"2025-09-03T04:16:45.064098711Z","hostname":"oxz_internal_dns_33692814-cb11-4468-bf51-4d6d8418d856","pid":5259,"peer_addr":"[fd00:1122:3344:101::1b]:45695","req_id":"fd327e2e-b977-4772-86c8-148146d1207a","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 63551,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 0,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"0.pool.ntp.org.\"),\n ),\n original: Query {\n name: Name(\"0.pool.ntp.org.\"),\n query_type: A,\n query_class: IN,\n },\n },\n ],\n original: [\n 1,\n 48,\n 4,\n 112,\n 111,\n 111,\n 108,\n 3,\n 110,\n 116,\n 112,\n 3,\n 111,\n 114,\n 103,\n 0,\n 0,\n 1,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: None,\n} SERVFAIL: server is not authoritative for name: \"0.pool.ntp.org.\"","v":0,"name":"dns-server","level":50,"time":"2025-09-03T04:16:45.085414576Z","hostname":"oxz_internal_dns_33692814-cb11-4468-bf51-4d6d8418d856","pid":5259,"peer_addr":"[fd00:1122:3344:101::1b]:36326","req_id":"fbfba773-3e20-4229-b45f-122ecdb32995","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 40012,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2025-09-03T04:16:49.660866724Z","hostname":"oxz_internal_dns_33692814-cb11-4468-bf51-4d6d8418d856","pid":5259,"peer_addr":"[fd00:1122:3344:101::d]:62839","req_id":"7b1c703a-f456-4601-abb1-236e27aac251","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 18068,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2025-09-03T04:16:59.663512168Z","hostname":"oxz_internal_dns_33692814-cb11-4468-bf51-4d6d8418d856","pid":5259,"peer_addr":"[fd00:1122:3344:101::d]:55745","req_id":"0989f04f-289c-4d20-8ff7-7cfeaed99efb","component":"dns"} {"msg":"accepted connection","v":0,"name":"dns-server","level":30,"time":"2025-09-03T04:17:07.742066321Z","hostname":"oxz_internal_dns_33692814-cb11-4468-bf51-4d6d8418d856","pid":5259,"local_addr":"[fd00:1122:3344:3::1]:5353","component":"http","remote_addr":"[fd00:1122:3344:101::a]:49336"} {"msg":"accepted connection","v":0,"name":"dns-server","level":30,"time":"2025-09-03T04:17:07.810602978Z","hostname":"oxz_internal_dns_33692814-cb11-4468-bf51-4d6d8418d856","pid":5259,"local_addr":"[fd00:1122:3344:3::1]:5353","component":"http","remote_addr":"[fd00:1122:3344:101::b]:34756"} {"msg":"attempting generation update","v":0,"name":"dns-server","level":30,"time":"2025-09-03T04:17:07.826521663Z","hostname":"oxz_internal_dns_33692814-cb11-4468-bf51-4d6d8418d856","pid":5259,"new_generation":1,"req_id":"2c43ed76-7380-49b3-9604-bb0cc059b34e","component":"store"} {"msg":"updated generation","v":0,"name":"dns-server","level":30,"time":"2025-09-03T04:17:07.826576663Z","hostname":"oxz_internal_dns_33692814-cb11-4468-bf51-4d6d8418d856","pid":5259,"new_generation":1,"req_id":"2c43ed76-7380-49b3-9604-bb0cc059b34e","component":"store"} {"msg":"request completed","v":0,"name":"dns-server","level":30,"time":"2025-09-03T04:17:07.826608394Z","hostname":"oxz_internal_dns_33692814-cb11-4468-bf51-4d6d8418d856","pid":5259,"uri":"/config","method":"PUT","req_id":"2c43ed76-7380-49b3-9604-bb0cc059b34e","remote_addr":"[fd00:1122:3344:101::a]:49336","local_addr":"[fd00:1122:3344:3::1]:5353","component":"http","latency_us":212,"response_code":204} {"msg":"accepted connection","v":0,"name":"dns-server","level":30,"time":"2025-09-03T04:17:07.866085439Z","hostname":"oxz_internal_dns_33692814-cb11-4468-bf51-4d6d8418d856","pid":5259,"local_addr":"[fd00:1122:3344:3::1]:5353","component":"http","remote_addr":"[fd00:1122:3344:101::c]:54047"} {"msg":"attempting generation update","v":0,"name":"dns-server","level":30,"time":"2025-09-03T04:17:07.872212514Z","hostname":"oxz_internal_dns_33692814-cb11-4468-bf51-4d6d8418d856","pid":5259,"new_generation":1,"req_id":"12c2d9d5-a872-4a02-b5ec-670cd750d844","component":"store"} {"msg":"updated generation","v":0,"name":"dns-server","level":30,"time":"2025-09-03T04:17:07.872232689Z","hostname":"oxz_internal_dns_33692814-cb11-4468-bf51-4d6d8418d856","pid":5259,"new_generation":1,"req_id":"12c2d9d5-a872-4a02-b5ec-670cd750d844","component":"store"} {"msg":"request completed","v":0,"name":"dns-server","level":30,"time":"2025-09-03T04:17:07.872240367Z","hostname":"oxz_internal_dns_33692814-cb11-4468-bf51-4d6d8418d856","pid":5259,"uri":"/config","method":"PUT","req_id":"12c2d9d5-a872-4a02-b5ec-670cd750d844","remote_addr":"[fd00:1122:3344:101::b]:34756","local_addr":"[fd00:1122:3344:3::1]:5353","component":"http","latency_us":177,"response_code":204} {"msg":"attempting generation update","v":0,"name":"dns-server","level":30,"time":"2025-09-03T04:17:07.930270744Z","hostname":"oxz_internal_dns_33692814-cb11-4468-bf51-4d6d8418d856","pid":5259,"new_generation":1,"req_id":"2aa33538-91b8-471e-8822-051b104d3970","component":"store"} {"msg":"updated generation","v":0,"name":"dns-server","level":30,"time":"2025-09-03T04:17:07.930291474Z","hostname":"oxz_internal_dns_33692814-cb11-4468-bf51-4d6d8418d856","pid":5259,"new_generation":1,"req_id":"2aa33538-91b8-471e-8822-051b104d3970","component":"store"} {"msg":"request completed","v":0,"name":"dns-server","level":30,"time":"2025-09-03T04:17:07.930300584Z","hostname":"oxz_internal_dns_33692814-cb11-4468-bf51-4d6d8418d856","pid":5259,"uri":"/config","method":"PUT","req_id":"2aa33538-91b8-471e-8822-051b104d3970","remote_addr":"[fd00:1122:3344:101::c]:54047","local_addr":"[fd00:1122:3344:3::1]:5353","component":"http","latency_us":149,"response_code":204} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 52770,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2025-09-03T04:17:09.665533029Z","hostname":"oxz_internal_dns_33692814-cb11-4468-bf51-4d6d8418d856","pid":5259,"peer_addr":"[fd00:1122:3344:101::d]:61441","req_id":"49f35882-1de0-42d7-835e-ed598055191b","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 43860,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2025-09-03T04:17:19.667363858Z","hostname":"oxz_internal_dns_33692814-cb11-4468-bf51-4d6d8418d856","pid":5259,"peer_addr":"[fd00:1122:3344:101::d]:57867","req_id":"ef44e2f5-6afe-46d2-a7ed-26228a6a259c","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 16142,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2025-09-03T04:17:29.668634964Z","hostname":"oxz_internal_dns_33692814-cb11-4468-bf51-4d6d8418d856","pid":5259,"peer_addr":"[fd00:1122:3344:101::d]:53656","req_id":"cd8c1e18-756c-4f9a-99c8-060fbc8d3638","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 55251,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2025-09-03T04:17:39.668807508Z","hostname":"oxz_internal_dns_33692814-cb11-4468-bf51-4d6d8418d856","pid":5259,"peer_addr":"[fd00:1122:3344:101::d]:59071","req_id":"0d39f7ab-40f4-46c9-bce8-7dffa21b955e","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 61029,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2025-09-03T04:17:49.670267895Z","hostname":"oxz_internal_dns_33692814-cb11-4468-bf51-4d6d8418d856","pid":5259,"peer_addr":"[fd00:1122:3344:101::d]:64007","req_id":"0411d870-8a7d-409b-84fd-10df75197d87","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 15558,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2025-09-03T04:17:59.672758799Z","hostname":"oxz_internal_dns_33692814-cb11-4468-bf51-4d6d8418d856","pid":5259,"peer_addr":"[fd00:1122:3344:101::d]:62694","req_id":"80ffd16c-c6aa-4587-b40a-deb65efa1668","component":"dns"}