Max level shown:
12025-03-21T02:15:08.552ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 16330, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, query: WireQuery { query: LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, dnssec_ok: false, max_payload: 1232, options: OPT { options: {}, }, }, ), } NXDOMAIN: no records found for name: "_clickhouse-cluster-native._tcp.control-plane.oxide.internal." peer_addr = [fd00:1122:3344:101::d]:49552 req_id = 6183c196-6614-473a-bed9-fbda1a9344a7
22025-03-21T02:15:18.553ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 23954, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, query: WireQuery { query: LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, dnssec_ok: false, max_payload: 1232, options: OPT { options: {}, }, }, ), } NXDOMAIN: no records found for name: "_clickhouse-cluster-native._tcp.control-plane.oxide.internal." peer_addr = [fd00:1122:3344:101::d]:50312 req_id = 9b019469-a49f-4a1d-a46b-eb0e0a25f43a
32025-03-21T02:15:27.046ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:1::1]:5353 remote_addr = [fd00:1122:3344:101::a]:34144
42025-03-21T02:15:27.119ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:1::1]:5353 remote_addr = [fd00:1122:3344:101::b]:50053
52025-03-21T02:15:27.175ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = a3cf3f34-82ab-45c2-9e68-b453d9873791
62025-03-21T02:15:27.175ZINFOdns-server (store): updated generation new_generation = 1 req_id = a3cf3f34-82ab-45c2-9e68-b453d9873791
72025-03-21T02:15:27.175ZINFOdns-server (http): request completed latency_us = 161 local_addr = [fd00:1122:3344:1::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::a]:34144 req_id = a3cf3f34-82ab-45c2-9e68-b453d9873791 response_code = 204 uri = /config
82025-03-21T02:15:27.212ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = 1bf6868a-257e-47a4-80ff-958dcab012a7
92025-03-21T02:15:27.212ZINFOdns-server (store): updated generation new_generation = 1 req_id = 1bf6868a-257e-47a4-80ff-958dcab012a7
102025-03-21T02:15:27.212ZINFOdns-server (http): request completed latency_us = 150 local_addr = [fd00:1122:3344:1::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::b]:50053 req_id = 1bf6868a-257e-47a4-80ff-958dcab012a7 response_code = 204 uri = /config
112025-03-21T02:15:27.617ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:1::1]:5353 remote_addr = [fd00:1122:3344:101::c]:64136
122025-03-21T02:15:27.648ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = 59eaf925-4b08-4dad-a6e3-8c65e0103268
132025-03-21T02:15:27.648ZINFOdns-server (store): updated generation new_generation = 1 req_id = 59eaf925-4b08-4dad-a6e3-8c65e0103268
142025-03-21T02:15:27.648ZINFOdns-server (http): request completed latency_us = 176 local_addr = [fd00:1122:3344:1::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::c]:64136 req_id = 59eaf925-4b08-4dad-a6e3-8c65e0103268 response_code = 204 uri = /config
152025-03-21T02:15:28.555ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 23568, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, query: WireQuery { query: LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, dnssec_ok: false, max_payload: 1232, options: OPT { options: {}, }, }, ), } NXDOMAIN: no records found for name: "_clickhouse-cluster-native._tcp.control-plane.oxide.internal." peer_addr = [fd00:1122:3344:101::d]:62922 req_id = 8454c743-1fb8-488c-87e7-e5aa06edc3e5
162025-03-21T02:15:38.558ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 6228, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, query: WireQuery { query: LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, dnssec_ok: false, max_payload: 1232, options: OPT { options: {}, }, }, ), } NXDOMAIN: no records found for name: "_clickhouse-cluster-native._tcp.control-plane.oxide.internal." peer_addr = [fd00:1122:3344:101::d]:58673 req_id = 87d1c99e-dcfc-42e8-9d89-a936c156e6ee
172025-03-21T02:15:48.560ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 30613, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, query: WireQuery { query: LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, dnssec_ok: false, max_payload: 1232, options: OPT { options: {}, }, }, ), } NXDOMAIN: no records found for name: "_clickhouse-cluster-native._tcp.control-plane.oxide.internal." peer_addr = [fd00:1122:3344:101::d]:53223 req_id = 45f5e045-7a41-4c00-8a4a-b757e162f91a
182025-03-21T02:15:58.562ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 24022, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, query: WireQuery { query: LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, dnssec_ok: false, max_payload: 1232, options: OPT { options: {}, }, }, ), } NXDOMAIN: no records found for name: "_clickhouse-cluster-native._tcp.control-plane.oxide.internal." peer_addr = [fd00:1122:3344:101::d]:62861 req_id = 21a667c1-d76f-4e4f-a6d5-6eb89ac59df3
192025-03-21T02:16:08.564ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 47964, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, query: WireQuery { query: LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, dnssec_ok: false, max_payload: 1232, options: OPT { options: {}, }, }, ), } NXDOMAIN: no records found for name: "_clickhouse-cluster-native._tcp.control-plane.oxide.internal." peer_addr = [fd00:1122:3344:101::d]:49418 req_id = 225edee2-ecb0-44b0-8fdb-106941e07532
202025-03-21T02:16:18.565ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 27534, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, query: WireQuery { query: LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, dnssec_ok: false, max_payload: 1232, options: OPT { options: {}, }, }, ), } NXDOMAIN: no records found for name: "_clickhouse-cluster-native._tcp.control-plane.oxide.internal." peer_addr = [fd00:1122:3344:101::d]:56348 req_id = 7603c4cc-d88b-4e4d-8bd6-c0e93a4e1946
212025-03-21T02:16:26.933ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:1::1]:5353 remote_addr = [fd00:1122:3344:101::b]:34812
222025-03-21T02:16:27.078ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = a4201b81-c4bb-42b8-af4a-5de3fa86530c
232025-03-21T02:16:27.078ZINFOdns-server (store): updated generation new_generation = 1 req_id = a4201b81-c4bb-42b8-af4a-5de3fa86530c
242025-03-21T02:16:27.078ZINFOdns-server (http): request completed latency_us = 150 local_addr = [fd00:1122:3344:1::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::b]:34812 req_id = a4201b81-c4bb-42b8-af4a-5de3fa86530c response_code = 204 uri = /config
252025-03-21T02:16:27.109ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:1::1]:5353 remote_addr = [fd00:1122:3344:101::a]:38491
262025-03-21T02:16:27.231ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = d88362c6-7f0b-4e06-ad1a-54d4bd3dbabe
272025-03-21T02:16:27.231ZINFOdns-server (store): updated generation new_generation = 1 req_id = d88362c6-7f0b-4e06-ad1a-54d4bd3dbabe
282025-03-21T02:16:27.231ZINFOdns-server (http): request completed latency_us = 160 local_addr = [fd00:1122:3344:1::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::a]:38491 req_id = d88362c6-7f0b-4e06-ad1a-54d4bd3dbabe response_code = 204 uri = /config
292025-03-21T02:16:27.381ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:1::1]:5353 remote_addr = [fd00:1122:3344:101::c]:63332
302025-03-21T02:16:27.488ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = c475ed6d-c916-4f00-a529-f208838d7bbd
312025-03-21T02:16:27.488ZINFOdns-server (store): updated generation new_generation = 1 req_id = c475ed6d-c916-4f00-a529-f208838d7bbd
322025-03-21T02:16:27.488ZINFOdns-server (http): request completed latency_us = 143 local_addr = [fd00:1122:3344:1::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::c]:63332 req_id = c475ed6d-c916-4f00-a529-f208838d7bbd response_code = 204 uri = /config
332025-03-21T02:16:28.566ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 2059, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, query: WireQuery { query: LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, dnssec_ok: false, max_payload: 1232, options: OPT { options: {}, }, }, ), } NXDOMAIN: no records found for name: "_clickhouse-cluster-native._tcp.control-plane.oxide.internal." peer_addr = [fd00:1122:3344:101::d]:56060 req_id = 82f5900f-c90e-43e2-a3ef-1d6f8cf7a040
342025-03-21T02:16:38.567ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 34929, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, query: WireQuery { query: LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, dnssec_ok: false, max_payload: 1232, options: OPT { options: {}, }, }, ), } NXDOMAIN: no records found for name: "_clickhouse-cluster-native._tcp.control-plane.oxide.internal." peer_addr = [fd00:1122:3344:101::d]:61417 req_id = 9196975f-b579-4e3b-b1a9-8b55a5076fcd
352025-03-21T02:16:48.569ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 17653, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, query: WireQuery { query: LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, dnssec_ok: false, max_payload: 1232, options: OPT { options: {}, }, }, ), } NXDOMAIN: no records found for name: "_clickhouse-cluster-native._tcp.control-plane.oxide.internal." peer_addr = [fd00:1122:3344:101::d]:60413 req_id = a3087ff3-6797-4ee0-9732-f6fe5788e197
362025-03-21T02:16:58.571ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 28675, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, query: WireQuery { query: LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, dnssec_ok: false, max_payload: 1232, options: OPT { options: {}, }, }, ), } NXDOMAIN: no records found for name: "_clickhouse-cluster-native._tcp.control-plane.oxide.internal." peer_addr = [fd00:1122:3344:101::d]:64257 req_id = 9e32b72b-e419-4031-9ae5-1cbb1f859557
372025-03-21T02:17:08.573ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 18437, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, query: WireQuery { query: LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, dnssec_ok: false, max_payload: 1232, options: OPT { options: {}, }, }, ), } NXDOMAIN: no records found for name: "_clickhouse-cluster-native._tcp.control-plane.oxide.internal." peer_addr = [fd00:1122:3344:101::d]:54694 req_id = 2d190069-ba6a-4975-b708-25ac938e3181
382025-03-21T02:17:18.575ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 48433, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, query: WireQuery { query: LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, dnssec_ok: false, max_payload: 1232, options: OPT { options: {}, }, }, ), } NXDOMAIN: no records found for name: "_clickhouse-cluster-native._tcp.control-plane.oxide.internal." peer_addr = [fd00:1122:3344:101::d]:50913 req_id = c374ad42-78ac-47c0-a9cc-92c27c9df6ee
392025-03-21T02:17:27.000ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:1::1]:5353 remote_addr = [fd00:1122:3344:101::b]:55286
402025-03-21T02:17:27.029ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:1::1]:5353 remote_addr = [fd00:1122:3344:101::a]:38852
412025-03-21T02:17:27.118ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = 22a12f44-83e7-4113-98e1-c7efed819d1f
422025-03-21T02:17:27.118ZINFOdns-server (store): updated generation new_generation = 1 req_id = 22a12f44-83e7-4113-98e1-c7efed819d1f
432025-03-21T02:17:27.118ZINFOdns-server (http): request completed latency_us = 143 local_addr = [fd00:1122:3344:1::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::a]:38852 req_id = 22a12f44-83e7-4113-98e1-c7efed819d1f response_code = 204 uri = /config
442025-03-21T02:17:27.180ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = 8da2c8fd-c22c-4163-8f4c-074a070c3ca7
452025-03-21T02:17:27.180ZINFOdns-server (store): updated generation new_generation = 1 req_id = 8da2c8fd-c22c-4163-8f4c-074a070c3ca7
462025-03-21T02:17:27.180ZINFOdns-server (http): request completed latency_us = 161 local_addr = [fd00:1122:3344:1::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::b]:55286 req_id = 8da2c8fd-c22c-4163-8f4c-074a070c3ca7 response_code = 204 uri = /config
472025-03-21T02:17:27.197ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:1::1]:5353 remote_addr = [fd00:1122:3344:101::c]:48123
482025-03-21T02:17:27.272ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = cb3a8f98-8da8-47b1-adb0-eec0c4ac301e
492025-03-21T02:17:27.272ZINFOdns-server (store): updated generation new_generation = 1 req_id = cb3a8f98-8da8-47b1-adb0-eec0c4ac301e
502025-03-21T02:17:27.272ZINFOdns-server (http): request completed latency_us = 165 local_addr = [fd00:1122:3344:1::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::c]:48123 req_id = cb3a8f98-8da8-47b1-adb0-eec0c4ac301e response_code = 204 uri = /config
512025-03-21T02:17:28.576ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 4180, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, query: WireQuery { query: LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, dnssec_ok: false, max_payload: 1232, options: OPT { options: {}, }, }, ), } NXDOMAIN: no records found for name: "_clickhouse-cluster-native._tcp.control-plane.oxide.internal." peer_addr = [fd00:1122:3344:101::d]:49994 req_id = fc217d33-f66c-48a1-a2a3-8af4b36798c3
522025-03-21T02:17:38.578ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 53497, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, query: WireQuery { query: LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, dnssec_ok: false, max_payload: 1232, options: OPT { options: {}, }, }, ), } NXDOMAIN: no records found for name: "_clickhouse-cluster-native._tcp.control-plane.oxide.internal." peer_addr = [fd00:1122:3344:101::d]:63621 req_id = 425f6ba4-508c-49ca-a3ea-60080b1a40ae
532025-03-21T02:17:48.580ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 61344, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, query: WireQuery { query: LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, dnssec_ok: false, max_payload: 1232, options: OPT { options: {}, }, }, ), } NXDOMAIN: no records found for name: "_clickhouse-cluster-native._tcp.control-plane.oxide.internal." peer_addr = [fd00:1122:3344:101::d]:64616 req_id = c8839739-586e-4a71-8a8b-bd8713cf335c
542025-03-21T02:17:58.582ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 39842, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, query: WireQuery { query: LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, dnssec_ok: false, max_payload: 1232, options: OPT { options: {}, }, }, ), } NXDOMAIN: no records found for name: "_clickhouse-cluster-native._tcp.control-plane.oxide.internal." peer_addr = [fd00:1122:3344:101::d]:62041 req_id = f2fbc5c5-0488-4e8d-ac6b-bb1e4883c4bc