Max level shown:
12025-03-25T01:30:04.715ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 6449, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, query: WireQuery { query: LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, dnssec_ok: false, max_payload: 1232, options: OPT { options: {}, }, }, ), } NXDOMAIN: no records found for name: "_clickhouse-cluster-native._tcp.control-plane.oxide.internal." peer_addr = [fd00:1122:3344:101::d]:49632 req_id = 566113e2-1be8-4a34-afd7-e7421f611503
22025-03-25T01:30:14.717ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 24008, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, query: WireQuery { query: LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, dnssec_ok: false, max_payload: 1232, options: OPT { options: {}, }, }, ), } NXDOMAIN: no records found for name: "_clickhouse-cluster-native._tcp.control-plane.oxide.internal." peer_addr = [fd00:1122:3344:101::d]:64978 req_id = af0a91d9-7855-4cf0-8252-51219cbbe1c0
32025-03-25T01:30:24.719ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 43019, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, query: WireQuery { query: LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, dnssec_ok: false, max_payload: 1232, options: OPT { options: {}, }, }, ), } NXDOMAIN: no records found for name: "_clickhouse-cluster-native._tcp.control-plane.oxide.internal." peer_addr = [fd00:1122:3344:101::d]:58901 req_id = 8281423a-09cf-4347-91aa-84261496bb35
42025-03-25T01:30:32.227ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:2::1]:5353 remote_addr = [fd00:1122:3344:101::b]:45212
52025-03-25T01:30:32.227ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = b8075e61-dc55-484d-9eb8-9eaa55fed50f
62025-03-25T01:30:32.227ZINFOdns-server (store): updated generation new_generation = 1 req_id = b8075e61-dc55-484d-9eb8-9eaa55fed50f
72025-03-25T01:30:32.227ZINFOdns-server (http): request completed latency_us = 136 local_addr = [fd00:1122:3344:2::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::b]:45212 req_id = b8075e61-dc55-484d-9eb8-9eaa55fed50f response_code = 204 uri = /config
82025-03-25T01:30:32.373ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:2::1]:5353 remote_addr = [fd00:1122:3344:101::a]:55065
92025-03-25T01:30:32.373ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = 39c3be09-d8df-4756-864a-60fd6638b27c
102025-03-25T01:30:32.373ZINFOdns-server (store): updated generation new_generation = 1 req_id = 39c3be09-d8df-4756-864a-60fd6638b27c
112025-03-25T01:30:32.373ZINFOdns-server (http): request completed latency_us = 132 local_addr = [fd00:1122:3344:2::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::a]:55065 req_id = 39c3be09-d8df-4756-864a-60fd6638b27c response_code = 204 uri = /config
122025-03-25T01:30:32.653ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:2::1]:5353 remote_addr = [fd00:1122:3344:101::c]:55481
132025-03-25T01:30:32.653ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = 7598820e-c6cc-4fc5-b878-c7a665d26dcb
142025-03-25T01:30:32.653ZINFOdns-server (store): updated generation new_generation = 1 req_id = 7598820e-c6cc-4fc5-b878-c7a665d26dcb
152025-03-25T01:30:32.653ZINFOdns-server (http): request completed latency_us = 151 local_addr = [fd00:1122:3344:2::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::c]:55481 req_id = 7598820e-c6cc-4fc5-b878-c7a665d26dcb response_code = 204 uri = /config
162025-03-25T01:30:34.720ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 43587, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, query: WireQuery { query: LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, dnssec_ok: false, max_payload: 1232, options: OPT { options: {}, }, }, ), } NXDOMAIN: no records found for name: "_clickhouse-cluster-native._tcp.control-plane.oxide.internal." peer_addr = [fd00:1122:3344:101::d]:64226 req_id = 76f55f65-fc3f-43d2-b095-a3ca9dd95695
172025-03-25T01:30:44.722ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 40621, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, query: WireQuery { query: LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, dnssec_ok: false, max_payload: 1232, options: OPT { options: {}, }, }, ), } NXDOMAIN: no records found for name: "_clickhouse-cluster-native._tcp.control-plane.oxide.internal." peer_addr = [fd00:1122:3344:101::d]:61563 req_id = 305f7c8c-ef2d-428a-9924-781867fa178b
182025-03-25T01:30:54.724ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 30551, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, query: WireQuery { query: LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, dnssec_ok: false, max_payload: 1232, options: OPT { options: {}, }, }, ), } NXDOMAIN: no records found for name: "_clickhouse-cluster-native._tcp.control-plane.oxide.internal." peer_addr = [fd00:1122:3344:101::d]:51842 req_id = 4bba8987-4d9e-4118-8fa0-22cf2e91a684
192025-03-25T01:31:04.725ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 34760, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, query: WireQuery { query: LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, dnssec_ok: false, max_payload: 1232, options: OPT { options: {}, }, }, ), } NXDOMAIN: no records found for name: "_clickhouse-cluster-native._tcp.control-plane.oxide.internal." peer_addr = [fd00:1122:3344:101::d]:57081 req_id = 3b075751-758d-4a00-a7d0-a2bd71c7e465
202025-03-25T01:31:14.727ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 5149, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, query: WireQuery { query: LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, dnssec_ok: false, max_payload: 1232, options: OPT { options: {}, }, }, ), } NXDOMAIN: no records found for name: "_clickhouse-cluster-native._tcp.control-plane.oxide.internal." peer_addr = [fd00:1122:3344:101::d]:61333 req_id = bae8aef9-1a2f-461d-8462-adfd397e6fd7
212025-03-25T01:31:24.728ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 40131, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, query: WireQuery { query: LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, dnssec_ok: false, max_payload: 1232, options: OPT { options: {}, }, }, ), } NXDOMAIN: no records found for name: "_clickhouse-cluster-native._tcp.control-plane.oxide.internal." peer_addr = [fd00:1122:3344:101::d]:55713 req_id = e5e156d0-76f5-44cd-bb23-ed4e7f7ef99b
222025-03-25T01:31:32.252ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:2::1]:5353 remote_addr = [fd00:1122:3344:101::b]:64463
232025-03-25T01:31:32.252ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = 9ea3b4e5-a6ed-49aa-b6a2-3b905c36aee5
242025-03-25T01:31:32.252ZINFOdns-server (store): updated generation new_generation = 1 req_id = 9ea3b4e5-a6ed-49aa-b6a2-3b905c36aee5
252025-03-25T01:31:32.252ZINFOdns-server (http): request completed latency_us = 146 local_addr = [fd00:1122:3344:2::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::b]:64463 req_id = 9ea3b4e5-a6ed-49aa-b6a2-3b905c36aee5 response_code = 204 uri = /config
262025-03-25T01:31:32.288ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:2::1]:5353 remote_addr = [fd00:1122:3344:101::a]:62514
272025-03-25T01:31:32.288ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = a9a67e1f-f79a-436b-9311-71ff3b1e47be
282025-03-25T01:31:32.288ZINFOdns-server (store): updated generation new_generation = 1 req_id = a9a67e1f-f79a-436b-9311-71ff3b1e47be
292025-03-25T01:31:32.288ZINFOdns-server (http): request completed latency_us = 129 local_addr = [fd00:1122:3344:2::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::a]:62514 req_id = a9a67e1f-f79a-436b-9311-71ff3b1e47be response_code = 204 uri = /config
302025-03-25T01:31:32.418ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:2::1]:5353 remote_addr = [fd00:1122:3344:101::c]:45096
312025-03-25T01:31:32.418ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = 56e4cc6a-dec2-463e-9fda-aa43c5c0cfa8
322025-03-25T01:31:32.418ZINFOdns-server (store): updated generation new_generation = 1 req_id = 56e4cc6a-dec2-463e-9fda-aa43c5c0cfa8
332025-03-25T01:31:32.418ZINFOdns-server (http): request completed latency_us = 144 local_addr = [fd00:1122:3344:2::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::c]:45096 req_id = 56e4cc6a-dec2-463e-9fda-aa43c5c0cfa8 response_code = 204 uri = /config
342025-03-25T01:31:34.730ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 50405, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, query: WireQuery { query: LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, dnssec_ok: false, max_payload: 1232, options: OPT { options: {}, }, }, ), } NXDOMAIN: no records found for name: "_clickhouse-cluster-native._tcp.control-plane.oxide.internal." peer_addr = [fd00:1122:3344:101::d]:63201 req_id = d9cc30e6-790a-4b62-8ba6-03b6c7cf93b0
352025-03-25T01:31:44.731ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 3538, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, query: WireQuery { query: LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, dnssec_ok: false, max_payload: 1232, options: OPT { options: {}, }, }, ), } NXDOMAIN: no records found for name: "_clickhouse-cluster-native._tcp.control-plane.oxide.internal." peer_addr = [fd00:1122:3344:101::d]:49659 req_id = 1e675c5a-e2c6-413b-933f-d6e3e045f540
362025-03-25T01:31:54.732ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 61840, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, query: WireQuery { query: LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, dnssec_ok: false, max_payload: 1232, options: OPT { options: {}, }, }, ), } NXDOMAIN: no records found for name: "_clickhouse-cluster-native._tcp.control-plane.oxide.internal." peer_addr = [fd00:1122:3344:101::d]:55611 req_id = ed5ffea3-d748-44c9-b53d-9c2b945c4f37
372025-03-25T01:32:04.734ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 17284, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, query: WireQuery { query: LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, dnssec_ok: false, max_payload: 1232, options: OPT { options: {}, }, }, ), } NXDOMAIN: no records found for name: "_clickhouse-cluster-native._tcp.control-plane.oxide.internal." peer_addr = [fd00:1122:3344:101::d]:64800 req_id = d736b1d6-0a27-4d7b-80e5-c91042ba51b9
382025-03-25T01:32:14.735ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 59473, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, query: WireQuery { query: LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, dnssec_ok: false, max_payload: 1232, options: OPT { options: {}, }, }, ), } NXDOMAIN: no records found for name: "_clickhouse-cluster-native._tcp.control-plane.oxide.internal." peer_addr = [fd00:1122:3344:101::d]:63202 req_id = bc51efe6-0a62-42dc-b2e0-807ed55c47a0
392025-03-25T01:32:24.736ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 19233, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, query: WireQuery { query: LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, dnssec_ok: false, max_payload: 1232, options: OPT { options: {}, }, }, ), } NXDOMAIN: no records found for name: "_clickhouse-cluster-native._tcp.control-plane.oxide.internal." peer_addr = [fd00:1122:3344:101::d]:63383 req_id = f4004d2e-5f3a-4c0f-8c0f-fb8f4c523a70
402025-03-25T01:32:32.225ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:2::1]:5353 remote_addr = [fd00:1122:3344:101::b]:36430
412025-03-25T01:32:32.233ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = a553ff21-dbd0-4f4b-8a35-7d010ca20819
422025-03-25T01:32:32.233ZINFOdns-server (store): updated generation new_generation = 1 req_id = a553ff21-dbd0-4f4b-8a35-7d010ca20819
432025-03-25T01:32:32.233ZINFOdns-server (http): request completed latency_us = 155 local_addr = [fd00:1122:3344:2::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::b]:36430 req_id = a553ff21-dbd0-4f4b-8a35-7d010ca20819 response_code = 204 uri = /config
442025-03-25T01:32:32.281ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:2::1]:5353 remote_addr = [fd00:1122:3344:101::a]:42348
452025-03-25T01:32:32.281ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = 57a29da8-695f-427c-bf33-621dc61759d7
462025-03-25T01:32:32.281ZINFOdns-server (store): updated generation new_generation = 1 req_id = 57a29da8-695f-427c-bf33-621dc61759d7
472025-03-25T01:32:32.281ZINFOdns-server (http): request completed latency_us = 199 local_addr = [fd00:1122:3344:2::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::a]:42348 req_id = 57a29da8-695f-427c-bf33-621dc61759d7 response_code = 204 uri = /config
482025-03-25T01:32:32.426ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:2::1]:5353 remote_addr = [fd00:1122:3344:101::c]:58989
492025-03-25T01:32:32.426ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = 5ff6169f-0961-4827-be14-0d93784fa746
502025-03-25T01:32:32.426ZINFOdns-server (store): updated generation new_generation = 1 req_id = 5ff6169f-0961-4827-be14-0d93784fa746
512025-03-25T01:32:32.426ZINFOdns-server (http): request completed latency_us = 156 local_addr = [fd00:1122:3344:2::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::c]:58989 req_id = 5ff6169f-0961-4827-be14-0d93784fa746 response_code = 204 uri = /config
522025-03-25T01:32:34.739ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 14831, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, query: WireQuery { query: LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, dnssec_ok: false, max_payload: 1232, options: OPT { options: {}, }, }, ), } NXDOMAIN: no records found for name: "_clickhouse-cluster-native._tcp.control-plane.oxide.internal." peer_addr = [fd00:1122:3344:101::d]:62358 req_id = 00d41b25-bad8-4eee-916f-dd30c6be793b
532025-03-25T01:32:44.741ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 64020, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, query: WireQuery { query: LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, dnssec_ok: false, max_payload: 1232, options: OPT { options: {}, }, }, ), } NXDOMAIN: no records found for name: "_clickhouse-cluster-native._tcp.control-plane.oxide.internal." peer_addr = [fd00:1122:3344:101::d]:59264 req_id = e2299569-4b6d-455e-aa7f-157da4704aa5
542025-03-25T01:32:54.742ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 12145, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, query: WireQuery { query: LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, dnssec_ok: false, max_payload: 1232, options: OPT { options: {}, }, }, ), } NXDOMAIN: no records found for name: "_clickhouse-cluster-native._tcp.control-plane.oxide.internal." peer_addr = [fd00:1122:3344:101::d]:59100 req_id = d4c957fb-7b3f-4b04-bf5d-dc4b042f4f00
552025-03-25T01:33:04.744ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 53523, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, query: WireQuery { query: LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, dnssec_ok: false, max_payload: 1232, options: OPT { options: {}, }, }, ), } NXDOMAIN: no records found for name: "_clickhouse-cluster-native._tcp.control-plane.oxide.internal." peer_addr = [fd00:1122:3344:101::d]:62597 req_id = c13b860c-76ca-46bc-a161-104b75ccd4b9
562025-03-25T01:33:14.747ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 55629, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, query: WireQuery { query: LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, dnssec_ok: false, max_payload: 1232, options: OPT { options: {}, }, }, ), } NXDOMAIN: no records found for name: "_clickhouse-cluster-native._tcp.control-plane.oxide.internal." peer_addr = [fd00:1122:3344:101::d]:55652 req_id = 23477878-c05a-4fc1-b311-14023a0dca55
572025-03-25T01:33:24.749ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 36403, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, query: WireQuery { query: LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, dnssec_ok: false, max_payload: 1232, options: OPT { options: {}, }, }, ), } NXDOMAIN: no records found for name: "_clickhouse-cluster-native._tcp.control-plane.oxide.internal." peer_addr = [fd00:1122:3344:101::d]:59246 req_id = c5e9b22e-0738-401c-a789-4c9d88e42cc7
582025-03-25T01:33:32.270ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:2::1]:5353 remote_addr = [fd00:1122:3344:101::b]:33973
592025-03-25T01:33:32.270ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = 800162a6-0b23-4c74-b227-6e0e754ce8ca
602025-03-25T01:33:32.270ZINFOdns-server (store): updated generation new_generation = 1 req_id = 800162a6-0b23-4c74-b227-6e0e754ce8ca
612025-03-25T01:33:32.270ZINFOdns-server (http): request completed latency_us = 181 local_addr = [fd00:1122:3344:2::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::b]:33973 req_id = 800162a6-0b23-4c74-b227-6e0e754ce8ca response_code = 204 uri = /config
622025-03-25T01:33:32.443ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:2::1]:5353 remote_addr = [fd00:1122:3344:101::a]:55606
632025-03-25T01:33:32.444ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = 633103fd-02b3-429e-860d-a756dd9941cf
642025-03-25T01:33:32.444ZINFOdns-server (store): updated generation new_generation = 1 req_id = 633103fd-02b3-429e-860d-a756dd9941cf
652025-03-25T01:33:32.444ZINFOdns-server (http): request completed latency_us = 135 local_addr = [fd00:1122:3344:2::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::a]:55606 req_id = 633103fd-02b3-429e-860d-a756dd9941cf response_code = 204 uri = /config
662025-03-25T01:33:32.558ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:2::1]:5353 remote_addr = [fd00:1122:3344:101::c]:47616
672025-03-25T01:33:32.558ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = b0286baa-3a18-4cd1-8388-f25187f5c56a
682025-03-25T01:33:32.558ZINFOdns-server (store): updated generation new_generation = 1 req_id = b0286baa-3a18-4cd1-8388-f25187f5c56a
692025-03-25T01:33:32.558ZINFOdns-server (http): request completed latency_us = 176 local_addr = [fd00:1122:3344:2::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::c]:47616 req_id = b0286baa-3a18-4cd1-8388-f25187f5c56a response_code = 204 uri = /config
702025-03-25T01:33:34.750ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 14963, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, query: WireQuery { query: LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, dnssec_ok: false, max_payload: 1232, options: OPT { options: {}, }, }, ), } NXDOMAIN: no records found for name: "_clickhouse-cluster-native._tcp.control-plane.oxide.internal." peer_addr = [fd00:1122:3344:101::d]:62294 req_id = 9d6068ea-cff3-4a11-843b-af16e198725a