Max level shown:
12024-11-14T17:00:00.487ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 9194, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, query: WireQuery { query: LowerQuery { name: LowerName( Name("oxz_cockroachdb_c44e611e-23ba-44be-a5ed-2c89466f4b3f."), ), original: Query { name: Name("oxz_cockroachdb_c44e611e-23ba-44be-a5ed-2c89466f4b3f."), query_type: A, query_class: IN, }, }, original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 99, 52, 52, 101, 54, 49, 49, 101, 45, 50, 51, 98, 97, 45, 52, 52, 98, 101, 45, 97, 53, 101, 100, 45, 50, 99, 56, 57, 52, 54, 54, 102, 52, 98, 51, 102, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_c44e611e-23ba-44be-a5ed-2c89466f4b3f." peer_addr = [fd00:1122:3344:101::5]:37171 req_id = 103d65a7-e373-4519-857c-b05867669bae
22024-11-14T17:00:00.487ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 9194, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, query: WireQuery { query: LowerQuery { name: LowerName( Name("oxz_cockroachdb_c44e611e-23ba-44be-a5ed-2c89466f4b3f."), ), original: Query { name: Name("oxz_cockroachdb_c44e611e-23ba-44be-a5ed-2c89466f4b3f."), query_type: A, query_class: IN, }, }, original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 99, 52, 52, 101, 54, 49, 49, 101, 45, 50, 51, 98, 97, 45, 52, 52, 98, 101, 45, 97, 53, 101, 100, 45, 50, 99, 56, 57, 52, 54, 54, 102, 52, 98, 51, 102, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_c44e611e-23ba-44be-a5ed-2c89466f4b3f." peer_addr = [fd00:1122:3344:101::5]:63586 req_id = c4f7b680-b305-451c-aa6a-814c61573cee
32024-11-14T17:00:00.624ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 54179, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, query: WireQuery { query: LowerQuery { name: LowerName( Name("oxz_cockroachdb_43b3cc0f-740c-4fce-80a6-e7841d2c19c8."), ), original: Query { name: Name("oxz_cockroachdb_43b3cc0f-740c-4fce-80a6-e7841d2c19c8."), query_type: A, query_class: IN, }, }, original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 52, 51, 98, 51, 99, 99, 48, 102, 45, 55, 52, 48, 99, 45, 52, 102, 99, 101, 45, 56, 48, 97, 54, 45, 101, 55, 56, 52, 49, 100, 50, 99, 49, 57, 99, 56, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_43b3cc0f-740c-4fce-80a6-e7841d2c19c8." peer_addr = [fd00:1122:3344:101::7]:54973 req_id = 0cfdebb2-b2dc-4ad1-ad40-f2c52740446f
42024-11-14T17:00:00.624ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 54179, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, query: WireQuery { query: LowerQuery { name: LowerName( Name("oxz_cockroachdb_43b3cc0f-740c-4fce-80a6-e7841d2c19c8."), ), original: Query { name: Name("oxz_cockroachdb_43b3cc0f-740c-4fce-80a6-e7841d2c19c8."), query_type: A, query_class: IN, }, }, original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 52, 51, 98, 51, 99, 99, 48, 102, 45, 55, 52, 48, 99, 45, 52, 102, 99, 101, 45, 56, 48, 97, 54, 45, 101, 55, 56, 52, 49, 100, 50, 99, 49, 57, 99, 56, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_43b3cc0f-740c-4fce-80a6-e7841d2c19c8." peer_addr = [fd00:1122:3344:101::7]:32938 req_id = 6f3d5f40-f5f1-45e6-aaee-ae18d89e7df3
52024-11-14T17:00:00.780ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 12922, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, query: WireQuery { query: LowerQuery { name: LowerName( Name("oxz_cockroachdb_19a1b81d-d3d4-4822-9259-477bb2e97c6a."), ), original: Query { name: Name("oxz_cockroachdb_19a1b81d-d3d4-4822-9259-477bb2e97c6a."), query_type: A, query_class: IN, }, }, original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 49, 57, 97, 49, 98, 56, 49, 100, 45, 100, 51, 100, 52, 45, 52, 56, 50, 50, 45, 57, 50, 53, 57, 45, 52, 55, 55, 98, 98, 50, 101, 57, 55, 99, 54, 97, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_19a1b81d-d3d4-4822-9259-477bb2e97c6a." peer_addr = [fd00:1122:3344:101::3]:45727 req_id = 3245e1ed-7a4e-4be5-bc15-84686e508245
62024-11-14T17:00:00.781ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 12922, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, query: WireQuery { query: LowerQuery { name: LowerName( Name("oxz_cockroachdb_19a1b81d-d3d4-4822-9259-477bb2e97c6a."), ), original: Query { name: Name("oxz_cockroachdb_19a1b81d-d3d4-4822-9259-477bb2e97c6a."), query_type: A, query_class: IN, }, }, original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 49, 57, 97, 49, 98, 56, 49, 100, 45, 100, 51, 100, 52, 45, 52, 56, 50, 50, 45, 57, 50, 53, 57, 45, 52, 55, 55, 98, 98, 50, 101, 57, 55, 99, 54, 97, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_19a1b81d-d3d4-4822-9259-477bb2e97c6a." peer_addr = [fd00:1122:3344:101::3]:51596 req_id = eb15be7e-254d-4636-a34b-a49cd87d2009
72024-11-14T17:00:00.958ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 24624, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, query: WireQuery { query: LowerQuery { name: LowerName( Name("oxz_cockroachdb_0bcdfcca-b1d5-4eff-b95c-68fc86a07272."), ), original: Query { name: Name("oxz_cockroachdb_0bcdfcca-b1d5-4eff-b95c-68fc86a07272."), query_type: A, query_class: IN, }, }, original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 48, 98, 99, 100, 102, 99, 99, 97, 45, 98, 49, 100, 53, 45, 52, 101, 102, 102, 45, 98, 57, 53, 99, 45, 54, 56, 102, 99, 56, 54, 97, 48, 55, 50, 55, 50, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_0bcdfcca-b1d5-4eff-b95c-68fc86a07272." peer_addr = [fd00:1122:3344:101::4]:58355 req_id = 4df43232-2ce0-4b2e-a3b8-31a29f910a8c
82024-11-14T17:00:00.958ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 24624, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, query: WireQuery { query: LowerQuery { name: LowerName( Name("oxz_cockroachdb_0bcdfcca-b1d5-4eff-b95c-68fc86a07272."), ), original: Query { name: Name("oxz_cockroachdb_0bcdfcca-b1d5-4eff-b95c-68fc86a07272."), query_type: A, query_class: IN, }, }, original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 48, 98, 99, 100, 102, 99, 99, 97, 45, 98, 49, 100, 53, 45, 52, 101, 102, 102, 45, 98, 57, 53, 99, 45, 54, 56, 102, 99, 56, 54, 97, 48, 55, 50, 55, 50, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_0bcdfcca-b1d5-4eff-b95c-68fc86a07272." peer_addr = [fd00:1122:3344:101::4]:43394 req_id = 2284795b-734d-420d-9072-c5968d80b737
92024-11-14T17:00:16.973ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:1::1]:5353 remote_addr = [fd00:1122:3344:101::a]:35138
102024-11-14T17:00:16.973ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:1::1]:5353 remote_addr = [fd00:1122:3344:101::c]:58100
112024-11-14T17:00:17.012ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:1::1]:5353 remote_addr = [fd00:1122:3344:101::b]:33764
122024-11-14T17:00:17.246ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = 2c5b29e6-02c5-448b-8587-f2780db4984a
132024-11-14T17:00:17.246ZINFOdns-server (store): updated generation new_generation = 1 req_id = 2c5b29e6-02c5-448b-8587-f2780db4984a
142024-11-14T17:00:17.246ZINFOdns-server (http): request completed latency_us = 217 local_addr = [fd00:1122:3344:1::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::b]:33764 req_id = 2c5b29e6-02c5-448b-8587-f2780db4984a response_code = 204 uri = /config
152024-11-14T17:00:17.352ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = ff821178-9337-4f28-83d5-6e9d5aca912f
162024-11-14T17:00:17.352ZINFOdns-server (store): updated generation new_generation = 1 req_id = ff821178-9337-4f28-83d5-6e9d5aca912f
172024-11-14T17:00:17.352ZINFOdns-server (http): request completed latency_us = 221 local_addr = [fd00:1122:3344:1::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::c]:58100 req_id = ff821178-9337-4f28-83d5-6e9d5aca912f response_code = 204 uri = /config
182024-11-14T17:00:17.424ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = 7c9fce61-f2fd-4528-97b5-4686447d73e1
192024-11-14T17:00:17.424ZINFOdns-server (store): updated generation new_generation = 1 req_id = 7c9fce61-f2fd-4528-97b5-4686447d73e1
202024-11-14T17:00:17.424ZINFOdns-server (http): request completed latency_us = 191 local_addr = [fd00:1122:3344:1::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::a]:35138 req_id = 7c9fce61-f2fd-4528-97b5-4686447d73e1 response_code = 204 uri = /config
212024-11-14T17:01:16.827ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:1::1]:5353 remote_addr = [fd00:1122:3344:101::b]:38425
222024-11-14T17:01:16.906ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:1::1]:5353 remote_addr = [fd00:1122:3344:101::c]:63124
232024-11-14T17:01:17.017ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:1::1]:5353 remote_addr = [fd00:1122:3344:101::a]:41858
242024-11-14T17:01:17.180ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = 0bcb9cec-9a7d-4500-8e1a-7d2b34d04b6a
252024-11-14T17:01:17.180ZINFOdns-server (store): updated generation new_generation = 1 req_id = 0bcb9cec-9a7d-4500-8e1a-7d2b34d04b6a
262024-11-14T17:01:17.180ZINFOdns-server (http): request completed latency_us = 184 local_addr = [fd00:1122:3344:1::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::c]:63124 req_id = 0bcb9cec-9a7d-4500-8e1a-7d2b34d04b6a response_code = 204 uri = /config
272024-11-14T17:01:17.198ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = 7bff5b58-acc0-49a7-8e55-5a1c8d786306
282024-11-14T17:01:17.198ZINFOdns-server (store): updated generation new_generation = 1 req_id = 7bff5b58-acc0-49a7-8e55-5a1c8d786306
292024-11-14T17:01:17.198ZINFOdns-server (http): request completed latency_us = 105 local_addr = [fd00:1122:3344:1::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::b]:38425 req_id = 7bff5b58-acc0-49a7-8e55-5a1c8d786306 response_code = 204 uri = /config
302024-11-14T17:01:17.274ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = bd9d54a2-f826-46dc-b5f2-2bf30457d076
312024-11-14T17:01:17.274ZINFOdns-server (store): updated generation new_generation = 1 req_id = bd9d54a2-f826-46dc-b5f2-2bf30457d076
322024-11-14T17:01:17.274ZINFOdns-server (http): request completed latency_us = 141 local_addr = [fd00:1122:3344:1::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::a]:41858 req_id = bd9d54a2-f826-46dc-b5f2-2bf30457d076 response_code = 204 uri = /config
332024-11-14T17:02:16.867ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:1::1]:5353 remote_addr = [fd00:1122:3344:101::b]:56105
342024-11-14T17:02:16.870ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:1::1]:5353 remote_addr = [fd00:1122:3344:101::c]:35001
352024-11-14T17:02:17.065ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:1::1]:5353 remote_addr = [fd00:1122:3344:101::a]:53482
362024-11-14T17:02:17.182ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = e83ff3be-a361-45ec-94f0-2b4acb88d87a
372024-11-14T17:02:17.183ZINFOdns-server (store): updated generation new_generation = 1 req_id = e83ff3be-a361-45ec-94f0-2b4acb88d87a
382024-11-14T17:02:17.183ZINFOdns-server (http): request completed latency_us = 226 local_addr = [fd00:1122:3344:1::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::c]:35001 req_id = e83ff3be-a361-45ec-94f0-2b4acb88d87a response_code = 204 uri = /config
392024-11-14T17:02:17.206ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = 89a4d9f5-bbcf-45f0-be83-bb17e7b6ac55
402024-11-14T17:02:17.206ZINFOdns-server (store): updated generation new_generation = 1 req_id = 89a4d9f5-bbcf-45f0-be83-bb17e7b6ac55
412024-11-14T17:02:17.206ZINFOdns-server (http): request completed latency_us = 157 local_addr = [fd00:1122:3344:1::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::b]:56105 req_id = 89a4d9f5-bbcf-45f0-be83-bb17e7b6ac55 response_code = 204 uri = /config
422024-11-14T17:02:17.345ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = 988df108-dfde-45a5-bbb2-f191a6f8cb58
432024-11-14T17:02:17.346ZINFOdns-server (store): updated generation new_generation = 1 req_id = 988df108-dfde-45a5-bbb2-f191a6f8cb58
442024-11-14T17:02:17.346ZINFOdns-server (http): request completed latency_us = 146 local_addr = [fd00:1122:3344:1::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::a]:53482 req_id = 988df108-dfde-45a5-bbb2-f191a6f8cb58 response_code = 204 uri = /config
452024-11-14T17:03:16.850ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:1::1]:5353 remote_addr = [fd00:1122:3344:101::c]:54987
462024-11-14T17:03:16.990ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:1::1]:5353 remote_addr = [fd00:1122:3344:101::b]:50223
472024-11-14T17:03:17.120ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:1::1]:5353 remote_addr = [fd00:1122:3344:101::a]:58066
482024-11-14T17:03:17.230ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = 8dd08a80-d41a-4c45-afab-68cbdc18b10a
492024-11-14T17:03:17.230ZINFOdns-server (store): updated generation new_generation = 1 req_id = 8dd08a80-d41a-4c45-afab-68cbdc18b10a
502024-11-14T17:03:17.230ZINFOdns-server (http): request completed latency_us = 198 local_addr = [fd00:1122:3344:1::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::c]:54987 req_id = 8dd08a80-d41a-4c45-afab-68cbdc18b10a response_code = 204 uri = /config
512024-11-14T17:03:17.388ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = 32336173-6e83-4427-937a-e7a8cbe221bb
522024-11-14T17:03:17.388ZINFOdns-server (store): updated generation new_generation = 1 req_id = 32336173-6e83-4427-937a-e7a8cbe221bb
532024-11-14T17:03:17.388ZINFOdns-server (http): request completed latency_us = 180 local_addr = [fd00:1122:3344:1::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::b]:50223 req_id = 32336173-6e83-4427-937a-e7a8cbe221bb response_code = 204 uri = /config
542024-11-14T17:03:17.459ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = aa34ba66-0754-4147-b62e-5a29cff8fbfe
552024-11-14T17:03:17.459ZINFOdns-server (store): updated generation new_generation = 1 req_id = aa34ba66-0754-4147-b62e-5a29cff8fbfe
562024-11-14T17:03:17.459ZINFOdns-server (http): request completed latency_us = 169 local_addr = [fd00:1122:3344:1::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::a]:58066 req_id = aa34ba66-0754-4147-b62e-5a29cff8fbfe response_code = 204 uri = /config
572024-11-14T17:04:16.872ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:1::1]:5353 remote_addr = [fd00:1122:3344:101::b]:61566
582024-11-14T17:04:16.876ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:1::1]:5353 remote_addr = [fd00:1122:3344:101::c]:60044
592024-11-14T17:04:16.964ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:1::1]:5353 remote_addr = [fd00:1122:3344:101::a]:36578
602024-11-14T17:04:17.056ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 15367, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, query: WireQuery { query: LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, dnssec_ok: false, max_payload: 1232, options: OPT { options: {}, }, }, ), } NXDOMAIN: no records found for name: "_clickhouse-admin-keeper._tcp.control-plane.oxide.internal." peer_addr = [fd00:1122:3344:101::b]:52673 req_id = 24c8cc22-3b50-4530-b3f8-1284f6d4e755
612024-11-14T17:04:17.142ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 11195, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, query: WireQuery { query: LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, dnssec_ok: false, max_payload: 1232, options: OPT { options: {}, }, }, ), } NXDOMAIN: no records found for name: "_clickhouse-admin-keeper._tcp.control-plane.oxide.internal." peer_addr = [fd00:1122:3344:101::c]:60486 req_id = b4ac29b9-fb42-4d2a-82e8-eee22728ef60
622024-11-14T17:04:17.167ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 35384, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, query: WireQuery { query: LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, dnssec_ok: false, max_payload: 1232, options: OPT { options: {}, }, }, ), } NXDOMAIN: no records found for name: "_clickhouse-admin-keeper._tcp.control-plane.oxide.internal." peer_addr = [fd00:1122:3344:101::a]:52597 req_id = 168362df-af20-49a7-9d7a-249f4901f930
632024-11-14T17:04:17.309ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = faa959ab-720d-488e-a5a6-49115e01994a
642024-11-14T17:04:17.309ZINFOdns-server (store): updated generation new_generation = 1 req_id = faa959ab-720d-488e-a5a6-49115e01994a
652024-11-14T17:04:17.309ZINFOdns-server (http): request completed latency_us = 156 local_addr = [fd00:1122:3344:1::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::a]:36578 req_id = faa959ab-720d-488e-a5a6-49115e01994a response_code = 204 uri = /config
662024-11-14T17:04:17.367ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = 4f9f7b1f-483c-4abc-a73f-93d4da47f208
672024-11-14T17:04:17.367ZINFOdns-server (store): updated generation new_generation = 1 req_id = 4f9f7b1f-483c-4abc-a73f-93d4da47f208
682024-11-14T17:04:17.367ZINFOdns-server (http): request completed latency_us = 214 local_addr = [fd00:1122:3344:1::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::c]:60044 req_id = 4f9f7b1f-483c-4abc-a73f-93d4da47f208 response_code = 204 uri = /config
692024-11-14T17:04:17.407ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = 114f4b2d-fd24-4a97-b9e6-f7b64dbae2b4
702024-11-14T17:04:17.407ZINFOdns-server (store): updated generation new_generation = 1 req_id = 114f4b2d-fd24-4a97-b9e6-f7b64dbae2b4
712024-11-14T17:04:17.407ZINFOdns-server (http): request completed latency_us = 145 local_addr = [fd00:1122:3344:1::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::b]:61566 req_id = 114f4b2d-fd24-4a97-b9e6-f7b64dbae2b4 response_code = 204 uri = /config
722024-11-14T17:05:16.954ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:1::1]:5353 remote_addr = [fd00:1122:3344:101::b]:41763
732024-11-14T17:05:17.078ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:1::1]:5353 remote_addr = [fd00:1122:3344:101::a]:60333
742024-11-14T17:05:17.161ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:1::1]:5353 remote_addr = [fd00:1122:3344:101::c]:53351
752024-11-14T17:05:17.285ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = fa733dd5-562b-457c-907f-a0ad142df345
762024-11-14T17:05:17.285ZINFOdns-server (store): updated generation new_generation = 1 req_id = fa733dd5-562b-457c-907f-a0ad142df345
772024-11-14T17:05:17.285ZINFOdns-server (http): request completed latency_us = 135 local_addr = [fd00:1122:3344:1::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::b]:41763 req_id = fa733dd5-562b-457c-907f-a0ad142df345 response_code = 204 uri = /config
782024-11-14T17:05:17.350ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = c8f8888d-0317-470e-895e-7b5a6a2b9652
792024-11-14T17:05:17.350ZINFOdns-server (store): updated generation new_generation = 1 req_id = c8f8888d-0317-470e-895e-7b5a6a2b9652
802024-11-14T17:05:17.350ZINFOdns-server (http): request completed latency_us = 132 local_addr = [fd00:1122:3344:1::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::a]:60333 req_id = c8f8888d-0317-470e-895e-7b5a6a2b9652 response_code = 204 uri = /config
812024-11-14T17:05:17.490ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = 83878f40-fa4f-402d-bbf8-9dbc369ed22e
822024-11-14T17:05:17.490ZINFOdns-server (store): updated generation new_generation = 1 req_id = 83878f40-fa4f-402d-bbf8-9dbc369ed22e
832024-11-14T17:05:17.490ZINFOdns-server (http): request completed latency_us = 134 local_addr = [fd00:1122:3344:1::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::c]:53351 req_id = 83878f40-fa4f-402d-bbf8-9dbc369ed22e response_code = 204 uri = /config
842024-11-14T17:06:16.820ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:1::1]:5353 remote_addr = [fd00:1122:3344:101::b]:53682
852024-11-14T17:06:16.833ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:1::1]:5353 remote_addr = [fd00:1122:3344:101::c]:61583
862024-11-14T17:06:16.981ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:1::1]:5353 remote_addr = [fd00:1122:3344:101::a]:48660
872024-11-14T17:06:17.217ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = fad0180e-8a16-43e8-bc31-b267765106bd
882024-11-14T17:06:17.217ZINFOdns-server (store): updated generation new_generation = 1 req_id = fad0180e-8a16-43e8-bc31-b267765106bd
892024-11-14T17:06:17.217ZINFOdns-server (http): request completed latency_us = 185 local_addr = [fd00:1122:3344:1::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::c]:61583 req_id = fad0180e-8a16-43e8-bc31-b267765106bd response_code = 204 uri = /config
902024-11-14T17:06:17.245ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = 02a6491a-fc1a-4704-adea-d824cb2d9eb9
912024-11-14T17:06:17.245ZINFOdns-server (store): updated generation new_generation = 1 req_id = 02a6491a-fc1a-4704-adea-d824cb2d9eb9
922024-11-14T17:06:17.245ZINFOdns-server (http): request completed latency_us = 156 local_addr = [fd00:1122:3344:1::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::b]:53682 req_id = 02a6491a-fc1a-4704-adea-d824cb2d9eb9 response_code = 204 uri = /config
932024-11-14T17:06:17.255ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = 244a2867-7448-4aab-832a-24827edab7fc
942024-11-14T17:06:17.255ZINFOdns-server (store): updated generation new_generation = 1 req_id = 244a2867-7448-4aab-832a-24827edab7fc
952024-11-14T17:06:17.255ZINFOdns-server (http): request completed latency_us = 160 local_addr = [fd00:1122:3344:1::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::a]:48660 req_id = 244a2867-7448-4aab-832a-24827edab7fc response_code = 204 uri = /config
962024-11-14T17:07:16.883ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:1::1]:5353 remote_addr = [fd00:1122:3344:101::c]:50546
972024-11-14T17:07:16.892ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:1::1]:5353 remote_addr = [fd00:1122:3344:101::b]:54683
982024-11-14T17:07:16.978ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:1::1]:5353 remote_addr = [fd00:1122:3344:101::a]:45996
992024-11-14T17:07:17.158ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = 3bd47937-6038-449b-a977-26941632f57b
1002024-11-14T17:07:17.158ZINFOdns-server (store): updated generation new_generation = 1 req_id = 3bd47937-6038-449b-a977-26941632f57b
1012024-11-14T17:07:17.158ZINFOdns-server (http): request completed latency_us = 936 local_addr = [fd00:1122:3344:1::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::b]:54683 req_id = 3bd47937-6038-449b-a977-26941632f57b response_code = 204 uri = /config
1022024-11-14T17:07:17.387ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = d5360562-4fde-401f-be2c-b64bc6a8aac7
1032024-11-14T17:07:17.387ZINFOdns-server (store): updated generation new_generation = 1 req_id = d5360562-4fde-401f-be2c-b64bc6a8aac7
1042024-11-14T17:07:17.387ZINFOdns-server (http): request completed latency_us = 147 local_addr = [fd00:1122:3344:1::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::a]:45996 req_id = d5360562-4fde-401f-be2c-b64bc6a8aac7 response_code = 204 uri = /config
1052024-11-14T17:07:17.494ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = 84f60267-ab21-4209-8039-dfcd3b6a5363
1062024-11-14T17:07:17.495ZINFOdns-server (store): updated generation new_generation = 1 req_id = 84f60267-ab21-4209-8039-dfcd3b6a5363
1072024-11-14T17:07:17.495ZINFOdns-server (http): request completed latency_us = 136 local_addr = [fd00:1122:3344:1::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::c]:50546 req_id = 84f60267-ab21-4209-8039-dfcd3b6a5363 response_code = 204 uri = /config
1082024-11-14T17:08:16.869ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:1::1]:5353 remote_addr = [fd00:1122:3344:101::c]:37986
1092024-11-14T17:08:16.933ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:1::1]:5353 remote_addr = [fd00:1122:3344:101::b]:65154
1102024-11-14T17:08:17.021ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:1::1]:5353 remote_addr = [fd00:1122:3344:101::a]:50354
1112024-11-14T17:08:17.161ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = e2896014-eaf2-4f69-945f-043ac537359d
1122024-11-14T17:08:17.161ZINFOdns-server (store): updated generation new_generation = 1 req_id = e2896014-eaf2-4f69-945f-043ac537359d
1132024-11-14T17:08:17.161ZINFOdns-server (http): request completed latency_us = 253 local_addr = [fd00:1122:3344:1::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::c]:37986 req_id = e2896014-eaf2-4f69-945f-043ac537359d response_code = 204 uri = /config
1142024-11-14T17:08:17.340ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = 615ecbf6-1fdd-490e-912d-25c3423f2228
1152024-11-14T17:08:17.340ZINFOdns-server (store): updated generation new_generation = 1 req_id = 615ecbf6-1fdd-490e-912d-25c3423f2228
1162024-11-14T17:08:17.340ZINFOdns-server (http): request completed latency_us = 136 local_addr = [fd00:1122:3344:1::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::a]:50354 req_id = 615ecbf6-1fdd-490e-912d-25c3423f2228 response_code = 204 uri = /config
1172024-11-14T17:08:17.348ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = 67ffa19b-8443-4bc4-bf72-05cabf0fed6a
1182024-11-14T17:08:17.348ZINFOdns-server (store): updated generation new_generation = 1 req_id = 67ffa19b-8443-4bc4-bf72-05cabf0fed6a
1192024-11-14T17:08:17.348ZINFOdns-server (http): request completed latency_us = 101 local_addr = [fd00:1122:3344:1::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::b]:65154 req_id = 67ffa19b-8443-4bc4-bf72-05cabf0fed6a response_code = 204 uri = /config
1202024-11-14T17:09:16.841ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:1::1]:5353 remote_addr = [fd00:1122:3344:101::c]:35612
1212024-11-14T17:09:16.877ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:1::1]:5353 remote_addr = [fd00:1122:3344:101::b]:41380
1222024-11-14T17:09:16.992ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:1::1]:5353 remote_addr = [fd00:1122:3344:101::a]:46998
1232024-11-14T17:09:17.176ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = 45cc1e96-29db-456b-9c3f-0321ab2f4522
1242024-11-14T17:09:17.176ZINFOdns-server (store): updated generation new_generation = 1 req_id = 45cc1e96-29db-456b-9c3f-0321ab2f4522
1252024-11-14T17:09:17.176ZINFOdns-server (http): request completed latency_us = 195 local_addr = [fd00:1122:3344:1::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::b]:41380 req_id = 45cc1e96-29db-456b-9c3f-0321ab2f4522 response_code = 204 uri = /config
1262024-11-14T17:09:17.256ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = 57898953-bfe9-4617-8127-170fea311de7
1272024-11-14T17:09:17.256ZINFOdns-server (store): updated generation new_generation = 1 req_id = 57898953-bfe9-4617-8127-170fea311de7
1282024-11-14T17:09:17.256ZINFOdns-server (http): request completed latency_us = 139 local_addr = [fd00:1122:3344:1::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::c]:35612 req_id = 57898953-bfe9-4617-8127-170fea311de7 response_code = 204 uri = /config
1292024-11-14T17:09:17.291ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = a5ba2cd8-d292-49d8-a264-bc7a97ecd730
1302024-11-14T17:09:17.291ZINFOdns-server (store): updated generation new_generation = 1 req_id = a5ba2cd8-d292-49d8-a264-bc7a97ecd730
1312024-11-14T17:09:17.291ZINFOdns-server (http): request completed latency_us = 136 local_addr = [fd00:1122:3344:1::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::a]:46998 req_id = a5ba2cd8-d292-49d8-a264-bc7a97ecd730 response_code = 204 uri = /config