Max level shown:
12024-11-18T18:45:00.630ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 21872, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, query: WireQuery { query: LowerQuery { name: LowerName( Name("oxz_cockroachdb_509f6459-b46e-474b-8247-9cd9c287fa80."), ), original: Query { name: Name("oxz_cockroachdb_509f6459-b46e-474b-8247-9cd9c287fa80."), query_type: A, query_class: IN, }, }, original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 53, 48, 57, 102, 54, 52, 53, 57, 45, 98, 52, 54, 101, 45, 52, 55, 52, 98, 45, 56, 50, 52, 55, 45, 57, 99, 100, 57, 99, 50, 56, 55, 102, 97, 56, 48, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_509f6459-b46e-474b-8247-9cd9c287fa80." peer_addr = [fd00:1122:3344:101::5]:40321 req_id = 807e65b5-32e1-4431-82f7-9b32aecde3be
22024-11-18T18:45:00.631ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 21872, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, query: WireQuery { query: LowerQuery { name: LowerName( Name("oxz_cockroachdb_509f6459-b46e-474b-8247-9cd9c287fa80."), ), original: Query { name: Name("oxz_cockroachdb_509f6459-b46e-474b-8247-9cd9c287fa80."), query_type: A, query_class: IN, }, }, original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 53, 48, 57, 102, 54, 52, 53, 57, 45, 98, 52, 54, 101, 45, 52, 55, 52, 98, 45, 56, 50, 52, 55, 45, 57, 99, 100, 57, 99, 50, 56, 55, 102, 97, 56, 48, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_509f6459-b46e-474b-8247-9cd9c287fa80." peer_addr = [fd00:1122:3344:101::5]:58627 req_id = f056b1a0-7a50-4b64-8e8e-6b5c68f3b3ed
32024-11-18T18:45:00.661ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 53486, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, query: WireQuery { query: LowerQuery { name: LowerName( Name("oxz_cockroachdb_9d6a1714-4692-4a2d-9475-dc5b067334ad."), ), original: Query { name: Name("oxz_cockroachdb_9d6a1714-4692-4a2d-9475-dc5b067334ad."), query_type: A, query_class: IN, }, }, original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 57, 100, 54, 97, 49, 55, 49, 52, 45, 52, 54, 57, 50, 45, 52, 97, 50, 100, 45, 57, 52, 55, 53, 45, 100, 99, 53, 98, 48, 54, 55, 51, 51, 52, 97, 100, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_9d6a1714-4692-4a2d-9475-dc5b067334ad." peer_addr = [fd00:1122:3344:101::3]:62601 req_id = 0a1a81a9-33d9-45f6-8fa1-a2854be4dec3
42024-11-18T18:45:00.662ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 53486, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, query: WireQuery { query: LowerQuery { name: LowerName( Name("oxz_cockroachdb_9d6a1714-4692-4a2d-9475-dc5b067334ad."), ), original: Query { name: Name("oxz_cockroachdb_9d6a1714-4692-4a2d-9475-dc5b067334ad."), query_type: A, query_class: IN, }, }, original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 57, 100, 54, 97, 49, 55, 49, 52, 45, 52, 54, 57, 50, 45, 52, 97, 50, 100, 45, 57, 52, 55, 53, 45, 100, 99, 53, 98, 48, 54, 55, 51, 51, 52, 97, 100, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_9d6a1714-4692-4a2d-9475-dc5b067334ad." peer_addr = [fd00:1122:3344:101::3]:35854 req_id = 310ba864-b4b3-40ed-b866-a7fbaa209221
52024-11-18T18:45:00.696ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 59492, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, query: WireQuery { query: LowerQuery { name: LowerName( Name("oxz_cockroachdb_b9daa5c1-3421-4e6b-889a-4c4b145361da."), ), original: Query { name: Name("oxz_cockroachdb_b9daa5c1-3421-4e6b-889a-4c4b145361da."), query_type: A, query_class: IN, }, }, original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 98, 57, 100, 97, 97, 53, 99, 49, 45, 51, 52, 50, 49, 45, 52, 101, 54, 98, 45, 56, 56, 57, 97, 45, 52, 99, 52, 98, 49, 52, 53, 51, 54, 49, 100, 97, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_b9daa5c1-3421-4e6b-889a-4c4b145361da." peer_addr = [fd00:1122:3344:101::7]:36815 req_id = 59bb833e-3dbe-4d3a-aa53-aa2db3430204
62024-11-18T18:45:00.697ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 59492, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, query: WireQuery { query: LowerQuery { name: LowerName( Name("oxz_cockroachdb_b9daa5c1-3421-4e6b-889a-4c4b145361da."), ), original: Query { name: Name("oxz_cockroachdb_b9daa5c1-3421-4e6b-889a-4c4b145361da."), query_type: A, query_class: IN, }, }, original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 98, 57, 100, 97, 97, 53, 99, 49, 45, 51, 52, 50, 49, 45, 52, 101, 54, 98, 45, 56, 56, 57, 97, 45, 52, 99, 52, 98, 49, 52, 53, 51, 54, 49, 100, 97, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_b9daa5c1-3421-4e6b-889a-4c4b145361da." peer_addr = [fd00:1122:3344:101::7]:65328 req_id = a332a124-26a8-4a78-9954-c28ed47d625f
72024-11-18T18:45:48.557ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:2::1]:5353 remote_addr = [fd00:1122:3344:101::b]:36488
82024-11-18T18:45:48.808ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = 0c071dc0-cfe1-4a23-8a65-0c9a999f442a
92024-11-18T18:45:48.808ZINFOdns-server (store): updated generation new_generation = 1 req_id = 0c071dc0-cfe1-4a23-8a65-0c9a999f442a
102024-11-18T18:45:48.808ZINFOdns-server (http): request completed latency_us = 144 local_addr = [fd00:1122:3344:2::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::b]:36488 req_id = 0c071dc0-cfe1-4a23-8a65-0c9a999f442a response_code = 204 uri = /config
112024-11-18T18:45:49.534ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:2::1]:5353 remote_addr = [fd00:1122:3344:101::a]:34368
122024-11-18T18:45:49.597ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:2::1]:5353 remote_addr = [fd00:1122:3344:101::c]:54790
132024-11-18T18:45:49.840ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = b4a8c56e-52e2-4dae-b491-b51ed65b23dd
142024-11-18T18:45:49.840ZINFOdns-server (store): updated generation new_generation = 1 req_id = b4a8c56e-52e2-4dae-b491-b51ed65b23dd
152024-11-18T18:45:49.840ZINFOdns-server (http): request completed latency_us = 188 local_addr = [fd00:1122:3344:2::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::a]:34368 req_id = b4a8c56e-52e2-4dae-b491-b51ed65b23dd response_code = 204 uri = /config
162024-11-18T18:45:49.878ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = fe400efe-6757-464f-86b2-be8e9006c715
172024-11-18T18:45:49.878ZINFOdns-server (store): updated generation new_generation = 1 req_id = fe400efe-6757-464f-86b2-be8e9006c715
182024-11-18T18:45:49.878ZINFOdns-server (http): request completed latency_us = 106 local_addr = [fd00:1122:3344:2::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::c]:54790 req_id = fe400efe-6757-464f-86b2-be8e9006c715 response_code = 204 uri = /config
192024-11-18T18:46:48.465ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:2::1]:5353 remote_addr = [fd00:1122:3344:101::b]:38561
202024-11-18T18:46:48.943ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = 11117dc7-f23b-4322-bb94-8de317b1cb6a
212024-11-18T18:46:48.943ZINFOdns-server (store): updated generation new_generation = 1 req_id = 11117dc7-f23b-4322-bb94-8de317b1cb6a
222024-11-18T18:46:48.943ZINFOdns-server (http): request completed latency_us = 161 local_addr = [fd00:1122:3344:2::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::b]:38561 req_id = 11117dc7-f23b-4322-bb94-8de317b1cb6a response_code = 204 uri = /config
232024-11-18T18:46:49.414ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:2::1]:5353 remote_addr = [fd00:1122:3344:101::c]:45262
242024-11-18T18:46:49.584ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:2::1]:5353 remote_addr = [fd00:1122:3344:101::a]:53467
252024-11-18T18:46:49.821ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = ad56391f-a562-487b-8007-62fe60bff417
262024-11-18T18:46:49.821ZINFOdns-server (store): updated generation new_generation = 1 req_id = ad56391f-a562-487b-8007-62fe60bff417
272024-11-18T18:46:49.821ZINFOdns-server (http): request completed latency_us = 151 local_addr = [fd00:1122:3344:2::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::c]:45262 req_id = ad56391f-a562-487b-8007-62fe60bff417 response_code = 204 uri = /config
282024-11-18T18:46:49.922ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = 6e21c4b8-dd87-482c-b76f-414dea5149be
292024-11-18T18:46:49.922ZINFOdns-server (store): updated generation new_generation = 1 req_id = 6e21c4b8-dd87-482c-b76f-414dea5149be
302024-11-18T18:46:49.922ZINFOdns-server (http): request completed latency_us = 145 local_addr = [fd00:1122:3344:2::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::a]:53467 req_id = 6e21c4b8-dd87-482c-b76f-414dea5149be response_code = 204 uri = /config
312024-11-18T18:47:48.514ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:2::1]:5353 remote_addr = [fd00:1122:3344:101::b]:59051
322024-11-18T18:47:48.848ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = c63c46d4-4e54-4d1d-af53-b47c38c88353
332024-11-18T18:47:48.848ZINFOdns-server (store): updated generation new_generation = 1 req_id = c63c46d4-4e54-4d1d-af53-b47c38c88353
342024-11-18T18:47:48.848ZINFOdns-server (http): request completed latency_us = 228 local_addr = [fd00:1122:3344:2::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::b]:59051 req_id = c63c46d4-4e54-4d1d-af53-b47c38c88353 response_code = 204 uri = /config
352024-11-18T18:47:49.406ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:2::1]:5353 remote_addr = [fd00:1122:3344:101::c]:64366
362024-11-18T18:47:49.515ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:2::1]:5353 remote_addr = [fd00:1122:3344:101::a]:54228
372024-11-18T18:47:49.774ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = cf05ca9b-7a9c-4981-99e3-5fc717e7a3c4
382024-11-18T18:47:49.774ZINFOdns-server (store): updated generation new_generation = 1 req_id = cf05ca9b-7a9c-4981-99e3-5fc717e7a3c4
392024-11-18T18:47:49.774ZINFOdns-server (http): request completed latency_us = 147 local_addr = [fd00:1122:3344:2::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::c]:64366 req_id = cf05ca9b-7a9c-4981-99e3-5fc717e7a3c4 response_code = 204 uri = /config
402024-11-18T18:47:49.775ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = bd24f968-d416-4e6c-ae63-09e6ae772294
412024-11-18T18:47:49.775ZINFOdns-server (store): updated generation new_generation = 1 req_id = bd24f968-d416-4e6c-ae63-09e6ae772294
422024-11-18T18:47:49.775ZINFOdns-server (http): request completed latency_us = 82 local_addr = [fd00:1122:3344:2::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::a]:54228 req_id = bd24f968-d416-4e6c-ae63-09e6ae772294 response_code = 204 uri = /config
432024-11-18T18:48:48.595ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:2::1]:5353 remote_addr = [fd00:1122:3344:101::b]:43286
442024-11-18T18:48:48.897ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = 97484f4e-25ee-480f-a66b-6291a7c1b452
452024-11-18T18:48:48.897ZINFOdns-server (store): updated generation new_generation = 1 req_id = 97484f4e-25ee-480f-a66b-6291a7c1b452
462024-11-18T18:48:48.897ZINFOdns-server (http): request completed latency_us = 154 local_addr = [fd00:1122:3344:2::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::b]:43286 req_id = 97484f4e-25ee-480f-a66b-6291a7c1b452 response_code = 204 uri = /config
472024-11-18T18:48:49.427ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:2::1]:5353 remote_addr = [fd00:1122:3344:101::c]:49750
482024-11-18T18:48:49.596ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:2::1]:5353 remote_addr = [fd00:1122:3344:101::a]:59610
492024-11-18T18:48:49.756ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = 7186a8d6-fa52-4ad8-9d94-077c60811dba
502024-11-18T18:48:49.756ZINFOdns-server (store): updated generation new_generation = 1 req_id = 7186a8d6-fa52-4ad8-9d94-077c60811dba
512024-11-18T18:48:49.756ZINFOdns-server (http): request completed latency_us = 155 local_addr = [fd00:1122:3344:2::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::c]:49750 req_id = 7186a8d6-fa52-4ad8-9d94-077c60811dba response_code = 204 uri = /config
522024-11-18T18:48:49.903ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = 5407799d-b68f-46e6-93ae-8d2b8002ded2
532024-11-18T18:48:49.903ZINFOdns-server (store): updated generation new_generation = 1 req_id = 5407799d-b68f-46e6-93ae-8d2b8002ded2
542024-11-18T18:48:49.903ZINFOdns-server (http): request completed latency_us = 167 local_addr = [fd00:1122:3344:2::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::a]:59610 req_id = 5407799d-b68f-46e6-93ae-8d2b8002ded2 response_code = 204 uri = /config
552024-11-18T18:49:48.575ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:2::1]:5353 remote_addr = [fd00:1122:3344:101::b]:45742
562024-11-18T18:49:48.884ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = 04bb9336-3bc7-4953-a4cc-03f0e64de4bb
572024-11-18T18:49:48.884ZINFOdns-server (store): updated generation new_generation = 1 req_id = 04bb9336-3bc7-4953-a4cc-03f0e64de4bb
582024-11-18T18:49:48.884ZINFOdns-server (http): request completed latency_us = 191 local_addr = [fd00:1122:3344:2::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::b]:45742 req_id = 04bb9336-3bc7-4953-a4cc-03f0e64de4bb response_code = 204 uri = /config
592024-11-18T18:49:49.419ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:2::1]:5353 remote_addr = [fd00:1122:3344:101::c]:44580
602024-11-18T18:49:49.574ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:2::1]:5353 remote_addr = [fd00:1122:3344:101::a]:56034
612024-11-18T18:49:49.717ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = a8366919-d2a9-4895-9ab6-11968da0189f
622024-11-18T18:49:49.717ZINFOdns-server (store): updated generation new_generation = 1 req_id = a8366919-d2a9-4895-9ab6-11968da0189f
632024-11-18T18:49:49.717ZINFOdns-server (http): request completed latency_us = 146 local_addr = [fd00:1122:3344:2::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::c]:44580 req_id = a8366919-d2a9-4895-9ab6-11968da0189f response_code = 204 uri = /config
642024-11-18T18:49:49.876ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = 8822d1ad-802d-4baf-8841-5747386e9aec
652024-11-18T18:49:49.876ZINFOdns-server (store): updated generation new_generation = 1 req_id = 8822d1ad-802d-4baf-8841-5747386e9aec
662024-11-18T18:49:49.876ZINFOdns-server (http): request completed latency_us = 141 local_addr = [fd00:1122:3344:2::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::a]:56034 req_id = 8822d1ad-802d-4baf-8841-5747386e9aec response_code = 204 uri = /config
672024-11-18T18:50:48.624ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:2::1]:5353 remote_addr = [fd00:1122:3344:101::b]:55766
682024-11-18T18:50:48.811ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 30538, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, query: WireQuery { query: LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, dnssec_ok: false, max_payload: 1232, options: OPT { options: {}, }, }, ), } NXDOMAIN: no records found for name: "_clickhouse-admin-keeper._tcp.control-plane.oxide.internal." peer_addr = [fd00:1122:3344:101::b]:62279 req_id = 8d9dc241-55e0-479d-91d2-aafed38719ef
692024-11-18T18:50:49.057ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = c7149f05-cc2f-4e96-becb-355eebaaf3ea
702024-11-18T18:50:49.057ZINFOdns-server (store): updated generation new_generation = 1 req_id = c7149f05-cc2f-4e96-becb-355eebaaf3ea
712024-11-18T18:50:49.057ZINFOdns-server (http): request completed latency_us = 159 local_addr = [fd00:1122:3344:2::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::b]:55766 req_id = c7149f05-cc2f-4e96-becb-355eebaaf3ea response_code = 204 uri = /config
722024-11-18T18:50:49.427ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:2::1]:5353 remote_addr = [fd00:1122:3344:101::c]:49277
732024-11-18T18:50:49.538ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:2::1]:5353 remote_addr = [fd00:1122:3344:101::a]:35432
742024-11-18T18:50:49.651ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 48495, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, query: WireQuery { query: LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, dnssec_ok: false, max_payload: 1232, options: OPT { options: {}, }, }, ), } NXDOMAIN: no records found for name: "_clickhouse-admin-keeper._tcp.control-plane.oxide.internal." peer_addr = [fd00:1122:3344:101::c]:55446 req_id = e95beb21-b20b-4f36-94b4-7f1568f3f232
752024-11-18T18:50:49.812ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = 373dcbb0-866c-43d6-9132-7657da390dba
762024-11-18T18:50:49.812ZINFOdns-server (store): updated generation new_generation = 1 req_id = 373dcbb0-866c-43d6-9132-7657da390dba
772024-11-18T18:50:49.812ZINFOdns-server (http): request completed latency_us = 186 local_addr = [fd00:1122:3344:2::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::c]:49277 req_id = 373dcbb0-866c-43d6-9132-7657da390dba response_code = 204 uri = /config
782024-11-18T18:50:49.822ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = d64ef6ae-31cf-4383-aa8d-061ab28e46a4
792024-11-18T18:50:49.822ZINFOdns-server (store): updated generation new_generation = 1 req_id = d64ef6ae-31cf-4383-aa8d-061ab28e46a4
802024-11-18T18:50:49.822ZINFOdns-server (http): request completed latency_us = 100 local_addr = [fd00:1122:3344:2::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::a]:35432 req_id = d64ef6ae-31cf-4383-aa8d-061ab28e46a4 response_code = 204 uri = /config
812024-11-18T18:50:49.930ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 34934, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, query: WireQuery { query: LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, dnssec_ok: false, max_payload: 1232, options: OPT { options: {}, }, }, ), } NXDOMAIN: no records found for name: "_clickhouse-admin-keeper._tcp.control-plane.oxide.internal." peer_addr = [fd00:1122:3344:101::a]:53873 req_id = 0ac3fee9-ae1c-4b4d-8e69-6db114840cb3
822024-11-18T18:51:48.712ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:2::1]:5353 remote_addr = [fd00:1122:3344:101::b]:47702
832024-11-18T18:51:49.054ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = cc90b817-a255-42e5-9c77-0e3f7f9fd4ee
842024-11-18T18:51:49.054ZINFOdns-server (store): updated generation new_generation = 1 req_id = cc90b817-a255-42e5-9c77-0e3f7f9fd4ee
852024-11-18T18:51:49.054ZINFOdns-server (http): request completed latency_us = 159 local_addr = [fd00:1122:3344:2::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::b]:47702 req_id = cc90b817-a255-42e5-9c77-0e3f7f9fd4ee response_code = 204 uri = /config
862024-11-18T18:51:49.565ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:2::1]:5353 remote_addr = [fd00:1122:3344:101::a]:65257
872024-11-18T18:51:49.584ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:2::1]:5353 remote_addr = [fd00:1122:3344:101::c]:36276
882024-11-18T18:51:49.916ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = 230f34f6-6e01-4759-bed4-863fcf70b7c3
892024-11-18T18:51:49.916ZINFOdns-server (store): updated generation new_generation = 1 req_id = 230f34f6-6e01-4759-bed4-863fcf70b7c3
902024-11-18T18:51:49.916ZINFOdns-server (http): request completed latency_us = 150 local_addr = [fd00:1122:3344:2::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::a]:65257 req_id = 230f34f6-6e01-4759-bed4-863fcf70b7c3 response_code = 204 uri = /config
912024-11-18T18:51:49.919ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = f33d03cc-063f-4d72-b2d2-f6fe492a5082
922024-11-18T18:51:49.919ZINFOdns-server (store): updated generation new_generation = 1 req_id = f33d03cc-063f-4d72-b2d2-f6fe492a5082
932024-11-18T18:51:49.919ZINFOdns-server (http): request completed latency_us = 124 local_addr = [fd00:1122:3344:2::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::c]:36276 req_id = f33d03cc-063f-4d72-b2d2-f6fe492a5082 response_code = 204 uri = /config
942024-11-18T18:52:48.476ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:2::1]:5353 remote_addr = [fd00:1122:3344:101::b]:42064
952024-11-18T18:52:48.744ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = e5a8a072-9672-4d3f-bb08-3c447b676941
962024-11-18T18:52:48.744ZINFOdns-server (store): updated generation new_generation = 1 req_id = e5a8a072-9672-4d3f-bb08-3c447b676941
972024-11-18T18:52:48.744ZINFOdns-server (http): request completed latency_us = 138 local_addr = [fd00:1122:3344:2::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::b]:42064 req_id = e5a8a072-9672-4d3f-bb08-3c447b676941 response_code = 204 uri = /config
982024-11-18T18:52:49.418ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:2::1]:5353 remote_addr = [fd00:1122:3344:101::c]:64442
992024-11-18T18:52:49.723ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:2::1]:5353 remote_addr = [fd00:1122:3344:101::a]:57970
1002024-11-18T18:52:49.765ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = c6e9ca4f-2247-4470-a335-62f877ab4d2a
1012024-11-18T18:52:49.765ZINFOdns-server (store): updated generation new_generation = 1 req_id = c6e9ca4f-2247-4470-a335-62f877ab4d2a
1022024-11-18T18:52:49.765ZINFOdns-server (http): request completed latency_us = 154 local_addr = [fd00:1122:3344:2::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::c]:64442 req_id = c6e9ca4f-2247-4470-a335-62f877ab4d2a response_code = 204 uri = /config
1032024-11-18T18:52:49.850ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = f3eb183c-6a67-4860-bb6b-4d140b1e4b64
1042024-11-18T18:52:49.850ZINFOdns-server (store): updated generation new_generation = 1 req_id = f3eb183c-6a67-4860-bb6b-4d140b1e4b64
1052024-11-18T18:52:49.850ZINFOdns-server (http): request completed latency_us = 155 local_addr = [fd00:1122:3344:2::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::a]:57970 req_id = f3eb183c-6a67-4860-bb6b-4d140b1e4b64 response_code = 204 uri = /config
1062024-11-18T18:53:48.498ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:2::1]:5353 remote_addr = [fd00:1122:3344:101::b]:35860
1072024-11-18T18:53:48.775ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = dc88579b-b6d9-4c16-aa71-11fe51d31ed0
1082024-11-18T18:53:48.775ZINFOdns-server (store): updated generation new_generation = 1 req_id = dc88579b-b6d9-4c16-aa71-11fe51d31ed0
1092024-11-18T18:53:48.776ZINFOdns-server (http): request completed latency_us = 165 local_addr = [fd00:1122:3344:2::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::b]:35860 req_id = dc88579b-b6d9-4c16-aa71-11fe51d31ed0 response_code = 204 uri = /config
1102024-11-18T18:53:49.481ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:2::1]:5353 remote_addr = [fd00:1122:3344:101::c]:43131
1112024-11-18T18:53:49.564ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:2::1]:5353 remote_addr = [fd00:1122:3344:101::a]:42784
1122024-11-18T18:53:49.865ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = 5d141587-ebba-407d-8fbe-44e5f663d73c
1132024-11-18T18:53:49.865ZINFOdns-server (store): updated generation new_generation = 1 req_id = 5d141587-ebba-407d-8fbe-44e5f663d73c
1142024-11-18T18:53:49.865ZINFOdns-server (http): request completed latency_us = 150 local_addr = [fd00:1122:3344:2::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::c]:43131 req_id = 5d141587-ebba-407d-8fbe-44e5f663d73c response_code = 204 uri = /config
1152024-11-18T18:53:49.989ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = 18a30954-b31a-4a83-9216-c5ff82b960be
1162024-11-18T18:53:49.989ZINFOdns-server (store): updated generation new_generation = 1 req_id = 18a30954-b31a-4a83-9216-c5ff82b960be
1172024-11-18T18:53:49.989ZINFOdns-server (http): request completed latency_us = 204 local_addr = [fd00:1122:3344:2::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::a]:42784 req_id = 18a30954-b31a-4a83-9216-c5ff82b960be response_code = 204 uri = /config
1182024-11-18T18:54:48.578ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:2::1]:5353 remote_addr = [fd00:1122:3344:101::b]:58383
1192024-11-18T18:54:48.900ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = 752df179-562a-40a2-9155-72374f94edbf
1202024-11-18T18:54:48.900ZINFOdns-server (store): updated generation new_generation = 1 req_id = 752df179-562a-40a2-9155-72374f94edbf
1212024-11-18T18:54:48.900ZINFOdns-server (http): request completed latency_us = 147 local_addr = [fd00:1122:3344:2::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::b]:58383 req_id = 752df179-562a-40a2-9155-72374f94edbf response_code = 204 uri = /config
1222024-11-18T18:54:49.567ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:2::1]:5353 remote_addr = [fd00:1122:3344:101::c]:41727
1232024-11-18T18:54:49.671ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:2::1]:5353 remote_addr = [fd00:1122:3344:101::a]:52288
1242024-11-18T18:54:49.786ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = 6e48bb3d-feb3-49e5-88e6-a1b2f0565369
1252024-11-18T18:54:49.786ZINFOdns-server (store): updated generation new_generation = 1 req_id = 6e48bb3d-feb3-49e5-88e6-a1b2f0565369
1262024-11-18T18:54:49.786ZINFOdns-server (http): request completed latency_us = 142 local_addr = [fd00:1122:3344:2::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::c]:41727 req_id = 6e48bb3d-feb3-49e5-88e6-a1b2f0565369 response_code = 204 uri = /config
1272024-11-18T18:54:50.048ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = f32643da-6384-44a3-8eaa-6fe9ce72fd14
1282024-11-18T18:54:50.048ZINFOdns-server (store): updated generation new_generation = 1 req_id = f32643da-6384-44a3-8eaa-6fe9ce72fd14
1292024-11-18T18:54:50.048ZINFOdns-server (http): request completed latency_us = 142 local_addr = [fd00:1122:3344:2::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::a]:52288 req_id = f32643da-6384-44a3-8eaa-6fe9ce72fd14 response_code = 204 uri = /config