Max level shown:
12024-11-08T01:30:00.516ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 28817, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, query: WireQuery { query: LowerQuery { name: LowerName( Name("oxz_cockroachdb_772de816-b223-47bf-bfb3-d71923af1e47."), ), original: Query { name: Name("oxz_cockroachdb_772de816-b223-47bf-bfb3-d71923af1e47."), query_type: A, query_class: IN, }, }, original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 55, 55, 50, 100, 101, 56, 49, 54, 45, 98, 50, 50, 51, 45, 52, 55, 98, 102, 45, 98, 102, 98, 51, 45, 100, 55, 49, 57, 50, 51, 97, 102, 49, 101, 52, 55, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_772de816-b223-47bf-bfb3-d71923af1e47." peer_addr = [fd00:1122:3344:101::7]:53011 req_id = dd9f63bc-c71b-4b29-93f7-cd9ced6c133d
22024-11-08T01:30:00.516ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 28817, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, query: WireQuery { query: LowerQuery { name: LowerName( Name("oxz_cockroachdb_772de816-b223-47bf-bfb3-d71923af1e47."), ), original: Query { name: Name("oxz_cockroachdb_772de816-b223-47bf-bfb3-d71923af1e47."), query_type: A, query_class: IN, }, }, original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 55, 55, 50, 100, 101, 56, 49, 54, 45, 98, 50, 50, 51, 45, 52, 55, 98, 102, 45, 98, 102, 98, 51, 45, 100, 55, 49, 57, 50, 51, 97, 102, 49, 101, 52, 55, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_772de816-b223-47bf-bfb3-d71923af1e47." peer_addr = [fd00:1122:3344:101::7]:47724 req_id = cc851d4c-9cf2-42c5-9ab2-efa6ac0c5400
32024-11-08T01:30:00.527ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 27317, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, query: WireQuery { query: LowerQuery { name: LowerName( Name("oxz_clickhouse_bef64488-55d2-4df7-b667-d2d397808752."), ), original: Query { name: Name("oxz_clickhouse_bef64488-55d2-4df7-b667-d2d397808752."), query_type: A, query_class: IN, }, }, original: [ 51, 111, 120, 122, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 95, 98, 101, 102, 54, 52, 52, 56, 56, 45, 53, 53, 100, 50, 45, 52, 100, 102, 55, 45, 98, 54, 54, 55, 45, 100, 50, 100, 51, 57, 55, 56, 48, 56, 55, 53, 50, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_clickhouse_bef64488-55d2-4df7-b667-d2d397808752." peer_addr = [fd00:1122:3344:101::e]:41134 req_id = aa03ca37-161c-4bb0-804c-00cab61ab8b0
42024-11-08T01:30:00.527ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 27317, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, query: WireQuery { query: LowerQuery { name: LowerName( Name("oxz_clickhouse_bef64488-55d2-4df7-b667-d2d397808752."), ), original: Query { name: Name("oxz_clickhouse_bef64488-55d2-4df7-b667-d2d397808752."), query_type: A, query_class: IN, }, }, original: [ 51, 111, 120, 122, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 95, 98, 101, 102, 54, 52, 52, 56, 56, 45, 53, 53, 100, 50, 45, 52, 100, 102, 55, 45, 98, 54, 54, 55, 45, 100, 50, 100, 51, 57, 55, 56, 48, 56, 55, 53, 50, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_clickhouse_bef64488-55d2-4df7-b667-d2d397808752." peer_addr = [fd00:1122:3344:101::e]:44358 req_id = 7e6497e6-29bc-4f6b-bc0f-87bff85b0f22
52024-11-08T01:30:00.544ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 19400, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, query: WireQuery { query: LowerQuery { name: LowerName( Name("oxz_cockroachdb_ab771c3d-3933-453f-b87c-e1e2e5f9f49d."), ), original: Query { name: Name("oxz_cockroachdb_ab771c3d-3933-453f-b87c-e1e2e5f9f49d."), query_type: A, query_class: IN, }, }, original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 97, 98, 55, 55, 49, 99, 51, 100, 45, 51, 57, 51, 51, 45, 52, 53, 51, 102, 45, 98, 56, 55, 99, 45, 101, 49, 101, 50, 101, 53, 102, 57, 102, 52, 57, 100, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_ab771c3d-3933-453f-b87c-e1e2e5f9f49d." peer_addr = [fd00:1122:3344:101::3]:41770 req_id = fd007572-9857-41e9-b2f0-82aaec9a2577
62024-11-08T01:30:00.544ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 19400, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, query: WireQuery { query: LowerQuery { name: LowerName( Name("oxz_cockroachdb_ab771c3d-3933-453f-b87c-e1e2e5f9f49d."), ), original: Query { name: Name("oxz_cockroachdb_ab771c3d-3933-453f-b87c-e1e2e5f9f49d."), query_type: A, query_class: IN, }, }, original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 97, 98, 55, 55, 49, 99, 51, 100, 45, 51, 57, 51, 51, 45, 52, 53, 51, 102, 45, 98, 56, 55, 99, 45, 101, 49, 101, 50, 101, 53, 102, 57, 102, 52, 57, 100, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_ab771c3d-3933-453f-b87c-e1e2e5f9f49d." peer_addr = [fd00:1122:3344:101::3]:39502 req_id = 38f0f893-5d71-4f00-b0a5-a71bac6ec6a8
72024-11-08T01:30:00.587ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 26236, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, query: WireQuery { query: LowerQuery { name: LowerName( Name("oxz_cockroachdb_df793937-99c9-4b19-a0f3-f00075eac57e."), ), original: Query { name: Name("oxz_cockroachdb_df793937-99c9-4b19-a0f3-f00075eac57e."), query_type: A, query_class: IN, }, }, original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 100, 102, 55, 57, 51, 57, 51, 55, 45, 57, 57, 99, 57, 45, 52, 98, 49, 57, 45, 97, 48, 102, 51, 45, 102, 48, 48, 48, 55, 53, 101, 97, 99, 53, 55, 101, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_df793937-99c9-4b19-a0f3-f00075eac57e." peer_addr = [fd00:1122:3344:101::4]:39034 req_id = 4f8e1ce3-fc0f-4c53-8d5f-cb9085dffaaf
82024-11-08T01:30:00.588ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 26236, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, query: WireQuery { query: LowerQuery { name: LowerName( Name("oxz_cockroachdb_df793937-99c9-4b19-a0f3-f00075eac57e."), ), original: Query { name: Name("oxz_cockroachdb_df793937-99c9-4b19-a0f3-f00075eac57e."), query_type: A, query_class: IN, }, }, original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 100, 102, 55, 57, 51, 57, 51, 55, 45, 57, 57, 99, 57, 45, 52, 98, 49, 57, 45, 97, 48, 102, 51, 45, 102, 48, 48, 48, 55, 53, 101, 97, 99, 53, 55, 101, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_df793937-99c9-4b19-a0f3-f00075eac57e." peer_addr = [fd00:1122:3344:101::4]:36677 req_id = d4730710-f70f-45dc-a19e-ffd7daa8f1e6
92024-11-08T01:30:00.633ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 44791, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, query: WireQuery { query: LowerQuery { name: LowerName( Name("oxz_cockroachdb_a4103367-f495-4bce-8ac7-2159dbb9cf14."), ), original: Query { name: Name("oxz_cockroachdb_a4103367-f495-4bce-8ac7-2159dbb9cf14."), query_type: A, query_class: IN, }, }, original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 97, 52, 49, 48, 51, 51, 54, 55, 45, 102, 52, 57, 53, 45, 52, 98, 99, 101, 45, 56, 97, 99, 55, 45, 50, 49, 53, 57, 100, 98, 98, 57, 99, 102, 49, 52, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_a4103367-f495-4bce-8ac7-2159dbb9cf14." peer_addr = [fd00:1122:3344:101::6]:34015 req_id = 62130bd8-b2e6-40f7-a048-795d0cf39d68
102024-11-08T01:30:00.634ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 44791, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, query: WireQuery { query: LowerQuery { name: LowerName( Name("oxz_cockroachdb_a4103367-f495-4bce-8ac7-2159dbb9cf14."), ), original: Query { name: Name("oxz_cockroachdb_a4103367-f495-4bce-8ac7-2159dbb9cf14."), query_type: A, query_class: IN, }, }, original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 97, 52, 49, 48, 51, 51, 54, 55, 45, 102, 52, 57, 53, 45, 52, 98, 99, 101, 45, 56, 97, 99, 55, 45, 50, 49, 53, 57, 100, 98, 98, 57, 99, 102, 49, 52, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_a4103367-f495-4bce-8ac7-2159dbb9cf14." peer_addr = [fd00:1122:3344:101::6]:42176 req_id = 63d04980-d130-492e-ab4c-ada50464132d
112024-11-08T01:30:41.346ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:1::1]:5353 remote_addr = [fd00:1122:3344:101::c]:56039
122024-11-08T01:30:41.422ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:1::1]:5353 remote_addr = [fd00:1122:3344:101::b]:41265
132024-11-08T01:30:41.511ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:1::1]:5353 remote_addr = [fd00:1122:3344:101::a]:44570
142024-11-08T01:30:41.677ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = cce28cde-19fb-4640-8d95-4051429ecf86
152024-11-08T01:30:41.677ZINFOdns-server (store): updated generation new_generation = 1 req_id = cce28cde-19fb-4640-8d95-4051429ecf86
162024-11-08T01:30:41.678ZINFOdns-server (http): request completed latency_us = 150 local_addr = [fd00:1122:3344:1::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::c]:56039 req_id = cce28cde-19fb-4640-8d95-4051429ecf86 response_code = 204 uri = /config
172024-11-08T01:30:41.697ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = 50b9a7dd-8893-4c13-bd1c-487adedc9b2e
182024-11-08T01:30:41.697ZINFOdns-server (store): updated generation new_generation = 1 req_id = 50b9a7dd-8893-4c13-bd1c-487adedc9b2e
192024-11-08T01:30:41.697ZINFOdns-server (http): request completed latency_us = 113 local_addr = [fd00:1122:3344:1::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::b]:41265 req_id = 50b9a7dd-8893-4c13-bd1c-487adedc9b2e response_code = 204 uri = /config
202024-11-08T01:30:41.776ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = c798a11c-eb20-4d51-81cd-a33f94b8817b
212024-11-08T01:30:41.776ZINFOdns-server (store): updated generation new_generation = 1 req_id = c798a11c-eb20-4d51-81cd-a33f94b8817b
222024-11-08T01:30:41.776ZINFOdns-server (http): request completed latency_us = 143 local_addr = [fd00:1122:3344:1::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::a]:44570 req_id = c798a11c-eb20-4d51-81cd-a33f94b8817b response_code = 204 uri = /config
232024-11-08T01:31:41.317ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:1::1]:5353 remote_addr = [fd00:1122:3344:101::c]:49180
242024-11-08T01:31:41.447ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:1::1]:5353 remote_addr = [fd00:1122:3344:101::b]:63814
252024-11-08T01:31:41.473ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:1::1]:5353 remote_addr = [fd00:1122:3344:101::a]:63151
262024-11-08T01:31:41.576ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = 5472897f-520c-4fba-ad8b-677b8fc811bc
272024-11-08T01:31:41.576ZINFOdns-server (store): updated generation new_generation = 1 req_id = 5472897f-520c-4fba-ad8b-677b8fc811bc
282024-11-08T01:31:41.577ZINFOdns-server (http): request completed latency_us = 145 local_addr = [fd00:1122:3344:1::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::c]:49180 req_id = 5472897f-520c-4fba-ad8b-677b8fc811bc response_code = 204 uri = /config
292024-11-08T01:31:41.730ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = d812fdaf-2d54-426f-ba61-e796fe2a6f5f
302024-11-08T01:31:41.730ZINFOdns-server (store): updated generation new_generation = 1 req_id = d812fdaf-2d54-426f-ba61-e796fe2a6f5f
312024-11-08T01:31:41.731ZINFOdns-server (http): request completed latency_us = 179 local_addr = [fd00:1122:3344:1::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::b]:63814 req_id = d812fdaf-2d54-426f-ba61-e796fe2a6f5f response_code = 204 uri = /config
322024-11-08T01:31:41.923ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = 8f676e4b-8b34-41ab-bbb5-f27bb7df515e
332024-11-08T01:31:41.923ZINFOdns-server (store): updated generation new_generation = 1 req_id = 8f676e4b-8b34-41ab-bbb5-f27bb7df515e
342024-11-08T01:31:41.923ZINFOdns-server (http): request completed latency_us = 160 local_addr = [fd00:1122:3344:1::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::a]:63151 req_id = 8f676e4b-8b34-41ab-bbb5-f27bb7df515e response_code = 204 uri = /config
352024-11-08T01:32:41.388ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:1::1]:5353 remote_addr = [fd00:1122:3344:101::c]:40637
362024-11-08T01:32:41.505ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:1::1]:5353 remote_addr = [fd00:1122:3344:101::a]:44733
372024-11-08T01:32:41.546ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:1::1]:5353 remote_addr = [fd00:1122:3344:101::b]:32860
382024-11-08T01:32:41.654ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = 3da5fab2-08be-49e0-b27e-0be381c88dbe
392024-11-08T01:32:41.654ZINFOdns-server (store): updated generation new_generation = 1 req_id = 3da5fab2-08be-49e0-b27e-0be381c88dbe
402024-11-08T01:32:41.654ZINFOdns-server (http): request completed latency_us = 146 local_addr = [fd00:1122:3344:1::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::c]:40637 req_id = 3da5fab2-08be-49e0-b27e-0be381c88dbe response_code = 204 uri = /config
412024-11-08T01:32:41.930ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = 6956df01-e1b0-486e-a2ce-c50f6d7ad854
422024-11-08T01:32:41.930ZINFOdns-server (store): updated generation new_generation = 1 req_id = 6956df01-e1b0-486e-a2ce-c50f6d7ad854
432024-11-08T01:32:41.930ZINFOdns-server (http): request completed latency_us = 139 local_addr = [fd00:1122:3344:1::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::b]:32860 req_id = 6956df01-e1b0-486e-a2ce-c50f6d7ad854 response_code = 204 uri = /config
442024-11-08T01:32:41.967ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = da146eab-0218-4113-9d6b-5a7a1337dcfa
452024-11-08T01:32:41.967ZINFOdns-server (store): updated generation new_generation = 1 req_id = da146eab-0218-4113-9d6b-5a7a1337dcfa
462024-11-08T01:32:41.967ZINFOdns-server (http): request completed latency_us = 124 local_addr = [fd00:1122:3344:1::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::a]:44733 req_id = da146eab-0218-4113-9d6b-5a7a1337dcfa response_code = 204 uri = /config
472024-11-08T01:33:41.521ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:1::1]:5353 remote_addr = [fd00:1122:3344:101::c]:60778
482024-11-08T01:33:41.540ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:1::1]:5353 remote_addr = [fd00:1122:3344:101::b]:43370
492024-11-08T01:33:41.568ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 24209, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, query: WireQuery { query: LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, dnssec_ok: false, max_payload: 1232, options: OPT { options: {}, }, }, ), } NXDOMAIN: no records found for name: "_clickhouse-admin-keeper._tcp.control-plane.oxide.internal." peer_addr = [fd00:1122:3344:101::b]:53349 req_id = 3db869dd-0766-4693-9242-2e2db97ddff2
502024-11-08T01:33:41.603ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 28233, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, query: WireQuery { query: LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, dnssec_ok: false, max_payload: 1232, options: OPT { options: {}, }, }, ), } NXDOMAIN: no records found for name: "_clickhouse-admin-keeper._tcp.control-plane.oxide.internal." peer_addr = [fd00:1122:3344:101::c]:50946 req_id = 467b06fe-f2da-4c20-8bc9-2ef291d341c8
512024-11-08T01:33:41.672ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:1::1]:5353 remote_addr = [fd00:1122:3344:101::a]:44829
522024-11-08T01:33:41.849ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 39300, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, query: WireQuery { query: LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, dnssec_ok: false, max_payload: 1232, options: OPT { options: {}, }, }, ), } NXDOMAIN: no records found for name: "_clickhouse-admin-keeper._tcp.control-plane.oxide.internal." peer_addr = [fd00:1122:3344:101::a]:59859 req_id = c2c64559-dd02-4f50-b654-1259bb30bead
532024-11-08T01:33:41.861ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = 8d005d9f-8608-4758-b6c0-28d532d57eba
542024-11-08T01:33:41.861ZINFOdns-server (store): updated generation new_generation = 1 req_id = 8d005d9f-8608-4758-b6c0-28d532d57eba
552024-11-08T01:33:41.861ZINFOdns-server (http): request completed latency_us = 140 local_addr = [fd00:1122:3344:1::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::b]:43370 req_id = 8d005d9f-8608-4758-b6c0-28d532d57eba response_code = 204 uri = /config
562024-11-08T01:33:41.920ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = a45523ce-b4d6-4a8a-b468-de621c14de50
572024-11-08T01:33:41.920ZINFOdns-server (store): updated generation new_generation = 1 req_id = a45523ce-b4d6-4a8a-b468-de621c14de50
582024-11-08T01:33:41.920ZINFOdns-server (http): request completed latency_us = 142 local_addr = [fd00:1122:3344:1::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::c]:60778 req_id = a45523ce-b4d6-4a8a-b468-de621c14de50 response_code = 204 uri = /config
592024-11-08T01:33:41.962ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = 4e9bc40e-6c38-4f61-8fca-39bf4746c466
602024-11-08T01:33:41.962ZINFOdns-server (store): updated generation new_generation = 1 req_id = 4e9bc40e-6c38-4f61-8fca-39bf4746c466
612024-11-08T01:33:41.962ZINFOdns-server (http): request completed latency_us = 108 local_addr = [fd00:1122:3344:1::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::a]:44829 req_id = 4e9bc40e-6c38-4f61-8fca-39bf4746c466 response_code = 204 uri = /config
622024-11-08T01:34:41.356ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:1::1]:5353 remote_addr = [fd00:1122:3344:101::c]:35711
632024-11-08T01:34:41.443ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:1::1]:5353 remote_addr = [fd00:1122:3344:101::b]:60165
642024-11-08T01:34:41.444ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:1::1]:5353 remote_addr = [fd00:1122:3344:101::a]:61600
652024-11-08T01:34:41.645ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = 01a8445d-d520-4514-9a4b-8135166949c2
662024-11-08T01:34:41.645ZINFOdns-server (store): updated generation new_generation = 1 req_id = 01a8445d-d520-4514-9a4b-8135166949c2
672024-11-08T01:34:41.645ZINFOdns-server (http): request completed latency_us = 197 local_addr = [fd00:1122:3344:1::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::c]:35711 req_id = 01a8445d-d520-4514-9a4b-8135166949c2 response_code = 204 uri = /config
682024-11-08T01:34:41.700ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = d47e884b-a3cd-4986-8317-0f99c57bdcc3
692024-11-08T01:34:41.700ZINFOdns-server (store): updated generation new_generation = 1 req_id = d47e884b-a3cd-4986-8317-0f99c57bdcc3
702024-11-08T01:34:41.700ZINFOdns-server (http): request completed latency_us = 142 local_addr = [fd00:1122:3344:1::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::b]:60165 req_id = d47e884b-a3cd-4986-8317-0f99c57bdcc3 response_code = 204 uri = /config
712024-11-08T01:34:41.720ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = 05b12884-eafe-4fb2-82b6-a4065280a360
722024-11-08T01:34:41.720ZINFOdns-server (store): updated generation new_generation = 1 req_id = 05b12884-eafe-4fb2-82b6-a4065280a360
732024-11-08T01:34:41.720ZINFOdns-server (http): request completed latency_us = 132 local_addr = [fd00:1122:3344:1::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::a]:61600 req_id = 05b12884-eafe-4fb2-82b6-a4065280a360 response_code = 204 uri = /config
742024-11-08T01:35:41.325ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:1::1]:5353 remote_addr = [fd00:1122:3344:101::c]:48232
752024-11-08T01:35:41.556ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:1::1]:5353 remote_addr = [fd00:1122:3344:101::a]:33645
762024-11-08T01:35:41.630ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = dc0477b2-891c-452e-9109-bd3216a214fe
772024-11-08T01:35:41.630ZINFOdns-server (store): updated generation new_generation = 1 req_id = dc0477b2-891c-452e-9109-bd3216a214fe
782024-11-08T01:35:41.630ZINFOdns-server (http): request completed latency_us = 203 local_addr = [fd00:1122:3344:1::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::c]:48232 req_id = dc0477b2-891c-452e-9109-bd3216a214fe response_code = 204 uri = /config
792024-11-08T01:35:41.655ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:1::1]:5353 remote_addr = [fd00:1122:3344:101::b]:53141
802024-11-08T01:35:41.855ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = 41576c87-8f7c-4ce2-84cd-a8c63e344103
812024-11-08T01:35:41.855ZINFOdns-server (store): updated generation new_generation = 1 req_id = 41576c87-8f7c-4ce2-84cd-a8c63e344103
822024-11-08T01:35:41.855ZINFOdns-server (http): request completed latency_us = 160 local_addr = [fd00:1122:3344:1::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::a]:33645 req_id = 41576c87-8f7c-4ce2-84cd-a8c63e344103 response_code = 204 uri = /config
832024-11-08T01:35:42.041ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = 043805d1-37ce-4c3a-a184-5673a29db864
842024-11-08T01:35:42.041ZINFOdns-server (store): updated generation new_generation = 1 req_id = 043805d1-37ce-4c3a-a184-5673a29db864
852024-11-08T01:35:42.041ZINFOdns-server (http): request completed latency_us = 141 local_addr = [fd00:1122:3344:1::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::b]:53141 req_id = 043805d1-37ce-4c3a-a184-5673a29db864 response_code = 204 uri = /config
862024-11-08T01:36:41.329ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:1::1]:5353 remote_addr = [fd00:1122:3344:101::c]:33463
872024-11-08T01:36:41.436ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:1::1]:5353 remote_addr = [fd00:1122:3344:101::b]:51107
882024-11-08T01:36:41.486ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:1::1]:5353 remote_addr = [fd00:1122:3344:101::a]:43621
892024-11-08T01:36:41.677ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = bc7abe7b-cb3a-4e00-a324-0d12a9d54d5d
902024-11-08T01:36:41.677ZINFOdns-server (store): updated generation new_generation = 1 req_id = bc7abe7b-cb3a-4e00-a324-0d12a9d54d5d
912024-11-08T01:36:41.677ZINFOdns-server (http): request completed latency_us = 149 local_addr = [fd00:1122:3344:1::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::c]:33463 req_id = bc7abe7b-cb3a-4e00-a324-0d12a9d54d5d response_code = 204 uri = /config
922024-11-08T01:36:41.779ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = 3a3fd4a5-5004-46e5-92ae-ae3b95bcd53b
932024-11-08T01:36:41.779ZINFOdns-server (store): updated generation new_generation = 1 req_id = 3a3fd4a5-5004-46e5-92ae-ae3b95bcd53b
942024-11-08T01:36:41.779ZINFOdns-server (http): request completed latency_us = 187 local_addr = [fd00:1122:3344:1::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::b]:51107 req_id = 3a3fd4a5-5004-46e5-92ae-ae3b95bcd53b response_code = 204 uri = /config
952024-11-08T01:36:41.858ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = f00419e1-fd61-4ab8-aab9-d8e91c77b999
962024-11-08T01:36:41.858ZINFOdns-server (store): updated generation new_generation = 1 req_id = f00419e1-fd61-4ab8-aab9-d8e91c77b999
972024-11-08T01:36:41.858ZINFOdns-server (http): request completed latency_us = 134 local_addr = [fd00:1122:3344:1::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::a]:43621 req_id = f00419e1-fd61-4ab8-aab9-d8e91c77b999 response_code = 204 uri = /config
982024-11-08T01:37:41.352ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:1::1]:5353 remote_addr = [fd00:1122:3344:101::c]:54430
992024-11-08T01:37:41.458ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:1::1]:5353 remote_addr = [fd00:1122:3344:101::b]:63781
1002024-11-08T01:37:41.473ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:1::1]:5353 remote_addr = [fd00:1122:3344:101::a]:43385
1012024-11-08T01:37:41.700ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = 0ad48173-32f5-44fb-970e-4bbc3f658cbd
1022024-11-08T01:37:41.700ZINFOdns-server (store): updated generation new_generation = 1 req_id = 0ad48173-32f5-44fb-970e-4bbc3f658cbd
1032024-11-08T01:37:41.700ZINFOdns-server (http): request completed latency_us = 140 local_addr = [fd00:1122:3344:1::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::b]:63781 req_id = 0ad48173-32f5-44fb-970e-4bbc3f658cbd response_code = 204 uri = /config
1042024-11-08T01:37:41.752ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = 1c271a61-ae3f-42b9-b4eb-d844efeb6de1
1052024-11-08T01:37:41.752ZINFOdns-server (store): updated generation new_generation = 1 req_id = 1c271a61-ae3f-42b9-b4eb-d844efeb6de1
1062024-11-08T01:37:41.752ZINFOdns-server (http): request completed latency_us = 114 local_addr = [fd00:1122:3344:1::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::c]:54430 req_id = 1c271a61-ae3f-42b9-b4eb-d844efeb6de1 response_code = 204 uri = /config
1072024-11-08T01:37:41.786ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = 6840239b-5b6c-446f-a2a1-79a7cd2b9ea0
1082024-11-08T01:37:41.786ZINFOdns-server (store): updated generation new_generation = 1 req_id = 6840239b-5b6c-446f-a2a1-79a7cd2b9ea0
1092024-11-08T01:37:41.786ZINFOdns-server (http): request completed latency_us = 102 local_addr = [fd00:1122:3344:1::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::a]:43385 req_id = 6840239b-5b6c-446f-a2a1-79a7cd2b9ea0 response_code = 204 uri = /config
1102024-11-08T01:38:41.327ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:1::1]:5353 remote_addr = [fd00:1122:3344:101::c]:44657
1112024-11-08T01:38:41.449ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:1::1]:5353 remote_addr = [fd00:1122:3344:101::b]:58381
1122024-11-08T01:38:41.496ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:1::1]:5353 remote_addr = [fd00:1122:3344:101::a]:64724
1132024-11-08T01:38:41.683ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = c280704b-c426-4084-b032-9e4409f8b030
1142024-11-08T01:38:41.683ZINFOdns-server (store): updated generation new_generation = 1 req_id = c280704b-c426-4084-b032-9e4409f8b030
1152024-11-08T01:38:41.683ZINFOdns-server (http): request completed latency_us = 149 local_addr = [fd00:1122:3344:1::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::c]:44657 req_id = c280704b-c426-4084-b032-9e4409f8b030 response_code = 204 uri = /config
1162024-11-08T01:38:41.712ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = 0fb3edff-e238-4354-8e3c-3c769f17f766
1172024-11-08T01:38:41.712ZINFOdns-server (store): updated generation new_generation = 1 req_id = 0fb3edff-e238-4354-8e3c-3c769f17f766
1182024-11-08T01:38:41.712ZINFOdns-server (http): request completed latency_us = 136 local_addr = [fd00:1122:3344:1::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::b]:58381 req_id = 0fb3edff-e238-4354-8e3c-3c769f17f766 response_code = 204 uri = /config
1192024-11-08T01:38:41.814ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = 6a3f0c47-5f8a-4640-9f2d-d07d6c1a9b57
1202024-11-08T01:38:41.814ZINFOdns-server (store): updated generation new_generation = 1 req_id = 6a3f0c47-5f8a-4640-9f2d-d07d6c1a9b57
1212024-11-08T01:38:41.815ZINFOdns-server (http): request completed latency_us = 145 local_addr = [fd00:1122:3344:1::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::a]:64724 req_id = 6a3f0c47-5f8a-4640-9f2d-d07d6c1a9b57 response_code = 204 uri = /config