Max level shown:
12024-11-28T02:00:00.972ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 20151, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, query: WireQuery { query: LowerQuery { name: LowerName( Name("oxz_cockroachdb_de4ffc97-f8c2-4704-be1c-411fbcd8c214."), ), original: Query { name: Name("oxz_cockroachdb_de4ffc97-f8c2-4704-be1c-411fbcd8c214."), query_type: A, query_class: IN, }, }, original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 100, 101, 52, 102, 102, 99, 57, 55, 45, 102, 56, 99, 50, 45, 52, 55, 48, 52, 45, 98, 101, 49, 99, 45, 52, 49, 49, 102, 98, 99, 100, 56, 99, 50, 49, 52, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_de4ffc97-f8c2-4704-be1c-411fbcd8c214." peer_addr = [fd00:1122:3344:101::7]:36623 req_id = 131acd8b-56e9-4ad2-82db-200fc2f13752
22024-11-28T02:00:00.973ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 20151, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, query: WireQuery { query: LowerQuery { name: LowerName( Name("oxz_cockroachdb_de4ffc97-f8c2-4704-be1c-411fbcd8c214."), ), original: Query { name: Name("oxz_cockroachdb_de4ffc97-f8c2-4704-be1c-411fbcd8c214."), query_type: A, query_class: IN, }, }, original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 100, 101, 52, 102, 102, 99, 57, 55, 45, 102, 56, 99, 50, 45, 52, 55, 48, 52, 45, 98, 101, 49, 99, 45, 52, 49, 49, 102, 98, 99, 100, 56, 99, 50, 49, 52, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_de4ffc97-f8c2-4704-be1c-411fbcd8c214." peer_addr = [fd00:1122:3344:101::7]:39480 req_id = 4250931d-52ae-4d63-890b-4a9ef229c037
32024-11-28T02:00:10.798ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:2::1]:5353 remote_addr = [fd00:1122:3344:101::b]:60033
42024-11-28T02:00:10.872ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:2::1]:5353 remote_addr = [fd00:1122:3344:101::c]:38838
52024-11-28T02:00:10.965ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = 63b3e975-c4dc-461e-a895-afb87dcf2799
62024-11-28T02:00:10.965ZINFOdns-server (store): updated generation new_generation = 1 req_id = 63b3e975-c4dc-461e-a895-afb87dcf2799
72024-11-28T02:00:10.965ZINFOdns-server (http): request completed latency_us = 162 local_addr = [fd00:1122:3344:2::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::b]:60033 req_id = 63b3e975-c4dc-461e-a895-afb87dcf2799 response_code = 204 uri = /config
82024-11-28T02:00:10.967ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = 5fcd056d-8cbf-4a44-b706-ec09b40de943
92024-11-28T02:00:10.967ZINFOdns-server (store): updated generation new_generation = 1 req_id = 5fcd056d-8cbf-4a44-b706-ec09b40de943
102024-11-28T02:00:10.967ZINFOdns-server (http): request completed latency_us = 165 local_addr = [fd00:1122:3344:2::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::c]:38838 req_id = 5fcd056d-8cbf-4a44-b706-ec09b40de943 response_code = 204 uri = /config
112024-11-28T02:00:10.983ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:2::1]:5353 remote_addr = [fd00:1122:3344:101::a]:56950
122024-11-28T02:00:11.066ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = 4bb7681a-8798-48d6-9999-7d4aa426c1e3
132024-11-28T02:00:11.066ZINFOdns-server (store): updated generation new_generation = 1 req_id = 4bb7681a-8798-48d6-9999-7d4aa426c1e3
142024-11-28T02:00:11.066ZINFOdns-server (http): request completed latency_us = 180 local_addr = [fd00:1122:3344:2::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::a]:56950 req_id = 4bb7681a-8798-48d6-9999-7d4aa426c1e3 response_code = 204 uri = /config
152024-11-28T02:01:10.703ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:2::1]:5353 remote_addr = [fd00:1122:3344:101::c]:39311
162024-11-28T02:01:10.820ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:2::1]:5353 remote_addr = [fd00:1122:3344:101::b]:62959
172024-11-28T02:01:10.956ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = 1d1d48d2-5cca-49d3-a70b-9b0e3a3cdc61
182024-11-28T02:01:10.956ZINFOdns-server (store): updated generation new_generation = 1 req_id = 1d1d48d2-5cca-49d3-a70b-9b0e3a3cdc61
192024-11-28T02:01:10.956ZINFOdns-server (http): request completed latency_us = 148 local_addr = [fd00:1122:3344:2::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::c]:39311 req_id = 1d1d48d2-5cca-49d3-a70b-9b0e3a3cdc61 response_code = 204 uri = /config
202024-11-28T02:01:10.968ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = be45eebe-1435-4efb-8ddd-f923e8b61ed1
212024-11-28T02:01:10.968ZINFOdns-server (store): updated generation new_generation = 1 req_id = be45eebe-1435-4efb-8ddd-f923e8b61ed1
222024-11-28T02:01:10.968ZINFOdns-server (http): request completed latency_us = 117 local_addr = [fd00:1122:3344:2::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::b]:62959 req_id = be45eebe-1435-4efb-8ddd-f923e8b61ed1 response_code = 204 uri = /config
232024-11-28T02:01:11.138ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:2::1]:5353 remote_addr = [fd00:1122:3344:101::a]:40529
242024-11-28T02:01:11.234ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = 6c56a03f-4a83-42ed-9114-5b4942bd0713
252024-11-28T02:01:11.234ZINFOdns-server (store): updated generation new_generation = 1 req_id = 6c56a03f-4a83-42ed-9114-5b4942bd0713
262024-11-28T02:01:11.234ZINFOdns-server (http): request completed latency_us = 150 local_addr = [fd00:1122:3344:2::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::a]:40529 req_id = 6c56a03f-4a83-42ed-9114-5b4942bd0713 response_code = 204 uri = /config
272024-11-28T02:02:10.755ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:2::1]:5353 remote_addr = [fd00:1122:3344:101::c]:34302
282024-11-28T02:02:10.842ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:2::1]:5353 remote_addr = [fd00:1122:3344:101::b]:36622
292024-11-28T02:02:10.872ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = 9c121fe2-961a-47b0-8b13-7840414d40aa
302024-11-28T02:02:10.872ZINFOdns-server (store): updated generation new_generation = 1 req_id = 9c121fe2-961a-47b0-8b13-7840414d40aa
312024-11-28T02:02:10.872ZINFOdns-server (http): request completed latency_us = 206 local_addr = [fd00:1122:3344:2::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::c]:34302 req_id = 9c121fe2-961a-47b0-8b13-7840414d40aa response_code = 204 uri = /config
322024-11-28T02:02:10.981ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:2::1]:5353 remote_addr = [fd00:1122:3344:101::a]:55483
332024-11-28T02:02:10.987ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = 15ae0317-3f08-4883-990c-f23dce84cb0a
342024-11-28T02:02:10.987ZINFOdns-server (store): updated generation new_generation = 1 req_id = 15ae0317-3f08-4883-990c-f23dce84cb0a
352024-11-28T02:02:10.987ZINFOdns-server (http): request completed latency_us = 130 local_addr = [fd00:1122:3344:2::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::b]:36622 req_id = 15ae0317-3f08-4883-990c-f23dce84cb0a response_code = 204 uri = /config
362024-11-28T02:02:11.063ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = 17f6d0b6-9213-4f77-abe1-2a8ea11071ed
372024-11-28T02:02:11.063ZINFOdns-server (store): updated generation new_generation = 1 req_id = 17f6d0b6-9213-4f77-abe1-2a8ea11071ed
382024-11-28T02:02:11.063ZINFOdns-server (http): request completed latency_us = 160 local_addr = [fd00:1122:3344:2::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::a]:55483 req_id = 17f6d0b6-9213-4f77-abe1-2a8ea11071ed response_code = 204 uri = /config
392024-11-28T02:03:10.744ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:2::1]:5353 remote_addr = [fd00:1122:3344:101::c]:46784
402024-11-28T02:03:10.866ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 43199, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, query: WireQuery { query: LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, dnssec_ok: false, max_payload: 1232, options: OPT { options: {}, }, }, ), } NXDOMAIN: no records found for name: "_clickhouse-admin-keeper._tcp.control-plane.oxide.internal." peer_addr = [fd00:1122:3344:101::c]:57914 req_id = f8a3cae0-f7d4-45a5-a2fd-5de3f79f8540
412024-11-28T02:03:10.877ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:2::1]:5353 remote_addr = [fd00:1122:3344:101::b]:54430
422024-11-28T02:03:10.901ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 58030, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, query: WireQuery { query: LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, dnssec_ok: false, max_payload: 1232, options: OPT { options: {}, }, }, ), } NXDOMAIN: no records found for name: "_clickhouse-admin-keeper._tcp.control-plane.oxide.internal." peer_addr = [fd00:1122:3344:101::b]:59620 req_id = cec0366b-398c-49e4-ade3-79a230018382
432024-11-28T02:03:10.934ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = 306d4884-8668-4ef8-a0a2-4947055fe8de
442024-11-28T02:03:10.934ZINFOdns-server (store): updated generation new_generation = 1 req_id = 306d4884-8668-4ef8-a0a2-4947055fe8de
452024-11-28T02:03:10.934ZINFOdns-server (http): request completed latency_us = 152 local_addr = [fd00:1122:3344:2::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::b]:54430 req_id = 306d4884-8668-4ef8-a0a2-4947055fe8de response_code = 204 uri = /config
462024-11-28T02:03:10.952ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = 252233df-95da-49b6-bf3f-d1a6daaad9fc
472024-11-28T02:03:10.952ZINFOdns-server (store): updated generation new_generation = 1 req_id = 252233df-95da-49b6-bf3f-d1a6daaad9fc
482024-11-28T02:03:10.952ZINFOdns-server (http): request completed latency_us = 157 local_addr = [fd00:1122:3344:2::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::c]:46784 req_id = 252233df-95da-49b6-bf3f-d1a6daaad9fc response_code = 204 uri = /config
492024-11-28T02:03:11.098ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 35368, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, query: WireQuery { query: LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, dnssec_ok: false, max_payload: 1232, options: OPT { options: {}, }, }, ), } NXDOMAIN: no records found for name: "_clickhouse-admin-keeper._tcp.control-plane.oxide.internal." peer_addr = [fd00:1122:3344:101::a]:54977 req_id = a4ef9abc-1532-452a-8bc0-6c945e89ae1f
502024-11-28T02:03:11.106ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:2::1]:5353 remote_addr = [fd00:1122:3344:101::a]:63658
512024-11-28T02:03:11.311ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = a7cb1aa9-3c9d-4508-8346-a644cd5487d4
522024-11-28T02:03:11.311ZINFOdns-server (store): updated generation new_generation = 1 req_id = a7cb1aa9-3c9d-4508-8346-a644cd5487d4
532024-11-28T02:03:11.311ZINFOdns-server (http): request completed latency_us = 140 local_addr = [fd00:1122:3344:2::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::a]:63658 req_id = a7cb1aa9-3c9d-4508-8346-a644cd5487d4 response_code = 204 uri = /config
542024-11-28T02:04:10.808ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:2::1]:5353 remote_addr = [fd00:1122:3344:101::a]:44401
552024-11-28T02:04:10.847ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = 4118d627-a37a-4cdf-84b9-1c739f75b2b4
562024-11-28T02:04:10.847ZINFOdns-server (store): updated generation new_generation = 1 req_id = 4118d627-a37a-4cdf-84b9-1c739f75b2b4
572024-11-28T02:04:10.847ZINFOdns-server (http): request completed latency_us = 167 local_addr = [fd00:1122:3344:2::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::a]:44401 req_id = 4118d627-a37a-4cdf-84b9-1c739f75b2b4 response_code = 204 uri = /config
582024-11-28T02:04:10.859ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:2::1]:5353 remote_addr = [fd00:1122:3344:101::c]:36778
592024-11-28T02:04:10.904ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = 81fbd217-8e9a-442f-a7b2-f8a915532bb9
602024-11-28T02:04:10.904ZINFOdns-server (store): updated generation new_generation = 1 req_id = 81fbd217-8e9a-442f-a7b2-f8a915532bb9
612024-11-28T02:04:10.904ZINFOdns-server (http): request completed latency_us = 166 local_addr = [fd00:1122:3344:2::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::c]:36778 req_id = 81fbd217-8e9a-442f-a7b2-f8a915532bb9 response_code = 204 uri = /config
622024-11-28T02:04:10.986ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:2::1]:5353 remote_addr = [fd00:1122:3344:101::b]:42587
632024-11-28T02:04:11.089ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = 11400ef4-e141-49be-83d2-3e84c7b4e0bc
642024-11-28T02:04:11.089ZINFOdns-server (store): updated generation new_generation = 1 req_id = 11400ef4-e141-49be-83d2-3e84c7b4e0bc
652024-11-28T02:04:11.089ZINFOdns-server (http): request completed latency_us = 162 local_addr = [fd00:1122:3344:2::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::b]:42587 req_id = 11400ef4-e141-49be-83d2-3e84c7b4e0bc response_code = 204 uri = /config
662024-11-28T02:05:10.707ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:2::1]:5353 remote_addr = [fd00:1122:3344:101::c]:47880
672024-11-28T02:05:10.867ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = 64d293ae-3e57-4675-9e7d-12edebbeb4ef
682024-11-28T02:05:10.867ZINFOdns-server (store): updated generation new_generation = 1 req_id = 64d293ae-3e57-4675-9e7d-12edebbeb4ef
692024-11-28T02:05:10.867ZINFOdns-server (http): request completed latency_us = 141 local_addr = [fd00:1122:3344:2::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::c]:47880 req_id = 64d293ae-3e57-4675-9e7d-12edebbeb4ef response_code = 204 uri = /config
702024-11-28T02:05:10.987ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:2::1]:5353 remote_addr = [fd00:1122:3344:101::b]:45037
712024-11-28T02:05:11.016ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:2::1]:5353 remote_addr = [fd00:1122:3344:101::a]:65332
722024-11-28T02:05:11.129ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = a115fdea-679a-4cd9-84a5-b564c74299a1
732024-11-28T02:05:11.129ZINFOdns-server (store): updated generation new_generation = 1 req_id = a115fdea-679a-4cd9-84a5-b564c74299a1
742024-11-28T02:05:11.129ZINFOdns-server (http): request completed latency_us = 138 local_addr = [fd00:1122:3344:2::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::b]:45037 req_id = a115fdea-679a-4cd9-84a5-b564c74299a1 response_code = 204 uri = /config
752024-11-28T02:05:11.135ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = 8cce4bcd-e8aa-4b47-a594-e219ec8a2ec2
762024-11-28T02:05:11.135ZINFOdns-server (store): updated generation new_generation = 1 req_id = 8cce4bcd-e8aa-4b47-a594-e219ec8a2ec2
772024-11-28T02:05:11.135ZINFOdns-server (http): request completed latency_us = 118 local_addr = [fd00:1122:3344:2::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::a]:65332 req_id = 8cce4bcd-e8aa-4b47-a594-e219ec8a2ec2 response_code = 204 uri = /config