Max level shown:
12024-12-21T01:45:00.892ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 24087, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, query: WireQuery { query: LowerQuery { name: LowerName( Name("oxz_cockroachdb_fbebab72-2d7c-4860-ac0a-3f84d25966ec."), ), original: Query { name: Name("oxz_cockroachdb_fbebab72-2d7c-4860-ac0a-3f84d25966ec."), query_type: A, query_class: IN, }, }, original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 102, 98, 101, 98, 97, 98, 55, 50, 45, 50, 100, 55, 99, 45, 52, 56, 54, 48, 45, 97, 99, 48, 97, 45, 51, 102, 56, 52, 100, 50, 53, 57, 54, 54, 101, 99, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_fbebab72-2d7c-4860-ac0a-3f84d25966ec." peer_addr = [fd00:1122:3344:101::5]:64950 req_id = 4a838d13-51f3-4c32-9c8c-4cf4a447fe09
22024-12-21T01:45:00.892ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 24087, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, query: WireQuery { query: LowerQuery { name: LowerName( Name("oxz_cockroachdb_fbebab72-2d7c-4860-ac0a-3f84d25966ec."), ), original: Query { name: Name("oxz_cockroachdb_fbebab72-2d7c-4860-ac0a-3f84d25966ec."), query_type: A, query_class: IN, }, }, original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 102, 98, 101, 98, 97, 98, 55, 50, 45, 50, 100, 55, 99, 45, 52, 56, 54, 48, 45, 97, 99, 48, 97, 45, 51, 102, 56, 52, 100, 50, 53, 57, 54, 54, 101, 99, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_fbebab72-2d7c-4860-ac0a-3f84d25966ec." peer_addr = [fd00:1122:3344:101::5]:61708 req_id = a1fceccd-b05a-4f6d-91fd-fb3fdf3fabc9
32024-12-21T01:45:38.523ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:2::1]:5353 remote_addr = [fd00:1122:3344:101::c]:46396
42024-12-21T01:45:38.587ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:2::1]:5353 remote_addr = [fd00:1122:3344:101::b]:46852
52024-12-21T01:45:38.801ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = 10e11661-a67c-4602-a47e-2c59d1c70cd8
62024-12-21T01:45:38.801ZINFOdns-server (store): updated generation new_generation = 1 req_id = 10e11661-a67c-4602-a47e-2c59d1c70cd8
72024-12-21T01:45:38.801ZINFOdns-server (http): request completed latency_us = 151 local_addr = [fd00:1122:3344:2::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::c]:46396 req_id = 10e11661-a67c-4602-a47e-2c59d1c70cd8 response_code = 204 uri = /config
82024-12-21T01:45:38.963ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:2::1]:5353 remote_addr = [fd00:1122:3344:101::a]:40410
92024-12-21T01:45:38.970ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = 20238f68-414c-4e6b-a6ce-45fb417126b0
102024-12-21T01:45:38.970ZINFOdns-server (store): updated generation new_generation = 1 req_id = 20238f68-414c-4e6b-a6ce-45fb417126b0
112024-12-21T01:45:38.970ZINFOdns-server (http): request completed latency_us = 227 local_addr = [fd00:1122:3344:2::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::b]:46852 req_id = 20238f68-414c-4e6b-a6ce-45fb417126b0 response_code = 204 uri = /config
122024-12-21T01:45:39.256ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = 1bab7fb2-77c5-4453-9b39-743e5d0f181c
132024-12-21T01:45:39.256ZINFOdns-server (store): updated generation new_generation = 1 req_id = 1bab7fb2-77c5-4453-9b39-743e5d0f181c
142024-12-21T01:45:39.256ZINFOdns-server (http): request completed latency_us = 144 local_addr = [fd00:1122:3344:2::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::a]:40410 req_id = 1bab7fb2-77c5-4453-9b39-743e5d0f181c response_code = 204 uri = /config
152024-12-21T01:46:38.484ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:2::1]:5353 remote_addr = [fd00:1122:3344:101::c]:37044
162024-12-21T01:46:38.590ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:2::1]:5353 remote_addr = [fd00:1122:3344:101::b]:63933
172024-12-21T01:46:38.740ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = 6f77f59a-f6be-4714-99bf-fe8d9fde0618
182024-12-21T01:46:38.740ZINFOdns-server (store): updated generation new_generation = 1 req_id = 6f77f59a-f6be-4714-99bf-fe8d9fde0618
192024-12-21T01:46:38.740ZINFOdns-server (http): request completed latency_us = 162 local_addr = [fd00:1122:3344:2::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::c]:37044 req_id = 6f77f59a-f6be-4714-99bf-fe8d9fde0618 response_code = 204 uri = /config
202024-12-21T01:46:38.965ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = ddf4fc60-08d5-47f0-abc0-67b02ccb3d82
212024-12-21T01:46:38.965ZINFOdns-server (store): updated generation new_generation = 1 req_id = ddf4fc60-08d5-47f0-abc0-67b02ccb3d82
222024-12-21T01:46:38.965ZINFOdns-server (http): request completed latency_us = 198 local_addr = [fd00:1122:3344:2::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::b]:63933 req_id = ddf4fc60-08d5-47f0-abc0-67b02ccb3d82 response_code = 204 uri = /config
232024-12-21T01:46:39.065ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:2::1]:5353 remote_addr = [fd00:1122:3344:101::a]:47181
242024-12-21T01:46:39.268ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = 0a93c1fe-034d-483b-9c97-e64895c18a17
252024-12-21T01:46:39.268ZINFOdns-server (store): updated generation new_generation = 1 req_id = 0a93c1fe-034d-483b-9c97-e64895c18a17
262024-12-21T01:46:39.268ZINFOdns-server (http): request completed latency_us = 164 local_addr = [fd00:1122:3344:2::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::a]:47181 req_id = 0a93c1fe-034d-483b-9c97-e64895c18a17 response_code = 204 uri = /config
272024-12-21T01:47:38.538ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:2::1]:5353 remote_addr = [fd00:1122:3344:101::b]:59138
282024-12-21T01:47:38.574ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:2::1]:5353 remote_addr = [fd00:1122:3344:101::c]:64090
292024-12-21T01:47:38.855ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = fe7cf302-d8b0-4657-911d-aae5d01a7a25
302024-12-21T01:47:38.855ZINFOdns-server (store): updated generation new_generation = 1 req_id = fe7cf302-d8b0-4657-911d-aae5d01a7a25
312024-12-21T01:47:38.855ZINFOdns-server (http): request completed latency_us = 254 local_addr = [fd00:1122:3344:2::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::c]:64090 req_id = fe7cf302-d8b0-4657-911d-aae5d01a7a25 response_code = 204 uri = /config
322024-12-21T01:47:38.925ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:2::1]:5353 remote_addr = [fd00:1122:3344:101::a]:50656
332024-12-21T01:47:38.969ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = a99cf830-73a7-4908-8ef3-644b86a719ec
342024-12-21T01:47:38.970ZINFOdns-server (store): updated generation new_generation = 1 req_id = a99cf830-73a7-4908-8ef3-644b86a719ec
352024-12-21T01:47:38.970ZINFOdns-server (http): request completed latency_us = 145 local_addr = [fd00:1122:3344:2::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::b]:59138 req_id = a99cf830-73a7-4908-8ef3-644b86a719ec response_code = 204 uri = /config
362024-12-21T01:47:39.304ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = 4348109a-cd64-4e09-8abb-7c4cafc69366
372024-12-21T01:47:39.304ZINFOdns-server (store): updated generation new_generation = 1 req_id = 4348109a-cd64-4e09-8abb-7c4cafc69366
382024-12-21T01:47:39.304ZINFOdns-server (http): request completed latency_us = 160 local_addr = [fd00:1122:3344:2::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::a]:50656 req_id = 4348109a-cd64-4e09-8abb-7c4cafc69366 response_code = 204 uri = /config
392024-12-21T01:48:38.521ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:2::1]:5353 remote_addr = [fd00:1122:3344:101::c]:56917
402024-12-21T01:48:38.638ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:2::1]:5353 remote_addr = [fd00:1122:3344:101::b]:49813
412024-12-21T01:48:38.745ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 41273, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, query: WireQuery { query: LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, dnssec_ok: false, max_payload: 1232, options: OPT { options: {}, }, }, ), } NXDOMAIN: no records found for name: "_clickhouse-admin-keeper._tcp.control-plane.oxide.internal." peer_addr = [fd00:1122:3344:101::b]:51926 req_id = 0e9a2784-e4e4-4b01-9b84-43cff4a25a45
422024-12-21T01:48:38.759ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 9850, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, query: WireQuery { query: LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, dnssec_ok: false, max_payload: 1232, options: OPT { options: {}, }, }, ), } NXDOMAIN: no records found for name: "_clickhouse-admin-keeper._tcp.control-plane.oxide.internal." peer_addr = [fd00:1122:3344:101::c]:65408 req_id = d32fe89b-5c2d-44ea-9845-c65c5ade5944
432024-12-21T01:48:38.840ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = 0174d1b8-4d73-486d-a856-a2519e29b323
442024-12-21T01:48:38.840ZINFOdns-server (store): updated generation new_generation = 1 req_id = 0174d1b8-4d73-486d-a856-a2519e29b323
452024-12-21T01:48:38.841ZINFOdns-server (http): request completed latency_us = 218 local_addr = [fd00:1122:3344:2::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::c]:56917 req_id = 0174d1b8-4d73-486d-a856-a2519e29b323 response_code = 204 uri = /config
462024-12-21T01:48:38.918ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = e7c725d4-2f8e-4c0f-a203-20ca9ffc1658
472024-12-21T01:48:38.918ZINFOdns-server (store): updated generation new_generation = 1 req_id = e7c725d4-2f8e-4c0f-a203-20ca9ffc1658
482024-12-21T01:48:38.918ZINFOdns-server (http): request completed latency_us = 155 local_addr = [fd00:1122:3344:2::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::b]:49813 req_id = e7c725d4-2f8e-4c0f-a203-20ca9ffc1658 response_code = 204 uri = /config
492024-12-21T01:48:38.981ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:2::1]:5353 remote_addr = [fd00:1122:3344:101::a]:35771
502024-12-21T01:48:39.158ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 54376, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, query: WireQuery { query: LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, dnssec_ok: false, max_payload: 1232, options: OPT { options: {}, }, }, ), } NXDOMAIN: no records found for name: "_clickhouse-admin-keeper._tcp.control-plane.oxide.internal." peer_addr = [fd00:1122:3344:101::a]:52706 req_id = e3edd6ba-7472-4236-bac4-5947fb4b29c8
512024-12-21T01:48:39.377ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = 73f953ef-7820-4a32-9cb9-50ba19a7e1c6
522024-12-21T01:48:39.377ZINFOdns-server (store): updated generation new_generation = 1 req_id = 73f953ef-7820-4a32-9cb9-50ba19a7e1c6
532024-12-21T01:48:39.377ZINFOdns-server (http): request completed latency_us = 141 local_addr = [fd00:1122:3344:2::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::a]:35771 req_id = 73f953ef-7820-4a32-9cb9-50ba19a7e1c6 response_code = 204 uri = /config
542024-12-21T01:49:38.554ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:2::1]:5353 remote_addr = [fd00:1122:3344:101::c]:37320
552024-12-21T01:49:38.622ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:2::1]:5353 remote_addr = [fd00:1122:3344:101::b]:62810
562024-12-21T01:49:38.864ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = 176c8b7e-7be2-4296-a97d-224c8e8a8eff
572024-12-21T01:49:38.864ZINFOdns-server (store): updated generation new_generation = 1 req_id = 176c8b7e-7be2-4296-a97d-224c8e8a8eff
582024-12-21T01:49:38.864ZINFOdns-server (http): request completed latency_us = 165 local_addr = [fd00:1122:3344:2::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::b]:62810 req_id = 176c8b7e-7be2-4296-a97d-224c8e8a8eff response_code = 204 uri = /config
592024-12-21T01:49:38.921ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = 605f25d7-12e5-4be3-990a-28e9c9116c2d
602024-12-21T01:49:38.921ZINFOdns-server (store): updated generation new_generation = 1 req_id = 605f25d7-12e5-4be3-990a-28e9c9116c2d
612024-12-21T01:49:38.921ZINFOdns-server (http): request completed latency_us = 146 local_addr = [fd00:1122:3344:2::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::c]:37320 req_id = 605f25d7-12e5-4be3-990a-28e9c9116c2d response_code = 204 uri = /config
622024-12-21T01:49:38.954ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:2::1]:5353 remote_addr = [fd00:1122:3344:101::a]:57112
632024-12-21T01:49:39.339ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = c7b4296e-2677-4b31-b499-529d6a33dfcd
642024-12-21T01:49:39.339ZINFOdns-server (store): updated generation new_generation = 1 req_id = c7b4296e-2677-4b31-b499-529d6a33dfcd
652024-12-21T01:49:39.339ZINFOdns-server (http): request completed latency_us = 147 local_addr = [fd00:1122:3344:2::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::a]:57112 req_id = c7b4296e-2677-4b31-b499-529d6a33dfcd response_code = 204 uri = /config
662024-12-21T01:50:38.529ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:2::1]:5353 remote_addr = [fd00:1122:3344:101::c]:36874
672024-12-21T01:50:38.617ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:2::1]:5353 remote_addr = [fd00:1122:3344:101::b]:65438
682024-12-21T01:50:38.789ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = af5c5c7a-b158-44ee-a26f-185830e8d162
692024-12-21T01:50:38.789ZINFOdns-server (store): updated generation new_generation = 1 req_id = af5c5c7a-b158-44ee-a26f-185830e8d162
702024-12-21T01:50:38.789ZINFOdns-server (http): request completed latency_us = 157 local_addr = [fd00:1122:3344:2::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::c]:36874 req_id = af5c5c7a-b158-44ee-a26f-185830e8d162 response_code = 204 uri = /config
712024-12-21T01:50:38.938ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:2::1]:5353 remote_addr = [fd00:1122:3344:101::a]:38013
722024-12-21T01:50:39.129ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = 83997adb-0de7-40d5-9791-87c20c17cd39
732024-12-21T01:50:39.129ZINFOdns-server (store): updated generation new_generation = 1 req_id = 83997adb-0de7-40d5-9791-87c20c17cd39
742024-12-21T01:50:39.129ZINFOdns-server (http): request completed latency_us = 182 local_addr = [fd00:1122:3344:2::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::b]:65438 req_id = 83997adb-0de7-40d5-9791-87c20c17cd39 response_code = 204 uri = /config
752024-12-21T01:50:39.271ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = 5f3af088-689e-444e-8f53-d5f1a0a6a808
762024-12-21T01:50:39.271ZINFOdns-server (store): updated generation new_generation = 1 req_id = 5f3af088-689e-444e-8f53-d5f1a0a6a808
772024-12-21T01:50:39.271ZINFOdns-server (http): request completed latency_us = 139 local_addr = [fd00:1122:3344:2::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::a]:38013 req_id = 5f3af088-689e-444e-8f53-d5f1a0a6a808 response_code = 204 uri = /config