Max level shown:
12025-02-07T10:15:00.985ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 13610, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, query: WireQuery { query: LowerQuery { name: LowerName( Name("oxz_clickhouse_54700d03-7e22-42c8-b50f-2b41b5b4fd7a."), ), original: Query { name: Name("oxz_clickhouse_54700d03-7e22-42c8-b50f-2b41b5b4fd7a."), query_type: A, query_class: IN, }, }, original: [ 51, 111, 120, 122, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 95, 53, 52, 55, 48, 48, 100, 48, 51, 45, 55, 101, 50, 50, 45, 52, 50, 99, 56, 45, 98, 53, 48, 102, 45, 50, 98, 52, 49, 98, 53, 98, 52, 102, 100, 55, 97, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_clickhouse_54700d03-7e22-42c8-b50f-2b41b5b4fd7a." peer_addr = [fd00:1122:3344:101::e]:33588 req_id = fc42e605-5324-4443-843a-d92a72cec1ca
22025-02-07T10:15:00.986ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 13610, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, query: WireQuery { query: LowerQuery { name: LowerName( Name("oxz_clickhouse_54700d03-7e22-42c8-b50f-2b41b5b4fd7a."), ), original: Query { name: Name("oxz_clickhouse_54700d03-7e22-42c8-b50f-2b41b5b4fd7a."), query_type: A, query_class: IN, }, }, original: [ 51, 111, 120, 122, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 95, 53, 52, 55, 48, 48, 100, 48, 51, 45, 55, 101, 50, 50, 45, 52, 50, 99, 56, 45, 98, 53, 48, 102, 45, 50, 98, 52, 49, 98, 53, 98, 52, 102, 100, 55, 97, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_clickhouse_54700d03-7e22-42c8-b50f-2b41b5b4fd7a." peer_addr = [fd00:1122:3344:101::e]:63449 req_id = ace42eb9-9832-4492-82b0-a58ee467c089
32025-02-07T10:15:16.844ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:3::1]:5353 remote_addr = [fd00:1122:3344:101::c]:58952
42025-02-07T10:15:16.844ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = 81a2ef50-294d-4c9e-be37-21d48965b48c
52025-02-07T10:15:16.844ZINFOdns-server (store): updated generation new_generation = 1 req_id = 81a2ef50-294d-4c9e-be37-21d48965b48c
62025-02-07T10:15:16.844ZINFOdns-server (http): request completed latency_us = 152 local_addr = [fd00:1122:3344:3::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::c]:58952 req_id = 81a2ef50-294d-4c9e-be37-21d48965b48c response_code = 204 uri = /config
72025-02-07T10:15:16.954ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:3::1]:5353 remote_addr = [fd00:1122:3344:101::a]:55161
82025-02-07T10:15:16.954ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = fe66f9cc-2bea-45ee-97c0-ae485a54c68d
92025-02-07T10:15:16.954ZINFOdns-server (store): updated generation new_generation = 1 req_id = fe66f9cc-2bea-45ee-97c0-ae485a54c68d
102025-02-07T10:15:16.954ZINFOdns-server (http): request completed latency_us = 163 local_addr = [fd00:1122:3344:3::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::a]:55161 req_id = fe66f9cc-2bea-45ee-97c0-ae485a54c68d response_code = 204 uri = /config
112025-02-07T10:15:17.228ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:3::1]:5353 remote_addr = [fd00:1122:3344:101::b]:50388
122025-02-07T10:15:17.228ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = 6d73ae75-b514-4b9b-bc44-87347eff2a0c
132025-02-07T10:15:17.228ZINFOdns-server (store): updated generation new_generation = 1 req_id = 6d73ae75-b514-4b9b-bc44-87347eff2a0c
142025-02-07T10:15:17.228ZINFOdns-server (http): request completed latency_us = 150 local_addr = [fd00:1122:3344:3::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::b]:50388 req_id = 6d73ae75-b514-4b9b-bc44-87347eff2a0c response_code = 204 uri = /config
152025-02-07T10:16:16.841ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 42612, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, query: WireQuery { query: LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, dnssec_ok: false, max_payload: 1232, options: OPT { options: {}, }, }, ), } NXDOMAIN: no records found for name: "_clickhouse-admin-keeper._tcp.control-plane.oxide.internal." peer_addr = [fd00:1122:3344:101::c]:64925 req_id = 57926c1a-54f7-42f1-bffd-10e4af53af20
162025-02-07T10:16:16.858ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:3::1]:5353 remote_addr = [fd00:1122:3344:101::c]:38449
172025-02-07T10:16:16.858ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = c24b86f8-f45b-40c5-88cd-3b4f21270328
182025-02-07T10:16:16.858ZINFOdns-server (store): updated generation new_generation = 1 req_id = c24b86f8-f45b-40c5-88cd-3b4f21270328
192025-02-07T10:16:16.858ZINFOdns-server (http): request completed latency_us = 171 local_addr = [fd00:1122:3344:3::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::c]:38449 req_id = c24b86f8-f45b-40c5-88cd-3b4f21270328 response_code = 204 uri = /config
202025-02-07T10:16:16.932ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 31526, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, query: WireQuery { query: LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, dnssec_ok: false, max_payload: 1232, options: OPT { options: {}, }, }, ), } NXDOMAIN: no records found for name: "_clickhouse-admin-keeper._tcp.control-plane.oxide.internal." peer_addr = [fd00:1122:3344:101::b]:49480 req_id = 49096f61-c463-4342-b6ea-0b5b341207f4
212025-02-07T10:16:17.030ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 29233, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, query: WireQuery { query: LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, dnssec_ok: false, max_payload: 1232, options: OPT { options: {}, }, }, ), } NXDOMAIN: no records found for name: "_clickhouse-admin-keeper._tcp.control-plane.oxide.internal." peer_addr = [fd00:1122:3344:101::a]:50589 req_id = 77aa8ff2-84cd-4bbc-9dd0-674a2222d6d5
222025-02-07T10:16:17.054ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:3::1]:5353 remote_addr = [fd00:1122:3344:101::a]:47014
232025-02-07T10:16:17.054ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = ea1613b4-d912-43b7-8902-42bb1ea80cfd
242025-02-07T10:16:17.054ZINFOdns-server (store): updated generation new_generation = 1 req_id = ea1613b4-d912-43b7-8902-42bb1ea80cfd
252025-02-07T10:16:17.054ZINFOdns-server (http): request completed latency_us = 161 local_addr = [fd00:1122:3344:3::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::a]:47014 req_id = ea1613b4-d912-43b7-8902-42bb1ea80cfd response_code = 204 uri = /config
262025-02-07T10:16:17.142ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:3::1]:5353 remote_addr = [fd00:1122:3344:101::b]:59499
272025-02-07T10:16:17.142ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = 2966825b-36ed-4d54-ac43-e964b5b89550
282025-02-07T10:16:17.142ZINFOdns-server (store): updated generation new_generation = 1 req_id = 2966825b-36ed-4d54-ac43-e964b5b89550
292025-02-07T10:16:17.142ZINFOdns-server (http): request completed latency_us = 130 local_addr = [fd00:1122:3344:3::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::b]:59499 req_id = 2966825b-36ed-4d54-ac43-e964b5b89550 response_code = 204 uri = /config
302025-02-07T10:17:16.866ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:3::1]:5353 remote_addr = [fd00:1122:3344:101::c]:47261
312025-02-07T10:17:16.867ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = 221ab317-cdee-4017-9d92-8492a498d325
322025-02-07T10:17:16.867ZINFOdns-server (store): updated generation new_generation = 1 req_id = 221ab317-cdee-4017-9d92-8492a498d325
332025-02-07T10:17:16.867ZINFOdns-server (http): request completed latency_us = 135 local_addr = [fd00:1122:3344:3::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::c]:47261 req_id = 221ab317-cdee-4017-9d92-8492a498d325 response_code = 204 uri = /config
342025-02-07T10:17:16.917ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:3::1]:5353 remote_addr = [fd00:1122:3344:101::a]:40672
352025-02-07T10:17:16.917ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = b1663cc6-5580-4b38-bae2-7c694db0c827
362025-02-07T10:17:16.917ZINFOdns-server (store): updated generation new_generation = 1 req_id = b1663cc6-5580-4b38-bae2-7c694db0c827
372025-02-07T10:17:16.917ZINFOdns-server (http): request completed latency_us = 119 local_addr = [fd00:1122:3344:3::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::a]:40672 req_id = b1663cc6-5580-4b38-bae2-7c694db0c827 response_code = 204 uri = /config
382025-02-07T10:17:17.341ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:3::1]:5353 remote_addr = [fd00:1122:3344:101::b]:40690
392025-02-07T10:17:17.341ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = b058ac1e-5206-4a0d-ab36-e797bd922489
402025-02-07T10:17:17.341ZINFOdns-server (store): updated generation new_generation = 1 req_id = b058ac1e-5206-4a0d-ab36-e797bd922489
412025-02-07T10:17:17.341ZINFOdns-server (http): request completed latency_us = 136 local_addr = [fd00:1122:3344:3::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::b]:40690 req_id = b058ac1e-5206-4a0d-ab36-e797bd922489 response_code = 204 uri = /config
422025-02-07T10:18:16.824ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:3::1]:5353 remote_addr = [fd00:1122:3344:101::c]:45432
432025-02-07T10:18:16.824ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = 4ff958ac-7dbc-4498-9710-d2eb499a1acd
442025-02-07T10:18:16.824ZINFOdns-server (store): updated generation new_generation = 1 req_id = 4ff958ac-7dbc-4498-9710-d2eb499a1acd
452025-02-07T10:18:16.824ZINFOdns-server (http): request completed latency_us = 190 local_addr = [fd00:1122:3344:3::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::c]:45432 req_id = 4ff958ac-7dbc-4498-9710-d2eb499a1acd response_code = 204 uri = /config
462025-02-07T10:18:16.949ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:3::1]:5353 remote_addr = [fd00:1122:3344:101::a]:52683
472025-02-07T10:18:16.950ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = f4345b6f-057d-46dd-b219-3e5ed72debf9
482025-02-07T10:18:16.950ZINFOdns-server (store): updated generation new_generation = 1 req_id = f4345b6f-057d-46dd-b219-3e5ed72debf9
492025-02-07T10:18:16.950ZINFOdns-server (http): request completed latency_us = 166 local_addr = [fd00:1122:3344:3::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::a]:52683 req_id = f4345b6f-057d-46dd-b219-3e5ed72debf9 response_code = 204 uri = /config
502025-02-07T10:18:17.173ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:3::1]:5353 remote_addr = [fd00:1122:3344:101::b]:38831
512025-02-07T10:18:17.173ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = 673def28-0ee7-4f7e-9b01-a0e12031fb3f
522025-02-07T10:18:17.173ZINFOdns-server (store): updated generation new_generation = 1 req_id = 673def28-0ee7-4f7e-9b01-a0e12031fb3f
532025-02-07T10:18:17.173ZINFOdns-server (http): request completed latency_us = 144 local_addr = [fd00:1122:3344:3::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::b]:38831 req_id = 673def28-0ee7-4f7e-9b01-a0e12031fb3f response_code = 204 uri = /config