Max level shown:
1 [ Jul 22 05:11:57 Enabled. ]
2 [ Jul 22 05:11:57 Rereading configuration. ]
3 [ Jul 22 05:11:58 Rereading configuration. ]
4 [ Jul 22 05:11:59 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/dns-server/bin/dns-server --config-file /var/svc/manifest/site/internal_dns/config.toml --http-address [fd00:1122:3344:2::1]:5353 --dns-address [fd00:1122:3344:2::1]:53 &"). ]
5 [ Jul 22 05:11:59 Method "start" exited with status 0. ]
6 Config { log: File { level: Info, path: "/dev/stdout", if_exists: Append }, dropshot: ConfigDropshot { bind_address: [fd00:1122:3344:2::1]:5353, default_request_body_max_bytes: 104857600, default_handler_task_mode: Detached, log_headers: [], compression: None }, storage: Config { storage_path: "/data/dns", keep_old_generations: 3 } }
7 note: configured to log to "/dev/stdout"
82026-07-22T05:11:59.519ZINFOdns-server: config config = Config { log: File { level: Info, path: "/dev/stdout", if_exists: Append }, dropshot: ConfigDropshot { bind_address: [fd00:1122:3344:2::1]:5353, default_request_body_max_bytes: 104857600, default_handler_task_mode: Detached, log_headers: [], compression: None }, storage: Config { storage_path: "/data/dns", keep_old_generations: 3 } } dns_config = Config { bind_address: [fd00:1122:3344:2::1]:53 }
92026-07-22T05:11:59.519ZINFOdns-server (store): opening sled database path = /data/dns
102026-07-22T05:11:59.542ZINFOdns-server (store): pruning trees for generations newer than 0
112026-07-22T05:11:59.542ZINFOdns-server (store): pruning trees for generations older than 0 keep = 3
122026-07-22T05:11:59.542ZINFOdns-server (dns): DNS server bound to address local_address = [fd00:1122:3344:2::1]:53
132026-07-22T05:11:59.543ZINFOdns-server (http): listening local_addr = [fd00:1122:3344:2::1]:5353
142026-07-22T05:12:01.408ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:2::1]:5353 remote_addr = [fd00:1122:3344:2::2]:36500
152026-07-22T05:12:01.409ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = 43c9ded7-7486-4675-a8ef-6c5d3803f91a
162026-07-22T05:12:01.409ZINFOdns-server (store): pruning trees for generations newer than 0
172026-07-22T05:12:01.421ZINFOdns-server (store): pruning trees for generations older than 1 keep = 3
182026-07-22T05:12:01.421ZINFOdns-server (store): updated generation new_generation = 1 req_id = 43c9ded7-7486-4675-a8ef-6c5d3803f91a
192026-07-22T05:12:01.421ZINFOdns-server (http): request completed latency_us = 12727 local_addr = [fd00:1122:3344:2::1]:5353 method = PUT remote_addr = [fd00:1122:3344:2::2]:36500 req_id = 43c9ded7-7486-4675-a8ef-6c5d3803f91a response_code = 204 uri = /config
202026-07-22T05:12:16.216ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 28729, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("0.pool.ntp.org."), ), original: Query { name: Name("0.pool.ntp.org."), query_type: AAAA, query_class: IN, }, }, ], original: [ 1, 48, 4, 112, 111, 111, 108, 3, 110, 116, 112, 3, 111, 114, 103, 0, 0, 28, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "0.pool.ntp.org." peer_addr = [fd00:1122:3344:101::1b]:37337 req_id = 4d34bd09-9e40-434b-89ca-442cb3e8f57f
212026-07-22T05:12:16.221ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 56188, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("0.pool.ntp.org."), ), original: Query { name: Name("0.pool.ntp.org."), query_type: AAAA, query_class: IN, }, }, ], original: [ 1, 48, 4, 112, 111, 111, 108, 3, 110, 116, 112, 3, 111, 114, 103, 0, 0, 28, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "0.pool.ntp.org." peer_addr = [fd00:1122:3344:101::1b]:49868 req_id = e4f3d005-8981-46ba-bea1-368a9714efe1
222026-07-22T05:12:16.225ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 39204, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("0.pool.ntp.org."), ), original: Query { name: Name("0.pool.ntp.org."), query_type: A, query_class: IN, }, }, ], original: [ 1, 48, 4, 112, 111, 111, 108, 3, 110, 116, 112, 3, 111, 114, 103, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "0.pool.ntp.org." peer_addr = [fd00:1122:3344:101::1b]:63931 req_id = 11663902-958f-474f-9596-18f7e5149c61
232026-07-22T05:13:14.692ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 22070, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::d]:59860 req_id = c8d96910-916e-4283-82ba-e1f4fc6e5d0d
242026-07-22T05:13:19.017ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 59242, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_clickhouse_4a7586df-847e-4e68-b342-0f6dd259d43b."), ), original: Query { name: Name("oxz_clickhouse_4a7586df-847e-4e68-b342-0f6dd259d43b."), query_type: A, query_class: IN, }, }, ], original: [ 51, 111, 120, 122, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 95, 52, 97, 55, 53, 56, 54, 100, 102, 45, 56, 52, 55, 101, 45, 52, 101, 54, 56, 45, 98, 51, 52, 50, 45, 48, 102, 54, 100, 100, 50, 53, 57, 100, 52, 51, 98, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_clickhouse_4a7586df-847e-4e68-b342-0f6dd259d43b." peer_addr = [fd00:1122:3344:101::e]:36965 req_id = d64bd6da-bde0-4fa3-aa7c-b322327ffac9
252026-07-22T05:13:19.023ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 59242, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_clickhouse_4a7586df-847e-4e68-b342-0f6dd259d43b."), ), original: Query { name: Name("oxz_clickhouse_4a7586df-847e-4e68-b342-0f6dd259d43b."), query_type: A, query_class: IN, }, }, ], original: [ 51, 111, 120, 122, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 95, 52, 97, 55, 53, 56, 54, 100, 102, 45, 56, 52, 55, 101, 45, 52, 101, 54, 56, 45, 98, 51, 52, 50, 45, 48, 102, 54, 100, 100, 50, 53, 57, 100, 52, 51, 98, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_clickhouse_4a7586df-847e-4e68-b342-0f6dd259d43b." peer_addr = [fd00:1122:3344:101::e]:56479 req_id = d4c69a13-211b-4e39-8558-6d62be7cd442
262026-07-22T05:13:24.677ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 45718, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::d]:55943 req_id = 31c9756e-647d-41a3-b1d7-7976abe011f0
272026-07-22T05:13:26.083ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 53844, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::c]:24234 req_id = 537cd4ca-8e88-4703-96ab-f60466fb0356
282026-07-22T05:13:27.380ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 63762, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::a]:16002 req_id = 817cbd20-bd0e-4208-9143-ae57f8b74cf6
292026-07-22T05:13:27.439ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 4293, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::b]:8165 req_id = b6ed6a53-b17c-44d9-b1dc-c430b84d6036
302026-07-22T05:13:28.052ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:2::1]:5353 remote_addr = [fd00:1122:3344:101::c]:60508
312026-07-22T05:13:28.057ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:2::1]:5353 remote_addr = [fd00:1122:3344:101::b]:51594
322026-07-22T05:13:28.057ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:2::1]:5353 remote_addr = [fd00:1122:3344:101::a]:41891
332026-07-22T05:13:28.110ZINFOdns-server (http): request completed latency_us = 32878 local_addr = [fd00:1122:3344:2::1]:5353 method = GET remote_addr = [fd00:1122:3344:101::a]:41891 req_id = 901b740b-f3aa-4da9-9caf-c532265a0371 response_code = 200 uri = /config
342026-07-22T05:13:28.110ZINFOdns-server (http): request completed latency_us = 32879 local_addr = [fd00:1122:3344:2::1]:5353 method = GET remote_addr = [fd00:1122:3344:101::c]:60508 req_id = 5e34f42f-4900-4369-86bd-efe607219f99 response_code = 200 uri = /config
352026-07-22T05:13:28.110ZINFOdns-server (http): request completed latency_us = 32945 local_addr = [fd00:1122:3344:2::1]:5353 method = GET remote_addr = [fd00:1122:3344:101::b]:51594 req_id = aaee9f9d-07dd-4c77-bbcf-1cec9c5a2655 response_code = 200 uri = /config
362026-07-22T05:13:28.987ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:2::1]:5353 remote_addr = [fd00:1122:3344:101::c]:50699
372026-07-22T05:13:29.000ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = 1ede274e-cc95-45fe-9b87-fb0c8f78b7c2
382026-07-22T05:13:29.000ZINFOdns-server (store): updated generation new_generation = 1 req_id = 1ede274e-cc95-45fe-9b87-fb0c8f78b7c2
392026-07-22T05:13:29.000ZINFOdns-server (http): request completed latency_us = 11803 local_addr = [fd00:1122:3344:2::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::c]:50699 req_id = 1ede274e-cc95-45fe-9b87-fb0c8f78b7c2 response_code = 204 uri = /config
402026-07-22T05:13:29.188ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 9782, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::a]:27138 req_id = cb1a3202-8fb9-4b1a-a3fd-438dcc3b2995
412026-07-22T05:13:29.192ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 11266, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::c]:17222 req_id = 7ba58a99-4b77-4165-b0e3-207e63b3e8af
422026-07-22T05:13:29.320ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:2::1]:5353 remote_addr = [fd00:1122:3344:101::a]:65059
432026-07-22T05:13:29.321ZINFOdns-server (http): request completed latency_us = 240 local_addr = [fd00:1122:3344:2::1]:5353 method = GET remote_addr = [fd00:1122:3344:101::a]:65059 req_id = 360f1815-cbaf-485f-8b05-78857dfd92fe response_code = 200 uri = /config
442026-07-22T05:13:29.473ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:2::1]:5353 remote_addr = [fd00:1122:3344:101::c]:58360
452026-07-22T05:13:29.473ZINFOdns-server (http): request completed latency_us = 250 local_addr = [fd00:1122:3344:2::1]:5353 method = GET remote_addr = [fd00:1122:3344:101::c]:58360 req_id = b85dd71d-3be8-40cc-b288-7567c8f6695f response_code = 200 uri = /config
462026-07-22T05:13:30.526ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 4472, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::c]:21117 req_id = 5311ab85-9009-43e4-903f-2ca051ddf643
472026-07-22T05:13:30.741ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:2::1]:5353 remote_addr = [fd00:1122:3344:101::c]:37898
482026-07-22T05:13:30.742ZINFOdns-server (http): request completed latency_us = 176 local_addr = [fd00:1122:3344:2::1]:5353 method = GET remote_addr = [fd00:1122:3344:101::c]:37898 req_id = 75bd97fa-0a82-464e-9660-815da5ddbd09 response_code = 200 uri = /config
492026-07-22T05:13:34.679ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 10134, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::d]:58950 req_id = 5cdda8f8-e859-405a-9c4d-770898cb742e
502026-07-22T05:13:38.083ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 41496, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::a]:51952 req_id = 287f682c-2874-4557-b6aa-ecc5c2eb5d29
512026-07-22T05:13:38.083ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 41147, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::b]:18902 req_id = 225d11cb-7e03-48e9-b4e4-f31958fd8bd6
522026-07-22T05:13:38.207ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:2::1]:5353 remote_addr = [fd00:1122:3344:101::a]:44959
532026-07-22T05:13:38.207ZINFOdns-server (http): request completed latency_us = 173 local_addr = [fd00:1122:3344:2::1]:5353 method = GET remote_addr = [fd00:1122:3344:101::a]:44959 req_id = d7cc4a0b-98e9-437a-9cf1-d42da1d208b4 response_code = 200 uri = /config
542026-07-22T05:13:38.307ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:2::1]:5353 remote_addr = [fd00:1122:3344:101::b]:56701
552026-07-22T05:13:38.308ZINFOdns-server (http): request completed latency_us = 184 local_addr = [fd00:1122:3344:2::1]:5353 method = GET remote_addr = [fd00:1122:3344:101::b]:56701 req_id = d4d4a92f-5c61-41b7-8f4d-b2dbb7d86db0 response_code = 200 uri = /config
562026-07-22T05:13:44.681ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 15412, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::d]:59235 req_id = cfeb9e55-87c4-432e-8c03-474ac5143685
572026-07-22T05:13:54.683ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 24977, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::d]:62135 req_id = 0d28e768-2d96-4187-9b27-6e99a75b3c98
582026-07-22T05:14:04.685ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 19617, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::d]:54025 req_id = 7916f144-313c-4c8c-a146-1717710ab0f8
592026-07-22T05:14:14.687ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 60874, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::d]:57026 req_id = 58af2067-7014-49d5-a383-aea89cd7f022
602026-07-22T05:14:15.473ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 8326, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("0.pool.ntp.org."), ), original: Query { name: Name("0.pool.ntp.org."), query_type: AAAA, query_class: IN, }, }, ], original: [ 1, 48, 4, 112, 111, 111, 108, 3, 110, 116, 112, 3, 111, 114, 103, 0, 0, 28, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "0.pool.ntp.org." peer_addr = [fd00:1122:3344:101::1b]:37494 req_id = 6fb0aef4-21cf-4ddb-a318-4f37b69271b4
612026-07-22T05:14:15.477ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 24006, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("0.pool.ntp.org."), ), original: Query { name: Name("0.pool.ntp.org."), query_type: AAAA, query_class: IN, }, }, ], original: [ 1, 48, 4, 112, 111, 111, 108, 3, 110, 116, 112, 3, 111, 114, 103, 0, 0, 28, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "0.pool.ntp.org." peer_addr = [fd00:1122:3344:101::1b]:61637 req_id = c1613228-89e3-49e6-911c-c156f9f714d6
622026-07-22T05:14:15.482ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 50387, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("0.pool.ntp.org."), ), original: Query { name: Name("0.pool.ntp.org."), query_type: A, query_class: IN, }, }, ], original: [ 1, 48, 4, 112, 111, 111, 108, 3, 110, 116, 112, 3, 111, 114, 103, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "0.pool.ntp.org." peer_addr = [fd00:1122:3344:101::1b]:33006 req_id = 579d77f3-429b-4f33-85b4-c47d0bb69c12
632026-07-22T05:14:24.688ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 42796, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::d]:57876 req_id = d3574eb5-66e1-459a-92c3-863a3a3e0f3d
642026-07-22T05:14:25.760ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:2::1]:5353 remote_addr = [fd00:1122:3344:101::c]:52819
652026-07-22T05:14:25.762ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = 3e4d6f71-02aa-46bc-8563-d61d89a01143
662026-07-22T05:14:25.762ZINFOdns-server (store): updated generation new_generation = 1 req_id = 3e4d6f71-02aa-46bc-8563-d61d89a01143
672026-07-22T05:14:25.762ZINFOdns-server (http): request completed latency_us = 337 local_addr = [fd00:1122:3344:2::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::c]:52819 req_id = 3e4d6f71-02aa-46bc-8563-d61d89a01143 response_code = 204 uri = /config
682026-07-22T05:14:27.204ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:2::1]:5353 remote_addr = [fd00:1122:3344:101::b]:64749
692026-07-22T05:14:27.209ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = 1f912500-3434-40e6-b098-9dd691c941c3
702026-07-22T05:14:27.209ZINFOdns-server (store): updated generation new_generation = 1 req_id = 1f912500-3434-40e6-b098-9dd691c941c3
712026-07-22T05:14:27.209ZINFOdns-server (http): request completed latency_us = 959 local_addr = [fd00:1122:3344:2::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::b]:64749 req_id = 1f912500-3434-40e6-b098-9dd691c941c3 response_code = 204 uri = /config
722026-07-22T05:14:27.490ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:2::1]:5353 remote_addr = [fd00:1122:3344:101::a]:56419
732026-07-22T05:14:27.491ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = 10c534ac-09e8-4817-8497-01a5b16ffa5e
742026-07-22T05:14:27.491ZINFOdns-server (store): updated generation new_generation = 1 req_id = 10c534ac-09e8-4817-8497-01a5b16ffa5e
752026-07-22T05:14:27.491ZINFOdns-server (http): request completed latency_us = 203 local_addr = [fd00:1122:3344:2::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::a]:56419 req_id = 10c534ac-09e8-4817-8497-01a5b16ffa5e response_code = 204 uri = /config
762026-07-22T05:14:27.543ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 12006, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::c]:59426 req_id = d7cedc8e-5a04-44c3-8e68-b49d5ab1cb3a
772026-07-22T05:14:27.651ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:2::1]:5353 remote_addr = [fd00:1122:3344:101::c]:51692
782026-07-22T05:14:27.651ZINFOdns-server (http): request completed latency_us = 196 local_addr = [fd00:1122:3344:2::1]:5353 method = GET remote_addr = [fd00:1122:3344:101::c]:51692 req_id = 57680ed1-f9b8-44e1-925f-d519cfc50d93 response_code = 200 uri = /config
792026-07-22T05:14:28.010ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 41765, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::b]:39564 req_id = ec33153e-69bc-49bd-b6ba-11e4e786f37f
802026-07-22T05:14:28.117ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:2::1]:5353 remote_addr = [fd00:1122:3344:101::b]:50451
812026-07-22T05:14:28.117ZINFOdns-server (http): request completed latency_us = 192 local_addr = [fd00:1122:3344:2::1]:5353 method = GET remote_addr = [fd00:1122:3344:101::b]:50451 req_id = 5981a17c-ae4e-4844-9544-63347ff6a6c6 response_code = 200 uri = /config
822026-07-22T05:14:28.525ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 10223, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::a]:40936 req_id = 00ae3263-cd27-468b-9a6c-faa97d05a2d0
832026-07-22T05:14:28.624ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:2::1]:5353 remote_addr = [fd00:1122:3344:101::a]:63660
842026-07-22T05:14:28.624ZINFOdns-server (http): request completed latency_us = 194 local_addr = [fd00:1122:3344:2::1]:5353 method = GET remote_addr = [fd00:1122:3344:101::a]:63660 req_id = 9cc039fa-888c-42e2-ad7d-465afb22b8cb response_code = 200 uri = /config
852026-07-22T05:14:34.689ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 33940, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::d]:61384 req_id = ba4818b5-6185-4a60-b2d3-daddca4d36e5
862026-07-22T05:14:44.692ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 58935, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::d]:63440 req_id = 19003282-bdec-4024-b91e-c1cbe95059c7
872026-07-22T05:14:54.694ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 48705, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::d]:63984 req_id = 383d6c6a-244f-4db7-9260-c7196c6abe78
882026-07-22T05:15:00.168ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 60635, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_ntp_a3f7922b-9efe-485a-9275-c647c0426b29."), ), original: Query { name: Name("oxz_ntp_a3f7922b-9efe-485a-9275-c647c0426b29."), query_type: A, query_class: IN, }, }, ], original: [ 44, 111, 120, 122, 95, 110, 116, 112, 95, 97, 51, 102, 55, 57, 50, 50, 98, 45, 57, 101, 102, 101, 45, 52, 56, 53, 97, 45, 57, 50, 55, 53, 45, 99, 54, 52, 55, 99, 48, 52, 50, 54, 98, 50, 57, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_ntp_a3f7922b-9efe-485a-9275-c647c0426b29." peer_addr = [fd00:1122:3344:101::1b]:35722 req_id = 1ef4ef8b-190c-40ce-9bb4-e5be06575664
892026-07-22T05:15:00.343ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 56033, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_a5b67cbd-c24b-4893-bbf0-b05a2655d26b."), ), original: Query { name: Name("oxz_cockroachdb_a5b67cbd-c24b-4893-bbf0-b05a2655d26b."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 97, 53, 98, 54, 55, 99, 98, 100, 45, 99, 50, 52, 98, 45, 52, 56, 57, 51, 45, 98, 98, 102, 48, 45, 98, 48, 53, 97, 50, 54, 53, 53, 100, 50, 54, 98, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_a5b67cbd-c24b-4893-bbf0-b05a2655d26b." peer_addr = [fd00:1122:3344:101::5]:37640 req_id = 1a1ce62f-523f-4c37-915c-da7563b802f2
902026-07-22T05:15:00.344ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 56033, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_a5b67cbd-c24b-4893-bbf0-b05a2655d26b."), ), original: Query { name: Name("oxz_cockroachdb_a5b67cbd-c24b-4893-bbf0-b05a2655d26b."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 97, 53, 98, 54, 55, 99, 98, 100, 45, 99, 50, 52, 98, 45, 52, 56, 57, 51, 45, 98, 98, 102, 48, 45, 98, 48, 53, 97, 50, 54, 53, 53, 100, 50, 54, 98, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_a5b67cbd-c24b-4893-bbf0-b05a2655d26b." peer_addr = [fd00:1122:3344:101::5]:34452 req_id = d110bf54-73b8-4804-a35e-230b2c10c7cb
912026-07-22T05:15:00.561ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 39534, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_clickhouse_4a7586df-847e-4e68-b342-0f6dd259d43b."), ), original: Query { name: Name("oxz_clickhouse_4a7586df-847e-4e68-b342-0f6dd259d43b."), query_type: A, query_class: IN, }, }, ], original: [ 51, 111, 120, 122, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 95, 52, 97, 55, 53, 56, 54, 100, 102, 45, 56, 52, 55, 101, 45, 52, 101, 54, 56, 45, 98, 51, 52, 50, 45, 48, 102, 54, 100, 100, 50, 53, 57, 100, 52, 51, 98, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_clickhouse_4a7586df-847e-4e68-b342-0f6dd259d43b." peer_addr = [fd00:1122:3344:101::e]:40834 req_id = fba2a36f-1ee5-47a3-b3e0-967463b8ab1c
922026-07-22T05:15:00.562ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 39534, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_clickhouse_4a7586df-847e-4e68-b342-0f6dd259d43b."), ), original: Query { name: Name("oxz_clickhouse_4a7586df-847e-4e68-b342-0f6dd259d43b."), query_type: A, query_class: IN, }, }, ], original: [ 51, 111, 120, 122, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 95, 52, 97, 55, 53, 56, 54, 100, 102, 45, 56, 52, 55, 101, 45, 52, 101, 54, 56, 45, 98, 51, 52, 50, 45, 48, 102, 54, 100, 100, 50, 53, 57, 100, 52, 51, 98, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_clickhouse_4a7586df-847e-4e68-b342-0f6dd259d43b." peer_addr = [fd00:1122:3344:101::e]:64664 req_id = df2c5223-a14a-4fea-b809-562a3e486f1d
932026-07-22T05:15:00.639ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 38500, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_fd79e3ea-0f70-4057-9cb5-b2c4f9b4eece."), ), original: Query { name: Name("oxz_cockroachdb_fd79e3ea-0f70-4057-9cb5-b2c4f9b4eece."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 102, 100, 55, 57, 101, 51, 101, 97, 45, 48, 102, 55, 48, 45, 52, 48, 53, 55, 45, 57, 99, 98, 53, 45, 98, 50, 99, 52, 102, 57, 98, 52, 101, 101, 99, 101, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_fd79e3ea-0f70-4057-9cb5-b2c4f9b4eece." peer_addr = [fd00:1122:3344:101::7]:59304 req_id = f6be87f9-595f-4736-852d-3ae7b8759e0f
942026-07-22T05:15:00.640ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 38500, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_fd79e3ea-0f70-4057-9cb5-b2c4f9b4eece."), ), original: Query { name: Name("oxz_cockroachdb_fd79e3ea-0f70-4057-9cb5-b2c4f9b4eece."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 102, 100, 55, 57, 101, 51, 101, 97, 45, 48, 102, 55, 48, 45, 52, 48, 53, 55, 45, 57, 99, 98, 53, 45, 98, 50, 99, 52, 102, 57, 98, 52, 101, 101, 99, 101, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_fd79e3ea-0f70-4057-9cb5-b2c4f9b4eece." peer_addr = [fd00:1122:3344:101::7]:55279 req_id = 5fe0097d-cb8f-44c1-891b-bbab08d0bf9a
952026-07-22T05:15:00.663ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 49458, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_002d1189-8ff1-4f60-9145-f770f2390afe."), ), original: Query { name: Name("oxz_cockroachdb_002d1189-8ff1-4f60-9145-f770f2390afe."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 48, 48, 50, 100, 49, 49, 56, 57, 45, 56, 102, 102, 49, 45, 52, 102, 54, 48, 45, 57, 49, 52, 53, 45, 102, 55, 55, 48, 102, 50, 51, 57, 48, 97, 102, 101, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_002d1189-8ff1-4f60-9145-f770f2390afe." peer_addr = [fd00:1122:3344:101::6]:45241 req_id = 66c20947-05de-4ad8-b3f5-1e73ab5fb5f7
962026-07-22T05:15:00.664ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 49458, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_002d1189-8ff1-4f60-9145-f770f2390afe."), ), original: Query { name: Name("oxz_cockroachdb_002d1189-8ff1-4f60-9145-f770f2390afe."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 48, 48, 50, 100, 49, 49, 56, 57, 45, 56, 102, 102, 49, 45, 52, 102, 54, 48, 45, 57, 49, 52, 53, 45, 102, 55, 55, 48, 102, 50, 51, 57, 48, 97, 102, 101, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_002d1189-8ff1-4f60-9145-f770f2390afe." peer_addr = [fd00:1122:3344:101::6]:62703 req_id = 666e472f-84c0-4797-82ae-0afa00e99fc9
972026-07-22T05:15:00.683ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 39937, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_a3b54c57-034c-4617-a02d-6d5c2f97ddf1."), ), original: Query { name: Name("oxz_cockroachdb_a3b54c57-034c-4617-a02d-6d5c2f97ddf1."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 97, 51, 98, 53, 52, 99, 53, 55, 45, 48, 51, 52, 99, 45, 52, 54, 49, 55, 45, 97, 48, 50, 100, 45, 54, 100, 53, 99, 50, 102, 57, 55, 100, 100, 102, 49, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_a3b54c57-034c-4617-a02d-6d5c2f97ddf1." peer_addr = [fd00:1122:3344:101::3]:40420 req_id = dbd5e5a0-13dc-41df-8517-65b46ae9c648
982026-07-22T05:15:00.684ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 39937, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_a3b54c57-034c-4617-a02d-6d5c2f97ddf1."), ), original: Query { name: Name("oxz_cockroachdb_a3b54c57-034c-4617-a02d-6d5c2f97ddf1."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 97, 51, 98, 53, 52, 99, 53, 55, 45, 48, 51, 52, 99, 45, 52, 54, 49, 55, 45, 97, 48, 50, 100, 45, 54, 100, 53, 99, 50, 102, 57, 55, 100, 100, 102, 49, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_a3b54c57-034c-4617-a02d-6d5c2f97ddf1." peer_addr = [fd00:1122:3344:101::3]:39508 req_id = aac50217-e809-436d-be15-1627d84e7b30
992026-07-22T05:15:00.704ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 9074, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_c58a61d2-673f-4583-9358-62e4897b5ed2."), ), original: Query { name: Name("oxz_cockroachdb_c58a61d2-673f-4583-9358-62e4897b5ed2."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 99, 53, 56, 97, 54, 49, 100, 50, 45, 54, 55, 51, 102, 45, 52, 53, 56, 51, 45, 57, 51, 53, 56, 45, 54, 50, 101, 52, 56, 57, 55, 98, 53, 101, 100, 50, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_c58a61d2-673f-4583-9358-62e4897b5ed2." peer_addr = [fd00:1122:3344:101::4]:63831 req_id = 94579a3f-66eb-4de5-b266-bd13f1966b20
1002026-07-22T05:15:00.705ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 9074, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_c58a61d2-673f-4583-9358-62e4897b5ed2."), ), original: Query { name: Name("oxz_cockroachdb_c58a61d2-673f-4583-9358-62e4897b5ed2."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 99, 53, 56, 97, 54, 49, 100, 50, 45, 54, 55, 51, 102, 45, 52, 53, 56, 51, 45, 57, 51, 53, 56, 45, 54, 50, 101, 52, 56, 57, 55, 98, 53, 101, 100, 50, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_c58a61d2-673f-4583-9358-62e4897b5ed2." peer_addr = [fd00:1122:3344:101::4]:57533 req_id = 7ab7e75f-522c-40c6-a095-5257513b7e0a
1012026-07-22T05:15:00.711ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 3496, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_switch."), ), original: Query { name: Name("oxz_switch."), query_type: A, query_class: IN, }, }, ], original: [ 10, 111, 120, 122, 95, 115, 119, 105, 116, 99, 104, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_switch." peer_addr = [fd00:1122:3344:101::2]:63697 req_id = 6c2cbf2b-cb45-487d-8fe1-5a8dbe89fba8
1022026-07-22T05:15:00.712ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 3496, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_switch."), ), original: Query { name: Name("oxz_switch."), query_type: A, query_class: IN, }, }, ], original: [ 10, 111, 120, 122, 95, 115, 119, 105, 116, 99, 104, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_switch." peer_addr = [fd00:1122:3344:101::2]:32966 req_id = d3bfbaf6-d719-4713-85cf-f8b8714184cb