Max level shown:
1 [ Mar 23 20:12:19 Enabled. ]
2 [ Mar 23 20:12:19 Rereading configuration. ]
3 [ Mar 23 20:12:20 Rereading configuration. ]
4 [ Mar 23 20:12:23 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/dns-server/bin/dns-server --config-file /var/svc/manifest/site/internal_dns/config.toml --http-address [fd00:1122:3344:2::1]:5353 --dns-address [fd00:1122:3344:2::1]:53 &"). ]
5 [ Mar 23 20:12:23 Method "start" exited with status 0. ]
6 Config { log: File { level: Info, path: "/dev/stdout", if_exists: Append }, dropshot: ConfigDropshot { bind_address: [fd00:1122:3344:2::1]:5353, default_request_body_max_bytes: 104857600, default_handler_task_mode: Detached, log_headers: [] }, storage: Config { storage_path: "/data/dns", keep_old_generations: 3 } }
7 note: configured to log to "/dev/stdout"
82026-03-23T20:12:23.817ZINFOdns-server: config config = Config { log: File { level: Info, path: "/dev/stdout", if_exists: Append }, dropshot: ConfigDropshot { bind_address: [fd00:1122:3344:2::1]:5353, default_request_body_max_bytes: 104857600, default_handler_task_mode: Detached, log_headers: [] }, storage: Config { storage_path: "/data/dns", keep_old_generations: 3 } } dns_config = Config { bind_address: [fd00:1122:3344:2::1]:53 }
92026-03-23T20:12:23.817ZINFOdns-server (store): opening sled database path = /data/dns
102026-03-23T20:12:23.834ZINFOdns-server (store): pruning trees for generations newer than 0
112026-03-23T20:12:23.834ZINFOdns-server (store): pruning trees for generations older than 0 keep = 3
122026-03-23T20:12:23.834ZINFOdns-server (dns): DNS server bound to address local_address = [fd00:1122:3344:2::1]:53
132026-03-23T20:12:23.835ZINFOdns-server (http): listening local_addr = [fd00:1122:3344:2::1]:5353
142026-03-23T20:12:24.174ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:2::1]:5353 remote_addr = [fd00:1122:3344:2::2]:47566
152026-03-23T20:12:24.175ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = 1f25f33b-fd07-4728-88fb-f2995b07e0b7
162026-03-23T20:12:24.175ZINFOdns-server (store): pruning trees for generations newer than 0
172026-03-23T20:12:24.185ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 41673, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_nexus._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 6, 95, 110, 101, 120, 117, 115, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } SERVFAIL: server is not authoritative for name: "_nexus._tcp.control-plane.oxide.internal." peer_addr = [fd00:1122:3344:2::2]:45302 req_id = 2b8d8787-133d-4030-b9a9-b7f998fdf456
182026-03-23T20:12:24.186ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 3007, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("2eb435d8-caa2-4aaf-a56b-efc535cd1305.host.control-plane.oxide.internal."), ), original: Query { name: Name("2eb435d8-caa2-4aaf-a56b-efc535cd1305.host.control-plane.oxide.internal."), query_type: AAAA, query_class: IN, }, }, ], original: [ 36, 50, 101, 98, 52, 51, 53, 100, 56, 45, 99, 97, 97, 50, 45, 52, 97, 97, 102, 45, 97, 53, 54, 98, 45, 101, 102, 99, 53, 51, 53, 99, 100, 49, 51, 48, 53, 4, 104, 111, 115, 116, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 28, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } SERVFAIL: server is not authoritative for name: "2eb435d8-caa2-4aaf-a56b-efc535cd1305.host.control-plane.oxide.internal." peer_addr = [fd00:1122:3344:2::2]:12835 req_id = cdae6633-5ab5-42a7-a2e9-8e74ecd2fbb7
192026-03-23T20:12:24.186ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 25244, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("0e821eb3-d068-40e3-90c2-87e33b74bdc0.host.control-plane.oxide.internal."), ), original: Query { name: Name("0e821eb3-d068-40e3-90c2-87e33b74bdc0.host.control-plane.oxide.internal."), query_type: AAAA, query_class: IN, }, }, ], original: [ 36, 48, 101, 56, 50, 49, 101, 98, 51, 45, 100, 48, 54, 56, 45, 52, 48, 101, 51, 45, 57, 48, 99, 50, 45, 56, 55, 101, 51, 51, 98, 55, 52, 98, 100, 99, 48, 4, 104, 111, 115, 116, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 28, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } SERVFAIL: server is not authoritative for name: "0e821eb3-d068-40e3-90c2-87e33b74bdc0.host.control-plane.oxide.internal." peer_addr = [fd00:1122:3344:2::2]:1158 req_id = b3f6fb8d-cb8e-401b-ae0f-00b1224d6806
202026-03-23T20:12:24.186ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 36425, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("c64becd6-21a7-4674-a33c-c7caa35d02e0.host.control-plane.oxide.internal."), ), original: Query { name: Name("c64becd6-21a7-4674-a33c-c7caa35d02e0.host.control-plane.oxide.internal."), query_type: AAAA, query_class: IN, }, }, ], original: [ 36, 99, 54, 52, 98, 101, 99, 100, 54, 45, 50, 49, 97, 55, 45, 52, 54, 55, 52, 45, 97, 51, 51, 99, 45, 99, 55, 99, 97, 97, 51, 53, 100, 48, 50, 101, 48, 4, 104, 111, 115, 116, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 28, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } SERVFAIL: server is not authoritative for name: "c64becd6-21a7-4674-a33c-c7caa35d02e0.host.control-plane.oxide.internal." peer_addr = [fd00:1122:3344:2::2]:37314 req_id = d509597a-2fc0-4cce-95f6-222125deca88
212026-03-23T20:12:24.252ZINFOdns-server (store): pruning trees for generations older than 1 keep = 3
222026-03-23T20:12:24.252ZINFOdns-server (store): updated generation new_generation = 1 req_id = 1f25f33b-fd07-4728-88fb-f2995b07e0b7
232026-03-23T20:12:24.252ZINFOdns-server (http): request completed latency_us = 77978 local_addr = [fd00:1122:3344:2::1]:5353 method = PUT remote_addr = [fd00:1122:3344:2::2]:47566 req_id = 1f25f33b-fd07-4728-88fb-f2995b07e0b7 response_code = 204 uri = /config
242026-03-23T20:12:37.183ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 14140, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("0.pool.ntp.org."), ), original: Query { name: Name("0.pool.ntp.org."), query_type: AAAA, query_class: IN, }, }, ], original: [ 1, 48, 4, 112, 111, 111, 108, 3, 110, 116, 112, 3, 111, 114, 103, 0, 0, 28, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "0.pool.ntp.org." peer_addr = [fd00:1122:3344:101::1b]:48094 req_id = 5ba191f3-8674-4404-922c-80f6f57175df
252026-03-23T20:12:37.188ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 48275, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("0.pool.ntp.org."), ), original: Query { name: Name("0.pool.ntp.org."), query_type: AAAA, query_class: IN, }, }, ], original: [ 1, 48, 4, 112, 111, 111, 108, 3, 110, 116, 112, 3, 111, 114, 103, 0, 0, 28, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "0.pool.ntp.org." peer_addr = [fd00:1122:3344:101::1b]:35988 req_id = b459470a-7834-4ee7-9587-84fc217577b7
262026-03-23T20:12:37.192ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 56495, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("0.pool.ntp.org."), ), original: Query { name: Name("0.pool.ntp.org."), query_type: A, query_class: IN, }, }, ], original: [ 1, 48, 4, 112, 111, 111, 108, 3, 110, 116, 112, 3, 111, 114, 103, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "0.pool.ntp.org." peer_addr = [fd00:1122:3344:101::1b]:57751 req_id = ba4efa9d-fbf5-48bd-bd94-d94b2415985e
272026-03-23T20:14:13.685ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 33526, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::d]:52176 req_id = 068a8ebc-8ee5-45ea-94e5-4d37e854a620
282026-03-23T20:14:15.098ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 43332, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_clickhouse_915f754c-f85c-4b65-b293-9f2dc9a61c62."), ), original: Query { name: Name("oxz_clickhouse_915f754c-f85c-4b65-b293-9f2dc9a61c62."), query_type: A, query_class: IN, }, }, ], original: [ 51, 111, 120, 122, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 95, 57, 49, 53, 102, 55, 53, 52, 99, 45, 102, 56, 53, 99, 45, 52, 98, 54, 53, 45, 98, 50, 57, 51, 45, 57, 102, 50, 100, 99, 57, 97, 54, 49, 99, 54, 50, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_clickhouse_915f754c-f85c-4b65-b293-9f2dc9a61c62." peer_addr = [fd00:1122:3344:101::e]:46076 req_id = e9464b01-cfe7-4dc1-a69e-d94fc8fc9f82
292026-03-23T20:14:15.106ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 43332, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_clickhouse_915f754c-f85c-4b65-b293-9f2dc9a61c62."), ), original: Query { name: Name("oxz_clickhouse_915f754c-f85c-4b65-b293-9f2dc9a61c62."), query_type: A, query_class: IN, }, }, ], original: [ 51, 111, 120, 122, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 95, 57, 49, 53, 102, 55, 53, 52, 99, 45, 102, 56, 53, 99, 45, 52, 98, 54, 53, 45, 98, 50, 57, 51, 45, 57, 102, 50, 100, 99, 57, 97, 54, 49, 99, 54, 50, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_clickhouse_915f754c-f85c-4b65-b293-9f2dc9a61c62." peer_addr = [fd00:1122:3344:101::e]:46042 req_id = e9a82503-2f5e-4ba7-9238-048c78bac242
302026-03-23T20:14:21.183ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 48650, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::a]:29392 req_id = 24f2fe37-563d-4314-afa1-c54de8cb908a
312026-03-23T20:14:22.163ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 6068, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::c]:7042 req_id = 46fc9850-2165-4b35-a7a3-66b03d26beb4
322026-03-23T20:14:22.196ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 39401, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::b]:16698 req_id = 8ef819e3-46bf-486f-b26b-b08923cfab54
332026-03-23T20:14:23.648ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 38062, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::d]:52579 req_id = fc44cede-1e89-46fb-9c32-4cb1780b74f8
342026-03-23T20:14:33.650ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 11562, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::d]:54956 req_id = 95aed2d8-90c9-4067-b1c8-b0efdca9f106
352026-03-23T20:14:36.516ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 35351, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("0.pool.ntp.org."), ), original: Query { name: Name("0.pool.ntp.org."), query_type: AAAA, query_class: IN, }, }, ], original: [ 1, 48, 4, 112, 111, 111, 108, 3, 110, 116, 112, 3, 111, 114, 103, 0, 0, 28, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "0.pool.ntp.org." peer_addr = [fd00:1122:3344:101::1b]:49677 req_id = fec644d7-8b36-43d7-a8e7-d64b2e2f4736
362026-03-23T20:14:36.522ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 23563, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("0.pool.ntp.org."), ), original: Query { name: Name("0.pool.ntp.org."), query_type: AAAA, query_class: IN, }, }, ], original: [ 1, 48, 4, 112, 111, 111, 108, 3, 110, 116, 112, 3, 111, 114, 103, 0, 0, 28, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "0.pool.ntp.org." peer_addr = [fd00:1122:3344:101::1b]:55670 req_id = 29870b42-0aec-4475-84a8-bd1c022b997d
372026-03-23T20:14:36.526ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 56472, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("0.pool.ntp.org."), ), original: Query { name: Name("0.pool.ntp.org."), query_type: A, query_class: IN, }, }, ], original: [ 1, 48, 4, 112, 111, 111, 108, 3, 110, 116, 112, 3, 111, 114, 103, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "0.pool.ntp.org." peer_addr = [fd00:1122:3344:101::1b]:50137 req_id = 9b0ab3ba-6435-4256-8e63-8c3df9f93298
382026-03-23T20:14:41.151ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 34906, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::a]:27196 req_id = 2869f23b-e4c8-4748-9739-29ecd4871b6b
392026-03-23T20:14:41.557ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:2::1]:5353 remote_addr = [fd00:1122:3344:101::a]:38284
402026-03-23T20:14:41.633ZINFOdns-server (http): request completed latency_us = 43187 local_addr = [fd00:1122:3344:2::1]:5353 method = GET remote_addr = [fd00:1122:3344:101::a]:38284 req_id = c233bcdd-95f0-4f56-8cd8-d334e9757580 response_code = 200 uri = /config
412026-03-23T20:14:43.602ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:2::1]:5353 remote_addr = [fd00:1122:3344:101::a]:39882
422026-03-23T20:14:43.606ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = 2fb5786f-06ec-4858-a752-eaa8cb5e2eae
432026-03-23T20:14:43.606ZINFOdns-server (store): updated generation new_generation = 1 req_id = 2fb5786f-06ec-4858-a752-eaa8cb5e2eae
442026-03-23T20:14:43.606ZINFOdns-server (http): request completed latency_us = 3146 local_addr = [fd00:1122:3344:2::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::a]:39882 req_id = 2fb5786f-06ec-4858-a752-eaa8cb5e2eae response_code = 204 uri = /config
452026-03-23T20:14:43.652ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 47540, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::d]:57083 req_id = a09ae8f5-950c-437e-bce5-1e5871ebf702
462026-03-23T20:14:43.843ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 62597, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::a]:42637 req_id = 1d7661aa-a60f-4b06-a281-1ce85e361557
472026-03-23T20:14:43.954ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:2::1]:5353 remote_addr = [fd00:1122:3344:101::a]:33412
482026-03-23T20:14:43.954ZINFOdns-server (http): request completed latency_us = 184 local_addr = [fd00:1122:3344:2::1]:5353 method = GET remote_addr = [fd00:1122:3344:101::a]:33412 req_id = e71b4999-d083-46d9-9809-7d92d6d84489 response_code = 200 uri = /config
492026-03-23T20:14:44.406ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 9281, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::a]:65334 req_id = 0c19432f-6636-49a9-88c5-b027b3452b1c
502026-03-23T20:14:44.528ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:2::1]:5353 remote_addr = [fd00:1122:3344:101::a]:60396
512026-03-23T20:14:44.528ZINFOdns-server (http): request completed latency_us = 249 local_addr = [fd00:1122:3344:2::1]:5353 method = GET remote_addr = [fd00:1122:3344:101::a]:60396 req_id = ad5d12ea-a973-46d9-bb00-058adbeff73a response_code = 200 uri = /config
522026-03-23T20:14:52.815ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 45042, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::b]:53284 req_id = 4d7543bf-5b84-417f-b906-87a2c70f4eb7
532026-03-23T20:14:52.870ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 45176, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::c]:4957 req_id = df08e7da-9403-454c-a390-388879409dc8
542026-03-23T20:14:52.929ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:2::1]:5353 remote_addr = [fd00:1122:3344:101::b]:38956
552026-03-23T20:14:52.929ZINFOdns-server (http): request completed latency_us = 282 local_addr = [fd00:1122:3344:2::1]:5353 method = GET remote_addr = [fd00:1122:3344:101::b]:38956 req_id = c6fce55f-e639-4df8-86ae-2fc318972fa9 response_code = 200 uri = /config
562026-03-23T20:14:52.983ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:2::1]:5353 remote_addr = [fd00:1122:3344:101::c]:65112
572026-03-23T20:14:52.983ZINFOdns-server (http): request completed latency_us = 199 local_addr = [fd00:1122:3344:2::1]:5353 method = GET remote_addr = [fd00:1122:3344:101::c]:65112 req_id = a76ed2b6-e9b9-4904-88ac-f27f635ac861 response_code = 200 uri = /config
582026-03-23T20:14:53.654ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 35017, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::d]:64630 req_id = ba7dd8c0-acdc-4f57-bda0-897939e7e948
592026-03-23T20:15:00.075ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 26936, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_88d90769-b275-4a7e-8051-61e328a0636e."), ), original: Query { name: Name("oxz_cockroachdb_88d90769-b275-4a7e-8051-61e328a0636e."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 56, 56, 100, 57, 48, 55, 54, 57, 45, 98, 50, 55, 53, 45, 52, 97, 55, 101, 45, 56, 48, 53, 49, 45, 54, 49, 101, 51, 50, 56, 97, 48, 54, 51, 54, 101, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_88d90769-b275-4a7e-8051-61e328a0636e." peer_addr = [fd00:1122:3344:101::3]:65418 req_id = c9a5e2d0-4d27-495f-9391-bca434142bc8
602026-03-23T20:15:00.075ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 23512, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_7f5dd3bb-a5b5-43e8-ab34-b5f79f443e40."), ), original: Query { name: Name("oxz_cockroachdb_7f5dd3bb-a5b5-43e8-ab34-b5f79f443e40."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 55, 102, 53, 100, 100, 51, 98, 98, 45, 97, 53, 98, 53, 45, 52, 51, 101, 56, 45, 97, 98, 51, 52, 45, 98, 53, 102, 55, 57, 102, 52, 52, 51, 101, 52, 48, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_7f5dd3bb-a5b5-43e8-ab34-b5f79f443e40." peer_addr = [fd00:1122:3344:101::5]:38117 req_id = fc87e3ae-6f2e-445f-87cd-654f317508fb
612026-03-23T20:15:00.075ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 23512, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_7f5dd3bb-a5b5-43e8-ab34-b5f79f443e40."), ), original: Query { name: Name("oxz_cockroachdb_7f5dd3bb-a5b5-43e8-ab34-b5f79f443e40."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 55, 102, 53, 100, 100, 51, 98, 98, 45, 97, 53, 98, 53, 45, 52, 51, 101, 56, 45, 97, 98, 51, 52, 45, 98, 53, 102, 55, 57, 102, 52, 52, 51, 101, 52, 48, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_7f5dd3bb-a5b5-43e8-ab34-b5f79f443e40." peer_addr = [fd00:1122:3344:101::5]:42028 req_id = 7ecf4e40-2288-40f0-9d1a-e5c0411eb98e
622026-03-23T20:15:00.075ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 26936, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_88d90769-b275-4a7e-8051-61e328a0636e."), ), original: Query { name: Name("oxz_cockroachdb_88d90769-b275-4a7e-8051-61e328a0636e."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 56, 56, 100, 57, 48, 55, 54, 57, 45, 98, 50, 55, 53, 45, 52, 97, 55, 101, 45, 56, 48, 53, 49, 45, 54, 49, 101, 51, 50, 56, 97, 48, 54, 51, 54, 101, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_88d90769-b275-4a7e-8051-61e328a0636e." peer_addr = [fd00:1122:3344:101::3]:40685 req_id = e7005575-d972-4c35-ab70-9377674f3f31
632026-03-23T20:15:00.091ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 35745, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_ntp_b1919362-9527-447b-a072-844e0792047f."), ), original: Query { name: Name("oxz_ntp_b1919362-9527-447b-a072-844e0792047f."), query_type: A, query_class: IN, }, }, ], original: [ 44, 111, 120, 122, 95, 110, 116, 112, 95, 98, 49, 57, 49, 57, 51, 54, 50, 45, 57, 53, 50, 55, 45, 52, 52, 55, 98, 45, 97, 48, 55, 50, 45, 56, 52, 52, 101, 48, 55, 57, 50, 48, 52, 55, 102, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_ntp_b1919362-9527-447b-a072-844e0792047f." peer_addr = [fd00:1122:3344:101::1b]:39056 req_id = 5348ac7e-6cbb-4cfd-ae67-0102bfca4c9a
642026-03-23T20:15:00.146ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 16232, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_0aa86c51-dcf9-4eec-9197-c35878881766."), ), original: Query { name: Name("oxz_cockroachdb_0aa86c51-dcf9-4eec-9197-c35878881766."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 48, 97, 97, 56, 54, 99, 53, 49, 45, 100, 99, 102, 57, 45, 52, 101, 101, 99, 45, 57, 49, 57, 55, 45, 99, 51, 53, 56, 55, 56, 56, 56, 49, 55, 54, 54, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_0aa86c51-dcf9-4eec-9197-c35878881766." peer_addr = [fd00:1122:3344:101::7]:51423 req_id = d13dd362-6cbe-4c63-b6da-23a5b79c7a56
652026-03-23T20:15:00.146ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 16232, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_0aa86c51-dcf9-4eec-9197-c35878881766."), ), original: Query { name: Name("oxz_cockroachdb_0aa86c51-dcf9-4eec-9197-c35878881766."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 48, 97, 97, 56, 54, 99, 53, 49, 45, 100, 99, 102, 57, 45, 52, 101, 101, 99, 45, 57, 49, 57, 55, 45, 99, 51, 53, 56, 55, 56, 56, 56, 49, 55, 54, 54, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_0aa86c51-dcf9-4eec-9197-c35878881766." peer_addr = [fd00:1122:3344:101::7]:37215 req_id = ee7e6f48-94b0-4222-a2d8-3bbddd50e41e
662026-03-23T20:15:00.404ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 34304, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_switch."), ), original: Query { name: Name("oxz_switch."), query_type: A, query_class: IN, }, }, ], original: [ 10, 111, 120, 122, 95, 115, 119, 105, 116, 99, 104, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_switch." peer_addr = [fd00:1122:3344:101::2]:41705 req_id = 72f15f40-7593-4c4a-90bf-9672fa920f96
672026-03-23T20:15:00.405ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 34304, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_switch."), ), original: Query { name: Name("oxz_switch."), query_type: A, query_class: IN, }, }, ], original: [ 10, 111, 120, 122, 95, 115, 119, 105, 116, 99, 104, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_switch." peer_addr = [fd00:1122:3344:101::2]:48585 req_id = 4b88cea5-c309-42bb-9dca-e20549767c40