Max level shown:
1 [ May 4 19:27:24 Enabled. ]
2 [ May 4 19:27:24 Rereading configuration. ]
3 [ May 4 19:27:24 Rereading configuration. ]
4 [ May 4 19:27:25 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/dns-server/bin/dns-server --config-file /var/svc/manifest/site/internal_dns/config.toml --http-address [fd00:1122:3344:3::1]:5353 --dns-address [fd00:1122:3344:3::1]:53 &"). ]
5 [ May 4 19:27:25 Method "start" exited with status 0. ]
6 Config { log: File { level: Info, path: "/dev/stdout", if_exists: Append }, dropshot: ConfigDropshot { bind_address: [fd00:1122:3344:3::1]:5353, default_request_body_max_bytes: 104857600, default_handler_task_mode: Detached, log_headers: [], compression: None }, storage: Config { storage_path: "/data/dns", keep_old_generations: 3 } }
7 note: configured to log to "/dev/stdout"
82026-05-04T19:27:25.904ZINFOdns-server: config config = Config { log: File { level: Info, path: "/dev/stdout", if_exists: Append }, dropshot: ConfigDropshot { bind_address: [fd00:1122:3344:3::1]:5353, default_request_body_max_bytes: 104857600, default_handler_task_mode: Detached, log_headers: [], compression: None }, storage: Config { storage_path: "/data/dns", keep_old_generations: 3 } } dns_config = Config { bind_address: [fd00:1122:3344:3::1]:53 }
92026-05-04T19:27:25.904ZINFOdns-server (store): opening sled database path = /data/dns
102026-05-04T19:27:25.926ZINFOdns-server (store): pruning trees for generations newer than 0
112026-05-04T19:27:25.926ZINFOdns-server (store): pruning trees for generations older than 0 keep = 3
122026-05-04T19:27:25.926ZINFOdns-server (dns): DNS server bound to address local_address = [fd00:1122:3344:3::1]:53
132026-05-04T19:27:25.927ZINFOdns-server (http): listening local_addr = [fd00:1122:3344:3::1]:5353
142026-05-04T19:27:25.969ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:3::1]:5353 remote_addr = [fd00:1122:3344:3::2]:40046
152026-05-04T19:27:25.970ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = 49b0d852-6b51-41f8-8ed4-aeff73c5e91d
162026-05-04T19:27:25.970ZINFOdns-server (store): pruning trees for generations newer than 0
172026-05-04T19:27:25.995ZINFOdns-server (store): pruning trees for generations older than 1 keep = 3
182026-05-04T19:27:25.995ZINFOdns-server (store): updated generation new_generation = 1 req_id = 49b0d852-6b51-41f8-8ed4-aeff73c5e91d
192026-05-04T19:27:25.995ZINFOdns-server (http): request completed latency_us = 25034 local_addr = [fd00:1122:3344:3::1]:5353 method = PUT remote_addr = [fd00:1122:3344:3::2]:40046 req_id = 49b0d852-6b51-41f8-8ed4-aeff73c5e91d response_code = 204 uri = /config
202026-05-04T19:27:37.033ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 14072, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("0.pool.ntp.org."), ), original: Query { name: Name("0.pool.ntp.org."), query_type: AAAA, query_class: IN, }, }, ], original: [ 1, 48, 4, 112, 111, 111, 108, 3, 110, 116, 112, 3, 111, 114, 103, 0, 0, 28, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "0.pool.ntp.org." peer_addr = [fd00:1122:3344:101::1b]:40331 req_id = 8211c8e6-7ef5-40b6-9127-6fed45d86889
212026-05-04T19:27:37.038ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 16013, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("0.pool.ntp.org."), ), original: Query { name: Name("0.pool.ntp.org."), query_type: AAAA, query_class: IN, }, }, ], original: [ 1, 48, 4, 112, 111, 111, 108, 3, 110, 116, 112, 3, 111, 114, 103, 0, 0, 28, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "0.pool.ntp.org." peer_addr = [fd00:1122:3344:101::1b]:59014 req_id = 8cbffea7-a1ca-4a3c-ba97-2388c37875c2
222026-05-04T19:27:37.042ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 64206, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("0.pool.ntp.org."), ), original: Query { name: Name("0.pool.ntp.org."), query_type: A, query_class: IN, }, }, ], original: [ 1, 48, 4, 112, 111, 111, 108, 3, 110, 116, 112, 3, 111, 114, 103, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "0.pool.ntp.org." peer_addr = [fd00:1122:3344:101::1b]:37511 req_id = 693d6b22-c8cc-432f-a689-2be42a74e9b7
232026-05-04T19:29:16.672ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 21763, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("0.pool.ntp.org."), ), original: Query { name: Name("0.pool.ntp.org."), query_type: AAAA, query_class: IN, }, }, ], original: [ 1, 48, 4, 112, 111, 111, 108, 3, 110, 116, 112, 3, 111, 114, 103, 0, 0, 28, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "0.pool.ntp.org." peer_addr = [fd00:1122:3344:101::1b]:54444 req_id = b73aa01b-796c-4ef6-8247-1644398bc99f
242026-05-04T19:29:16.678ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 64665, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("0.pool.ntp.org."), ), original: Query { name: Name("0.pool.ntp.org."), query_type: AAAA, query_class: IN, }, }, ], original: [ 1, 48, 4, 112, 111, 111, 108, 3, 110, 116, 112, 3, 111, 114, 103, 0, 0, 28, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "0.pool.ntp.org." peer_addr = [fd00:1122:3344:101::1b]:39067 req_id = af55578e-3e39-4c06-b6bc-cc9c63c5843f
252026-05-04T19:29:16.678ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 56937, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("0.pool.ntp.org."), ), original: Query { name: Name("0.pool.ntp.org."), query_type: A, query_class: IN, }, }, ], original: [ 1, 48, 4, 112, 111, 111, 108, 3, 110, 116, 112, 3, 111, 114, 103, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "0.pool.ntp.org." peer_addr = [fd00:1122:3344:101::1b]:57505 req_id = b53d7f36-bba8-41ef-a66a-cf05d017f794
262026-05-04T19:29:29.505ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 24323, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::d]:59498 req_id = d710c2a2-ae5c-42ec-941f-4b1035e0c908
272026-05-04T19:29:39.506ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 30285, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::d]:59357 req_id = e3bf8d6a-fd1d-47be-94ca-d192c57f39dc
282026-05-04T19:29:40.404ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 37385, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::a]:41701 req_id = 4ddd6fe6-170d-4e6a-bc2d-7f0121bbe7f6
292026-05-04T19:29:40.423ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 19696, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::c]:8402 req_id = 4c0a53da-99f5-4a4d-9ae6-e0e0713a9ae9
302026-05-04T19:29:40.488ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 34349, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::b]:46805 req_id = b1e424dd-7fe6-4842-add7-1bfaca7d5f95
312026-05-04T19:29:46.177ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 56555, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::c]:33520 req_id = 73946997-d50d-4dae-a546-781d86ce1f6e
322026-05-04T19:29:46.676ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:3::1]:5353 remote_addr = [fd00:1122:3344:101::c]:41231
332026-05-04T19:29:46.942ZINFOdns-server (http): request completed latency_us = 187543 local_addr = [fd00:1122:3344:3::1]:5353 method = GET remote_addr = [fd00:1122:3344:101::c]:41231 req_id = 6ac814eb-9f1e-413a-9e5f-4d5927438dc2 response_code = 200 uri = /config
342026-05-04T19:29:47.048ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:3::1]:5353 remote_addr = [fd00:1122:3344:101::c]:51912
352026-05-04T19:29:47.052ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = 5b9a5566-985a-4992-8961-cc0e56e30029
362026-05-04T19:29:47.052ZINFOdns-server (store): updated generation new_generation = 1 req_id = 5b9a5566-985a-4992-8961-cc0e56e30029
372026-05-04T19:29:47.052ZINFOdns-server (http): request completed latency_us = 2530 local_addr = [fd00:1122:3344:3::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::c]:51912 req_id = 5b9a5566-985a-4992-8961-cc0e56e30029 response_code = 204 uri = /config
382026-05-04T19:29:47.731ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 13929, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::c]:22162 req_id = 2b56dd68-3f86-41da-915b-c4c6a3fc6afc
392026-05-04T19:29:47.768ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 44248, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_clickhouse_445888ac-0a47-4d7e-bafb-56ece110f8ed."), ), original: Query { name: Name("oxz_clickhouse_445888ac-0a47-4d7e-bafb-56ece110f8ed."), query_type: A, query_class: IN, }, }, ], original: [ 51, 111, 120, 122, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 95, 52, 52, 53, 56, 56, 56, 97, 99, 45, 48, 97, 52, 55, 45, 52, 100, 55, 101, 45, 98, 97, 102, 98, 45, 53, 54, 101, 99, 101, 49, 49, 48, 102, 56, 101, 100, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_clickhouse_445888ac-0a47-4d7e-bafb-56ece110f8ed." peer_addr = [fd00:1122:3344:101::e]:64768 req_id = cdf06c93-5925-4d31-946b-1ed483f06cd9
402026-05-04T19:29:47.768ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 44248, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_clickhouse_445888ac-0a47-4d7e-bafb-56ece110f8ed."), ), original: Query { name: Name("oxz_clickhouse_445888ac-0a47-4d7e-bafb-56ece110f8ed."), query_type: A, query_class: IN, }, }, ], original: [ 51, 111, 120, 122, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 95, 52, 52, 53, 56, 56, 56, 97, 99, 45, 48, 97, 52, 55, 45, 52, 100, 55, 101, 45, 98, 97, 102, 98, 45, 53, 54, 101, 99, 101, 49, 49, 48, 102, 56, 101, 100, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_clickhouse_445888ac-0a47-4d7e-bafb-56ece110f8ed." peer_addr = [fd00:1122:3344:101::e]:57709 req_id = 7182292b-faf0-4946-aa27-9d582be8428b
412026-05-04T19:29:47.849ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:3::1]:5353 remote_addr = [fd00:1122:3344:101::c]:43238
422026-05-04T19:29:47.850ZINFOdns-server (http): request completed latency_us = 214 local_addr = [fd00:1122:3344:3::1]:5353 method = GET remote_addr = [fd00:1122:3344:101::c]:43238 req_id = f80f5623-a4df-49ba-b585-9fda26efd4d8 response_code = 200 uri = /config
432026-05-04T19:29:48.801ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 54403, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::c]:44407 req_id = 1325111e-3a85-442f-8607-b444cbffc469
442026-05-04T19:29:48.916ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:3::1]:5353 remote_addr = [fd00:1122:3344:101::c]:39384
452026-05-04T19:29:48.917ZINFOdns-server (http): request completed latency_us = 214 local_addr = [fd00:1122:3344:3::1]:5353 method = GET remote_addr = [fd00:1122:3344:101::c]:39384 req_id = dff058a9-9c3b-4b19-9200-76e2ae47499f response_code = 200 uri = /config
462026-05-04T19:29:49.508ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 28350, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::d]:53220 req_id = 8e4d30b8-8f60-49a8-bf97-9829622ea198
472026-05-04T19:29:51.045ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 38874, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::b]:24982 req_id = e82386a8-903c-4834-867e-a27f2b663565
482026-05-04T19:29:51.051ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 1946, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::a]:60970 req_id = 11e82cbb-199a-4d3a-b667-72b84a9347bf
492026-05-04T19:29:51.186ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:3::1]:5353 remote_addr = [fd00:1122:3344:101::a]:45986
502026-05-04T19:29:51.186ZINFOdns-server (http): request completed latency_us = 214 local_addr = [fd00:1122:3344:3::1]:5353 method = GET remote_addr = [fd00:1122:3344:101::a]:45986 req_id = 33499920-9097-4134-88e1-17c95439e8ec response_code = 200 uri = /config
512026-05-04T19:29:51.270ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:3::1]:5353 remote_addr = [fd00:1122:3344:101::b]:43084
522026-05-04T19:29:51.270ZINFOdns-server (http): request completed latency_us = 245 local_addr = [fd00:1122:3344:3::1]:5353 method = GET remote_addr = [fd00:1122:3344:101::b]:43084 req_id = eee371af-4365-4f65-b530-557fe18d21c8 response_code = 200 uri = /config
532026-05-04T19:29:59.511ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 49138, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::d]:59309 req_id = 7bce1263-a0ac-40bb-b5fc-946a09da45d7
542026-05-04T19:30:00.143ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 28573, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_switch."), ), original: Query { name: Name("oxz_switch."), query_type: A, query_class: IN, }, }, ], original: [ 10, 111, 120, 122, 95, 115, 119, 105, 116, 99, 104, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_switch." peer_addr = [fd00:1122:3344:101::2]:47973 req_id = d6f0abdf-2af9-41d9-b1a9-5a572f6a606e
552026-05-04T19:30:00.143ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 28573, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_switch."), ), original: Query { name: Name("oxz_switch."), query_type: A, query_class: IN, }, }, ], original: [ 10, 111, 120, 122, 95, 115, 119, 105, 116, 99, 104, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_switch." peer_addr = [fd00:1122:3344:101::2]:63951 req_id = a1e0770a-ea20-4b5d-8f2e-84b5a22eb7f2
562026-05-04T19:30:00.157ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 27703, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_ntp_d6b8092d-6994-4c38-9183-a24282fd4d1f."), ), original: Query { name: Name("oxz_ntp_d6b8092d-6994-4c38-9183-a24282fd4d1f."), query_type: A, query_class: IN, }, }, ], original: [ 44, 111, 120, 122, 95, 110, 116, 112, 95, 100, 54, 98, 56, 48, 57, 50, 100, 45, 54, 57, 57, 52, 45, 52, 99, 51, 56, 45, 57, 49, 56, 51, 45, 97, 50, 52, 50, 56, 50, 102, 100, 52, 100, 49, 102, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_ntp_d6b8092d-6994-4c38-9183-a24282fd4d1f." peer_addr = [fd00:1122:3344:101::1b]:45563 req_id = 024a9066-8b32-4eb4-bba7-810f66ae4c5f
572026-05-04T19:30:00.167ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 14797, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_e43d741a-4899-4c03-bfea-7d3a6d8e45dc."), ), original: Query { name: Name("oxz_cockroachdb_e43d741a-4899-4c03-bfea-7d3a6d8e45dc."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 101, 52, 51, 100, 55, 52, 49, 97, 45, 52, 56, 57, 57, 45, 52, 99, 48, 51, 45, 98, 102, 101, 97, 45, 55, 100, 51, 97, 54, 100, 56, 101, 52, 53, 100, 99, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_e43d741a-4899-4c03-bfea-7d3a6d8e45dc." peer_addr = [fd00:1122:3344:101::4]:35031 req_id = 291d122f-b684-44ec-bb79-ed4d8b88dfbe
582026-05-04T19:30:00.167ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 14797, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_e43d741a-4899-4c03-bfea-7d3a6d8e45dc."), ), original: Query { name: Name("oxz_cockroachdb_e43d741a-4899-4c03-bfea-7d3a6d8e45dc."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 101, 52, 51, 100, 55, 52, 49, 97, 45, 52, 56, 57, 57, 45, 52, 99, 48, 51, 45, 98, 102, 101, 97, 45, 55, 100, 51, 97, 54, 100, 56, 101, 52, 53, 100, 99, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_e43d741a-4899-4c03-bfea-7d3a6d8e45dc." peer_addr = [fd00:1122:3344:101::4]:51902 req_id = dbf24829-fbea-46a3-b6cc-50acbd2d1b99
592026-05-04T19:30:00.323ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 22687, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_a2f6d87c-f2f7-4fa4-9841-abe49e2e2a4a."), ), original: Query { name: Name("oxz_cockroachdb_a2f6d87c-f2f7-4fa4-9841-abe49e2e2a4a."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 97, 50, 102, 54, 100, 56, 55, 99, 45, 102, 50, 102, 55, 45, 52, 102, 97, 52, 45, 57, 56, 52, 49, 45, 97, 98, 101, 52, 57, 101, 50, 101, 50, 97, 52, 97, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_a2f6d87c-f2f7-4fa4-9841-abe49e2e2a4a." peer_addr = [fd00:1122:3344:101::5]:42629 req_id = 8bc7814e-efc1-4c69-abd0-9b69e44108bb
602026-05-04T19:30:00.324ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 22687, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_a2f6d87c-f2f7-4fa4-9841-abe49e2e2a4a."), ), original: Query { name: Name("oxz_cockroachdb_a2f6d87c-f2f7-4fa4-9841-abe49e2e2a4a."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 97, 50, 102, 54, 100, 56, 55, 99, 45, 102, 50, 102, 55, 45, 52, 102, 97, 52, 45, 57, 56, 52, 49, 45, 97, 98, 101, 52, 57, 101, 50, 101, 50, 97, 52, 97, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_a2f6d87c-f2f7-4fa4-9841-abe49e2e2a4a." peer_addr = [fd00:1122:3344:101::5]:49208 req_id = 5966b44a-2e04-4e55-8f2c-34df8a2854a3
612026-05-04T19:30:00.701ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 58126, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_f0515ae7-21d1-40e1-ad87-737dee42347d."), ), original: Query { name: Name("oxz_cockroachdb_f0515ae7-21d1-40e1-ad87-737dee42347d."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 102, 48, 53, 49, 53, 97, 101, 55, 45, 50, 49, 100, 49, 45, 52, 48, 101, 49, 45, 97, 100, 56, 55, 45, 55, 51, 55, 100, 101, 101, 52, 50, 51, 52, 55, 100, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_f0515ae7-21d1-40e1-ad87-737dee42347d." peer_addr = [fd00:1122:3344:101::6]:47360 req_id = 504fe3a0-d069-4e47-a259-a88c1d481840
622026-05-04T19:30:00.702ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 58126, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_f0515ae7-21d1-40e1-ad87-737dee42347d."), ), original: Query { name: Name("oxz_cockroachdb_f0515ae7-21d1-40e1-ad87-737dee42347d."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 102, 48, 53, 49, 53, 97, 101, 55, 45, 50, 49, 100, 49, 45, 52, 48, 101, 49, 45, 97, 100, 56, 55, 45, 55, 51, 55, 100, 101, 101, 52, 50, 51, 52, 55, 100, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_f0515ae7-21d1-40e1-ad87-737dee42347d." peer_addr = [fd00:1122:3344:101::6]:60857 req_id = 251d5373-8ccb-4418-a8eb-7b4c11f68d5f
632026-05-04T19:30:00.730ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 21664, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_clickhouse_445888ac-0a47-4d7e-bafb-56ece110f8ed."), ), original: Query { name: Name("oxz_clickhouse_445888ac-0a47-4d7e-bafb-56ece110f8ed."), query_type: A, query_class: IN, }, }, ], original: [ 51, 111, 120, 122, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 95, 52, 52, 53, 56, 56, 56, 97, 99, 45, 48, 97, 52, 55, 45, 52, 100, 55, 101, 45, 98, 97, 102, 98, 45, 53, 54, 101, 99, 101, 49, 49, 48, 102, 56, 101, 100, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_clickhouse_445888ac-0a47-4d7e-bafb-56ece110f8ed." peer_addr = [fd00:1122:3344:101::e]:59252 req_id = bb221117-49e7-48df-84be-e7d4c086f206
642026-05-04T19:30:00.731ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 21664, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_clickhouse_445888ac-0a47-4d7e-bafb-56ece110f8ed."), ), original: Query { name: Name("oxz_clickhouse_445888ac-0a47-4d7e-bafb-56ece110f8ed."), query_type: A, query_class: IN, }, }, ], original: [ 51, 111, 120, 122, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 95, 52, 52, 53, 56, 56, 56, 97, 99, 45, 48, 97, 52, 55, 45, 52, 100, 55, 101, 45, 98, 97, 102, 98, 45, 53, 54, 101, 99, 101, 49, 49, 48, 102, 56, 101, 100, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_clickhouse_445888ac-0a47-4d7e-bafb-56ece110f8ed." peer_addr = [fd00:1122:3344:101::e]:55026 req_id = 339f56fd-ff05-4a47-87b1-7fa3bf094137
652026-05-04T19:30:00.959ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 31393, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_d177398b-9e5a-4786-8584-7a7710a4e531."), ), original: Query { name: Name("oxz_cockroachdb_d177398b-9e5a-4786-8584-7a7710a4e531."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 100, 49, 55, 55, 51, 57, 56, 98, 45, 57, 101, 53, 97, 45, 52, 55, 56, 54, 45, 56, 53, 56, 52, 45, 55, 97, 55, 55, 49, 48, 97, 52, 101, 53, 51, 49, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_d177398b-9e5a-4786-8584-7a7710a4e531." peer_addr = [fd00:1122:3344:101::7]:63959 req_id = 9f72c0f1-34b5-4458-be38-0be54511cb95
662026-05-04T19:30:00.960ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 31393, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_d177398b-9e5a-4786-8584-7a7710a4e531."), ), original: Query { name: Name("oxz_cockroachdb_d177398b-9e5a-4786-8584-7a7710a4e531."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 100, 49, 55, 55, 51, 57, 56, 98, 45, 57, 101, 53, 97, 45, 52, 55, 56, 54, 45, 56, 53, 56, 52, 45, 55, 97, 55, 55, 49, 48, 97, 52, 101, 53, 51, 49, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_d177398b-9e5a-4786-8584-7a7710a4e531." peer_addr = [fd00:1122:3344:101::7]:49346 req_id = fd69525b-79f1-44e4-b1af-87218491d3bb
672026-05-04T19:30:00.966ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 48284, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_8d12d1c3-f01c-4597-b792-a057781d2d3a."), ), original: Query { name: Name("oxz_cockroachdb_8d12d1c3-f01c-4597-b792-a057781d2d3a."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 56, 100, 49, 50, 100, 49, 99, 51, 45, 102, 48, 49, 99, 45, 52, 53, 57, 55, 45, 98, 55, 57, 50, 45, 97, 48, 53, 55, 55, 56, 49, 100, 50, 100, 51, 97, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_8d12d1c3-f01c-4597-b792-a057781d2d3a." peer_addr = [fd00:1122:3344:101::3]:61708 req_id = be53d405-4a15-40e7-98c3-8929436af8be
682026-05-04T19:30:00.967ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 48284, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_8d12d1c3-f01c-4597-b792-a057781d2d3a."), ), original: Query { name: Name("oxz_cockroachdb_8d12d1c3-f01c-4597-b792-a057781d2d3a."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 56, 100, 49, 50, 100, 49, 99, 51, 45, 102, 48, 49, 99, 45, 52, 53, 57, 55, 45, 98, 55, 57, 50, 45, 97, 48, 53, 55, 55, 56, 49, 100, 50, 100, 51, 97, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_8d12d1c3-f01c-4597-b792-a057781d2d3a." peer_addr = [fd00:1122:3344:101::3]:60186 req_id = e97d83ec-b6d4-460a-ae43-b39728a0813a